WO2013178129A1 - Voice scrawling implementation method, device and terminal - Google Patents

Description

 Method, device and terminal for implementing voice graffiti

 The invention belongs to the field of terminal products, and more specifically relates to a method, a device and a terminal for realizing a voice graffiti. Background technique

 With the development of communication technology, mobile phone applications are emerging one after another. At present, there are many graffiti applications for mobile phone systems, but the basic principle of these graffiti functions is to draw on the mobile phone display through the brush, and then form graffiti, or collect users in real time on the touch screen. The trajectory formed by the touch action on the touch screen is displayed on the touch screen to form a graffiti. However, this is a graffiti method limited to text or writing, and the user experience is not high. Summary of the invention

 The embodiment of the invention discloses a method, a device and a terminal for implementing a voice graffiti, which are used for solving the problem that the user experience is not high due to the graffiti method limited to text or writing.

 According to a first embodiment of the present invention, a method for implementing a voice graffiti is provided, including: a method for implementing a voice graffiti, applied to a terminal with a display screen, including acquiring a piece of audio data; according to a preset audio frame and a Corresponding relationship of display screen pixels acquires pixel points on the display screen corresponding to each audio frame of the audio data; color processing the pixel points; and placing the processed pixel points on the display Displayed on the screen, the audio data is converted into a pair of graffiti works.

 Preferably, the correspondence between the audio frame and the pixel of the display area of the display screen is at least one of the following: when the number of pixels of the display area is greater than or equal to the maximum quantization value of the audio frame, one audio frame corresponds to One or more display area pixel points; when the number of display area pixel points is smaller than the maximum quantization value of the audio frame, one or more audio frames correspond to one display area pixel point.

Preferably, the color processing of the pixel point comprises: acquiring a current RGB value of the pixel point; calling a random function of the system to calculate a random value within a preset range; The RGB value and the random value calculate a new RGB value for the pixel and assign the new RGB value to the pixel.

 Preferably, the calculating the new RGB value of the pixel point according to the current RGB value and the random value comprises: determining whether the flag bit of the pixel point is 0 or 1 and obtaining the first judgment a result; when the first determination result is 0, adding the current RGB value to the random value; when the first determination result is 1, the current RGB value is compared with the random value Less.

 Preferably, the assignment of the flag bit is converted according to a new RGB value of the pixel point, and when a new RGB value of the pixel point is added by the current RGB value to the random value to reach a first threshold, The assignment of the flag bit is set to 1, and the value of the flag bit is set to 0 when the new RGB value of the pixel point is subtracted from the random value by the current value to a second threshold.

 Preferably, after the acquiring a piece of audio data, the method for implementing the voice graffiti further comprises: placing the audio data into a storage unit; and outputting the audio data in units of the audio frame.

 Preferably, after the processed pixel is displayed on the display screen, the method for implementing the voice graffiti further includes: determining whether the storage unit is empty, and obtaining a third determination result; The third result is that when the storage unit is not empty, the color processing of the pixel is repeatedly performed until the processed pixel is displayed on the display area, so that the audio data is converted into A pair of graffiti works.

 According to another embodiment of the present invention, a device for implementing voice graffiti is provided for a terminal with a display screen, including: a first acquiring module configured to acquire a piece of audio data; and a corresponding module configured to be preset according to a corresponding relationship between the audio frame and the display pixel pixel to acquire a pixel on the display screen corresponding to each audio frame of the audio data; a processing module configured to perform color processing on the pixel point; And a display module, configured to display the processed pixel on the display screen, so that the audio data is converted into a pair of graffiti works.

Preferably, the processing module includes: a second acquiring module, configured to acquire a current RGB value of the pixel point; and a calling module configured to calculate a random value in a preset range by calling a random function of the system; And setting to calculate a new RGB value of the pixel according to the current RGB value and the random value, and assign the new RGB value to the pixel. Preferably, the calculation module includes: a first determining module, configured to determine whether the flag of the pixel is assigned a value of 0 or 1, and obtain a first determination result; and the adding module is set to be in the When the judgment result is 0, the current RGB value is added to the random value; and the subtraction module is configured to set the current RGB value and the random value when the first determination result is 1. Subtraction.

 Preferably, the voice graffiti implementation device further includes: a storage module configured to put the audio data into a storage unit; and an output module configured to output the audio data in units of the audio frame.

 According to still another embodiment of the present invention, a terminal is provided, the terminal comprising the above-described implementation device for voice coating.

 Through the above technical solution of the embodiment of the present invention, a piece of speech of a user or a piece of audio of other language sources is collected, and a random graffiti work is presented. Of course, the user can also fix a certain sound frequency to speak, then the display will be displayed. A picture work in a section enhances the user experience of the terminal. BRIEF abstract

 The drawings are intended to provide a further understanding of the present invention, and are intended to be a part of the present invention, and the description of the present invention and the description thereof are not intended to limit the invention. In the drawing:

 1 is a flow chart showing a method for implementing voice graffiti according to an embodiment of the present invention;

 2 is a schematic diagram showing the distribution of pixel points on a display screen according to an embodiment of the present invention;

 3 is a flowchart of an audio data collection method according to an embodiment of the present invention;

 Figure 4 is a flow chart showing the operation of the voice graffiti system according to the embodiment of the present invention; and Figure 5 is a block diagram showing the structure of the voice graffiti implementation device according to the embodiment of the present invention. Preferred embodiment of the invention

Embodiments of the present invention will be described in detail below with reference to the accompanying drawings. It should be noted that the embodiments in the present application and the features in the embodiments may be combined with each other without conflict. FIG. 1 is a flow chart showing a method for implementing voice graffiti according to an embodiment of the present invention.

 Referring to Figure 1, the implementation of the voice graffiti is applied to a terminal with a display, which may include the following steps:

 a: Get a piece of audio data;

 b: corresponding each audio frame of the audio data to a pixel point on the display screen according to a correspondence between a preset audio frame and the display pixel pixel;

 c: color processing the pixel; and

 d: displaying the processed pixel on the display screen to convert the audio data into a graffiti artwork.

 In the above technical solution of the embodiment, the obtaining of a piece of audio data in step a may be a speech of the user, and the audio collection system of the terminal with the display screen may continuously collect the speech in the real-time, of course, the audio The source of the data may be many, not limited to a speech by the user, for example, may be a piece of music, a song sung by a singer, etc., and the graffiti works can be formed by the embodiment of the present invention; in step b , is to convert the audio data of the above set into pixel points on the display screen, the specific method is to convert the audio data into pixel points on the display screen by presetting the relationship between the audio frame of the audio data and the pixel of the display screen. Then, the pixel is color-processed by step c, and the color-processed pixel is displayed on the corresponding position on the display screen in step d, and the plurality of pixels are connected to form a pair of graffiti works. Through the above process, a graffiti image can be formed on the screen of a mobile phone or other terminal by means of voice, thereby improving the user experience of the user.

 Preferably, the correspondence between the audio frame and the pixel of the display screen is: the number of pixels of the display screen is an integer multiple or 1/2 times the maximum quantization value of the audio frame.

 FIG. 2 is a schematic diagram showing the distribution of pixel points on a display screen according to an embodiment of the invention.

Referring to FIG. 2, taking a mobile phone terminal as an example, since the screen pixels of various mobile terminals are different, the screen of the standard configuration is usually 480*800 resolution, that is, the total number of such screens is 38,400. Pixels. In this embodiment, a pixel of 480*800 is used to simulate the pixel points of the screen, each grid represents a pixel on the screen, and then sorted from top to bottom, left to right, and the top left is 0, the rightmost Below is 38400. In addition, as shown in FIG. 2, the collection of audio data is collected by the microphone of the mobile terminal. Currently, the audio data is collected once in 20 ms, and each acquisition includes 160 audio frames, and each audio frame is 2 bytes, that is, 16 Bit. According to the conversion, each audio frame can be represented by an integer of 0-65535.

 Since the audio frame is 0-65535, for the sake of convenience, it is not necessary to use all the screen pixels, and 32768 pixels of the design can be taken. This is exactly half of the maximum value of the audio frame. In this way, the correspondence between the audio frame and the pixel of the display screen can be set in advance to correspond to one screen pixel point every two digits of the audio frame value.

 With the above technical solution of the embodiment, each time an audio frame is collected, the value of the audio frame collected each time is different because the voice of the person speaks differently. In this way, according to the difference of the audio frames, it can correspond to different screen pixels, and finally form different graffiti pictures.

 Preferably, the color processing of the pixel point comprises: acquiring a current RGB value of the pixel point; calling a random function of the system to calculate a random value within a preset range; according to the current RGB value and the The random value calculates the new RGB value of the pixel.

 The audio frame to pixel point conversion can be completed by the previous embodiment. In this embodiment, color processing is performed on each pixel. First, it is necessary to understand the concept of a color gradation, and the color gradation indicates that the liquid crystal display has strong brightness. The weak index standard, also known as the color index. The gradation of the various screens is different, and the 1600W color gradation currently used in the market. The general mobile phone display shows colors in RGB, from pure black #000000, to pure white #FFFFFF, and the corresponding integer is 0-16777215.

 In this embodiment, the display screen with 32,768 pixels is still taken as an example. The initial state of the RGB color of each pixel is set to #000000, that is, it is pure black at the beginning.

 The initial RGB value of the pixel is 0. After each pixel is corresponding to an audio frame, a random function is called to calculate a value within 0-50000, and this value is added to the initial value of RGB to form a new RGB value. The color value of the pixel after processing. The value of 50000 here can be dynamically adjusted during system design, or it can be 500000 or other values, which can be adjusted according to the effect. If a pixel is corresponding to multiple times, the accumulated value may exceed iFFFFFF, then start subtracting the value of ^????? minus the current RGB value of the pixel as the new point of the pixel. The RGB value, so looping, until the speech is finished.

If you say this in a paragraph, you will present a very random graffiti. Of course, users can also To speak at a certain sound frequency, a picture artwork in a section is displayed.

 Preferably, calculating the new RGB value of the pixel point according to the current RGB value and the random value comprises: determining whether the flag bit of the pixel point is 0 or 1 and obtaining a first determination result; When the first determination result is 0, the current RGB value is added to the random value; when the first determination result is 1, the current RGB value is subtracted from the random value.

 In the process of converting one audio frame of one piece of audio data to a pixel on the display screen, one pixel point may be corresponding to more than one audio frame, and the current RGB value and random value of the pixel point are used at this time. Whether to add or subtract is determined according to the flag set by the pixel, that is, after the random value is calculated, the flag is read, and the flag can be set to B, if B is 0 Add the random value to the current RGB value of the pixel. If B is 1, subtract the random value from the current RGB value of the pixel, thus obtaining a new RGB value for one pixel.

 When the pixel point is corresponding to an audio frame next time, whether the current RGB value of the pixel point and the random value are added or subtracted are still determined according to the flag bit set by the pixel point. However, the flag will be converted based on the new RGB value of the last pixel.

 Preferably, the assignment of the flag bit is converted according to a new RGB value of the pixel point, and when a new RGB value of the pixel point is added by the current RGB value to the random value to reach a first threshold, The assignment of the flag bit is set to 1, and the value of the flag bit is set to 0 when the new RGB value of the pixel point is subtracted from the random value by the current RGB value to reach a second threshold.

 In the above technical solution of the embodiment, the first threshold may be set to #FFFFFF (16777215), and the second threshold is 0. That is, if the new pixel value is less than or equal to 0, then the ^B flag bit B is set to 0. And set this new pixel to 0; if the pixel value is greater than or equal to #FFFFFF ( 16777215 ), set flag B to 1, and set the new pixel value to #FFFFFF.

In the above technical solution of the embodiment, a color processing method of a pixel is set, a random value is calculated by a random function, and a new RGB value of the pixel is obtained by adding or subtracting a current RGB value of the pixel, and The new RGB value is assigned to the pixel and displayed on the display screen, but the color processing method is not unique, and the random value interval calculated by calling the random function of the system can also be adjusted according to the actual effect. Therefore, any method that allows processing of pixel color is encompassed within the scope of the present invention. Preferably, after the acquiring a piece of audio data, the method for implementing the voice graffiti further comprises: putting the audio data into a storage unit; and outputting the audio data in units of the audio frame.

 FIG. 3 is a flowchart of a method for collecting audio data according to an embodiment of the present invention.

 The method for collecting audio data is given in this embodiment. For details, as shown in FIG. 3, the method for collecting audio data can be performed as follows:

 Step 301: Initialize a thread and each parameter state;

 In this step, the threads that need to be initialized are: Initialize the audio collection thread and the graffiti thread, that is, the audio collection thread and the graffiti thread are all ready to start working; the initial parameters are required to: Set the pixel value of the pixel in the display box area to be full 0, that is, pure black.

 Step 302: The audio collection system is started;

 In this step, the audio collection thread starts working, and can be set to collect every 20ms, and 160 audio frames are collected at a time, each audio frame is 16 bits, that is, 0-65535.

 Step 303: collecting audio data every 20 ms;

 According to the above settings, the audio collection thread continuously collects audio data in real time, and collects every 20ms, and collects 160 audio frames at a time, each audio frame is 16 bits, that is, 0-65535.

 Step 304: The data is stored in the Buff cache;

 In this step, the user starts to talk, the audio collection system continuously collects audio data in real time, and the collected data is placed in a cache buff.

 Step 305: Whether to end;

 In this step, it is judged whether there is audio available for the collection, and if so, the audio collection operation is ended, and if no, the process returns to step 303.

 Through the above technical solution of the embodiment, in the cache buff of the system, a certain audio data is collected, and another graffiti thread starts working. For details, refer to FIG. 4.

 FIG. 4 is a flow chart showing the operation of the voice graffiti system according to the embodiment of the present invention.

 Referring to FIG. 4, the specific workflow of the voice graffiti system may include the following steps:

Step 401: Initialize a thread and each parameter state; Step 402: The graffiti thread is started;

 In this step, the graffiti thread starts to obtain the audio frame data from the buff, such as 15634, 3789, 23456, etc., and divides the data according to the obtained data by 2, and then rounds it according to the value, and then finds the corresponding block area in the display screen according to the value. Pixels. Here, the rounding by 2 is determined according to the correspondence between the audio frame and the pixel in the embodiment used in the present invention, but the correspondence is not unique, depending on the situation, that is, according to the audio frame and Depending on the correspondence of pixel settings.

 Step 403: Whether there is data in the buff;

 Determine if there is data in the buff, if yes, go to step 404, if no, go back to the step

403 ;

 Step 404: Take one of the data, and find the corresponding block area according to the screen scale operation (divide by 2);

 In this step, after finding a pixel, first obtain the current RGB value of the pixel. Step 405: Calling the system random function to obtain a random value;

 In this step, the system's random function is called to calculate a value between 0 and 50000. If the system's random function generator is a value of 0-1, multiply by 50000. The value of 50000 here can be dynamically adjusted during system design, or it can be 500000 or other values, which can be adjusted according to the effect.

 Step 406: Read standard bit B;

 After calculating the random value, read the flag bit B. If the flag bit B is 0, add the random value and the original value of the pixel. If the flag bit B is 1, the original pixel value is subtracted from the random value. , so you get a new pixel value. As for the flag bit B, when the system is set, each pixel point is set with a flag bit, and the flag bit B is given an initial value, that is, 0 or 1, but after the pixel point is corresponding to the audio frame, the flag The assignment of bit B will change, as will be explained in the following examples.

 Step 407: Perform corresponding addition or subtraction according to the flag bit;

In step 406, it has been explained that if the flag bit B is 0, the random value is added to the original value of the pixel. If the flag bit B is 1, the original pixel value is subtracted from the random value. However, as the pixel is increased by the corresponding number of times, the accumulated value or the reduced value may reach the threshold set by the system. For example, 0 or #FFFFFF (16777215), therefore, in this embodiment, if the new pixel value is set to be less than or equal to 0, the flag bit is set to 0, and the new pixel point is set to 0; If the value is greater than or equal to #FFFFFF ( 16777215 ), set flag bit B and set the new pixel value to #FFFFFF.

 Step 408: Write the newly obtained value (RGB value) to the corresponding pixel and display it on the screen;

 Step 409: Whether to end;

 Repeat the above steps until the buff buffer is empty, then stop waiting for the data in the buff to arrive, and press the stop end button, all threads stop operating, the color pattern displayed on the screen is the user's voice graffiti works, the user of this work can Save, or share the operation.

 FIG. 5 is a schematic structural diagram of an apparatus for implementing voice graffiti according to an embodiment of the present invention.

 As shown in FIG. 5, the voice graffiti implementation device is applied to a terminal with a display screen, including: a first acquisition module 50 configured to acquire a piece of audio data; and a corresponding module 52 configured to be based on a preset audio frame and Corresponding relationship of the pixels of the display screen corresponds to each audio frame of the audio data as a pixel point on the display screen; the processing module 54 is configured to perform color processing on the pixel point; and a display module 56, It is arranged to display the processed pixel on the display screen, so that the audio data is converted into a pair of graffiti works.

 Preferably, the processing module 54 includes: a second acquiring module (not shown) configured to acquire a current RGB value of the pixel; a calling module (not shown), configured to call a random function calculation of the system a random value within a preset range; a calculation module (not shown) configured to calculate the current RGB value and the random value according to the assignment of the preset flag bit to obtain a new RGB value of the pixel .

 Preferably, the calculating module (not shown) includes: a first determining module (not shown), configured to determine whether the preset flag bit is assigned a value of 0 or 1, and obtain a first determining result; An adding module (not shown) is configured to add the current RGB value to the random value when the first determination result is 0; the subtraction module (not shown) is set to When the first determination result is 1, the current RGB value is subtracted from the random value.

Preferably, the implementation device of the voice graffiti further includes: a storage module (not shown), The audio data is placed in a storage unit; an output module (not shown) is arranged to output the audio data in units of the audio frames.

 The terminal provided by the embodiment of the present invention includes the foregoing apparatus for implementing voice graffiti.

 Through the above embodiments of the present invention, it can be seen that a speech, a recording, and any piece of audio, through the technical solution provided by the present invention, presents a very random graffiti work without any complicated operation, Any hardware investment, just through the audio acquisition system, will display a picture in a section on the display, which improves the user experience.

 In another embodiment, software is also provided for performing the technical solutions described in the above embodiments and preferred embodiments.

 In still another embodiment, a storage medium is provided, the software being stored, including but not limited to: an optical disk, a floppy disk, a hard disk, a rewritable memory, and the like.

 Obviously, those skilled in the art should understand that the above modules or steps of the present invention can be implemented by a general-purpose computing device, which can be concentrated on a single computing device or distributed over a network composed of multiple computing devices. Alternatively, they may be implemented by program code executable by the computing device, such that they may be stored in the storage device by the computing device and, in some cases, may be different from the order herein. The steps shown or described are performed, or they are separately fabricated into individual integrated circuit modules, or a plurality of modules or steps are fabricated as a single integrated circuit module. Thus, the invention is not limited to any particular combination of hardware and software.

 The above is a preferred embodiment of the present invention, and it should be noted that those skilled in the art can also make several improvements and retouchings without departing from the principles of the present invention. It should be considered as the scope of protection of the present invention. Industrial applicability

 In the embodiment of the present invention, a piece of speech of the user or a piece of audio of other language sources is collected, and a random graffiti work is presented. Of course, the user can also fix a certain sound frequency to speak, then the display will be displayed within a certain area. A picture work enhances the user experience of the terminal.

Claims

Claim  A method for implementing a voice graffiti, applied to a terminal with a display screen, the method comprising: acquiring a piece of audio data;  Acquiring pixel points on the display screen corresponding to each audio frame of the audio data according to a correspondence between a preset audio frame and a pixel of a display area of the display screen;  Color processing the pixels; and  The processed pixel points are displayed on the display area such that the audio data is converted into a pair of graffiti works.  The method for implementing the voice graffiti according to claim 1, wherein the correspondence between the audio frame and the pixel of the display area of the display screen is at least one of the following:  When the number of pixels of the display area is greater than or equal to the maximum quantization value of the audio frame, one audio frame corresponds to one or more display area pixel points;  When the number of pixel points in the display area is smaller than the maximum quantization value of the audio frame, one or more audio frames correspond to one display area i or pixel point.  3. The method for implementing a voice graffiti according to claim 1, wherein the color processing the pixel points comprises:  Obtaining a current color three primary color (RGB) value of the pixel;  Calling the random function of the system to calculate a random value within a predetermined range;  A new RGB value of the pixel is calculated from the current RGB value and the random value, and the new RGB value is assigned to the pixel.  4. The method for implementing a voice graffiti according to claim 3, wherein the calculating the new RGB value of the pixel according to the current RGB value and the random value comprises:  Determining whether the flag of the pixel is assigned a value of 0 or 1, and obtaining a first determination result; when the first determination result is 0, adding the current RGB value to the random value; When the first judgment result is 1, the current RGB value is subtracted from the random value. 5. The method for implementing a voice graffiti according to claim 4, wherein the assignment of the flag bit Converting according to the new RGB value of the pixel, when the new RGB value of the pixel is added by the current RGB value and the random value to reach a first threshold, the value of the flag is set When the new RGB value of the pixel is subtracted from the random value by the random value to reach the second value, the assignment of the flag bit is set to zero.  The method for implementing the voice graffiti according to claim 1, wherein after the acquiring the audio data, the method for implementing the voice graffiti further comprises:  Putting the audio data into a storage unit;  And outputting the audio data in units of the audio frame.  The method for implementing the voice graffiti according to claim 6, wherein after the processed pixel is displayed on the display screen, the method for implementing the voice graffiti further comprises:  Determining whether the storage unit is empty, and obtaining a third determination result;  When the third result is that the storage unit is not empty, performing color processing on the pixel point repeatedly until the processed pixel point is displayed on the display area, so that the audio data is made. Converted to a doodle.  A device for implementing a voice graffiti, which is applied to a terminal with a display screen, the device comprising: a first acquiring module, configured to: acquire a piece of audio data;  Corresponding module, configured to: acquire, according to a preset correspondence between the audio frame and the pixel of the display screen, a pixel on the display screen corresponding to each audio frame of the audio data; Set to: color the pixels; and  And a display module, configured to: display the processed pixel on the display screen, so that the audio data is converted into a graffiti work.  The apparatus for implementing the voice graffiti according to claim S, wherein the processing module comprises: a second acquiring module, configured to: acquire a current RGB value of the pixel;  Calling a module, which is set to: call a random function of the system to calculate a random value within a predetermined range; a calculation module, configured to: calculate a new RGB value of the pixel point according to the current RGB value and the random value, and assign the new RGB value to the pixel point. 10. The apparatus for implementing voice graffiti according to claim 9, wherein the calculation module comprises:  a first determining module, configured to: determine whether the flag of the pixel is assigned a value of 0 or 1, and obtain a first determination result;  An adding module, configured to: add the current RGB value to the random value when the first determination result is 0;  The subtraction module is configured to: when the first determination criterion is 1, subtract the current RGB value from the random value.  11. The apparatus for implementing voice graffiti according to claim 9, further comprising:  a storage module, configured to: put the audio data into a storage unit;  And an output module, configured to: output the audio data in units of the audio frame.  12. A terminal comprising the speech graffiti implementation device of any of claims 8-11.