WO2021008350A1 - Audio playback method and apparatus and computer readable storage medium - Google Patents

Abstract

Disclosed in the present application is an audio playback method, the method comprising: acquiring PCM data corresponding to audio data inputted into a sound card; performing frequency band separation on the PCM data and, on the basis of preset audio separation parameters, extracting frequency band data after frequency band separation; on the basis of a preset sound effect algorithm, performing sound effect processing on the frequency band data; writing the PCM data after sound effect processing back to the sound card, and playing the audio data on the sound card. Also disclosed in the present application are an audio playback apparatus and a computer readable storage medium.

Description

Audio playback method, device and computer readable storage medium

Priority information

This application claims the priority of the Chinese patent application filed on July 12, 2019, with the application number 201910633434.8 and the title "audio playback method, device and computer-readable storage medium", the entire content of which is incorporated into this application by reference in.

Technical field

This application relates to the technical field of smart TVs, and in particular to an audio playback method, device and computer-readable storage medium.

Background technique

At present, smart TVs basically support live Internet audio and video content. Since Internet audio and video content has more scenes and longer ages than the audio and video content provided by previous TV content providers, smart TVs need to handle things when playing Internet audio and video content. The more, the more complicated. For example, when in a noisy outdoor scene such as a subway or a bus station, the TV needs to help users clearly distinguish the voices of others; when in a quiet indoor scene, the TV needs to help users clearly identify all sound details; when the sound changes suddenly, the TV needs to be audible to the user Protect it; when playing audio and video with a long history, the TV needs to compensate and improve the lost or damaged sound quality. Usually, smart TV chip manufacturers will provide one or more sound effects modes to achieve high and low bass adjustment, crisp vocals, smart surround and other functions, but because these functions are basically free, it is difficult to achieve good sound effects. Moreover, in the face of smart TV products with ever-decreasing prices, the power amplifiers and speakers used by smart TVs currently on the market cannot restore and render these sound scenes well. Therefore, how to improve the sound effects of smart TVs without increasing hardware costs has become an urgent technical problem to be solved.

Summary of the invention

The main purpose of this application is to provide an audio playback method, device, and computer-readable storage medium, aiming to solve the technical problem of how to improve the sound effect of a smart TV without increasing the hardware cost.

To achieve the above objective, the present application provides an audio playback method, the audio playback method includes:

Obtain PCM data corresponding to the audio data input to the sound card;

Performing frequency band separation on the PCM data, and extracting frequency band data after the frequency band separation according to preset audio separation parameters;

Performing sound effect processing on the frequency band data according to a preset sound effect algorithm;

The PCM data after the sound effect processing is written back to the sound card, and the audio data on the sound card is played.

In an embodiment, the step of performing frequency band separation on the PCM data and extracting frequency band data after the frequency band separation according to preset audio separation parameters includes:

Performing frequency band separation on the PCM data according to a preset filtering algorithm;

Obtain preset audio separation parameters;

Extract frequency band data after frequency band separation according to the audio separation parameter.

In an embodiment, the step of obtaining PCM data corresponding to the audio data input to the sound card includes:

Acquiring PCM data corresponding to the audio data input to the sound card, and determining the sound scene corresponding to the TV channel that outputs the PCM data;

Set corresponding sound effect parameters according to the sound scene.

In an embodiment, the step of performing sound effect processing on the frequency band data according to a preset sound effect algorithm includes:

The sound effect parameters are transferred into a preset sound effect algorithm to perform sound effect processing on the frequency band data.

In an embodiment, the preset sound effect algorithm is a harmony search algorithm.

In an embodiment, the sound effect parameters include the value probability HMCR of the harmony memory bank, and the step of tuning the sound effect parameters into a preset sound effect algorithm to perform sound effect processing on the frequency band data includes:

Initialize the harmony memory bank, and set a preset number of harmony variables in the harmony memory bank;

Randomly generating a first variable, and determining whether the first variable is less than the value of the HMCR, wherein the first variable is a random number between 0 and 1;

Acquire the target harmony variable according to the judgment result, and fine-tune the target harmony variable;

Determine whether to traverse all frequency band data;

If all frequency band data has been traversed, judge whether the harmony after fine-tuning disturbance is better than the worst harmony in the harmony memory;

If the harmony after the fine-tuning disturbance is better than the worst harmony in the harmony memory bank, replace the worst harmony with the harmony after the fine-tuning disturbance to form a new harmony memory bank.

In an embodiment, the sound effect parameters include fine-tuning probability PAR and fine-tuning bandwidth BW, and the step of obtaining a new harmony variable according to the judgment result and fine-tuning the new harmony variable includes:

If the first variable is less than the value of the HMCR, obtain any harmony variable from the current harmony memory bank as the target harmony variable;

If the first variable is greater than or equal to the value of the HMCR, randomly generating a new harmony variable as a target harmony variable according to the frequency band data;

The target harmony variable is fine-tuned based on the fine-tuning probability PAR and the fine-tuning bandwidth BW.

In an embodiment, after the step of determining whether to traverse all frequency band data, the method further includes:

If all frequency band data has not been traversed, a new variable is randomly generated as the first variable, and the step is returned: judging whether the first variable is less than the value of the HMCR.

In addition, in order to achieve the above object, the present application also provides an audio playback device, the audio playback device comprising: a memory, a processor, and an audio playback program stored on the memory and running on the processor, so When the audio playing program is executed by the processor, the steps of any one of the above audio playing methods are implemented.

In addition, in order to achieve the foregoing objective, the present application also provides a computer-readable storage medium on which an audio playback program is stored, and when the audio playback program is executed by a processor, the steps of any one of the foregoing audio playback methods are implemented.

This application obtains the PCM data corresponding to the audio data input into the sound card, and separates the PCM data into frequency bands, and then extracts the frequency band data after the frequency band separation according to the preset audio separation parameters; Sound effect processing; write back the PCM data after sound effect processing to the sound card, and play the audio data on the sound card, thereby improving the sound effect of the smart TV, and at the same time enhancing the market competitiveness and user experience of the smart TV, and There is no need to add any hardware cost to the smart TV.

Description of the drawings

FIG. 1 is a schematic diagram of the device structure of the hardware operating environment involved in the solution of the embodiment of the present application;

2 is a schematic flowchart of the first embodiment of the audio playback method of this application;

Figure 3 is a schematic diagram of the structure of the Android audio framework;

4 is a schematic flowchart of the detailed steps of obtaining PCM data corresponding to audio data input to the sound card in FIG. 2;

FIG. 5 is a schematic flowchart of a second embodiment of the audio playback method of this application.

The realization, functional characteristics, and advantages of the purpose of this application will be further described in conjunction with the embodiments and with reference to the accompanying drawings.

Detailed ways

It should be understood that the specific embodiments described here are only used to explain the application, and are not used to limit the application.

As shown in FIG. 1, FIG. 1 is a schematic diagram of the device structure of the hardware operating environment involved in the solution of the embodiment of the present application.

The device in the embodiment of this application may be a smart TV, or a smart phone, a tablet computer, a PC, an MP3 (Moving Picture Experts Group Audio Layer III, dynamic image expert compression standard audio layer 3) player, MP4 (Moving Picture Experts Group Audio) Layer IV, dynamic image experts compress standard audio layer 4) Players, portable computers and other devices with audio playback.

As shown in FIG. 1, the device may include: a processor 1001, such as a CPU, a communication bus 1002, a user interface 1003, a network interface 1004, and a memory 1005. Among them, the communication bus 1002 is used to implement connection and communication between these components. The user interface 1003 may include a display screen (Display) and an input unit such as a keyboard (Keyboard), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1005 may be a high-speed RAM memory, or a non-volatile memory (non-volatile memory), such as a magnetic disk memory. Optionally, the memory 1005 may also be a storage device independent of the foregoing processor 1001.

In an embodiment, the device may also include a speaker, a microphone, etc., which will not be repeated here.

Those skilled in the art can understand that the terminal structure shown in FIG. 1 does not constitute a limitation on the terminal, and may include more or fewer components than shown in the figure, or combine some components, or arrange different components.

As shown in Fig. 1, a memory 1005, which is a computer storage medium, may include an operating system, a network communication module, a user interface module, and an audio playback program. The processor 1001 may be used to call the audio playback program stored in the memory 1005 and perform the following operations:

Obtain PCM data corresponding to the audio data input to the sound card;

Performing frequency band separation on the PCM data, and extracting frequency band data after the frequency band separation according to preset audio separation parameters;

Performing sound effect processing on the frequency band data according to a preset sound effect algorithm;

The PCM data after the sound effect processing is written back to the sound card, and the audio data on the sound card is played.

Further, the processor 1001 may call an audio playback program stored in the memory 1005, and also perform the following operations:

Performing frequency band separation on the PCM data according to a preset filtering algorithm;

Obtain preset audio separation parameters;

Extract frequency band data after frequency band separation according to the audio separation parameter.

Further, the processor 1001 may call an audio playback program stored in the memory 1005, and also perform the following operations:

Acquiring PCM data corresponding to the audio data input to the sound card, and determining the sound scene corresponding to the TV channel that outputs the PCM data;

Set corresponding sound effect parameters according to the sound scene.

Further, the processor 1001 may call an audio playback program stored in the memory 1005, and also perform the following operations:

The sound effect parameters are transferred into a preset sound effect algorithm to perform sound effect processing on the frequency band data.

Acquire sound effect parameters corresponding to the PCM data from an audio database according to the sound scene, and tune the sound effect parameters into a preset sound effect algorithm.

Further, the processor 1001 may call an audio playback program stored in the memory 1005, and also perform the following operations:

The preset sound effect algorithm is a harmony search algorithm.

Further, the processor 1001 may call an audio playback program stored in the memory 1005, and also perform the following operations:

Initialize the harmony memory bank, and set a preset number of harmony variables in the harmony memory bank;

Randomly generating a first variable, and determining whether the first variable is less than the value of the HMCR, wherein the first variable is a random number between 0 and 1;

Acquire the target harmony variable according to the judgment result, and fine-tune the target harmony variable;

Determine whether to traverse all frequency band data;

If all frequency band data has been traversed, judge whether the harmony after fine-tuning disturbance is better than the worst harmony in the harmony memory;

If the harmony after the fine-tuning disturbance is better than the worst harmony in the harmony memory bank, replace the worst harmony with the harmony after the fine-tuning disturbance to form a new harmony memory bank.

Further, the processor 1001 may call an audio playback program stored in the memory 1005, and also perform the following operations:

If the first variable is less than the value of the HMCR, obtain any harmony variable from the current harmony memory bank as the target harmony variable;

If the first variable is greater than or equal to the value of the HMCR, randomly generating a new harmony variable as a target harmony variable according to the frequency band data;

The target harmony variable is fine-tuned based on the fine-tuning probability PAR and the fine-tuning bandwidth BW.

Further, the processor 1001 may call an audio playback program stored in the memory 1005, and also perform the following operations:

If all the frequency band data has not been traversed, a new variable is randomly generated as the first variable, and the step is returned: judging whether the first variable is less than the value of the HMCR.

The specific embodiments of the audio playback device of the present application are basically the same as the following embodiments of the audio playback method, and will not be repeated here.

2 is a schematic flowchart of a first embodiment of an audio playback method according to the present application. The audio playback method includes:

Step S10: Acquire PCM data corresponding to the audio data input to the sound card.

The device in the embodiment of this application may be a smart TV, or a smart phone, a tablet computer, a PC, an MP3 (Moving Picture Experts Group Audio Layer III, dynamic image expert compression standard audio layer 3) player, MP4 (Moving Picture Experts Group Audio) Layer IV, dynamic image experts compress standard audio layer 4) Players, portable computers and other devices with audio playback. For convenience of description, the subsequent embodiments all take smart TVs as examples. At present, most smart TVs are Android systems, and sound playback is realized through the Android audio framework, as shown in Figure 3, which is a schematic diagram of the structure of the Android audio framework. The Android audio framework is composed of Framework, AudioHal, ALSA, KERNEL, and HW layers. The user opens application software at the application layer, such as a player, and plays audio from a certain channel of the TV through the application software, such as online video, local media, and third-party Audio in video. In the process of playing audio, the smart TV calls the AudioHal interface through the audio interface of the Framework layer to write the original audio data, microphone, Bluetooth, ARC return audio and other audio data to the sound card registered in the KERNEL layer. The layer uses the pcm_open interface to open the sound card in the KERNEL layer, and then suggests a thread in the mediaserver process to use the IOCTRL operation to read the PCM data written to the sound card by the upper application from the pcm_read interface, and input the read PCM data to AudioHal layer's smart sound module (SmartSE), the smart sound module performs sound effect processing on the PCM data through the preset sound effect algorithm, and then rewrites the sound effect processed PCM data into the alsa driver of the sound card through the pcm_write interface, and the SOC chip reads Take the audio in the alsa driver of the sound card for encoding, mixing, and superimposing sound effects, output to the power amplifier IC, and then present it to the user through the speaker, digital audio interface, ARC interface or AVOUT interface.

In order to prevent excessive sound delay and sound freeze caused by audio reading and writing blocking, this application establishes two buffer areas in the process of reading and writing audio data, namely, a read buffer area and a write buffer area, through two buffers The area is designed with dual threads to handle the reading and writing of audio data respectively, and set the reading and writing of audio data to the same sampling rate, number of channels and bit number, so as to ensure the synchronization of audio data input and output. At the same time, two FIFO circular queues are established through these two buffer areas, so that when the system CPU is used too high, it will not cause pcm flow to get stuck, PcmInFIFO overflow, PcmOutFIFO empty processing, etc. The situation happened. When designing the software, the user can reasonably design the size and idle time of the two FIFOs according to the operating speed of different platforms to prevent the AVSYNC delay from being too large and the CPU usage rate from being too high.

Of course, for other operating systems of smart TVs, such as YunOS system, WebOS system, TIZEN system, etc., the PCM data in the sound card can also be obtained through software, which will not be repeated here.

Step S20: Perform frequency band separation on the PCM data, and extract frequency band data after the frequency band separation according to preset audio separation parameters.

The obtained PCM data is separated by frequency band using a preset filtering algorithm, the PCM data is separated according to the different frequency bands of the audio in which the PCM data is located, and then the frequency band data after the frequency band separation is extracted according to the preset audio separation parameters. For example, if the audio separation parameters are set to 100 and 500 respectively, the frequency is lower than 100HZ, it is considered that the audio is in the low frequency band, the frequency is higher than 100HZ and lower than 500HZ, the audio is considered to be in the middle frequency band, and the frequency is higher than 500HZ, the audio is considered to be high Frequency band. Multiple audio separation parameters can be set here. The more the number, the higher the accuracy of audio processing. Those skilled in the art can think that the specific number and value of the audio separation parameter can be set according to the user’s experience or specific The actual needs to be set, I won’t repeat them here.

Step S30: Perform sound effect processing on the frequency band data according to a preset sound effect algorithm.

After the frequency band data is obtained, the frequency band data is processed according to the preset sound effect algorithm. In this embodiment, the harmony search algorithm is used to perform sound effect processing on the frequency band data. The harmony search algorithm is similar to the genetic algorithm's imitation of biological evolution. The simulated annealing algorithm simulates physical annealing and the particle swarm optimization algorithm simulates the flock of birds. The harmony search algorithm simulates the principle of music performance. For example, if there are n data in the current frequency band, defined as x ₁ to x _n , then X={x ₁ ,x ₂ ,...,x _n }, randomly generate a preset number of harmony variables from the solution space of X The preset number in this embodiment is based on the size of the harmony memory bank. For example, the size of the harmony memory bank is defined as HMS, which generates HMS harmony variables, namely X ¹ , X ² ,..., X ^HMS , and HMS Harmony variables are put into the harmony memory bank, and the corresponding f(X) is recorded, then the form of the generated harmony memory bank is:

Generate a random number r1 between [0,1] and compare r1 with the value probability HMCR of the acoustic memory bank, and obtain the target harmony variable according to the judgment result. If r1 is less than HMCR, then randomly from the harmony memory bank Obtain any harmony variable as the target harmony variable; if r1 is greater than or equal to HMCR, a harmony variable is randomly generated from the solution space of the frequency band data. After obtaining the target harmony variable, the target harmony variable is fine-tuned and disturbed. If the target harmony variable is obtained from the harmony memory, the target harmony variable needs to be fine-tuned, between [0, 1] Generate a random number r2, if r2 is less than the fine-tuning probability PAR, adjust the obtained new harmony variable according to the fine-tuning bandwidth BW to obtain a new harmony variable Xnew; if r2 is greater than or equal to the fine-tuning probability PAR, then No adjustments are made, and finally Xnew is evaluated, that is, f(Xnew). If it is better than the one with the worst function value in the harmony memory, that is, f(Xnew)<f(Xworst), then Xnew will replace the harmony The harmony Xworst with the worst function value in the memory bank; otherwise, no modification is made. Repeat the above steps until the maximum number of iterations is reached or the stop criterion is met, the loop is ended, and the optimal solution is output. As a result, sound effect processing is performed on all frequency band data to obtain the sound effect required by the user.

Step S40: Write back the PCM data after the sound effect processing to the sound card, and play the audio data on the sound card.

After the smart sound effect module completes the sound effect processing, it writes the PCM data to the sound card through the pcm_write interface of the AudioHal layer, and plays the new audio data in the sound card, so that the user hears the audio after the sound effect processing.

In this embodiment, the PCM data of the audio data is separated into frequency bands, and the frequency band data is subjected to sound effect processing according to the preset sound effect algorithm, so that the audio data after the sound effect processing is played, so that the smart TV does not increase the hardware In the case of cost, the audio data can be processed with intelligent sound effects for different sound scenes in the audio data, thereby improving the sound effects of the smart TV and at the same time enhancing the market competitiveness and user experience of the smart TV.

Further, referring to FIG. 4, FIG. 4 is a schematic flowchart of the detailed steps of obtaining PCM data corresponding to the audio data input to the sound card in FIG. 2, the step of obtaining PCM data corresponding to the audio data input to the sound card, include:

Step S50: Obtain PCM data corresponding to the audio data input to the sound card, and determine the sound scene corresponding to the TV channel that outputs the PCM data.

Since the audio obtained by different TV channels is different, the sound effect processing of the audio is also different. For example, when the audio is a concert site, it needs to present the bass of the cello, drums, saxophone and other musical instruments. If the audio is a war scene in a film and television work, it needs to restore the effects of battlefield vocals, weapon handover, war horse neighing, etc. . Therefore, before performing sound effect processing on the audio, it is necessary to obtain the PCM data corresponding to the audio data input to the sound card, and determine the sound scene corresponding to the TV channel that outputs the PCM data.

Step S60: Set corresponding sound effect parameters according to the sound scene.

Different sound effect parameters are set in the audio database for different sound scenes. The sound effect parameters can be related parameters of the harmony search algorithm, such as the value probability of the acoustic memory bank HMCR, the fine-tuning probability PAR, the fine-tuning bandwidth BW, etc., or Other parameters related to the sound effect algorithm. In this embodiment, after obtaining the PCM data from the sound card, the sound scene is determined according to the TV channel output by the PCM data, and corresponding sound effect parameters are set for the sound scene. Of course, as another implementation manner, the sound scenes of each TV channel can be defined in advance, and the corresponding sound effect parameters can be set and stored in the audio database, which can be directly called when needed. Specifically, the sound effect parameters can be stored in the audio database as an ini file, so that when audio data is read into the sound card, the corresponding sound effect parameters in the audio database can be automatically obtained, and the ideal sound effect algorithm can be achieved directly through the preset sound effect algorithm. Sound effects.

In this embodiment, different sound effect parameters are set through different sound scenes of the sound, and the corresponding sound effect parameters are automatically obtained when the sound effect algorithm is executed to perform sound effect processing on the audio data. There is no need to consider different platforms and different sound scenes. The algorithm is implemented, thus reducing the workload of R&D personnel, and at the same time facilitating software transplantation.

Further, referring to FIG. 5, FIG. 5 is a schematic flow chart of the second embodiment of the audio playback method of this application. Based on the embodiment shown in FIG. 2, the step S30: perform processing on the frequency band data according to a preset sound effect algorithm Perform sound processing, including:

Step S301: Initialize the harmony memory bank, and set a preset number of harmony variables in the harmony memory bank.

In this embodiment, the preset sound effect algorithm is a harmony search algorithm. Before the intelligent sound effect module performs sound effect processing on the audio data, it needs to obtain a preset size of storage space in the memory as the harmony memory bank, initialize the harmony memory bank, and generate presets based on the frequency band data obtained by separating the frequency band of the audio data The number of harmony variables. For example, if there are n data in the current frequency band, defined as x ₁ to x _n , then X={x ₁ ,x ₂ ,...,x _n }, randomly generate a preset number of harmony variables from the solution space of X The preset number in this embodiment is based on the size of the harmony memory bank. For example, the size of the harmony memory bank is defined as HMS, which generates HMS harmony variables, namely X ¹ , X ² ,..., X ^HMS , and HMS Harmony variables are put into the harmony memory bank, and the corresponding f(X) is recorded, then the form of the generated harmony memory bank is:

Step S302, randomly generating a first variable, and determining whether the first variable is less than the value of the HMCR, where the first variable is a random number between 0 and 1.

Step S303: Obtain the target harmony variable according to the judgment result, and fine-tune the target harmony variable.

Acquire the sound effect parameter corresponding to the current audio data from the audio database, and the sound effect parameter includes the value probability HMCR of the harmony memory bank. Randomly generate the first variable r1 in the range of [0,1], and compare the first variable r1 with the value probability HMCR of the harmony memory bank in the sound effect parameter, if the first variable r1 is less than the value of the harmony memory bank If the probability HMCR, step S310 is executed; if the first variable r1 of r1 is greater than or equal to the value probability HMCR of the harmony memory bank, then step S311 is executed.

Specifically, step S303 includes:

Step S310: Obtain any harmony variable from the current harmony memory bank as the target harmony variable.

Step S311, randomly generating a new harmony variable as the target harmony variable according to the frequency band data.

Step S312, fine-tuning the target harmony variable based on the fine-tuning probability PAR and the fine-tuning bandwidth BW.

Specifically, after obtaining the target harmony variable, the target harmony variable is fine-tuned and disturbed. If the target harmony variable is obtained from the harmony memory bank, the target harmony variable needs to be fine-tuned as follows:

Randomly generate a second variable r2 in the range of [0,1]. If the second variable r2 is less than the fine-tuning probability PAR in the sound effect parameter, then the target harmony variable is adjusted according to the fine-tuning bandwidth BW to obtain a new Harmony variable Xnew; if the second variable r2 is greater than or equal to the fine-tuning probability PAR, no adjustment is made.

If this target harmony variable is to randomly generate a new harmony variable Xnew based on the frequency band data, then the step of adjusting based on the fine-tuning probability PAR and the fine-tuning bandwidth BW is ignored.

Step S304: It is judged whether all frequency band data has been traversed.

Every time a random variable is obtained and compared with the value probability HMCR of the harmony memory bank, it traverses a frequency band data, and loops sequentially. It is necessary to traverse all the frequency band data in the harmony memory bank to adjust all audio frequency bands. It is necessary to determine in real time whether to traverse all frequency band data in the process of executing the sound effect algorithm. If all frequency band data has been traversed, steps S305 and S306 are executed; if all frequency band data has not been traversed, step S307 is executed.

Step S305: It is judged whether the harmony after the fine-tuning disturbance is better than the worst harmony in the harmony memory bank.

Step S306: If the fine-tuned and disturbed harmony is better than the worst harmony in the harmony memory bank, replace the worst harmony with the fine-tuned and disturbed harmony to form a new harmony memory bank.

Step S307, randomly generating a new variable as the first variable, and returning to the step: judging whether the first variable is less than the value of the HMCR.

If all frequency band data has been traversed, the obtained Xnew is evaluated, and the function value of Xnew is calculated, namely f(Xnew). If f(Xnew) is better than the worst one in the harmony memory, namely f( Xnew)<f(Xworst), Xnew will replace Xworst with the worst function value in the harmony memory; otherwise, no modification will be made. The above steps S305 and S306 are continuously repeated until all the frequency band data is traversed to end the loop, and the optimal solution is output. As another implementation manner, the maximum number of iterations may not only be determined by the number of frequency band data, but also may be a parameter preset in the sound effect parameters. Once the number of cycles reaches the maximum number of iterations, the iteration stops.

Those skilled in the art can think that, in addition to the aforementioned harmony search algorithm, the preset sound effect algorithm may also be other sound effect algorithms implemented by software or software algorithms implemented in combination with hardware such as filters, which will not be repeated here.

In this embodiment, a preset sound effect algorithm is used to perform sound effect processing on audio data. Since the sound effect parameters in different sound scenes are different, and the results obtained according to the sound effect algorithm are different, the sound effect processing in different sound scenes is realized.

In addition, the embodiment of the present application also proposes a computer-readable storage medium, the computer-readable storage medium stores an audio playback program, and when the audio playback program is executed by a processor, the following operations are implemented:

Obtain PCM data corresponding to the audio data input to the sound card;

Performing frequency band separation on the PCM data, and extracting frequency band data after the frequency band separation according to preset audio separation parameters;

Performing sound effect processing on the frequency band data according to a preset sound effect algorithm;

The PCM data after the sound effect processing is written back to the sound card, and the audio data on the sound card is played.

Further, the following operations are also implemented when the audio playback program is executed by the processor:

Performing frequency band separation on the PCM data according to a preset filtering algorithm;

Obtain preset audio separation parameters;

Extract frequency band data after frequency band separation according to the audio separation parameter.

Further, the following operations are also implemented when the audio playback program is executed by the processor:

Acquiring PCM data corresponding to the audio data input to the sound card, and determining the sound scene corresponding to the TV channel that outputs the PCM data;

Set corresponding sound effect parameters according to the sound scene.

Further, the following operations are also implemented when the audio playback program is executed by the processor:

The sound effect parameters are transferred into a preset sound effect algorithm to perform sound effect processing on the frequency band data.

Further, the following operations are also implemented when the audio playback program is executed by the processor:

The preset sound effect algorithm is a harmony search algorithm.

Further, the following operations are also implemented when the audio playback program is executed by the processor

Initialize the harmony memory bank, and set a preset number of harmony variables in the harmony memory bank;

Randomly generating a first variable, and determining whether the first variable is less than the value of the HMCR, wherein the first variable is a random number between 0 and 1;

Acquire the target harmony variable according to the judgment result, and fine-tune the target harmony variable;

Determine whether to traverse all frequency band data;

If all frequency band data has been traversed, judge whether the harmony after fine-tuning disturbance is better than the worst harmony in the harmony memory;

If the harmony after the fine-tuning disturbance is better than the worst harmony in the harmony memory bank, replace the worst harmony with the harmony after the fine-tuning disturbance to form a new harmony memory bank.

Further, the following operations are also implemented when the audio playback program is executed by the processor:

If the first variable is less than the value of the HMCR, obtain any harmony variable from the current harmony memory bank as the target harmony variable;

If the first variable is greater than or equal to the value of the HMCR, randomly generating a new harmony variable as a target harmony variable according to the frequency band data;

The target harmony variable is fine-tuned based on the fine-tuning probability PAR and the fine-tuning bandwidth BW.

Further, the following operations are also implemented when the audio playback program is executed by the processor:

If all frequency band data has not been traversed, a new variable is randomly generated as the first variable, and the step is returned: judging whether the first variable is less than the value of the HMCR.

The specific embodiments of the computer-readable storage medium of the present application are basically the same as the above-mentioned embodiments of the application software security vulnerability detection method, and will not be repeated here.

It should be noted that in this article, the terms "include", "include" or any other variants thereof are intended to cover non-exclusive inclusion, so that a process, method, article or system including a series of elements not only includes those elements, It also includes other elements that are not explicitly listed, or elements inherent to the process, method, article, or system. If there are no more restrictions, the element defined by the sentence "including a..." does not exclude the existence of other identical elements in the process, method, article or system that includes the element.

The serial numbers of the foregoing embodiments of the present application are for description only, and do not represent the superiority of the embodiments.

Through the description of the above embodiments, those skilled in the art can clearly understand that the method of the above embodiments can be implemented by means of software plus the necessary general hardware platform. Of course, it can also be implemented by hardware, but in many cases the former is better.的实施方式。 Based on this understanding, the technical solution of this application essentially or the part that contributes to the existing technology can be embodied in the form of a software product, and the computer software product is stored in a storage medium (such as ROM/RAM) as described above. , Magnetic disk, optical disk), including several instructions to make a terminal device (can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the method described in each embodiment of the present application.

The above are only preferred embodiments of this application, and do not limit the scope of this application. Any equivalent structure or equivalent process transformation made using the content of the description and drawings of this application, or directly or indirectly used in other related technical fields , The same reason is included in the scope of patent protection of this application.

Claims (10)

An audio playback method, wherein the audio playback method includes: Obtain PCM data corresponding to the audio data input to the sound card; Performing frequency band separation on the PCM data, and extracting frequency band data after the frequency band separation according to preset audio separation parameters; Performing sound effect processing on the frequency band data according to a preset sound effect algorithm; The PCM data after the sound effect processing is written back to the sound card, and the audio data on the sound card is played. 5. The audio playback method according to claim 1, wherein the step of performing frequency band separation on the PCM data and extracting frequency band data after the frequency band separation according to preset audio separation parameters comprises: Performing frequency band separation on the PCM data according to a preset filtering algorithm; Obtain preset audio separation parameters; Extract frequency band data after frequency band separation according to the audio separation parameter. The audio playback method according to claim 1, wherein the step of obtaining PCM data corresponding to the audio data input into the sound card comprises: Acquiring PCM data corresponding to the audio data input to the sound card, and determining the sound scene corresponding to the TV channel that outputs the PCM data; Set corresponding sound effect parameters according to the sound scene. 8. The audio playback method of claim 3, wherein the step of performing sound effect processing on the frequency band data according to a preset sound effect algorithm comprises: The sound effect parameters are transferred into a preset sound effect algorithm to perform sound effect processing on the frequency band data. 5. The audio playback method of claim 4, wherein the preset sound effect algorithm is a harmony search algorithm. The audio playback method according to claim 5, wherein the sound effect parameters include the value probability HMCR of the harmony memory bank, and the sound effect parameters are transferred into a preset sound effect algorithm to perform sound effects on the frequency band data The processing steps include: Initialize the harmony memory bank, and set a preset number of harmony variables in the harmony memory bank; Randomly generating a first variable, and determining whether the first variable is less than the value of the HMCR, wherein the first variable is a random number between 0 and 1; Acquire the target harmony variable according to the judgment result, and fine-tune the target harmony variable; Determine whether to traverse all frequency band data; If all frequency band data has been traversed, judge whether the harmony after fine-tuning disturbance is better than the worst harmony in the harmony memory; If the harmony after the fine-tuning disturbance is better than the worst harmony in the harmony memory bank, replace the worst harmony with the harmony after the fine-tuning disturbance to form a new harmony memory bank. 8. The audio playback method of claim 6, wherein the sound effect parameters include a fine-tuning probability PAR and a fine-tuning bandwidth BW, and the step of acquiring a new harmony variable according to the judgment result and fine-tuning the new harmony variable, include: If the first variable is less than the value of the HMCR, obtain any harmony variable from the current harmony memory bank as the target harmony variable; If the first variable is greater than or equal to the value of the HMCR, randomly generating a new harmony variable as a target harmony variable according to the frequency band data; The target harmony variable is fine-tuned based on the fine-tuning probability PAR and the fine-tuning bandwidth BW. 8. The audio playback method of claim 6, wherein after the step of determining whether to traverse all frequency band data, the method further comprises: If all frequency band data has not been traversed, a new variable is randomly generated as the first variable, and the step is returned: judging whether the first variable is less than the value of the HMCR. An audio playback device, wherein the audio playback device includes a memory, a processor, and an audio playback program stored on the memory and capable of running on the processor, and the audio playback program is used by the processor When executed, the steps of the audio playback method according to any one of claims 1 to 8 are realized. A computer-readable storage medium having an audio playing program stored thereon, wherein the audio playing program is executed by a processor to implement the steps of the audio playing method according to any one of claims 1 to 8.

Images