[go: up one dir, main page]

WO2025010612A1 - Procédé et appareil de lecture audio optimisée, dispositif et support de stockage - Google Patents

Procédé et appareil de lecture audio optimisée, dispositif et support de stockage Download PDF

Info

Publication number
WO2025010612A1
WO2025010612A1 PCT/CN2023/106689 CN2023106689W WO2025010612A1 WO 2025010612 A1 WO2025010612 A1 WO 2025010612A1 CN 2023106689 W CN2023106689 W CN 2023106689W WO 2025010612 A1 WO2025010612 A1 WO 2025010612A1
Authority
WO
WIPO (PCT)
Prior art keywords
filter
signal
audio
output device
value
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
PCT/CN2023/106689
Other languages
English (en)
Chinese (zh)
Inventor
黄坤朋
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guoguang Electric Co Ltd
Original Assignee
Guoguang Electric Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guoguang Electric Co Ltd filed Critical Guoguang Electric Co Ltd
Priority to CN202380010021.9A priority Critical patent/CN117242786A/zh
Priority to PCT/CN2023/106689 priority patent/WO2025010612A1/fr
Publication of WO2025010612A1 publication Critical patent/WO2025010612A1/fr
Pending legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R1/00—Details of transducers, loudspeakers or microphones
    • H04R1/20—Arrangements for obtaining desired frequency or directional characteristics
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04R—LOUDSPEAKERS, MICROPHONES, GRAMOPHONE PICK-UPS OR LIKE ACOUSTIC ELECTROMECHANICAL TRANSDUCERS; DEAF-AID SETS; PUBLIC ADDRESS SYSTEMS
    • H04R3/00—Circuits for transducers, loudspeakers or microphones

Definitions

  • the present application relates to the field of audio and electroacoustic technology, for example, to an audio optimized playback method, device, equipment and storage medium.
  • Car audio is a sound receiving and playing device set up to relieve the boredom of drivers and passengers during travel, and is usually assembled and set up at the factory.
  • some cars are also equipped with detachable audio, so that users can move the audio outside the car for independent playback when traveling outdoors.
  • the present application provides an audio optimization playback method, device, equipment and storage medium, which ensures high-quality audio playback and effectively improves the user experience at a relatively low cost.
  • the present disclosure provides an audio optimization playback method, comprising:
  • the first filter and the second filter are based on the frequency of the recording signal captured by the microphone.
  • the recording signal is output by the first audio output device and/or the second audio output device; or,
  • the first filter and the second filter are respectively determined in the time domain based on adaptive adjustment of the previous filter value corresponding to the filter itself at the previous moment, and the adjustment parameters of the adaptive adjustment are determined based on the output signals of the first audio output device and the second audio output device at the previous moment.
  • an audio optimized playback device comprising:
  • a first optimized playback module is configured to input a source audio signal into a first filter, and play a first filtered audio signal output by the first filter through a first audio output device after delay processing, and play the source audio signal through a second audio output device;
  • a second optimized playback module configured to input the source audio signal into the second filter, and play the second filtered audio signal output by the second filter through the second audio output device, and play the source audio signal through the first audio output device after delay processing;
  • a third optimized playback module is configured to input the source audio signal into the first filter and the second filter, play the first filtered audio signal output by the first filter through the first audio output device after delay processing, and play the second filtered audio signal output by the second filter through the second audio output device;
  • the first filter and the second filter are determined according to a signal transmission result corresponding to a recording signal captured by a microphone in the frequency domain, and the recording signal is output by the first audio output device and/or the second audio output device; or
  • the first filter and the second filter are determined in the time domain based on adaptive adjustment of the previous filter value corresponding to the filter itself at the previous moment, and the adjustment parameters of the adaptive adjustment are determined based on the output signals of the first audio output device and the second audio output device at the previous moment.
  • an electronic device including:
  • the memory stores a computer program that can be executed by at least one processor, and the computer program is executed by at least one processor so that the at least one processor can execute the above-mentioned audio optimization playback method.
  • the present disclosure provides a computer-readable storage medium, which stores computer instructions, and the computer instructions are used to implement the above-mentioned audio optimization playback method when executed by a processor.
  • FIG1 is a schematic diagram of an audio optimization playback method provided in Example 1 of the present application.
  • FIG2 is a diagram showing a first example of audio optimization playback in the frequency domain involved in an audio optimization playback method provided in Example 1 of the present application;
  • FIG3 is a diagram showing a second example of audio optimization playback in the frequency domain involved in an audio optimization playback method provided in Example 1 of the present application;
  • FIG4 is a diagram showing a third example of audio optimization playback in the frequency domain involved in an audio optimization playback method provided in Example 1 of the present application;
  • FIG5 is an example diagram showing a compensation frequency range and amplitude involved in an audio optimization playback method provided in Example 1 of the present application;
  • FIG6 is a diagram showing a first example of audio optimization playback in the time domain involved in an audio optimization playback method provided in Example 1 of the present application;
  • FIG. 7 is a diagram showing an example of a second audio optimization playback in the time domain involved in an audio optimization playback method provided in Embodiment 1 of the present application;
  • FIG8 is a diagram showing a third example of audio optimization playback in the time domain involved in an audio optimization playback method provided in Embodiment 1 of the present application;
  • FIG9 is a schematic diagram of the structure of an audio optimization playback device provided in Embodiment 2 of the present application.
  • FIG10 is a schematic diagram of the structure of an electronic device provided in Embodiment 3 of the present application.
  • FIG1 is a flow chart of an audio optimization playback method provided in Embodiment 1 of the present application.
  • This embodiment is applicable to the case where two audio output devices are combined to achieve optimized audio playback.
  • the method can be performed by a An audio optimization playback device is used to perform the audio optimization playback, and the device can be implemented in the form of hardware and/or software.
  • An audio optimization playback method provided in an embodiment of the present application can be implemented based on any of the following steps S101 to S103. Each of the steps S101 to S103 has a complete execution logic and can be implemented as an independent audio optimization playback method.
  • the execution order of the steps of the method provided in an embodiment of the present application is not limited by the sequence number of the process.
  • the method includes:
  • the source audio signal may be an initial audio signal directly sent by a source audio device, and is an audio signal that has not been processed by filter compensation.
  • the first filter may be a filter corresponding to the first audio output device.
  • the first filtered audio signal may be an audio signal generated after filtering and compensation by the first filter.
  • the first audio output device may be an audio device capable of playing audio, equipped with a microphone, and the first audio output device may be, for example, a portable audio device that can be carried around.
  • the second audio output device may also be an audio device capable of playing audio, for example, may be a car audio device equipped in a vehicle.
  • the recorded signal may be a sound signal played by the first audio output device and/or the second audio output device recorded by a microphone.
  • Figure 2 is a display diagram of the first audio optimization playback example in the frequency domain involved in an audio optimization playback method provided in Example 1 of the present application.
  • the source audio signal is input into a first filter corresponding to the first audio output device, the first filter filters the source audio signal to generate a first filtered audio signal after filtering compensation, the first filtered audio signal is delayed, and the first filtered audio signal is played through the first audio output device after the delay; the source audio signal is played through the second audio output device.
  • the first filter is determined according to the signal transmission result corresponding to the recording signal captured by the microphone in the frequency domain, and the recording signal is output by the first audio output device and/or the second audio output device; or, the first filter is determined in the time domain according to the adaptive adjustment of the previous filter value corresponding to the first filter at the previous moment, and the adjustment parameter of the adaptive adjustment is determined based on the output signal of the first audio output device and the second audio output device at the previous moment.
  • the filter value of the first filter is determined in advance.
  • the filter value of the first filter can be determined according to the signal transmission result corresponding to the recording signal captured by the microphone in the frequency domain, or it can be determined after the filter value corresponding to the previous moment in the time domain is adaptively filtered and adjusted. This embodiment does not set any limitation on this.
  • the source audio signal may be an initial audio signal directly sent by the source audio device, and is an audio signal that has not been processed by filter compensation.
  • the second filter may be a filter corresponding to the second audio output device.
  • the second filtered audio signal may be an audio signal generated after filtering and compensation by the second filter.
  • the second audio output device may be an audio device capable of playing audio, equipped with a microphone, and the second audio output device may be, for example, a car audio device equipped in a vehicle.
  • the first audio output device may also be an audio device capable of playing audio, for example, a portable audio device that can be carried around.
  • Figure 3 is a diagram showing an example of a second audio optimization playback in the frequency domain involved in an audio optimization playback method provided in Example 1 of the present application.
  • the source audio signal is input into a second filter corresponding to the second audio output device, the second filter filters the source audio signal to generate a second filtered audio signal after filtering compensation, and the second filtered audio signal is played through the second audio output device; the source audio signal is delayed, and the source audio signal is played through the first audio output device after the delay.
  • the second filter is determined according to the signal transmission result corresponding to the recording signal captured by the microphone in the frequency domain, and the recording signal is output by the first audio output device and/or the second audio output device; or, the second filter is determined in the time domain according to the adaptive adjustment of the previous filter value corresponding to the second filter at the previous moment, and the adjustment parameter of the adaptive adjustment is determined based on the output signal of the first audio output device and the second audio output device at the previous moment.
  • the filter value of the second filter is predetermined, and the filter value of the second filter can be determined according to the signal transmission result corresponding to the recording signal captured by the microphone in the frequency domain, or it can be determined after the filter value corresponding to the previous moment in the time domain is adaptively filtered and adjusted, and this embodiment does not set any limitation on this.
  • the source audio signal may be an initial audio signal directly sent by the source audio device, and is an audio signal that has not been processed by filter compensation.
  • the first filter may be a filter corresponding to the first audio output device.
  • the second filter may be a filter corresponding to the second audio output device.
  • the first filtered audio signal may be an audio signal generated after filtering compensation by the first filter.
  • the second filtered audio signal may be an audio signal generated after filtering compensation by the second filter.
  • the first audio output device may be an audio device capable of playing audio, for example, a portable audio device that can be carried around.
  • the second audio output device may also be an audio device capable of playing audio, for example, a car audio device equipped in a vehicle. Either the first audio output device or the second audio output device may be equipped with a microphone.
  • Figure 4 is a third example display diagram of audio optimization playback in the frequency domain involved in an audio optimization playback method provided in Example 1 of the present application.
  • the source audio signal is respectively input into a first filter corresponding to a first audio output device and a second filter corresponding to a second audio output device, the first filter and the second filter respectively filter the source audio signal to generate a first filtered audio signal and a second filtered audio signal after filtering compensation, the first filtered audio signal is delayed, and the first filtered audio signal is played through the first audio output device after the delay; the second filtered audio signal is played through the second audio output device.
  • the first filter and the second filter are determined according to the signal transmission result corresponding to the recording signal captured by the microphone in the frequency domain, and the recording signal is output by the first audio output device and/or the second audio output device; or, the first filter and the second filter are determined in the time domain according to the adaptive adjustment of the previous filter value corresponding to the filter itself at the previous moment, and the adjustment parameters of the adaptive adjustment are determined based on the output signal of the first audio output device and the second audio output device at the previous moment.
  • the filter values of the first filter and the second filter are predetermined, and the filter values of the first filter and the second filter can be determined according to the signal transmission result corresponding to the recording signal captured by the microphone in the frequency domain, or can be determined after the filter value corresponding to the previous moment in the time domain is adaptively filtered and adjusted, and this embodiment does not set any limitation on this.
  • the source audio signal is input into the first filter, and the first filtered audio signal output by the first filter is played through the first audio output device after delay processing, and the source audio signal is played through the second audio output device; or, the source audio signal is input into the second filter, and the second filtered audio signal output by the second filter is played through the second audio output device, and the source audio signal is played through the first audio output device after delay processing; or, the source audio signal is input into the first filter and the second filter, and the first filtered audio signal output by the first filter is played through the first audio output device after delay processing, and the second filtered audio signal output by the second filter is played through the second audio output device.
  • the first filter and the second filter are determined according to the signal transmission result corresponding to the recording signal captured by the microphone in the frequency domain, and the recording signal is output by the first audio output device.
  • the first filter and the second filter are respectively determined in the time domain according to the adaptive adjustment of the previous filter value corresponding to the filter itself at the previous moment, and the adjustment parameters of the adaptive adjustment are determined based on the output signals of the first audio output device and the second audio output device at the previous moment.
  • this first embodiment further adds a step of determining the first filter and the second filter according to the signal transmission result corresponding to the recording signal captured by the microphone in the frequency domain, including:
  • the recording signal may be an audio signal recorded by the microphone in the first audio output device and the second audio output device.
  • the single-channel signal may be a specific signal input to the first audio output device and/or the second audio output device, and may be a frequency sweep signal or a pseudo-random sequence signal, such as a maximum length sequence (MLS).
  • the first signal may be a signal recorded by the microphone when the first audio output device plays the single-channel signal.
  • the second signal may be a signal recorded by the microphone when the second audio output device plays the single-channel signal.
  • the third signal may be a signal recorded by the microphone when the first audio output device and the second audio output device play the single-channel signal simultaneously.
  • a gain processing module is provided, which is configured to perform gain processing on the signal input to the first audio output device according to a preset gain coefficient. Any audio signal input to the first audio output device must first be gain processed by the gain module before other signal processing is performed.
  • the single-channel signal is input to the first audio output device and the second audio output device, and the two audio output devices play the single-channel signal respectively according to the preset volume.
  • the preset volume can be 50% of the full volume or other volume, and this embodiment does not limit this.
  • the microphone captures the single-channel signal played by the first audio output device as the first signal, captures the single-channel signal played by the second audio output device as the second signal, and captures the single-channel signal played simultaneously by the first audio output device and the second audio output device as the third signal.
  • the first signal transmission result may be a transmission function determined according to the first signal.
  • the second signal transmission result may be a transmission function determined according to the second signal.
  • the third signal transmission result may be a transmission function determined according to the second signal. is a transfer function determined according to the third signal.
  • the first signal transmission result corresponding to the frequency domain is determined according to the first signal, i.e., the first transmission function HA1 ; the second signal transmission result corresponding to the frequency domain is determined according to the second signal, i.e., the second transmission function HB1 ; the third signal transmission result corresponding to the frequency domain is determined according to the third signal, i.e., the third transmission function HC1 .
  • c1) determining a first filter and a second filter according to the first signal transmission result, the second signal transmission result and the third signal transmission result in combination with a set first filtering calculation formula and a set second filtering calculation formula.
  • the first filtering calculation formula may be a formula for determining a filtering value of the first filter.
  • the second filtering calculation formula may be a formula for determining a filtering value of the second filter.
  • the first filtering calculation formula and the second filtering calculation formula are both preset formulas determined based on the first signal transmission result, the second signal transmission result, and the third signal transmission result. When the order of determining the filters is different, the corresponding set filtering calculation formulas are also different.
  • the set first filtering calculation formula and the second filtering calculation formula are both determined based on the first signal transmission result, the second signal transmission result and the third signal transmission result. After determining the first filtering calculation formula and the second filtering calculation formula, the first filter is determined based on the first filtering formula, and the second filter is determined based on the second filtering calculation formula.
  • the first filter calculation formula H F1 is determined according to the first signal transmission result H A1 , the second signal transmission result H B1 , the first frequency response formula HD1 and the delay parameter e i ⁇ t0 .
  • the first frequency response formula HD1 is determined according to the first signal transmission result H A1 and the third signal transmission result H C1 .
  • the first filter calculation formula H F1 is as follows:
  • the determination step of the first frequency response formula HD1 includes: determining the average value A0 of the sound pressure level ratio of the third signal transmission result HC1 and the first signal transmission result HA1 in a frequency range, and the above-mentioned frequency range is the effective sound frequency range of the first audio output device, which is the effective frequency band compensation.
  • Figure 5 is an example display diagram of the compensation frequency range and amplitude involved in an audio optimization playback method provided in Example 1 of the present application. As shown in Figure 5, the compensation sound pressure level A in the effective frequency range [ ⁇ L , ⁇ U ] is obtained.
  • the compensation sound pressure level A is a function of the frequency ⁇ , and the lower and upper limits of the cutoff frequency are windowed; outside the effective frequency range, A is 0.
  • the amplitude response corresponding to HD10 is smoothed to correct the original frequency response peaks and valleys.
  • the minimum phase form of HD10 is obtained, and the minimum phase form of HD10 is determined as the first frequency response formula HD1 .
  • the compensation range and compensation amplitude of the frequency are changed within the range [ ⁇ L , ⁇ U ], for example, the compensation range and amplitude are changed to low frequency, and only the low frequency is compensated to improve the low-frequency standing wave problem in the interior space of the car.
  • the second filter calculation formula is determined by the following steps: determining the second filter calculation formula H F2 according to the first signal transmission result H A1 , the first filter calculation formula H F1 and the second frequency response formula HD2 , wherein the second frequency response formula HD2 is determined according to the first signal transmission result H A1 and the third signal transmission result H C1 .
  • the second filter calculation formula H F2 is as follows:
  • H B2 is the first modified transmission result
  • the step of obtaining H B2 includes: applying the first filter determined according to the first filtering calculation formula H F1 to the first audio output device for testing, inputting the single-channel signal into the first audio output device at a preset volume, filtering the single-channel signal in the first audio output device by the first filter, playing the corresponding audio signal, recording the audio signal played by the first audio output device with a microphone, and determining the first modified transmission result H B2 described in the frequency domain according to the recorded signal.
  • the amplitude response corresponding to HD20 is smoothed, and the minimum phase form of HD20 is obtained with the original frequency response peaks and valleys.
  • the minimum phase form of HD20 is determined as the first frequency response formula HD2 .
  • the frequency compensation range and compensation amplitude can be changed within the effective frequency range [ ⁇ L , ⁇ U ] of the second audio output device. For example, if the compensation range and amplitude are changed to low frequency, only low frequency is compensated to improve the low-frequency standing wave problem in the interior space of the car.
  • the second filter calculation formula H F2 is determined according to the first signal transmission result H A1 , the second signal transmission result H B1 , the second frequency response formula HD2 and the delay parameter e -i ⁇ t0 .
  • the second frequency response formula HD2 is determined in the same manner as described in the above specification.
  • the second filter calculation formula H F2 is as follows:
  • the first filter calculation formula H F1 is determined according to the second signal transmission result H B1 , the second filter calculation formula H F2 , the first frequency response formula HD2 and the delay parameter e -i ⁇ t0 , wherein the first frequency response formula HD1 is determined in the same manner as described in the above specification.
  • the first filter calculation formula H F1 is as follows:
  • HA2 is the second modified transmission result
  • the step of obtaining HA2 includes: applying the second filter determined according to the second filtering calculation formula HF2 to the second audio output device for testing, inputting the single-channel signal into the second audio output device at a preset volume, filtering the single-channel signal in the second audio output device by the second filter, playing the corresponding audio signal, recording the audio signal played by the second audio output device with a microphone, and determining the second modified transmission result HA2 described in the frequency domain according to the recorded signal.
  • the steps for determining the delay value used in the delay processing include:
  • the first delay value may be a delay time value t A0 of the first audio output device
  • the second delay value may be a delay time value t B0 of the second audio output device.
  • a first delay value t A0 of the first audio output device is obtained from the determined first signal transmission result HA1 ; and a second delay value t B0 of the second audio output device is obtained from the determined second signal transmission result HB1 .
  • c12 determining a delay value used for delay processing according to the first delay value and the second delay value in combination with a maximum delay value when the second audio output device performs audio output.
  • the second audio output device has multiple channels for signal transmission and processing, each channel also has its corresponding delay value, and the maximum delay value can be the channel delay value with the largest system delay after the second audio output device processes multiple channels.
  • the actual value (1ms/8ms) in the delay value t 0 determination formula can be adjusted according to the rated sound pressure level of the first audio output device and the actual auditory sound image position.
  • the introduction of the delay value t0 can achieve the stabilization of the sound and image of the original car playback system.
  • the steps for determining the gain coefficient used in the gain processing include:
  • test signal captured by a microphone, wherein the test signal comprises a first test signal outputted by a single-channel signal via a first audio output device and a second test signal outputted via a second audio output device.
  • the test signal may be a signal for testing the audio effect of the first audio output device and the second audio output device.
  • the first test signal may be a signal for testing the audio effect of the first audio output device.
  • the second test signal may be a signal for testing the audio effect of the second audio output device.
  • a single-channel signal of a preset volume is input to the first audio output device and the second audio output device, wherein the preset volume can be 80% of the full volume or other volume, which is not limited in this embodiment.
  • the first audio output device plays the single-channel signal, and the microphone captures and records the first test signal played by the first audio output device; the second audio output device plays the single-channel signal, and the microphone captures and records the second test signal played by the second audio output device.
  • the first test signal of the first audio output device and the second test signal of the second audio output device captured by the microphone are obtained.
  • calculation is performed based on the first test signal and the second test signal to determine the A-weighted sound pressure level difference AD0 of the first audio output device relative to the second audio output device.
  • the A-weighted sound pressure level difference AD0 may be a negative number.
  • the gain coefficient may be a gain value of the first audio output device for the signal flowing through.
  • the microphone used in the test may be placed in the passenger listening area for compensating a specific position, or may be placed in multiple positions for average compensation.
  • the built-in speaker of the first audio output device may also be used to obtain a partial compensation effect.
  • the gain coefficient g B for the first audio output device is determined in combination with the microphone position and the A-weighted sound pressure level difference AD0 : Wherein, N represents the total number of mid-range and woofer speakers in the second audio output device.
  • the gain factor g B for the first audio output device is determined in combination with the microphone position and the A-weighted sound pressure level difference AD0 :
  • the gain coefficient g B is usually a coefficient less than 1.
  • the gain coefficient g B is set to be equal to 1.
  • the second embodiment further adds a step of determining the first filter and the second filter in the time domain according to the adaptive adjustment of the previous filter values corresponding to the first filter and the second filter at the previous moment, including:
  • the first previous filter value may be a filter value corresponding to the first filter at a previous moment
  • the second previous filter value may be a filter value corresponding to the second filter at a previous moment
  • adaptive adjustment is performed according to the previous filter value corresponding to the previous moment. It is necessary to obtain the first previous filter value corresponding to the first filter at the previous moment and the second previous filter value corresponding to the second filter at the previous moment.
  • the first audio signal may be an audio signal input into a first audio output device.
  • the first audio output device outputs an audio signal after filtering according to the first previous filter value.
  • the second audio signal may be an audio signal input into the second audio output device and outputted after filtering according to the second previous filter value in the second audio output device.
  • the third filter may be a filter for assisting the first filter and/or the second filter in performing adaptive filtering, and is a reference filter.
  • the third filtered audio signal may be a filtered audio signal generated after the source audio signal is input into the third filter at the previous moment and the third filter performs filtering compensation on the source audio signal.
  • a third filter is set to obtain a third filtered audio signal output by the third filter after the source audio signal has passed through the third filter given for auxiliary filtering at the previous moment.
  • d2) adjusting the first previous filter value according to the first audio signal and the third filtered audio signal to obtain the first current filter value of the first filter at the current moment; or, adjusting the second previous filter value according to the second audio signal and the third filtered audio signal to obtain the second current filter value of the second filter at the current moment; or, adjusting the first previous filter value and the second previous filter value according to the first audio signal, the second audio signal and the third filtered audio signal to obtain the first current filter value of the first filter at the current moment and the second current filter value of the second filter at the current moment.
  • the first current filtering value may be a filtering value corresponding to the first filter at the current moment
  • the second current filtering value may be a filtering value corresponding to the second filter at the current moment
  • the adaptive filtering of the filter may be adaptive filtering implemented by only a single filter, for example, adaptive filtering is performed only on the first filter, or adaptive filtering is performed only on the second filter, or adaptive filtering is performed on both the first filter and the second filter at the same time.
  • the third filter is used to assist in determining the filter value of the first filter and/or the second filter. According to the signal output under the first previous filter value and/or the second previous filter value, combined with the third filtered audio signal output by the third filter, the first previous filter value and/or the second previous filter value are updated to obtain the first current filter value and/or the second current filter value.
  • FIG. 6 is a diagram showing an example of a first audio optimization playback method in the time domain provided in an audio optimization playback method according to an embodiment of the present application.
  • the source audio signal is input to the first filter. and the third filter, obtaining a first audio signal output by the first audio output device after filtering by the first previous filter value and a third filtered audio signal output by the third filter, wherein the first filtered audio signal output by the first filter is delayed, and the first filtered audio signal after the delay processing is input into the first audio output device for playback
  • the microphone collects the first audio signal played by the first audio output device and the third filtered audio signal output by the third filter, performs a filtering feedback loop, adjusts the first previous filter value, and obtains the first current filter value of the first filter at the current moment.
  • Figure 7 is a diagram showing an example of the second audio optimization playback in the time domain involved in an audio optimization playback method provided in Example 1 of the present application.
  • the source audio signal is input into the second filter and the third filter to obtain a second audio signal output by the second audio output device after filtering by the second previous filter value, and a third filtered audio signal output by the third filter, wherein the second filtered audio signal output by the second filter is input into the second audio output device for playback, a microphone collects the second audio signal played by the second audio output device, and the third filtered audio signal output by the third filter, a filtering feedback loop is performed, the second previous filter value is adjusted, and the second current filter value of the second filter at the current moment is obtained.
  • FIG8 is a third example of audio optimization playback in the time domain involved in an audio optimization playback method provided in Example 1 of the present application.
  • the source audio signal is input into the first filter, the second filter and the third filter to obtain the first audio signal output by the first audio output device after filtering by the first previous filter value, the second audio signal output by the second audio output device after filtering by the second previous filter value and the third filtered audio signal output by the third filter, wherein the first filtered audio signal output by the first filter is delayed, the first filtered audio signal after the delay processing is input into the first audio output device for playback, and the second filtered audio signal output by the second filter is input into the second audio output device for playback.
  • the microphone collects the first audio signal played by the first audio output device, the second audio signal played by the second audio output device and the third filtered audio signal output by the third filter, performs a filtering feedback loop, adjusts the first previous filter value, obtains the first current filter value of the first filter at the current moment, adjusts the second previous filter value, and obtains the second current filter value of the second filter at the current moment.
  • the third filters used in Figures 6, 7 and 8 are all filters used for reference filtering, they are essentially different.
  • the third filter shown in Figure 6 is a reference filter for assisting in updating the filtering value of the first filter
  • the third filter shown in Figure 7 is a reference filter for assisting in updating the filtering value of the second filter
  • the third filter shown in Figure 8 is a reference filter for assisting in simultaneously updating the filtering values of the first filter and the second filter.
  • the step of adjusting the first previous filtered value and the second previous filtered value comprises:
  • the current error value may be a filter error of a filter between a previous and a next moment.
  • the first current error value may be a filter error of a first filter between a previous and a next moment.
  • the second current error value may be a filter error of a second filter between a previous and a next moment.
  • the third current error value may be a filter error of a combined filter between a previous and a next moment after combining the first filter and the second filter.
  • the first previous filter value is adjusted according to the first audio signal and the third filtered audio signal, combined with the first current error value, according to the difference between the first previous filter value and the first current error value, to form the first current filter value.
  • the second previous filter value is adjusted according to the second audio signal and the third filtered audio signal, combined with the second current error value, according to the difference between the second previous filter value and the second current error value, to form the second current filter value.
  • the first previous filter value is adjusted according to the difference between the first previous filter value and the third current error value to form the first current filter value;
  • the second previous filter value is adjusted according to the difference between the second previous filter value and the third current error value to form the second current filter value.
  • the steps for determining the current error value include:
  • the first captured signal may be an audio signal collected by a microphone when the first audio output device plays audio.
  • the first frequency response value may be a custom frequency response value of the first filter, and the first frequency response value is a frequency response value in time domain corresponding to the first frequency response formula in the above specification.
  • the first current error value of the first filter is determined according to the first captured signal s(n)*h A1 (n)+y 1 (n), the first frequency response value d 1 (n) of the first filter in time domain form, and the source audio signal S(n).
  • the first captured signal is a signal directly read by the microphone, but the signal is composed of: the source audio signal S(n), the first audio signal y 1 (n) and the time domain form h A1 (n) of the first signal transmission result H A1 .
  • the first captured signal may be an audio signal collected by a microphone when the second audio output device plays audio.
  • the second frequency response value may be a custom frequency response value of the second filter, and the second frequency response value is a frequency response value in time domain corresponding to the second frequency response formula in the above specification.
  • the second current error value of the second filter is determined according to the second captured signal s(n)*h B1 (nt 0 )+y 2 (n), the second frequency response value d 2 (n) of the second filter in time domain form, and the source audio signal S(n).
  • the second captured signal is a signal directly read by the microphone, but the signal is composed of: the source audio signal S(n), the second audio signal y 2 (n), and the time domain form h B1 (nt 0 ) of the second signal transmission result H B1 after a time delay t 0 .
  • the third captured signal may be a mixed audio total signal collected by the microphone when the first audio output device and the second audio output device play audio simultaneously.
  • the third current error value of the third filter is determined according to the third captured signal y 3 (n), the third frequency response value d 3 (n), and the source audio signal S(n).
  • the third frequency response value d 3 (n) is the frequency response value when the first filter and the second filter are combined and filtered together, and the determination steps are the same as the determination steps of the first frequency response value d 1 (n) and the second frequency response value d 2 (n), which is not limited in this embodiment.
  • the effective frequency range corresponding to the third frequency response value includes the effective frequency range of the first audio output device and the second audio output device.
  • an audio optimization playback method is used to optimize the audio playback between two audio output devices by using at least one filter.
  • a single filter can be used to filter and compensate any one of the first audio output device or the second audio output device.
  • Multiple filters can be used to filter and compensate the two devices. It can flexibly achieve audio optimization playback, solve the problem of integrating portable audio into the car audio playback system, and meet the outdoor use of portable audio, and can achieve matching playback of portable audio and car audio.
  • either device can carry a microphone.
  • An audio optimization playback method based on this can be easily implemented in a car where the car audio has been installed, so it matches many models on the market.
  • the gain processing and delay processing modules are set in the first audio output device, and the gain coefficient and delay are used to keep the sound image of the source audio stable.
  • the original frequency response curve can be basically maintained, and smoothing and minimum phase improvements can be made. This is conducive to maintaining the acoustic characteristics of the original car in terms of listening, smoothing the peaks and valleys, and having a good transient response.
  • the filter audio compensation of the filter is based on the frequency coverage range of the second audio output device, and can also be selected as compensation for a specific frequency range. The use of filters with phase and amplitude compensation helps to compensate for the acoustics of the interior space of the car. Standing wave problem.
  • FIG9 is a schematic diagram of the structure of an audio optimization playback device provided in Example 3 of the present application. As shown in FIG9 , the device includes:
  • the first optimized playback module 21 is configured to input the source audio signal into the first filter, and play the first filtered audio signal output by the first filter through the first audio output device after delay processing, and play the source audio signal through the second audio output device; or, the second optimized playback module 22 is configured to input the source audio signal into the second filter, and play the second filtered audio signal output by the second filter through the second audio output device, and play the source audio signal through the first audio output device after delay processing; or, the third optimized playback module 23 is configured to input the source audio signal into the first filter and the second filter, and play the second filtered audio signal output by the first filter through the second audio output device.
  • the first filtered audio signal is played through the first audio output device after delay processing, and the second filtered audio signal output by the second filter is played through the second audio output device; wherein, the first filter and the second filter are determined according to the signal transmission result corresponding to the recording signal captured by the microphone in the frequency domain, and the recording signal is output by the first audio output device and/or the second audio output device; or, the first filter and the second filter are determined in the time domain according to the adaptive adjustment of the previous filtering value corresponding to the filter itself at the previous moment, and the adjustment parameters of the adaptive adjustment are determined based on the output signals of the first audio output device and the second audio output device at the previous moment.
  • the technical solution adopts an audio optimization playback device, which, without increasing the application cost, realizes signal compensation for the source audio signal by adopting at least one filter, and flexibly realizes optimized playback of the compensated audio by adopting two audio output devices, thereby ensuring high-quality audio playback and effectively improving the user experience.
  • the device further includes a frequency domain filtering determination module, wherein the frequency domain filtering determination module is configured to:
  • the recording signal includes a first signal output by a first audio output device of a single-channel signal, a second signal output by a second audio output device, and a third signal output by the first audio output device and the second audio output device at the same time, wherein the first signal output by the first audio output device is a signal that has been gain-processed according to a gain coefficient; determine a first signal transmission result, a second signal transmission result, and a third signal transmission result corresponding to the first signal, the second signal, and the third signal in the frequency domain, respectively; determine the first filter and the second filter according to the first signal transmission result, the second signal transmission result, and the third signal transmission result, in combination with a set first filtering calculation formula and a second filtering calculation formula.
  • the frequency domain filtering determination module includes a delay value determination unit, and the delay value determination unit is configured as:
  • a first delay value is obtained from the first signal transmission result and a second delay value is obtained from the second signal transmission result; and a delay value used for delay processing is determined based on the first delay value and the second delay value and the maximum delay value when the second audio output device performs audio output.
  • the frequency domain filtering determination module includes a gain coefficient determination unit, and the gain coefficient determination unit is configured as:
  • test signal captured by a microphone, wherein the test signal includes a first test signal output by a first audio output device and a second test signal output by a second audio output device; determine a sound pressure level difference of the first audio output device relative to the second audio output device according to the first test signal and the second test signal; and determine a gain coefficient of the first audio output device according to a microphone position and the sound pressure level difference.
  • the device further includes a time domain filtering determination module, wherein the time domain filtering determination module is configured to:
  • the time domain filtering determination module includes a filtering value adjustment submodule, and the filtering value adjustment submodule is configured as:
  • the current error value includes the first current error value of the first filter, the second current error value of the second filter, or the third current error value of the first filter and the second filter.
  • the filter value adjustment submodule includes an error value determination unit, and the error value determination unit is configured as:
  • a first current error value of the first filter is determined; according to the second captured signal and the second frequency response value of the second filter, a second current error value of the second filter is determined; according to the third captured signal and the third frequency response value, a third current error value of the first filter and the second filter is determined, wherein the third frequency response value
  • the response value is a frequency response value of the first filter and the second filter acting together.
  • An audio optimization playback device provided in an embodiment of the present application can execute an audio optimization playback method provided in any embodiment of the present application, and has functional modules and effects corresponding to the execution method.
  • FIG10 shows a block diagram of an electronic device that can be used to implement an embodiment of the present application.
  • the electronic device 30 is intended to represent various forms of digital computers, such as laptop computers, desktop computers, workbenches, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers.
  • the electronic device 30 can also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices (such as helmets, glasses, watches, etc.) and other similar computing devices.
  • the components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present application described and/or required herein.
  • the electronic device 30 may also include a vehicle with processing computing capabilities.
  • the electronic device 30 includes at least one processor 31, and a memory connected to the at least one processor 31, such as a read-only memory (ROM) 32, a random access memory (RAM) 33, etc., wherein the memory stores a computer program that can be executed by at least one processor, and the processor 31 can perform a variety of appropriate actions and processes according to the computer program stored in the ROM 32 or the computer program loaded from the storage unit 38 to the RAM 33.
  • the RAM 33 a variety of programs and data required for the operation of the electronic device 30 can also be stored.
  • the processor 31, the ROM 32, and the RAM 33 are connected to each other through a bus 34.
  • An input/output (I/O) interface 35 is also connected to the bus 34.
  • a number of components in the electronic device 30 are connected to the I/O interface 35, including: an input unit 36, such as a keyboard, a mouse, etc.; an output unit 37, such as various types of displays, speakers, etc.; a storage unit 38, such as a disk, an optical disk, etc.; and a communication unit 39, such as a network card, a modem, a wireless communication transceiver, etc.
  • the communication unit 39 allows the electronic device 30 to exchange information/data with other devices through a computer network such as the Internet and/or various telecommunication networks.
  • the processor 31 may be a variety of general and/or special processing components with processing and computing capabilities. Some examples of the processor 31 include a central processing unit (CPU), a graphics processing unit (GPU), a variety of dedicated artificial intelligence (AI) computing chips, a variety of processors running machine learning model algorithms, a digital signal processor (DSP), and any appropriate processor, controller, microcontroller, etc.
  • the processor 31 performs the multiple methods and processes described above, such as an audio optimization playback method.
  • an audio optimized playback method may be implemented as a computer program that is tangibly contained in a computer-readable storage medium, such as a storage unit 38.
  • part or all of the computer program may be loaded and/or installed on the electronic device 30 via the ROM 32 and/or the communication unit 39.
  • the processor 31 may be configured to perform an audio optimized playback method in any other appropriate manner (e.g., by means of firmware).
  • Various embodiments of the systems and techniques described above herein may be implemented in digital electronic circuit systems, integrated circuit systems, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard parts (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), computer hardware, firmware, software, and/or combinations thereof.
  • FPGAs field programmable gate arrays
  • ASICs application specific integrated circuits
  • ASSPs application specific standard parts
  • SOCs systems on chips
  • CPLDs complex programmable logic devices
  • These various embodiments may include: being implemented in one or more computer programs that are executable and/or interpreted on a programmable system that includes at least one programmable processor that may be a special purpose or general purpose programmable processor that may receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.
  • a programmable processor may be a special purpose or general purpose programmable processor that may receive data and instructions from a storage system, at least one input device, and at least one output device, and transmit data and instructions to the storage system, the at least one input device, and the at least one output device.
  • the computer programs for implementing the methods of the present application may be written in any combination of one or more programming languages. These computer programs may be provided to a processor of a general-purpose computer, a special-purpose computer, or other programmable data processing device, so that when the computer programs are executed by the processor, the functions/operations specified in the flow charts and/or block diagrams are implemented.
  • the computer programs may be executed entirely on the machine, partially on the machine, partially on the machine and partially on a remote machine as a stand-alone software package, or entirely on a remote machine or server.
  • a computer readable storage medium may be a tangible medium that may contain or store a computer program for use by or in conjunction with an instruction execution system, device or equipment.
  • a computer readable storage medium may include an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or equipment, or any suitable combination of the foregoing.
  • a computer readable storage medium may be a machine readable signal medium. Examples of machine readable storage media may include electrical connections based on one or more lines, portable computer disks, hard disks, RAM, ROM, erasable programmable read-only memory (EPROM or flash memory), optical fibers, portable compact disk read-only memory (CD-ROM), optical storage devices, magnetic storage devices, or any suitable combination of the foregoing.
  • the systems and techniques described herein may be implemented on an electronic device having: a display device (e.g., a cathode ray tube (CRT) or a liquid crystal display (LCD) monitor) configured to display information to the user; and a keyboard and pointing device (e.g., a mouse or trackball) through which the user can provide input to the electronic device.
  • a display device e.g., a cathode ray tube (CRT) or a liquid crystal display (LCD) monitor
  • a keyboard and pointing device e.g., a mouse or trackball
  • Other types of devices may also be configured to provide interaction with a user; for example, the feedback provided to the user may be any form of sensory feedback (e.g., visual feedback, auditory feedback, or tactile feedback); and input from the user may be received in any form (including acoustic input, voice input, or tactile input).
  • the systems and techniques described herein may be implemented in a computing system that includes backend components (e.g., as a data server), or a computing system that includes middleware components (e.g., an application server), or a computing system that includes frontend components (e.g., a user computer with a graphical user interface or a web browser through which a user can interact with implementations of the systems and techniques described herein), or a computing system that includes any combination of such backend components, middleware components, or frontend components.
  • the components of the system may be interconnected by any form or medium of digital data communication (e.g., a communication network). Examples of communication networks include: Local Area Network (LAN), Wide Area Network (WAN), blockchain network, and the Internet.
  • a computing system may include a client and a server.
  • the client and the server are generally remote from each other and usually interact through a communication network.
  • the client and server relationship is generated by computer programs running on the respective computers and having a client-server relationship with each other.
  • the server may be a cloud server, also known as a cloud computing server or cloud host, which is a host product in the cloud computing service system to solve the defects of difficult management and weak business scalability in traditional physical hosts and virtual private servers (VPS) services.
  • VPN virtual private servers

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Acoustics & Sound (AREA)
  • Signal Processing (AREA)
  • Circuit For Audible Band Transducer (AREA)

Abstract

L'invention concerne un procédé et un appareil de lecture audio optimisée, un dispositif et un support de stockage. Le procédé de lecture audio optimisé consiste à : entrer un signal audio source dans un premier filtre, effectuer un traitement de retard sur un premier signal audio filtré délivré par le premier filtre, puis lire le premier signal audio filtré au moyen d'un premier appareil de sortie audio, et lire le signal audio source au moyen d'un second appareil de sortie audio ; ou, entrer un signal audio source dans un second filtre, lire, au moyen d'un second appareil de sortie audio, un second signal audio filtré délivré par le second filtre, effectuer un traitement de retard sur le signal audio source, puis lire le signal audio source au moyen d'un premier appareil de sortie audio ; ou, entrer un signal audio source dans un premier filtre et un second filtre, effectuer un traitement de retard sur un premier signal audio filtré délivré par le premier filtre, puis lire le premier signal audio filtré au moyen d'un premier appareil de sortie audio, et lire, au moyen d'un second appareil de sortie audio, un second signal audio filtré délivré par le second filtre.
PCT/CN2023/106689 2023-07-11 2023-07-11 Procédé et appareil de lecture audio optimisée, dispositif et support de stockage Pending WO2025010612A1 (fr)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202380010021.9A CN117242786A (zh) 2023-07-11 2023-07-11 音频优化播放方法、装置、设备及存储介质
PCT/CN2023/106689 WO2025010612A1 (fr) 2023-07-11 2023-07-11 Procédé et appareil de lecture audio optimisée, dispositif et support de stockage

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2023/106689 WO2025010612A1 (fr) 2023-07-11 2023-07-11 Procédé et appareil de lecture audio optimisée, dispositif et support de stockage

Publications (1)

Publication Number Publication Date
WO2025010612A1 true WO2025010612A1 (fr) 2025-01-16

Family

ID=89093479

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2023/106689 Pending WO2025010612A1 (fr) 2023-07-11 2023-07-11 Procédé et appareil de lecture audio optimisée, dispositif et support de stockage

Country Status (2)

Country Link
CN (1) CN117242786A (fr)
WO (1) WO2025010612A1 (fr)

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
NL1032538A1 (nl) * 2005-09-22 2007-03-23 Samsung Electronics Co Ltd Apparaat en werkwijze voor het reproduceren van virtueel geluid van twee kanalen.
CN113473294A (zh) * 2021-06-30 2021-10-01 展讯通信（上海）有限公司 系数确定方法及装置
DE102020111851A1 (de) * 2020-04-30 2021-11-04 Harman Becker Automotive Systems Gmbh Audiowiedergabe mit mehrkanaliger akustischer echokompensation
CN115460513A (zh) * 2022-10-19 2022-12-09 国光电器股份有限公司 一种音频处理方法、装置、系统及存储介质
CN116249065A (zh) * 2023-03-06 2023-06-09 Oppo广东移动通信有限公司 音频信号处理方法与装置、音频播放设备
CN116320133A (zh) * 2023-03-31 2023-06-23 Oppo广东移动通信有限公司 音频播放方法、装置、电子设备及存储介质

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
NL1032538A1 (nl) * 2005-09-22 2007-03-23 Samsung Electronics Co Ltd Apparaat en werkwijze voor het reproduceren van virtueel geluid van twee kanalen.
DE102020111851A1 (de) * 2020-04-30 2021-11-04 Harman Becker Automotive Systems Gmbh Audiowiedergabe mit mehrkanaliger akustischer echokompensation
CN113473294A (zh) * 2021-06-30 2021-10-01 展讯通信（上海）有限公司 系数确定方法及装置
CN115460513A (zh) * 2022-10-19 2022-12-09 国光电器股份有限公司 一种音频处理方法、装置、系统及存储介质
CN116249065A (zh) * 2023-03-06 2023-06-09 Oppo广东移动通信有限公司 音频信号处理方法与装置、音频播放设备
CN116320133A (zh) * 2023-03-31 2023-06-23 Oppo广东移动通信有限公司 音频播放方法、装置、电子设备及存储介质

Also Published As

Publication number Publication date
CN117242786A (zh) 2023-12-15

Similar Documents

Publication Publication Date Title
JP5122879B2 (ja) 時間および周波数領域内のパーティションされた高速畳み込み
US10142763B2 (en) Audio signal processing
CN103634726B (zh) 一种扬声器自动均衡方法
CN110024419B (zh) 增益相位均衡(gpeq)滤波器和调谐方法
CN110838301B (zh) 抑制啸叫的方法、装置终端和非临时性计算机可读存储介质
CN111796790A (zh) 一种音效调节方法、装置、可读存储介质及终端设备
WO2024093307A1 (fr) Procédé et appareil de traitement audio, dispositif électronique, et support de stockage lisible par ordinateur
CN110996216B (zh) 对耳机内均衡滤波器进行配置的方法、装置、系统及耳机
CN109905808B (zh) 用于调节智能语音设备的方法和装置
CN118824302A (zh) 音频信号处理方法、音频信号处理设备及存储介质
CN108495235B (zh) 一种重低音的分离方法、装置、计算机设备及存储介质
CN115460513B (zh) 一种音频处理方法、装置、系统及存储介质
CN115460516A (zh) 单声道转立体声的信号处理方法、装置、设备及介质
WO2025010612A1 (fr) Procédé et appareil de lecture audio optimisée, dispositif et support de stockage
CN114420153A (zh) 音质调整方法、装置、设备及存储介质
US12170886B2 (en) Methods and systems for optimizing behavior of audio playback systems
CN119007736A (zh) 一种音频压缩方法及装置
CN115835112A (zh) 一种基于投影仪自适应音效调试方法、系统、装置及平台
CN117116245A (zh) 声音信号的谐波生成方法、装置、设备及存储介质
CN116597801A (zh) 主动降噪方法、装置、电子设备和计算机可读介质
US20080285768A1 (en) Method and System for Modifying and Audio Signal, and Filter System for Modifying an Electrical Signal
CN117912485A (zh) 语音频带扩展方法、降噪音频设备以及存储介质
JP5826712B2 (ja) マルチチャネルエコー消去装置、マルチチャネルエコー消去方法、およびプログラム
WO2016133061A1 (fr) Dispositif de génération de signal de commande de phase, procédé de génération de signal de commande de phase, et programme de génération de signal de commande de phase
US20200090637A1 (en) Method and system for implementing a modal processor

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23944635

Country of ref document: EP

Kind code of ref document: A1