WO2023212879A1 - Object audio data generation method and apparatus, electronic device, and storage medium - Google Patents

Abstract

Disclosed in embodiments of the present disclosure are an object audio data generation method and apparatus, an electronic device, and a storage medium. The method comprises: obtaining sound data of at least one sound object; obtaining current position information of the at least one sound object; and synthesizing the sound data and the current position information of the at least one sound object to generate object audio data. Therefore, position information of each sound object can be accurately obtained in real time, so that object audio data can be recorded and generated in real time.

Description

Object audio data generation method, device, electronic equipment and storage medium Technical field

The present disclosure relates to the field of communication technology, and in particular, to a method, device, electronic device and storage medium for generating object audio data.

Background technique

MPEG-H 3D Audio, the next generation audio codec standard of MPEG (Moving Picture Experts Group), is the ISO/IEC 23008-3 international standard. In this standard framework, a new audio format, object audio, is used (Object Audio) can mark the direction of the sound, so that the listener can hear the sound coming from a specific direction regardless of the number of speakers using headphones or speakers.

In related technologies, object audio data is generated by pre-recording monophonic audio and combining it with the position information of the pre-prepared monophonic audio in the later stage. Using this method requires the production of production equipment in the later stage, and there is still a lack of a method. A method for recording object audio data of a sound object in real time.

Contents of the invention

Embodiments of the present disclosure provide a method, device, electronic device, and storage medium for generating object audio data, which can accurately obtain the location information of each sound object in real time, and record and generate object audio data in real time.

In a first aspect, embodiments of the present disclosure provide a method for generating object audio data. The method includes: obtaining sound data of at least one sound object; obtaining current location information of the at least one sound object; and converting at least one sound object to The sound data and the current location information are synthesized to generate object audio data.

In this technical solution, sound data of at least one sound object is obtained; current position information of at least one sound object is obtained; sound data of at least one sound object and current position information are synthesized to generate object audio data. As a result, the position information of each sound object can be accurately obtained in real time, and the object audio data can be recorded and generated in real time.

In some embodiments, obtaining the current location information of the at least one sound object includes: obtaining the current location information of at least one recording terminal that records the sound data of the at least one sound object.

In some embodiments, before synthesizing the sound data of the at least one sound object and the current location information, the method further includes: synthesizing the sound data of the at least one sound object and the current location information. to synchronize.

In some embodiments, obtaining the current location information of at least one recording terminal that records the sound data of the at least one sound object includes: obtaining the at least one recording in a one-way transceiver mode, a two-way transceiver mode, or a hybrid transceiver mode. The current location information of the terminal.

In some embodiments, obtaining the location information of the at least one recording terminal using a hybrid transceiver method includes: obtaining first positioning reference information using the one-way transceiver method; and obtaining a second positioning reference information using the two-way transceiver method. Information: determining the current location information of the at least one recording terminal according to the first positioning reference information and the second positioning reference information.

In some embodiments, the first positioning reference information is one of angle information and distance information, and the second positioning reference information is the other one of the angle information and the distance information.

In some embodiments, obtaining the current location information of the at least one recording terminal in the one-way transceiver mode includes: receiving a first positioning signal sent by the at least one recording terminal in a broadcast manner, and based on the The first positioning signal generates current location information of the at least one recording terminal.

In some embodiments, obtaining the location information of the at least one recording terminal in the two-way transceiver mode includes: receiving a positioning start signal sent by the at least one recording terminal in a broadcast manner; The terminal sends a response signal; receives a second positioning signal sent by the at least one recording terminal, and generates current location information of the at least one recording terminal according to the second positioning signal.

In some embodiments, each recording terminal corresponds to a sound object, and the position of the recording terminal moves along with the sound source of the sound object.

In some embodiments, the method further includes: obtaining initial position information of the at least one sound object.

In some embodiments, synthesizing the sound data and current location information of at least one sound object to generate object audio data includes: obtaining audio parameters, and using the audio parameters as the object audio data. header file information of the data; at each sampling moment, the sound data of each sound object is saved as the object audio signal, and the current position information is saved as the object audio auxiliary data to generate the object audio data.

In some embodiments, the method further includes: saving the sound data and the current location information in frame units.

In a second aspect, embodiments of the present disclosure provide a device for generating object audio data. The device for generating object audio data includes: a data acquisition unit configured to acquire sound data of at least one sound object; and an information acquisition unit configured to In order to obtain the current position information of the at least one sound object; a data generation unit is configured to synthesize the sound data and the current position information of the at least one sound object to generate object audio data.

In some embodiments, the information acquisition unit is specifically configured to: acquire the current location information of at least one recording terminal that records the sound data of the at least one sound object.

In some embodiments, the device further includes: a synchronization processing unit configured to synchronize the sound data of the at least one sound object and the current location information.

In some embodiments, the information acquisition unit is specifically configured to acquire the current location information of the at least one recording terminal in a one-way transceiver mode, a two-way transceiver mode, or a hybrid transceiver mode.

In some embodiments, the information acquisition unit includes: a first information acquisition module configured to acquire the first positioning reference information in the one-way transceiver mode; a second information acquisition module configured to acquire the first positioning reference information in the two-way transceiver mode. The transceiver mode acquires second positioning reference information; the first current information acquisition module is configured to determine the current position information of the at least one recording terminal according to the first positioning reference information and the second positioning reference information.

In some embodiments, the first positioning reference information is one of angle information and distance information, and the second positioning reference information is the other one of the angle information and the distance information.

In some embodiments, the information acquisition unit includes: a second current information acquisition module configured to receive a first positioning signal sent by the at least one recording terminal in a broadcast manner, and generate a generated positioning signal based on the first positioning signal. The current location information of the at least one recording terminal.

In some embodiments, the information acquisition unit includes: a signal receiving module configured to receive a positioning start signal sent by the at least one recording terminal in a broadcast manner; a signal sending module configured to send a signal to the at least one recording terminal. The recording terminal sends a response signal; the third current information acquisition module is configured to receive the second positioning signal sent by the at least one recording terminal, and generate the current location information of the at least one recording terminal according to the second positioning signal.

In some embodiments, each recording terminal corresponds to a sound object, and the position of the recording terminal moves along with the sound source of the sound object.

In some embodiments, the device further includes: an initial position acquisition unit configured to acquire initial position information of the at least one sound object.

In some embodiments, the data generation unit includes: a parameter acquisition module configured to acquire audio parameters and use the audio parameters as header file information of the object audio data; an audio data generation module configured to At each sampling moment, the sound data of each sound object is saved as an object audio signal, and the current position information is saved as object audio auxiliary data to generate the object audio data.

In some embodiments, the data generation unit further includes: a processing module configured to save the sound data and the current location information in frame units.

In a third aspect, embodiments of the present disclosure provide an electronic device, which includes: at least one processor; and a memory communicatively connected to the at least one processor; wherein the memory stores information that can be used by the at least one processor. Instructions executed by the processor, the instructions being executed by the at least one processor, so that the at least one processor can execute the method described in the first aspect.

In a fourth aspect, embodiments of the present disclosure provide a non-transitory computer-readable storage medium storing computer instructions, wherein the computer instructions are used to cause the computer to execute the method described in the first aspect.

In a fifth aspect, embodiments of the present disclosure provide a computer program product, including computer instructions, characterized in that, when executed by a processor, the computer instructions implement the method described in the first aspect.

It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only, and do not limit the present disclosure.

Description of the drawings

In order to more clearly illustrate the technical solutions in the embodiments of the disclosure or the background technology, the drawings required to be used in the embodiments or the background technology of the disclosure will be described below.

Figure 1 is a flow chart of a method for generating object audio data provided by an embodiment of the present disclosure;

Figure 2 is a flow chart of another method for generating object audio data provided by an embodiment of the present disclosure;

Figure 3 is a flow chart of yet another method for generating object audio data provided by an embodiment of the present disclosure;

Figure 4 is a flow chart of yet another method for generating object audio data provided by an embodiment of the present disclosure;

Figure 5 is a flow chart of yet another method for generating object audio data provided by an embodiment of the present disclosure;

Figure 6 is a flow chart of yet another method for generating object audio data provided by an embodiment of the present disclosure;

Figure 7 is a structural diagram of a device for generating object audio data provided by an embodiment of the present disclosure;

Figure 8 is a structural diagram of another device for generating object audio data provided by an embodiment of the present disclosure;

Figure 9 is a structural diagram of an information acquisition unit in the device for generating object audio data provided by an embodiment of the present disclosure;

Figure 10 is a structural diagram of another information acquisition unit in the device for generating object audio data provided by an embodiment of the present disclosure;

Figure 11 is a structural diagram of yet another information acquisition unit in the device for generating object audio data provided by an embodiment of the present disclosure;

Figure 12 is a structural diagram of yet another device for generating object audio data provided by an embodiment of the present disclosure;

Figure 13 is a structural diagram of a data generation unit in the device for generating object audio data provided by an embodiment of the present disclosure;

FIG. 14 is a structural diagram of an electronic device according to an embodiment of the present disclosure.

Detailed ways

In order to allow ordinary people in the art to better understand the technical solutions of the present disclosure, the technical solutions in the embodiments of the present disclosure will be clearly and completely described below in conjunction with the accompanying drawings.

Unless the context requires otherwise, throughout the specification and claims, the term "including" is to be interpreted in an open, inclusive sense, that is, "including, but not limited to." In the description of this specification, the terms "some embodiments" and the like are intended to indicate that a particular feature, structure, material, or characteristic associated with the embodiment or example is included in at least one embodiment or example of the present disclosure. The schematic representations of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials or characteristics described may be included in any suitable manner in any one or more embodiments or examples.

It should be noted that the terms "first", "second", etc. in the description, claims and drawings of the present disclosure are used to distinguish similar objects and are not necessarily used to describe a specific order or sequence. The terms “first” and “second” are used for descriptive purposes only and shall not be understood as indicating or implying relative importance or implicitly indicating the quantity of indicated technical features. Therefore, features defined as "first" and "second" may explicitly or implicitly include one or more of these features. It is to be understood that the data so used are interchangeable under appropriate circumstances so that the embodiments of the disclosure described herein can be practiced in sequences other than those illustrated or described herein. The implementations described in the following exemplary embodiments do not represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with aspects of the disclosure as detailed in the appended claims.

At least one in the present disclosure can also be described as one or more, and the plurality can be two, three, four or more, and the present disclosure is not limited. In the embodiment of the present disclosure, for a technical feature, the technical feature is distinguished by “first”, “second”, “third”, “A”, “B”, “C” and “D” etc. The technical features described in "first", "second", "third", "A", "B", "C" and "D" are in no particular order or order.

The corresponding relationships shown in each table in this disclosure can be configured or predefined. The values of the information in each table are only examples and can be configured as other values, which is not limited by this disclosure. When configuring the correspondence between information and each parameter, it is not necessarily required to configure all the correspondences shown in each table. For example, in the table in this disclosure, the corresponding relationships shown in some rows may not be configured. For another example, appropriate deformation adjustments can be made based on the above table, such as splitting, merging, etc. The names of the parameters shown in the titles of the above tables may also be other names understandable by the communication device, and the values or expressions of the parameters may also be other values or expressions understandable by the communication device. When implementing the above tables, other data structures can also be used, such as arrays, queues, containers, stacks, linear lists, pointers, linked lists, trees, graphs, structures, classes, heaps, hash tables or hash tables. wait.

Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented with electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each specific application, but such implementations should not be considered to be beyond the scope of this disclosure.

In the related technology, the object audio data acquisition method cannot realize the direct recording of the object audio data and cannot obtain the real sound object position information. Embodiments of the present disclosure provide a method, device, electronic device and storage medium for generating object audio data to accurately obtain the location information of each sound object in real time and record and generate object audio data in real time to solve problems in related technologies. .

Specifically, the method, device, electronic device, and storage medium for generating object audio data provided by embodiments of the present disclosure are described in detail below with reference to the accompanying drawings.

It should be noted that the method for generating object audio data in the embodiment of the present disclosure can be executed by the device for generating object audio data according to the embodiment of the present disclosure. The device for generating object audio data can be implemented by software and/or hardware. The object The audio data generating device may be configured in an electronic device, and the electronic device may install and run the target audio data generating program. Among them, electronic devices may include but are not limited to smartphones, tablet computers and other hardware devices with various operating systems.

In the embodiment of the present disclosure, position information: refers to the position information of each microphone or sound object relative to the listener when the listener (Audience) is taken as the origin. The position information can be expressed in a rectangular coordinate system (xyz) or a spherical coordinate system (θ, γ, r). They can be converted by the following formula (1).

In formula (1), xyz respectively represent the position coordinates of the microphone or sound object on the x-axis (front-back direction), y-axis (left-right direction), and z-axis (up-down direction) of the rectangular coordinate system. θ, γ, and r respectively represent the horizontal angle of the microphone or sound object on the spherical coordinate system (the angle between the mapping of the microphone or sound object and the origin on the horizontal plane and the x-axis); the vertical angle (the angle between the microphone or sound object and the origin) The angle between the line connecting the object and the origin and the horizontal plane); and the straight-line distance of the microphone or sound object from the origin.

The aforementioned position information is position information in a three-dimensional coordinate system. If it is in a two-dimensional coordinate system, the position information can be expressed in the rectangular coordinate system (x, y) or in the polar coordinate system (θ, r). They can be converted by the following formula (2).

x＝rcosθ

y＝sinθ (2)

The meaning of each variable in formula (2) is consistent with formula (1).

No matter what coordinate system (rectangular coordinate system, spherical coordinate system, or other coordinate system) is used to express it, or the transformation form such as changing the origin of the coordinate system does not affect the specific implementation of the disclosure, nor does it affect the assertion of rights in the disclosure.

Therefore, in the description of this disclosure, for simplicity, the position information will be expressed in a spherical coordinate system (polar coordinate system).

In this disclosed embodiment, object audio (Object Audio) generally refers to various sound formats that can describe sound objects (Audio Object). Point sound objects containing position information, or surface sound objects that can roughly determine the center position can be used as audio objects (Audio Object). Object Audio (Object Audio) generally consists of two parts, the sound signal itself (Audio Data), and the accompanying position information (Object Audio Metadata). Among them, the sound signal itself can be regarded as a mono audio signal, which can be in the form of PCM (Pulse-code modulation), DSD (Direct Stream Digital) and other uncompressed formats, or it can be MP3 (MPEG-1 or MPEG-2 Audio Layer III), AAC (Advanced Audio Coding), Dolby Digital and other compression formats. The attached position information is the position information shown in 1. above at any time t.

If there are multiple object audios, the format can be a separate combination of the sound signal and position information of each object audio; it can also be a combination of the sound signals of all objects, the position information is combined, and the sound signal or position information is combined. Corresponding information of which sound signal corresponds to which position information is added.

Please refer to FIG. 1 , which is a flow chart of a method for generating object audio data provided by an embodiment of the present disclosure.

As shown in Figure 1, the method may include but is not limited to the following steps:

S1, obtain sound data of at least one sound object.

In the embodiment of the present disclosure, to obtain the sound data of at least one sound object, the sound signal of the sound object can be recorded through a sound collection device to obtain the sound data of the sound object. The at least one sound object can include one or more sound objects, including one In the case of a sound object, the sound signal of the sound object is recorded by one sound collecting device. In the case of multiple sound objects, the sound signals of multiple sound objects are recorded by multiple sound collecting devices.

The sound collection device may be a device capable of collecting sound information, such as a microphone, which is not specifically limited in the embodiments of the present disclosure.

S2, obtain the current location information of at least one sound object.

In the embodiment of the present disclosure, obtaining the current location information of the sound object may be to obtain the current location information of the sound object while obtaining the sound data of the sound object, so as to obtain the sound data and location information of the sound object in real time.

Among them, for each sound object, the sound data of the sound object is obtained, and the sound data of the sound object can be obtained through one or more sound collection devices. In the embodiment of the present disclosure, the current position information of the sound object is obtained, relative to the sound collection device. When the relative position of the sound object is fixed, the current position information of the sound collection device can be obtained, and the current position information of the sound object can be determined based on the relative position relationship between the sound collection device and the sound object.

In the embodiment of the present disclosure, when the relative position of the sound collection device and the sound object is fixed, the sound object moves, and the sound collection device moves with the movement of the sound object, so that the position information of each sound object can be obtained in real time.

It should be noted that in the embodiment of the present disclosure, the current location information of the sound collection device can be obtained through the ultrasonic positioning method. For example, the sound collection device is provided with an ultrasonic transceiver device, and the ultrasonic signal in the sound collection device is collected. The current location information of the sound collection device can be obtained. Alternatively, other methods may be used, and the embodiments of the present disclosure do not specifically limit this.

S3: Synthesize the sound data of at least one sound object and the current location information to generate object audio data.

In the embodiment of the present disclosure, when the sound data and current location information of at least one sound object are obtained and the sound data and location information of the sound object are obtained in real time, the sound data and current location information of the sound object are synthesized to generate an object. audio data.

Among them, the sound data of the sound object and the current location information are synthesized. The sound data and the current location information can be combined according to time and saved in a specific file storage format to generate the object audio data.

By implementing embodiments of the present disclosure, sound data of at least one sound object is obtained; current position information of at least one sound object is obtained; sound data and current position information of at least one sound object are synthesized to generate object audio data. As a result, the position information of each sound object can be accurately obtained in real time, and the object audio data can be recorded and generated in real time.

As shown in Figure 2, the method may include but is not limited to the following steps:

S21, obtain the sound data of at least one sound object.

For the relevant description of S21, please refer to the relevant description in the above embodiment, and will not be described again here.

S22, obtain the current location information of at least one sound object.

In the embodiment of the present disclosure, obtaining the current location information of the sound object may be to obtain the current location information of the sound object while obtaining the sound data of the sound object, so as to obtain the sound data and location information of the sound object in real time.

In some embodiments, obtaining the current location information of at least one sound object includes: obtaining the current location information of at least one recording terminal that records the sound data of the at least one sound object.

In the embodiment of the present disclosure, the sound signal of the sound object can be recorded through the recording terminal, and the sound data of the sound object can be obtained. Wherein, when there is one sound object, the sound data of the sound object can be recorded through one recording terminal; when there are multiple sound objects, the sound data of the sound object can be recorded through multiple recording terminals.

The recording terminal includes a microphone, and the sound data of the sound object can be recorded through the microphone in the recording terminal.

In the embodiment of the present disclosure, the current location information of at least one sound object is obtained. The current location information of the recording terminal that records the sound data of the sound object can be obtained. In the case where one or more sound objects exist, the current location information of the recording terminal that records one or more sound objects can be obtained. The current location information of the recording terminal of the sound data of the sound object.

In some embodiments, obtaining the current location information of at least one recording terminal that records sound data of at least one sound object includes: obtaining the current location information of at least one recording terminal in a one-way transceiver mode, a two-way transceiver mode, or a hybrid transceiver mode.

In the embodiment of the present disclosure, the current location information of at least one recording terminal that records the sound data of at least one sound object is obtained. If there is a sound object, the current location information of at least one recording terminal that records the sound data of the sound object is obtained. Information, when there are multiple sound objects, obtain the current location information of at least one recording terminal that records the sound data of each sound object.

Among them, the current location information of the recording terminal can be obtained through a one-way transceiver method, or the current location information of at least one recording terminal can be obtained through a two-way transceiver method, or the current location information of the recording terminal can be obtained through a hybrid transceiver method.

Among them, the current location information of the recording terminal is obtained through a hybrid transceiver method, and the current location information of the recording terminal can be obtained through a one-way transceiver method and a two-way transceiver method.

In some embodiments, obtaining the location information of at least one recording terminal in a hybrid transceiver mode includes: obtaining the first positioning reference information in a one-way transceiver mode; acquiring the second positioning reference information in a two-way transceiver mode; and obtaining the second positioning reference information according to the first positioning reference information. and the second positioning reference information to determine the current location information of at least one recording terminal.

In the embodiment of the present disclosure, the location information of the recording terminal is obtained through a hybrid transceiver method. The first positioning reference information can be obtained through a one-way transceiver method, and the second positioning reference information can be obtained through a two-way transceiver method. According to the first positioning reference information and The second positioning reference information determines the current location information of the recording terminal.

Wherein, the first positioning reference information and the second positioning reference information are different.

In some embodiments, the first positioning reference information is one of angle information and distance information, and the second positioning reference information is the other one of angle information and distance information.

In the embodiment of the present disclosure, the location information of the recording terminal is obtained through a hybrid transceiver method, the angle information can be obtained through a one-way transceiver method, and the distance information can be obtained through a two-way transceiver method, and the current location information of the recording terminal is determined based on the angle information and distance information. .

Alternatively, in the embodiment of the present disclosure, the location information of the recording terminal is obtained through a hybrid transceiver method, the distance information can be obtained through a one-way transceiver method, and the angle information can be obtained through a two-way transceiver method, and the current location of the recording terminal is determined based on the distance information and angle information. location information.

In the embodiment of the present disclosure, the first positioning reference information and the second positioning reference information can be obtained through sound waves or ultrasonic waves, or can also be obtained through electromagnetic wave signals such as UWB (Ultra Wide Band) or WiFi or BT.

In some embodiments, obtaining the current location information of at least one recording terminal in a one-way transceiver mode includes: receiving a first positioning signal sent by at least one recording terminal in a broadcast manner, and generating a location information of at least one recording terminal based on the first positioning signal. Current location information.

In the embodiment of the present disclosure, the current location information of the recording terminal is obtained through a one-way transceiver method, by receiving the first positioning signal sent by the recording terminal in a broadcast manner, and generating the current location information of the recording terminal based on the first positioning signal. Among them, the current location information of the recording terminal can be obtained through the TDOA (time difference of arrival) method.

Among them, the first positioning signal sent by the recording terminal in the broadcast mode can be a sound wave or an ultrasonic wave, or it can also be an electromagnetic wave signal such as UWB (Ultra Wide Band), WiFi or BT.

In some embodiments, obtaining the location information of at least one recording terminal in a two-way transceiver mode includes: receiving a positioning start signal sent by at least one recording terminal in a broadcast mode; sending a response signal to at least one recording terminal; receiving at least one recording terminal The second positioning signal is sent, and the current position information of at least one recording terminal is generated according to the second positioning signal.

In the embodiment of the present disclosure, the current location information of the recording terminal is obtained through a two-way transceiver method, by receiving the positioning start signal sent by the recording terminal in a broadcast mode, sending a response signal to the recording terminal, and receiving the second positioning signal sent by the recording terminal. And generate the current location information of the recording terminal according to the second positioning signal. Among them, the location information of at least one recording terminal can be obtained through the TOF (time of flight) method.

Among them, the positioning start signal sent by the recording terminal in a broadcast manner can be a sound wave or an ultrasonic wave, or it can also be an electromagnetic wave signal such as UWB (Ultra Wide Band) or WiFi or BT.

The second positioning signal sent by the recording terminal can be a sound wave or an ultrasonic wave, or it can also be an electromagnetic wave signal such as UWB (Ultra Wide Band) or WiFi or BT.

In some embodiments, each recording terminal corresponds to a sound object, and the position of the recording terminal moves along with the sound source of the sound object.

In the embodiment of the present disclosure, each recording terminal corresponds to a sound object. If there is a sound object, the corresponding sound object records the sound data of the sound object through one or more recording terminals.

The position of the recording terminal moves with the sound source of the sound object. It can be understood that, in the embodiment of the present disclosure, obtaining the current position information of at least one sound object includes: obtaining at least one recording of the sound data of the at least one sound object. The current location information of the terminal. The recording terminal corresponds to a sound object, and the positions of the recording terminal and the sound source of the sound object are relatively fixed. When the sound source of the sound object moves, the recording terminal moves along with the movement of the sound source of the sound object.

In some embodiments, initial position information of at least one sound object is obtained.

In the embodiment of the present disclosure, the initial position information of the sound object and the current position information of the sound object are obtained, and the sound data of the sound object is obtained, thereby obtaining the sound data and position information of the sound object in real time.

Among them, the sound data, initial position information and current position information of the sound object are obtained, and the sound data and position information of the sound object can be obtained in real time.

S23: Synchronize the sound data and current location information of at least one sound object.

In the embodiment of the present disclosure, when the sound data and the current location information of the sound object are obtained, the sound data and the current location information of the sound object are synchronized. The sound data and the current location information can be synchronized according to time.

S24: Synthesize the sound data of at least one sound object and the current location information to generate object audio data.

In the embodiment of the present disclosure, when the sound data and current location information of at least one sound object are obtained and the sound data and location information of the sound object are obtained in real time, the sound data and current location information of the sound object are synthesized to generate an object. audio data.

In some embodiments, synthesizing the sound data of at least one sound object and the current position information to generate the object audio data includes: obtaining audio parameters and using the audio parameters as header file information of the object audio data; in each sample At each moment, the sound data of each sound object is saved as the object audio signal, and the current position information is saved as the object audio auxiliary data to generate the object audio data.

In the embodiment of the present disclosure, the generated object audio data can be stored in multiple storage formats, such as a first format saved as a file, a second format that can be played in real time, etc.

For example, in the first format: file packing mode[], the sound data of at least one sound object will be combined into one audio information, and its storage method can be raw-pcm format or uncompressed wav format (this When a single sound object is regarded as a channel of a wav file), it can also be encoded into various compression formats. The current position information of at least one sound object will also be combined and saved as object audio auxiliary data (Object Audio metadata).

For example, the second format: low delay mode[], with a certain length of time as one frame (frame), inside each frame, save it in the same format as file packing mode, and combine the sound data at this time with The current position information is concatenated together to become the object audio data of the frame. At this time, the target audio data of each frame is sent to the playback device or saved in chronological order.

Among them, in the embodiment of the present disclosure, to obtain the audio parameters, you can obtain the sampling rate (Sampling rate), bit width (bit depth), the number of sound objects N _obj (Number of objects s), etc., and use the audio parameters as the object audio data header file information, for each sampling moment, the sound data of each sound object is saved as the object audio signal, and the current position information is saved as the object audio auxiliary data to generate the object audio data.

声音对象的声音数据

In a possible implementation, as shown in Figure 3, [s51] obtains the number of sound objects N _obj and the current position information of at least one sound object after synchronization

Sound data for sound objects

[s52] Determine the storage format and determine whether to save/transmit in file packing mode or low delay mode.

[s53a] Record the basic parameters of audio, such as sampling rate (Sampling rate), bit width (bit depth), number of sound objects N _obj (Number of objects s), etc. as header file information into the target audio file.

[s54a] When it is determined that it is file packing mode, the object audio information is saved according to file packing mode, as follows:

[s541a] Save the object sound information in raw-pcm format, as follows:

按声音源的自然顺序进行保存，每个声音对象的声音数据占据长度为wBitsPerSample比特。 For the first sampling time, the sound data of the sound object obtained from the audio data sampled at time t=1 is obtained.

Saved in the natural order of sound sources, the sound data of each sound object occupies a length of wBitsPerSample bits.

按声音源的自然顺序记录在t-1时刻得到的声音对象的对象音频信号

之后，每个声音对象的声音数据占据长度为wBitsPerSample比特。 At each subsequent sampling time t, the sound data of the sound object sampled at time t will be obtained.

Record the object audio signal of the sound object obtained at time t-1 according to the natural order of the sound source.

After that, the sound data of each sound object occupies a length of wBitsPerSample bits.

Its saving format can be seen in Table 1 below:

Table 1

作为对象音频辅助数据进行保存，在第一个采样点，按声音源的自然顺序进行保存，保存格式参见下表2： [s542a] The current location information of at least one sound object will be obtained

It is saved as object audio auxiliary data. At the first sampling point, it is saved in the natural order of the sound sources. For the saving format, see Table 2 below:

Table 2

Among them, each parameter is: iSampleOffset: the serial number of the sampling point;

Object Object_index: the serial number of the currently recorded audio source;

Object Object_Azimuth: θ of the currently recorded sound source;

Object Object_Elevation: γ of the currently recorded sound source;

Object Object_Radius: r of the currently recorded audio source.

At subsequent sampling points, determine whether at least one sound object has a change in position. If so, save the sound source whose position has changed at the sampling point. See Table 2 above for the storage format.

Among them, a certain time interval can be specified, such as N sampling points being judged and saved at one time to save storage space.

[s55a] In the embodiment of the present disclosure, the audio parameters as the header file information of the object audio data, the sound data of the sound object as the object audio signal, and the current position information as the object audio auxiliary data are spliced to generate a complete Object audio data.

Among them, the splicing methods are shown in Table 3 to Table 6 below:

table 3

Table 4

table 5

Table 6

声音对象的声音数据

In another possible implementation, as shown in Figure 3, the number of sound objects N _obj and the synchronized current position information of at least one sound object are obtained.

Sound data for sound objects

[s53b] Get the audio parameters, you can get the sampling rate (Sampling rate), bit width (bit depth), the number of sound objects N _obj (Number of objects s), etc., and use the audio parameters as the header file information of the object audio data, [s54b] When the storage format is the second format low delay mode[], the object audio data is saved in low delay mode, as follows:

按声音源的自然顺序进行保存，每个声音对象的声音数据占据长度为wBitsPerSample比特。 [s541b] Taking the frame as a unit, for all the sampling points contained in the current frame, for the first sampling time, the sound data of the sound object obtained from the audio data sampled at t=1 time will be obtained

Saved in the natural order of sound sources, the sound data of each sound object occupies a length of wBitsPerSample bits.

在之后每一个采样时刻t，将获取的对t时刻采样得到的声音对象的声音数据

按声音源的自然顺序记录在t-1时刻得到的声音对象的对象音频信号

之后，每个声音对象的声音数据占据长度为wBitsPerSample比特。 [s542b] In frame units, the position information of the sound objects of all sampling points contained in the current frame is

At each subsequent sampling time t, the sound data of the sound object sampled at time t will be obtained.

Record the object audio signal of the sound object obtained at time t-1 according to the natural order of the sound source.

After that, the sound data of each sound object occupies a length of wBitsPerSample bits.

Among them, the saving format is shown in Table 1 above.

[s543b] In the embodiment of the present disclosure, the audio parameters as the header file information of the object audio data, the sound data of the sound object as the object audio signal, and the current position information as the object audio auxiliary data are spliced to generate a complete Object audio data.

Among them, the splicing methods are shown in Table 7 to Table 9 below:

Table 7

Table 8

Table 9

In some embodiments, the method further includes: saving the sound data and current location information in frame units.

[s55] In the embodiment of the present disclosure, the header file information is first recorded or transmitted. For each frame, the recorded sound data of the sound object and the recorded object audio auxiliary data (Object Audio metadata) are spliced to become the object of the frame. audio information. The object audio data of each frame is spliced in chronological order and saved, or directly transmitted after obtaining one frame of object audio data each time to achieve low delay transmission. The combined object audio data is saved in memory or disk as needed, or transferred to the playback device, or encoded into MPEG-H 3D Audio format, or Dolby Atmos format or other supported object audio ( Object Audio) encoding format and save or transmit it.

By implementing the embodiments of the present disclosure, positioning technology can be used to obtain the current location information of each sound object in real time and accurately. Instead of post-production software, the object audio data can be recorded and generated in real time.

For ease of understanding, the embodiment of the present disclosure provides an exemplary embodiment.

As shown in Figure 4, in one possible implementation, in the embodiment of the present disclosure, the sound data of the sound object is obtained through a recording terminal. Each sound object collects sound data through a recording terminal, and multiple recording terminals obtain multiple The sound data of the sound object is sent to the recording module to obtain the sound data of at least one sound object.

Among them, the recording terminal can send a positioning signal, which is received by several receiving ends (antennas or microphones) in the positioning module. Figure 4 shows that the sound signal is transmitted to the recording module in a wired manner, but it can also be transmitted wirelessly (WiFi or BT, etc.), the receiving end in the positioning module receives the positioning signal sent by the recording terminal, and obtains the current location information of the sound object.

It should be noted that FIG. 4 only shows the situation of obtaining the current location information of the sound object using the one-way transceiver method. In the embodiment of the present disclosure, the current location information of the sound object can also be obtained using the two-way transceiver method, or the hybrid transceiver method. , among them, when the two-way transceiver mode is adopted, in addition to sending positioning signals, the recording terminal can also send positioning start signals as needed, and can also receive response signals returned by the positioning module. The positioning module can accept the positioning sent by the recording terminal. In addition to the signal and initial positioning signal, a response signal can also be sent.

As shown in FIG. 5 , in the embodiment of the present disclosure, when recording object audio data of a sound object, the sound signal of the corresponding sound object is first recorded through each recording device, and a ranging signal is emitted. Obtain the sound information (sound data) and the position information (current position information) of the sound object respectively; synchronize the sound information (sound data) and position information (current position information) of the sound object, and then combine the sounds of each sound object information (sound data) and position information (current position information) to generate a complete object audio signal (object audio data), thereby completing the recording of the object audio data.

As shown in Figure 6, the process of combining the sound information (sound data) and position information (current position information) of each sound object to generate a complete object audio signal (object audio data) may specifically include:

[S301] Obtain the number N of sound objects, the characteristic parameters of the positioning signals transmitted by each recording terminal, and the position information of the positioning module. Among them, the number N of sound objects and the characteristic parameters of the positioning signals emitted by each recording terminal can be agreed in advance, or can be synchronously transmitted to the recording module by each recording terminal when sending the sound signal to the recording module, and then the recording module Passed to the positioning module.

[S302] According to the position information of the positioning module, determine the coordinate origin position of the position information. And assign an initial position to each sound object.

[S303] Demodulate the positioning signals received at each receiving device (antenna or microphone) of the positioning module and extract positioning features for subsequent positioning of each recording terminal through the features.

[S304~S311] For each sound object to be located, the position information is determined respectively.

S305 to S306 are to determine whether there is a positioning signal or positioning start signal of a certain sound object from the received positioning characteristics. If so, obtain the information and use different positioning solutions according to the positioning method. For example, when using the one-way transceiver method, the TDOA (time difference of arrival) method is used to obtain the position information of the sound object. When the two-way transceiver method is used, the TOF (time of flight) method is used to obtain the position information of the sound object. Or UWB indoor positioning solution, etc. If the two-way sending and receiving method is adopted, the positioning module must conduct two-way data communication with each recording terminal.

The synchronization module obtains the sound information (sound data) of the sound object from the recording module, obtains the position information (current position information) of the sound object from the positioning module, synchronizes according to time, and synchronizes the sound information (sound data) of the sound object. ) and location information (current location information) are sent to the combination module.

和声音信息(声音数据)

并将声音对象的位置信息(当前位置信息)和声音对象的声音信息(声音数据)进行组合，成为完整的对象音频信号。 The combination module obtains the synchronized position information (current position information) of each sound object from the synchronization module.

and sound information (sound data)

And combine the position information of the sound object (current position information) and the sound information of the sound object (sound data) to form a complete object audio signal.

Depending on the purpose, there are two ways to save the object audio signal, file packing mode[] for saving, and low delay mode[] for real-time playback.

For file packing mode, the sound information (sound data) of each sound object will be combined into a multi-object audio information, which can be saved in raw-pcm format or uncompressed wav format (in this case, a single object Seen as a channel of a wav file), it can also be encoded into various compression formats. The sound object position information of each object will also be combined together and saved as object audio auxiliary data (Object Audio metadata).

For low delay mode, a certain time length τ is specified as a frame. Within each frame, it is saved in the same format as file packing mode, and the sound information and audio auxiliary data at this time are connected together to become Object audio information for this frame. At this time, the audio information of each frame is sent to the playback device or saved in chronological order.

FIG. 7 is a structural diagram of a device for generating object audio data provided by an embodiment of the present disclosure.

As shown in FIG. 7 , the object audio data generating device 1 includes: a data acquisition unit 11 , an information acquisition unit 12 and a data generation unit 13 .

The data acquisition unit 11 is configured to acquire sound data of at least one sound object.

The information acquisition unit 12 is configured to acquire current location information of at least one sound object.

The data generating unit 13 is configured to synthesize the sound data of at least one sound object and the current location information to generate object audio data.

In some embodiments, the information acquisition unit 12 is specifically configured to: acquire the current location information of at least one recording terminal that records the sound data of at least one sound object.

As shown in Figure 8, in some embodiments, the object audio data generating device 1 also includes: a synchronization processing unit 14 configured to synchronize the sound data of at least one sound object and the current location information.

In some embodiments, the information acquisition unit 12 is specifically configured to acquire the current location information of at least one recording terminal in a one-way transceiver mode, a two-way transceiver mode, or a hybrid transceiver mode.

As shown in Figure 9, in some embodiments, the information acquisition unit 12 includes: a first information acquisition module 121, a second information acquisition module 122, and a first current information acquisition module 123.

The first information acquisition module 121 is configured to acquire the first positioning reference information in a one-way sending and receiving manner.

The second information acquisition module 122 is configured to acquire the second positioning reference information in a bidirectional sending and receiving manner.

The first current information acquisition module 123 is configured to determine the current location information of at least one recording terminal based on the first positioning reference information and the second positioning reference information.

In some embodiments, the first positioning reference information is one of angle information and distance information, and the second positioning reference information is the other one of angle information and distance information.

As shown in Figure 10, in some embodiments, the information acquisition unit 12 includes: a second current information acquisition module 124, configured to receive a first positioning signal sent by at least one recording terminal in a broadcast manner, and according to the first positioning The signal generates current location information of at least one recording terminal.

As shown in Figure 11, in some embodiments, the information acquisition unit 12 includes: a signal receiving module 125, a signal sending module 126 and a third current information acquiring module 127.

The signal receiving module 125 is configured to receive a positioning start signal sent by at least one recording terminal in a broadcast manner.

The signal sending module 126 is configured to send a response signal to at least one recording terminal.

The third current information acquisition module 127 is configured to receive a second positioning signal sent by at least one recording terminal, and generate current location information of at least one recording terminal according to the second positioning signal.

In some embodiments, each recording terminal corresponds to a sound object, and the position of the recording terminal moves along with the sound source of the sound object.

As shown in Figure 12, in some embodiments, the object audio data generating device 1 further includes: an initial position acquisition unit 15 configured to acquire initial position information of at least one sound object.

As shown in Figure 13, in some embodiments, the data generation unit 13 includes: a parameter acquisition module 131 and an audio data generation module 132.

The parameter acquisition module 131 is configured to acquire audio parameters and use the audio parameters as header file information of the object audio data.

The audio data generation module 132 is configured to, at each sampling moment, save the sound data of each sound object as the object audio signal, and save the current position information as the object audio auxiliary data, to generate the object audio data.

Please continue to refer to Figure 13. In some embodiments, the data generation unit 13 also includes: a processing module 133.

The processing module 133 is configured to save the sound data and current location information in frame units.

Regarding the devices in the above embodiments, the specific manner in which each module performs operations has been described in detail in the embodiments related to the method, and will not be described in detail here.

The object audio data generation device provided by the embodiments of the present disclosure can perform the object audio data generation method as described in some of the above embodiments, and its beneficial effects are the same as those of the object audio data generation method described above, which are not mentioned here. Again.

FIG. 14 is a structural diagram of an electronic device 100 used for a method of generating object audio data according to an exemplary embodiment.

Illustratively, the electronic device 100 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, or the like.

As shown in FIG. 14 , the electronic device 100 may include one or more of the following components: a processing component 101 , a memory 102 , a power supply component 103 , a multimedia component 104 , an audio component 105 , an input/output (I/O) interface 106 , and a sensor. component 107, and communications component 108.

The processing component 101 generally controls the overall operations of the electronic device 100, such as operations associated with display, phone calls, data communications, camera operations, and recording operations. The processing component 101 may include one or more processors 1011 to execute instructions to complete all or part of the steps of the above method. Additionally, processing component 101 may include one or more modules that facilitate interaction between processing component 101 and other components. For example, processing component 101 may include a multimedia module to facilitate interaction between multimedia component 104 and processing component 101 .

Memory 102 is configured to store various types of data to support operations at electronic device 100 . Examples of such data include instructions for any application or method operating on the electronic device 100, contact data, phonebook data, messages, pictures, videos, etc. The memory 102 can be implemented by any type of volatile or non-volatile storage device or a combination thereof, such as SRAM (Static Random-Access Memory), EEPROM (Electrically Erasable Programmable read only memory), which can be Erasable programmable read-only memory), EPROM (Erasable Programmable Read-Only Memory, erasable programmable read-only memory), PROM (Programmable read-only memory, programmable read-only memory), ROM (Read-Only Memory, only read memory), magnetic memory, flash memory, magnetic disk or optical disk.

Power supply component 103 provides power to various components of electronic device 100 . Power supply components 103 may include a power management system, one or more power supplies, and other components associated with generating, managing, and distributing power to electronic device 100 .

Multimedia component 104 includes a touch-sensitive display screen that provides an output interface between the electronic device 100 and the user. In some embodiments, the touch display screen may include LCD (Liquid Crystal Display) and TP (Touch Panel). The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide action. In some embodiments, multimedia component 104 includes a front-facing camera and/or a rear-facing camera. When the electronic device 100 is in an operating mode, such as a shooting mode or a video mode, the front camera and/or the rear camera may receive external multimedia data. Each front-facing camera and rear-facing camera can be a fixed optical lens system or have a focal length and optical zoom capabilities.

Audio component 105 is configured to output and/or input audio signals. For example, the audio component 105 includes a MIC (Microphone), and when the electronic device 100 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode, the microphone is configured to receive an external audio signal. The received audio signals may be further stored in memory 102 or sent via communications component 108 . In some embodiments, audio component 105 also includes a speaker for outputting audio signals.

The I/O interface 2112 provides an interface between the processing component 101 and a peripheral interface module. The peripheral interface module may be a keyboard, a click wheel, a button, etc. These buttons may include, but are not limited to: Home button, Volume buttons, Start button, and Lock button.

Sensor component 107 includes one or more sensors for providing various aspects of status assessment for electronic device 100 . For example, the sensor component 107 can detect the open/closed state of the electronic device 100, the relative positioning of components, such as the display and the keypad of the electronic device 100, the sensor component 107 can also detect the electronic device 100 or an electronic device 100. The position of components changes, the presence or absence of user contact with the electronic device 100 , the orientation or acceleration/deceleration of the electronic device 100 and the temperature of the electronic device 100 change. Sensor assembly 107 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor component 107 may also include a light sensor, such as a CMOS (Complementary Metal Oxide Semiconductor) or a CCD (Charge-coupled Device) image sensor for use in imaging applications. In some embodiments, the sensor component 107 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.

Communication component 108 is configured to facilitate wired or wireless communication between electronic device 100 and other devices. The electronic device 100 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In one exemplary embodiment, the communication component 108 receives broadcast signals or broadcast related information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 108 also includes an NFC (Near Field Communication) module to facilitate short-range communication. For example, the NFC module can be based on RFID (Radio Frequency Identification) technology, IrDA (Infrared Data Association) technology, UWB (Ultra Wide Band) technology, BT (Bluetooth, Bluetooth) technology and other Technology to achieve.

In an exemplary embodiment, the electronic device 100 may be configured by one or more ASIC (Application Specific Integrated Circuit), DSP (Digital Signal Processor, digital signal processor), digital signal processing device (DSPD), PLD ( Programmable Logic Device, Programmable Logic Device), FPGA (Field Programmable Gate Array, Field Programmable Logic Gate Array), controller, microcontroller, microprocessor or other electronic components, used to perform the generation of audio data for the above objects method. It should be noted that for the implementation process and technical principles of the electronic device in this embodiment, please refer to the aforementioned explanation of the method for generating object audio data in this embodiment of the present disclosure, and will not be described again here.

The electronic device 100 provided by the embodiments of the present disclosure can perform the object audio data generation method as described in some of the above embodiments, and its beneficial effects are the same as those of the object audio data generation method described above, which will not be described again here.

In order to implement the above embodiments, the present disclosure also proposes a storage medium.

Wherein, when the instructions in the storage medium are executed by the processor of the electronic device, the electronic device can execute the method of generating the object audio data as described above. For example, the storage medium can be ROM (Read Only Memory Image, read-only memory), RAM (Random Access Memory, random access memory), CD-ROM (Compact Disc Read-Only Memory, compact disc read-only memory) , tapes, floppy disks and optical data storage devices, etc.

In order to implement the above embodiments, the present disclosure also provides a computer program product. When the computer program is executed by a processor of an electronic device, the electronic device can perform the object audio data generating method as described above.

Other embodiments of the disclosure will be readily apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed herein. This application is intended to cover any variations, uses, or adaptations of the disclosure that follow the general principles of the disclosure and include common knowledge or customary technical means in the technical field that are not disclosed in the disclosure. . It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

Those skilled in the art can clearly understand that for the convenience and simplicity of description, the specific working processes of the systems, devices and units described above can be referred to the corresponding processes in the foregoing method embodiments, and will not be described again here.

The above are only specific embodiments of the present disclosure, but the protection scope of the present disclosure is not limited thereto. Any person familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present disclosure. should be covered by the protection scope of this disclosure. Therefore, the protection scope of the present disclosure should be subject to the protection scope of the claims.

Claims (27)

A method for generating object audio data, which is characterized by including: Obtain the sound data of at least one sound object; Obtain the current location information of the at least one sound object; The sound data and current location information of at least one sound object are synthesized to generate object audio data. The method of claim 1, wherein obtaining the current location information of the at least one sound object includes: Obtain the current location information of at least one recording terminal that records the sound data of the at least one sound object. The method according to claim 1 or 2, characterized in that, before synthesizing the sound data of at least one of the sound objects and the current location information, it further includes: Synchronize the sound data of the at least one sound object and the current location information. The method of claim 2, wherein obtaining the current location information of at least one recording terminal that records the sound data of the at least one sound object includes: The current location information of the at least one recording terminal is obtained in a one-way transceiver mode, a two-way transceiver mode or a hybrid transceiver mode. The method of claim 4, wherein the obtaining the location information of the at least one recording terminal in a hybrid sending and receiving manner includes: Obtain the first positioning reference information in the one-way sending and receiving method; Obtain the second positioning reference information in the two-way sending and receiving mode; The current location information of the at least one recording terminal is determined according to the first positioning reference information and the second positioning reference information. The method of claim 5, wherein the first positioning reference information is one of angle information and distance information, and the second positioning reference information is one of the angle information and the distance information. Another of. The method according to any one of claims 4 to 6, characterized in that, obtaining the current location information of the at least one recording terminal in the one-way transceiver mode includes: Receive the first positioning signal sent by the at least one recording terminal in a broadcast manner, and generate the current location information of the at least one recording terminal according to the first positioning signal. The method according to any one of claims 4 to 6, characterized in that, obtaining the location information of the at least one recording terminal in the two-way transceiver mode includes: Receive a positioning start signal sent by the at least one recording terminal in a broadcast manner; Send a response signal to the at least one recording terminal; Receive a second positioning signal sent by the at least one recording terminal, and generate current location information of the at least one recording terminal according to the second positioning signal. The method according to any one of claims 2 to 8, characterized in that each recording terminal corresponds to a sound object, and the position of the recording terminal moves along with the sound source of the sound object. The method of claim 9, further comprising: Obtain initial position information of the at least one sound object. The method according to any one of claims 1 to 10, characterized in that said synthesizing the sound data of at least one of the sound objects and the current location information to generate object audio data includes: Obtain audio parameters and use the audio parameters as header file information of the object audio data; At each sampling moment, the sound data of each sound object is saved as an object audio signal, and the current position information is saved as object audio auxiliary data to generate the object audio data. The method of claim 11, further comprising: The sound data and the current location information are saved in units of frames. A device for generating object audio data, characterized by including: a data acquisition unit configured to acquire sound data of at least one sound object; an information acquisition unit configured to acquire current location information of the at least one sound object; A data generating unit configured to synthesize the sound data of at least one of the sound objects and the current location information to generate object audio data. The device according to claim 13, wherein the information acquisition unit is specifically configured to: Obtain the current location information of at least one recording terminal that records the sound data of the at least one sound object. The device according to claim 13 or 14, characterized in that the device further includes: A synchronization processing unit configured to synchronize the sound data of the at least one sound object and the current location information. The device according to claim 14, wherein the information acquisition unit is specifically configured to The current location information of the at least one recording terminal is obtained in a one-way transceiver mode, a two-way transceiver mode or a hybrid transceiver mode. The device of claim 16, wherein the information acquisition unit includes: The first information acquisition module is configured to acquire the first positioning reference information in the one-way transceiver mode; The second information acquisition module is configured to acquire the second positioning reference information in the two-way sending and receiving mode; The first current information acquisition module is configured to determine the current location information of the at least one recording terminal according to the first positioning reference information and the second positioning reference information. The device of claim 17, wherein the first positioning reference information is one of angle information and distance information, and the second positioning reference information is one of the angle information and the distance information. Another kind of. The device according to any one of claims 16 to 18, characterized in that the information acquisition unit includes: The second current information acquisition module is configured to receive the first positioning signal sent by the at least one recording terminal in a broadcast manner, and generate the current location information of the at least one recording terminal according to the first positioning signal. The device according to any one of claims 16 to 18, characterized in that the information acquisition unit includes: A signal receiving module configured to receive a positioning start signal sent by the at least one recording terminal in a broadcast manner; A signal sending module configured to send a response signal to the at least one recording terminal; The third current information acquisition module is configured to receive the second positioning signal sent by the at least one recording terminal, and generate the current location information of the at least one recording terminal according to the second positioning signal. The device according to any one of claims 14 to 20, wherein each recording terminal corresponds to a sound object, and the position of the recording terminal moves along with the sound source of the sound object. The device according to claim 21, characterized in that the device further includes: An initial position acquisition unit is configured to acquire initial position information of the at least one sound object. The device according to any one of claims 13 to 22, characterized in that the data generating unit includes: A parameter acquisition module configured to acquire audio parameters and use the audio parameters as header file information of the object audio data; The audio data generation module is configured to, at each sampling moment, save the sound data of each sound object as an object audio signal, and save the current position information as object audio auxiliary data, to generate the Object audio data. The device of claim 23, wherein the data generating unit further includes: A processing module configured to save the sound data and the current location information in frame units. An electronic device, characterized by including: at least one processor; and a memory communicatively connected to the at least one processor; wherein, The memory stores instructions executable by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can perform any one of claims 1 to 12 Methods. A non-transitory computer-readable storage medium storing computer instructions, characterized in that the computer instructions are used to cause the computer to execute the method described in any one of claims 1 to 12. A computer program product comprising computer instructions, characterized in that, when executed by a processor, the computer instructions implement the method of any one of claims 1 to 12.

Images