Disclosure of Invention
The application provides a method for obtaining playing data, which solves the problems in the prior art, and simultaneously provides an audio data obtaining device, electronic equipment and a storage medium. In addition, the application also provides a data playing system.
The method for obtaining the play data comprises the following steps:
Obtaining watermark data;
obtaining raw data with audio features to be played to a user;
And obtaining the original data embedded with the watermark data as target data for playing to a user according to the watermark data and the original data with the audio characteristic.
Optionally, the obtaining the original data with audio features to be played to the user includes:
and obtaining the original live audio data which is output by the audio output device in real time and is ready to be live broadcast to the user.
Optionally, the obtaining watermark data includes:
and when the signal intensity corresponding to the original data with the audio characteristics is smaller than a preset signal intensity threshold value, obtaining the watermark data output by the watermark output device.
Optionally, the working frequency of the audio output device when outputting the original live audio data is the same as the working frequency of the watermark output device when outputting the watermark data.
Optionally, the obtaining the original data embedded with the watermark data according to the watermark data and the original data with audio characteristics includes:
obtaining original audio data corresponding to the audio features in the original data with the audio features;
embedding the watermark data in the original audio data to obtain the original audio data embedded with the watermark data as the audio data in the original data embedded with the watermark data.
Optionally, the watermark data includes at least one of the following information:
Copyright information corresponding to the original live audio data;
SMPTE time code information;
play position information of the target data;
playing time information of the target data;
cryptographic signature information for encrypting watermark data in the audio data embedded with the watermark data.
The application also provides a device for obtaining the playing data, which comprises the following steps:
a watermark obtaining unit for obtaining watermark data;
an original data obtaining unit for obtaining original data having audio characteristics to be played to a user;
and the target data obtaining unit is used for obtaining the original data embedded with the watermark data as target audio data for live broadcasting to a user according to the watermark data and the original data with the audio characteristics.
The present application also provides an electronic device including:
Processor, and
The device is powered on and executes the program for obtaining the audio data through the processor, and then the device performs the steps of obtaining watermark data, obtaining original data with audio characteristics to be played to a user, and obtaining the original data embedded with the watermark data as target data for playing to the user according to the watermark data and the original data with the audio characteristics.
The present application also provides a storage medium comprising:
a program for an obtaining method of audio data is stored, the program being executed by a processor to perform the steps of:
The method comprises the steps of obtaining watermark data, obtaining original data with audio characteristics to be played to a user, and obtaining the original data embedded with the watermark data as target data for playing to the user according to the watermark data and the original data with the audio characteristics.
The application also provides a data playing system, which comprises an original data output device, a watermark signal output device, an information processor and a target data player;
The original data output device is used for sending the original data with the audio characteristics to be played to the user to the signal receiver;
The watermark data output device is used for sending watermark data to the information processor;
The information processor is used for obtaining the original data embedded with the watermark data according to the original data with the audio characteristics and the watermark data, and sending the target data to the target data player as target data for playing to a user;
The target data player is used for playing the target data.
Optionally, the sending watermark information to the information processor includes:
And when the signal intensity corresponding to the original data with the audio frequency characteristic is smaller than a preset signal intensity threshold value, the watermark data is sent to the information processor.
Optionally, the operating frequency of the original data outputter is the same as the operating frequency of the watermark data outputter.
Optionally, the obtaining the original data embedded with the watermark data according to the watermark data and the original data with audio characteristics includes:
obtaining original audio data corresponding to the audio features in the original data with the audio features;
embedding the watermark data in the original audio data to obtain the original audio data embedded with the watermark data as the audio data in the original data embedded with the watermark data.
Optionally, the watermark data includes at least one of the following information:
Copyright information corresponding to the original live audio data;
SMPTE time code information;
play position information of the target data;
playing time information of the target data;
Cryptographic signature information for encrypting watermark data in the original data embedded with the watermark data.
Optionally, the information processor comprises a frequency adjusting device;
The frequency adjusting device is used for adjusting the signal frequency corresponding to the original audio data and the signal frequency corresponding to the watermark data, and obtaining the original audio data embedded with the watermark data according to the original audio data and the watermark information after adjusting the signal frequency.
Optionally, the device also comprises a camera and a video receiving device;
The video camera is used for obtaining live image information, obtaining target data played by the target data player, and obtaining the live data for live broadcasting according to the live image information and the target data;
The video receiving device is used for playing the live broadcast data.
Optionally, the device also comprises an audio watermark extraction device;
The audio watermark extraction device is used for obtaining the target data played by the target data player in real time, analyzing the target data and obtaining watermark information in the target data.
Compared with the prior art, the application has the following advantages:
The application provides an audio data obtaining method, which comprises the steps of obtaining watermark data, obtaining original data with audio characteristics to be played to a user, and obtaining the original data embedded with the watermark data as target data for playing to the user according to the watermark data and the original data. Before the original data is played, the method adds watermark data into the original data to obtain target data to be played, so that the target data already carries the watermark data during playing, and meanwhile, transmission of the original data on a server is avoided.
Detailed Description
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application. The present application may be embodied in many other forms than described herein and similarly generalized by those skilled in the art without departing from the spirit of the application and, therefore, the application is not limited to the specific embodiments disclosed below.
The application provides a method, a device, electronic equipment and a storage medium for obtaining playing data. In addition, the application also provides a data playing system, which is described in detail in the following embodiments.
In order to facilitate understanding of the method for obtaining playing data provided by the present application, a description will be given first of all to a data playing system provided by the present application, which provides a basis for a subsequent method for obtaining playing data, please refer to fig. 1, which is a schematic structural diagram of the data playing system provided by the first embodiment of the present application.
The data playing system mainly comprises an original data output device 101, a watermark data output device 102, an information processor 103 and a target data player 104;
the data playing system is mainly applied to live broadcast scenes, and can be online conference live broadcast, online teaching live broadcast, live broadcast of television programs and the like.
The original data outputter 101 is configured to send original data with audio features to be played to the user to the information receiver 103.
The raw data having audio characteristics may be understood as audio data having sound or multimedia data having sound. In the scene provided by the first embodiment of the application, since the online live broadcast scene is involved, and the main purpose of the application is to add watermark data in audio data so as to prevent live broadcast content from being recorded. Based on this, the original data with audio characteristics can be further understood as original audio data sent by a live target sound source, wherein the target sound source is a speaking object in a live process, for example, in an online conference live process, the target sound source is a speaker in the conference.
It will be appreciated that the use of the original data as audio data is only an alternative embodiment provided for the purpose of facilitating understanding of the present application, and in other scenarios, the original data may also be video data containing audio data, for example, in a process of teaching through live video, the original data may also refer to live video data, where the live video data contains video data and audio data.
The raw data may be obtained through a live set-up of a transducer, such as a microphone. The raw data outputter 101 transmits raw data corresponding to sound information of a target sound source transmitted by a sound transducer connected thereto by receiving the sound information and transmitting the raw data to the information processor 103.
A watermark data outputter 102 for sending watermark data to said information processor 103.
The watermark data refers to additional information that needs to be added to a carrier object, where the additional information has a specific meaning, and in the first embodiment of the present application, the carrier object is original audio data sent by the target sound source received by the original data outputter 101. And proper watermark data is added into the original audio data, so that the leakage of the original audio data can be prevented, and the safety of the data is protected. For example, copyright information is added to the sound information of the target sound source as a watermark, so that piracy can be prevented.
In a first embodiment of the application, the watermark data comprises at least one of the following information:
The system comprises copyright information corresponding to original live broadcast audio data, SMPTE time code information, play position information of original target data, play time information of the target data and cryptographic signature information used for encrypting watermark data in the original data embedded with the watermark data.
The SMPTE (The Society of Motion Picture and Television Engineers) time code information is a time code that is typically used to identify and record each frame in a video data stream, i.e., from a start frame to a terminal frame of a video, each frame having unique time code information.
The play position information of the target data can be understood as geographical position information of a live broadcast, for example, specific address information of a live broadcast conference.
The playing time information of the target data may be information of a time of live broadcasting.
The cryptographic signature information used for encrypting the watermark data in the original data embedded with the watermark data is encryption information used for adding the watermark data in the original data.
An information processor 103, configured to obtain the original data and watermark data output by the original data output unit 101 and the watermark data output unit 102, obtain the original data embedded with the watermark data according to the original data and the watermark data, and send the target data to the target data player as target data for playing to a user;
specifically, the method for obtaining the original data embedded with the watermark data as target data for playing to a user according to the original data with audio characteristics and the watermark data comprises the following steps:
Step S101, obtaining original audio data corresponding to the audio features in the original data with the audio features;
Since the first embodiment of the present application is applied to an online live broadcast scene, the original data is the original audio data sent by the target sound source, and therefore, the original audio data corresponding to the audio feature in the original data with the sound feature is the original audio data sent by the target sound source.
Step S102, embedding the watermark data into the original audio data to obtain the original audio data embedded with the watermark data as the audio data in the original data embedded with the watermark data. In the first embodiment of the present application, in the process of sending the original data and watermark data to the information processor by using the corresponding output device, the specific expression form of the original data is a corresponding audio signal, and the specific expression form of the watermark data is a watermark signal.
In the system provided in the first embodiment, the watermark data is added to the original live audio data in a similar manner to the same-frequency interference, and it can be understood that the manner of adding the watermark data can also be applied to other scenes, for example, adding the watermark data in a video with audio characteristics.
As shown in fig. 1, the information processor 103 may receive the original data and watermark data outputted by the original data outputter 101 and watermark data outputter 102 in a wireless manner to obtain a mixed signal. The mixed signal is the original data embedded with the watermark data.
It will be appreciated that there are various ways of information transmission, and that fig. 1 shows only an alternative embodiment of the system according to the present application, and in other embodiments, the information processor 103 may also receive the original live audio data and the watermark data sent by the original data outputter 101 and the watermark data outputter 102 by means of wired transmission.
In the first embodiment of the present application, the information processor 103 may receive the original live audio data and watermark data output by the original data outputter 101 and watermark data outputter 102 in a wired/wireless manner to obtain the original data embedded with the watermark data.
In an alternative embodiment of the present application, in order to ensure that the information processor 103 can receive the original audio data and the watermark data simultaneously, when the corresponding output device outputs the original audio data and the watermark data, the original audio data and the watermark data may be modulated into an audio signal and a watermark signal in the same system. The above-described manner is only required to adjust the operating frequencies of the original data outputter 101 and the watermark data outputter 102 to be the same, that is, to adjust the operating frequencies of the original data outputter 101 and the watermark data outputter 102 to be the same.
For example, assuming that the original audio data is an AM-mode microphone (wireless amplitude-modulated microphone, operating frequency is 525 to 1605 kHz), the operating frequency of the watermark data output apparatus 102 may be adjusted to the same operating frequency as the microphone. In a preferred embodiment of the application, the above-described manner makes it known for the information receiver 103 to obtain the watermark data and the original audio data by directly superimposing the watermark data into the original audio data, i.e. by obtaining a mixed signal comprising the original live audio data and the watermark data. The mixed signal comprising the original live audio data and the watermark data is also an audio data to which watermark data is added, but is not available for playback.
In another alternative embodiment of the present application, the watermark data outputter 102 may also send the watermark data to the signal receiver periodically and in a short time, that is, when the audio signal strength of the original live audio data is less than a preset signal strength threshold, the watermark data is sent to the information processor.
For example, assuming that the original audio data is a microphone of FM system (wireless FM microphone, operating frequency is 110-120 MHz), the watermark data may be continuously transmitted to the information processor 103 in a gap where there is no sound in the live conference.
As can be seen from the foregoing, the information sending and receiving methods are different for different models of information outputters, and in the system provided in the first embodiment of the present application, the operating frequencies of the original live audio data and the watermark data sent by the original data outputter 101 and the watermark data outputter 102 need only be adjusted according to the models of the original data outputter and the watermark data.
Specifically, in order to obtain the audio data embedded with the watermark data from the mixed signal, the audio data is used as audio data for live broadcasting to a user. The information processor 103 further includes a frequency adjustment device 105.
In the first embodiment of the present application, the frequency adjustment device 105 is specifically a sound mixing console, which corresponds to an audio control center. In a first embodiment of the present application, watermark data in the audio data embedded with the watermark data, which includes the original live audio data and the watermark data, is subjected to attenuation processing by a sound console, so as to obtain target audio data. The weakening standard is that when the target data is played, a live user watching live broadcast or a live user watching live broadcast through a live broadcast platform can not feel interference caused by watermark data in audio data in the original data embedded with the watermark data when hearing sound information sent by a target sound source.
In an alternative embodiment of the present application, the process of adding watermark data to the original audio data by the watermark data output unit 102 and the information processor 103 may also be implemented by an application installed in the terminal device, for example, by an application installed in a mobile phone or a tablet computer.
The application program responds to the receiving of the output instruction for outputting the watermark data by displaying a control interface for controlling the watermark data output device 102 and the information processor 103 to a live broadcast staff, and sends request information for outputting the watermark data to the watermark data output device 102, and the watermark data output device outputs the watermark data after receiving the request information so as to mix the watermark data with the original live broadcast audio data.
The application program is further configured to receive the operating frequency when the original data outputter 101 outputs the original audio data, and display the operating frequency of the original data outputter 101 and an interface for adjusting the operating frequency of the watermark data outputter 102 to the live staff, so that the live staff can adjust the operating frequency of the watermark data outputter 102 to be the same as the operating frequency of the original data outputter 101 through the application program.
In addition, when the information processor 103 receives the mixed signal of the watermark data and the original live audio data, the application program is further configured to display a control interface for controlling the frequency adjustment device 105 to weaken the watermark data, so as to obtain target audio data.
After the information processor 103 obtains the target audio data, the target audio data is sent to a target audio data player 104 to play the target audio data.
In a first embodiment of the present application, the target audio data player 104 is specifically a live audio device for playing the target audio data on a live broadcast.
In addition, in order to prevent a live staff member from acquiring the original live audio data in the field through the frequency adjustment device 104, a recording device may be added in an idle data output port of the frequency adjustment device 104.
In an alternative embodiment of the application, the system further comprises:
a camera 106 and a video receiving device 107;
The camera 106 is configured to obtain live image information, obtain target audio data played by the target audio data player, obtain the live data for live broadcast according to the live image information and the target audio data, and send the live data to the video receiving device in real time. That is, the camera 106 is configured to capture live video information of a live scene, and it can be understood that, in the process of capturing live video, in addition to the image information of the live thread, the target audio data played by the target audio data player can be obtained.
In an alternative embodiment of the application the system further comprises audio watermark extraction means 108.
The audio watermark extraction device 108 is configured to obtain the watermark-embedded audio information played by the audio player in real time, and obtain watermark data in the watermark-embedded audio information.
After watermark data in the audio information is determined, the continuity of the watermark data in the audio information can be determined according to the watermark data in the audio information.
As can be seen from the above, in the audio data playing system according to the first embodiment of the present application, when the target audio data is live broadcast, the watermark data is carried in the target audio data. Therefore, when the target audio data is provided with the watermark data, whether the video information obtained by pirating the video data through live-broadcast equipment or other equipment is provided with the audio information, the watermark data can be contained, so that the pirated video can be directly determined to be the pirated video by analyzing the audio in the video to obtain the watermark data.
In addition, by analyzing the content of the video or audio containing the live broadcast to obtain watermark data contained in the content, and detecting the continuity of the video or audio through the watermark data, whether the content has a clip misleading the content in the video or audio can be judged.
The foregoing embodiment describes a playing system of audio data, and correspondingly, a second embodiment of the present application provides a method for obtaining audio data, please refer to fig. 2, which is a flowchart of a method for obtaining audio data according to the second embodiment of the present application, the method is implemented based on the foregoing system, and implementation steps and basis of the method are described in detail below. Since the method embodiment is partially similar to the system embodiment described above, only the portions of the system embodiment not mentioned below will be described, and other relevant portions will be found in the system embodiment.
The method for obtaining the audio data comprises the following steps:
step S201, obtaining watermark data;
step S202, obtaining original data with audio characteristics to be played to a user;
Specifically, the original data with the audio characteristics to be played to the user is obtained according to the live audio output device, namely the original live audio data to be live played to the user, which is output by the audio output device in real time, is obtained. Similarly, the watermark data is obtained according to a watermark output device on the live broadcast site, namely the watermark data output by the watermark data is obtained.
When the watermark data and the original live broadcast audio data are obtained, the working frequency of the audio data device when the original live broadcast audio data are output is required to be ensured to be the same as the working frequency of the watermark output device when the watermark data are output.
Optionally, the watermark data includes at least one of the following information:
Copyright information corresponding to the original live audio data;
SMPTE time code information;
play position information of the target data;
playing time information of the target data;
Cryptographic signature information for encrypting watermark data in the original data embedded with the watermark data.
In an alternative embodiment of the present application, the watermark data may be obtained when the signal strength corresponding to the original data having the audio feature is less than a preset signal strength threshold. The watermark data may also be obtained at the same time as the original live audio data.
In the second embodiment of the present application, the audio data output device is the original data output device 101 mentioned in the first embodiment of the present application, and the watermark data output device is the watermark data output device 102 mentioned in the first embodiment of the present application. In addition, in the second embodiment of the present application, the implementation subjects of step S201 and step S202 are the information processor 103 in the first implementation of the present application.
Therefore, for the description of the step S201 and the step S202, reference may be made to the description of the original data outputter 101, the watermark data outputter 102, and the information processor 103 in the first embodiment of the present application, and the description is omitted here.
And step S203, according to the watermark data and the original live broadcast audio data, obtaining the audio data embedded with the watermark data as target audio data for live broadcasting to users.
The step S203 includes:
obtaining original audio data corresponding to the audio features in the original data with the audio features;
Embedding the watermark data in the original audio data to obtain the original audio data embedded with the watermark data as the audio data in the original data embedded with the watermark data. In the second embodiment of the present application, the process of obtaining the original audio data embedded with the watermark data may refer to the description of the information processor 103 in the first embodiment of the present application, and will not be described herein.
In summary, before playing the original data, the method adds watermark data into the original data to obtain target data to be played, so that the target data already carries the watermark data during playing, and meanwhile, transmission of the original data on a server is avoided.
In the foregoing embodiments, a method for obtaining play data is provided, and accordingly, a third embodiment of the present application further provides a device for obtaining play data. Since the apparatus embodiments are substantially similar to the system embodiments and method embodiments described above, the description is relatively simple, and reference will only be made to the descriptions of portions of the system embodiments and method embodiments described above. The device embodiments described below are merely illustrative.
Fig. 3 is a schematic structural diagram of an apparatus for obtaining audio data according to a third embodiment of the present application, where the apparatus includes:
A watermark obtaining unit 301 for obtaining watermark data;
an original data obtaining unit 302 for obtaining original data having audio characteristics to be played to a user;
a target data obtaining unit 303, configured to obtain, as target data for live broadcasting to a user, original data embedded with the watermark data, based on the watermark data and the original data having audio characteristics.
Optionally, the obtaining the original data with audio features to be played to the user includes:
and obtaining the original live audio data which is output by the audio output device in real time and is ready to be live broadcast to the user.
Optionally, the obtaining watermark data includes:
and when the signal intensity corresponding to the original data with the audio characteristics is smaller than a preset signal intensity threshold value, obtaining the watermark data output by the watermark output device.
Optionally, the working frequency of the audio data device when outputting the original live audio data is the same as the working frequency of the watermark output device when outputting the watermark data.
Optionally, the obtaining, according to the watermark data and the original data with audio characteristics, the original data embedded with the watermark data as target data for playing to a user includes:
obtaining original audio data corresponding to the audio features in the original data with the audio features;
embedding the watermark data in the original audio data to obtain the original audio data embedded with the watermark data as the audio data in the original data embedded with the watermark data.
Optionally, the watermark data includes at least one of the following information:
Copyright information corresponding to the original live audio data;
SMPTE time code information;
play position information of the target data;
playing time information of the target data;
Cryptographic signature information for encrypting watermark data in the original data embedded with the watermark data.
The fourth embodiment of the present application, which corresponds to the second and third embodiments described above, also provides an electronic device, and since the electronic device provided in the fourth embodiment of the present application is substantially similar to the method and apparatus embodiments described above, the description is relatively simple, and the relevant points are only required to refer to the partial description of the method and apparatus embodiments described above, and the electronic device embodiments described below are merely illustrative. A step of
Fig. 4 is a schematic structural diagram of the electronic device according to the fourth embodiment of the present application.
The electronic device includes a processor 401;
And a memory 402 for storing a program of a method, the apparatus being powered on and running the program by the processor, performing the steps of obtaining watermark data, obtaining raw data having audio characteristics to be played to a user, and obtaining the raw data embedded with the watermark data as target data for playing to the user based on the watermark data and the raw data having audio characteristics.
Corresponding to the above-described embodiments, a fifth embodiment of the present application provides a computer storage medium. Since the fifth embodiment of the present application is substantially similar to the method embodiment described above, the description is relatively simple, and with regard to the description of the above embodiments, reference is made to the portions of the description of the above embodiments, and the storage medium embodiments described below are merely illustrative.
The storage medium stores a program for an obtaining method of audio data, the program being executed by a processor to perform the steps of:
The present application, although disclosed in the preferred embodiment above as target data for playback to a user, is not intended to limit the present application, and any person skilled in the art may make possible variations and modifications without departing from the spirit and scope of the present application, and therefore the scope of the present application shall be defined by the claims of the present application.
In one typical configuration, a computing device includes one or more processors (CPUs), input/output interfaces, network interfaces, and memory.
The memory may include volatile memory in a computer-readable medium, random Access Memory (RAM) and/or nonvolatile memory, such as Read Only Memory (ROM) or flash memory (flash RAM). Memory is an example of computer-readable media.
1. Computer readable media, including both non-transitory and non-transitory, removable and non-removable media, may implement information storage by any method or technology. The information may be computer readable instructions, data structures, modules of a program, or other data. Examples of storage media for a computer include, but are not limited to, phase change memory (PRAM), static Random Access Memory (SRAM), dynamic Random Access Memory (DRAM), other types of Random Access Memory (RAM), read Only Memory (ROM), electrically Erasable Programmable Read Only Memory (EEPROM), flash memory or other memory technology, compact disc read only memory (CD-ROM), digital Versatile Discs (DVD) or other optical storage, magnetic cassettes, magnetic tape magnetic disk storage or other magnetic storage devices, or any other non-transmission medium, which can be used to store information that can be accessed by a computing device. Computer readable media, as defined herein, does not include non-transitory computer readable media (transmission media), such as modulated data signals and carrier waves.
2. Those skilled in the art will appreciate that embodiments of the application may be provided as a system or an electronic device. Accordingly, the present application may take the form of an entirely hardware embodiment, an entirely software embodiment or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, CD-ROM, optical storage, and the like) having computer-usable program code embodied therein.