CN118233442A - Multimedia file generation method and device and multimedia file playing method and device - Google Patents

Abstract

The present disclosure relates to a multimedia file generation method and apparatus, and a multimedia file playing method and apparatus, the multimedia file generation method comprising: acquiring a multimedia file, wherein the multimedia file comprises redundant information; and writing the hidden information into the redundant information to generate a multimedia file carrying the hidden information, wherein the hidden information is used for indicating that the multimedia file is played in a specific playing mode. Based on the above, different hidden information can be set for different multimedia files, and a plurality of hidden information is written into redundant information corresponding to the multimedia files, so that the content of the multimedia files is enriched.

Description

Multimedia file generation method and device and multimedia file playback method and device

Technical Field

The present disclosure relates to the field of computer technology, and in particular to a method and device for generating a multimedia file and a method and device for playing a multimedia file.

Background technique

At present, traditional sound effects are mainly set manually by users according to parameters such as text content of multimedia files and frequency of multimedia files. However, most users do not have professional knowledge of multimedia files and are unable to set the most suitable sound effects for multimedia files.

In the prior art, when users spend a lot of time and energy to set sound effects for multimedia files, they can only be played on the current terminal, and cross-platform playback cannot be achieved. In addition, the sound effects cannot be flexibly switched for different scenes and different multimedia file playback periods.

Summary of the invention

In view of this, the embodiments of the present disclosure provide a multimedia file generation method and device and a multimedia file playback method and device, which can provide a user with a multimedia file containing the best sound effect without the need for user selection.

According to a first aspect of an embodiment of the present disclosure, a method for generating a multimedia file is provided, comprising: obtaining a multimedia file, wherein the multimedia file includes redundant information; writing steganographic information into the redundant information to generate a multimedia file carrying the steganographic information, wherein the steganographic information is used to indicate that the multimedia file is to be played in a specific playback mode.

A second aspect of an embodiment of the present disclosure provides a method for playing a multimedia file, including: acquiring a multimedia file; detecting whether there is steganographic information in the multimedia file, wherein the steganographic information is used to indicate that the multimedia file is to be played in a specific playback mode; and when the steganographic information exists in the multimedia file, playing the multimedia file in the specific playback mode.

According to a third aspect of an embodiment of the present disclosure, a multimedia file generation device is provided, comprising: an acquisition module, configured to acquire a multimedia file, wherein the multimedia file includes redundant information; and a generation module, configured to write steganographic information into the redundant information to generate a multimedia file carrying the steganographic information, wherein the steganographic information is used to indicate that the multimedia file is to be played in a specific playback mode.

According to a fourth aspect of the embodiments of the present disclosure, a multimedia file playback device is provided, including: an acquisition module, configured to acquire a multimedia file; a detection module, configured to detect whether there is steganographic information in the multimedia file, wherein the steganographic information is used to indicate that the multimedia file is to be played in a specific playback mode; and a playback module, configured to play the multimedia file in a specific playback mode when the steganographic information is present in the multimedia file.

According to a fifth aspect of an embodiment of the present disclosure, an electronic device is provided, comprising at least one processor; and a memory for storing instructions executable by at least one processor; wherein the at least one processor is used to execute instructions to implement the steps of the above method.

According to a sixth aspect of an embodiment of the present disclosure, a computer-readable storage medium is provided. When instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to perform the steps of the above method.

At least one of the above-mentioned technical solutions adopted in the embodiments of the present disclosure can achieve the following beneficial effects: by obtaining a multimedia file, wherein the multimedia file includes redundant information; writing steganographic information into the redundant information to generate a multimedia file carrying the steganographic information, wherein the steganographic information is used to indicate that the multimedia file is to be played in a specific playback mode, and the steganographic information for playing the multimedia file can be added to the redundant information of the multimedia file by using the steganography method, so that the multimedia file is played in a specific playback mode, thereby enriching the content of the multimedia file and increasing the user experience and fun.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present disclosure, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present disclosure. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

FIG1 is a schematic diagram showing the structure of a system applicable to multimedia file generation according to an embodiment of the present disclosure;

FIG2 is a schematic diagram showing a flow chart of a method for generating a multimedia file according to an embodiment of the present disclosure;

FIG3 is a schematic diagram showing a process of writing steganographic information into a multimedia file according to an embodiment of the present disclosure;

FIG4 is a schematic diagram showing a flow chart of a multimedia file playing method according to an embodiment of the present disclosure;

FIG5 is a schematic diagram showing a process flow of a multimedia file playing process according to an embodiment of the present disclosure;

FIG6 is a schematic diagram showing a process flow of a multimedia file playing process according to an embodiment of the present disclosure;

FIG7 shows a schematic diagram of the structure of a multimedia file generating device according to an embodiment of the present disclosure;

FIG8 is a schematic structural diagram of a multimedia file playing device according to an embodiment of the present disclosure;

FIG9 shows a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure;

FIG. 10 shows a schematic diagram of the structure of a computer system provided in an embodiment of the present disclosure.

Detailed ways

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments described herein, which are instead provided for a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

It should be understood that the various steps described in the method embodiments of the present disclosure may be performed in different orders and/or in parallel. In addition, the method embodiments may include additional steps and/or omit the steps shown. The scope of the present disclosure is not limited in this respect.

The term "including" and its variations used in this document are open inclusions, that is, "including but not limited to". The term "based on" means "based at least in part on". The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one other embodiment"; the term "some embodiments" means "at least some embodiments". Relevant definitions of other terms will be given in the description below. It should be noted that the concepts of "first", "second", etc. mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order or interdependence of the functions performed by these devices, modules or units.

It should be noted that the modifications of "one" and "plurality" mentioned in the present disclosure are illustrative rather than restrictive, and those skilled in the art should understand that unless otherwise clearly indicated in the context, it should be understood as "one or more".

The names of the messages or information exchanged between multiple devices in the embodiments of the present disclosure are only used for illustrative purposes and are not used to limit the scope of these messages or information.

Before introducing the embodiments of the present disclosure, the following definitions are given for the relevant terms involved in the embodiments of the present disclosure:

AES stands for Advanced Encryption Standard. It was created to replace the DES encryption algorithm, because we all know that the key length of the DES algorithm is 56 bits, so the theoretical security strength of the algorithm is 2 to the 56th power. However, the mid-to-late 20th century was a period of rapid development of computers. The advancement of component manufacturing technology made the processing power of computers stronger and stronger. Although the 3DES encryption method appeared, its encryption time was more than 3 times that of the DES algorithm, and the 64-bit group size was relatively small, so it still could not meet people's requirements for security.

The full name of DES is Data Encryption Standard, which is a block encryption algorithm. Typical DES encrypts data in 64-bit blocks, and the same algorithm is used for encryption and decryption.

The full name of RSA is The Republic of South Africa. The RSA encryption algorithm is an asymmetric encryption algorithm. The so-called asymmetric means that the algorithm uses different keys for encryption and decryption, that is, the encryption key is used for encryption and the decryption key is used for decryption.

QR code is a type of two-dimensional barcode. QR is the abbreviation of "Quick Response" in English, which means quick response. It comes from the inventor's hope that QR code can allow its content to be decoded quickly. QR code can store more information than ordinary barcodes, and it does not need to be aligned with the scanner when scanning like ordinary barcodes.

Time domain low bit steganography mainly starts with the least significant bit (LSB) steganography, which includes LSB replacement and LSB matching. Steganography is performed based on the 16-bit sample value of the time domain waveform of the multimedia file.

Phase encoding method: the human auditory system has different sensitivities to the relative phase of different spectral components. The phase of the initial multimedia file can be replaced by a reference phase representing the embedded data, thereby embedding information. When the segments after the position is modified, corresponding adjustments should also be made to ensure that the relative phase between the segments does not change. Phase encoding is one of the most effective encoding methods in terms of the perceived signal-to-noise ratio of the signal. In fact, when the phase relationship between the frequency components changes significantly, obvious phase dispersion will occur. As long as the phase correction is small enough, imperceptible encoding can be achieved. Moreover, phase encoding can tolerate signal distortion.

Spread spectrum method, spread spectrum technology is a concept developed in the field of data communication. By generating redundant copies of transmitted information, the original data can still be correctly recovered after being interfered by a noisy channel. There are two main types of spread spectrum technology: direct sequence spread spectrum and frequency modulation. The advantage of spread spectrum method is that even if noise destroys some hidden information, it can be recovered through the copy.

The echo hiding algorithm is a classic algorithm. In the echo hiding algorithm, the encoder delays the carrier data for a certain time and superimposes it on the original carrier data to generate an echo. The encoder can embed "0" and "1" with two different delay times. In actual operation, the echo kernel representing "0" or "1" is convolved with the carrier signal to achieve the effect of adding an echo.

In recent years, with the development of the Internet, multimedia file contents under the multimedia industry have a very wide range of users. In order to enrich the content of multimedia files, users will add various sound effects to multimedia files to enrich the content of multimedia files. However, traditional sound effects are mainly set manually by users according to parameters such as the text content of multimedia files and the frequency of multimedia files. Since most users do not have professional knowledge of multimedia files, they are unable to set the most suitable sound effects for multimedia files. In addition, in the process of manually setting sound effects, users are required to set multiple different sound effects for the same multimedia file and keep trying, which consumes a lot of time and energy of users. If users choose not to set sound effects to play multimedia files, the same multimedia file played on different users' terminals is the original multimedia file, which lacks fun.

In response to the above problems, the embodiments of the present disclosure provide a multimedia file generation method and a multimedia file playback method, which can steganographically write the playback mode for the multimedia file into the multimedia file, and transmit the multimedia file carrying the steganographic information through a network channel. After the multimedia file playback device obtains the multimedia file, it is first necessary to detect the multimedia file to confirm whether the multimedia file contains the steganographic information. When the multimedia file contains the steganographic information, the multimedia file is played in a specific playback mode, and can be played imperceptibly on any multimedia file playback device, thereby realizing cross-platform playback of multimedia files and increasing the user experience and fun.

Fig. 1 is a schematic diagram showing the structure of a system applicable to multimedia file generation according to an embodiment of the present disclosure. As shown in Fig. 1 , the system 100 of the embodiment of the present disclosure may include: a multimedia file playing device 110, a computing device 120 and a data storage system 130.

Specifically, the multimedia file playback device 110 can communicate with the computing device 130 through a communication network. The communication network can be a wired communication network or a wireless communication network. The wired communication network can be a communication network based on power line carrier technology, and the wireless communication network can be a local wireless network or a wide area wireless network. The local wireless network can be a WIFI wireless network, a Zigbee wireless network, a mobile communication network, or a satellite communication network. At the same time, the multimedia file playback device can be a multimedia file playback device with decoding capability.

The multimedia file playing device 110 may include but is not limited to a computer, a mobile phone or an intelligent terminal such as an information processing center. The computing device 120 may be a server with data processing function such as a cloud server, a network server, an application server and a management server.

The data storage system 130 may be a general term, including local storage and a database storing historical data, and the database may be on the computing device 120, on other network servers, or on the data storage system 130. The data storage system 130 may be separate from the computing device 120, or may be integrated in the computing device 120.

In actual applications, the computing device 120 can split a multimedia file into multiple multimedia segments, where the multimedia file includes redundant information, and determine multiple playback modes corresponding to the multiple multimedia segments, and then write the playback modes into the redundant information in a steganographic manner to generate a multimedia file carrying steganographic information.

The multimedia file playing device 110 obtains the multimedia file from the computing device 120 and detects the multimedia file. If it is detected that there is steganographic information in the multimedia file, the multimedia file is played in a specific playing mode, wherein the specific mode can be based on a specific decoding mode to identify the steganographic information, and the steganographic information is used to indicate that the multimedia file is played in a specific playing mode; if it is detected that there is no steganographic information in the multimedia file, the multimedia file is directly played using the multimedia file playing device 110.

The multimedia file generation method of the embodiment of the present disclosure may be executed by a server, or may be executed by a chip applied to the server.

Fig. 2 shows a basic flow chart of a multimedia file generation method according to an embodiment of the present disclosure. As shown in Fig. 2, the multimedia file generation method according to an embodiment of the present disclosure may include S201 and S202.

S201: Acquire a multimedia file, where the multimedia file includes redundant information.

Specifically, redundant information can be added to multimedia files. The redundant information can not only be used to speed up the access speed of multimedia files, but also can be edited without affecting the main content of the multimedia files, thereby enriching the content of the multimedia files.

S202, writing the stego information into the redundant information to generate a multimedia file carrying the stego information, wherein the stego information is used to instruct to play the multimedia file in a specific playing mode.

Specifically, different steganographic information can be set for different multimedia files, and multiple steganographic information can be written into the redundant information corresponding to the multimedia file, thereby enriching the content of the multimedia file. The multimedia file may include a video file, an audio file, an animation file, etc. The following is a detailed description of the case where the multimedia file is an audio file.

According to the technical solution provided by the embodiment of the present disclosure, a multimedia file is obtained, wherein the multimedia file includes redundant information; steganographic information is written into the redundant information to generate a multimedia file carrying the steganographic information, wherein the steganographic information is used to indicate that the multimedia file is to be played in a specific playback mode, and the steganographic information for playing the multimedia file can be added to the redundant information of the multimedia file by using the steganography method, so that the multimedia file is played in a specific playback mode, thereby enriching the content of the multimedia file and increasing the user experience and fun.

In some embodiments, the method also includes: segmenting the multimedia file based on at least one time period to obtain multimedia segments corresponding to each time period in at least one time period; selecting a playback mode matching the multimedia segment corresponding to each time period in a pre-stored index table, wherein the index table is used to store multiple playback control information corresponding to all multimedia segments, and the playback control information is used to change the playback mode of the multimedia segment.

Specifically, the multimedia file can be split into pure accompaniment, pure vocals, and vocals and accompaniment through AI model training. It is assumed that the pure accompaniment part of the split multimedia file is in the interval t∈∑ ₁ (T ₁ ,T ₁ ′), where T ₁ represents the start time of the pure accompaniment part, and T ₁ ′ represents the end time of the pure accompaniment part; the pure vocal part is in the interval t′∈∑ ₂ (T ₂ ,T ₂ ′), where T ₂ represents the start time of the pure vocal part, and T ₂ ′ represents the end time of the pure vocal part; the vocals and accompaniment part are in the interval t″∈∑ ₃ (T ₃ ,T ₃ ′), where T ₃ represents the start time of the vocals and accompaniment part, and T ₃ ′ represents the end time of the vocals and accompaniment part. Wherein t+t′+t″＝E, and E represents the total duration of the multimedia file.

When the multimedia file is an audio file, multiple playback control information for the audio file can be for changing the music style and sound effect mode, etc.; for example, when the playback control information is the music style, the music style of the original audio file can be changed to the electronic music style based on the playback control information, and then the multimedia file is played in the electronic music style, and the music style of the original audio file can be changed to the Hi-Fi style, and then the multimedia file is played in the Hi-Fi style, etc.; when the playback control information is for adding a sound effect mode, the sound effect of an uncle's voice can be added to the original audio file based on the playback control information, and the human voice in the original audio file can be changed to an uncle's voice, and the sound effect of a lolita voice can be added to the original audio file, and the human voice in the original audio file can be changed to a lolita voice, etc.

In actual applications, when data is transmitted, related data will be directly packaged. When the amount of data is large, the data packaging process and the data transmission process will consume a lot of time. At the same time, directly packaging the data will reduce the security of the data. Therefore, in order to reduce the overhead in the data transmission process as much as possible and ensure data security, the embodiment of the present disclosure defines a dual-end query sound effect index table for audio files, that is, an index table that can be queried on a multimedia file playback device and a computing device.

In some embodiments, different playback control information can be represented by numerical values, and multiple different playback control information can also be classified by numerical values. The sound effect index table is shown in Table 1:

Table 1 Sound effect index table

Playback control information The index number music style 1 Clear life style 11 Electronic music style 12 HI-FI style 13 Sound Mode 2 Uncle Voice twenty one Loli Voice twenty two Royal sister sound twenty three Audio Speed 3 0.5x speed 31 1.0x speed 32 1.5x speed 33

In Table 1, the playback control information includes music style 1, sound effect mode 2, and audio speed 3, wherein music style 1 includes three sound effects: clear vocal style 11, electronic music style 12, and HI-FI style 13; sound effect mode 2 includes uncle voice 21, loli voice 22, and royal sister voice 23; and audio speed 3 includes 0.5 times speed 31, 1.0 times speed 32, and 1.5 times speed 33. It should be understood that the playback control information may also include pitch change and replacement of lyrics, etc., which may be set according to actual conditions.

In practical applications, after a multimedia file is split into three multimedia segments, the playback control information of the multimedia segments can be written into the multimedia file using a steganographic algorithm to generate a multimedia file carrying steganographic information.

Specifically, according to the above splitting results, the value 11 corresponding to the clear vocal style can be written into the multimedia segment corresponding to the duration t interval corresponding to the pure accompaniment part of the multimedia file, the value 12 corresponding to the electronic music style can be written into the pure vocal part at t′, and the value 13 corresponding to the HI-FI style can be written into the vocal and accompaniment part at t″, and the multimedia segments with the stego information written can be merged according to the playback order to generate a multimedia file carrying the stego information. Among them, the playback order can be based on the playback order of the multimedia files without the stego information written, and can also be sorted by duration, which can be set according to actual conditions.

Based on this, we can only transmit the numerical value of the corresponding playback mode of the multimedia file during the data transmission process. In this way, even if the data is intercepted during the data transmission process, the data content will not be obtained without an index table, thereby ensuring the security of the data. In addition, using numerical values instead of the text description of the playback mode will reduce the amount of transmitted data, thereby speeding up the data transmission process.

FIG3 shows a schematic diagram of a process of writing stego information into a multimedia file according to an embodiment of the present disclosure. As shown in FIG3 , writing the stego information into redundant information to generate a multimedia file carrying the stego information includes:

S301, encode the value corresponding to the playing mode to obtain an encoded character string.

Specifically, the embodiment of the present disclosure uses ASCII or UTF8 encoding to encode the numerical value corresponding to the playback mode into a transcoded character form to obtain a transcoded character string. Based on this, a transcoded character string containing only numbers can be obtained.

S302, compress the encoded character string to obtain a compressed character string.

Specifically, the transcoded character string may be compressed, and the transcoded character string may be compressed using Huffman compression coding to obtain compressed data;

S303, encrypt the compressed string to obtain an encrypted string.

Specifically, the compressed data can be encrypted by an encryption algorithm to obtain an encrypted transcoded string, wherein the encryption algorithm can adopt an encryption algorithm such as AES, DES or RSA, and the encrypted transcoded string can be replaced with a QR code. However, since the amount of information carried by the QR code is limited, the present disclosure adopts the form of an encrypted transcoded string for data transmission.

S304, steganographically writing the encrypted string into the redundant information to obtain a multimedia file steganographically writing the encrypted string.

Specifically, a steganographic algorithm may be used to write an encrypted transcoded character string into redundant information of a multimedia file, thereby generating a multimedia file carrying steganographic information.

Specifically, multimedia file steganography algorithms may include LSB method, phase coding method, spread spectrum method and echo data hiding method, all of which utilize the redundant information of multimedia files to achieve the purpose of steganographic information.

The disclosed embodiment adopts the echo data hiding method to write the encrypted transcoded string into the redundant information corresponding to the multimedia file. For example, if the multimedia file is a dual-channel multimedia file, the amplitude of the left channel and the right channel can be reduced, and the multimedia segment with the reduced amplitude of the left channel can be mixed into the right channel, and the multimedia segment with the reduced amplitude of the right channel can be mixed into the left channel. When mixing, the multimedia segments with lower amplitudes on both sides are mixed in the form of a delay of 500 microseconds, thereby obtaining a cross-feedback sound effect (CrossFeed), so that redundant information can be generated in the multimedia file without the user's perception, and then the data steganography is completed by processing the redundant information. Based on this, the information bits of 0 and 1 are generated by the amplitude difference or delay offset of the respective multimedia files mixed into the left and right channels, and the encrypted transcoded string is steganographically written.

In practical applications, when taking the left channel as an example and encrypting the pure human voice part in the multimedia file, the pure human voice part with reduced amplitude of the right channel can be mixed into the pure human voice part of the left channel with a delay of 500 microseconds, that is, the pure human voice part with reduced amplitude of the right channel is used as an additional resonance signal of the left channel, wherein the multimedia segment corresponding to the redundant information is an audio segment generated by a delay of 500 microseconds, corresponding to 0 information bits, and the pure human voice part with reduced amplitude of the right channel corresponds to 1 information bit. When performing data steganography, the encrypted transcoded string can be written into 0 information bits. Then, the multimedia segments corresponding to the 0 information bits and the 1 information bits are spliced, and the spliced multimedia segments are mixed into the corresponding part of the left channel to obtain a multimedia file carrying steganographic information.

In an optional manner, when the multimedia file is a multimedia file telling a story by a single person, voice-changing sound effects or ghost sound effects may be added to the different sounds corresponding to the dialogue periods of different story characters in the multimedia file. The multimedia clips of a certain time period in the multimedia file may also be played repeatedly. Speed-changing or pitch-changing sound effects may also be added to the multimedia clips of a certain time period.

Furthermore, the songs, lyrics or singers in the multimedia file can be modified, and the new lyrics and singer information can be steganographically written into the multimedia file. Based on this, when the terminal obtains the modified lyrics and the stego-information of the singer, the vocal part in the multimedia file can be standardized according to the Musical Instrument Digital Interface (MIDI), and the vocals in the multimedia file can be replaced based on AI technology with the vocals of the singer in the stego-information. Then, pure vocal synthesis is performed according to the MIDI scale based on the new lyrics to obtain a new vocal synthesis segment. Finally, the sounds corresponding to other instruments in the multimedia file except the vocals are synthesized with the vocal synthesis segment to obtain the multimedia file.

The multimedia file playing method of the embodiment of the present disclosure may be executed by a terminal, or may be executed by a chip applied to the terminal.

Fig. 4 shows a basic flow chart of a multimedia file playing method according to an embodiment of the present disclosure. As shown in Fig. 4, the multimedia file playing method according to an embodiment of the present disclosure may include S401 to S403.

S401, obtaining multimedia files.

Specifically, the embodiments of the present disclosure can download multimedia files through the network, or obtain multimedia files through instant messaging software. After the user obtains the multimedia file, the user can directly open the multimedia file or use a designated multimedia file playback device to open the multimedia file.

S402, detecting whether there is steganographic information in the multimedia file, wherein the steganographic information is used to instruct to play the multimedia file in a specific playing mode.

Specifically, before playing a multimedia file, the embodiment of the present disclosure needs to first detect whether the multimedia file contains stego information, so as to avoid ignoring the stego information when the playback mode does not match but the multimedia file is successfully played.

S403, when there is steganographic information in the multimedia file, the multimedia file is played in a specific playing mode.

Specifically, when playing a multimedia file in a specific manner, the effective reading of the stego information can be ensured, and the content corresponding to the stego information can be integrated into the multimedia file, thereby enriching the content of the multimedia file. It should be understood that when the multimedia file is an audio file, the stego information can be used to change the sound of the audio file, and sound effects can be added to the audio file, thereby enriching the content of the multimedia file.

Fig. 5 is a schematic diagram of a process of playing a multimedia file according to an embodiment of the present disclosure. As shown in Fig. 5, when there is steganographic information in the multimedia file, the multimedia file is played in a specific playing mode, including S501 to S506.

S501, extract the stego information to obtain an encrypted string.

S502, decrypt the encrypted string to obtain a compressed string.

Specifically, if the encrypted multimedia file can be successfully decrypted, step S502 is executed, otherwise it is considered that the multimedia file decryption fails, and the multimedia file without the stego information is directly played. The stego information is an encrypted transcoded string, and the decryption failure may be caused by an error in the stego information or a network problem.

S503, decompress the compressed string to obtain a decompressed string. It should be understood that the compressed data can be decompressed using Huffman coding to obtain a transcoded string.

Specifically, if the compressed data can be successfully decompressed, step S503 is executed; otherwise, it is considered that the multimedia file cannot be decompressed, and the multimedia file without the steganographic information is directly played.

S504, decoding the decompressed character string to obtain a numerical value.

Specifically, the transcoded string is transcoded into ASCII or UTF8 to obtain a numerical value.

S505: Select a playback mode corresponding to the value in a pre-stored index table.

Specifically, the values can be translated according to the index table to determine the playback control information corresponding to different multimedia segments, and then multiple playback control information and multiple multimedia segments are synthesized to obtain multiple synthesized multimedia segments; finally, the multiple synthesized multimedia segments are spliced according to the playback order of the multimedia segments to obtain a decoded multimedia file. It should be understood that a multimedia segment can correspond to one playback control information, and may also correspond to multiple playback control information, which can be set according to actual conditions.

S506, controlling the multimedia file to be played in a play mode.

Specifically, when the extraction of the stego information fails, that is, when the stego information does not exist in the multimedia file, the multimedia file can be played directly.

Figure 6 shows a schematic flow chart of a multimedia file playback process according to an embodiment of the present disclosure. As shown in Figure 6, the multimedia file is an audio file including HI-FI style, clear vocal style, electronic music style and other playback modes. Different playback modes are set for different audio clips. The present disclosure adds fade-in and fade-out audio effects to switch between different playback modes, thereby ensuring smooth switching between different playback modes and avoiding abruptness caused by direct playback, which affects the user experience.

In actual applications, when a user obtains a multimedia file, a pop-up window can be displayed on the user terminal interface to notify the user that the multimedia file is a multimedia file containing stego information. If the user chooses to play a multimedia file containing stego information, the multimedia file containing stego information will be played; otherwise, the multimedia file without stego information will be played directly, thereby facilitating the user's selection.

It can be seen that the disclosed embodiment can obtain a multimedia file containing stego information by stego-writing the index information corresponding to the target sound effect into the multimedia file, thereby ensuring the data security and data transmission efficiency of the multimedia file, and playing it without perception. At the same time, the playback control information is stego-written into the multimedia file. After the multimedia file carrying the stego-information is generated, the multimedia file carrying the stego-information can be transmitted through networks such as web pages or chat software APPs, thereby enhancing the user experience and fun.

At least one of the above-mentioned technical solutions adopted in the embodiments of the present disclosure can achieve the following beneficial effects: a multimedia file can be obtained, wherein the multimedia file includes redundant information, and the redundant information can not only be used to speed up the access speed of the multimedia file, but also can be edited without affecting the main content of the multimedia file, thereby enriching the content of the multimedia file; at the same time, stego information can be written into the redundant information to generate a multimedia file carrying the stego information, wherein the stego information is used to indicate that the multimedia file is to be played in a specific playback mode, based on this, different stego information can be set for different multimedia files, and multiple stego information can be written into the redundant information corresponding to the multimedia file, thereby enriching the content of the multimedia file.

On this basis, when the method of the embodiment of the present disclosure is applied to multimedia file playback, the multimedia file can be obtained and whether there is stego information in the multimedia file can be detected, wherein the stego information is used to indicate that the multimedia file is to be played in a specific playback mode. Detecting whether there is stego information in the multimedia file can avoid ignoring the stego information when the playback mode does not match but the multimedia file is successfully played. Based on this, when there is stego information in the multimedia file, the multimedia file is played in a specific playback mode, which can not only ensure the effective reading of the stego information, but also integrate the content corresponding to the stego information into the multimedia file, thereby enriching the content of the multimedia file.

The above mainly introduces the solution provided by the embodiment of the present disclosure from the perspective of the server. It is understandable that in order to realize the above functions, the server includes hardware structures and/or software modules corresponding to the execution of each function. Those skilled in the art should easily realize that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the present disclosure can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to exceed the scope of the present disclosure.

The embodiment of the present disclosure can divide the functional units of the server according to the above method example. For example, each functional module can be divided according to each function, or two or more functions can be integrated into one processing module. The above integrated module can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiment of the present disclosure is schematic and is only a logical functional division. There may be other division methods in actual implementation.

In the case of dividing each functional module according to each function, the embodiment of the present disclosure provides a multimedia file generation device, which can be a server or a chip applied to a server. FIG7 shows a schematic diagram of the structure of a multimedia file generation device according to an embodiment of the present disclosure. As shown in FIG7, the multimedia file generation device 700 includes:

The acquisition module 701 is configured to acquire a multimedia file, wherein the multimedia file includes redundant information;

The generating module 702 is configured to write the stego information into the redundant information to generate a multimedia file carrying the stego information, wherein the stego information is used to indicate that the multimedia file is to be played in a specific playing mode.

In one possible implementation, the multimedia file is segmented based on at least one time period to obtain multimedia segments corresponding to each of the at least one time period; and a playback mode matching the multimedia segments corresponding to each time period is selected from a pre-stored index table, wherein the index table is used to store multiple playback control information corresponding to all multimedia segments.

In a possible implementation, the generation module 702 is also used to encode the numerical value corresponding to the playback mode to obtain a coded string; compress the coded string to obtain a compressed string; encrypt the compressed string to obtain an encrypted string; and steganographically write the encrypted string into the redundant information to obtain a multimedia file with the encrypted string steganographically written therein.

In the case of dividing each functional module according to each function, the embodiment of the present disclosure provides a multimedia file playback device, which can be a terminal or a chip applied to a terminal. FIG8 shows a schematic diagram of the structure of a multimedia file playback device according to the embodiment of the present disclosure. As shown in FIG8, the multimedia file playback device 800 includes:

The acquisition module 801 is configured to acquire multimedia files;

The detection module 802 is configured to detect whether there is stego information in the multimedia file, wherein the stego information is used to indicate that the multimedia file is to be played in a specific playback mode;

The playing module 803 is configured to play the multimedia file in a specific playing mode when the steganographic information exists in the multimedia file.

In a possible implementation, the playback module 803 is also used to extract the steganographic information to obtain an encrypted string; decrypt the encrypted string to obtain a compressed string; decompress the compressed string to obtain a decompressed string; decode the decompressed string to obtain a numerical value; select a playback mode corresponding to the numerical value in a pre-stored index table; and control the multimedia file to be played in the playback mode.

In a possible implementation, the playing module 803 is further configured to directly play the multimedia file when the steganographic information does not exist in the multimedia file.

An embodiment of the present disclosure also provides an electronic device, comprising: at least one processor; a memory for storing instructions executable by at least one processor; wherein the at least one processor is used to execute instructions to implement the steps of the above method disclosed in the embodiment of the present disclosure.

Fig. 9 shows a schematic diagram of the structure of an electronic device provided by an embodiment of the present disclosure. As shown in Fig. 9, the electronic device 900 includes at least one processor 901 and a memory 902 coupled to the processor 901, and the processor 901 can execute the corresponding steps in the above method disclosed in the embodiment of the present disclosure.

The processor 901 may also be referred to as a central processing unit (CPU), which may be an integrated circuit chip having signal processing capabilities. Each step in the method disclosed in the embodiment of the present disclosure may be completed by an integrated logic circuit of hardware in the processor 901 or by instructions in the form of software. The processor 901 may be a general-purpose processor, a digital signal processor (DSP), an ASIC, a field-programmable gate array (FPGA) or other programmable logic device, a discrete gate or transistor logic device, or a discrete hardware component. A general-purpose processor may be a microprocessor or the processor may also be any conventional processor, etc. The steps of the method disclosed in the embodiment of the present disclosure may be directly embodied as being executed by a hardware decoding processor, or may be executed by a combination of hardware and software modules in a decoding processor. The software module may be located in a memory 902, such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, or an electrically erasable programmable memory, a register, or other mature storage media in the art. The processor 901 reads the information in the memory 902 and completes the steps of the method in combination with its hardware.

In addition, when various operations/processes according to the present disclosure are implemented by software and/or firmware, the programs constituting the software can be installed from a storage medium or a network to a computer system having a dedicated hardware structure, for example, the computer system 1000 shown in FIG10 , and the computer system can perform various functions, including the functions described above, etc. when various programs are installed. FIG10 shows a schematic diagram of the structure of a computer system provided by an embodiment of the present disclosure.

Computer system 1000 is intended to represent various forms of digital electronic computer devices, such as laptop computers, desktop computers, workstations, personal digital assistants, servers, blade servers, mainframe computers, and other suitable computers. Electronic devices may also represent various forms of mobile devices, such as personal digital processing, cellular phones, smart phones, wearable devices, and other similar computing devices. The components shown herein, their connections and relationships, and their functions are merely examples and are not intended to limit the implementation of the present disclosure described and/or claimed herein.

As shown in FIG10 , the computer system 1000 includes a computing unit 1001, which can perform various appropriate actions and processes according to a computer program stored in a read-only memory (ROM) 1002 or a computer program loaded from a storage unit 1008 into a random access memory (RAM) 1003. In the RAM 1003, various programs and data required for the operation of the computer system 1000 can also be stored. The computing unit 1001, the ROM 1002, and the RAM 1003 are connected to each other via a bus 1004. An input/output (I/O) interface 1005 is also connected to the bus 1004.

A plurality of components in the computer system 1000 are connected to the I/O interface 1005, including: an input unit 1006, an output unit 1007, a storage unit 1008, and a communication unit 1009. The input unit 1006 may be any type of device capable of inputting information to the computer system 1000, and the input unit 1006 may receive input digital or character information, and generate key signal inputs related to user settings and/or function control of the electronic device. The output unit 1007 may be any type of device capable of presenting information, and may include but is not limited to a display, a speaker, a video/multimedia file output terminal, a vibrator, and/or a printer. The storage unit 1008 may include but is not limited to a disk, an optical disk. The communication unit 1009 allows the computer system 1000 to exchange information/data with other devices via a network such as the Internet, and may include but is not limited to a modem, a network card, an infrared communication device, a wireless communication transceiver, and/or a chipset, for example, a Bluetooth™ device, a WiFi device, a WiMax device, a cellular communication device, and/or the like.

The computing unit 1001 may be a variety of general and/or special processing components with processing and computing capabilities. Some examples of the computing unit 1001 include, but are not limited to, a central processing unit (CPU), a graphics processing unit (GPU), various dedicated artificial intelligence (AI) computing chips, various computing units running machine learning model algorithms, digital signal processors (DSPs), and any appropriate processors, controllers, microcontrollers, etc. The computing unit 1001 performs the various methods and processes described above. For example, in some embodiments, the above methods disclosed in the embodiments of the present disclosure may be implemented as a computer software program, which is tangibly included in a machine-readable medium, such as a storage unit 1008. In some embodiments, part or all of the computer program may be loaded and/or installed on the electronic device 1000 via the ROM 1002 and/or the communication unit 1009. In some embodiments, the computing unit 1001 may be configured to perform the above methods disclosed in the embodiments of the present disclosure in any other appropriate manner (e.g., by means of firmware).

The embodiment of the present disclosure also provides a computer-readable storage medium, wherein when the instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the above method disclosed in the embodiment of the present disclosure.

The computer-readable storage medium in the disclosed embodiments may be a tangible medium that may contain or store a program for use by or in conjunction with an instruction execution system, device, or equipment. The computer-readable storage medium may include, but is not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices, or equipment, or any suitable combination of the foregoing. More specifically, the computer-readable storage medium may include an electrical connection based on one or more lines, a portable computer disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing.

The computer-readable medium may be included in the electronic device, or may exist independently without being incorporated into the electronic device.

The embodiments of the present disclosure also provide a computer program product, including a computer program, wherein when the computer program is executed by a processor, the above method disclosed in the embodiments of the present disclosure is implemented.

In embodiments of the present disclosure, computer program codes for performing the operations of the present disclosure may be written in one or more programming languages or combinations thereof, including but not limited to object-oriented programming languages, such as Java, Smalltalk, C++, and conventional procedural programming languages, such as "C" language or similar programming languages. The program code may be executed entirely on a user's computer, partially on a user's computer, as an independent software package, partially on a user's computer, partially on a remote computer, or entirely on a remote computer or server. In the case of a remote computer, the remote computer may be connected to the user's computer via any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computer.

The flow chart and block diagram in the accompanying drawings illustrate the possible architecture, function and operation of the system, method and computer program product according to various embodiments of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a module, a program segment or a part of a code, and the module, the program segment or a part of the code contains one or more executable instructions for realizing the specified logical function. It should also be noted that in some implementations as replacements, the functions marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two square boxes represented in succession can actually be executed substantially in parallel, and they can sometimes be executed in the opposite order, depending on the functions involved. It should also be noted that each square box in the block diagram and/or flow chart, and the combination of the square boxes in the block diagram and/or flow chart can be implemented with a dedicated hardware-based system that performs a specified function or operation, or can be implemented with a combination of dedicated hardware and computer instructions.

The modules, components or units involved in the embodiments described in the present disclosure may be implemented by software or hardware, wherein the names of the modules, components or units do not, in some cases, limit the modules, components or units themselves.

The functions described above herein may be performed at least in part by one or more hardware logic components. For example, exemplary hardware logic components that may be used include, without limitation, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chip (SOCs), complex programmable logic devices (CPLDs), and the like.

The above descriptions are only some embodiments of the present disclosure and an explanation of the technical principles used. Those skilled in the art should understand that the scope of disclosure involved in the present disclosure is not limited to the technical solutions formed by a specific combination of the above technical features, but should also cover other technical solutions formed by any combination of the above technical features or their equivalent features without departing from the above disclosed concept. For example, a technical solution formed by replacing the above features with the technical features with similar functions disclosed in the present disclosure (but not limited to).

Although some specific embodiments of the present disclosure have been described in detail by way of example, it should be understood by those skilled in the art that the above examples are for illustration only and are not intended to limit the scope of the present disclosure. It should be understood by those skilled in the art that the above embodiments may be modified without departing from the scope and spirit of the present disclosure. The scope of the present disclosure is defined by the appended claims.

Claims (10)

1. A method for generating a multimedia file, comprising: Acquire a multimedia file, wherein the multimedia file includes redundant information; The steganographic information is written into the redundant information to generate a multimedia file carrying the steganographic information, wherein the steganographic information is used to indicate that the multimedia file is to be played in a specific playing mode. 2. The method according to claim 1, characterized in that the method further comprises: Segmenting the multimedia file based on at least one time period to obtain multimedia segments corresponding to each time period in the at least one time period; A play mode matching the multimedia segment corresponding to each time period is selected in a pre-stored index table, wherein the index table is used to store a plurality of play control information corresponding to all multimedia segments. 3. The method according to claim 2, characterized in that the step of writing the stego information into the redundant information to generate a multimedia file carrying the stego information comprises: Encode the numerical value corresponding to the playing mode to obtain a coded character string; Compressing the encoded string to obtain a compressed string; Encrypting the compressed string to obtain an encrypted string; The encrypted string is steganographically written into the redundant information to obtain a multimedia file in which the encrypted string is steganographically written. 4. A multimedia file playing method, characterized by comprising: Get multimedia files; Detecting whether there is steganographic information in the multimedia file, wherein the steganographic information is used to instruct to play the multimedia file in a specific playing mode; In the case where the steganographic information exists in the multimedia file, the multimedia file is played in a specific playing mode. 5. The method according to claim 4, characterized in that, when the steganographic information exists in the multimedia file, playing the multimedia file in a specific playing mode comprises: Extracting the stego information to obtain an encrypted string; Decrypting the encrypted string to obtain a compressed string; Decompressing the compressed string to obtain a decompressed string; Decoding the decompressed character string to obtain a numerical value; Selecting a playback mode corresponding to the value in a pre-stored index table; Control the multimedia file to be played in the playing mode. 6. The method according to claim 4 or 5, characterized in that the method further comprises: When the steganographic information does not exist in the multimedia file, the multimedia file is directly played. 7. A multimedia file generating device, characterized by comprising: An acquisition module, configured to acquire a multimedia file, wherein the multimedia file includes redundant information; The generating module is configured to write the stego information into the redundant information to generate a multimedia file carrying the stego information, wherein the stego information is used to indicate that the multimedia file is to be played in a specific playing mode. 8. A multimedia file playing device, comprising: An acquisition module, configured to acquire multimedia files; a detection module configured to detect whether there is steganographic information in the multimedia file, wherein the steganographic information is used to indicate that the multimedia file is to be played in a specific playback mode; The playing module is configured to play the multimedia file in a specific playing mode when the steganographic information exists in the multimedia file. 9. An electronic device, comprising: at least one processor; a memory for storing the at least one processor-executable instruction; The at least one processor is configured to execute the instructions to implement the steps of the method as claimed in any one of claims 1 to 6. 10. A computer-readable storage medium, characterized in that when instructions in the computer-readable storage medium are executed by a processor of an electronic device, the electronic device is enabled to execute the method according to any one of claims 1 to 6.