WO2020192012A1 - Data processing method and apparatus, and storage medium - Google Patents

Abstract

A data processing method and apparatus, and a storage medium. The method comprises the following steps: acquiring, from a segment set, a header file segment for target multimedia data (S101); acquiring, according to the header file segment, absolute location information of respective data frames in the target multimedia data, determining, according to the absolute location information, relative location information of sub-segments corresponding to the respective data frames in the target multimedia data, and taking the relative location information of the sub-segments as information to be matched (S102); performing matching on the information to be matched and standard relative location information contained in all sub-segments in the segment set, and acquiring address information of the sub-segment containing the matched standard relative location information (S103); and generating multimedia segment indices corresponding to the target multimedia data according to an association relationship between the address information and the target multimedia data (S104). The method can reduce a probability of data loss, thereby enhancing data security.

Description

Data processing method, equipment and storage medium

This application claims the priority of a Chinese patent application filed with the Chinese Patent Office on March 28, 2019. The application number is 201910244412.2 and the invention title is "a data processing method, equipment and storage medium". The entire content is incorporated by reference. In this application.

Technical field

The present invention relates to the field of electronic technology, and in particular to a data processing method, equipment and storage medium.

Background technique

With the continuous development and improvement of information technology, the use of distributed storage systems has become more and more popular. In order to increase the efficiency of storage and distribution, distributed storage systems generally decompose large files into multiple small files, and then perform processing on small files. The number is composed of a file index and stored in the database. For example, large files (video files of tens of MB or hundreds of MB) are sequentially decomposed into N small files of 512KB for storage and distribution. When accessing large files, only need Know the file index of the large file, find each small file according to the index, then assemble it into a large file, and then access the large file. However, due to system failures or human operation errors, the file index is sometimes lost. The loss of the file index cannot cause the small files to be recombined into large files, which in turn causes all the stored data to be lost or even huge economic losses.

Summary of the invention

The embodiments of the present invention provide a data processing method, device and storage medium, which can reduce the possibility of data loss and improve data security.

One aspect of the embodiments of the present invention provides a data processing method, which may include:

Obtain the header file fragments for the target multimedia data from the fragment set; the fragment set is used to store a plurality of unit data fragments, and the plurality of unit data fragments include header file fragments and sub-files of a plurality of multimedia data. Fragmentation;

Obtain the absolute position information of each frame of data in the target multimedia data according to the header file fragments, determine the relative position information of the sub-slices corresponding to each frame of data in the target multimedia data according to the absolute position information, and convert the The relative position information of the sub-slices is used as the information to be matched;

Matching the to-be-matched information with the standard relative position information contained in all sub-slices in the shard set, and obtain the address information of the sub-shard to which the matched standard relative position information belongs;

According to the association relationship between the address information and the target multimedia data, a multimedia fragment index corresponding to the target multimedia data is generated.

Wherein, the obtaining the header file fragments for the target multimedia data from the fragment set includes:

The file header information of all unit data segments in the segment set is detected, and the unit data segment whose file header information is the first target field is determined as the header file segment of the target multimedia data.

Wherein, the absolute position information of each frame of data in the target multimedia data is obtained according to the header file fragment, and the relative position information of the sub-slice corresponding to each frame of data in the target multimedia data is determined according to the absolute position information , Using the relative position information of the sub-slices as the information to be matched, including:

Acquiring a second target field from the header file fragment; the second target field includes absolute position information of each frame of data in the target multimedia data;

Acquire relative position information corresponding to each frame of data in the target multimedia data in the sub-slices according to the absolute position information and the memory size information of the data fragments of the target multimedia data, and use the relative position information as the information to be matched;

The absolute position information and the relative position information are stored.

Wherein, the absolute position information of each frame of data in the target multimedia data is obtained according to the header file fragment, and the relative position information of the sub-slice corresponding to each frame of data in the target multimedia data is determined according to the absolute position information After using the relative position information of the sub-segments as the information to be matched, the method further includes:

According to the frame header synchronization word information of the data segment, obtain the standard relative position information of each frame of data in all sub-slices in the sub-slice to which it belongs from the segment set;

Obtain address information of all sub-slices according to the storage address of the slice set, and store the standard relative position information and address information.

Wherein, the matching the to-be-matched information with the standard relative position information contained in the sub-shards in the slice set, and obtaining the address information of the sub-shard to which the matched standard relative position information belongs, includes:

The standard relative position information that is the same as the relative position information is searched from the standard relative position information contained in the sub-slices in the slice set, and the sub-segment to which the standard relative position information the same as the relative position information belongs The slice is determined to be the target sub-slice, and if the number of the target sub-slices meets the preset quantity condition, the address information of the target sub-slice is acquired.

Among them, it also includes:

If the number of the target sub-slices does not meet the preset number condition, a prompt message indicating that the multimedia segment index reconstruction fails is output.

Wherein, the generating the multimedia fragment index corresponding to the target multimedia data according to the association relationship between the address information and the target multimedia data includes:

According to the association relationship between the address information and the data fragments of the target multimedia data, the address information is arranged according to the playback order of the target sub-slices, and the multimedia fragments corresponding to the multimedia data are generated according to the arranged address information. Slice index.

One aspect of the embodiments of the present invention provides a data processing device, which may include:

The slice obtaining unit is configured to obtain header file slices for target multimedia data from a slice set; the slice set is used to store multiple unit data slices, and the multiple unit data slices include multiple multimedia Header file fragmentation and sub-fragmentation of data;

The location information acquiring unit is configured to acquire the absolute location information of each frame of data in the target multimedia data according to the header file fragment, and determine the sub-slice corresponding to each frame of data in the target multimedia data according to the absolute position information Relative position information, using the relative position information of the sub-slices as the information to be matched;

The first address information obtaining unit is configured to match the to-be-matched information with the standard relative position information contained in all sub-slices in the slice set, and obtain the sub-slice to which the matched standard relative position information belongs Address information;

The index generating unit is configured to generate a multimedia segment index corresponding to the target multimedia data according to the association relationship between the address information and the target multimedia data.

Wherein, the fragment acquisition unit is specifically used for:

The file header information of all unit data segments in the segment set is detected, and the unit data segment whose file header information is the first target field is determined as the header file segment of the target multimedia data.

Wherein, the location information acquiring unit includes:

An absolute position information obtaining subunit, configured to obtain a second target field from the header file fragment; the second target field includes absolute position information of each frame of data in the target multimedia data;

The relative position information obtaining subunit is used to obtain the relative position information corresponding to each frame of data in the target multimedia data in the subslice according to the absolute position information and the memory size information of the data slice of the target multimedia data, and to compare all The relative position information is used as the information to be matched;

The first storage subunit is configured to store the absolute position information and the relative position information.

Among them, it also includes:

The standard location information acquiring unit is used to acquire the standard relative position information of each frame of data in all sub-slices in the sub-slice to which it belongs from the segment set according to the frame header synchronization word information of the data segment;

The second address information obtaining unit is configured to obtain the address information of all sub-slices according to the storage addresses of the slice set, and to store the standard relative position information and address information.

Wherein, the first address information obtaining unit is specifically configured to:

The standard relative position information that is the same as the relative position information is searched from the standard relative position information contained in the sub-slices in the slice set, and the sub-segment to which the standard relative position information the same as the relative position information belongs The slice is determined to be the target sub-slice, and if the number of the target sub-slices meets the preset quantity condition, the address information of the target sub-slice is acquired.

Among them, it also includes:

The output unit is configured to output a prompt message indicating that the index reconstruction of the multimedia segment fails if the number of the target sub-slices does not meet the preset number condition.

Wherein, the index generating unit is specifically configured to:

According to the association relationship between the address information and the data fragments of the target multimedia data, the address information is arranged according to the playback order of the target sub-slices, and the multimedia fragments corresponding to the multimedia data are generated according to the arranged address information. Slice index.

One aspect of the embodiments of the present invention provides a computer storage medium, the computer storage medium stores a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the above method steps.

One aspect of the embodiments of the present invention provides a data processing device including a processor and a memory; wherein the memory stores a computer program, and the computer program is adapted to be loaded by the processor and execute the following steps:

Obtain the header file fragments for the target multimedia data from the fragment set; the fragment set is used to store a plurality of unit data fragments, and the plurality of unit data fragments include header file fragments and sub-files of a plurality of multimedia data. Fragmentation;

Obtain the absolute position information of each frame of data in the target multimedia data according to the header file fragments, determine the relative position information of the sub-slices corresponding to each frame of data in the target multimedia data according to the absolute position information, and convert the The relative position information of the sub-slices is used as the information to be matched;

Matching the to-be-matched information with the standard relative position information contained in all sub-slices in the shard set, and obtain the address information of the sub-shard to which the matched standard relative position information belongs;

According to the association relationship between the address information and the target multimedia data, a multimedia segment index corresponding to the target multimedia data is generated.

In the embodiment of the present invention, the header file fragment for the target multimedia data is obtained from the fragment set; the absolute position information of each frame of data in the target multimedia data is obtained according to the header file fragment, and according to the The absolute position information determines the relative position information of the sub-slices corresponding to each frame of data in the target multimedia data, and uses the relative position information of the sub-slices as the information to be matched; and compares the information to be matched with all the pieces in the set of pieces. The standard relative position information contained in the sub-segment is matched, and the address information of the sub-segment to which the matched standard relative position information belongs is obtained; the said address information is generated according to the association relationship between the address information and the target multimedia data Multimedia segment index corresponding to the target multimedia data. Through the position information of each frame of data in the small file, the file index of the large file to which the small file belongs is reconstructed, avoiding the problem of losing the file index and being unable to read the large file, reducing the possibility of data loss, and improving the data safety.

Description of the drawings

In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only These are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work.

FIG. 1 is a schematic flowchart of a data processing method provided by an embodiment of the present invention;

2 is a schematic diagram of an example of a data processing method provided by an embodiment of the present invention;

FIG. 3 is a schematic flowchart of another data processing method provided by an embodiment of the present invention;

4 is a schematic structural diagram of a data processing device provided by an embodiment of the present invention;

Figure 5 is a schematic structural diagram of another data processing device provided by an embodiment of the present invention;

6 is a schematic structural diagram of a location information acquiring unit provided by an embodiment of the present invention;

FIG. 7 is a schematic structural diagram of yet another data processing device provided by an embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only a part of the embodiments of the present invention, rather than all the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.

The data processing method provided by the embodiment of the present invention can be applied to the reconstruction of the file index in the distributed storage system. Specifically, the data processing device obtains the header file segment for the target multimedia data from the segment set; according to the header file Obtain the absolute position information of each frame of data in the target multimedia data in fragments, determine the relative position information of the sub-slices corresponding to each frame of data in the target multimedia data according to the absolute position information, and set the relative positions of the sub-slices The information is used as the information to be matched; the information to be matched is matched with the standard relative position information contained in all sub-shards in the shard set, and the address information of the sub-shard to which the matched standard relative position information belongs ; According to the association relationship between the address information and the target multimedia data, generate a multimedia fragment index corresponding to the target multimedia data. Through the position information of each frame of data in the small file, the file index of the large file to which the small file belongs is reconstructed, avoiding the problem of losing the file index and being unable to read the large file, reducing the possibility of data loss, and improving the data safety.

The data processing equipment involved in the embodiment of the present invention may include terminal equipment such as a tablet computer, a personal computer (PC), a notebook computer, and a mobile Internet device (MID).

Please refer to FIG. 1, which is a schematic flowchart of a data processing method according to an embodiment of the present invention. As shown in FIG. 1, the method of the embodiment of the present invention may include the following steps S101 to S104.

S101. Obtain header file fragments for target multimedia data from a fragmentation set; the fragmentation set is used to store a plurality of unit data fragments, and the plurality of unit data fragments include header file fragments of a plurality of multimedia data. Slices and sub-slices;

Specifically, the data processing device obtains header file fragments for the target multimedia data from the fragment set; the fragment set is used to store a plurality of unit data fragments, and the plurality of unit data fragments include a plurality of multimedia data It can be understood that the shard collection stores multiple unit data shards, and the shard collection collective may be the storage space in a distributed storage system, and the unit data shards A slice can be a header file slice of multimedia data or a sub slice of multimedia data. The unit data slice is a large file that is divided into small files using slice storage technology. The header file slice is a storage The encoding and encapsulation characteristics of multimedia data and the unit data fragments of the absolute position information of each frame of data in the multimedia data. The sub-fragments are unit data fragments of partial data frame information stored after the decomposition of the multimedia data. The multimedia data It is a video file or audio file. For example, multimedia data can be H264 or Advanced Video Coding (AVC) video files encapsulated by Moving Picture Experts Group (Moving Picture Experts Group 4, MP4). When the file is stored in fragments, the multimedia file will be decomposed into multiple unit data fragments. A multimedia file can be decomposed into a header file fragment and multiple sub fragments. The data processing device obtains the target multimedia data from the fragment collection. The target multimedia data is the multimedia data whose file index is lost and needs to be reconstructed.

S102. Obtain absolute position information of each frame of data in the target multimedia data according to the header file fragments, determine relative position information of sub-slices corresponding to each frame of data in the target multimedia data according to the absolute position information, and The relative position information of the sub-slices is used as the information to be matched;

Specifically, the data processing device obtains the absolute position information of each frame of data in the target multimedia data according to the header file fragment, and determines the relative sub-slice corresponding to each frame of data in the target multimedia data according to the absolute position information. Position information, the relative position information of the sub-slices is used as the information to be matched. It can be understood that the header file slices store information related to the absolute position information of each frame of data in the target multimedia data, for example, If the target multimedia data is an H264 or AVC video file encapsulated in MP4, there is a "stco" field in the header file segment, and the "stco" field stores the absolute position information of each frame in the video file. The absolute position information is the position of each frame of data in the target multimedia data in the target multimedia file, and the relative position information is the position of each frame of data in the target multimedia data in the unit data slice. Please also refer to Figure 2. An example schematic diagram of a data processing method is provided for an embodiment of the present invention. As shown in Figure 2, the target multimedia file is decomposed to generate a header file segment and multiple sub-slices. The header file segment stores the absolute position information of each frame of data in the target multimedia data. The position information of the frame data is relative position information. The position information of each frame of data in the target multimedia data is not the same as the position information in the sub-slices. The data processing device can use a preset algorithm to calculate according to the absolute position information. The relative position information of the sub-slices corresponding to each frame of data in the target multimedia data, and the relative position information of the sub-slices is used as the to-be-matched information. Similarly, the above-mentioned target multimedia data is used as an example. The unit slice of the above-mentioned target multimedia data The length is a fixed value, and the difference between the absolute position information and the length of the unit segment is modulo operation, and the result of the modulo operation is relative position information.

S103: Match the to-be-matched information with the standard relative position information contained in all sub-slices in the slice set, and obtain the address information of the sub-shard to which the matched standard relative position information belongs;

Specifically, the data processing device matches the to-be-matched information with the standard relative position information contained in all sub-slices in the slice set, and obtains the address information of the sub-shard to which the matched standard relative position information belongs It can be understood that the data processing device obtains the standard relative position information of all sub-slices in the slice set, and the standard relative position information is that the data of each frame in all sub-slices in the slice set belongs to The relative position information in the sub-segment, the information to be matched is matched with the standard relative position information, specifically, the standard relative position information that is the same as the relative position information is searched from the standard relative position information, and the data The processing device obtains the address information of the sub-segment to which the matched standard relative position information belongs, where the address information is the storage address of the sub-segment in the storage space.

S104: Generate a multimedia segment index corresponding to the target multimedia data according to the association relationship between the address information and the target multimedia data.

Specifically, the data processing device generates a multimedia fragment index corresponding to the target multimedia data according to the association relationship between the address information and the target multimedia data. It can be understood that the multimedia data includes multiple unit data Fragmentation, each unit data fragment corresponds to one piece of address information, the association relationship is the correspondence relationship between the address information of the unit data fragment in the target multimedia data and the target multimedia data, and the target multimedia is generated according to the association relationship A multimedia segment index corresponding to the data, where the multimedia segment index is address information corresponding to all unit data segments in the target multimedia data.

In the embodiment of the present invention, the header file fragment for the target multimedia data is obtained from the fragment set; the absolute position information of each frame of data in the target multimedia data is obtained according to the header file fragment, and according to the The absolute position information determines the relative position information of the sub-slices corresponding to each frame of data in the target multimedia data, and uses the relative position information of the sub-slices as the information to be matched; and compares the information to be matched with all the pieces in the set of pieces. The standard relative position information contained in the sub-segment is matched, and the address information of the sub-segment to which the matched standard relative position information belongs is obtained; the said address information is generated according to the association relationship between the address information and the target multimedia data Multimedia segment index corresponding to the target multimedia data. Through the position information of each frame of data in the small file, the file index of the large file to which the small file belongs is reconstructed, avoiding the problem of losing the file index and being unable to read the large file, reducing the possibility of data loss, and improving the data safety.

Refer to FIG. 3, which is a schematic flowchart of a data processing method according to an embodiment of the present invention. As shown in FIG. 3, the method of the embodiment of the present invention may include the following steps S201-S209.

S201: Detect file header information of all unit data segments in the segment set, and determine the unit data segment with the file header information as the first target field as the header file segment of the target multimedia data;

Specifically, the data processing device detects the file header information of all unit data slices in the slice set, and determines that the file header information is the unit data slice of the first target field as the header file slice of the target multimedia data, which can be understood The file header information is a character string that determines the type of unit data slice, and the file header information corresponding to the multimedia data encoded and encapsulated in different ways is different, and the first target field is the file corresponding to the target multimedia data Header information, searching for file header information of all unit data segments in the segment set, and determining the file header information of the unit data segment as the first target field as the header file segment of the target multimedia data, for example The target multimedia data is an H264 or AVC video file encapsulated in MP4, and the 4-8th bytes of the header file fragment of the target multimedia data must be the "ftyp" character string. In the fragment set, the unit data The 4-8th byte of the fragment is the "ftyp" string, which is the header file fragment of the target multimedia data.

S202. Obtain a second target field from the header file fragment; the second target field includes absolute position information of each frame of data in the target multimedia data;

Specifically, the data processing device obtains the second target field from the header file fragment; the second target field includes the absolute position information of each frame of data in the target multimedia data. It can be understood that the first The second target field is a field in the header file fragment. The second target field corresponding to the multimedia file encoded and encapsulated in different ways is different. The above target multimedia data is used for explanation. The second target field is the "stco" field, The "stco" field includes absolute position information of each frame of data in the target multimedia data.

S203: Obtain relative position information corresponding to each frame of data in the target multimedia data in the sub-slices according to the absolute position information and the memory size information of the data fragments of the target multimedia data, and use the relative position information as the to-be-matched information;

Specifically, the data processing device obtains the relative position information corresponding to each frame of data in the target multimedia data in the sub-slice according to the absolute position information and the memory size information of the data slice of the target multimedia data, and calculates the relative position The information is the information to be matched. It can be understood that the memory size information of the data segment is the memory size of a unit data segment. The multimedia data may include multiple unit data segments, and the memory size information of each unit data segment The data processing device uses a preset algorithm to calculate the relative position information of the sub-slice corresponding to each frame of data in the target multimedia data according to the absolute position information and the memory size information, and compares the sub-slices relative to each other. The position information is used as the information to be matched, and the above target multimedia data is also used as an example. The unit slice length of the target multimedia data is a fixed value of 512k, and the difference between the absolute position information and the unit slice length is subjected to a modulo operation. The result of the modular operation is relative position information, and the relative position information is used as the information to be matched.

S204, storing the absolute position information and the relative position information;

Specifically, the data processing device stores the absolute position information and the relative position information. It can be understood that the absolute position information and the relative position information may be stored in a document or other storage space.

S205: Obtain standard relative position information of each frame of data in all sub-slices in the sub-slice to which it belongs from the segment set according to the frame header synchronization word information of the data segment;

Specifically, the data processing device obtains the standard relative position information of each frame of data in all sub-slices in the sub-slice to which it belongs according to the frame header synchronization word information of the data slices. It is understandable that The frame header sync word information corresponding to multimedia data encoded and encapsulated in different ways is different, and the frame header sync word information corresponds to the multimedia data. For example, the target multimedia data is an H264 or AVC video file encapsulated in MP4, Then the frame header synchronization word is "0x000000", according to the frame header synchronization word information of the data fragment, the byte whose character string is the frame header synchronization word is searched in the sub-slice, and the byte is determined as a frame of data According to the frame header synchronization word information, the standard relative position information of each frame of data in all sub-slices in the sub-slice to which it belongs is obtained from the slice set according to the frame header synchronization word information.

S206: Obtain address information of all sub-shards according to the storage address of the shard set, and store the standard relative position information and address information;

Specifically, the data processing device obtains the address information of all sub-shards according to the storage address of the shard set, and stores the standard relative position information and address information. It can be understood that the storage of the shard set The address is the address information of the slice set in the storage space, the storage address includes the address information of each unit data slice in the slice set, and the address information of all sub slices is obtained according to the storage address of the slice set, And store the standard relative position information of each frame of data in each sub-segment and the address information corresponding to each sub-segment. The standard relative position information and the address information can be stored in a file or other storage space .

S207. Search for standard relative position information that is the same as the relative position information from the standard relative position information contained in the sub-slices in the fragment set, and assign the standard relative position information that is the same as the relative position information to The sub-shard is determined to be the target sub-segment, and if the number of the target sub-shards meets a preset quantity condition, the address information of the target sub-shard is acquired;

Specifically, the data processing device searches for the standard relative position information that is the same as the relative position information from the standard relative position information contained in the sub-slices in the slice set, and compares the standard relative position information with the relative position information. The sub-shard to which the location information belongs is determined to be the target sub-shard, and if the number of the target sub-shards meets the preset quantity condition, the address information of the target sub-shard is obtained. It can be understood that the data processing device receives The standard relative position information that is the same as the relative position information is searched for in the standard relative position information contained in all sub-slices in the slice set, and the sub-segment to which the standard relative position information the same as the relative position information belongs A slice is determined as a target sub-slice, and the number of the target sub-slice is detected. If the number of the target sub-slice meets a preset number condition, the address information corresponding to the target sub-slice is acquired, and the pre-slice The quantity condition is set in advance and can be adjusted according to actual conditions. For example, if the preset quantity condition is that the number of target sub-shards is 1, then when the number of target sub-slices is detected to be 1, It is explained that the standard relative position information of only one target sub-slice in the slice set is the same as the relative position information, then it can be determined that the target sub-slice corresponding to the standard relative position information is a sub-slice of the target multimedia data, and further Obtain the address information of the target sub-segment.

S208: If the number of the target sub-slices does not meet the preset number condition, output a prompt message indicating that the multimedia segment index reconstruction fails;

Specifically, if the number of target sub-slices does not meet the preset number condition, the data processing device outputs a prompt message indicating that the multimedia slice index reconstruction has failed. It is understandable that the prompt information may be voice prompt information or A text box. For example, if the preset quantity condition is that the number of target sub-slices is 1, then when no target sub-slice is detected or multiple target sub-slices are detected, the data processing device outputs multimedia The message indicating that the fragment index reconstruction failed.

S209. According to the association relationship between the address information and the data fragments of the target multimedia data, arrange the address information according to the playback order of the target sub-slices, and generate multimedia data corresponding to the arranged address information. Multimedia fragment index.

Specifically, the data processing device arranges the address information according to the play order of the target sub-slices according to the association relationship between the address information and the data fragments of the target multimedia data, and generates the address information according to the arranged address information The multimedia segment index corresponding to the multimedia data. It can be understood that the multimedia data includes multiple unit data segments, and each unit data segment corresponds to one address information, and the association relationship is the unit data in the target multimedia data. The corresponding relationship between the address information of the fragments and the target multimedia data. According to the playback order of the target sub-segments, the corresponding address information of the target sub-slices are arranged in the playback order, and the address information is generated according to the arranged address information. The multimedia fragment index corresponding to the target multimedia data. When accessing the target multimedia file, only the multimedia fragment index corresponding to the target multimedia data needs to be obtained. According to the address information of each unit data fragment in the multimedia fragment index, the target multimedia is obtained All unit data fragments corresponding to the data, and then the unit data fragments are assembled into a target multimedia file.

In the embodiment of the present invention, the header file fragment for the target multimedia data is obtained from the fragment set; the absolute position information of each frame of data in the target multimedia data is obtained according to the header file fragment, and according to the The absolute position information determines the relative position information of the sub-slices corresponding to each frame of data in the target multimedia data, and uses the relative position information of the sub-slices as the information to be matched; and compares the information to be matched with all the pieces in the set of pieces. The standard relative position information contained in the sub-segment is matched, and the address information of the sub-segment to which the matched standard relative position information belongs is obtained; the said address information is generated according to the association relationship between the address information and the target multimedia data Multimedia segment index corresponding to the target multimedia data. Through the location information of each frame of data in the small file, the address information of the small file in the storage space is obtained, the file index of the large file to which the small file belongs is reconstructed, and the user is notified of the result of the file index reconstruction, avoiding the loss of the file index. The problem of being unable to read large files reduces the possibility of data loss and improves data security.

Refer to FIG. 4, which is a schematic structural diagram of a data processing device according to an embodiment of the present invention. As shown in FIG. 4, the data processing device 1 of the embodiment of the present invention may include: a fragment obtaining unit 11, a location information obtaining unit 12, a first address information obtaining unit 13, and an index generating unit 14.

The fragment obtaining unit 11 is configured to obtain header file fragments for target multimedia data from a fragment set; the fragment set is used to store multiple unit data fragments, and the multiple unit data fragments include multiple Header file fragments and sub-fragments of multimedia data;

The position information obtaining unit 12 is configured to obtain the absolute position information of each frame of data in the target multimedia data according to the header file fragments, and determine the sub-segment corresponding to each frame of data in the target multimedia data according to the absolute position information. Slice relative position information, using the relative position information of the sub-slice as the information to be matched;

The first address information obtaining unit 13 is configured to match the to-be-matched information with the standard relative position information contained in all sub-slices in the slice set, and obtain the sub-segment to which the matched standard relative position information belongs The address information of the piece;

The index generating unit 14 is configured to generate a multimedia segment index corresponding to the target multimedia data according to the association relationship between the address information and the target multimedia data.

In the embodiment of the present invention, the header file fragment for the target multimedia data is obtained from the fragment set; the absolute position information of each frame of data in the target multimedia data is obtained according to the header file fragment, and according to the The absolute position information determines the relative position information of the sub-slices corresponding to each frame of data in the target multimedia data, and uses the relative position information of the sub-slices as the information to be matched; and compares the information to be matched with all the pieces in the set of pieces. The standard relative position information contained in the sub-segment is matched, and the address information of the sub-segment to which the matched standard relative position information belongs is obtained; the said address information is generated according to the association relationship between the address information and the target multimedia data Multimedia segment index corresponding to the target multimedia data. Through the position information of each frame of data in the small file, the file index of the large file to which the small file belongs is reconstructed, avoiding the problem of losing the file index and being unable to read the large file, reducing the possibility of data loss, and improving the data safety.

Refer to FIG. 5, which is a schematic structural diagram of a data processing device according to an embodiment of the present invention. As shown in FIG. 5, the data processing device 1 of the embodiment of the present invention may include: a fragment obtaining unit 11, a location information obtaining unit 12, a first address information obtaining unit 13, an index generating unit 14, and a standard location information obtaining unit 15. The second address information acquisition unit 16, the output unit 17.

The slice obtaining unit 11 is configured to detect file header information of all unit data slices in the slice set, and determine that the file header information is the unit data slice of the first target field as the target multimedia data header file slice;

The position information obtaining unit 12 is configured to obtain the absolute position information of each frame of data in the target multimedia data according to the header file fragments, and determine the sub-segment corresponding to each frame of data in the target multimedia data according to the absolute position information. Slice relative position information, using the relative position information of the sub-slice as the information to be matched;

Please refer to FIG. 6 together, which is a schematic structural diagram of a location information acquiring unit 12 according to an embodiment of the present invention. As shown in FIG. 6, the position information obtaining unit 12 in the embodiment of the present invention may include: an absolute position information obtaining subunit 121, a relative position information obtaining subunit 122, and a first storage subunit 123.

The absolute position information obtaining subunit 121 is configured to obtain a second target field from the header file fragment; the second target field includes absolute position information of each frame of data in the target multimedia data;

The relative position information acquisition sub-unit 122 is configured to acquire relative position information corresponding to each frame of data in the target multimedia data in the sub-slice according to the absolute position information and the memory size information of the data segment of the target multimedia data, and The relative position information is used as the information to be matched;

The first storage subunit 123 is configured to store the absolute position information and the relative position information;

The standard position information obtaining unit 15 is configured to obtain the standard relative position information of each frame of data in all sub-slices in the sub-slice to which it belongs from the slice set according to the frame header synchronization word information of the data slices;

The second address information obtaining unit 16 is configured to obtain the address information of all sub-slices according to the storage addresses of the slice set, and store the standard relative position information and address information;

The first address information acquiring unit 13 is configured to search for the standard relative position information that is the same as the relative position information from the standard relative position information contained in the sub-slices in the slice set, and compare it with the relative position information. The sub-segment to which the same standard relative position information belongs is determined to be the target sub-segment, and if the number of the target sub-segment meets a preset quantity condition, the address information of the target sub-segment is acquired;

The output unit 17 is configured to, if the number of the target sub-slices does not meet the preset number condition, output a prompt message that the multimedia segment index reconstruction fails;

The index generating unit 14 is configured to arrange the address information according to the play order of the target sub-slices according to the association relationship between the address information and the data segments of the target multimedia data, and according to the arranged address information Generate the multimedia fragment index corresponding to the multimedia data.

In the embodiment of the present invention, the header file fragment for the target multimedia data is obtained from the fragment set; the absolute position information of each frame of data in the target multimedia data is obtained according to the header file fragment, and according to the The absolute position information determines the relative position information of the sub-slices corresponding to each frame of data in the target multimedia data, and uses the relative position information of the sub-slices as the information to be matched; and compares the information to be matched with all the pieces in the set of pieces. The standard relative position information contained in the sub-segment is matched, and the address information of the sub-segment to which the matched standard relative position information belongs is obtained; the said address information is generated according to the association relationship between the address information and the target multimedia data Multimedia segment index corresponding to the target multimedia data. Through the location information of each frame of data in the small file, the address information of the small file in the storage space is obtained, the file index of the large file to which the small file belongs is reconstructed, and the user is notified of the result of the file index reconstruction, avoiding the loss of the file index. The problem of being unable to read large files reduces the possibility of data loss and improves data security.

The embodiment of the present invention also provides a computer storage medium. The computer storage medium may store a plurality of instructions, and the instructions are suitable for being loaded by a processor and executing the method steps of the embodiment shown in FIGS. 1 and 2 above. For the specific execution process, please refer to the specific description of the embodiment shown in FIG. 1 to FIG. 2, which will not be repeated here.

Refer to FIG. 7, which is a schematic structural diagram of a data processing device according to an embodiment of the present invention. As shown in FIG. 7, the data processing device 1000 may include: at least one processor 1001, such as a CPU, at least one network interface 1004, a user interface 1003, a memory 1005, and at least one communication bus 1002. Among them, the communication bus 1002 is used to implement connection and communication between these components. The user interface 1003 may include a display screen (Display), and the optional user interface 1003 may also include a standard wired interface and a wireless interface. The network interface 1004 may optionally include a standard wired interface and a wireless interface (such as a WI-FI interface). The memory 1005 may be a high-speed RAM memory, or a non-volatile memory (non-volatile memory), such as at least one disk memory. Optionally, the memory 1005 may also be at least one storage device located far away from the foregoing processor 1001. As shown in FIG. 7, the memory 1005 as a computer storage medium may include an operating system, a network communication module, a user interface module, and a data processing application program.

In the terminal 1000 shown in FIG. 7, the user interface 1003 is mainly used to provide an input interface for the user to obtain data input by the user; and the processor 1001 can be used to call a data processing application stored in the memory 1005, and specifically execute The following operations:

Obtain the header file fragments for the target multimedia data from the fragment set; the fragment set is used to store a plurality of unit data fragments, and the plurality of unit data fragments include header file fragments and sub-files of a plurality of multimedia data. Fragmentation;

Obtain the absolute position information of each frame of data in the target multimedia data according to the header file fragments, determine the relative position information of the sub-slices corresponding to each frame of data in the target multimedia data according to the absolute position information, and convert the The relative position information of the sub-slices serves as the information to be matched;

Matching the to-be-matched information with the standard relative position information contained in all sub-slices in the shard set, and obtain the address information of the sub-shard to which the matched standard relative position information belongs;

According to the association relationship between the address information and the target multimedia data, a multimedia segment index corresponding to the target multimedia data is generated.

In the embodiment of the present invention, the header file fragment for the target multimedia data is obtained from the fragment set; the absolute position information of each frame of data in the target multimedia data is obtained according to the header file fragment, and according to the The absolute position information determines the relative position information of the sub-slices corresponding to each frame of data in the target multimedia data, and uses the relative position information of the sub-slices as the information to be matched; and compares the information to be matched with all the pieces in the set of pieces. The standard relative position information contained in the sub-segment is matched, and the address information of the sub-segment to which the matched standard relative position information belongs is obtained; the said address information is generated according to the association relationship between the address information and the target multimedia data Multimedia segment index corresponding to the target multimedia data. Through the position information of each frame of data in the small file, the file index of the large file to which the small file belongs is reconstructed, avoiding the problem of losing the file index and being unable to read the large file, reducing the possibility of data loss, and improving the data safety.

A person of ordinary skill in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be implemented by instructing relevant hardware through a computer program. The program can be stored in a computer readable storage medium. During execution, it may include the procedures of the above-mentioned method embodiments. Wherein, the storage medium may be a magnetic disk, an optical disc, a read-only memory (Read-Only Memory, ROM), or a random access memory (Random Access Memory, RAM), etc.

The above-disclosed are only preferred embodiments of the present invention. Of course, the scope of rights of the present invention cannot be limited by this. Therefore, equivalent changes made according to the claims of the present invention still fall within the scope of the present invention.

Claims (10)

A data processing method, characterized by comprising: Obtain the header file fragments for the target multimedia data from the fragment set; the fragment set is used to store a plurality of unit data fragments, and the plurality of unit data fragments include header file fragments and sub-files of a plurality of multimedia data. Fragmentation; Obtain the absolute position information of each frame of data in the target multimedia data according to the header file fragments, determine the relative position information of the sub-slices corresponding to each frame of data in the target multimedia data according to the absolute position information, and convert the The relative position information of the sub-slices is used as the information to be matched; Matching the to-be-matched information with the standard relative position information contained in all sub-slices in the shard set, and obtain the address information of the sub-shard to which the matched standard relative position information belongs; According to the association relationship between the address information and the target multimedia data, a multimedia segment index corresponding to the target multimedia data is generated. The method according to claim 1, wherein the obtaining the header file fragments for the target multimedia data from the fragment set comprises: The file header information of all unit data segments in the segment set is detected, and the unit data segment whose file header information is the first target field is determined as the header file segment of the target multimedia data. The method according to claim 1, wherein the absolute position information of each frame of data in the target multimedia data is obtained according to the header file fragment, and each frame of data in the target multimedia data is determined according to the absolute position information. The relative position information of the sub-slices corresponding to one frame of data, using the relative position information of the sub-slices as the information to be matched, includes: Acquiring a second target field from the header file fragment; the second target field includes absolute position information of each frame of data in the target multimedia data; Acquire relative position information corresponding to each frame of data in the target multimedia data in the sub-slices according to the absolute position information and the memory size information of the data fragments of the target multimedia data, and use the relative position information as the information to be matched; The absolute position information and the relative position information are stored. The method according to claim 1, wherein the absolute position information of each frame of data in the target multimedia data is obtained according to the header file fragment, and each frame of data in the target multimedia data is determined according to the absolute position information. The relative position information of the sub-slices corresponding to one frame of data, after the relative position information of the sub-slices is used as the information to be matched, further includes: According to the frame header synchronization word information of the data segment, obtain the standard relative position information of each frame of data in all sub-slices in the sub-slice to which it belongs from the segment set; Obtain address information of all sub-slices according to the storage address of the slice set, and store the standard relative position information and address information. The method according to claim 4, wherein said matching the information to be matched with the standard relative position information contained in the sub-shards in the shard set to obtain the standard relative position information of a successful match The address information of the sub-shard to which it belongs, including: The standard relative position information that is the same as the relative position information is searched from the standard relative position information contained in the sub-slices in the slice set, and the sub-segment to which the standard relative position information the same as the relative position information belongs The slice is determined to be the target sub-slice, and if the number of the target sub-slices meets the preset quantity condition, the address information of the target sub-slice is acquired. The method according to claim 5, further comprising: If the number of the target sub-slices does not meet the preset number condition, a prompt message indicating that the multimedia segment index reconstruction fails is output. The method according to claim 1, wherein the generating a multimedia fragment index corresponding to the target multimedia data according to the association relationship between the address information and the target multimedia data comprises: According to the association relationship between the address information and the data fragments of the target multimedia data, the address information is arranged according to the playback order of the target sub-slices, and the multimedia fragments corresponding to the multimedia data are generated according to the arranged address information. Slice index. A data processing device, characterized by comprising: The slice obtaining unit is configured to obtain header file slices for target multimedia data from a slice set; the slice set is used to store multiple unit data slices, and the multiple unit data slices include multiple multimedia Header file fragmentation and sub-fragmentation of data; The location information acquiring unit is configured to acquire the absolute location information of each frame of data in the target multimedia data according to the header file fragment, and determine the sub-slice corresponding to each frame of data in the target multimedia data according to the absolute position information Relative position information, using the relative position information of the sub-slices as the information to be matched; The first address information obtaining unit is configured to match the to-be-matched information with the standard relative position information contained in all sub-slices in the slice set, and obtain the sub-slice to which the matched standard relative position information belongs Address information; The index generating unit is configured to generate a multimedia segment index corresponding to the target multimedia data according to the association relationship between the address information and the target multimedia data. A computer storage medium, wherein the computer storage medium stores a plurality of instructions, and the instructions are adapted to be loaded by a processor and execute the method steps according to any one of claims 1-7. A data processing device, characterized by comprising: a processor and a memory; wherein the memory stores a computer program, and the computer program is adapted to be loaded by the processor and execute the following steps: Obtain the header file fragments for the target multimedia data from the fragment set; the fragment set is used to store a plurality of unit data fragments, and the plurality of unit data fragments include header file fragments and sub-files of a plurality of multimedia data. Fragmentation; Obtain the absolute position information of each frame of data in the target multimedia data according to the header file fragments, determine the relative position information of the sub-slices corresponding to each frame of data in the target multimedia data according to the absolute position information, and convert the The relative position information of the sub-slices is used as the information to be matched; Matching the to-be-matched information with the standard relative position information contained in all sub-slices in the shard set, and obtain the address information of the sub-shard to which the matched standard relative position information belongs; According to the association relationship between the address information and the target multimedia data, a multimedia segment index corresponding to the target multimedia data is generated.

Images