CN111581426A - Audio fingerprint matching method, device and equipment - Google Patents
Audio fingerprint matching method, device and equipment Download PDFInfo
- Publication number
- CN111581426A CN111581426A CN202010364799.8A CN202010364799A CN111581426A CN 111581426 A CN111581426 A CN 111581426A CN 202010364799 A CN202010364799 A CN 202010364799A CN 111581426 A CN111581426 A CN 111581426A
- Authority
- CN
- China
- Prior art keywords
- audio fingerprint
- common
- user
- matching
- audio
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/60—Information retrieval; Database structures therefor; File system structures therefor of audio data
- G06F16/63—Querying
- G06F16/632—Query formulation
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
- G06F16/60—Information retrieval; Database structures therefor; File system structures therefor of audio data
- G06F16/68—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
- G06F16/683—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/22—Matching criteria, e.g. proximity measures
-
- G—PHYSICS
- G10—MUSICAL INSTRUMENTS; ACOUSTICS
- G10L—SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING
- G10L25/00—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00
- G10L25/48—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use
- G10L25/51—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination
- G10L25/54—Speech or voice analysis techniques not restricted to a single one of groups G10L15/00 - G10L21/00 specially adapted for particular use for comparison or discrimination for retrieval
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Data Mining & Analysis (AREA)
- Multimedia (AREA)
- General Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- Databases & Information Systems (AREA)
- Library & Information Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Mathematical Physics (AREA)
- Evolutionary Biology (AREA)
- Bioinformatics & Computational Biology (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Evolutionary Computation (AREA)
- Computational Linguistics (AREA)
- Signal Processing (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- Human Computer Interaction (AREA)
- Acoustics & Sound (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Collating Specific Patterns (AREA)
Abstract
The invention discloses an audio fingerprint matching method, an audio fingerprint matching device and audio fingerprint matching equipment. Wherein the method comprises the following steps: determining the common characteristics of personal characteristics in one or more associated user profile data, constructing an audio fingerprint database set associated with the one or more common characteristics, performing priority ordering on all audio fingerprint databases in the audio fingerprint database set according to the number of the common characteristics, configuring all audio fingerprint databases in the audio fingerprint database set after the priority ordering to the audio fingerprint database of the common characteristics of the personal characteristics of the user corresponding to the audio fingerprint to be matched, performing similarity matching on the audio fingerprint to be matched and the configured audio fingerprint database, and matching the user corresponding to the audio fingerprint with the highest similarity to be the user corresponding to the audio fingerprint to be matched. Through the mode, the efficiency of audio fingerprint matching can be improved.
Description
Technical Field
The invention relates to the technical field of audio fingerprints, in particular to an audio fingerprint matching method, an audio fingerprint matching device and audio fingerprint matching equipment.
Background
The audio fingerprint refers to that unique digital features in a piece of audio are extracted in the form of identifiers through a specific algorithm and are used for identifying massive sound samples or tracking and positioning the positions of the samples in a database. The audio fingerprint is used as a core algorithm of a content automatic identification technology, and is widely applied to the fields of music identification, copyright content monitoring and broadcasting, content library duplicate removal, television second screen interaction and the like.
In the existing audio fingerprint matching scheme, similarity matching is generally performed between an audio fingerprint to be matched and all audio fingerprints in a preset audio fingerprint database, and a user corresponding to the audio fingerprint with the highest similarity is matched and is the user corresponding to the audio fingerprint to be matched.
However, the inventors found that at least the following problems exist in the prior art:
according to the existing audio fingerprint matching scheme, because similarity comparison is required to be carried out on the audio fingerprint to be matched and all audio fingerprints in a preset audio fingerprint database, the time consumption of the similarity comparison process is long, and the efficiency of matching the audio fingerprints is general.
Disclosure of Invention
In view of this, the present invention provides an audio fingerprint matching method, an audio fingerprint matching apparatus, and an audio fingerprint matching device, which can improve the efficiency of audio fingerprint matching.
According to an aspect of the present invention, there is provided an audio fingerprint matching method, including: acquiring each audio fingerprint data in a preset audio fingerprint database and user information of each user corresponding to each audio fingerprint data; analyzing the audio fingerprint data and the personal characteristics of each user in the audio fingerprint database based on the user information of each user, and establishing user profile data; determining one or more commonality characteristics associated with individual characteristics in the user profile data; constructing a database set of audio fingerprints associated with the one or more common features; according to the number of the common features, all the audio fingerprint databases in the audio fingerprint database set are subjected to priority ranking; configuring all audio fingerprint databases in the audio fingerprint database set after the priority ranking to audio fingerprint databases of the common characteristics of the personal characteristics of the users corresponding to the audio fingerprints to be matched; and performing similarity matching on the audio fingerprint to be matched and the configured audio fingerprint database, and matching the user corresponding to the audio fingerprint with the highest similarity, wherein the user is the user corresponding to the audio fingerprint to be matched.
Wherein said determining one or more common characteristics associated with personal characteristics in said user profile data comprises: screening out a set of at least one common characteristic data associated with the personal characteristics in the user profile data according to the user profile data, and determining one or more common characteristics associated with the personal characteristics in the user profile data according to the set of common characteristic data.
Wherein said constructing a database collection of audio fingerprints associated with said one or more common features comprises: based on one or more same personal characteristics of the common characteristics, ranking and combining the common characteristics containing the one or more same personal characteristics, respectively constructing an audio fingerprint database related to the ranked and combined common characteristics, and forming an audio fingerprint database set related to the one or more common characteristics.
Wherein the prioritizing all audio fingerprint databases in the audio fingerprint database collection according to the number of the common features comprises: and sequencing all the audio fingerprint databases in the audio fingerprint database set according to the priority of the sequence in a mode that the number of the common features is more or less.
Wherein, after the matching the similarity between the audio fingerprint to be matched and the configured audio fingerprint database, matching the user corresponding to the audio fingerprint with the highest similarity, and being the user corresponding to the audio fingerprint to be matched, the method further comprises: compressing all audio fingerprint databases in the audio fingerprint database collection.
According to another aspect of the present invention, there is provided an audio fingerprint matching apparatus including: the device comprises an acquisition module, an establishment module, a determination module, a construction module, a sorting module, a configuration module and a matching module; the acquisition module is used for acquiring each audio fingerprint data in a preset audio fingerprint database and user information of each user corresponding to each audio fingerprint data; the establishing module is used for analyzing the audio fingerprint data and the personal characteristics of each user in the audio fingerprint database based on the user information of each user and establishing user profile data; the determining module is used for determining one or more common characteristics related to personal characteristics in the user profile data; the construction module is used for constructing an audio fingerprint database set related to the one or more common characteristics; the sorting module is used for sorting the priority of all the audio fingerprint databases in the audio fingerprint database set according to the number of the common features; the configuration module is used for configuring all the audio fingerprint databases in the audio fingerprint database set after the priority ranking to the audio fingerprint database of the common characteristic of the personal characteristic of the user corresponding to the audio fingerprint to be matched; and the matching module is used for matching the similarity of the audio fingerprint to be matched with the configured audio fingerprint database, matching the user corresponding to the audio fingerprint with the highest similarity, and taking the user corresponding to the audio fingerprint to be matched as the user corresponding to the audio fingerprint to be matched.
Wherein the determining module is specifically configured to: screening out a set of at least one common characteristic data associated with the personal characteristics in the user profile data according to the user profile data, and determining one or more common characteristics associated with the personal characteristics in the user profile data according to the set of common characteristic data.
Wherein the building block is specifically configured to: based on one or more same personal characteristics of the common characteristics, ranking and combining the common characteristics containing the one or more same personal characteristics, respectively constructing an audio fingerprint database related to the ranked and combined common characteristics, and forming an audio fingerprint database set related to the one or more common characteristics.
Wherein the sorting module is specifically configured to: and sequencing all the audio fingerprint databases in the audio fingerprint database set according to the priority of the sequence in a mode that the number of the common features is more or less.
Wherein, the audio fingerprint matching device further comprises: a compression module; and the compression module is used for compressing all the audio fingerprint databases in the audio fingerprint database set.
According to still another aspect of the present invention, there is provided an audio fingerprint matching apparatus including: at least one processor; and a memory communicatively coupled to the at least one processor; wherein the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the audio fingerprint matching method of any one of the above.
According to a further aspect of the present invention, there is provided a computer-readable storage medium storing a computer program, characterized in that the computer program, when executed by a processor, implements the audio fingerprint matching method as defined in any one of the above.
It can be found that, by the above scheme, each audio fingerprint data in a preset audio fingerprint database and user information of each user corresponding to each audio fingerprint data can be obtained, and the audio fingerprint data and personal features of each user in the audio fingerprint database can be analyzed based on the user information of each user, user profile data can be established, one or more common features related to the personal features in the user profile data can be determined, an audio fingerprint database set related to the one or more common features can be established, and all the audio fingerprint databases in the audio fingerprint database set can be prioritized according to the number of the common features, and the audio fingerprint database of the audio fingerprint database set after being prioritized can be configured to the audio fingerprint database of the common features of the personal features of the user corresponding to the audio fingerprint to be matched, and the audio fingerprint to be matched and the configured audio fingerprint database can be subjected to similarity matching, a user corresponding to the audio fingerprint with the highest similarity is matched, and the time consumed for the similarity matching process of the audio fingerprint to be matched and the audio fingerprint in the corresponding audio fingerprint database can be shortened through a common characteristic mode of personal characteristics for the user corresponding to the audio fingerprint to be matched, so that the efficiency of matching the audio fingerprint can be improved.
Furthermore, according to the scheme, a set of at least one common characteristic data associated with the personal characteristics in the user profile data can be screened out according to the user profile data, and one or more common characteristics associated with the personal characteristics in the user profile data are determined according to the set of the common characteristic data.
Further, according to the above scheme, the common features containing the one or more same personal features can be arranged and combined based on the one or more same personal features of the common features, the audio fingerprint databases related to the common features after the arrangement and combination are respectively constructed, and the audio fingerprint database set related to the one or more common features is formed.
Furthermore, according to the scheme, the audio fingerprint databases in the audio fingerprint database set can be subjected to priority sequencing in sequence according to the mode that the number of the common features is from large to small, so that the advantage that the audio fingerprint database with the most common features of the personal features of the user corresponding to the audio fingerprint to be matched can be conveniently configured from all the audio fingerprint databases in the audio fingerprint database set subjected to the priority sequencing, the time consumption of the similarity matching process of the audio fingerprint to be matched and the audio fingerprint database with the most common features can be shortened to the shortest, and the efficiency of audio fingerprint matching can be improved to the fastest.
Furthermore, by the scheme, all the audio fingerprint databases in the audio fingerprint database set can be compressed, and the advantage is that the storage resources of all the audio fingerprint databases in the audio fingerprint database set can be saved.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the description of the embodiments or the prior art will be briefly described below, it is obvious that the drawings in the following description are only some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 is a flowchart illustrating an audio fingerprint matching method according to an embodiment of the present invention;
FIG. 2 is a flowchart illustrating an audio fingerprint matching method according to another embodiment of the present invention;
FIG. 3 is a schematic diagram of an embodiment of an audio fingerprint matching apparatus according to the invention;
FIG. 4 is a schematic diagram illustrating an audio fingerprint matching apparatus according to another embodiment of the present invention;
fig. 5 is a schematic structural diagram of an embodiment of an audio fingerprint matching apparatus according to the present invention.
Detailed Description
The present invention will be described in further detail with reference to the accompanying drawings and examples. It is to be noted that the following examples are only illustrative of the present invention, and do not limit the scope of the present invention. Similarly, the following examples are only some but not all examples of the present invention, and all other examples obtained by those skilled in the art without any inventive work are within the scope of the present invention.
The invention provides an audio fingerprint matching method which can improve the efficiency of audio fingerprint matching.
Referring to fig. 1, fig. 1 is a flowchart illustrating an audio fingerprint matching method according to an embodiment of the invention. It should be noted that the method of the present invention is not limited to the flow sequence shown in fig. 1 if the results are substantially the same. As shown in fig. 1, the method comprises the steps of:
s101: and acquiring each audio fingerprint data in a preset audio fingerprint database and user information of each user corresponding to each audio fingerprint data.
In this embodiment, each audio fingerprint data in the preset audio fingerprint database and the user information of each user corresponding to each audio fingerprint data may be acquired at one time, each audio fingerprint data in the preset audio fingerprint database and the user information of each user corresponding to each audio fingerprint data may be acquired for multiple times, each audio fingerprint data in the preset audio fingerprint database and the user information of each user corresponding to each audio fingerprint data may be acquired one by one for each user, and the like.
In this embodiment, a plurality of audio fingerprint data may correspond to the same user, or one audio fingerprint data may correspond to one user, and different audio fingerprint data may correspond to different users, and the present invention is not limited thereto.
S102: and analyzing the audio fingerprint data and the personal characteristics of each user in the audio fingerprint database based on the user information of each user, and establishing user profile data.
In this embodiment, the created user profile data may be profile data created for each user, profile data created for all users, and the like, and the present invention is not limited thereto.
In the present embodiment, the personal characteristics may include gender and/or age and/or ethnicity and/or native country and/or occupation, etc., and the present invention is not limited thereto.
S103: one or more commonality characteristics associated with the personal characteristics in the user profile data are determined.
Wherein the determining one or more common characteristics associated with the personal characteristics in the user profile data may comprise:
screening out a set of at least one common characteristic data associated with the personal characteristics in the user profile data according to the user profile data, and determining one or more common characteristics associated with the personal characteristics in the user profile data according to the set of the common characteristic data.
In the present embodiment, the common characteristics may include the same sex and/or the same age and/or the same ethnicity and/or the same occupation, etc., and the present invention is not limited thereto.
S104: an audio fingerprint database set is constructed that correlates the one or more commonality features.
Wherein the constructing of the audio fingerprint database set associated with the one or more common characteristics may include:
based on one or more same personal characteristics of the common characteristics, the common characteristics containing the one or more same personal characteristics are arranged and combined, the audio fingerprint databases related to the common characteristics after the arrangement and combination are respectively constructed, and an audio fingerprint database set related to the one or more common characteristics is formed.
S105: prioritizing all audio fingerprint databases in the set of audio fingerprint databases according to the number of the common features.
Wherein the prioritizing all audio fingerprint databases in the audio fingerprint database set according to the number of the common features may include:
and according to the mode that the number of the common features is from most to few, sequencing all the audio fingerprint databases in the audio fingerprint database set in sequence, so that the advantage that all the audio fingerprint databases in the audio fingerprint database set after being sequenced in priority can be conveniently configured to the audio fingerprint database with the most common features of the personal features of the user corresponding to the audio fingerprint to be matched, the time consumption of the similarity matching process between the audio fingerprint to be matched and the audio fingerprint database with the most common features can be shortened to the shortest, and the efficiency of audio fingerprint matching can be improved to the fastest.
S106: and configuring all the audio fingerprint databases in the audio fingerprint database set after the priority ranking to the audio fingerprint database of the common characteristic of the personal characteristics of the user corresponding to the audio fingerprint to be matched.
Wherein, the configuring all the audio fingerprint databases in the audio fingerprint database set after the priority ranking to the audio fingerprint database of the common feature of the personal feature of the user corresponding to the audio fingerprint to be matched may include:
all the audio fingerprint databases in the audio fingerprint database set after the priority ranking are configured to the audio fingerprint database with the most common characteristic of the personal characteristics of the user corresponding to the audio fingerprint to be matched, so that the advantage that the time consumption of the similarity matching process between the audio fingerprint to be matched and the audio fingerprint database with the most common characteristic can be shortened to the shortest, and the efficiency of audio fingerprint matching can be improved to the fastest.
S107: and performing similarity matching on the audio fingerprint to be matched and the configured audio fingerprint database, and matching the user corresponding to the audio fingerprint with the highest similarity as the user corresponding to the audio fingerprint to be matched.
Wherein, after the matching of the similarity between the audio fingerprint to be matched and the configured audio fingerprint database, and the matching of the user corresponding to the audio fingerprint with the highest similarity, being the user corresponding to the audio fingerprint to be matched, the method may further include:
all the audio fingerprint databases in the audio fingerprint database set are compressed, so that the storage resources of all the audio fingerprint databases in the audio fingerprint database set can be saved.
It can be found that, in this embodiment, each audio fingerprint data in a preset audio fingerprint database and user information of each user corresponding to each audio fingerprint data can be obtained, and the audio fingerprint data and personal features of each user in the audio fingerprint database can be analyzed based on the user information of each user, user profile data can be established, one or more common features related to the personal features in the user profile data can be determined, an audio fingerprint database set related to the one or more common features can be established, and all the audio fingerprint databases in the audio fingerprint database set can be prioritized according to the number of the common features, and the audio fingerprint database of the audio fingerprint database set after being prioritized can be configured to the audio fingerprint database of the common features of the personal features of the user corresponding to the audio fingerprint to be matched, and the audio fingerprint to be matched and the configured audio fingerprint database can be subjected to similarity matching, a user corresponding to the audio fingerprint with the highest similarity is matched, and the time consumed for the similarity matching process of the audio fingerprint to be matched and the audio fingerprint in the corresponding audio fingerprint database can be shortened through a common characteristic mode of personal characteristics for the user corresponding to the audio fingerprint to be matched, so that the efficiency of matching the audio fingerprint can be improved.
Further, in this embodiment, a set of at least one common characteristic data associated with the personal characteristics in the user profile data may be screened out according to the user profile data, and one or more common characteristics associated with the personal characteristics in the user profile data may be determined according to the set of the common characteristic data.
Further, in this embodiment, the user may be presented with a list of personal characteristics based on one or more of the same personal characteristics of the common characteristic, ranking and combining the common features containing the one or more same personal features, respectively constructing an audio fingerprint database related to the ranked and combined common features, forming an audio fingerprint database set related to the one or more common features, the method has the advantages that the audio fingerprint database corresponding to the personal characteristics of the user associated with the audio fingerprint to be matched can be conveniently configured from the established audio fingerprint database set according to the personal characteristics of the user associated with the audio fingerprint to be matched, time consumption of the similarity matching process between the audio fingerprint to be matched and the audio fingerprint in the configured audio fingerprint database can be shortened, and the efficiency of audio fingerprint matching can be improved.
Further, in this embodiment, all the audio fingerprint databases in the audio fingerprint database set may be prioritized in order according to the number of the common features, which has the advantage that the audio fingerprint database with the most common features of the personal features of the user corresponding to the audio fingerprint to be matched can be conveniently configured from all the audio fingerprint databases in the audio fingerprint database set that are prioritized, so that the time consumption for performing the similarity matching process between the audio fingerprint to be matched and the audio fingerprint database with the most common features can be reduced to the shortest, and the efficiency of matching the audio fingerprint can be improved to the fastest.
Referring to fig. 2, fig. 2 is a flowchart illustrating an audio fingerprint matching method according to another embodiment of the invention. In this embodiment, the method includes the steps of:
s201: and acquiring each audio fingerprint data in a preset audio fingerprint database and user information of each user corresponding to each audio fingerprint data.
As described above in S101, further description is omitted here.
S202: and analyzing the audio fingerprint data and the personal characteristics of each user in the audio fingerprint database based on the user information of each user, and establishing user profile data.
As described above in S102, further description is omitted here.
S203: one or more commonality characteristics associated with the personal characteristics in the user profile data are determined.
As described above in S103, which is not described herein.
S204: an audio fingerprint database set is constructed that correlates the one or more commonality features.
As described above in S104, and will not be described herein.
S205: prioritizing all audio fingerprint databases in the set of audio fingerprint databases according to the number of the common features.
As described above in S105, which is not described herein.
S206: and configuring all the audio fingerprint databases in the audio fingerprint database set after the priority ranking to the audio fingerprint database of the common characteristic of the personal characteristics of the user corresponding to the audio fingerprint to be matched.
As described above in S106, and will not be described herein.
S207: and performing similarity matching on the audio fingerprint to be matched and the configured audio fingerprint database, and matching the user corresponding to the audio fingerprint with the highest similarity as the user corresponding to the audio fingerprint to be matched.
As described above in S107, and will not be described herein.
S208: all audio fingerprint databases in the audio fingerprint database collection are compressed.
It can be seen that, in this embodiment, all the audio fingerprint databases in the audio fingerprint database set can be compressed, which has the advantage of saving storage resources of all the audio fingerprint databases in the audio fingerprint database set.
The invention also provides an audio fingerprint matching device, which can improve the efficiency of matching the audio fingerprints.
Referring to fig. 3, fig. 3 is a schematic structural diagram of an audio fingerprint matching device according to an embodiment of the invention. In this embodiment, the audio fingerprint matching apparatus 30 includes an obtaining module 31, a creating module 32, a determining module 33, a constructing module 34, a sorting module 35, a configuring module 36, and a matching module 37.
The obtaining module 31 is configured to obtain each audio fingerprint data in a preset audio fingerprint database and user information of each user corresponding to each audio fingerprint data.
The creating module 32 is configured to parse the audio fingerprint data and the personal characteristics of each user in the audio fingerprint database based on the user information of each user, and create user profile data.
The determining module 33 is configured to determine one or more common characteristics associated with the personal characteristics in the user profile data.
The constructing module 34 is configured to construct a database set of audio fingerprints associated with the one or more commonality characteristics.
The sorting module 35 is configured to perform priority sorting on all the audio fingerprint databases in the audio fingerprint database set according to the number of the common features.
The configuration module 36 is configured to configure, from all the audio fingerprint databases in the audio fingerprint database set after the priority ranking, an audio fingerprint database of the common features of the personal features of the user corresponding to the audio fingerprint to be matched.
The matching module 37 is configured to perform similarity matching between the audio fingerprint to be matched and the configured audio fingerprint database, and match the user corresponding to the audio fingerprint with the highest similarity, which is the user corresponding to the audio fingerprint to be matched.
Optionally, the determining module 33 may be specifically configured to:
screening out at least one common characteristic data set related to the personal characteristics in the user profile data according to the user profile data, and determining one or more common characteristics related to the personal characteristics in the user profile data according to the common characteristic data set.
Optionally, the building module 34 may be specifically configured to:
based on one or more same personal characteristics of the common characteristics, the common characteristics containing the one or more same personal characteristics are arranged and combined, audio fingerprint databases related to the common characteristics after arrangement and combination are respectively constructed, and an audio fingerprint database set related to the one or more common characteristics is formed.
Optionally, the sorting module 35 may be specifically configured to:
and sequencing all the audio fingerprint databases in the audio fingerprint database set according to the mode of the number of the common features from large to small.
Referring to fig. 4, fig. 4 is a schematic structural diagram of an audio fingerprint matching device according to another embodiment of the present invention. Different from the previous embodiment, the audio fingerprint matching device 40 of the present embodiment further includes a compression module 41.
The compressing module 41 is configured to compress all the audio fingerprint databases in the audio fingerprint database set.
Each unit module of the audio fingerprint matching device 30/40 can respectively execute the corresponding steps in the above method embodiments, and therefore, the detailed description of each unit module is omitted here, please refer to the description of the corresponding steps above.
The present invention also provides an audio fingerprint matching apparatus, as shown in fig. 5, comprising: at least one processor 51; and a memory 52 communicatively coupled to the at least one processor 51; the memory 52 stores instructions executable by the at least one processor 51, and the instructions are executable by the at least one processor 51 to enable the at least one processor 51 to perform the audio fingerprint matching method described above.
Wherein the memory 52 and the processor 51 are coupled in a bus, which may comprise any number of interconnected buses and bridges, which couple one or more of the various circuits of the processor 51 and the memory 52 together. The bus may also connect various other circuits such as peripherals, voltage regulators, power management circuits, and the like, which are well known in the art, and therefore, will not be described any further herein. A bus interface provides an interface between the bus and the transceiver. The transceiver may be one element or a plurality of elements, such as a plurality of receivers and transmitters, providing a means for communicating with various other apparatus over a transmission medium. The data processed by the processor 51 is transmitted over a wireless medium via an antenna, which further receives the data and transmits the data to the processor 51.
The processor 51 is responsible for managing the bus and general processing and may also provide various functions including timing, peripheral interfaces, voltage regulation, power management, and other control functions. And the memory 52 may be used to store data used by the processor 51 in performing operations.
The present invention further provides a computer-readable storage medium storing a computer program. The computer program realizes the above-described method embodiments when executed by a processor.
It can be found that, by the above scheme, each audio fingerprint data in a preset audio fingerprint database and user information of each user corresponding to each audio fingerprint data can be obtained, and the audio fingerprint data and personal features of each user in the audio fingerprint database can be analyzed based on the user information of each user, user profile data can be established, one or more common features related to the personal features in the user profile data can be determined, an audio fingerprint database set related to the one or more common features can be established, and all the audio fingerprint databases in the audio fingerprint database set can be prioritized according to the number of the common features, and the audio fingerprint database of the audio fingerprint database set after being prioritized can be configured to the audio fingerprint database of the common features of the personal features of the user corresponding to the audio fingerprint to be matched, and the audio fingerprint to be matched and the configured audio fingerprint database can be subjected to similarity matching, a user corresponding to the audio fingerprint with the highest similarity is matched, and the time consumed for the similarity matching process of the audio fingerprint to be matched and the audio fingerprint in the corresponding audio fingerprint database can be shortened through a common characteristic mode of personal characteristics for the user corresponding to the audio fingerprint to be matched, so that the efficiency of matching the audio fingerprint can be improved.
Furthermore, according to the scheme, a set of at least one common characteristic data associated with the personal characteristics in the user profile data can be screened out according to the user profile data, and one or more common characteristics associated with the personal characteristics in the user profile data are determined according to the set of the common characteristic data.
Further, according to the above scheme, the common features containing the one or more same personal features can be arranged and combined based on the one or more same personal features of the common features, the audio fingerprint databases related to the common features after the arrangement and combination are respectively constructed, and the audio fingerprint database set related to the one or more common features is formed.
Furthermore, according to the scheme, the audio fingerprint databases in the audio fingerprint database set can be subjected to priority sequencing in sequence according to the mode that the number of the common features is from large to small, so that the advantage that the audio fingerprint database with the most common features of the personal features of the user corresponding to the audio fingerprint to be matched can be conveniently configured from all the audio fingerprint databases in the audio fingerprint database set subjected to the priority sequencing, the time consumption of the similarity matching process of the audio fingerprint to be matched and the audio fingerprint database with the most common features can be shortened to the shortest, and the efficiency of audio fingerprint matching can be improved to the fastest.
Furthermore, by the scheme, all the audio fingerprint databases in the audio fingerprint database set can be compressed, and the advantage is that the storage resources of all the audio fingerprint databases in the audio fingerprint database set can be saved.
In the several embodiments provided in the present invention, it should be understood that the disclosed system, apparatus and method may be implemented in other manners. For example, the above-described apparatus embodiments are merely illustrative, and for example, a division of a module or a unit is merely a logical division, and an actual implementation may have another division, for example, a plurality of units or components may be combined or integrated into another system, or some features may be omitted, or not executed. In addition, the shown or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in an electrical, mechanical or other form.
Units described as separate parts may or may not be physically separate, and parts displayed as units may or may not be physical units, may be located in one place, or may be distributed on a plurality of network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the embodiment.
In addition, functional units in the embodiments of the present invention may be integrated into one processing unit, or each unit may exist alone physically, or two or more units are integrated into one unit. The integrated unit can be realized in a form of hardware, and can also be realized in a form of a software functional unit.
The integrated unit, if implemented in the form of a software functional unit and sold or used as a stand-alone product, may be stored in a computer readable storage medium. Based on such understanding, the technical solution of the present invention may be substantially or partially implemented in the form of a software product stored in a storage medium and including instructions for causing a computer device (which may be a personal computer, a server, a network device, or the like) or a processor (processor) to execute all or part of the steps of the method according to the embodiments of the present invention. And the aforementioned storage medium includes: a U-disk, a removable hard disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a magnetic disk or an optical disk, and other various media capable of storing program codes.
The above description is only a part of the embodiments of the present invention, and not intended to limit the scope of the present invention, and all equivalent devices or equivalent processes performed by the present invention through the contents of the specification and the drawings, or directly or indirectly applied to other related technical fields, are included in the scope of the present invention.
Claims (10)
1. An audio fingerprint matching method, comprising:
acquiring each audio fingerprint data in a preset audio fingerprint database and user information of each user corresponding to each audio fingerprint data;
analyzing the audio fingerprint data and the personal characteristics of each user in the audio fingerprint database based on the user information of each user, and establishing user profile data;
determining one or more commonality characteristics associated with individual characteristics in the user profile data;
constructing a database set of audio fingerprints associated with the one or more common features;
according to the number of the common features, all the audio fingerprint databases in the audio fingerprint database set are subjected to priority ranking;
configuring all audio fingerprint databases in the audio fingerprint database set after the priority ranking to audio fingerprint databases of the common characteristics of the personal characteristics of the users corresponding to the audio fingerprints to be matched;
and performing similarity matching on the audio fingerprint to be matched and the configured audio fingerprint database, and matching the user corresponding to the audio fingerprint with the highest similarity, wherein the user is the user corresponding to the audio fingerprint to be matched.
2. The audio fingerprint matching method of claim 1 wherein said determining one or more common features that correlate personal features in said user profile data comprises:
screening out a set of at least one common characteristic data associated with the personal characteristics in the user profile data according to the user profile data, and determining one or more common characteristics associated with the personal characteristics in the user profile data according to the set of common characteristic data.
3. The audio fingerprint matching method of claim 1 wherein said constructing a database set of audio fingerprints associating said one or more common features comprises:
based on one or more same personal characteristics of the common characteristics, ranking and combining the common characteristics containing the one or more same personal characteristics, respectively constructing an audio fingerprint database related to the ranked and combined common characteristics, and forming an audio fingerprint database set related to the one or more common characteristics.
4. The audio fingerprint matching method of claim 1 wherein said prioritizing all of the audio fingerprint databases in the audio fingerprint database collection by the number of common features comprises:
and sequencing all the audio fingerprint databases in the audio fingerprint database set according to the priority of the sequence in a mode that the number of the common features is more or less.
5. The audio fingerprint matching method of claim 1, wherein after the matching of the similarity between the audio fingerprint to be matched and the configured audio fingerprint database to match the user corresponding to the audio fingerprint with the highest similarity, is the user corresponding to the audio fingerprint to be matched, further comprising:
compressing all audio fingerprint databases in the audio fingerprint database collection.
6. An audio fingerprint matching apparatus, comprising:
the device comprises an acquisition module, an establishment module, a determination module, a construction module, a sorting module, a configuration module and a matching module;
the acquisition module is used for acquiring each audio fingerprint data in a preset audio fingerprint database and user information of each user corresponding to each audio fingerprint data;
the establishing module is used for analyzing the audio fingerprint data and the personal characteristics of each user in the audio fingerprint database based on the user information of each user and establishing user profile data;
the determining module is used for determining one or more common characteristics related to personal characteristics in the user profile data;
the construction module is used for constructing an audio fingerprint database set related to the one or more common characteristics;
the sorting module is used for sorting the priority of all the audio fingerprint databases in the audio fingerprint database set according to the number of the common features;
the configuration module is used for configuring all the audio fingerprint databases in the audio fingerprint database set after the priority ranking to the audio fingerprint database of the common characteristic of the personal characteristic of the user corresponding to the audio fingerprint to be matched;
and the matching module is used for matching the similarity of the audio fingerprint to be matched with the configured audio fingerprint database, matching the user corresponding to the audio fingerprint with the highest similarity, and taking the user corresponding to the audio fingerprint to be matched as the user corresponding to the audio fingerprint to be matched.
7. The audio fingerprint matching device of claim 6, wherein the determination module is specifically configured to:
screening out a set of at least one common characteristic data associated with the personal characteristics in the user profile data according to the user profile data, and determining one or more common characteristics associated with the personal characteristics in the user profile data according to the set of common characteristic data.
8. The audio fingerprint matching device of claim 6, wherein the construction module is specifically configured to:
based on one or more same personal characteristics of the common characteristics, ranking and combining the common characteristics containing the one or more same personal characteristics, respectively constructing an audio fingerprint database related to the ranked and combined common characteristics, and forming an audio fingerprint database set related to the one or more common characteristics.
9. The audio fingerprint matching device of claim 6, wherein the ranking module is specifically configured to:
and sequencing all the audio fingerprint databases in the audio fingerprint database set according to the priority of the sequence in a mode that the number of the common features is more or less.
10. The audio fingerprint matching apparatus of claim 6, wherein the audio fingerprint matching apparatus further comprises:
a compression module;
and the compression module is used for compressing all the audio fingerprint databases in the audio fingerprint database set.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010364799.8A CN111581426A (en) | 2020-04-30 | 2020-04-30 | Audio fingerprint matching method, device and equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010364799.8A CN111581426A (en) | 2020-04-30 | 2020-04-30 | Audio fingerprint matching method, device and equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111581426A true CN111581426A (en) | 2020-08-25 |
Family
ID=72111959
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010364799.8A Pending CN111581426A (en) | 2020-04-30 | 2020-04-30 | Audio fingerprint matching method, device and equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111581426A (en) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108696768A (en) * | 2018-05-08 | 2018-10-23 | 北京恒信彩虹信息技术有限公司 | A kind of audio recognition method and system |
| CN109036436A (en) * | 2018-09-18 | 2018-12-18 | 广州势必可赢网络科技有限公司 | A kind of voice print database method for building up, method for recognizing sound-groove, apparatus and system |
| US20190130032A1 (en) * | 2017-10-31 | 2019-05-02 | Spotify Ab | Audio fingerprint extraction and audio recognition using said fingerprints |
| CN110113635A (en) * | 2019-04-25 | 2019-08-09 | 广州智伴人工智能科技有限公司 | A kind of method and system of automatic broadcasting PUSH message |
| CN110956966A (en) * | 2019-11-01 | 2020-04-03 | 平安科技(深圳)有限公司 | Voiceprint authentication method, voiceprint authentication device, voiceprint authentication medium and electronic equipment |
-
2020
- 2020-04-30 CN CN202010364799.8A patent/CN111581426A/en active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20190130032A1 (en) * | 2017-10-31 | 2019-05-02 | Spotify Ab | Audio fingerprint extraction and audio recognition using said fingerprints |
| CN108696768A (en) * | 2018-05-08 | 2018-10-23 | 北京恒信彩虹信息技术有限公司 | A kind of audio recognition method and system |
| CN109036436A (en) * | 2018-09-18 | 2018-12-18 | 广州势必可赢网络科技有限公司 | A kind of voice print database method for building up, method for recognizing sound-groove, apparatus and system |
| CN110113635A (en) * | 2019-04-25 | 2019-08-09 | 广州智伴人工智能科技有限公司 | A kind of method and system of automatic broadcasting PUSH message |
| CN110956966A (en) * | 2019-11-01 | 2020-04-03 | 平安科技(深圳)有限公司 | Voiceprint authentication method, voiceprint authentication device, voiceprint authentication medium and electronic equipment |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11526799B2 (en) | Identification and application of hyperparameters for machine learning | |
| CN106657213B (en) | File transmission method and device | |
| CN112364014B (en) | Data query method, device, server and storage medium | |
| CN109408507B (en) | Multi-attribute data processing method, apparatus, device and readable storage medium | |
| US11030050B2 (en) | Method and device of archiving database and method and device of retrieving archived database | |
| CN113010310B (en) | Method, device and server for processing job data | |
| CN104112010A (en) | Data storage method and device | |
| CN111104427A (en) | Global logistics single number identification method and device, computer equipment and storage medium | |
| US20210357201A1 (en) | Upgrades based on analytics from multiple sources | |
| CN110297953A (en) | Product information recommended method, device, computer equipment and storage medium | |
| CN111309946B (en) | Established file optimization method and device | |
| CN113505272A (en) | Behavior habit based control method and device, electronic equipment and storage medium | |
| CN115204251B (en) | Data processing method, device, electronic device and storage medium | |
| CN112612865A (en) | Document storage method and device based on elastic search | |
| CN111414395A (en) | Data processing method, system and computer equipment | |
| CN111326163B (en) | Voiceprint recognition method, device and equipment | |
| CN111581426A (en) | Audio fingerprint matching method, device and equipment | |
| CN113094415A (en) | Data extraction method and device, computer readable medium and electronic equipment | |
| CN116303072A (en) | Full-link performance test method and device | |
| CN110825729A (en) | Data query method and device, storage medium and electronic device | |
| CN117785973B (en) | Community user information integration method, device, equipment and storage medium | |
| CN111444376A (en) | Audio fingerprint identification method and device and equipment | |
| JP2018013819A (en) | Business matching support system, and business matching support method | |
| CN113495891A (en) | Data processing method and device | |
| CN119293673B (en) | Data classification and grading method and device |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20200825 |