[go: up one dir, main page]

WO2022083653A1 - Method and apparatus for updating biometric library, and electronic device - Google Patents

Method and apparatus for updating biometric library, and electronic device Download PDF

Info

Publication number
WO2022083653A1
WO2022083653A1 PCT/CN2021/125065 CN2021125065W WO2022083653A1 WO 2022083653 A1 WO2022083653 A1 WO 2022083653A1 CN 2021125065 W CN2021125065 W CN 2021125065W WO 2022083653 A1 WO2022083653 A1 WO 2022083653A1
Authority
WO
WIPO (PCT)
Prior art keywords
biometric
feature
input
biometrics
similarity
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2021/125065
Other languages
French (fr)
Chinese (zh)
Inventor
杨威
彭剑峰
叶挺群
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Hikvision Digital Technology Co Ltd
Original Assignee
Hangzhou Hikvision Digital Technology Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Hikvision Digital Technology Co Ltd filed Critical Hangzhou Hikvision Digital Technology Co Ltd
Publication of WO2022083653A1 publication Critical patent/WO2022083653A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/22Matching criteria, e.g. proximity measures
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/0464Convolutional networks [CNN, ConvNet]
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/25Fusion techniques
    • G06F18/253Fusion techniques of extracted features
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74Image or video pattern matching; Proximity measures in feature spaces
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/80Fusion, i.e. combining data from various sources at the sensor level, preprocessing level, feature extraction level or classification level
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/82Arrangements for image or video recognition or understanding using pattern recognition or machine learning using neural networks
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions

Definitions

  • the present application relates to the technical field of artificial intelligence, and in particular, to a method, an apparatus, an electronic device, and a computer-readable storage medium for updating a biometric database.
  • Biometric-based identification technology refers to a technology that uses a computer to identify an individual by using the inherent physiological or behavioral characteristics of an organism.
  • face recognition technology is widely used due to its convenience and speed.
  • the features of the face to be recognized are generally compared with the reference face features, and the identification result is obtained according to the similarity.
  • face features may change greatly with changes in age, hairstyle, weather, season, etc., which may cause the features of the face to be recognized to be less similar to the reference face features due to the changes, and further This results in lower accuracy of face recognition. Therefore, how to improve the accuracy of face recognition is a technical problem that needs to be solved urgently. That is, how to improve the accuracy of individual identification using biometrics is a technical problem that needs to be solved urgently.
  • Embodiments of the present application provide a method, apparatus, electronic device, and computer-readable storage medium for updating a biometric database, so as to improve the accuracy of individual identification using biometrics.
  • a method for updating a biometric database the biometric database includes at least one reference biometric, and the method includes:
  • the input biometric feature is a biometric feature extracted from multimedia data
  • the target reference biometric feature is the at least one reference biometric feature that is the same as the The reference biometrics with the highest matching degree of identity of the input biometrics
  • feature fusion is performed on the input biometric feature and the target reference biometric feature to obtain a fused feature
  • the input biometric feature is obtained after biometric feature extraction is performed on a single picture containing the biometric feature;
  • the input biometric feature is obtained by performing biometric feature extraction on a plurality of pictures containing biometric features and then performing biometric feature fusion.
  • the updating of the target reference biometrics to the fused features includes:
  • the obtaining the similarity between the input biometrics and the target reference biometrics includes: after completing the identification based on the input biometrics, obtaining the similarity between the input biometrics and the target reference biometrics Spend;
  • the first threshold value is greater than the second threshold value
  • the second threshold value is: when performing identification based on the input biometric characteristics, the minimum similarity between the input biometric characteristic and the reference biometric characteristic indicating that the identification is successful.
  • the method for updating the biometric database further includes: before acquiring the similarity between the input biometric and the target reference biometric, according to the similarity between the input biometric and the reference biometric degree, and the result information of whether the associated attributes of the input biometric feature and the reference biometric feature are consistent, and determine the target reference biometric feature;
  • the confidence level of the similarity between the input biometric feature and the reference biometric feature is not less than a confidence level threshold
  • the associated attribute includes at least one of gender, age, and physical shape category.
  • the feature fusion of the input biometric feature and the target reference biometric feature to obtain the fused feature includes:
  • feature fusion is performed on the input biometrics and the target reference biometrics
  • the feat_out is the feature after fusion
  • the feat_cap is the input biometric
  • the feat_old is the target reference biometric
  • the momentum is the momentum coefficient
  • the biometric library includes a face feature library, a palm shape feature library, a skin feature library, a pinna feature library, a gait feature library, or a voice feature library.
  • an apparatus for updating a biometric database wherein the biometric database includes at least one reference biometric feature, and the apparatus includes:
  • an obtaining unit configured to obtain the similarity between the input biometric feature and the target reference biometric feature, wherein the input biometric feature is a biometric feature extracted from multimedia data, and the target reference biometric feature is the at least one reference biological feature The reference biometric feature that matches the identity of the input biometric feature with the greatest degree of identity;
  • a fusion unit configured to perform feature fusion on the input biological feature and the target reference biological feature when the similarity is greater than a first threshold to obtain a post-fusion feature
  • An update unit configured to update the target reference biological feature to the fusion feature.
  • an electronic device comprising: a memory and a processor coupled to the memory, the processor configured to execute any of the foregoing based on instructions stored in the memory The method for updating the biometric database described in the technical solution.
  • a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, the method for updating a biometric database described in any of the foregoing technical solutions is implemented .
  • the above-mentioned embodiments of the present application can implement automatic updating of the biometric database according to program settings.
  • the reference biological feature of the embodiment of the present application can make dynamic adjustment following the change of the individual biological feature.
  • the updated biometric database is applied to biometric identification, which can improve the accuracy of identification, thereby improving the security of information.
  • Fig. 1 is the flow chart of a kind of face recognition method in the related art
  • FIG. 2 is a flowchart of a method for updating a biometric database according to some embodiments of the present application
  • FIG. 3 is a flowchart of face recognition and update of face feature database in some embodiments of the present application.
  • FIG. 4 is a block diagram of an apparatus for updating a biometric database according to some embodiments of the present application.
  • FIG. 5 is a block diagram of an electronic device according to some embodiments of the present application.
  • Face recognition is a biometric recognition technology based on human facial features.
  • the pre-established reference face features in the feature library are compared, and the recognition result of the face identity information is obtained according to the similarity.
  • FIG. 1 it is a face recognition method in the related art, and the method includes the following steps S01-S05.
  • step S01 a picture including a face region collected by an image collection device is acquired.
  • step S02 a face feature extraction algorithm is used to extract a face feature from a picture containing a face region, as an input face feature.
  • step S03 the reference face features in the face feature database are traversed, and the similarity between the input face feature and each reference face feature is compared to obtain a similarity list.
  • step S04 the similarity list is screened, and the similarity comparison data whose confidence level is not less than the confidence level threshold is retained as the screening result.
  • the above confidence level may reflect: the confidence of the result of the similarity comparison between the input face feature and the reference face feature.
  • step S05 output the recognition result according to the reference face feature corresponding to the maximum similarity in the screening result.
  • the identification result may include the maximum similarity, the face image restored based on the reference face feature, the identification number of the individual corresponding to the reference face feature, and the like.
  • the inventors of the present application found that since the reference facial features in the facial feature database are fixed, when the facial features change greatly with changes in age, hairstyle, weather, season, etc. The accuracy of face recognition results will be greatly reduced, which will bring information security risks.
  • the embodiments of the present application provide a method, an apparatus, an electronic device, and a computer-readable storage medium for updating a biometrics database.
  • the biometric database may be, for example, a face feature library, a palm shape feature library, a skin feature library, a pinna feature library, a gait feature library, or a voice feature library, and so on.
  • the biometric database may include only one reference biological feature, or may include multiple reference biological features, and the number of reference biological features in the biometric database may be increased or deleted according to user requirements.
  • the above-mentioned biometric database can be understood as a database for storing reference biometric characteristics.
  • the above-mentioned reference biometrics can be understood as: pre-obtained biometrics used for feature comparison.
  • some embodiments of the present application provide a method for updating a biometric library, wherein the biometric library includes at least one reference biometric, and the method for updating the biometric library includes the following steps S1 to S3.
  • step S1 the similarity between the input biometric feature and the target reference biometric feature is obtained, wherein the input biometric feature is a biometric feature extracted from multimedia data, and the target reference biometric feature is the at least one reference biometric feature and the input biometric feature.
  • the above-mentioned input biometrics can be understood as: the biometrics of the individual whose identity needs to be matched may be the biometrics extracted from the multimedia data including the above-mentioned individual.
  • the above identity matching degree can be understood as a parameter used to measure whether the identity of the individual reflected by the reference biometrics is consistent with the identity of the individual reflected by the input biometrics.
  • the above-mentioned target reference biometrics can be understood as: the characteristics determined from the reference biometrics, and the reflected individual matches the identity of the individual reflected by the above input biometrics. That is, the identity of the individual reflected by the target reference biometrics matches the identity of the individual reflected by the above input biometrics.
  • the biometric database From the reference biometric features stored in the biometric database, it is possible to determine the features of the reflected individual that match the identity of the individual reflected by the above input biometric features, as the target reference biological feature, and then obtain the target reference biological feature Similarity to the above input biometrics.
  • the Euclidean distance, cosine similarity, Manhattan distance, etc. between the input biometrics and the reference biometrics may be calculated, as the above similarity between features.
  • the input biometrics and the reference biometrics can also be input into a pre-trained similarity calculation model to obtain the similarity between the input biometrics and the reference biometrics output by the model.
  • the input biometric feature is obtained after biometric feature extraction is performed on a single picture containing the biometric feature.
  • the input biometric feature is extracted from a single photo taken by the camera that contains the biometric feature, or from a frame in the video stream captured by the camera that contains the biometric feature.
  • the input biometric feature is obtained by performing biometric feature extraction on a plurality of pictures containing biometric features and then performing biometric feature fusion.
  • a plurality of pictures containing biological features can be obtained, and biological features are extracted from each picture to obtain a plurality of biological features, and then feature fusion is performed on the above-mentioned plurality of biological features, and the fusion result is used as the input biological features.
  • biometric feature extraction is performed on multiple frames captured by a camera that contain biometric features, and then these biometric features are fused to obtain input biometric features.
  • biometric fusion calculation can make the impact on the accuracy of the recognition result small or even negligible, thereby improving the accuracy of biometric recognition. accuracy.
  • the reference biological feature of the biological feature database is an offline reference template obtained based on a deep learning algorithm.
  • Deep learning is a type of machine learning, and machine learning is the only way to realize artificial intelligence.
  • the concept of deep learning originated from the study of artificial neural networks, and a multilayer perceptron containing multiple hidden layers is a deep learning structure. Deep learning realizes distributed feature representation of data by combining low-level features to form more abstract high-level features that represent attribute categories.
  • the motivation for studying deep learning is to build a neural network that simulates the human brain for analysis and learning, which imitates the mechanism of the human brain to parse data, such as images, sounds, and texts.
  • Typical deep learning models include convolutional neural network models, deep neural network models, and stacked self-encoding network models.
  • the target reference biometrics refers to: comparing each reference biometric feature in the biometric database with the input biometric features, wherein the reference biometric feature with the largest identity matching with the input biometric feature.
  • the consideration factor of the identity matching degree includes the similarity of the biometric comparison.
  • target baseline biometrics can be determined by:
  • the above-mentioned consideration factors of the identity matching degree may also include the consistency of other attributes associated with the user identity, for example, the consistency of gender, age group, physical form category, and the like.
  • the attributes associated with the user identity hereinafter referred to as the associated attributes
  • the associated attributes of the input biometrics can be calculated by using a certain algorithm. That is, the target reference biometrics can be understood as: in the biometric database, the reference biometrics with the highest degree of identity matching with the input biometrics and consistent associated attributes.
  • the method for updating the biometric database further includes: before acquiring the similarity between the input biometric and the target reference biometric, according to the similarity between the input biometric and the reference biometric, and The result information of whether the associated attributes of the input biometrics and the reference biometrics are consistent, and determine the target reference biometrics; wherein, the confidence level of the similarity between the input biometrics and the reference biometrics is not less than the confidence level threshold, and the associated attributes include gender, At least one of age group and physical form category.
  • the above confidence level may reflect: the confidence of the similarity between the acquired input biometrics and the reference biometrics.
  • the similarity between the input biometrics and each reference biometric in the biometric database can be obtained, and the confidence level of the similarity is determined to be greater than or equal to a preset confidence level threshold, the similarity is the largest, and the associated attribute is the same as the input biometrics. Consistent benchmark biometrics as the target benchmark biometrics with the greatest identity match.
  • the similarity between the input biometrics and each reference biometric in the biometric database can be obtained, and the reference biometrics whose confidence level of the similarity is greater than or equal to a preset confidence level threshold are selected from the comparison, and from From the selected benchmark biometrics, select the benchmark biometrics whose associated attributes are consistent with the input biometrics, and determine the feature with the greatest similarity with the input biometrics from the selected benchmark biometrics, as the target benchmark biometric with the greatest identity matching. feature.
  • the reference biometrics whose associated attributes are consistent with the input biometrics from the biometrics database, and use them as candidate reference biometrics to obtain the similarity between each candidate reference biometric and the input biometrics, and then filter similarities.
  • the confidence level of the degree is greater than or equal to the preset confidence level threshold, and the feature with the greatest similarity with the input biometrics is determined from the filtered benchmark biometrics as the target reference biometric with the greatest identity matching degree.
  • the above step S1 is performed after completing the identification based on the input biometrics. In other embodiments of the present application, the above-mentioned step S1 may also be performed in the process of performing identification based on the input biometrics, or before performing the identification based on the inputted biometrics.
  • the identification result may include the identity verification result of the input biometrics, and in addition, may also include the similarity of the input biometrics compared with the target reference biometrics, the identity of the individual corresponding to the target reference biometrics, based on The image of the individual restored by the target reference biometrics, and other associated attributes, such as gender, age, physical shape category, etc.
  • the similarity between the input biometrics and the target reference biometrics is obtained. That is, every time the biometric identification program is executed, after the identification is completed, a program for updating the biometric database is started.
  • each time a set period of time passes the identification result outputted by the identification based on the input biometric feature within the set period of time may be obtained, and the identification result includes the input biometric feature and the input biometric feature. Similarity of target baseline biometric alignments. That is, the procedure for updating the biometric database is started at a predetermined frequency.
  • the set time period can be determined in conjunction with system processing performance and update requirements of the biometric database.
  • step S2 when the similarity between the input biometrics and the target reference biometrics is greater than the first threshold, feature fusion is performed on the input biometrics and the target reference biometrics to obtain fused features.
  • the first threshold is preset and greater than the second threshold
  • the second threshold is the minimum similarity between the input biometrics and the reference biometrics indicating successful identification when performing identification based on the input biometrics Spend.
  • Application scenario settings of some embodiments of the present application when the similarity between the input biometrics and the target reference biometrics is not less than the second threshold, the input biometric identity verification is allowed to pass; otherwise, the input biometric identity is not allowed Verification passed.
  • the second threshold is 95% and the first threshold is 97%.
  • the similarity between the input biometric and the target reference biometric is not less than 95%, the input biometric authentication is allowed to pass, otherwise, the input biometric authentication is not allowed to pass.
  • the similarity based on the comparison between the input biometrics and the target reference biometrics is greater than 97%, the biometric database is updated; otherwise, the biometric database is not updated. That is, compared with the judgment of the input biometric identity, a higher similarity requirement is put forward for the update of the biometric database, so that the accuracy of the update of the biometric database can be improved.
  • both input biometrics and reference biometrics are vectors, and feature fusion refers to a method of transforming two or more biometric vectors into one biometric vector.
  • feature fusion is performed on the input biometrics and the target reference biometrics to obtain the fused features, including:
  • feat_out feat_cap*(1–momentum)+feat_old*momentum
  • the feature fusion is performed on the input biometrics and the target benchmark biometrics; among them, feat_out is the fused feature, feat_cap is the input biometric, feat_old is the target benchmark biometric, momentum is the momentum coefficient, and 0 ⁇ momentum ⁇ 1.
  • the momentum coefficient is greater than or equal to 0.9 and less than 1.
  • the momentum value is 0.95.
  • the feature fusion of the input biometrics and the target reference biometrics to obtain the fused features includes: splicing the vector components of the input biometrics and the target reference biological features to obtain the fused features.
  • step S3 the target reference biometric feature is updated to the fused feature.
  • each reference biometric corresponds to an identity document (ID).
  • ID an identity document
  • the above step S3 includes:
  • the methods for updating a biometric database are used in a face recognition scenario, and the method process for face recognition and updating the facial feature database includes the following steps S21 to S33 .
  • step S21 a plurality of pictures including a face region captured by the image acquisition device are acquired.
  • step S22 according to the set scoring rules, quality scores are performed on the plurality of pictures including the face region obtained in the above step S21, and pictures whose quality scores are lower than the set threshold are filtered out.
  • the video frame P11 does not pass the quality score because the face area is blurred, and the video frame P12 fails the quality score because the face area is incomplete, then the video frames P11 and P12 are filtered out in this step S22.
  • step S23 for each picture including a face region, a face feature extraction algorithm is used to extract the face feature from the picture.
  • face features F1, F2, F3..., F10 are extracted from video frames P1, P2, P3..., P10, respectively.
  • step S23 the facial feature extraction algorithm used is not limited.
  • the facial feature extraction algorithm adopts an Active Shape Model (ASM) algorithm.
  • ASM is an algorithm based on Point Distribution Model (PDM).
  • PDM Point Distribution Model
  • the geometric shapes of objects with similar shapes, such as faces, hands, hearts, lungs, etc. can be represented by a shape vector formed by concatenating the coordinates of several key feature points in sequence.
  • the process of using the ASM algorithm to extract face features from pictures includes: using the classifier to detect the face area; using the trained model to find a fixed number of feature points (for example, 68 feature points) on the face; recording the coordinates of each feature point position, and in turn concatenate to form a shape vector.
  • the facial feature extraction algorithm adopts an Active Appearance Model (Active Appearance Model, AAM) algorithm.
  • AAM algorithm On the basis of ASM algorithm, AAM algorithm further performs statistical modeling on texture, and further fuses the two statistical models of shape and texture into an appearance model. After the AAM algorithm unifies the dimensions of the shape and texture features, the modeling and search process is basically the same as that of the ASM.
  • step S24 the face features F1, F2, F3..., F10 extracted in step S23 are subjected to feature fusion to obtain the input face feature F.
  • the picture of the video frame P2 is slightly blurred. If the face feature F2 is simply extracted from the video frame P2 as the input face feature for face recognition, the accuracy of the recognition result may be affected to a certain extent. In this embodiment, feature fusion processing is performed on the facial features of the series of video frames, and the influence of the image quality of the video frame P2 on the input facial features can be ignored, so the accuracy of face recognition can be improved.
  • step S25 traverse the reference face features M1, M2, M3... in the face feature database, compare the similarity between the input face feature F and each reference face feature, and obtain a similarity list as shown in Table 1 below shown.
  • step S26 the similarity list is screened, and the similarity comparison data whose confidence level is not less than the confidence level threshold is retained as the first screening result, as shown in Table 2 below.
  • the confidence level is the probability that the population parameter value falls within a certain interval of the sample statistic value.
  • the face recognition result is considered unreliable, and the comparison data is eliminated; if the confidence level of the similarity comparison data is not less than the confidence level threshold, The face recognition result is considered credible, and the comparison data is retained.
  • step S27 the first screening result is screened again, and the comparison data of the reference face feature whose associated attribute is consistent with the input face feature F is retained as the second screening result, as shown in Table 3 below.
  • the associated attribute includes at least one of gender, age group, and physical form categories.
  • the gender corresponding to the reference face feature M6 in the above Table 2 is inconsistent with the gender obtained based on the input face feature, therefore, the comparison data related to the reference face feature M6 is screened out in this step S27 .
  • step S28 the reference face feature corresponding to the maximum similarity in the second screening result is used as the target reference face feature M1, and a recognition result is output based on the target reference face feature M1.
  • the recognition result includes the above-mentioned maximum similarity (98%), the face image restored based on the target benchmark face feature M1, and Wang's identity, such as Wang's job number 00345.
  • step S28 Since the reference face features whose confidence level is less than the confidence level threshold have been screened out in the aforementioned step S27, and the reference face features whose associated attributes are inconsistent with the input face feature F have been screened out in the aforementioned step S28, therefore, the step S28 The amount of calculation is greatly reduced, and the output results are more accurate.
  • step S29 the similarity between the input biometrics and the target reference biometrics is obtained.
  • step S30 it is judged whether the similarity (98%) between the input biometric feature and the target reference biometric feature is greater than the first threshold (eg, the first threshold is 95%), if so, the process goes to step S31, otherwise, the process ends.
  • the first threshold eg, the first threshold is 95%)
  • step S31 the target reference face feature M1 is found from the face feature database according to the identity identifier corresponding to the target reference face feature M1, such as Wang's job number 00345.
  • step S32 feature fusion is performed on the input face feature F and the target reference face feature M1 to obtain a fused feature M1'.
  • step S33 the target reference face feature M1 in the face feature library is updated to the fused feature M1', that is, the target reference face feature M1 in the face feature library is replaced with the fused feature M1'.
  • some embodiments of the present application further provide a device 400 for updating a biometric database, where the biometric database includes at least one reference biometric, and the device 400 for updating a biometric database includes:
  • the obtaining unit 41 is used to obtain the similarity between the input biological feature and the target reference biological feature, wherein the input biological feature is the biological feature extracted from the multimedia data, and the target reference biological feature is at least one reference biological feature and the input biological feature. Benchmark biometrics with the highest matching degree of identity of the features;
  • the fusion unit 42 is configured to perform feature fusion on the input biological feature and the target reference biological feature when the similarity is greater than the first threshold to obtain the fused feature;
  • the updating unit 43 is configured to update the target reference biological feature to the fused feature.
  • the above-mentioned embodiments of the present application can implement automatic updating of the biometric database according to program settings.
  • the reference biological feature of the embodiment of the present application can make dynamic adjustment following the change of the individual biological feature.
  • the updated biometric database is applied to biometric identification, which can improve the accuracy of identification, thereby improving the security of information.
  • some embodiments of the present application further provide an electronic device 500 , comprising: a memory 51 and a processor 52 coupled to the memory 51 , the processor 52 is configured to be based on instructions stored in the memory 51 , The method for updating a biometric database as in any of the preceding embodiments is performed.
  • the memory 51 may include random access memory (Random Access Memory, RAM), or may include non-volatile memory (Non-Volatile Memory, NVM), such as at least one disk storage.
  • RAM Random Access Memory
  • NVM Non-Volatile Memory
  • the memory 51 may also be at least one storage device located remotely from the aforementioned processor 52 .
  • the above-mentioned processor 52 can be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU), a network processor (Network Processor, NP), etc.; it can also be a digital signal processor (Digital Signal Processor, DSP), dedicated Integrated circuit (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.
  • CPU Central Processing Unit
  • NP Network Processor
  • DSP Digital Signal Processor
  • ASIC Application Specific Integrated Circuit
  • FPGA Field-Programmable Gate Array
  • Some embodiments of the present application further provide a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, implements the method for updating a biometric database according to any of the foregoing technical solutions.
  • a computer program product including instructions when it runs on a computer, the computer causes the computer to execute the method for updating a biometric database in any of the foregoing embodiments.
  • a computer program product includes one or more computer instructions.
  • the computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable device.
  • Computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, computer, server, or data center over a wire (e.g.
  • a computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, a data center, or the like that includes an integration of one or more available media.
  • Useful media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, DVD), or semiconductor media (eg, Solid State Disk (SSD)), among others.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Evolutionary Computation (AREA)
  • Artificial Intelligence (AREA)
  • Health & Medical Sciences (AREA)
  • Data Mining & Analysis (AREA)
  • General Health & Medical Sciences (AREA)
  • Software Systems (AREA)
  • Computing Systems (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Engineering & Computer Science (AREA)
  • Computational Linguistics (AREA)
  • Mathematical Physics (AREA)
  • Molecular Biology (AREA)
  • Biophysics (AREA)
  • Biomedical Technology (AREA)
  • Multimedia (AREA)
  • Medical Informatics (AREA)
  • Databases & Information Systems (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Evolutionary Biology (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Collating Specific Patterns (AREA)

Abstract

Provided in the present application are a method and apparatus for updating a biometric library, and an electronic device. The biometric library comprises at least one base biometric, and the method for updating the biometric library comprises: acquiring the similarity between an input biometric and a target base biometric, wherein the input biometric is the biometric extracted from multimedia data, and the target base biometric is the base biometric among the at least one base biometric that best matches the input biometric feature in terms of identity; when the similarity is greater than a first threshold, performing feature fusion on the input biometric and the target base biometric to obtain a fused feature; and updating the target base biometric as the fused feature.

Description

更新生物特征库的方法、装置及电子设备Method, device and electronic device for updating biometric database

本申请要求于2020年10月20日提交中国专利局、申请号为202011124636.9发明名称为“更新生物特征库的方法、装置及电子设备”、以及于2021年01月15日提交中国专利局、申请号为202110057029.3发明名称为“更新生物特征库的方法、装置及电子设备”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application is required to be submitted to the China Patent Office on October 20, 2020, the application number is 202011124636.9, and the title of the invention is "Method, Apparatus and Electronic Device for Updating Biometric Database", and the application should be submitted to the China Patent Office on January 15, 2021. The priority of the Chinese patent application No. 202110057029.3 and the title of the invention is "Method, Apparatus and Electronic Device for Updating Biometric Database", the entire contents of which are incorporated herein by reference.

技术领域technical field

本申请涉及人工智能技术领域,特别涉及一种更新生物特征库的方法、装置、电子设备及计算机可读存储介质。The present application relates to the technical field of artificial intelligence, and in particular, to a method, an apparatus, an electronic device, and a computer-readable storage medium for updating a biometric database.

背景技术Background technique

在当今信息化时代,如何准确鉴定个体的身份进而保护信息的安全,已成为一个必须解决的关键社会问题。为鉴定个体的身份,可以采用基于生物特征的身份识别技术。基于生物特征的身份识别技术(简称生物特征识别),是指通过计算机,利用生物体所固有的生理特征或行为特征来进行个体身份鉴定的技术。在基于生物特征的身份识别技术中,人脸识别技术由于其方便快捷的优势而被广泛应用。In today's information age, how to accurately identify the individual's identity to protect the security of information has become a key social problem that must be solved. To identify an individual, biometric-based identification techniques can be employed. Biometric-based identification technology (referred to as biometric identification) refers to a technology that uses a computer to identify an individual by using the inherent physiological or behavioral characteristics of an organism. Among biometric-based identification technologies, face recognition technology is widely used due to its convenience and speed.

在人脸识别技术中,一般是将待识别人脸的特征与基准人脸特征进行比对,根据相似度来得到身份识别结果。但是,人脸特征可能会随年龄、发型、天气、季节等变化而发生较大的变化,这样可能会导致待识别人脸的特征由于发生变化而与基准人脸特征的相似度较低,进而导致人脸识别的准确性较低。因此,如何提升人脸识别的准确性,是亟待解决的一个技术问题。也就是,如何提升利用生物特征进行个体身份识别的准确性,是亟待解决的一个技术问题。In the face recognition technology, the features of the face to be recognized are generally compared with the reference face features, and the identification result is obtained according to the similarity. However, face features may change greatly with changes in age, hairstyle, weather, season, etc., which may cause the features of the face to be recognized to be less similar to the reference face features due to the changes, and further This results in lower accuracy of face recognition. Therefore, how to improve the accuracy of face recognition is a technical problem that needs to be solved urgently. That is, how to improve the accuracy of individual identification using biometrics is a technical problem that needs to be solved urgently.

发明内容SUMMARY OF THE INVENTION

本申请实施例提供一种更新生物特征库的方法、装置、电子设备及计算机可读存储介质,以提升利用生物特征进行个体身份识别的准确性。Embodiments of the present application provide a method, apparatus, electronic device, and computer-readable storage medium for updating a biometric database, so as to improve the accuracy of individual identification using biometrics.

根据本申请实施例的一个方面,提供一种更新生物特征库的方法,所述生物特征库包括至少一个基准生物特征,所述方法包括:According to an aspect of the embodiments of the present application, there is provided a method for updating a biometric database, the biometric database includes at least one reference biometric, and the method includes:

获取输入生物特征与目标基准生物特征比对的相似度,其中,所述输入生物特征为从多媒体数据中提取的生物特征,所述目标基准生物特征为所述至少一个基准生物特征中与所述输入生物特征的身份匹配度最大的基准生物特征;Obtaining the similarity between the input biometric feature and the target reference biometric feature, wherein the input biometric feature is a biometric feature extracted from multimedia data, and the target reference biometric feature is the at least one reference biometric feature that is the same as the The reference biometrics with the highest matching degree of identity of the input biometrics;

当所述相似度大于第一阈值时,对所述输入生物特征与所述目标基准生物特征进行特征融合,得到融合后特征;When the similarity is greater than the first threshold, feature fusion is performed on the input biometric feature and the target reference biometric feature to obtain a fused feature;

将所述目标基准生物特征更新为所述融合后特征。Updating the target reference biometrics to the fused features.

在一些实施例中,所述输入生物特征是对单张包含生物特征的图片进行生物特征提取后得到的;或者In some embodiments, the input biometric feature is obtained after biometric feature extraction is performed on a single picture containing the biometric feature; or

所述输入生物特征是对多张包含生物特征的图片进行生物特征提取后再进行生物特征融合得到的。The input biometric feature is obtained by performing biometric feature extraction on a plurality of pictures containing biometric features and then performing biometric feature fusion.

在一些实施例中,所述将所述目标基准生物特征更新为所述融合后特征,包括:In some embodiments, the updating of the target reference biometrics to the fused features includes:

根据所述目标基准生物特征的身份标识,从所述生物特征库中查找所述目标基准生物特征;Searching for the target reference biometric feature from the biometric database according to the identity of the target reference biometric feature;

将所述目标基准生物特征替换为所述融合后特征。Replace the target fiducial biometric with the fused feature.

在一些实施例中,所述获取输入生物特征与目标基准生物特征比对的相似度,包括:在基于输入生物特征完成身份识别之后,获取所述输入生物特征与目标基准生物特征比对的相似度;In some embodiments, the obtaining the similarity between the input biometrics and the target reference biometrics includes: after completing the identification based on the input biometrics, obtaining the similarity between the input biometrics and the target reference biometrics Spend;

所述第一阈值大于第二阈值,所述第二阈值为:基于所述输入生物特征进行身份识别时,表征身份识别成功的输入生物特征与基准生物特征的最小相似度。The first threshold value is greater than the second threshold value, and the second threshold value is: when performing identification based on the input biometric characteristics, the minimum similarity between the input biometric characteristic and the reference biometric characteristic indicating that the identification is successful.

在一些实施例中,更新生物特征库的方法还包括:在所述获取输入生物特征与目标基准生物特征比对的相似度之前,根据所述输入生物特征与所述基准生物特征比对的相似度,以及所述输入生物特征与所述基准生物特征的关联属性是否一致的结果信息,确定目标基准生物特征;In some embodiments, the method for updating the biometric database further includes: before acquiring the similarity between the input biometric and the target reference biometric, according to the similarity between the input biometric and the reference biometric degree, and the result information of whether the associated attributes of the input biometric feature and the reference biometric feature are consistent, and determine the target reference biometric feature;

其中,所述输入生物特征与所述基准生物特征比对的相似度的置信水平不小于置信水平阈值,所述关联属性包括性别、年龄段、体质形态类别中的至少之一。Wherein, the confidence level of the similarity between the input biometric feature and the reference biometric feature is not less than a confidence level threshold, and the associated attribute includes at least one of gender, age, and physical shape category.

在一些实施例中,所述对所述输入生物特征与目标基准生物特征进行特征融合,得到融合后特征,包括:In some embodiments, the feature fusion of the input biometric feature and the target reference biometric feature to obtain the fused feature includes:

根据函数feat_out=feat_cap*(1–momentum)+feat_old*momentum,对所述输入生物特征与目标基准生物特征进行特征融合;According to the function feat_out=feat_cap*(1-momentum)+feat_old*momentum, feature fusion is performed on the input biometrics and the target reference biometrics;

其中,所述feat_out为融合后特征,所述feat_cap为所述输入生物特征,所述feat_old为所述目标基准生物特征,所述momentum为动量系数,且0≤momentum<1。The feat_out is the feature after fusion, the feat_cap is the input biometric, the feat_old is the target reference biometric, the momentum is the momentum coefficient, and 0≤momentum<1.

在一些实施例中,0.9≤momentum<1。In some embodiments, 0.9≤momentum<1.

在一些实施例中,所述生物特征库包括人脸特征库、掌形特征库、皮肤特征库、耳廓特征库、步态特征库或声音特征库。In some embodiments, the biometric library includes a face feature library, a palm shape feature library, a skin feature library, a pinna feature library, a gait feature library, or a voice feature library.

根据本申请实施例的另一个方面,提供一种更新生物特征库的装置,所述生物特征库包括至少一个基准生物特征,所述装置包括:According to another aspect of the embodiments of the present application, there is provided an apparatus for updating a biometric database, wherein the biometric database includes at least one reference biometric feature, and the apparatus includes:

获取单元,用于获取输入生物特征与目标基准生物特征比对的相似度,其中,所述输入生物特征为从多媒体数据中提取的生物特征,所述目标基准生物特征为所述至少一个基准生物特征中与所述输入生物特征的身份匹配度最大的基准生物特征;an obtaining unit, configured to obtain the similarity between the input biometric feature and the target reference biometric feature, wherein the input biometric feature is a biometric feature extracted from multimedia data, and the target reference biometric feature is the at least one reference biological feature The reference biometric feature that matches the identity of the input biometric feature with the greatest degree of identity;

融合单元,用于当所述相似度大于第一阈值时,对所述输入生物特征与所述目标基准生物特征进行特征融合,得到融合后特征;a fusion unit, configured to perform feature fusion on the input biological feature and the target reference biological feature when the similarity is greater than a first threshold to obtain a post-fusion feature;

更新单元,用于将所述目标基准生物特征更新为所述融合后特征。An update unit, configured to update the target reference biological feature to the fusion feature.

根据本申请实施例的又一个方面,提供一种电子设备,包括:存储器和耦接至所述存储器的处理器,所述处理器配置为基于存储在所述存储器中的指令,执行前述任一技术方案所述的更新生物特征库的方法。According to yet another aspect of the embodiments of the present application, there is provided an electronic device, comprising: a memory and a processor coupled to the memory, the processor configured to execute any of the foregoing based on instructions stored in the memory The method for updating the biometric database described in the technical solution.

根据本申请实施例的再一个方面,提供一种计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时实现前述任一技术方案所述的更新生物特征库的方法。According to yet another aspect of the embodiments of the present application, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the method for updating a biometric database described in any of the foregoing technical solutions is implemented .

本申请上述实施例可以根据程序设定实现对生物特征库的自动更新。相比相关技术中固定不变的基准生物特征,本申请实施例的基准生物特征可以追随个体生物特征的变化而做出动态调整。更新后的生物特征库应用于生物特征识别中,可以提升识别的准确性,进而提升信息的安全性。The above-mentioned embodiments of the present application can implement automatic updating of the biometric database according to program settings. Compared with the fixed reference biological feature in the related art, the reference biological feature of the embodiment of the present application can make dynamic adjustment following the change of the individual biological feature. The updated biometric database is applied to biometric identification, which can improve the accuracy of identification, thereby improving the security of information.

当然,实施本申请任一实施例的产品或方法并不一定需要同时达到以上所有优点。Of course, implementing the product or method of any embodiment of the present application does not necessarily need to achieve all the above advantages simultaneously.

附图说明Description of drawings

为了更清楚地说明本申请实施例和现有技术的技术方案,下面对实施例和现有技术中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图仅仅是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的实施例。In order to more clearly illustrate the embodiments of the present application and the technical solutions of the prior art, the following briefly introduces the drawings required in the embodiments and the prior art. Obviously, the drawings in the following description are only the For some embodiments of the application, for those of ordinary skill in the art, other embodiments can also be obtained according to these drawings without creative efforts.

图1为相关技术中的一种人脸识别方法的流程图;Fig. 1 is the flow chart of a kind of face recognition method in the related art;

图2为本申请一些实施例的更新生物特征库的方法的流程图;2 is a flowchart of a method for updating a biometric database according to some embodiments of the present application;

图3为本申请一些实施例中人脸识别及更新人脸特征库的流程图;3 is a flowchart of face recognition and update of face feature database in some embodiments of the present application;

图4为本申请一些实施例的更新生物特征库的装置的框图;4 is a block diagram of an apparatus for updating a biometric database according to some embodiments of the present application;

图5为本申请一些实施例的电子设备的框图。FIG. 5 is a block diagram of an electronic device according to some embodiments of the present application.

具体实施方式Detailed ways

为使本申请的目的、技术方案、及优点更加清楚明白,以下参照附图并举实施例,对本申请进一步详细说明。显然,所描述的实施例仅仅是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。In order to make the objectives, technical solutions, and advantages of the present application more clearly understood, the present application will be described in further detail below with reference to the accompanying drawings and examples. Obviously, the described embodiments are only a part of the embodiments of the present application, but not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative work fall within the protection scope of the present application.

人脸识别,是基于人的脸部特征进行身份识别的一种生物特征识别技术,其基本原理为,从包含人脸区域的图片或视频帧中提取人脸特征,将人脸特征与人脸特征库中预先建立的基准人脸特征进行比对,根据相似程度得到人脸身份信息的识别结果。Face recognition is a biometric recognition technology based on human facial features. The pre-established reference face features in the feature library are compared, and the recognition result of the face identity information is obtained according to the similarity.

如图1所示,为相关技术中的一种人脸识别方法,该方法包括以下步骤S01-S05。As shown in FIG. 1, it is a face recognition method in the related art, and the method includes the following steps S01-S05.

在步骤S01,获取图像采集设备采集的包含人脸区域的图片。In step S01, a picture including a face region collected by an image collection device is acquired.

在步骤S02,运用人脸特征提取算法,从包含人脸区域的图片中提取出人脸特征,作为输入人脸特征。In step S02, a face feature extraction algorithm is used to extract a face feature from a picture containing a face region, as an input face feature.

在步骤S03,遍历人脸特征库中的基准人脸特征,将输入人脸特征与每个基准人脸特征进行相似度比对,得到相似度列表。In step S03, the reference face features in the face feature database are traversed, and the similarity between the input face feature and each reference face feature is compared to obtain a similarity list.

在步骤S04,筛选相似度列表,保留置信水平不小于置信水平阈值的相似度比对数据作为筛选结果。In step S04, the similarity list is screened, and the similarity comparison data whose confidence level is not less than the confidence level threshold is retained as the screening result.

其中,上述置信水平可以反映:输入人脸特征与基准人脸特征之间相似度比对结果的置信度。The above confidence level may reflect: the confidence of the result of the similarity comparison between the input face feature and the reference face feature.

在步骤S05,根据筛选结果中相似度最大值所对应的基准人脸特征,输出识别结果。例如,识别结果可以包括该相似度最大值、基于基准人脸特征还原的人脸图像、基准人脸特征所对应个体的身份标识号,等等。In step S05, output the recognition result according to the reference face feature corresponding to the maximum similarity in the screening result. For example, the identification result may include the maximum similarity, the face image restored based on the reference face feature, the identification number of the individual corresponding to the reference face feature, and the like.

本申请的发明人在实现本申请实施例的过程中发现,由于人脸特征库中的基准人脸特征固定不变,当人脸特征随年龄、发型、天气、季节等变化而发生较大变化时,人脸识别结果的准确性就会大大降低,从而带来信息安全隐患。In the process of implementing the embodiments of the present application, the inventors of the present application found that since the reference facial features in the facial feature database are fixed, when the facial features change greatly with changes in age, hairstyle, weather, season, etc. The accuracy of face recognition results will be greatly reduced, which will bring information security risks.

为提升利用生物特征进行个体身份识别的准确性,本申请实施例提供了一种更新生物特征库的方法、装置、电子设备及计算机可读存储介质。In order to improve the accuracy of individual identification using biometrics, the embodiments of the present application provide a method, an apparatus, an electronic device, and a computer-readable storage medium for updating a biometrics database.

本申请实施例提供的技术方案可应用于各种需要进行生物特征识别的场景,例如,安全检查监控场景、公共场所监控场景、门禁监控场景、畜牧监控场景等,可应用的领域包括但不限于安防、金融、边境、海关、保险及民用娱乐等领域。根据生物特征识别的具体应用场景的不同,生物特征库例如可以为人脸特征库、掌形特征库、皮肤特征库、耳廓特征库、步态特征库或声音特征库,等等。生物特征库中可以只包括一个基准生物特征,也可以包括多个基准生物特征,生物特征库中基准生物特征的数量可以根据用户需求增加或删减。The technical solutions provided in the embodiments of this application can be applied to various scenarios that require biometric identification, such as security inspection monitoring scenarios, public place monitoring scenarios, access control monitoring scenarios, animal husbandry monitoring scenarios, etc. The applicable fields include but are not limited to Security, finance, border, customs, insurance and civil entertainment and other fields. Depending on the specific application scenarios of biometric identification, the biometric database may be, for example, a face feature library, a palm shape feature library, a skin feature library, a pinna feature library, a gait feature library, or a voice feature library, and so on. The biometric database may include only one reference biological feature, or may include multiple reference biological features, and the number of reference biological features in the biometric database may be increased or deleted according to user requirements.

上述生物特征库可以理解为:用于存储基准生物特征的数据库。上述基准生物特征可以理解为:预先获得的、用于进行特征比对的生物特征。The above-mentioned biometric database can be understood as a database for storing reference biometric characteristics. The above-mentioned reference biometrics can be understood as: pre-obtained biometrics used for feature comparison.

如图2所示,本申请一些实施例提供了一种更新生物特征库的方法,其中,生物特征库包括至少一个基准生物特征,该更新生物特征库的方法包括以下步骤S1至步骤S3。As shown in FIG. 2 , some embodiments of the present application provide a method for updating a biometric library, wherein the biometric library includes at least one reference biometric, and the method for updating the biometric library includes the following steps S1 to S3.

在步骤S1,获取输入生物特征与目标基准生物特征比对的相似度,其中,输入生物特征为从多媒体数据中提取的生物特征,目标基准生物特征为前述至少一个基准生物特征中与输入生物特征的身份匹配度最大的基准生物特征。In step S1, the similarity between the input biometric feature and the target reference biometric feature is obtained, wherein the input biometric feature is a biometric feature extracted from multimedia data, and the target reference biometric feature is the at least one reference biometric feature and the input biometric feature. The benchmark biometrics with the greatest identity match.

其中,上述输入生物特征可以理解为:需要进行身份匹配的个体的生物特征,可以是从包含上述个体的多媒体数据中提取的生物特征。The above-mentioned input biometrics can be understood as: the biometrics of the individual whose identity needs to be matched may be the biometrics extracted from the multimedia data including the above-mentioned individual.

上述身份匹配度可以理解为:用于衡量基准生物特征反映的个体、与输入生物特征反映的个体之间身份是否一致的参数。The above identity matching degree can be understood as a parameter used to measure whether the identity of the individual reflected by the reference biometrics is consistent with the identity of the individual reflected by the input biometrics.

上述目标基准生物特征可以理解为:从基准生物特征中确定的、所反映的个体与上述输入生物特征所反映的个体的身份相匹配的特征。也就是,目标基准生物特征所反映的个体,与上述输入生物特征所反映的个体之间的身份相匹配。The above-mentioned target reference biometrics can be understood as: the characteristics determined from the reference biometrics, and the reflected individual matches the identity of the individual reflected by the above input biometrics. That is, the identity of the individual reflected by the target reference biometrics matches the identity of the individual reflected by the above input biometrics.

具体的,可以从生物特征库所存储的基准生物特征中,确定所反映的个体与上述输入生物特征所反映的个体的身份相匹配的特征,作为目标基准生物特征,然后获得该目标基准生物特征与上述输入生物特征之间的相似度。Specifically, from the reference biometric features stored in the biometric database, it is possible to determine the features of the reflected individual that match the identity of the individual reflected by the above input biometric features, as the target reference biological feature, and then obtain the target reference biological feature Similarity to the above input biometrics.

本申请的一些实施例中,在计算输入生物特征与基准生物特征之间的相似度时,可以计算输入生物特征与基准生物特征之间的欧氏距离、余弦相似度、曼哈顿距离等,作为上述特征之间的相似度。In some embodiments of the present application, when calculating the similarity between the input biometrics and the reference biometrics, the Euclidean distance, cosine similarity, Manhattan distance, etc. between the input biometrics and the reference biometrics may be calculated, as the above similarity between features.

除此之外,也可以将上述输入生物特征与基准生物特征输入预先训练完成的相似度计算模型,得到上述模型输出的、输入生物特征与基准生物特征之间的相似度。In addition, the input biometrics and the reference biometrics can also be input into a pre-trained similarity calculation model to obtain the similarity between the input biometrics and the reference biometrics output by the model.

在本申请的一些实施例中,输入生物特征是对单张包含生物特征的图片进行生物特征提取后得到的。例如,输入生物特征是从相机拍摄的包含生物特征的单张照片中提取得到,或者,是从摄像机拍摄的视频流中的其中一帧包含生物特征的画面中提取得到。In some embodiments of the present application, the input biometric feature is obtained after biometric feature extraction is performed on a single picture containing the biometric feature. For example, the input biometric feature is extracted from a single photo taken by the camera that contains the biometric feature, or from a frame in the video stream captured by the camera that contains the biometric feature.

在本申请的另一些实施例中,输入生物特征是对多张包含生物特征的图片进行生物特征提取后再进行生物特征融合得到的。In other embodiments of the present application, the input biometric feature is obtained by performing biometric feature extraction on a plurality of pictures containing biometric features and then performing biometric feature fusion.

具体的,可以获得多张包含生物特征的图片,对各个图片分别进行生物特征提取,得到多个生物特征,然后对上述多个生物特征进行特征融合,将融合结果作为输入生物特征。Specifically, a plurality of pictures containing biological features can be obtained, and biological features are extracted from each picture to obtain a plurality of biological features, and then feature fusion is performed on the above-mentioned plurality of biological features, and the fusion result is used as the input biological features.

例如,对摄像机拍摄的多帧包含生物特征的画面分别进行生物特征提取,然后再将这些生物特征融合,得到输入生物特征。这样,当某张或某些图片画面模糊、分辨率低或拍摄角度不合理时,通过生物特征融合计算,可以使 其对识别结果准确性的影响较小甚至可以忽略,从而提升生物特征识别的准确性。For example, biometric feature extraction is performed on multiple frames captured by a camera that contain biometric features, and then these biometric features are fused to obtain input biometric features. In this way, when a certain picture or some pictures are blurry, the resolution is low or the shooting angle is unreasonable, the biometric fusion calculation can make the impact on the accuracy of the recognition result small or even negligible, thereby improving the accuracy of biometric recognition. accuracy.

在本申请实施例中,生物特征库的基准生物特征,是基于深度学习算法得到的离线基准模板。深度学习是机器学习的一种,而机器学习是实现人工智能的必经路径。深度学习的概念源于人工神经网络的研究,其中包含多个隐藏层的多层感知器就是一种深度学习结构。深度学习通过组合低层特征形成更加抽象的、表示属性类别的高层特征,以实现数据的分布式特征表示。研究深度学习的动机在于建立模拟人脑进行分析学习的神经网络,它模仿人脑的机制来解析数据,例如图像、声音和文本等数据。典型的深度学习模型包括卷积神经网络模型、深度神经网络模型和堆栈自编码网络模型等。In the embodiment of the present application, the reference biological feature of the biological feature database is an offline reference template obtained based on a deep learning algorithm. Deep learning is a type of machine learning, and machine learning is the only way to realize artificial intelligence. The concept of deep learning originated from the study of artificial neural networks, and a multilayer perceptron containing multiple hidden layers is a deep learning structure. Deep learning realizes distributed feature representation of data by combining low-level features to form more abstract high-level features that represent attribute categories. The motivation for studying deep learning is to build a neural network that simulates the human brain for analysis and learning, which imitates the mechanism of the human brain to parse data, such as images, sounds, and texts. Typical deep learning models include convolutional neural network models, deep neural network models, and stacked self-encoding network models.

在本申请实施例中,目标基准生物特征是指:将生物特征库的各个基准生物特征与输入生物特征进行比对,其中与输入生物特征的身份匹配度最大的基准生物特征。其中,身份匹配度的考量因素包括生物特征比对的相似度。In this embodiment of the present application, the target reference biometrics refers to: comparing each reference biometric feature in the biometric database with the input biometric features, wherein the reference biometric feature with the largest identity matching with the input biometric feature. Among them, the consideration factor of the identity matching degree includes the similarity of the biometric comparison.

例如,可以通过以下方式确定目标基准生物特征:For example, target baseline biometrics can be determined by:

计算输入生物特征与生物特征库中每一基准生物特征的相似度,将上述相似度作为身份匹配度,从相似度超过预设阈值的基准生物特征中,选择相似度最高的基准生物特征,作为所反映的个体与上述输入生物特征所反映的个体的身份相匹配的目标基准生物特征。Calculate the similarity between the input biometrics and each benchmark biometric in the biometric database, use the above similarity as the identity matching degree, and select the benchmark biometric with the highest similarity from the benchmark biometrics whose similarity exceeds the preset threshold as the identity matching degree. The target reference biometric whose reflected individual matches the identity of the individual as reflected by the above input biometrics.

此外,上述身份匹配度的考量因素还可以包括与用户身份相关联的其它属性的一致性,例如,性别、年龄段、体质形态类别等的一致性。生物特征库中,基准生物特征的与用户身份相关联的属性(以下简称关联属性)可以通过运用一定的算法预先计算出并存储在存储器中。在生物特征识别时,输入生物特征的关联属性,可以通过运用一定的算法计算得出。也就是,目标基准生物特征可以理解为:生物特征库中,与输入生物特征的身份匹配度最大、且关联属性一致的基准生物特征。In addition, the above-mentioned consideration factors of the identity matching degree may also include the consistency of other attributes associated with the user identity, for example, the consistency of gender, age group, physical form category, and the like. In the biometric database, the attributes associated with the user identity (hereinafter referred to as the associated attributes) of the reference biometrics can be pre-calculated by applying a certain algorithm and stored in the memory. In biometric identification, the associated attributes of the input biometrics can be calculated by using a certain algorithm. That is, the target reference biometrics can be understood as: in the biometric database, the reference biometrics with the highest degree of identity matching with the input biometrics and consistent associated attributes.

在本申请的一些实施例中,更新生物特征库的方法还包括:在获取输入生物特征与目标基准生物特征比对的相似度之前,根据输入生物特征与基准生物特征比对的相似度,以及输入生物特征与基准生物特征的关联属性是否一致的结果信息,确定目标基准生物特征;其中,输入生物特征与基准生物 特征比对的相似度的置信水平不小于置信水平阈值,关联属性包括性别、年龄段、体质形态类别中的至少之一。In some embodiments of the present application, the method for updating the biometric database further includes: before acquiring the similarity between the input biometric and the target reference biometric, according to the similarity between the input biometric and the reference biometric, and The result information of whether the associated attributes of the input biometrics and the reference biometrics are consistent, and determine the target reference biometrics; wherein, the confidence level of the similarity between the input biometrics and the reference biometrics is not less than the confidence level threshold, and the associated attributes include gender, At least one of age group and physical form category.

其中,上述置信水平可以反映:所获取的输入生物特征与基准生物特征之间的相似度的置信度。Wherein, the above confidence level may reflect: the confidence of the similarity between the acquired input biometrics and the reference biometrics.

具体的,可以获得输入生物特征与生物特征库中各个基准生物特征比对的相似度,从中确定相似度的置信水平大于等于预设的置信水平阈值、相似度最大、且关联属性与输入生物特征一致的基准生物特征,作为身份匹配度最大的目标基准生物特征。Specifically, the similarity between the input biometrics and each reference biometric in the biometric database can be obtained, and the confidence level of the similarity is determined to be greater than or equal to a preset confidence level threshold, the similarity is the largest, and the associated attribute is the same as the input biometrics. Consistent benchmark biometrics as the target benchmark biometrics with the greatest identity match.

本申请的一些实施例中,可以获得输入生物特征与生物特征库中各个基准生物特征比对的相似度,从中筛选相似度的置信水平大于等于预设的置信水平阈值的基准生物特征,并从筛选后的基准生物特征中选择关联属性与输入生物特征一致的基准生物特征,从所选择的基准生物特征中确定与输入生物特征之间相似度最大的特征,作为身份匹配度最大的目标基准生物特征。In some embodiments of the present application, the similarity between the input biometrics and each reference biometric in the biometric database can be obtained, and the reference biometrics whose confidence level of the similarity is greater than or equal to a preset confidence level threshold are selected from the comparison, and from From the selected benchmark biometrics, select the benchmark biometrics whose associated attributes are consistent with the input biometrics, and determine the feature with the greatest similarity with the input biometrics from the selected benchmark biometrics, as the target benchmark biometric with the greatest identity matching. feature.

除此之外,也可以从生物特征库中查找关联属性与输入生物特征一致的基准生物特征,作为候选基准生物特征,获得各个候选基准生物特征与输入生物特征比对的相似度,从中筛选相似度的置信水平大于等于预设的置信水平阈值的基准生物特征,并从筛选后的基准生物特征中确定与输入生物特征之间相似度最大的特征,作为身份匹配度最大的目标基准生物特征。In addition, it is also possible to search for the reference biometrics whose associated attributes are consistent with the input biometrics from the biometrics database, and use them as candidate reference biometrics to obtain the similarity between each candidate reference biometric and the input biometrics, and then filter similarities. The confidence level of the degree is greater than or equal to the preset confidence level threshold, and the feature with the greatest similarity with the input biometrics is determined from the filtered benchmark biometrics as the target reference biometric with the greatest identity matching degree.

在本申请的一些实施例中,上述步骤S1是在基于输入生物特征完成身份识别之后执行。在本申请的另一些实施例中,上述步骤S1也可以在基于输入生物特征进行身份识别的过程中,或者基于输入生物特征进行身份识别之前执行。In some embodiments of the present application, the above step S1 is performed after completing the identification based on the input biometrics. In other embodiments of the present application, the above-mentioned step S1 may also be performed in the process of performing identification based on the input biometrics, or before performing the identification based on the inputted biometrics.

在针对输入生物特征的身份识别完成之后,一般会输出识别结果。该识别结果可以包括对输入生物特征的身份验证判定结果,除此之外,还可以包括该输入生物特征与目标基准生物特征比对的相似度、目标基准生物特征所对应个体的身份标识、基于目标基准生物特征还原出的个体图像,以及其它关联属性,例如性别、年龄段、体质形态类别等。After the identification of the input biometrics is completed, the identification result is generally output. The identification result may include the identity verification result of the input biometrics, and in addition, may also include the similarity of the input biometrics compared with the target reference biometrics, the identity of the individual corresponding to the target reference biometrics, based on The image of the individual restored by the target reference biometrics, and other associated attributes, such as gender, age, physical shape category, etc.

在本申请的一些实施例中,在每次基于输入生物特征的身份识别完成之后,即获取上述输入生物特征与目标基准生物特征比对的相似度。即,每执 行一次生物特征识别程序,在识别完成之后,启动一次生物特征库更新的程序。In some embodiments of the present application, after each identification based on the input biometrics is completed, the similarity between the input biometrics and the target reference biometrics is obtained. That is, every time the biometric identification program is executed, after the identification is completed, a program for updating the biometric database is started.

在本申请的另一些实施例中,也可以每经历一设定时间段,获取在该设定时间段内基于输入生物特征进行身份识别而输出的识别结果,该识别结果包括上述输入生物特征与目标基准生物特征比对的相似度。即,生物特征库更新的程序按照预定的频率启动。设定时间段可以结合系统处理性能和生物特征库的更新需求来确定。In other embodiments of the present application, each time a set period of time passes, the identification result outputted by the identification based on the input biometric feature within the set period of time may be obtained, and the identification result includes the input biometric feature and the input biometric feature. Similarity of target baseline biometric alignments. That is, the procedure for updating the biometric database is started at a predetermined frequency. The set time period can be determined in conjunction with system processing performance and update requirements of the biometric database.

回到图2,在步骤S2,当上述输入生物特征与目标基准生物特征比对的相似度大于第一阈值时,对输入生物特征与目标基准生物特征进行特征融合,得到融合后特征。Returning to FIG. 2, in step S2, when the similarity between the input biometrics and the target reference biometrics is greater than the first threshold, feature fusion is performed on the input biometrics and the target reference biometrics to obtain fused features.

在本申请的一些实施例中,第一阈值预先设定,并且大于第二阈值,第二阈值为基于输入生物特征进行身份识别时,表征身份识别成功的输入生物特征与基准生物特征的最小相似度。本申请一些实施例的应用场景设定:当输入生物特征与目标基准生物特征比对的相似度不小于第二阈值时,允许该输入生物特征身份验证通过,否则,不允许该输入生物特征身份验证通过。In some embodiments of the present application, the first threshold is preset and greater than the second threshold, and the second threshold is the minimum similarity between the input biometrics and the reference biometrics indicating successful identification when performing identification based on the input biometrics Spend. Application scenario settings of some embodiments of the present application: when the similarity between the input biometrics and the target reference biometrics is not less than the second threshold, the input biometric identity verification is allowed to pass; otherwise, the input biometric identity is not allowed Verification passed.

例如,在一个实施例中,第二阈值为95%,第一阈值为97%。当输入生物特征与目标基准生物特征比对的相似度不小于95%时,允许该输入生物特征身份验证通过,否则,不允许该输入生物特征身份验证通过。当基于输入生物特征与目标基准生物特征比对的相似度大于97%时,对生物特征库进行更新,否则,对生物特征库不更新。即,相比对输入生物特征身份的判断,对生物特征库的更新提出了更高的相似度要求,这样,可以提高生物特征库更新的准确性。For example, in one embodiment, the second threshold is 95% and the first threshold is 97%. When the similarity between the input biometric and the target reference biometric is not less than 95%, the input biometric authentication is allowed to pass, otherwise, the input biometric authentication is not allowed to pass. When the similarity based on the comparison between the input biometrics and the target reference biometrics is greater than 97%, the biometric database is updated; otherwise, the biometric database is not updated. That is, compared with the judgment of the input biometric identity, a higher similarity requirement is put forward for the update of the biometric database, so that the accuracy of the update of the biometric database can be improved.

在深度学习中,输入生物特征和基准生物特征均为向量,特征融合指的是将两个或者多个生物特征向量变换成一个生物特征向量的方法。In deep learning, both input biometrics and reference biometrics are vectors, and feature fusion refers to a method of transforming two or more biometric vectors into one biometric vector.

在本申请的一些实施例中,对输入生物特征与目标基准生物特征进行特征融合,得到融合后特征,包括:In some embodiments of the present application, feature fusion is performed on the input biometrics and the target reference biometrics to obtain the fused features, including:

根据函数feat_out=feat_cap*(1–momentum)+feat_old*momentum,对输入生物特征与目标基准生物特征进行特征融合;其中,feat_out为融合后特征,feat_cap为输入生物特征,feat_old为目标基准生物特征,momentum 为动量系数,且0≤momentum<1。According to the function feat_out=feat_cap*(1–momentum)+feat_old*momentum, the feature fusion is performed on the input biometrics and the target benchmark biometrics; among them, feat_out is the fused feature, feat_cap is the input biometric, feat_old is the target benchmark biometric, momentum is the momentum coefficient, and 0≤momentum<1.

在一些实施例中,动量系数大于或等于0.9,且小于1。例如,在一个实施例中,momentum取值为0.95。这样,对目标基准生物特征的更新比较平缓和细微,使得生物特征识别的准确性更高。In some embodiments, the momentum coefficient is greater than or equal to 0.9 and less than 1. For example, in one embodiment, the momentum value is 0.95. In this way, the update of the target reference biometrics is gentle and subtle, resulting in higher accuracy of biometric identification.

在本申请的另一些实施例中,对输入生物特征与目标基准生物特征进行特征融合,得到融合后特征,包括:将输入生物特征与目标基准生物特征的向量分量进行拼接,得到融合后特征。In other embodiments of the present application, the feature fusion of the input biometrics and the target reference biometrics to obtain the fused features includes: splicing the vector components of the input biometrics and the target reference biological features to obtain the fused features.

回到图2,在步骤S3,将目标基准生物特征更新为融合后特征。Returning to Fig. 2, in step S3, the target reference biometric feature is updated to the fused feature.

生物特征库中,每个基准生物特征对应一个身份标识(Identity document,ID)。在一些实施例中,上述步骤S3,包括:In the biometric database, each reference biometric corresponds to an identity document (ID). In some embodiments, the above step S3 includes:

根据目标基准生物特征的身份标识,从生物特征库中查找目标基准生物特征;Find the target reference biometrics from the biometric database according to the identification of the target reference biometrics;

将目标基准生物特征替换为融合后特征。Replace the target baseline biometrics with the fused features.

如图3所示,本申请一些实施例更新生物特征库的方法用于人脸识别场景,人脸识别及更新人脸特征库的方法流程包括以下步骤S21至步骤S33。As shown in FIG. 3 , the methods for updating a biometric database according to some embodiments of the present application are used in a face recognition scenario, and the method process for face recognition and updating the facial feature database includes the following steps S21 to S33 .

在步骤S21,获取图像采集设备拍摄的多张包含人脸区域的图片。In step S21, a plurality of pictures including a face region captured by the image acquisition device are acquired.

例如,用户王某在进入公司办公区域之前,需要通过具有人脸识别功能的考勤打卡机完成打卡。考勤打卡机的摄像头拍摄到包含王某脸部区域的一系列视频帧P1,P2,P3……,P12。For example, before entering the office area of the company, user Wang needs to complete the punch-in through an attendance punch-in machine with face recognition function. The camera of the attendance punching machine captured a series of video frames P1, P2, P3..., P12 including the face area of Wang.

在步骤S22,按照设定的评分规则,对上述步骤S21中获取的多张包含人脸区域的图片进行质量评分,滤除质量分值低于设定阈值的图片。In step S22, according to the set scoring rules, quality scores are performed on the plurality of pictures including the face region obtained in the above step S21, and pictures whose quality scores are lower than the set threshold are filtered out.

例如,视频帧P11由于人脸区域较模糊、视频帧P12由于人脸区域不完整导致质量评分不通过,则在该步骤S22滤除掉该视频帧P11和P12。For example, the video frame P11 does not pass the quality score because the face area is blurred, and the video frame P12 fails the quality score because the face area is incomplete, then the video frames P11 and P12 are filtered out in this step S22.

在步骤S23,针对每张包含人脸区域的图片,运用人脸特征提取算法,从图片中提取出人脸特征。例如从视频帧P1,P2,P3……,P10中分别提取出人脸特征F1,F2,F 3……,F 10。In step S23, for each picture including a face region, a face feature extraction algorithm is used to extract the face feature from the picture. For example, face features F1, F2, F3..., F10 are extracted from video frames P1, P2, P3..., P10, respectively.

在步骤S23中,所采用的人脸特征提取算法不限。In step S23, the facial feature extraction algorithm used is not limited.

例如,在一些实施例中,人脸特征提取算法采用主观形状模型(Active Shape Model,ASM)算法。ASM是一种基于点分布模型(Point Distribution  Model,PDM)的算法。在PDM算法中,外形相似的物体,例如人脸、人手、心脏、肺部等的几何形状,可以通过将若干关键特征点的坐标依次串联形成的形状向量来表示。运用ASM算法从图片中提取人脸特征的过程包括:利用分类器检测人脸区域;利用训练好的模型,寻找人脸固定数量的特征点(例如68个特征点);记录各个特征点的坐标位置,并依次串联形成形状向量。For example, in some embodiments, the facial feature extraction algorithm adopts an Active Shape Model (ASM) algorithm. ASM is an algorithm based on Point Distribution Model (PDM). In the PDM algorithm, the geometric shapes of objects with similar shapes, such as faces, hands, hearts, lungs, etc., can be represented by a shape vector formed by concatenating the coordinates of several key feature points in sequence. The process of using the ASM algorithm to extract face features from pictures includes: using the classifier to detect the face area; using the trained model to find a fixed number of feature points (for example, 68 feature points) on the face; recording the coordinates of each feature point position, and in turn concatenate to form a shape vector.

例如,在另一些实施例中,人脸特征提取算法采用主动外观模型(Active Appearance Model,AAM)算法。AAM算法是在ASM算法的基础上,进一步对纹理进行统计建模,并将形状和纹理两个统计模型进一步融合为外观模型。AAM算法在对形状和纹理特征统一量纲后,建模和搜索过程和ASM基本相同。For example, in other embodiments, the facial feature extraction algorithm adopts an Active Appearance Model (Active Appearance Model, AAM) algorithm. On the basis of ASM algorithm, AAM algorithm further performs statistical modeling on texture, and further fuses the two statistical models of shape and texture into an appearance model. After the AAM algorithm unifies the dimensions of the shape and texture features, the modeling and search process is basically the same as that of the ASM.

在步骤S24,将步骤S23中提取出的人脸特征F1,F2,F 3……,F 10进行特征融合,得到输入人脸特征F。In step S24, the face features F1, F2, F3..., F10 extracted in step S23 are subjected to feature fusion to obtain the input face feature F.

例如,前述一系列视频帧P1,P2,P3……,P10中,视频帧P2的画面略为模糊。如果单从该视频帧P2中提取人脸特征F2作为人脸识别的输入人脸特征,那么在一定程度上可能会影响到识别结果的准确性。在该实施例中,对这一系列视频帧的人脸特征进行了特征融合处理,视频帧P2的画质对输入人脸特征的影响可以忽略,因此,可以提高人脸识别的准确性。For example, in the aforementioned series of video frames P1, P2, P3..., P10, the picture of the video frame P2 is slightly blurred. If the face feature F2 is simply extracted from the video frame P2 as the input face feature for face recognition, the accuracy of the recognition result may be affected to a certain extent. In this embodiment, feature fusion processing is performed on the facial features of the series of video frames, and the influence of the image quality of the video frame P2 on the input facial features can be ignored, so the accuracy of face recognition can be improved.

在步骤S25,遍历人脸特征库中的基准人脸特征M1,M2,M3……,将输入人脸特征F与每个基准人脸特征进行相似度比对,得到相似度列表如以下表一所示。In step S25, traverse the reference face features M1, M2, M3... in the face feature database, compare the similarity between the input face feature F and each reference face feature, and obtain a similarity list as shown in Table 1 below shown.

表一相似度列表Table 1 Similarity List

Figure PCTCN2021125065-appb-000001
Figure PCTCN2021125065-appb-000001

在步骤S26,筛选相似度列表,保留置信水平不小于置信水平阈值的相似度比对数据作为第一筛选结果,如以下表二所示。In step S26, the similarity list is screened, and the similarity comparison data whose confidence level is not less than the confidence level threshold is retained as the first screening result, as shown in Table 2 below.

表二第一筛选结果列表Table 2 List of first screening results

基准人脸特征Benchmark facial features M1M1 M6M6 M8M8 比对相似度Compare similarity 98%98% 99%99% 93%93%

在抽样对总体参数作出估计时,由于样本的随机性,其结论存在不确定性。置信水平是指总体参数值落在样本统计值某一区间内的概率。相似度列表中,如果相似度比对数据的置信水平小于置信水平阈值,则认为人脸识别结果不可信,将该比对数据剔除;若相似度比对数据的置信水平不小于置信水平阈值,则认为人脸识别结果可信,保留该比对数据。When sampling to estimate population parameters, the conclusion is uncertain due to the randomness of the sample. The confidence level is the probability that the population parameter value falls within a certain interval of the sample statistic value. In the similarity list, if the confidence level of the similarity comparison data is less than the confidence level threshold, the face recognition result is considered unreliable, and the comparison data is eliminated; if the confidence level of the similarity comparison data is not less than the confidence level threshold, The face recognition result is considered credible, and the comparison data is retained.

在步骤S27,对第一筛选结果进行再次筛选,保留关联属性与输入人脸特征F相一致的基准人脸特征的比对数据作为第二筛选结果,如以下表三所示。在一些实施例中,关联属性包括性别、年龄段、体质形态类别中的至少一项。In step S27, the first screening result is screened again, and the comparison data of the reference face feature whose associated attribute is consistent with the input face feature F is retained as the second screening result, as shown in Table 3 below. In some embodiments, the associated attribute includes at least one of gender, age group, and physical form categories.

表三第二筛选结果列表Table 3 The second filter result list

基准人脸特征Benchmark facial features M1M1 M8M8 比对相似度Compare similarity 98%98% 93%93%

例如,上述表二中的基准人脸特征M6所对应的性别,由于与基于输入人脸特征所得出的性别不一致,因此,有关基准人脸特征M6的比对数据在该步骤S27中被筛除。For example, the gender corresponding to the reference face feature M6 in the above Table 2 is inconsistent with the gender obtained based on the input face feature, therefore, the comparison data related to the reference face feature M6 is screened out in this step S27 .

在步骤S28,将第二筛选结果中相似度最大值所对应的基准人脸特征作为目标基准人脸特征M1,基于该目标基准人脸特征M1输出识别结果。识别结果包括上述相似度最大值(98%)、基于目标基准人脸特征M1还原的人脸图像,以及王某的身份标识,例如王某的工号00345。In step S28, the reference face feature corresponding to the maximum similarity in the second screening result is used as the target reference face feature M1, and a recognition result is output based on the target reference face feature M1. The recognition result includes the above-mentioned maximum similarity (98%), the face image restored based on the target benchmark face feature M1, and Wang's identity, such as Wang's job number 00345.

由于在前述步骤S27中已筛除置信水平小于置信水平阈值的基准人脸特征,在前述步骤S28中已筛除关联属性与输入人脸特征F不一致的基准人脸特征,因此,该步骤S28的计算量大大减小,输出结果也更加准确。Since the reference face features whose confidence level is less than the confidence level threshold have been screened out in the aforementioned step S27, and the reference face features whose associated attributes are inconsistent with the input face feature F have been screened out in the aforementioned step S28, therefore, the step S28 The amount of calculation is greatly reduced, and the output results are more accurate.

在步骤S29,获取上述输入生物特征与目标基准生物特征比对的相似度。In step S29, the similarity between the input biometrics and the target reference biometrics is obtained.

在步骤S30,判断输入生物特征与目标基准生物特征比对的相似度(98%)是否大于第一阈值(例如第一阈值为95%),如果是,流程走向步骤S31,否则,结束流程。In step S30, it is judged whether the similarity (98%) between the input biometric feature and the target reference biometric feature is greater than the first threshold (eg, the first threshold is 95%), if so, the process goes to step S31, otherwise, the process ends.

在步骤S31,从人脸特征库中根据目标基准人脸特征M1对应的身份标识, 例如王某的工号00345,查找到目标基准人脸特征M1。In step S31, the target reference face feature M1 is found from the face feature database according to the identity identifier corresponding to the target reference face feature M1, such as Wang's job number 00345.

在步骤S32,对输入人脸特征F与目标基准人脸特征M1进行特征融合,得到融合后特征M1’。In step S32, feature fusion is performed on the input face feature F and the target reference face feature M1 to obtain a fused feature M1'.

在步骤S33,将人脸特征库中的目标基准人脸特征M1更新为融合后特征M1’,即将人脸特征库中的目标基准人脸特征M1替换为融合后特征M1’。In step S33, the target reference face feature M1 in the face feature library is updated to the fused feature M1', that is, the target reference face feature M1 in the face feature library is replaced with the fused feature M1'.

如图4所示,本申请一些实施例还提供了一种更新生物特征库的装置400,生物特征库包括至少一个基准生物特征,该更新生物特征库的装置400包括:As shown in FIG. 4 , some embodiments of the present application further provide a device 400 for updating a biometric database, where the biometric database includes at least one reference biometric, and the device 400 for updating a biometric database includes:

获取单元41,用于获取输入生物特征与目标基准生物特征比对的相似度,其中,输入生物特征为从多媒体数据中提取的生物特征,目标基准生物特征为至少一个基准生物特征中与输入生物特征的身份匹配度最大的基准生物特征;The obtaining unit 41 is used to obtain the similarity between the input biological feature and the target reference biological feature, wherein the input biological feature is the biological feature extracted from the multimedia data, and the target reference biological feature is at least one reference biological feature and the input biological feature. Benchmark biometrics with the highest matching degree of identity of the features;

融合单元42,用于当相似度大于第一阈值时,对输入生物特征与目标基准生物特征进行特征融合,得到融合后特征;The fusion unit 42 is configured to perform feature fusion on the input biological feature and the target reference biological feature when the similarity is greater than the first threshold to obtain the fused feature;

更新单元43,用于将目标基准生物特征更新为融合后特征。The updating unit 43 is configured to update the target reference biological feature to the fused feature.

本申请上述实施例可以根据程序设定实现对生物特征库的自动更新。相比相关技术中固定不变的基准生物特征,本申请实施例的基准生物特征可以追随个体生物特征的变化而做出动态调整。更新后的生物特征库应用于生物特征识别中,可以提升识别的准确性,进而提升信息的安全性。The above-mentioned embodiments of the present application can implement automatic updating of the biometric database according to program settings. Compared with the fixed reference biological feature in the related art, the reference biological feature of the embodiment of the present application can make dynamic adjustment following the change of the individual biological feature. The updated biometric database is applied to biometric identification, which can improve the accuracy of identification, thereby improving the security of information.

如图5所示,本申请一些实施例还提供了一种电子设备500,包括:存储器51和耦接至存储器51的处理器52,处理器52被配置为基于存储在存储器51中的指令,执行如前述任一实施例的更新生物特征库的方法。As shown in FIG. 5 , some embodiments of the present application further provide an electronic device 500 , comprising: a memory 51 and a processor 52 coupled to the memory 51 , the processor 52 is configured to be based on instructions stored in the memory 51 , The method for updating a biometric database as in any of the preceding embodiments is performed.

存储器51可以包括随机存取存储器(Random Access Memory,RAM),也可以包括非易失性存储器(Non-Volatile Memory,NVM),例如至少一个磁盘存储器。存储器51还可以是至少一个位于远离前述处理器52的存储装置。The memory 51 may include random access memory (Random Access Memory, RAM), or may include non-volatile memory (Non-Volatile Memory, NVM), such as at least one disk storage. The memory 51 may also be at least one storage device located remotely from the aforementioned processor 52 .

上述的处理器52可以是通用处理器,包括中央处理器(Central Processing Unit,CPU)、网络处理器(Network Processor,NP)等;还可以是数字信号处理器(Digital Signal Processor,DSP)、专用集成电路(Application Specific Integrated Circuit,ASIC)、现场可编程门阵列(Field-Programmable Gate Array,FPGA)或者其他可编程逻辑器件、分立门或者晶体管逻辑器件、分立硬件组 件。The above-mentioned processor 52 can be a general-purpose processor, including a central processing unit (Central Processing Unit, CPU), a network processor (Network Processor, NP), etc.; it can also be a digital signal processor (Digital Signal Processor, DSP), dedicated Integrated circuit (Application Specific Integrated Circuit, ASIC), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components.

本申请一些实施例还提供了一种计算机可读存储介质,其上存储有计算机程序,该计算机程序被处理器执行时实现如前述任一技术方案的更新生物特征库的方法。Some embodiments of the present application further provide a computer-readable storage medium on which a computer program is stored, and when the computer program is executed by a processor, implements the method for updating a biometric database according to any of the foregoing technical solutions.

此外,在本申请的又一些实施例中,还提供了一种包含指令的计算机程序产品,当其在计算机上运行时,使得计算机执行上述实施例中任一的更新生物特征库的方法。In addition, in still other embodiments of the present application, a computer program product including instructions is also provided, when it runs on a computer, the computer causes the computer to execute the method for updating a biometric database in any of the foregoing embodiments.

在上述实施例中,可以全部或部分地通过软件、硬件、固件或者其任意组合来实现。当使用软件实现时,可以全部或部分地以计算机程序产品的形式实现。计算机程序产品包括一个或多个计算机指令。在计算机上加载和执行计算机程序指令时,全部或部分地产生按照本申请实施例的流程或功能。计算机可以是通用计算机、专用计算机、计算机网络、或者其他可编程装置。计算机指令可以存储在计算机可读存储介质中,或者从一个计算机可读存储介质向另一个计算机可读存储介质传输,例如,计算机指令可以从一个网站站点、计算机、服务器或数据中心通过有线(例如同轴电缆、光纤、数字用户线(DSL))或无线(例如红外、无线、微波等)方式向另一个网站站点、计算机、服务器或数据中心进行传输。计算机可读存储介质可以是计算机能够存取的任何可用介质或者是包含一个或多个可用介质集成的服务器、数据中心等数据存储设备。可用介质可以是磁性介质,(例如,软盘、硬盘、磁带)、光介质(例如,DVD)、或者半导体介质(例如固态硬盘Solid State Disk(SSD))等。In the above-mentioned embodiments, it may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented in software, it can be implemented in whole or in part in the form of a computer program product. A computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the procedures or functions according to the embodiments of the present application are generated in whole or in part. The computer may be a general purpose computer, a special purpose computer, a computer network, or other programmable device. Computer instructions may be stored in or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instructions may be transmitted from a website site, computer, server, or data center over a wire (e.g. coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (eg, infrared, wireless, microwave, etc.) to another website site, computer, server, or data center. A computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, a data center, or the like that includes an integration of one or more available media. Useful media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, DVD), or semiconductor media (eg, Solid State Disk (SSD)), among others.

需要说明的是,在本文中,诸如第一和第二等之类的关系术语仅仅用来将一个实体或者操作与另一个实体或操作区分开来,而不一定要求或者暗示这些实体或操作之间存在任何这种实际的关系或者顺序。而且,术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含,从而使得包括一系列要素的过程、方法、物品或者设备不仅包括那些要素,而且还包括没有明确列出的其他要素,或者是还包括为这种过程、方法、物品或者设备所固有的要素。在没有更多限制的情况下,由语句“包括一个……”限定的要素,并不排除在包括该要素的过程、方法、物品或者设备中还存在另外的相同要素。It should be noted that, in this document, relational terms such as first and second are only used to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply any relationship between these entities or operations. any such actual relationship or sequence exists. Moreover, the terms "comprising", "comprising" or any other variation thereof are intended to encompass a non-exclusive inclusion such that a process, method, article or device that includes a list of elements includes not only those elements, but also includes not explicitly listed or other elements inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in the process, method, article, or device that includes the element.

本说明书中的各个实施例均采用相关的方式描述,各个实施例之间相同相似的部分互相参见即可,每个实施例重点说明的都是与其他实施例的不同之处。尤其,对于装置、电子设备及计算机可读存储介质实施例而言,由于其基本相似于方法实施例,所以描述的比较简单,相关之处参见方法实施例的部分说明即可。Each embodiment in this specification is described in a related manner, and the same and similar parts between the various embodiments may be referred to each other, and each embodiment focuses on the differences from other embodiments. In particular, for the apparatus, electronic device, and computer-readable storage medium embodiments, since they are basically similar to the method embodiments, the description is relatively simple, and reference may be made to some descriptions of the method embodiments for related parts.

以上所述仅为本申请的较佳实施例,并不用以限制本申请,凡在本申请的精神和原则之内,所做的任何修改、等同替换、改进等,均应包含在本申请保护的范围之内。The above are only preferred embodiments of the present application, and are not intended to limit the present application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application shall be included in the protection of the present application. within the range.

Claims (11)

一种更新生物特征库的方法,所述生物特征库包括至少一个基准生物特征,其特征在于,所述方法包括:A method for updating a biometric database, the biometric database comprising at least one reference biometric, characterized in that the method comprises: 获取输入生物特征与目标基准生物特征比对的相似度,其中,所述输入生物特征为从多媒体数据中提取的生物特征,所述目标基准生物特征为所述至少一个基准生物特征中与所述输入生物特征的身份匹配度最大的基准生物特征;Obtaining the similarity between the input biometric feature and the target reference biometric feature, wherein the input biometric feature is a biometric feature extracted from multimedia data, and the target reference biometric feature is the at least one reference biometric feature that is the same as the The reference biometrics with the highest matching degree of identity of the input biometrics; 当所述相似度大于第一阈值时,对所述输入生物特征与所述目标基准生物特征进行特征融合,得到融合后特征;When the similarity is greater than the first threshold, feature fusion is performed on the input biometric feature and the target reference biometric feature to obtain a fused feature; 将所述目标基准生物特征更新为所述融合后特征。Updating the target reference biometrics to the fused features. 根据权利要求1所述的更新生物特征库的方法,其特征在于,The method for updating a biometric database according to claim 1, wherein, 所述输入生物特征是对单张包含生物特征的图片进行生物特征提取后得到的;或者The input biometric feature is obtained after biometric feature extraction is performed on a single picture containing the biometric feature; or 所述输入生物特征是对多张包含生物特征的图片进行生物特征提取后再进行生物特征融合得到的。The input biometric feature is obtained by performing biometric feature extraction on a plurality of pictures containing biometric features and then performing biometric feature fusion. 根据权利要求1所述的更新生物特征库的方法,其特征在于,所述将所述目标基准生物特征更新为所述融合后特征,包括:The method for updating a biometric database according to claim 1, wherein the updating the target reference biometric feature to the post-fusion feature comprises: 根据所述目标基准生物特征的身份标识,从所述生物特征库中查找所述目标基准生物特征;Searching for the target reference biometric feature from the biometric database according to the identity of the target reference biometric feature; 将所述目标基准生物特征替换为所述融合后特征。Replace the target fiducial biometric with the fused feature. 根据权利要求1所述的更新生物特征库的方法,其特征在于,The method for updating a biometric database according to claim 1, wherein, 所述获取输入生物特征与目标基准生物特征比对的相似度,包括:在基于输入生物特征完成身份识别之后,获取所述输入生物特征与目标基准生物特征比对的相似度;The obtaining the similarity between the input biometrics and the target reference biometrics includes: after completing the identity recognition based on the input biometrics, acquiring the similarity between the input biometrics and the target reference biometrics; 所述第一阈值大于第二阈值,所述第二阈值为:基于所述输入生物特征进行身份识别时,表征身份识别成功的输入生物特征与基准生物特征的最小相似度。The first threshold value is greater than the second threshold value, and the second threshold value is: when performing identification based on the input biometric characteristics, the minimum similarity between the input biometric characteristic and the reference biometric characteristic indicating that the identification is successful. 根据权利要求1所述的更新生物特征库的方法,其特征在于,还包括:The method for updating a biometric database according to claim 1, further comprising: 在所述获取输入生物特征与目标基准生物特征比对的相似度之前,根据 所述输入生物特征与所述基准生物特征比对的相似度,以及所述输入生物特征与所述基准生物特征的关联属性是否一致的结果信息,确定目标基准生物特征;Before acquiring the similarity between the input biometrics and the target reference biometrics, according to the similarity between the input biometrics and the reference biometrics, and the similarity between the input biometrics and the reference biometrics The result information of whether the associated attributes are consistent to determine the target benchmark biometrics; 其中,所述输入生物特征与所述基准生物特征比对的相似度的置信水平不小于置信水平阈值,所述关联属性包括性别、年龄段、体质形态类别中的至少之一。Wherein, the confidence level of the similarity between the input biometric feature and the reference biometric feature is not less than a confidence level threshold, and the associated attribute includes at least one of gender, age, and physical shape category. 根据权利要求1所述的更新生物特征库的方法,其特征在于,所述对所述输入生物特征与目标基准生物特征进行特征融合,得到融合后特征,包括:The method for updating a biometric database according to claim 1, wherein the feature fusion of the input biometrics and the target reference biometrics to obtain the fused features, comprising: 根据函数feat_out=feat_cap*(1–momentum)+feat_old*momentum,对所述输入生物特征与目标基准生物特征进行特征融合;According to the function feat_out=feat_cap*(1-momentum)+feat_old*momentum, feature fusion is performed on the input biometrics and the target reference biometrics; 其中,所述feat_out为融合后特征,所述feat_cap为所述输入生物特征,所述feat_old为所述目标基准生物特征,所述momentum为动量系数,且0≤momentum<1。The feat_out is the feature after fusion, the feat_cap is the input biometric, the feat_old is the target reference biometric, the momentum is the momentum coefficient, and 0≤momentum<1. 根据权利要求6所述的更新生物特征库的方法,其特征在于,0.9≤momentum<1。The method for updating a biometric database according to claim 6, wherein 0.9≤momentum<1. 根据权利要求1-7任一项所述的更新生物特征库的方法,其特征在于,所述生物特征库包括人脸特征库、掌形特征库、皮肤特征库、耳廓特征库、步态特征库或声音特征库。The method for updating a biometric database according to any one of claims 1-7, wherein the biometric database includes a face feature database, a palm shape feature database, a skin feature database, a pinna feature database, and a gait feature database. Signature library or sound signature library. 一种更新生物特征库的装置,所述生物特征库包括至少一个基准生物特征,其特征在于,所述装置包括:A device for updating a biometric database, the biometric database comprising at least one reference biometric, characterized in that the device includes: 获取单元,用于获取输入生物特征与目标基准生物特征比对的相似度,其中,所述输入生物特征为从多媒体数据中提取的生物特征,所述目标基准生物特征为所述至少一个基准生物特征中与所述输入生物特征的身份匹配度最大的基准生物特征;an obtaining unit, configured to obtain the similarity between the input biometric feature and the target reference biometric feature, wherein the input biometric feature is a biometric feature extracted from multimedia data, and the target reference biometric feature is the at least one reference biological feature The reference biometric feature that matches the identity of the input biometric feature with the greatest degree of identity; 融合单元,用于当所述相似度大于第一阈值时,对所述输入生物特征与所述目标基准生物特征进行特征融合,得到融合后特征;a fusion unit, configured to perform feature fusion on the input biological feature and the target reference biological feature when the similarity is greater than a first threshold to obtain a post-fusion feature; 更新单元,用于将所述目标基准生物特征更新为所述融合后特征。An update unit, configured to update the target reference biological feature to the fusion feature. 一种电子设备,其特征在于,包括:存储器和耦接至所述存储器的 处理器,所述处理器配置为基于存储在所述存储器中的指令,执行根据权利要求1-8中任一项所述的更新生物特征库的方法。An electronic device, comprising: a memory and a processor coupled to the memory, the processor configured to execute any one of claims 1-8 based on instructions stored in the memory The described method for updating a biometric database. 一种计算机可读存储介质,其特征在于,其上存储有计算机程序,所述计算机程序被处理器执行时实现如权利要求1-8中任一项所述的更新生物特征库的方法。A computer-readable storage medium, characterized in that a computer program is stored thereon, and when the computer program is executed by a processor, the method for updating a biometric database according to any one of claims 1-8 is implemented.
PCT/CN2021/125065 2020-10-20 2021-10-20 Method and apparatus for updating biometric library, and electronic device Ceased WO2022083653A1 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
CN202011124636 2020-10-20
CN202011124636.9 2020-10-20
CN202110057029.3A CN114387635B (en) 2020-10-20 2021-01-15 Method, device and electronic device for updating biometric database
CN202110057029.3 2021-01-15

Publications (1)

Publication Number Publication Date
WO2022083653A1 true WO2022083653A1 (en) 2022-04-28

Family

ID=81194972

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2021/125065 Ceased WO2022083653A1 (en) 2020-10-20 2021-10-20 Method and apparatus for updating biometric library, and electronic device

Country Status (2)

Country Link
CN (1) CN114387635B (en)
WO (1) WO2022083653A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117058739A (en) * 2023-08-28 2023-11-14 联通在线信息科技有限公司 A face clustering update method and device

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008126254A1 (en) * 2007-03-30 2008-10-23 Pioneer Corporation Speaker recognition device, acoustic model update method, and acoustic model update process program
CN104036245A (en) * 2014-06-10 2014-09-10 电子科技大学 Biometric feature recognition method based on on-line feature point matching
CN110268419A (en) * 2019-05-08 2019-09-20 深圳市汇顶科技股份有限公司 A face recognition method, a face recognition device and a computer-readable storage medium
CN110472537A (en) * 2019-07-31 2019-11-19 腾讯科技(深圳)有限公司 A kind of self-adaptive identification method, device, equipment and medium
CN111931718A (en) * 2020-09-22 2020-11-13 深圳市视美泰技术股份有限公司 Method and device for updating face features based on face recognition and computer equipment
CN112541446A (en) * 2020-12-17 2021-03-23 杭州海康威视数字技术股份有限公司 Biological feature library updating method and device and electronic equipment

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111523103B (en) * 2020-05-09 2022-06-24 支付宝(杭州)信息技术有限公司 User identity identification method and device and electronic equipment

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2008126254A1 (en) * 2007-03-30 2008-10-23 Pioneer Corporation Speaker recognition device, acoustic model update method, and acoustic model update process program
CN104036245A (en) * 2014-06-10 2014-09-10 电子科技大学 Biometric feature recognition method based on on-line feature point matching
CN110268419A (en) * 2019-05-08 2019-09-20 深圳市汇顶科技股份有限公司 A face recognition method, a face recognition device and a computer-readable storage medium
CN110472537A (en) * 2019-07-31 2019-11-19 腾讯科技(深圳)有限公司 A kind of self-adaptive identification method, device, equipment and medium
CN111931718A (en) * 2020-09-22 2020-11-13 深圳市视美泰技术股份有限公司 Method and device for updating face features based on face recognition and computer equipment
CN112541446A (en) * 2020-12-17 2021-03-23 杭州海康威视数字技术股份有限公司 Biological feature library updating method and device and electronic equipment

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117058739A (en) * 2023-08-28 2023-11-14 联通在线信息科技有限公司 A face clustering update method and device

Also Published As

Publication number Publication date
CN114387635B (en) 2025-07-04
CN114387635A (en) 2022-04-22

Similar Documents

Publication Publication Date Title
WO2019120115A1 (en) Facial recognition method, apparatus, and computer apparatus
CN106295313B (en) Object identity management method and device and electronic equipment
CN106529571B (en) Multilayer image feature extraction modeling and image recognition method and device based on neural network
CN112948612B (en) Human body cover generation method and device, electronic equipment and storage medium
AU2013213886A1 (en) Notification and privacy management of online photos and videos
WO2021031817A1 (en) Emotion recognition method and device, computer device, and storage medium
WO2022188844A1 (en) Video classification method and apparatus, device, and medium
CN109190521B (en) Construction method and application of face recognition model based on knowledge purification
CN109063611A (en) A kind of face recognition result treating method and apparatus based on video semanteme
CN114519863B (en) Human body weight recognition method, human body weight recognition device, computer equipment and medium
CN112541446A (en) Biological feature library updating method and device and electronic equipment
CN112257693A (en) Identity recognition method and equipment
Saraswat et al. Anti-spoofing-enabled contactless attendance monitoring system in the COVID-19 pandemic
Rodriguez et al. Calibration of score based likelihood ratio estimation in automated forensic facial image comparison
CN114926717B (en) Object feature fusion method, device and storage medium
CN106295574A (en) Face feature extraction modeling and face recognition method and device based on neural network
WO2022083653A1 (en) Method and apparatus for updating biometric library, and electronic device
CN117237757A (en) Face recognition model training method and device, electronic equipment and medium
CN113128278A (en) Image identification method and device
CN107480628B (en) Face recognition method and device
CN111708988B (en) Infringement video identification method and device, electronic equipment and storage medium
CN114021634A (en) Data augmentation strategy selection method, device and system
WO2022237065A1 (en) Classification model training method, video classification method, and related device
CN118658193A (en) Method and system for self-service document signing based on fusion verification
CN114519886B (en) Image processing method, device, equipment, storage medium and program

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21882068

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21882068

Country of ref document: EP

Kind code of ref document: A1

122 Ep: pct application non-entry in european phase

Ref document number: 21882068

Country of ref document: EP

Kind code of ref document: A1

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 20.10.2023)