[go: up one dir, main page]

WO2009003314A1 - Method for realizing personal face login system - Google Patents

Method for realizing personal face login system Download PDF

Info

Publication number
WO2009003314A1
WO2009003314A1 PCT/CN2007/002053 CN2007002053W WO2009003314A1 WO 2009003314 A1 WO2009003314 A1 WO 2009003314A1 CN 2007002053 W CN2007002053 W CN 2007002053W WO 2009003314 A1 WO2009003314 A1 WO 2009003314A1
Authority
WO
WIPO (PCT)
Prior art keywords
face
range
angle
degrees
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2007/002053
Other languages
French (fr)
Chinese (zh)
Inventor
Qing Zhang
Tao Wang
Li Mao
Jianping Wu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
SHANGHAI ISVISION TECHNOLOGIES Co Ltd
Original Assignee
SHANGHAI ISVISION TECHNOLOGIES Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by SHANGHAI ISVISION TECHNOLOGIES Co Ltd filed Critical SHANGHAI ISVISION TECHNOLOGIES Co Ltd
Priority to PCT/CN2007/002053 priority Critical patent/WO2009003314A1/en
Publication of WO2009003314A1 publication Critical patent/WO2009003314A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16Human faces, e.g. facial parts, sketches or expressions
    • G06V40/172Classification, e.g. identification

Definitions

  • the present invention relates to a login method, and more particularly to a method for implementing a face login system (e.g., an operating system, a game system, etc.).
  • a face login system e.g., an operating system, a game system, etc.
  • the technical problem to be solved by the present invention is to provide a method for implementing a face login system, which can enhance the security of system login, and can ensure the applicability, convenience and reliability of login.
  • the present invention provides a method for implementing a face registration system, including: a face registration process and a face registration process, where the face registration process includes:
  • the present invention adopts the above technical solution, and has the following technical effects, that is, the Retinex method is used to perform clearing processing on the acquired image in advance in the registration process, and the image data in the gray format is used for face detection and positioning, Then, the feature vector of the face at six different angles is saved as a compared feature vector to compare with the user face feature vector obtained during the login process to determine whether the user is allowed to enter the system;
  • the applicability and reliability of the face registration system enable the false recognition rate of face registration to reach one thousandth and the rejection rate to reach one thousandth. Therefore, the system login is ensured and improved.
  • Safety sexuality, intuitiveness and convenience In addition, the method of the invention is relatively simple and easy to generalize.
  • FIG. 1 is a schematic diagram of a flow of face registration according to an embodiment of the present invention
  • FIG. 2 is a diagram of face registration according to an embodiment of the present invention. Schematic diagram of the process.
  • the process of face registration in the system is first completed.
  • the process of face registration in various systems is as follows:
  • each frame of image data in the video is acquired, so that in the case of poor lighting conditions, the user of the login system can also successfully register according to the present invention and accurately pass the login authentication, preferably using the Retinex algorithm.
  • Each frame of image data is subjected to image enhancement preprocessing to highlight dark areas in the acquired image, improve the visual effect of the image, enhance the contrast of the image, sharpen the edges of the image, and remove noise in the image, thereby The image is clearer and more suitable for subsequent recognition processing.
  • the brightness of the image processed by the Retinex algorithm is converted to a range of brightness suitable for face recognition, for example, in one embodiment, the image gradation can be adjusted to be in the range of 120 to 210.
  • the conversion of the grayscale format can be implemented using the following formula:
  • the Adaboost algorithm can be used for face detection. Then, in the data determined as the face, the position of the organ in the face is located, optimally, in the present invention, the eye is positioned; in one embodiment, the Adaboost algorithm can also be used to implement the organ in the face. Positioning.
  • the Adaboost algorithm has the characteristics of simple method, good real-time performance and fast detection speed. It is a classifier algorithm. The basic implementation idea is: Use a large number of general classifiers with basic classification ability to superimpose through certain methods ( Boost), constitute a strong classifier with strong classification ability, and then connect several strong classifiers into a classifier cascade to complete image search detection.
  • Adaboost can be used to ensure face detection and people.
  • the accuracy of face positioning can also improve the speed of face detection and face positioning. Since it has been found in experiments that the selection of system detection parameters has a great influence on the detection speed and the recognition effect, in one embodiment, the extended Hair-like feature can be extracted to complete the detection and localization of the face.
  • the face data in the above six face images are respectively taken out and subjected to illumination compensation processing.
  • the data of the six images after illumination compensation are respectively Gaubor transformed, and then projected to PCA (principal component analysis) to project the samples of the Gabor transformed high-dimensional space into the low-dimensional space; then transform to LDA (linear discrimination) Analyze) space to extract the most discriminative low-dimensional features, and finally form the facial feature values into facial feature vectors, and extract the feature vectors of the above six images: front Tl, left turn 5-12 degrees ⁇ 2, turn right 5-12 degrees ⁇ 3, head up 5-10 degrees ⁇ 4, head 5-10 degrees ⁇ 5, left or right 5-10 degrees ⁇ 6.
  • the obtained six face images and their corresponding feature vectors T1, ⁇ 2, ⁇ 3, ⁇ 4, T5 and T6 are saved in file or data mode, and one of three usage modes: "loose”, “standard”, and “strict” is selected for saving.
  • the above three modes of use respectively correspond to “85”.
  • the three similarities of ", "90” and “95” can be selected by the user according to the requirements of the system confidentiality.
  • the face login system program When the system is turned on, the face login system program is started at the same time, and then the camera and the display are activated, and then the image data of each frame in the video is acquired.
  • Login authentication preferably, using the Retinex algorithm to perform image enhancement preprocessing on each frame of image data acquired to highlight dark areas in the acquired image, improve the visual effect of the image, enhance the contrast of the image, and make the edges of the image clear And removing the noise in the image, so that the converted image is more clear, and is more suitable for subsequent recognition processing.
  • the image data is converted into a grayscale format.
  • the following formula can be used to implement the conversion of the grayscale format -
  • face detection is performed to determine data in which the face is represented.
  • the Adaboost algorithm can be used for face detection. Then, in the data determined as the face, the position of the same organ in the face as the registered organ is located, and optimally, in the present invention, the eye is selected accordingly; in one embodiment, The Adaboost algorithm can be used to locate the organs in the face. Since it has been found through experiments that the selection of system detection parameters has a great influence on the detection speed and recognition effect, in one embodiment, the extended Hair-like feature can be extracted to complete the detection and localization of the face.
  • the present invention selects the Gabor wavelet transform most commonly used by researchers in the field of computational vision, the kernel function of which is described as:

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Theoretical Computer Science (AREA)
  • Collating Specific Patterns (AREA)

Abstract

A method for realizing personal face login system, it carries legible process beforehand using Retinex algorithm for the obtained images in the registering procedure, detects and positions the personal face using a gray-level format image data, then saves the feature vectors of personal face in six difference angles as the feature vectors to be compared with the feature vectors of user's personal face which obtained in the login procedure, determines whether or not allow the user to entry the system basis on the compared result.

Description

用于实现人脸登录系统的方法  Method for implementing a face login system

技术领域  Technical field

本发明涉及一种登录方法, 尤其涉及一种用于实现人脸登录系统 (如 操作系统、 游戏系统等) 的方法。  The present invention relates to a login method, and more particularly to a method for implementing a face login system (e.g., an operating system, a game system, etc.).

背景技术  Background technique

目前, 最普遍使用的登录各种系统(如 Windows Unix等操作系统、 游戏系统等) 的方法是通过键盘输入密码的方式, 但是这种方法安全性不 高也不够灵活, 容易被人盗取, 且易于遗忘。  At present, the most commonly used method for logging in various systems (such as Windows Unix and other operating systems, game systems, etc.) is to input a password through the keyboard, but this method is not high in security and flexible, and is easily stolen. And easy to forget.

. 为了提高安全性, 有人提出了使用指紋来登录系统的方法, 但是这种 方法存在以下缺点: 即由于人的指纹较细而且密度较高, 因此指纹数据的 采集较为困难, 而且当登录用户的手指上沾有汗水或污垢等时, 会对识别 结果产生较大影响, 造成使用上的极大不便, 因此要将这种登录方法不易 获取也不够直观, 要应用于实际还是具有一定难度的。  In order to improve security, a method of using a fingerprint to log in to the system has been proposed, but this method has the following disadvantages: that is, since the fingerprint of the person is thin and the density is high, the collection of the fingerprint data is difficult, and when the user logs in, When there is sweat or dirt on the finger, it will have a great influence on the recognition result, which causes great inconvenience in use. Therefore, it is not easy to obtain such a registration method, and it is not intuitive enough to be applied to the actual application.

虽然目前也有人提出了应用人脸来登录各种系统的方法, 但是往往没 有给出具体的实现方式, 而且其拒识率和误识率都很高, 几乎在百分之十 以上, 因此不具有适用性。  Although some people have proposed the method of applying face to log in to various systems, they often do not give specific implementation methods, and their rejection rate and misrecognition rate are very high, almost 10% or more, so Applicability.

发明内容  Summary of the invention

本发明要解决的技术问题是提供一种用于实现人脸登录系统的方法, 可增强系统登录的安全性, 且能保证登录的适用性、 便捷性和可靠性。  The technical problem to be solved by the present invention is to provide a method for implementing a face login system, which can enhance the security of system login, and can ensure the applicability, convenience and reliability of login.

为解决上述技术问题,本发明提供一种用于实现人脸登录系统的方法, 包括: 人脸注册过程和人脸登录过程, 其中, 所述人脸注册过程包括: In order to solve the above technical problem, the present invention provides a method for implementing a face registration system, including: a face registration process and a face registration process, where the face registration process includes:

( 1 )使用 Retinex算法对注册时所获取的每一帧图像数据进行处理的 步骤; (1) using the Retinex algorithm to process each frame of image data acquired during registration Step

(2)将经 Retinex处理的图像数据转化为灰度格式的步骤;  (2) a step of converting the image data processed by Retinex into a grayscale format;

(3)获取人脸正面、人脸左转角度在 5〜12度范围内、人脸右转角度 在 5〜12度范围内、人脸抬头角度在 5〜10度范围内和人脸低头角度在 5〜 10度范围内的六张人脸图像的特征向量 Tl、 Τ2、 Τ3、 Τ4、 Τ5和 Τ6的步骤; 所述人脸登录过程包括:  (3) Obtaining the face of the face, the angle of the left turn of the face is in the range of 5 to 12 degrees, the angle of the right turn of the face is in the range of 5 to 12 degrees, the angle of the face raising is in the range of 5 to 10 degrees, and the angle of the face is lowered. Steps of feature vectors T1, Τ2, Τ3, Τ4, Τ5, and Τ6 of six face images in the range of 5 to 10 degrees; the face registration process includes:

(a)使用 Retinex算法对登录时所获取的每一帧图像数据进行处理的  (a) using the Retinex algorithm to process each frame of image data acquired at login

(b)将经 Retinex处理的图像数据转化为灰度格式的步骤; (b) the step of converting the Retinex processed image data into a grayscale format;

(c)找出人脸正面、人脸左转角度在 5〜12度范围内、人脸右转角度 在 5〜12度范围内、人脸抬头角度在 5〜: L0度范围内或人脸低头角度在 5〜 10度范围内的一张人脸图像的步骤;  (c) Find the front of the face, the angle of the left turn of the face is in the range of 5 to 12 degrees, the angle of the right turn of the face is in the range of 5 to 12 degrees, and the angle of the face is raised in the range of 5 to: L0 or the face a step of lowering an angle of a face image in the range of 5 to 10 degrees;

(d)获取所述找到的人脸图像的特征向量 Te的步骤;  (d) a step of acquiring the feature vector Te of the found face image;

(e)将所述特征向量 Te与所述特征向量 Tl、 Τ2、 Τ3、 Τ4、 Τ5或 Τ6 进行比较, 确定是否可以成功登录系统的步骤。  (e) comparing the feature vector Te with the feature vector T1, Τ2, Τ3, Τ4, Τ5 or Τ6 to determine whether the system can be successfully logged into the system.

本发明由于釆用了上述技术方案, 具有如下技术效果, 即通过在注册 过程中预先对获取的图像使用 Retinex方法进行清晰化处理,并使用灰度格 式的图像数据来进行人脸检测和定位, 随后保存人脸在六个不同角度上的 特征向量, 作为被比特征向量, 以与登录过程中所得的用户人脸特征向量 进行比较, 来确定该用户是否为被允许进入系统; 由此, 保证了人脸登录 系统的适用性和可靠性, 使得人脸登录时的误识率可以达到 1000分之一、 而拒识率则可以达到 1000分之一,. 因此进而确保并提高了系统登录的安全 性、 直观性和便捷性; 另外, 本发明所述方法较为简单, 易于推广。 The present invention adopts the above technical solution, and has the following technical effects, that is, the Retinex method is used to perform clearing processing on the acquired image in advance in the registration process, and the image data in the gray format is used for face detection and positioning, Then, the feature vector of the face at six different angles is saved as a compared feature vector to compare with the user face feature vector obtained during the login process to determine whether the user is allowed to enter the system; The applicability and reliability of the face registration system enable the false recognition rate of face registration to reach one thousandth and the rejection rate to reach one thousandth. Therefore, the system login is ensured and improved. Safety Sexuality, intuitiveness and convenience; In addition, the method of the invention is relatively simple and easy to generalize.

附图说明  DRAWINGS

下面结合附图与具体实施方式对本发明作进一步详细的说明: 图 1为根据本发明的一个实施例进行人脸注册时的流程示意图; 图 2为根据本发明的一个实施例进行人脸登录时的流程示意图。  The present invention will be further described in detail with reference to the accompanying drawings and specific embodiments. FIG. 1 is a schematic diagram of a flow of face registration according to an embodiment of the present invention; FIG. 2 is a diagram of face registration according to an embodiment of the present invention. Schematic diagram of the process.

具体实施方式  detailed description

优选地, 为了能够确保人脸登录系统的精确性, 在使用人脸来实现系 统登录之前, 首先要完成在系统中进行人脸注册的过程。  Preferably, in order to be able to ensure the accuracy of the face registration system, before using the face to implement system login, the process of face registration in the system is first completed.

如图 1所示, 在一个优选实施例中, 在各种系统 (如 Windows、 Unix等 操作系统, 游戏系统等) 中进行人脸注册的过程如下:  As shown in FIG. 1, in a preferred embodiment, the process of face registration in various systems (such as Windows, Unix, etc., game systems, etc.) is as follows:

用于在开启系统中的人脸注册程序后, 首先启动摄像头和显示视频。 然后, 获取视频中的每一帧图像数据, 为了使得在光照条件不好的情 况下, 登录系统的用户也能根据本发明顺利注册并准确地经过登录认证, 优选地, 使用 Retinex算法对所获取的每一帧图像数据进行图像增强预处 理, 以突出所获取图像中的阴暗区域, 改善图像的视觉效果, 增强图形的 明暗对比度、 令图像边缘清晰、 并去除图像中的噪声, 从而使得转换后的 图像更为清晰, 更为适合后续的识别处理。  Used to start the camera and display the video first after opening the face registration program in the system. Then, each frame of image data in the video is acquired, so that in the case of poor lighting conditions, the user of the login system can also successfully register according to the present invention and accurately pass the login authentication, preferably using the Retinex algorithm. Each frame of image data is subjected to image enhancement preprocessing to highlight dark areas in the acquired image, improve the visual effect of the image, enhance the contrast of the image, sharpen the edges of the image, and remove noise in the image, thereby The image is clearer and more suitable for subsequent recognition processing.

随后, 将经 Retinex算法处理过的图像的亮度转换到适合进行人脸识 别的亮度范围内,例如,在一个实施例中,可将图像灰度调整到 120到 210 的范围之内。  Subsequently, the brightness of the image processed by the Retinex algorithm is converted to a range of brightness suitable for face recognition, for example, in one embodiment, the image gradation can be adjusted to be in the range of 120 to 210.

由于图像的灰度处理可以在一定程度上去除不同光照对人脸图像的影 响, 因此为了确保后续的人脸检测能够正常进行, 将图像数据转化为灰度 格式。 在一个实施例中, 可用以下公式来实现灰度格式的转换: Since the grayscale processing of the image can remove the influence of different illumination on the face image to some extent, in order to ensure that the subsequent face detection can be performed normally, the image data is converted into grayscale. Format. In one embodiment, the conversion of the grayscale format can be implemented using the following formula:

Y = krR + kgG + kbB Y = k r R + k g G + k b B

其中, R、 G、 B代表彩色图像的三个分量; kr、 kg、 kb分别表示上述各 分量所对应的权重; Y 为转换后的灰度图像。 在一个实施例中, 可取 kr=0. 299、 kg=0. 587、 kb=0. 114。 Where R, G, B represent three components of the color image; k r , k g , k b respectively represent the weights corresponding to the respective components; Y is the converted gray image. In one embodiment, k r =0. 299, k g =0.587, k b =0. 114.

根据所得的灰度格式图 数据, 进行人脸检测, 以确定其中表示人脸 的数据。 在一个实施例中, 可使用 Adaboost算法来进行人脸检测。 然后, 在确定为人脸的数据中, 定位人脸中器官的位置, 最优地, 在本发明中, 对眼睛进行定位; 在一个实施例中, 也可利用 Adaboost算法来实现人脸中 器官的定位。 Adaboost算法具有方法简单、 实时性好, 检测速度快的特点, 它是一种分类器算法, 其基本实现思想是: 利用大量的分类能力一般的简 单分类器(basic classifier)通过一定的方法叠加 (boost )起来, 构成 一个分类能力很强的强分类器 ( stage classifier) , 再将若干个强分类 器串联成为分级分类器(classifier cascade)完成图像搜索检测, 因此 使用 Adaboost可以确保人脸检测和人脸定位的精度, 同时也能提高人脸检 测和人脸定位的速度。 由于在实验中发现, 系统检测参数的选择, 对检测 速度和识别效果有很大的影响, 因此在一个实施例中,可抽取扩展的 Hair - like特征来完成人脸的检测和定位。  Based on the obtained grayscale map data, face detection is performed to determine data in which the face is represented. In one embodiment, the Adaboost algorithm can be used for face detection. Then, in the data determined as the face, the position of the organ in the face is located, optimally, in the present invention, the eye is positioned; in one embodiment, the Adaboost algorithm can also be used to implement the organ in the face. Positioning. The Adaboost algorithm has the characteristics of simple method, good real-time performance and fast detection speed. It is a classifier algorithm. The basic implementation idea is: Use a large number of general classifiers with basic classification ability to superimpose through certain methods ( Boost), constitute a strong classifier with strong classification ability, and then connect several strong classifiers into a classifier cascade to complete image search detection. Therefore, Adaboost can be used to ensure face detection and people. The accuracy of face positioning can also improve the speed of face detection and face positioning. Since it has been found in experiments that the selection of system detection parameters has a great influence on the detection speed and the recognition effect, in one embodiment, the extended Hair-like feature can be extracted to complete the detection and localization of the face.

然后, 确定经过上述处理的每一帧人脸图像数据的位置, 即计算出其 中人脸偏转的角度, 并且优选地, 选出其中较具代表性的六张合适角度的 人脸图像, 它们分别是: 人脸正面照片一张、人脸左转角度在 5〜12度范围 内的图像一张、人脸右转角度在 5〜12度范围内的图像一张、人脸抬头角度 在 5〜10度范围内的图像一张和人脸低头角度在 5〜10度范围内的图像一 张。 由于用户在登录系统过程中, 其人脸的朝向角度出现在上述角度范围 内的概率较高, 因此, 通过选取如上所述的六张人脸图像有助于提高用户 在登录系统过程中的认证速度。 Then, determining the position of the face image data of each frame subjected to the above processing, that is, calculating the angle at which the face is deflected, and preferably, selecting the six representative angle images of the face, respectively, which are respectively Yes: A photo of the front of the face, an image with a left-angle of the face in the range of 5 to 12 degrees, an image with a right-angle of the face in the range of 5 to 12 degrees, and a face-lifting angle An image in the range of 5 to 10 degrees and a picture of the face with a face angle of 5 to 10 degrees. Since the user has a high probability that the orientation angle of the face appears within the above-mentioned range of angles during the login process, it is helpful to improve the user's authentication during the login system by selecting the six face images as described above. speed.

然后, 分别取出上述六张人脸图像中的人脸数据, 并对其进行光照补 偿处理。在一个实施例中, 可采用如下公式对人脸数据进行光照补偿处理: S=T (r) =l/[l+ (m+r) E],其中 r表示输入图像的亮度, s是输出图像的相应亮 度值, E控制该函数的斜率, m是灰度级。 Then, the face data in the above six face images are respectively taken out and subjected to illumination compensation processing. In one embodiment, the face data may be subjected to illumination compensation processing using the following formula: S = T (r) = l / [l + (m + r ) E ], where r represents the brightness of the input image, and s is the output image For the corresponding brightness value, E controls the slope of the function, and m is the gray level.

对光照补偿后的六张图像的数据分别做 Gabor变换, 再投影到 PCA (主 成份分析), 以将 Gabor变换后的高维空间的样本投影到低维空间; 然后再 变换到 LDA (线性判别分析)空间, 以提取出最具有判别能力的低维特征, 最后将所得到人脸特征值组成人脸特征向量, 并从中提取上述六张图像的 特征向量: 正面 Tl、 左转 5- 12度 Τ2、 右转 5- 12度 Τ3、 抬头 5- 10度 Τ4、 低头 5-10度 Τ5、 左侧或者右侧 5-10度 Τ6。  The data of the six images after illumination compensation are respectively Gaubor transformed, and then projected to PCA (principal component analysis) to project the samples of the Gabor transformed high-dimensional space into the low-dimensional space; then transform to LDA (linear discrimination) Analyze) space to extract the most discriminative low-dimensional features, and finally form the facial feature values into facial feature vectors, and extract the feature vectors of the above six images: front Tl, left turn 5-12 degrees Τ 2, turn right 5-12 degrees Τ 3, head up 5-10 degrees Τ 4, head 5-10 degrees Τ 5, left or right 5-10 degrees Τ 6.

在一个实施例中, 本发明选择计算视觉领域研究人员最常用的 Gabor 小波变换, 其核函数描述为:

Figure imgf000007_0001
In one embodiment, the present invention selects the Gabor wavelet transform most commonly used by researchers in the field of computational vision, the kernel function of which is described as:
Figure imgf000007_0001

其中, "分别代表 Gabor卷积核的尺度参数和方向参数; z = ; ,ν = ^Φ', 其中 尸, Amax是最大频率; /是 Gabor核 在频域中的空间因子。 Among them, "representing the scale parameter and direction parameter of Gabor convolution kernel respectively; z = ; , ν = ^ Φ ', where corpse, A max is the maximum frequency; / is the spatial factor of Gabor kernel in the frequency domain.

最后, 将所得的六张人脸图像及其相应的特征向量 Tl、 Τ2、 Τ3、 Τ4、 T5和 T6以文件或者数据方式进行保存, 并且选择 "宽松"、 "标准"、 "严格" 三种使用方式中的一种进行保存, 在一个实施例中, 上述三种使用方式分 别对应 "85"、 "90"、 "95"三个相似度, 用户可根据对系统保密程度的要 求进行选择。 Finally, the obtained six face images and their corresponding feature vectors T1, Τ2, Τ3, Τ4, T5 and T6 are saved in file or data mode, and one of three usage modes: "loose", "standard", and "strict" is selected for saving. In one embodiment, the above three modes of use respectively correspond to "85". The three similarities of ", "90" and "95" can be selected by the user according to the requirements of the system confidentiality.

在系统中完成了人脸注册后, 如图 2所示, 在一个优选实施例中, 用户 可通过以下方法登录该系统:  After the face registration is completed in the system, as shown in FIG. 2, in a preferred embodiment, the user can log in to the system by the following method:

在开启系统时, 同时启动人脸登录系统程序, 然后启动摄像头和显示 然后, 获取视频中的每一帧图像数据, 为了使得在光照条件不好的情 况下, 登录系统的用户也能准确地经过登录认证, 优选地, 使用 Retinex 算法对所获取的每一帧图像数据进行图像增强预处理, 以突出所获取图像 中的阴暗区域, 改善图像的视觉效果, 增强图形的明暗对比度、 令图像边 缘清晰、 并去除图像中的噪声, 从而使得转换后的图像更为清晰, 更为适 合后续的识别处理。  When the system is turned on, the face login system program is started at the same time, and then the camera and the display are activated, and then the image data of each frame in the video is acquired. In order to make the user of the login system accurately pass under the condition of poor lighting conditions, Login authentication, preferably, using the Retinex algorithm to perform image enhancement preprocessing on each frame of image data acquired to highlight dark areas in the acquired image, improve the visual effect of the image, enhance the contrast of the image, and make the edges of the image clear And removing the noise in the image, so that the converted image is more clear, and is more suitable for subsequent recognition processing.

随后, 将经 Retinex处理过的图像的亮度转换到适合进行人脸识别的 亮度范围内, 例如, 在一个实施例中, 可将图像灰度调整到 120到 210的 范围之内。  Subsequently, the brightness of the Retinex processed image is converted to a range of brightness suitable for face recognition, for example, in one embodiment, the image gradation can be adjusted to a range of 120 to 210.

由于图像的灰度处理可以在一定程度上去除不同光照对人脸图像的影 响, 因此为了确保后续的人脸检测能够正常进行, 将图像数据转化为灰度 格式。 在一个实施例中, 可用以下公式来实现灰度格式的转换- Since the gradation processing of the image can remove the influence of different illumination on the face image to some extent, in order to ensure that the subsequent face detection can be performed normally, the image data is converted into a grayscale format. In one embodiment, the following formula can be used to implement the conversion of the grayscale format -

Y 二 krR + kgG + kbB 分量所对应的权重; Y 为转换后的灰度图像。 在一个实施例中, 可取 k 0. 299、 k 0.,587、 kb=0. 114。 Y two k r R + k g G + k b B The weight corresponding to the component; Y is the converted grayscale image. In one embodiment, k 0. 299, k 0., 587, k b =0. 114 may be taken.

根据所得的灰度格式图像数据, 进行人脸检测, 以确定其中表示人脸 的数据。 在一个实施例中, 可使用 Adaboost算法来进行人脸检测。 然后, 在确定为人脸的数据中, 定位人脸中与注册所定位的器官相同的器官的位 置, 最优地, 在本发明中, 相应地选择对眼睛进行定位; 在一个实施例中, 也可利用 Adaboost算法来实现人脸中器官的定位。 由于通过实验发现, 系 统检测参数的选择, 对检测速度和识别效果有很大的影响, 因此在一个实 施例中, 可抽取扩展的 Hair-like特征来完成人脸的检测和定位。  Based on the obtained grayscale format image data, face detection is performed to determine data in which the face is represented. In one embodiment, the Adaboost algorithm can be used for face detection. Then, in the data determined as the face, the position of the same organ in the face as the registered organ is located, and optimally, in the present invention, the eye is selected accordingly; in one embodiment, The Adaboost algorithm can be used to locate the organs in the face. Since it has been found through experiments that the selection of system detection parameters has a great influence on the detection speed and recognition effect, in one embodiment, the extended Hair-like feature can be extracted to complete the detection and localization of the face.

. 然后, 确定经过上述处理的图像数据的位置, 即计算出其中人脸偏转 的角度, 并从中实时判断所述图像数据是否为在如下所述的六个角度范围 的人脸: 即是否为人脸正面的图像、 人脸左转角度在 5〜12度范围内的图 像、 人脸右转角度在 5〜12度范围内的图像、 人脸抬头角度在 5〜10度范 围内的图像或者为人脸低头角度在 5〜10度范围内的图像。 只要找出了在 如上角度范围内的一个人脸图像, 即可进入下一步操作。  Then, determining the position of the image data subjected to the above processing, that is, calculating the angle at which the face is deflected, and judging from the real-time whether the image data is a face in a range of six angles as described below: that is, whether it is a face The image on the front side, the image in which the left turn angle of the face is in the range of 5 to 12 degrees, the image in which the face is rotated right in the range of 5 to 12 degrees, the image in which the face is raised in the range of 5 to 10 degrees or the face is An image with a head angle in the range of 5 to 10 degrees. As long as you find a face image within the above angle range, you can proceed to the next step.

将通过上一步所找出的人脸图像, 并根据其人脸的位置, 取出人脸数 据, 并对所述数据进行光照补偿处理。  The face image found in the previous step is taken, and the face data is taken out according to the position of the face of the face, and the data is subjected to illumination compensation processing.

对光照补偿后的数据做 Gabor变换,然后再投影到 PCA (主成份分析), 以将 Gabor变换后的高维空间的样本投影到低维空间; 然后再变换到 LM (线性判别分析) 空间, 组成人脸特征向量 Te。  Perform Gabor transform on the data after illumination compensation, and then project to PCA (principal component analysis) to project the samples of Gabor transformed high-dimensional space into low-dimensional space; then transform into LM (linear discriminant analysis) space. The face feature vector Te is formed.

在一个实施例中, 本发明选择计算视觉领域研究人员最常用的 Gabor 小波变换, 其核函数描述为: .

Figure imgf000010_0001
In one embodiment, the present invention selects the Gabor wavelet transform most commonly used by researchers in the field of computational vision, the kernel function of which is described as:
Figure imgf000010_0001

其中, , "分别代表 Gabor卷积核的尺度参数和方向参数; z = (x,j;); ,v = kvei , 其中 =^ /尸, ν =Μ /8 , 是最大频率; /是 Gabor核 在频域中的空间因子。 Where, "represents the scale parameter and direction parameter of the Gabor convolution kernel respectively; z = (x, j;) ; , v = k v e i , where =^ / corpse, ν = Μ /8, is the maximum frequency; / is the spatial factor of the Gabor kernel in the frequency domain.

取出视频图像数据中的人脸特征向量 Te, 将 Te和注册时所保存 St 征向量 Tl、 Τ2、 Τ3、 Τ4、 Τ5和 Τ6进行比对, 并根据人脸注册所选择的使 用方式作为门槛来确定识别是否成功。 根据人脸注册过程中所选择的保存 方式作为门槛来确定识别阈值。  The face feature vector Te in the video image data is taken out, and Te is compared with the St-symbol vectors T1, Τ2, Τ3, Τ4, Τ5, and Τ6 stored at the time of registration, and is used as a threshold according to the usage mode selected by the face registration. Determine if the identification is successful. The recognition threshold is determined based on the save mode selected in the face registration process as a threshold.

识别成功后, 则可自动登录操作系统了。 如果识别失败, 则保存识别 失败的人脸 Pe (用于査询显示识别失败的人脸), 并重复对从视频中获取 的每一帧图像进行 Retinex处理及以下的步骤, 以进行实时识别。  Once the identification is successful, you can automatically log in to the operating system. If the recognition fails, the face Pe that identifies the failure is saved (for querying the face whose display recognition is failed), and the Retinex processing and the following steps are repeated for each frame image acquired from the video to perform real-time recognition.

Claims

权利要求 Rights request 1、一种用于实现人脸登录系统的方法, 包括: 人脸注册过程和人脸登 录过程, 其特征在于:  A method for implementing a face login system, comprising: a face registration process and a face login process, wherein: 所述人脸注册过程包括:  The face registration process includes: (1 )使用 Retinex算法对注册时所获取的每一帧视频图像数据进行处 理的步骤;  (1) a step of processing each frame of video image data acquired at the time of registration using the Retinex algorithm; (2)将经 Retinex处理的图像数据转化为灰度格式的步骤;  (2) a step of converting the image data processed by Retinex into a grayscale format; (3)获取人脸正面、人脸左转角度在 5〜12度范围内、人脸右转角度 在 5〜12度范围内、人脸抬头角度在 5〜10度范围内和人脸低头角度在 5〜 10度范围内的六张人脸图像的特征向量 Tl、 Τ2、 Τ3、 Τ4、 Τ5和 Τ6的步骤; 所述人脸登录过程包括:  (3) Obtaining the face of the face, the angle of the left turn of the face is in the range of 5 to 12 degrees, the angle of the right turn of the face is in the range of 5 to 12 degrees, the angle of the face raising is in the range of 5 to 10 degrees, and the angle of the face is lowered. Steps of feature vectors T1, Τ2, Τ3, Τ4, Τ5, and Τ6 of six face images in the range of 5 to 10 degrees; the face registration process includes: (a)使用 Retinex算法对登录时所获取的每一帧图像数据进行处理的 步骤;  (a) a step of processing each frame of image data acquired at the time of login using the Retinex algorithm; (b)将经 Retinex处理的图像数据转化为灰度格式的步骤;  (b) the step of converting the Retinex processed image data into a grayscale format; (c)找出人脸正面、人脸左转角度在 5〜12度范围内、人脸右转角度 在 5〜12度范围内、人脸抬头角度在 5〜10度范围内或人脸低头角度在 5〜 10度范围内的一张人脸图像的步骤;  (c) Find the front of the face, the angle of the left turn of the face is in the range of 5 to 12 degrees, the angle of the right turn of the face is in the range of 5 to 12 degrees, the angle of the face is raised in the range of 5 to 10 degrees, or the face is bowed. a step of an image of a face having an angle in the range of 5 to 10 degrees; (d)获取所述找到的人脸图像的特征向量 Te的步骤;  (d) a step of acquiring the feature vector Te of the found face image; (e)将所述特征向量 Te与所述特征向量 Tl、 Τ2、 Τ3、 Τ4、 Τ5或 Τ6 进行比较, 确定是否可以成功登录系统的步骤。  (e) comparing the feature vector Te with the feature vector T1, Τ2, Τ3, Τ4, Τ5 or Τ6 to determine whether the system can be successfully logged into the system. 2、根据权利要求 1所述的用于实现人脸登录系统的方法,其特征在于, 在所述步骤(1)和步骤(2)之间还包括: 将经步骤(1 )处理过的图像的 亮度转换到适合进行人脸识别的亮度范围内的步骤; The method for implementing a face registration system according to claim 1, further comprising: between the step (1) and the step (2): the image processed by the step (1) of The step of converting the brightness into a range of brightness suitable for face recognition; 在所述步骤 (a)和步骤(b)之间还包括: 将经步骤(a)处理过的图 像的亮度转换到适合进行人脸识别的亮度范围内的步骤。  Between the step (a) and the step (b), the method further comprises: converting the brightness of the image processed in the step (a) to a range of brightness suitable for face recognition. 3、根据权利要求 1或 2所述的用于实现人脸登录系统的方法,其特征 在于, 所述步骤 (3)进一步包括:  The method for implementing a face registration system according to claim 1 or 2, wherein the step (3) further comprises: ( i )根据步骤(2)所得的灰度格式图像数据, 进行人脸检测和人脸 定位的步骤;  (i) performing steps of face detection and face positioning according to the grayscale format image data obtained in step (2); ( ii )确定每一帧人脸图像数据的位置, 即计算出其中人脸偏转的角 度, 并选出六张人脸图像的步骤, 所述六张人脸图像为: 人脸正面、 人脸 左转角度在 5〜12度范围内、 人脸右转角度在 5〜12度范围内、 人脸抬头 角度在 5〜10度范围内和人脸低头角度在 5〜10度范围内的人脸图像各一 张;  (ii) determining the position of the face image data of each frame, that is, calculating the angle in which the face is deflected, and selecting six face images, the six face images are: face front, face a face with a left turn angle in the range of 5 to 12 degrees, a face right turn angle in the range of 5 to 12 degrees, a face face lift angle in the range of 5 to 10 degrees, and a face face angle in the range of 5 to 10 degrees One image each; ( iii)分别取出所述六张人脸图像中的人脸数据, 并对其进行光照补 偿处理的步骤;  (iii) taking out the face data in the six face images separately and performing the step of performing illumination compensation processing; ( iv)对步骤(iii )所得的人脸数据分别做 Gabor变换, 再投影到主 成份分析空间和线性判别分析空间,得到由人脸特征值组成人脸特征向量, 然后从中提取相应的人脸特征向量 Tl、 Τ2、 Τ3、 Τ4、 Τ5和 Τ6。  (iv) Gabor transform is performed on the face data obtained in step (iii), and then projected into the principal component analysis space and the linear discriminant analysis space to obtain a face feature vector composed of facial feature values, and then the corresponding face is extracted therefrom. Feature vectors T1, Τ2, Τ3, Τ4, Τ5, and Τ6. 4、根据权利要求 3所述的用于实现人脸登录系统的方法,其特征在于, 在所述步骤 (i) 中是使用 Adaboost算法来实现人脸检测和人脸定位的。  The method for implementing a face registration system according to claim 3, wherein in the step (i), the Adaboost algorithm is used to implement face detection and face localization. 5、根据权利要求 1或 4所述的用于实现人脸登录系统的方法,其特征 在于, 所述人脸注册过程还包括: 将所得的六张人脸图像及其相应的人脸 特征向量 Tl、 Τ2、 Τ3、 Τ4、 Τ5和 Τ6以文件或者数据方式进行保存。 The method for implementing a face registration system according to claim 1 or 4, wherein the face registration process further comprises: using the obtained six face images and their corresponding face feature vectors Tl, Τ2, Τ3, Τ4, Τ5, and Τ6 are saved as files or data. 6、根据权利要求 5所述的用于实现人脸登录系统的方法,其特征在于, 将所述人脸图像及其特征向量 Tl、 Τ2、 Τ3、 Τ4、 Τ5和 Τ6进行保存时使用 相似度为 "85"、 "90"或 "95"中的一种使用方式进行保存。 The method for implementing a face registration system according to claim 5, wherein the similarity is used when saving the face image and its feature vectors T1, Τ2, Τ3, Τ4, Τ5, and Τ6 Save for one of "85", "90" or "95". 7、根据权利要求 1或 2所述的用于实现人脸登录系统的方法,其特征 在于, 所述步骤 (c )包括:  The method for implementing a face login system according to claim 1 or 2, wherein the step (c) comprises: 根据步骤(b)所得的灰度格式图像数据, 进行人脸检测和人脸定位的 步骤;  Performing steps of face detection and face localization according to the grayscale format image data obtained in step (b); 确定每一帧人脸图像数据的位置, 即计算出其中人脸偏转的角度, 并 从中找出包括在人脸正面、 人脸左转角度在 5〜12度范围内、 人脸右转角 度在 5〜12度范围内、 人脸抬头角度在 5〜: L0度范围内或人脸低头角度在 5〜10度范围内的一张人脸图像数据的步骤。  Determine the position of the face image data of each frame, that is, calculate the angle at which the face is deflected, and find out that it is included in the front of the face, the left turn angle of the face is in the range of 5 to 12 degrees, and the right turn angle of the face is The step of a face image data in the range of 5 to 12 degrees, the face heading angle is in the range of 5 to: L0 degrees or the face head angle is in the range of 5 to 10 degrees. 8、根据权利要求 7所述的用于实现人脸登录系统的方法,其特征在于, 所述人脸检测和人脸定位是使用 Adaboost算法来实现的。  The method for implementing a face registration system according to claim 7, wherein the face detection and the face location are implemented using an Adaboost algorithm. 9、根据权利要求 1或 2所述的用于实现人脸登录系统的方法,其特征 在于, 所述步骤(d)包括:  The method for implementing a face login system according to claim 1 or 2, wherein the step (d) comprises: 取出步骤(c)所找到的人脸图像的人脸数据, 并对所述数据进行光照 补偿处理的步骤;  Extracting the face data of the face image found in step (c), and performing the step of performing illumination compensation processing on the data; 对所得的人脸数据做 Gabor变换, 再投影到主成份分析空间和线性判 别分析空间, 组成相应的人脸特征向量 Te。  The obtained face data is Gabor transformed, and then projected into the principal component analysis space and the linear discrimination analysis space to form a corresponding face feature vector Te. 10、 根据权利要求 6所述的用于实现人脸登录系统的方法, 其特征在 于, 在所述步骤(e)中,.是根据所述人脸注册过程中所选择的保存方式作 为门槛来确定是否可以成功登录系统的。  10. The method for implementing a face registration system according to claim 6, wherein in the step (e), the storage mode selected in the face registration process is used as a threshold. Determine if you can successfully log in to the system.
PCT/CN2007/002053 2007-07-02 2007-07-02 Method for realizing personal face login system Ceased WO2009003314A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2007/002053 WO2009003314A1 (en) 2007-07-02 2007-07-02 Method for realizing personal face login system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2007/002053 WO2009003314A1 (en) 2007-07-02 2007-07-02 Method for realizing personal face login system

Publications (1)

Publication Number Publication Date
WO2009003314A1 true WO2009003314A1 (en) 2009-01-08

Family

ID=40225692

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2007/002053 Ceased WO2009003314A1 (en) 2007-07-02 2007-07-02 Method for realizing personal face login system

Country Status (1)

Country Link
WO (1) WO2009003314A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110580452A (en) * 2019-08-08 2019-12-17 宁波中国科学院信息技术应用研究院 A multi-template face automatic entry method in a video-based face recognition system

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6826300B2 (en) * 2001-05-31 2004-11-30 George Mason University Feature based classification
US7027622B2 (en) * 2002-04-09 2006-04-11 Industrial Technology Research Institute Method for locating face landmarks in an image
KR20060133345A (en) * 2005-06-20 2006-12-26 삼성전자주식회사 Face verification method and apparatus using local binary pattern discrimination method
CN1949245A (en) * 2006-11-09 2007-04-18 上海大学 Personal face matching method based on limited multiple personal face images

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6826300B2 (en) * 2001-05-31 2004-11-30 George Mason University Feature based classification
US7027622B2 (en) * 2002-04-09 2006-04-11 Industrial Technology Research Institute Method for locating face landmarks in an image
KR20060133345A (en) * 2005-06-20 2006-12-26 삼성전자주식회사 Face verification method and apparatus using local binary pattern discrimination method
CN1949245A (en) * 2006-11-09 2007-04-18 上海大学 Personal face matching method based on limited multiple personal face images

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
SHAN S.: "Study on Some Key Issues in Face Recognition", DOCTOR'S DEGREE THESIS OF GRADUATE UNIVERSITY OF CHINESE ACADEMY OF SCIENCES, May 2004 (2004-05-01), pages 79 - 81 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110580452A (en) * 2019-08-08 2019-12-17 宁波中国科学院信息技术应用研究院 A multi-template face automatic entry method in a video-based face recognition system

Similar Documents

Publication Publication Date Title
US12223760B2 (en) Systems and methods for performing fingerprint based user authentication using imagery captured using mobile devices
CN107423690B (en) A face recognition method and device
EP3552150B1 (en) Systems and methods for performing fingerprint based user authentication using imagery captured using mobile devices
EP2883190B1 (en) Texture features for biometric authentication
CN102004899B (en) Human face identifying system and method
Barnouti Improve face recognition rate using different image pre-processing techniques
US20160379042A1 (en) Apparatuses, systems, and methods for confirming identity
US11328043B2 (en) Spoof detection by comparing images captured using visible-range and infrared (IR) illuminations
US10922399B2 (en) Authentication verification using soft biometric traits
US7869632B2 (en) Automatic trimming method, apparatus and program
US20200218885A1 (en) Detecting artificial facial images using facial landmarks
CN103886301A (en) Human face living detection method
CN1302424C (en) Personal identity authentication process and system
Rana et al. Iris recognition system using PCA based on DWT
Othman et al. A novel approach for occluded ear recognition based on shape context
Basit et al. Efficient Iris Recognition Method for Human Identification.
Sudhakar et al. Facial identification of twins based on fusion score method
Tiwari et al. A palmprint based recognition system for smartphone
EP4495901B1 (en) Methods and systems for enhancing liveness detection of image data
Singla et al. Face Detection and Recognition Using Digital Image Processing:" State of the Art"
Khan et al. A new method to extract dorsal hand vein pattern using quadratic inference function
WO2009003314A1 (en) Method for realizing personal face login system
JP2005084979A (en) Face authentication system, method and program
Kharakwal et al. A Review on Skin Pigment and Vein Pattern Detection Techniques
Nestorovic et al. Extracting unique personal identification number from iris

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 07721615

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 07721615

Country of ref document: EP

Kind code of ref document: A1