[go: up one dir, main page]

WO2005008567A1 - Apparatus and method for iris recognition from all direction of view - Google Patents

Apparatus and method for iris recognition from all direction of view Download PDF

Info

Publication number
WO2005008567A1
WO2005008567A1 PCT/KR2004/001793 KR2004001793W WO2005008567A1 WO 2005008567 A1 WO2005008567 A1 WO 2005008567A1 KR 2004001793 W KR2004001793 W KR 2004001793W WO 2005008567 A1 WO2005008567 A1 WO 2005008567A1
Authority
WO
WIPO (PCT)
Prior art keywords
iris
view
person
wide field
camera
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2004/001793
Other languages
French (fr)
Inventor
Jai-Hie Kim
Kang-Ryoung Park
Kwang-Hyuk Bae
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yonsei University
Original Assignee
Yonsei University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yonsei University filed Critical Yonsei University
Publication of WO2005008567A1 publication Critical patent/WO2005008567A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/18—Eye characteristics, e.g. of the iris
    • G06V40/19—Sensors therefor
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/10—Image acquisition
    • G06V10/12—Details of acquisition arrangements; Constructional details thereof
    • G06V10/14—Optical characteristics of the device performing the acquisition or on the illumination arrangements
    • G06V10/143—Sensing or illuminating at different wavelengths
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/70—Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/77—Processing image or video features in feature spaces; using data integration or data reduction, e.g. principal component analysis [PCA] or independent component analysis [ICA] or self-organising maps [SOM]; Blind source separation
    • G06V10/776—Validation; Performance evaluation
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
    • G06V40/10—Human or animal bodies, e.g. vehicle occupants or pedestrians; Body parts, e.g. hands
    • G06V40/16—Human faces, e.g. facial parts, sketches or expressions
    • G06V40/161—Detection; Localisation; Normalisation

Definitions

  • the present invention relates to an iris recognition system, and more particularly to iris recognition method and apparatus in an omni-directional view, capable of monitoring the movements of various users in real time in the 360° omnidirectional view and of simultaneously acquiring iris images for various people to let the people perform iris recognition.
  • an iris recognition system is divided into an input device for acquiring an iris images and a recognition part for recognizing a person using the acquired iris images. Since the performance of the iris recognition system depends on how fast and correctly the input device acquires clear and clean iris images (that do not include regions reflected by specular reflection or external noise), the iris input device is very important.
  • the input device for acquiring iris images is divided into the following three for convenience sake. 1) Handheld acquisition device: A user acquires iris image with the device in hands. It is cheap. However, since the user must move the device immediately in front of an eye with the device in hands, it takes long to acquire the iris image and it is inconvenient to use the device.
  • a user approaches the iris input device, controls the height of a camera, and gets his or her eye close to the iris camera to acquire iris image.
  • the device is mainly attached to a wall to control entrance and exit or to authorize a user in a personal computer (PC).
  • the semi-automated acquisition device uses a fixed focus lens portion or a variable focus lens portion (or variable zoom/focus lens portion).
  • the semi-automated acquisition device uses the fixed focus lens portion, in a state where right and left/up and down positions of an eye are adjusted, the distance between the camera and the eyes (the distance Z) is controlled to acquire iris images that are in focus.
  • the semi-automated acquisition device uses the variable focus lens portion (or the variable zoom/focus lens portion), a user gets his or her eye close to the iris camera and fixes his or her eye to the region of the distance Z where the user can perform iris recognition and the camera performs an automated focusing (or automated zooming/focusing) function to automatically acquire the iris image.
  • Automated acquisition device A camera automatically detects the face and eyes of a person and rotates up and down/right and left and automatically performs focusing (or zooming/focusing) to automatically acquire the iris image suitable for iris recognition.
  • the handheld acquisition device and the semi- automated acquisition device need the cooperation of the user (the user must adjust the up and down/right and left positions of his or her eyes or control the height of the camera) in order to acquire iris images.
  • the conventional automated acquisition device since a wide field of view device is composed of one or two or more cameras and common lens portions are used for the cameras, an angle of view is restricted.
  • the conventional automated acquisition device has a problem in that iris images can be acquired only when the eyes of a user are positioned in a specific range in front of the iris input device like the semi-automated acquisition device. It is necessary for a system for controlling and monitoring entrance and exit to monitor whether only the user who is allowed to enter a place where security is to be guaranteed and who is in the place.
  • the angle of view at which iris images can be captured is restricted, it is not possible to monitor whether another person who is not allowed to enter the place enters the place when the user who is allowed to enter the place enters the place or whether another person enters the place instead of the user who is allowed to enter the place.
  • iris recognition method and apparatus in the omni-directional view comprising a first step of acquiring an image of a subject through a wide field of view camera included in a wide field of view device for monitoring all directions in a subject monitoring space, a second step of, when the movement of a subject acquired by the wide field of view camera is detected, determining that the subject as a person whose irises are to be recognized and of detecting the face image of the person, a third step of detecting the face image of the person and of acquiring information on the position of the eyes of the person, a fourth step of, when the position of the eyes of the person is detected, moving the optical axis of the narrow field of view camera for capturing the iris image to the position of the eyes of the person, a fifth step of controlling the zoom and the focus of the iris image camera in accordance with the position of the eyes of the person, a sixth step of correcting the information on the position of the eyes of the person and the focus of the iris image
  • an omni-directional iris recognition apparatus comprising a wide field of view device for acquiring the image of a subject by a wide field of view camera for monitoring all directions and for detecting the face image of a moving person, a narrow field of view device including an iris image camera for acquiring iris image from the face image of the person detected by the wide field of view device, controlling means for controlling the wide field of view device to select a person whose irises are to be recognized from acquired subjects and for controlling the narrow field of view device to acquire the iris images of the person based on information on the position of the eyes of the person, which is transmitted by the wide field of view device, and recognizing means for testing the quality of the iris images acquired by the narrow field of view by the control of the controlling means and for performing iris recognition on the iris image that passed the test.
  • Fig. 1 is a block diagram of an omni-directional iris recognition apparatus according to an embodiment of the present invention
  • Figs. 2 to 5 illustrate acquisition of an image in all directions by a wide field of view device according to the embodiment of the present invention
  • Figs. 6 and 7 illustrate a narrow field of view device according to the embodiment of the present invention
  • Figs. 8 to 12 illustrate various combinations between the wide field of view device and the narrow field of view device according to the embodiment of the present invention
  • Figs. 1 is a block diagram of an omni-directional iris recognition apparatus according to an embodiment of the present invention
  • Figs. 2 to 5 illustrate acquisition of an image in all directions by a wide field of view device according to the embodiment of the present invention
  • Figs. 6 and 7 illustrate a narrow field of view device according to the embodiment of the present invention
  • Figs. 8 to 12 illustrate various combinations between the wide field of view device and the narrow field of view device according to the embodiment of the present invention
  • FIG. 13 to 17 illustrate a method of making the three-dimensional spatial coordinate system of the wide field of view device coincide with the three-dimensional spatial coordinate system of the narrow field of view device according to the embodiment of the present invention
  • Fig. 18 illustrates a method of combining two or more wide field of view devices with each other in order to obtain a three-dimensional space according to the embodiment of the present invention
  • Fig. 19 illustrates a method of detecting the position of a face by a wide field of view camera and of acquiring a face image by a narrow field of view camera to detect the position of eyes
  • Figs. 20 to 22 illustrate states in which the apparatus for recognizing irises using the wide field of view device and the narrow field of view device according to the embodiment of the present invention are used; Figs.
  • Fig. 23 and 24 illustrate states in which the iris recognition apparatus according to the embodiment of the present invention is used for a door;
  • Fig. 25 illustrates a state in which the iris recognition apparatus according to the embodiment of the present invention is used for recognizing the iris of a person who moves from downstairs to upstairs or vise versa;
  • Fig. 26 is a flowchart illustrating iris recognition processes in all directions according to the embodiment of the present invention.
  • FIG. 1 is a block diagram of an omni-directional iris recognition apparatus according to an embodiment of the present invention.
  • a wide field of view device 110 for acquiring an image of a subject through a wide field of view camera 112 for monitoring all directions at 360° and for detecting the face image of a moving person
  • a narrow field of view device 120 including an iris image camera 122 for acquiring iris images from the face image of the person detected by the wide field of view device 110, a controlling portion 130 for selecting a person whose irises are to be recognized from subjects detected by the wide field of view device 110 and for controlling the narrow field of view device 120 so as to acquire the iris images of the person whose irises are to be recognized based on information on the position of the eyes of the person, which is transmitted by the wide field of view device 110, and an iris recognition portion 140 for testing the quality of the iris images acquired by the narrow
  • an omni-directional lens portion 111 for acquiring images of the entire region at 360° in a direction horizontal to the wide field of view camera 112 and for acquiring images of a region in accordance with the shape of a hyperboloidal mirror (or a paraboloidal mirror) in a direction vertical to the wide field of view camera 112, and a wide field of view illuminating portion 113 for illuminating all directions at 360° by visible rays or infrared rays.
  • the narrow field of view device 120 includes an iris image camera 122 for acquiring the iris images of a person whose irises are to be recognized by the control of the controlling portion 130, a zoom/focus lens portion 121 for controlling zoom and focus with respect to the iris of the person whose iris is to be recognized by the control of the controlling portion 130, a pan/tilt unit 124 for rotating the iris image camera 122 up and down/right and left such that the optical axis of the iris image camera 122 faces the irises of the person whose irises are to be recognized by the control of the controlling portion 130, a distance measuring sensor 125 for measuring the distance between the iris image camera 122 and the irises of the person whose irises are to be recognized by the control of the controlling portion 130, and an illuminating portion 123 for radiating infrared rays onto the irises of the person whose irises are to be recognized by the control of the controlling portion 130.
  • Fig. 1 is a block diagram of an omni-directional iris recognition apparatus according to an embodiment of the present invention.
  • the controlling portion 130 controls the omni-directional lens portion 111, the wide field of view camera 112, and the wide field of view illuminating portion 113 of the wide field of view device 110 to monitor subjects in all directions at 360°, controls the zooming/focusing lens portion 121, the iris image camera 122, the infrared rays illuminating portion 123, the pan/tilt unit 124, and the distance measuring sensor 125 of the narrow field of view device 120 to detect the iris images of the person whose irises are to be recognized and to establish the identity of the person having the detected iris images through the iris recognition portion 140.
  • the wide field of view device 110 uses the omni-directional lens portion 111 capable of monitoring a wide range in order to detect the approaches of various people, to detect faces, to monitor the movement of people, to detect the intension of recognition, to select a person whose irises are to be recognized, and to acquire information on the positions of a face and eyes.
  • the omni-directional lens portion 111 is composed of a lens that can acquire images of the entire region at 360° in a horizontal direction and whose range of region that can be acquired is determined in accordance with the shape of the hyperboloidal mirror (or the paraboloidal mirror) 201 in a vertical direction as illustrated in Figs. 2 and 3.
  • the hyperboloidal mirror (or the paraboloidal mirror) 201 reflects the images that exist in all directions at 360° such that the wide field of view camera 112 can acquire the image.
  • a panorama image device that can acquire images in all directions at 360° by combining several narrow field of view cameras 112 with each other and a panorama image device that can acquire images in all directions at 360° by combining several narrow field of view cameras with a planar mirror as illustrated in Figs. 4 and 5 can be used as an omni-directional image acquiring device in the wide field of view device.
  • An illuminating device (not shown) may be attached to the wide field of view device 110 in order to illuminate the entire region in all directions at 360°.
  • Visible rays or infrared rays are used for illumination such that the wide field of view device 110 can operate in a dark place. If the wide field of view device 110 is used indoors, indoor illumination can be used.
  • the controlling portion 130 determines the subject as a person whose irises are to be recognized to detect the face image of the person.
  • the face image of the person whose irises are to be recognized is detected to acquire information on the position of the eyes of the person when the person gazes at the iris image camera 122.
  • the controlling portion 130 controls the angle of view of the narrow field of view device 120 to acquire iris image.
  • the narrow field of view device 120 rotates the pan/tilt unit 124 up and down/right and left in order to make the optical axis of the iris recognizing camera face the irises of the person whose irises are to be recognized based on the information on the position of the eyes of the person whose irises are to be recognized, which is transmitted by the wide field of view device 110.
  • the narrow field of view device 120 includes the zooming/focusing lens portion 121 having a zooming/focusing function for acquiring iris images of a uniform size (a lens having only a focusing function), a camera loaded with an infrared ray transmitting filter, a distance measuring sensor for measuring the distance between the iris image camera 122 and the eyes of the person whose irises are to be recognized (image processing can be used instead of the distance measuring sensor), and a multi- wavelength infrared ray or halogen illuminating device for illuminating the irises.
  • the iris recognizing portion 140 may be included in the narrow field of view device 120 and can be independent of the narrow field of view device 120.
  • the pan/tilt unit 124 of the narrow field of view device 120 has a high speed and precise rotation function for acquiring the iris images of many people in many positions by one camera. Since the sizes of iris images vary with the distance between the iris image camera 122 and the eyes of the person whose irises are to be recognized, a zooming camera may be used in order to acquire iris images of a uniform size.
  • the infrared ray illumination portion 123 uses as infrared ray bandpass illumination (such as an infrared ray light emission diode (LED) and a halogen illumination) in order to acquire iris images without tiring the eyes of the person whose iris is to be recognized.
  • the infrared ray transmitting filter is attached to the iris image camera in the narrow field of view device 120 or, as illustrated in Figs. 8 to 10, when the hyperboloidal mirror (or the paraboloidal mirror) of the omni-directional lens in the wide field of view device is composed of a cold mirror (that transmits infrared rays and that intercepts visible rays) and the camera of the narrow field of view device is provided in the cold mirror in order to remove the influence of a visible ray bandpass and to acquire only the iris images reflected by the infrared ray wavelength bandpass illumination, it is possible to substitute the cold mirror for infrared ray transmitting filter.
  • Figs. 6 and 7 are block diagrams of the narrow field of view device.
  • the narrow field of view device includes the iris image camera (a charge coupled device
  • CCD compact flash camera
  • CMOS complementary metal-oxide semiconductor
  • the operation of the narrow field of view device 120 is activated by the controlling portion 130 when it is determined by the wide field of view device
  • the pan/tilt unit 124 makes the optical axis of the iris image camera 122 in the narrow field of view device 120 face the irises of the person whose irises are to be recognized with the information on the position of the eyes of the person whose irises are to be recognized, which is transmitted by the wide field of view device 110.
  • the iris image camera 122 faces the irises of the person whose irises are to be recognized
  • the distance between the iris image camera 122 and the eyes of the person whose irises are to be recognized is measured by the distance measuring sensor 125 attached to the iris image camera.
  • the zooming camera must be used in order to acquire iris images of the same size or only a variable/fixed focus lens without the zooming lens may be used.
  • the infrared ray illuminating portion 123 is used for illuminating the irises of the person whose irises are to be recognized and the infrared ray bandpass (700nm to 900nm) is used in order to prevent the person whose irises are to be recognized from feeling dazzled.
  • Figs. 8 to 12 illustrate a method of combining the wide field of view device with the narrow field of view device.
  • the hyperboloidal mirror (or the paraboloidal mirror) 201 is composed of the cold mirror such that the narrow field of view device 122 is provided in the hyperboloidal mirror (or the paraboloidal mirror) 201.
  • the cold mirror reflects the visible rays and transmits the infrared ray bandpass.
  • the iris images illuminated by light of the infrared ray bandpass transmits the cold mirror and is input to the iris image camera 122 in the narrow field of view device.
  • the above method is used for coinciding the viewpoint of the wide field of view device with the viewpoint of the narrow field of view device. In the state where one wide field of view device is combined with one narrow field of view device as illustrated in Fig. 13, it is not possible to know the distance between the iris image camera 122 to the eyes of the person whose irises are to be recognized. only by the wide field of view device and the viewpoint of the wide field of view device does not coincide with the viewpoint of the narrow field of view device.
  • the camera of the narrow field of view device may face the eyes of the person whose irises are to be recognized only by the position detected by the wide field of view device.
  • the camera of the narrow field of view device may face the first subject 101 or a second subject 102. As illustrated in Figs.
  • the narrow field of view device is provided in the hyperboloidal mirror (or the paraboloidal mirror) such that the viewpoint of the wide field of view device coincides with the viewpoint of the narrow field of view device.
  • the camera of the narrow field of view device face the eyes of the person whose irises are to be recognized only by the position of the eyes of the person whose irises are to be recognized, which is obtained by one wide field of view device.
  • a planar mirror 203 is provided in the hyperboloidal mirror (or the paraboloidal mirror) 201 in order to coincide the viewpoint of the wide field of view device with the viewpoint of the narrow field of view device and to miniaturize the iris recognizing device and to reduce the weight of the rotating device such that the up and down/right and left rotation can be rapidly performed without vibration.
  • the planar mirror 203 is attached to the pan/tilt unit 124 to reflect the iris images in a desired position and to input the iris images to the iris image camera 122 in the narrow field of view device.
  • it is possible to miniaturize the hyperboloidal mirror (or the paraboloidal mirror) 201 it is possible to reduce the size of the iris recognition device.
  • FIG. 11 illustrates a method of the wide field of view device 110 is separated from the narrow field of view device 120.
  • the narrow field of view device 120 is combined with the lower end of the wide field of view device 110 using the omnidirectional image device that is currently used as illustrated in Figs. 2 to 5 such that iris recognition can be performed in all directions at 360°.
  • a movement range L from the wide field of view device for recognizing the irises of the person whose irises are to be recognized is defined, the initial zoom magnification of the narrow field of view device is determined as the movement range of a user, capable of performing iris recognition, using the difference D between the viewpoint of the wide field of view device and the viewpoint of the narrow field of view device, and the narrow field of view camera is positioned by the position of the eyes of the person whose irises are to be recognized to acquire an initial eye image.
  • Fig. 12 illustrates a method of acquiring three-dimensional information by combining two or more wide field of view devices as illustrated in Fig. 18. According to this method, it is possible to know the distance between each of the wide field of view devices and the eyes of the person whose irises are to be recognized using the relationship between the wide field of view devices.
  • the distance between each of the wide field of view devices and the eyes of the person whose irises are to be recognized is calculated using the difference in the positions of the eyes of the same person with respect to the respective wide field of view devices.
  • FIG. 19 illustrates a method of solving the problem when it is not possible to know the correct position of the eyes of the person whose irises are to be recognized in the case of using a low-resolution camera as the wide field of view camera in the wide field of view device.
  • the position of the face of the person is acquired to obtain the face image of the person by the narrow field of view camera, the position of the eyes of the person is detected from the face image, and zoom and the value of the up and down/right and left rotation of the camera rotating device are corrected to acquire iris images.
  • Figs. 20 and 21 illustrate the structure and the applied field of the iris recognizing device capable of recognizing irises in all directions at 360°.
  • the iris recognizing device can be formed in a pillar 210 and can be attached to a ceiling as illustrated in Fig. 22.
  • the iris recognition device can be attached to a wall.
  • Figs. 23 and 24 illustrate acquisition of the iris images of the people who enter and exit a door according to the embodiment of the present invention. As illustrated in Figs. 23 and 24, it is possible to detect the iris images of a plurality of people that enter the door in various directions by the one omni-directional iris recognition system provided in the door.
  • Fig. 25 is a front view illustrating detection of the iris images of people who are moving from upstairs to downstairs or from downstairs to upstairs.
  • Fig. 19 is a flowchart illustrating processes of recognizing irises in all directions according to the embodiment of the present invention. Processes of monitoring subjects in all directions at 360° and of recognizing the iris images of the person whose iris is to be recognized to establish the identity of the person whose iris is to be recognized will be described as follows. First, the wide field of view illuminating portion 113 and the wide field of view camera 112 of the wide field of view device 110 are activated (SI 10).
  • the wide field of view illuminating portion 113 and the wide field of view illuminating camera 112 are driven to receive peripheral images and to thus monitor a plurality of people (Sill).
  • the controlling portion 130 determines the subject as the person whose irises are to be recognized and detects the face image of the person (SI 12 and The face image of the person is detected to acquire the information on the position of the eyes of the person when the person gazes at the iris image camera 122 (S114 to S116).
  • the controlling portion 130 controls the angle of view of the narrow field of view device 120 to acquire iris images.
  • the narrow field of view device 120 rotates the pan/tilt unit 124 up and down/right and left in order to make the optical axis of the iris image camera 122 face the irises of the person whose irises are to be recognized based on the information on the position of the eyes of the person whose irises are to be recognized, which is transmitted by the wide field of view device 110 (S 121).
  • the distance measuring sensor 125 is driven to detect the distance between the iris image camera 122 and the eyes of the person whose irises are to be recognized (S122).
  • the infrared ray illuminating portion 123 is driven to radiate the infrared rays onto the eyes of the person whose irises are to be recognized (S123).
  • the zooming/focusing lens portion 121 of the iris image camera 122 is driven to automatically control the zoom and the focus in order to acquire the iris images of the person whose irises are to be recognized (SI 24).
  • the information on the position of the eyes of the person whose irises are to be recognized is corrected and the focus is corrected (S125 and S126).
  • iris images are acquired (S127). It is determined whether the acquired iris images can be recognized, that is, the quality of the acquired iris images is determined (S128). When it is determined that the quality of the acquired iris images is no more than a reference value, the process is returned to the zooming/focusing step (SI 24) to acquire iris images again.
  • the identity of the person is established by data obtained after performing iris recognition and it is determined whether the person is an authorized person who is allowed to enter and exits the door or not to monitor the movement of the person (SI 29 to SI 32).
  • the iris recognition method is used among organism recognition methods.
  • the present invention can be introduced to a face recognition system. While this invention has been particularly shown and described with reference to the preferred embodiment thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
  • the apparatus can be provided in public institutions in which security is required such as airports, harbors, city halls, and police stations to authorize people and can be used for fields in which the movements of people are monitored in real time.
  • public institutions such as airports, harbors, city halls, and police stations to authorize people and can be used for fields in which the movements of people are monitored in real time.
  • the apparatus is used for controlling a door, since one iris recognition apparatus can be used for entrance and exit, it is possible to significantly reduce expenses and to monitor whether the person whose irises are to be recognized actually enters the door and whether other unauthorized people enter the door at the same time.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Human Computer Interaction (AREA)
  • Ophthalmology & Optometry (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Artificial Intelligence (AREA)
  • Computing Systems (AREA)
  • Databases & Information Systems (AREA)
  • Evolutionary Computation (AREA)
  • Medical Informatics (AREA)
  • Software Systems (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Image Input (AREA)
  • Measurement Of The Respiration, Hearing Ability, Form, And Blood Characteristics Of Living Organisms (AREA)
  • Studio Devices (AREA)

Abstract

The present invention relates to omni-directional iris recognition method and apparatus. The omni-directional iris recognition apparatus includes a wide field of view device for acquiring the image of a subject by a wide field of view camera for monitoring all directions and for detecting the face image of a moving person, a narrow field of view device including an iris image camera for acquiring iris images from the face image of the person detected by the wide field of view device, controlling means for controlling the wide field of view device to select a person whose irises are to be recognized from acquired subjects and for controlling the narrow field of view device to acquire the iris images of the person based on information on the position of the eyes of the person, which is transmitted by the wide field of view device, and recognizing means for testing the quality of the iris images acquired by the narrow field of view device by the control of the controlling means and for performing iris recognition with respect to the iris images that passed the test.

Description

APPARATUS AND METHOD FOR IRIS RECOGNITION FROM ALL DIRECTION OF VIEW
TECHNICAL FIELD The present invention relates to an iris recognition system, and more particularly to iris recognition method and apparatus in an omni-directional view, capable of monitoring the movements of various users in real time in the 360° omnidirectional view and of simultaneously acquiring iris images for various people to let the people perform iris recognition.
BACKGROUND ART In general, an iris recognition system is divided into an input device for acquiring an iris images and a recognition part for recognizing a person using the acquired iris images. Since the performance of the iris recognition system depends on how fast and correctly the input device acquires clear and clean iris images (that do not include regions reflected by specular reflection or external noise), the iris input device is very important. The input device for acquiring iris images is divided into the following three for convenience sake. 1) Handheld acquisition device: A user acquires iris image with the device in hands. It is cheap. However, since the user must move the device immediately in front of an eye with the device in hands, it takes long to acquire the iris image and it is inconvenient to use the device. 2) Semi-automated acquisition device: A user approaches the iris input device, controls the height of a camera, and gets his or her eye close to the iris camera to acquire iris image. The device is mainly attached to a wall to control entrance and exit or to authorize a user in a personal computer (PC). The semi-automated acquisition device uses a fixed focus lens portion or a variable focus lens portion (or variable zoom/focus lens portion). When the semi-automated acquisition device uses the fixed focus lens portion, in a state where right and left/up and down positions of an eye are adjusted, the distance between the camera and the eyes (the distance Z) is controlled to acquire iris images that are in focus. Thus, when the iris image is out of focus, the user must continuously move his or her head to adjust the distance Z in front of the input device. When the semi-automated acquisition device uses the variable focus lens portion (or the variable zoom/focus lens portion), a user gets his or her eye close to the iris camera and fixes his or her eye to the region of the distance Z where the user can perform iris recognition and the camera performs an automated focusing (or automated zooming/focusing) function to automatically acquire the iris image. 3) Automated acquisition device: A camera automatically detects the face and eyes of a person and rotates up and down/right and left and automatically performs focusing (or zooming/focusing) to automatically acquire the iris image suitable for iris recognition. Since it is not necessary to directly control the height of the camera and to correctly adjust his or her eyes to the iris camera unlike in the handheld or semi- automated acquisition device, it is convenient to use the device. However, since the positions of the face/eyes of the user must be detected, the camera must be rotated up and down/right and left, and focusing (or zooming/focusing) must be automatically performed in order to perform the iris recognition, it takes long to perform the iris recognition. Also, the device is expensive. The device is mainly used for controlling entrance and exit. Among the three devices, the handheld acquisition device and the semi- automated acquisition device need the cooperation of the user (the user must adjust the up and down/right and left positions of his or her eyes or control the height of the camera) in order to acquire iris images. According to the conventional automated acquisition device, since a wide field of view device is composed of one or two or more cameras and common lens portions are used for the cameras, an angle of view is restricted. Thus, the conventional automated acquisition device has a problem in that iris images can be acquired only when the eyes of a user are positioned in a specific range in front of the iris input device like the semi-automated acquisition device. It is necessary for a system for controlling and monitoring entrance and exit to monitor whether only the user who is allowed to enter a place where security is to be guaranteed and who is in the place. According to the conventional iris input devices, since the angle of view at which iris images can be captured is restricted, it is not possible to monitor whether another person who is not allowed to enter the place enters the place when the user who is allowed to enter the place enters the place or whether another person enters the place instead of the user who is allowed to enter the place.
DISCLOSURE OF INVENTION It is an object of the present invention to provide iris recognition method and apparatus in the 360° omni-directional view, capable of monitoring the movements of various users in real time in the omni-directional view using a wide field of view device and of acquiring iris images of a person whose irises are to be recognized using a narrow field of view device to perform iris recognition. It is another object of the present invention to provide iris recognition method and apparatus in the omni-directional view, capable of monitoring the movements of various users and entrance and exit of people who are allowed or are not allowed to enter in real time in the 360° omni-directional view. To achieve the objects of the present invention, there is provided iris recognition method and apparatus in the omni-directional view, comprising a first step of acquiring an image of a subject through a wide field of view camera included in a wide field of view device for monitoring all directions in a subject monitoring space, a second step of, when the movement of a subject acquired by the wide field of view camera is detected, determining that the subject as a person whose irises are to be recognized and of detecting the face image of the person, a third step of detecting the face image of the person and of acquiring information on the position of the eyes of the person, a fourth step of, when the position of the eyes of the person is detected, moving the optical axis of the narrow field of view camera for capturing the iris image to the position of the eyes of the person, a fifth step of controlling the zoom and the focus of the iris image camera in accordance with the position of the eyes of the person, a sixth step of correcting the information on the position of the eyes of the person and the focus of the iris image camera to acquire iris image, and a seventh step of, when it is determined that the quality of the iris image acquired by the iris image camera is no less than a certain reference, determining the acquired iris image as an iris image desired to be acquired. There is also provided an omni-directional iris recognition apparatus, comprising a wide field of view device for acquiring the image of a subject by a wide field of view camera for monitoring all directions and for detecting the face image of a moving person, a narrow field of view device including an iris image camera for acquiring iris image from the face image of the person detected by the wide field of view device, controlling means for controlling the wide field of view device to select a person whose irises are to be recognized from acquired subjects and for controlling the narrow field of view device to acquire the iris images of the person based on information on the position of the eyes of the person, which is transmitted by the wide field of view device, and recognizing means for testing the quality of the iris images acquired by the narrow field of view by the control of the controlling means and for performing iris recognition on the iris image that passed the test.
BRIEF DESCRIPTION OF THE DRAWINGS The objectives and advantages of the present invention will be more clearly understood with reference to accompanying drawings and detailed description of the preferred embodiment below. Fig. 1 is a block diagram of an omni-directional iris recognition apparatus according to an embodiment of the present invention; Figs. 2 to 5 illustrate acquisition of an image in all directions by a wide field of view device according to the embodiment of the present invention; Figs. 6 and 7 illustrate a narrow field of view device according to the embodiment of the present invention. Figs. 8 to 12 illustrate various combinations between the wide field of view device and the narrow field of view device according to the embodiment of the present invention; Figs. 13 to 17 illustrate a method of making the three-dimensional spatial coordinate system of the wide field of view device coincide with the three-dimensional spatial coordinate system of the narrow field of view device according to the embodiment of the present invention; Fig. 18 illustrates a method of combining two or more wide field of view devices with each other in order to obtain a three-dimensional space according to the embodiment of the present invention; Fig. 19 illustrates a method of detecting the position of a face by a wide field of view camera and of acquiring a face image by a narrow field of view camera to detect the position of eyes; Figs. 20 to 22 illustrate states in which the apparatus for recognizing irises using the wide field of view device and the narrow field of view device according to the embodiment of the present invention are used; Figs. 23 and 24 illustrate states in which the iris recognition apparatus according to the embodiment of the present invention is used for a door; Fig. 25 illustrates a state in which the iris recognition apparatus according to the embodiment of the present invention is used for recognizing the iris of a person who moves from downstairs to upstairs or vise versa; and Fig. 26 is a flowchart illustrating iris recognition processes in all directions according to the embodiment of the present invention.
BEST MODE FOR CARRYING OUT THE INVENTION The structure and operation of the present invention will be illustrated in detail with reference to the attached drawings. Fig. 1 is a block diagram of an omni-directional iris recognition apparatus according to an embodiment of the present invention. A wide field of view device 110 for acquiring an image of a subject through a wide field of view camera 112 for monitoring all directions at 360° and for detecting the face image of a moving person, a narrow field of view device 120 including an iris image camera 122 for acquiring iris images from the face image of the person detected by the wide field of view device 110, a controlling portion 130 for selecting a person whose irises are to be recognized from subjects detected by the wide field of view device 110 and for controlling the narrow field of view device 120 so as to acquire the iris images of the person whose irises are to be recognized based on information on the position of the eyes of the person, which is transmitted by the wide field of view device 110, and an iris recognition portion 140 for testing the quality of the iris images acquired by the narrow field of view device 120 by the control of the controlling portion 130 and for performing iris recognition with respect to the iris image that passed the test. Here, the wide field of view device 110 includes the wide field of view camera
112, an omni-directional lens portion 111 for acquiring images of the entire region at 360° in a direction horizontal to the wide field of view camera 112 and for acquiring images of a region in accordance with the shape of a hyperboloidal mirror (or a paraboloidal mirror) in a direction vertical to the wide field of view camera 112, and a wide field of view illuminating portion 113 for illuminating all directions at 360° by visible rays or infrared rays. The narrow field of view device 120 includes an iris image camera 122 for acquiring the iris images of a person whose irises are to be recognized by the control of the controlling portion 130, a zoom/focus lens portion 121 for controlling zoom and focus with respect to the iris of the person whose iris is to be recognized by the control of the controlling portion 130, a pan/tilt unit 124 for rotating the iris image camera 122 up and down/right and left such that the optical axis of the iris image camera 122 faces the irises of the person whose irises are to be recognized by the control of the controlling portion 130, a distance measuring sensor 125 for measuring the distance between the iris image camera 122 and the irises of the person whose irises are to be recognized by the control of the controlling portion 130, and an illuminating portion 123 for radiating infrared rays onto the irises of the person whose irises are to be recognized by the control of the controlling portion 130. The operation of the iris recognition apparatus according to the embodiment of the present invention of the above structure will be described in detail with reference to Figs. 1 to 10. First, according to the present invention, subjects in the 360° omni-directional view are detected by the wide field of view device and the iris images of a person whose irises are to be recognized is acquired by the narrow field of view device to recognize the acquired iris images and to thus establish the identity of the person having the acquired iris image. Fig. 1 is a block diagram of an omni-directional iris recognition apparatus according to an embodiment of the present invention. The controlling portion 130 controls the omni-directional lens portion 111, the wide field of view camera 112, and the wide field of view illuminating portion 113 of the wide field of view device 110 to monitor subjects in all directions at 360°, controls the zooming/focusing lens portion 121, the iris image camera 122, the infrared rays illuminating portion 123, the pan/tilt unit 124, and the distance measuring sensor 125 of the narrow field of view device 120 to detect the iris images of the person whose irises are to be recognized and to establish the identity of the person having the detected iris images through the iris recognition portion 140. The wide field of view device 110 uses the omni-directional lens portion 111 capable of monitoring a wide range in order to detect the approaches of various people, to detect faces, to monitor the movement of people, to detect the intension of recognition, to select a person whose irises are to be recognized, and to acquire information on the positions of a face and eyes. The omni-directional lens portion 111 is composed of a lens that can acquire images of the entire region at 360° in a horizontal direction and whose range of region that can be acquired is determined in accordance with the shape of the hyperboloidal mirror (or the paraboloidal mirror) 201 in a vertical direction as illustrated in Figs. 2 and 3. That is, the hyperboloidal mirror (or the paraboloidal mirror) 201 reflects the images that exist in all directions at 360° such that the wide field of view camera 112 can acquire the image. Here, it is possible to control the range in which images can be acquired in a vertical direction by changing the shapes of a hyperboloid and a paraboloidal. That is, it is possible to control the angle of view of the omni-directional camera in a vertical direction by changing the shapes of the hyperboloid and the paraboloidal. Also, it is possible to reflect the images reflected by the hyperboloidal mirror (or the paraboloidal mirror) 201 again by the hyperboloidal mirror (or the paraboloidal mirror) 201 as illustrated in Fig. 3 such that the omni-directional camera in the hyperboloidal mirror (or the paraboloidal mirror) 20 lean acquire the images. Other than the hyperboloidal mirror (or the paraboloidal mirror) as illustrated in Figs. 2 and 3, a panorama image device that can acquire images in all directions at 360° by combining several narrow field of view cameras 112 with each other and a panorama image device that can acquire images in all directions at 360° by combining several narrow field of view cameras with a planar mirror as illustrated in Figs. 4 and 5 can be used as an omni-directional image acquiring device in the wide field of view device. An illuminating device (not shown) may be attached to the wide field of view device 110 in order to illuminate the entire region in all directions at 360°. Visible rays or infrared rays are used for illumination such that the wide field of view device 110 can operate in a dark place. If the wide field of view device 110 is used indoors, indoor illumination can be used. When the movement of a subject, which is received by the wide field of view device 110, is detected, the controlling portion 130 determines the subject as a person whose irises are to be recognized to detect the face image of the person. The face image of the person whose irises are to be recognized is detected to acquire information on the position of the eyes of the person when the person gazes at the iris image camera 122. When the information on the position of the eyes of the person is acquired, the controlling portion 130 controls the angle of view of the narrow field of view device 120 to acquire iris image. The narrow field of view device 120 rotates the pan/tilt unit 124 up and down/right and left in order to make the optical axis of the iris recognizing camera face the irises of the person whose irises are to be recognized based on the information on the position of the eyes of the person whose irises are to be recognized, which is transmitted by the wide field of view device 110. The narrow field of view device 120 includes the zooming/focusing lens portion 121 having a zooming/focusing function for acquiring iris images of a uniform size (a lens having only a focusing function), a camera loaded with an infrared ray transmitting filter, a distance measuring sensor for measuring the distance between the iris image camera 122 and the eyes of the person whose irises are to be recognized (image processing can be used instead of the distance measuring sensor), and a multi- wavelength infrared ray or halogen illuminating device for illuminating the irises. The iris recognizing portion 140 may be included in the narrow field of view device 120 and can be independent of the narrow field of view device 120. The pan/tilt unit 124 of the narrow field of view device 120 has a high speed and precise rotation function for acquiring the iris images of many people in many positions by one camera. Since the sizes of iris images vary with the distance between the iris image camera 122 and the eyes of the person whose irises are to be recognized, a zooming camera may be used in order to acquire iris images of a uniform size. The infrared ray illumination portion 123 uses as infrared ray bandpass illumination (such as an infrared ray light emission diode (LED) and a halogen illumination) in order to acquire iris images without tiring the eyes of the person whose iris is to be recognized. When the infrared ray transmitting filter is attached to the iris image camera in the narrow field of view device 120 or, as illustrated in Figs. 8 to 10, when the hyperboloidal mirror (or the paraboloidal mirror) of the omni-directional lens in the wide field of view device is composed of a cold mirror (that transmits infrared rays and that intercepts visible rays) and the camera of the narrow field of view device is provided in the cold mirror in order to remove the influence of a visible ray bandpass and to acquire only the iris images reflected by the infrared ray wavelength bandpass illumination, it is possible to substitute the cold mirror for infrared ray transmitting filter. Figs. 6 and 7 are block diagrams of the narrow field of view device. The narrow field of view device includes the iris image camera (a charge coupled device
(CCD) camera or a complementary metal-oxide semiconductor (CMOS) camera may be used) 122, the zooming/focusing lens portion (or the focusing lens) 121, the pan/tilt unit
124 for rotating the iris image camera 122 up and down/right and left, the distance measuring sensor 125, the infrared ray illuminating portion 123, and the infrared ray transmitting filter. The operation of the narrow field of view device 120 is activated by the controlling portion 130 when it is determined by the wide field of view device
110 that the person whose irises are to be recognized has intention to perform iris recognition. The pan/tilt unit 124 makes the optical axis of the iris image camera 122 in the narrow field of view device 120 face the irises of the person whose irises are to be recognized with the information on the position of the eyes of the person whose irises are to be recognized, which is transmitted by the wide field of view device 110. When the iris image camera 122 faces the irises of the person whose irises are to be recognized, the distance between the iris image camera 122 and the eyes of the person whose irises are to be recognized is measured by the distance measuring sensor 125 attached to the iris image camera. It is possible to measure the distance between the iris image camera 122 and the eyes of the person whose irises are to be recognized without using the distance measuring sensor 125 by an image processing method (the horizontal or vertical size of the face of the person whose irises are to be recognized and the distance between the two eyes of the person whose irises are to be recognized). Since the distance between the iris image camera 122 that acquires the iris image and the eyes of the person whose iris is to be recognized varies with each person whose iris is to be recognized, the zooming camera must be used in order to acquire iris images of the same size or only a variable/fixed focus lens without the zooming lens may be used. The infrared ray illuminating portion 123 is used for illuminating the irises of the person whose irises are to be recognized and the infrared ray bandpass (700nm to 900nm) is used in order to prevent the person whose irises are to be recognized from feeling dazzled. Figs. 8 to 12 illustrate a method of combining the wide field of view device with the narrow field of view device. In Figs. 8 to 10, the hyperboloidal mirror (or the paraboloidal mirror) 201 is composed of the cold mirror such that the narrow field of view device 122 is provided in the hyperboloidal mirror (or the paraboloidal mirror) 201. Here, the cold mirror reflects the visible rays and transmits the infrared ray bandpass. Thus, the iris images illuminated by light of the infrared ray bandpass transmits the cold mirror and is input to the iris image camera 122 in the narrow field of view device. The above method is used for coinciding the viewpoint of the wide field of view device with the viewpoint of the narrow field of view device. In the state where one wide field of view device is combined with one narrow field of view device as illustrated in Fig. 13, it is not possible to know the distance between the iris image camera 122 to the eyes of the person whose irises are to be recognized. only by the wide field of view device and the viewpoint of the wide field of view device does not coincide with the viewpoint of the narrow field of view device. Thus, it is not possible to make the camera of the narrow field of view device face the eyes of the person whose irises are to be recognized only by the position detected by the wide field of view device. For example, as illustrated in Fig. 13, since it is possible to know the direction of the eyes of a first subject 101 but it is not possible to know the information on the distance between the iris image camera 122 and the eyes of the first subject 101 by the wide field of view device, the camera of the narrow field of view device may face the first subject 101 or a second subject 102. As illustrated in Figs. 14 to 16, since the viewpoint of the wide field of view device is provided in the hyperboloidal mirror (or the paraboloidal mirror), the narrow field of view device is provided in the hyperboloidal mirror (or the paraboloidal mirror) such that the viewpoint of the wide field of view device coincides with the viewpoint of the narrow field of view device. Thus, as illustrated in Figs. 14 to 16, it is possible to make the camera of the narrow field of view device face the eyes of the person whose irises are to be recognized only by the position of the eyes of the person whose irises are to be recognized, which is obtained by one wide field of view device. In Figs. 9 and 10, a planar mirror 203 is provided in the hyperboloidal mirror (or the paraboloidal mirror) 201 in order to coincide the viewpoint of the wide field of view device with the viewpoint of the narrow field of view device and to miniaturize the iris recognizing device and to reduce the weight of the rotating device such that the up and down/right and left rotation can be rapidly performed without vibration. The planar mirror 203 is attached to the pan/tilt unit 124 to reflect the iris images in a desired position and to input the iris images to the iris image camera 122 in the narrow field of view device. At this time, since it is possible to miniaturize the hyperboloidal mirror (or the paraboloidal mirror) 201, it is possible to reduce the size of the iris recognition device. Fig. 11 illustrates a method of the wide field of view device 110 is separated from the narrow field of view device 120. The narrow field of view device 120 is combined with the lower end of the wide field of view device 110 using the omnidirectional image device that is currently used as illustrated in Figs. 2 to 5 such that iris recognition can be performed in all directions at 360°. At this time, since it is not possible to know the distance between the wide field of view device and the eyes of the person whose irises are to be recognized, a movement range L from the wide field of view device for recognizing the irises of the person whose irises are to be recognized is defined, the initial zoom magnification of the narrow field of view device is determined as the movement range of a user, capable of performing iris recognition, using the difference D between the viewpoint of the wide field of view device and the viewpoint of the narrow field of view device, and the narrow field of view camera is positioned by the position of the eyes of the person whose irises are to be recognized to acquire an initial eye image. Then, the zoom magnification and the amount of the up and down/right and left rotation of the camera rotating device are calculated by the size and the position of the irises of the person whose irises are to be recognized from the initial eye image such that the irises are positioned in the center of the image and that the irises have a uniform size to obtain iris images. Fig. 12 illustrates a method of acquiring three-dimensional information by combining two or more wide field of view devices as illustrated in Fig. 18. According to this method, it is possible to know the distance between each of the wide field of view devices and the eyes of the person whose irises are to be recognized using the relationship between the wide field of view devices. The distance between each of the wide field of view devices and the eyes of the person whose irises are to be recognized is calculated using the difference in the positions of the eyes of the same person with respect to the respective wide field of view devices. Thus, when two or more wide field of view devices are combined with each other as illustrated in Fig. 18, it is possible to acquire the iris images of the person whose irises are to be recognized by positioning the narrow field of view device in an arbitrary position without making the viewpoint of the wide field of view device coincide with the viewpoint of the narrow field of view device. Fig. 19 illustrates a method of solving the problem when it is not possible to know the correct position of the eyes of the person whose irises are to be recognized in the case of using a low-resolution camera as the wide field of view camera in the wide field of view device. In resolution where the position of the eyes of the person whose irises are to be recognized, the position of the face of the person is acquired to obtain the face image of the person by the narrow field of view camera, the position of the eyes of the person is detected from the face image, and zoom and the value of the up and down/right and left rotation of the camera rotating device are corrected to acquire iris images. Figs. 20 and 21 illustrate the structure and the applied field of the iris recognizing device capable of recognizing irises in all directions at 360°. The iris recognizing device can be formed in a pillar 210 and can be attached to a ceiling as illustrated in Fig. 22. The iris recognition device can be attached to a wall. Figs. 23 and 24 illustrate acquisition of the iris images of the people who enter and exit a door according to the embodiment of the present invention. As illustrated in Figs. 23 and 24, it is possible to detect the iris images of a plurality of people that enter the door in various directions by the one omni-directional iris recognition system provided in the door. Fig. 25 is a front view illustrating detection of the iris images of people who are moving from upstairs to downstairs or from downstairs to upstairs. The iris images of the people who are moving from upstairs to downstairs or from downstairs to upstairs can be acquired by the omni-directional iris recognition systems provided in the upstairs and the downstairs, respectively. Fig. 19 is a flowchart illustrating processes of recognizing irises in all directions according to the embodiment of the present invention. Processes of monitoring subjects in all directions at 360° and of recognizing the iris images of the person whose iris is to be recognized to establish the identity of the person whose iris is to be recognized will be described as follows. First, the wide field of view illuminating portion 113 and the wide field of view camera 112 of the wide field of view device 110 are activated (SI 10). The wide field of view illuminating portion 113 and the wide field of view illuminating camera 112 are driven to receive peripheral images and to thus monitor a plurality of people (Sill). When the movement of a subject, which is received by the wide field of view device 110, is detected, the controlling portion 130 determines the subject as the person whose irises are to be recognized and detects the face image of the person (SI 12 and The face image of the person is detected to acquire the information on the position of the eyes of the person when the person gazes at the iris image camera 122 (S114 to S116). When the information on the position of the eyes of the person is acquired, the controlling portion 130 controls the angle of view of the narrow field of view device 120 to acquire iris images. That is, the narrow field of view device 120 rotates the pan/tilt unit 124 up and down/right and left in order to make the optical axis of the iris image camera 122 face the irises of the person whose irises are to be recognized based on the information on the position of the eyes of the person whose irises are to be recognized, which is transmitted by the wide field of view device 110 (S 121). The distance measuring sensor 125 is driven to detect the distance between the iris image camera 122 and the eyes of the person whose irises are to be recognized (S122). The infrared ray illuminating portion 123 is driven to radiate the infrared rays onto the eyes of the person whose irises are to be recognized (S123). The zooming/focusing lens portion 121 of the iris image camera 122 is driven to automatically control the zoom and the focus in order to acquire the iris images of the person whose irises are to be recognized (SI 24). The information on the position of the eyes of the person whose irises are to be recognized is corrected and the focus is corrected (S125 and S126). After correcting the focus, iris images are acquired (S127). It is determined whether the acquired iris images can be recognized, that is, the quality of the acquired iris images is determined (S128). When it is determined that the quality of the acquired iris images is no more than a reference value, the process is returned to the zooming/focusing step (SI 24) to acquire iris images again. When the quality of the acquired iris images is no less than the reference value, the identity of the person is established by data obtained after performing iris recognition and it is determined whether the person is an authorized person who is allowed to enter and exits the door or not to monitor the movement of the person (SI 29 to SI 32). According to the present invention, the iris recognition method is used among organism recognition methods. However, since it is possible to acquire a face image instead of iris images by the narrow field of view device, the present invention can be introduced to a face recognition system. While this invention has been particularly shown and described with reference to the preferred embodiment thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the invention as defined by the appended claims.
INDUSTRIAL APLICABILITY As described above, according to the omni-directional method and apparatus of the present invention, since the range in which subjects can be recognized is wide over all directions, the apparatus can be provided in public institutions in which security is required such as airports, harbors, city halls, and police stations to authorize people and can be used for fields in which the movements of people are monitored in real time. When the apparatus is used for controlling a door, since one iris recognition apparatus can be used for entrance and exit, it is possible to significantly reduce expenses and to monitor whether the person whose irises are to be recognized actually enters the door and whether other unauthorized people enter the door at the same time.

Claims

WHAT IS CLAIMED IS: 1. An omni-directional iris recognition method, comprising: a first step of acquiring an image of a subject through a wide field of view camera included in a wide field of view device for monitoring all directions in a subject monitoring space; a second step of, when the movement of a subject acquired by the wide field of view camera is detected, determining that the subject as a person whose irises are to be recognized and of detecting the' face image of the person; a third step of detecting the face image of the person and of acquiring information on the position of the eyes of the person; a fourth step of, when the position of the eyes of the person is detected, moving the optical axis of the iris image camera included in the narrow field of view device to the position of the eyes of the person; a fifth step of controlling the zoom and the focus of the iris image camera in accordance with the position of the eyes of the person; a sixth step of correcting the information on the position of the eyes of the person and the focus of the iris image camera to acquire iris fmages; and a seventh step of, when it is determined that the quality of the iris images acquired by the iris image camera is no less than a certain reference, determining the acquired iris images as iris images.
2. The omni-directional iris recognition method according to claim 1, wherein, in the fourth step, the optical axis of the iris image camera is made the same as the optical axis of the wide field of view camera to move the optical axis of the iris image camera to the position of the eyes of the person.
3. The omni-directional iris recognition method according to claim 1, wherein, in the fifth step, the distance between the iris image camera and the eyes of the person whose irises are to be recognized is measured by a distance measuring sensor using infrared rays or a distance measuring method using image processing.
4. The omni-directional iris recognition method according to claim 1, further comprising the step of radiating light in an infrared ray bandpass onto the irises of the person in order to acquire the iris images in addition to the fifth step.
5. An omni-directional iris recognition apparatus, comprising: a wide field of view device for acquiring the image of a subject by a wide field of view camera for monitoring all directions and for detecting the face image of a moving person; a narrow field of view device including an iris image camera for acquiring iris images from the face image of the person detected by the wide field of view device; controlling means for controlling the wide field of view device to select a person whose irises are to be recognized from acquired subjects and for controlling the narrow field of view device to acquire the iris images of the person based on information on the position of the eyes of the person, which is transmitted by the wide field of view device; and recognizing means for testing the quality of the iris images acquired by the narrow field of view device by the control of the controlling means and for performing iris recognition with respect to the iris images that passed the test.
6. The omni-directional iris recognition apparatus according to claim 5, further comprising a wide field of view illuminating portion for illuminating all directions by visible rays or infrared rays in addition to the wide field of view device.
7. The omni-directional iris recognition apparatus according to claim 6, wherein the wide field of view camera comprises an omni-directional lens portion for acquiring images of an entire region in a direction horizontal to the wide field of view camera and for acquiring images of a region in accordance with the shape of a hyperboloidal mirror (or a paraboloidal mirror) in a direction vertical to the wide field of view camera.
8. The omni-directional iris recognition apparatus according to claim 6, wherein the wide field of view camera comprises an omni-directional lens portion for acquiring images of an entire region in a direction horizontal to the wide field of view camera and for acquiring images of a region in accordance with the shape of a parabolidal mirror in a direction vertical to the wide field of view camera.
9. The omni-directional iris recognition apparatus according to claim 5, wherein the wide field of view camera is formed by combining one or more cameras with each other so as to expand an image acquiring region.
10. The omni-directional iris recognition apparatus according to claim 5, wherein the narrow field of view device comprises: an iris image camera for acquiring the iris images of a person whose irises are to be recognized by the control of the controlling means; a zooming/focusing lens portion for controlling the zoom and the focus of the irises of the person by the control of the controlling means; a pan/tilt unit for rotating the iris image camera up and down/right and left such that the optical axis of the iris image camera faces the irises of the person by the control of the controlling means; a distance measuring sensor for measuring the distance between the iris image camera and the irises of the person by the control of the controlling means; and an infrared ray illuminating portion for radiating infrared rays onto the irises of the person by the control of the controlling means.
11. The omni-directional iris recognition apparatus according to claim 10, wherein the distance measuring sensor is attached to an upper side of the iris image camera, and wherein the infrared ray illuminating portions are attached to the right and left sides of the iris image camera, respectively.
12. An omni-directional iris recognition apparatus, comprising: a hyperboloidal mirror fixed to an upper side of a space to be omni- directionally monitored such that a paraboloidal side faces downward; a narrow field of view device attached to the inside of the hyperboloidal mirror so as to detect the iris images of the person whose irises are to be recognized; and a wide field of view camera separated from the lower end of the hyperboloidal mirror by a predetermined distance and including a wide field of view lens portion facing the hyperboloidal mirror.
13. The omni-directional iris recognition apparatus according to claim 12, wherein the hyperboloidal mirror is a cold mirror in the form of the hyperboloidal mirror that transmits an infrared ray bandpass and reflects visible rays.
14. An omni-directional iris recognition apparatus, comprising: a hyperboloidal mirror fixed to an upper side of a space to be omnidirectionally monitored such that a paraboloidal side faces downward; a narrow field of view device attached to the external upper portion of the hyperboloidal mirror and including the zooming/focusing lens portion of an iris image camera , which is facing the inside of the hyperboloidal mirror; an iris image mirror for reflecting images of an infrared ray bandpass from the outside of the hyperboloidal mirror to the zooming/focusing lens portion; and a wide field of view camera separated from the lower end of the hyperboloidal mirror by a predetermined distance and including a wide field of view lens portion facing the hyperboloidal mirror.
15. The omni-directional iris recognition apparatus according to claim 14, wherein the hyperboloidal mirror is a cold mirror in the form of the hyperboloidal mirror that transmits an infrared ray bandpass and reflects visible rays
16. An omni-directional iris recognition apparatus, comprising: a paraboloidal mirror fixed to an upper side of a space to be monitored in all directions such that a parabola faces downward; a narrow field of view device attached to the inside of the paraboloidal mirror so as to detect the iris images of the person whose irises are to be recognized; and a wide field of view camera separated from the lower end of the paraboloidal mirror by a predetermined distance such that a wide view lens portion faces the paraboloidal mirror.
17. The omni-directional iris recognition apparatus according to claim 16, wherein the paraboloidal mirror is a cold mirror in the form of the paraboloidal mirror that transmits an infrared ray bandpass and reflects visible rays.
18. An omni-directional iris recognition apparatus, comprising: a paraboloidal mirror fixed to an upper side of a space to be monitored in all directions such that a parabola faces downward; a narrow field of view device attached to the external upper portion of the paraboloidal mirror such that the zooming/focusing lens portion of an iris image camera faces the inside of the paraboloidal mirror; an iris image mirror for reflecting images of an infrared ray bandpass from the outside of the paraboloidal mirror to the zooming/focusing lens portion; and a wide field of view camera separated from the lower end of the paraboloidal mirror by a predetermined distance such that a wide view lens portion faces the paraboloidal mirror.
19. The omni-directional iris recognition apparatus according to claim 18, wherein the paraboloidal mirror is a cold mirror in the form of the paraboloidal mirror that transmits an infrared ray bandpass and reflects visible rays.
PCT/KR2004/001793 2003-07-18 2004-07-19 Apparatus and method for iris recognition from all direction of view Ceased WO2005008567A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2003-0048984 2003-07-18
KR20030048984 2003-07-18

Publications (1)

Publication Number Publication Date
WO2005008567A1 true WO2005008567A1 (en) 2005-01-27

Family

ID=34074868

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2004/001793 Ceased WO2005008567A1 (en) 2003-07-18 2004-07-19 Apparatus and method for iris recognition from all direction of view

Country Status (2)

Country Link
KR (1) KR100587422B1 (en)
WO (1) WO2005008567A1 (en)

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007101276A1 (en) * 2006-03-03 2007-09-07 Honeywell International, Inc. Single lens splitter camera
WO2007103833A1 (en) * 2006-03-03 2007-09-13 Honeywell International, Inc. A combined face and iris recognition system
WO2008124382A1 (en) * 2007-04-03 2008-10-16 Honeywell International Inc. Agile illumination for biometric authentication
WO2008131201A1 (en) * 2007-04-19 2008-10-30 Global Rainmakers, Inc. Method and system for biometric recognition
WO2008154637A1 (en) * 2007-06-14 2008-12-18 Cubic Corporation Eye detection system
US7593550B2 (en) 2005-01-26 2009-09-22 Honeywell International Inc. Distance iris recognition
US20090274345A1 (en) * 2006-09-22 2009-11-05 Hanna Keith J Compact Biometric Acquisition System and Method
EP2062197A4 (en) * 2006-09-15 2010-10-06 Retica Systems Inc Long distance multimodal biometric system and method
US8121356B2 (en) 2006-09-15 2012-02-21 Identix Incorporated Long distance multimodal biometric system and method
WO2013028700A3 (en) * 2011-08-22 2013-05-10 Eyelock Inc. Systems and methods for capturing artifact free images
CN103605965A (en) * 2013-11-25 2014-02-26 苏州大学 Multi-pose face recognition method and device
US8705808B2 (en) 2003-09-05 2014-04-22 Honeywell International Inc. Combined face and iris recognition system
US8953849B2 (en) 2007-04-19 2015-02-10 Eyelock, Inc. Method and system for biometric recognition
CN104883548A (en) * 2015-06-16 2015-09-02 金鹏电子信息机器有限公司 Monitoring-video face-capturing processing method and system
CN106778713A (en) * 2017-03-01 2017-05-31 武汉虹识技术有限公司 The iris identification device and method of a kind of dynamic human eye tracking
CN109117692A (en) * 2017-06-23 2019-01-01 上海荆虹电子科技有限公司 A kind of iris identification device, system and method
CN109389018A (en) * 2017-08-14 2019-02-26 杭州海康威视数字技术股份有限公司 A kind of facial angle recognition methods, device and equipment
WO2023079862A1 (en) * 2021-11-05 2023-05-11 パナソニックＩｐマネジメント株式会社 Imaging system, processing device, and method executed by computer in imaging system

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101004629B1 (en) * 2009-02-06 2011-01-03 연세대학교 산학협력단 Non-compressive 3D face data acquisition system and method
CN106663187B (en) * 2014-07-09 2020-11-06 三星电子株式会社 Method and apparatus for identifying biometric information
KR101636895B1 (en) * 2014-12-30 2016-07-06 주식회사 펀진 Pupil Tracking System
KR101968101B1 (en) * 2018-07-12 2019-04-11 천재두 Object recognition camera module and object recognition system thereof

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5365597A (en) * 1993-06-11 1994-11-15 United Parcel Service Of America, Inc. Method and apparatus for passive autoranging using relaxation
US5572596A (en) * 1994-09-02 1996-11-05 David Sarnoff Research Center, Inc. Automated, non-invasive iris recognition system and method
JP2000011163A (en) * 1998-06-18 2000-01-14 Matsushita Electric Ind Co Ltd Iris imaging apparatus and iris imaging method thereof
KR200240864Y1 (en) * 2001-04-26 2001-10-12 (주)비이케이엔지니어링 A surveillance camera for monitoring in every direction using a media of the optical angle and multi-montoring device using a tracking type of the camera
KR20020028406A (en) * 2000-10-09 2002-04-17 정인수 Iris image acquisition device and iris recognition method with high recognition rates

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5365597A (en) * 1993-06-11 1994-11-15 United Parcel Service Of America, Inc. Method and apparatus for passive autoranging using relaxation
US5572596A (en) * 1994-09-02 1996-11-05 David Sarnoff Research Center, Inc. Automated, non-invasive iris recognition system and method
JP2000011163A (en) * 1998-06-18 2000-01-14 Matsushita Electric Ind Co Ltd Iris imaging apparatus and iris imaging method thereof
KR20020028406A (en) * 2000-10-09 2002-04-17 정인수 Iris image acquisition device and iris recognition method with high recognition rates
KR200240864Y1 (en) * 2001-04-26 2001-10-12 (주)비이케이엔지니어링 A surveillance camera for monitoring in every direction using a media of the optical angle and multi-montoring device using a tracking type of the camera

Cited By (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8705808B2 (en) 2003-09-05 2014-04-22 Honeywell International Inc. Combined face and iris recognition system
US7593550B2 (en) 2005-01-26 2009-09-22 Honeywell International Inc. Distance iris recognition
AU2007223336B2 (en) * 2006-03-03 2011-03-10 Honeywell International, Inc. A combined face and iris recognition system
WO2007103833A1 (en) * 2006-03-03 2007-09-13 Honeywell International, Inc. A combined face and iris recognition system
GB2448653A (en) * 2006-03-03 2008-10-22 Honeywell Int Inc Single lens splitter camera
WO2007101276A1 (en) * 2006-03-03 2007-09-07 Honeywell International, Inc. Single lens splitter camera
GB2450022A (en) * 2006-03-03 2008-12-10 Honeywell Int Inc A combined face and iris recognition system
GB2450022B (en) * 2006-03-03 2011-10-19 Honeywell Int Inc A combined face and iris recognition system
US7933507B2 (en) 2006-03-03 2011-04-26 Honeywell International Inc. Single lens splitter camera
GB2448653B (en) * 2006-03-03 2011-03-23 Honeywell Int Inc Single lens splitter camera
US8577093B2 (en) 2006-09-15 2013-11-05 Identix Incorporated Long distance multimodal biometric system and method
US8121356B2 (en) 2006-09-15 2012-02-21 Identix Incorporated Long distance multimodal biometric system and method
EP2062197A4 (en) * 2006-09-15 2010-10-06 Retica Systems Inc Long distance multimodal biometric system and method
US8433103B2 (en) 2006-09-15 2013-04-30 Identix Incorporated Long distance multimodal biometric system and method
US9984290B2 (en) 2006-09-22 2018-05-29 Eyelock Llc Compact biometric acquisition system and method
US20090274345A1 (en) * 2006-09-22 2009-11-05 Hanna Keith J Compact Biometric Acquisition System and Method
US9626562B2 (en) 2006-09-22 2017-04-18 Eyelock, Llc Compact biometric acquisition system and method
US8965063B2 (en) * 2006-09-22 2015-02-24 Eyelock, Inc. Compact biometric acquisition system and method
GB2462018A (en) * 2007-04-03 2010-01-27 Honeywell Int Inc Agile illumination for biometric authentication
GB2462018B (en) * 2007-04-03 2012-01-11 Honeywell Int Inc Agile illumination for biometric authentication
WO2008124382A1 (en) * 2007-04-03 2008-10-16 Honeywell International Inc. Agile illumination for biometric authentication
US10395097B2 (en) 2007-04-19 2019-08-27 Eyelock Llc Method and system for biometric recognition
WO2008131201A1 (en) * 2007-04-19 2008-10-30 Global Rainmakers, Inc. Method and system for biometric recognition
US8953849B2 (en) 2007-04-19 2015-02-10 Eyelock, Inc. Method and system for biometric recognition
US9646217B2 (en) 2007-04-19 2017-05-09 Eyelock Llc Method and system for biometric recognition
US9959478B2 (en) 2007-04-19 2018-05-01 Eyelock Llc Method and system for biometric recognition
US8351659B2 (en) 2007-06-14 2013-01-08 Cubic Corporation Eye detection system
WO2008154637A1 (en) * 2007-06-14 2008-12-18 Cubic Corporation Eye detection system
US9122925B2 (en) 2011-08-22 2015-09-01 Eyelock, Inc. Systems and methods for capturing artifact free images
WO2013028700A3 (en) * 2011-08-22 2013-05-10 Eyelock Inc. Systems and methods for capturing artifact free images
CN103605965A (en) * 2013-11-25 2014-02-26 苏州大学 Multi-pose face recognition method and device
CN104883548A (en) * 2015-06-16 2015-09-02 金鹏电子信息机器有限公司 Monitoring-video face-capturing processing method and system
CN106778713A (en) * 2017-03-01 2017-05-31 武汉虹识技术有限公司 The iris identification device and method of a kind of dynamic human eye tracking
CN106778713B (en) * 2017-03-01 2023-09-22 武汉虹识技术有限公司 Iris recognition device and method for dynamic human eye tracking
CN109117692A (en) * 2017-06-23 2019-01-01 上海荆虹电子科技有限公司 A kind of iris identification device, system and method
CN109117692B (en) * 2017-06-23 2024-03-29 深圳荆虹科技有限公司 Iris recognition device, system and method
CN109389018A (en) * 2017-08-14 2019-02-26 杭州海康威视数字技术股份有限公司 A kind of facial angle recognition methods, device and equipment
CN109389018B (en) * 2017-08-14 2020-12-25 杭州海康威视数字技术股份有限公司 Face angle recognition method, device and equipment
WO2023079862A1 (en) * 2021-11-05 2023-05-11 パナソニックＩｐマネジメント株式会社 Imaging system, processing device, and method executed by computer in imaging system
US20240260832A1 (en) * 2021-11-05 2024-08-08 Panasonic Intellectual Property Management Co., Ltd. Imaging system, processing device, and method to be performed by computer in imaging system

Also Published As

Publication number Publication date
KR20050009959A (en) 2005-01-26
KR100587422B1 (en) 2006-06-09

Similar Documents

Publication Publication Date Title
WO2005008567A1 (en) Apparatus and method for iris recognition from all direction of view
KR100977499B1 (en) Long Range Iris Image Acquisition System Using Panning and Tilting of Mirrors
CN1515952B (en) Iris recognition camera for iris recognition system and operating method of iris recognition camera
JP2002122899A (en) Iris imaging device
KR100869998B1 (en) Remote Iris Image Acquisition System
JP2002352235A (en) Apparatus and method for adjusting focus position in iris recognition system
JP2007504562A (en) Method and apparatus for performing iris authentication from a single image
JP2002514098A (en) Device for iris acquisition image
US20020057439A1 (en) Apparatus for focusing iris images of both eyes
JP2003030659A (en) Iris authentication device and iris imaging device
EP1408446A1 (en) Authentication object image-pickup method and device therefor
WO2017034701A1 (en) Infrared lamp control for use with iris recognition authentication
JP2004297518A (en) Authentication target image pickup apparatus and method
WO2019036751A1 (en) Enhanced video-based driver monitoring using phase detect sensors
EP4033400B1 (en) System for acquiring iris image to enlarge iris recognition range
JP2004295572A (en) Authentication target image pickup apparatus and image pickup method thereof
JP6624800B2 (en) Image processing apparatus, image processing method, and image processing system
KR100293468B1 (en) optical imager
CN1924886A (en) Iris recognition system using visible light and identification method thereof
JP3342810B2 (en) Iris image acquisition device
KR100443674B1 (en) Distance measuring method and apparatus of iris recognition system
KR20020086976A (en) Focusing angle and distance display in iris recognition system
KR20150117883A (en) iris recognition module and method
KR100410972B1 (en) Focusing distance display of iris recognition system
CN100523904C (en) Monitoring system

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
122 Ep: pct application non-entry in european phase