[go: up one dir, main page]

WO2021066252A1 - Biometrics-based vehicle control device and vehicle control method using same - Google Patents

Biometrics-based vehicle control device and vehicle control method using same Download PDF

Info

Publication number
WO2021066252A1
WO2021066252A1 PCT/KR2019/017193 KR2019017193W WO2021066252A1 WO 2021066252 A1 WO2021066252 A1 WO 2021066252A1 KR 2019017193 W KR2019017193 W KR 2019017193W WO 2021066252 A1 WO2021066252 A1 WO 2021066252A1
Authority
WO
WIPO (PCT)
Prior art keywords
vehicle
user
authentication
information
authentication information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2019/017193
Other languages
French (fr)
Korean (ko)
Inventor
김현우
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Saroris Co Ltd
Original Assignee
Saroris Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Saroris Co Ltd filed Critical Saroris Co Ltd
Publication of WO2021066252A1 publication Critical patent/WO2021066252A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R25/00Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
    • B60R25/20Means to switch the anti-theft system on or off
    • B60R25/25Means to switch the anti-theft system on or off using biometry
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R25/00Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
    • B60R25/10Fittings or systems for preventing or indicating unauthorised use or theft of vehicles actuating a signalling device
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R25/00Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
    • B60R25/20Means to switch the anti-theft system on or off
    • B60R25/24Means to switch the anti-theft system on or off using electronic identifiers containing a code not memorised by the user
    • B60R25/241Means to switch the anti-theft system on or off using electronic identifiers containing a code not memorised by the user whereby access privileges are related to the identifiers
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R25/00Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
    • B60R25/30Detection related to theft or to other events relevant to anti-theft systems
    • B60R25/305Detection related to theft or to other events relevant to anti-theft systems using a camera
    • BPERFORMING OPERATIONS; TRANSPORTING
    • B60VEHICLES IN GENERAL
    • B60RVEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR
    • B60R25/00Fittings or systems for preventing or indicating unauthorised use or theft of vehicles
    • B60R25/30Detection related to theft or to other events relevant to anti-theft systems
    • B60R25/33Detection related to theft or to other events relevant to anti-theft systems of global position, e.g. by providing GPS coordinates
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04WWIRELESS COMMUNICATION NETWORKS
    • H04W12/00Security arrangements; Authentication; Protecting privacy or anonymity
    • H04W12/06Authentication

Definitions

  • the present invention relates to a vehicle control apparatus and a vehicle control method, and more particularly, to a biometrics-based vehicle control apparatus and a vehicle control method using the same.
  • a vehicle alarm is basically installed, but it only performs a notification or alarm function for an abnormal situation on the vehicle, and does not prevent vehicle theft.
  • a wheel wheel lock or steering wheel lock is proposed to prevent vehicle theft, but this is inconvenient to lock and unlock each time, and the lock can be unlocked as much as possible by damaging the lock, so a fundamental preventive measure is required. It can't be done.
  • the present invention conceived by the above-described necessity, undergoes a first authentication process for a user who has access to the outside of the vehicle, a second authentication process for a user who boards a vehicle, and is processed unauthenticated in the first and second authentication.
  • a biometric-based vehicle control device that allows the vehicle to be controlled by authenticating a more true user by providing a supplementary authentication process to a true user, tracking the vehicle's location when the vehicle is stolen, and restricting the control of the vehicle. And a vehicle control method using the same.
  • a biometric-based vehicle control apparatus for achieving the above object is to obtain first authentication information of a corresponding user in order to perform a first authentication process for a user who accesses the outside of the vehicle.
  • 1 authentication information acquisition unit A second authentication information acquisition unit that acquires second authentication information of a corresponding user in order to perform a second authentication process for a user in the vehicle;
  • An authentication processing unit that performs first and second authentication processing for a corresponding user by using the first authentication information or the second authentication information;
  • a control unit configured to allow control of the vehicle to an authenticated user according to the result of the authentication processing unit and to allow control of the vehicle to a remote administrator while not allowing control of the vehicle to an unauthorized user.
  • the authentication processing unit when the user is determined to be a non-authenticated user from the result of the second authentication processing by the authentication processing unit, the first authentication information and the second authentication information and other types of biometric information or non-biometric information It further includes; a third authentication information acquisition unit that obtains the authentication information.
  • the first authentication information acquisition unit acquires at least one of face information, iris information, vein information, gesture information, and voice information of a corresponding user as the first authentication information.
  • the second authentication information acquisition unit acquires at least one of face information, iris information, vein information, gesture information, and voice information of a corresponding user as the second authentication information.
  • the third authentication information acquisition unit the first authentication information and the second authentication information and a different type, at least one of face information, iris information, vein information, gesture information, and voice information as the third authentication information.
  • the authentication processing unit authenticates the corresponding user based on the third authentication information.
  • control unit controls to activate a GPS module, a wireless communication module, a camera module, and various sensor modules of the vehicle when it is determined that the user in the vehicle is an unauthorized user.
  • the control unit allows the control of the vehicle to the remote manager, and the route distance or the time required is When it exceeds a predetermined size, the vehicle is controlled to move to a specific point.
  • a biometric-based vehicle control method includes a biometric device using a vehicle control device including a first authentication information acquisition unit, a second authentication information acquisition unit, a third authentication information acquisition unit, an authentication processing unit, and a control unit.
  • a metric-based vehicle control method wherein the first authentication information obtaining unit includes: obtaining first authentication information for a user who has access to the outside of the vehicle;
  • the authentication processing unit may include performing a first authentication process for a corresponding user by using the first authentication information;
  • the control unit when the user is determined to be an authenticated user, obtains second authentication information for the user who boarded the vehicle, and when the user is determined to be an unauthenticated user, the vehicle door is opened.
  • the second authentication information obtaining unit may include: obtaining second authentication information for a user who has boarded the vehicle;
  • the authentication processing unit may include performing a second authentication process for a corresponding user by using the second authentication information;
  • the control unit permits control of the vehicle to the user when the user is determined to be an authenticated user in the step of performing the second authentication process, and if the user is determined to be a non-authenticated user, the controller remotely controls the vehicle. It includes; performing a second control process to allow for.
  • the third authentication information acquisition unit may provide biometric information or non-biometric information different from the first authentication information and the second authentication information from a user determined as a non-authenticated user. Obtaining third authentication information;
  • the authentication processing unit performing a third authentication processing for a corresponding user by using the third authentication information;
  • the controller allows the user to control the vehicle if the user is determined to be an authenticated user, and if the user is determined to be an unauthorized user, the controller remotely controls the vehicle. And performing a third control process for allowing an administrator to allow it.
  • control unit when the user in the vehicle is determined to be an unauthorized user by the authentication processing unit, activating a GPS module, a wireless communication module, a camera module, and various sensor modules of the vehicle; And if the time required from the location of the vehicle to the location of the remote manager is less than or equal to a predetermined size, control of the vehicle is allowed to the remote manager, and when the time required exceeds the predetermined size, the vehicle is specified. It includes; controlling to move to the point.
  • the effect of increasing the reliability of the user's authentication through primary authentication for a user accessing the outside of a vehicle and secondary authentication for a user located inside the vehicle
  • control of the vehicle is allowed only to a remote administrator, thereby enabling the recovery and tracking of the stolen vehicle.
  • FIG. 1 is a block diagram exemplarily illustrating a biometric-based vehicle control apparatus according to an embodiment of the present invention
  • FIG. 2 is a diagram exemplarily illustrating the appearance of a biometric-based vehicle control apparatus according to an embodiment of the present invention
  • FIG. 3 is a diagram exemplarily illustrating an example in which the vehicle control device shown in FIG. 2 is installed in a vehicle;
  • FIG. 4 is a diagram illustrating a first authentication procedure for a user who has access to a vehicle equipped with a vehicle control device according to an embodiment of the present invention
  • FIG. 5 is a diagram illustrating a second authentication procedure for a user in a vehicle equipped with a vehicle control device according to an embodiment of the present invention
  • FIG. 6 is a diagram exemplarily illustrating a third authentication procedure for a user in a vehicle equipped with a vehicle control device according to an embodiment of the present invention
  • FIG. 7 is a diagram for illustratively explaining a control mode for a vehicle in which an unauthorized user boards in the third authentication procedure shown in FIG. 6;
  • FIG. 8 is a flowchart illustrating a process of a vehicle control method using a biometric-based vehicle control device according to another embodiment of the present invention.
  • the biometric-based vehicle control apparatus 100 includes a plurality of authentication information acquisition units 111 to 113, an authentication processing unit 120, and a control unit 130.
  • the communication unit 140, the GPS unit 150, the sensor unit 160, the dual display unit 170, the storage unit 180, and the I/O interface unit 190 are selectively or essential. Can be included as.
  • the plurality of authentication information acquisition units 111 to 113 may be distributedly installed in a plurality of spaces of the vehicle 10 or may be integrated into one module and installed in a specific space.
  • the first authentication information acquisition unit 111 acquires first authentication information for primary authentication for a user accessing the vehicle 10.
  • the first authentication information is biometric information (eg, face information, fingerprint information, vein information, iris information, other biometric information, etc.).
  • the sensor unit 160 of the vehicle control device 100 detects a user who is close to the vehicle 10 within a certain distance
  • the first authentication information acquisition unit 111 It can be composed of a camera that photographs everything. Since the first authentication information acquisition unit 111 needs to capture an image of an external situation of the vehicle 10, it is preferably installed to face the outside of the vehicle 10.
  • the first authentication information acquisition unit 111 transmits the captured digital image information as the first authentication information to the authentication processing unit 120.
  • the second authentication information acquisition unit 112 acquires second authentication information for secondary authentication for a user who has boarded the vehicle 10.
  • the second authentication information is biometric information (eg, face information, fingerprint information, vein information, iris information, other biometric information, etc.).
  • the second authentication information acquisition unit 112 uses a camera that photographs a part of the body of the user who has boarded the vehicle 10. Can be configured. Since the second authentication information acquisition unit 112 needs to capture an image of the internal situation of the vehicle 10, it is installed to face the face of a person in the driver's seat or the passenger seat inside the vehicle 10, or to adjust the lens angle. It is desirable to be.
  • the second authentication information acquisition unit 112 transmits the captured digital image information as the second authentication information to the authentication processing unit 120.
  • the third authentication information acquisition unit 113 acquires third authentication information for third authentication for a user who boards the vehicle 10.
  • the third authentication information is biometric information or non-biometric information.
  • the third authentication information acquisition unit 113 acquires third authentication information for the user when non-authentication determination is made for the user in the second authentication step.
  • the third authentication information acquisition unit 113 acquires third authentication information for the user when the authentication determination for the user is suspended in the second authentication step.
  • the third authentication information may acquire a different type of biometric information from the first authentication information and the second authentication information, or may be configured as a separate authentication means other than the biometric information.
  • the third authentication information may be fingerprint information, vein information, iris information, etc. as biometric authentication information.
  • the third authentication information acquisition unit 113 may obtain information on a part of the body of the user who has boarded the vehicle 10. It can be configured as an optical scanner.
  • the third authentication information acquisition unit 113 acquires information on a part of the body (for example, hands, arms, eyes) of a boarding user, a user's voice, and a user's motion as the third authentication information.
  • the third authentication information acquisition unit 113 may recognize a user's finger print, palm print, toe print, foot print, etc. to obtain pattern information of the fingerprint as third authentication information. have.
  • the authentication processing unit 120 uses the first to third authentication information obtained from the first to third authentication information acquisition units 111 to 113 to individually and independently determine whether the user is authenticated or unauthenticated, cannot be identified, or is pending determination. Perform the authentication process. For example, if face information or voice information is registered as the user's authentication information, the authentication processing unit 120 receives the user's face information from the first authentication information acquisition unit 111 and the second authentication information acquisition unit 112. Acquire. Alternatively, the authentication processing unit 120 acquires the user's voice information from the third authentication information acquisition unit 113.
  • the authentication processing unit 120 compares the registered face image and the evaluated face image to determine whether they are similar, but the determination of whether the face is similar is executed by a machine learning method using deep learning.
  • the authentication processing unit 120 pre-installs face recognition software programmed using a programming language such as Python in order to execute deep learning.
  • a deep learning technology is used to determine whether or not the face is similar using an open source library such as Tensor Flow and a programming library for real-time computer vision such as OpenCV.
  • the control unit 130 permits control of the vehicle to the authenticated user according to the result of the authentication processing unit 120. In addition, the control unit 130 does not allow an unauthorized user to control the vehicle. In addition, the controller 130 processes to allow the remote manager 200 to control the vehicle 10 when an unauthorized user boards the driver's seat.
  • the control unit 130, the communication unit 140, the GPS unit 150, and the sensor unit 160 of the vehicle 10 Control to activate.
  • control unit 130 calculates a time required from the location of the vehicle 10 to the location of the remote manager for an unauthorized vehicle. If the required time is less than or equal to a predetermined size, the control unit 130 allows the remote manager 200 to control the vehicle. When the required time exceeds a predetermined size, the controller 130 controls the vehicle 10 to autonomously move from the stolen point to the collection point.
  • the control unit 130 includes a plurality of authentication information acquisition units 111 to 113, an authentication processing unit 120, a communication unit 140, a GPS unit 150, a sensor unit 160, a dual display unit 170, and a storage unit ( 180) and the overall operation of the I/O interface unit 190 are controlled.
  • the communication unit 140 performs wired/wireless communication with the remote manager 200. In the case of vehicle theft, the communication unit 140 automatically transmits the information about theft to the remote manager 200 and government offices.
  • the communication unit 140 may be implemented as a cellular communication module according to 3G, 4G, 5G, and next-generation communication standards. Alternatively, the communication unit 140 may communicate directly with a ZigBee, Wi-Fi, Bluetooth, or infrared communication method, or connect to an Internet sharer (not shown) to communicate with a remote manager 200 and a terminal installed in a public office.
  • the GPS unit 150 is configured in the vehicle control device 100.
  • the GPS unit 150 may receive position coordinate information of a vehicle in which the vehicle control device 100 is installed from a GPS satellite.
  • the GPS unit 150 may receive location coordinates from an adjacent base station accessed through the communication unit 140.
  • the GPS unit 150 forms a route map using the received location coordinate information, and transmits the formed route map to the controller 130.
  • the sensor unit 160 is configured in the vehicle control device 100.
  • the sensor unit 160 is configured with various types of sensors for sensing the speed, acceleration, direction of the vehicle 10, whether a person approaches, or whether a person is on board.
  • the sensor unit 160 may be implemented in various types, such as a distance sensor for recognizing a person adjacent to the vehicle 10, a weight sensor for recognizing whether a person is on board the vehicle 10, and an acceleration sensor.
  • the dual display unit 170 is configured at the front and rear sides of the vehicle control apparatus 100, respectively.
  • the first display 171 is installed in front of the device, where the front is a direction facing the driver.
  • the second display 172 is installed at the rear of the device, where the rear is a direction facing the opposite direction to the driver.
  • the storage unit 180 is configured in the vehicle control device 100.
  • the storage unit 180 stores a data set on a user, information on parts constituting the vehicle control device 100, information on the vehicle 10, an application software executable file executed in the vehicle control device 100, and the like. do.
  • the I/O interface unit 190 is configured in the vehicle control device 100.
  • the I/O interface unit 190 is a USB, UART, audio input/output terminal, and video input/output terminal for connecting and expanding other devices to the vehicle control device 100.
  • FIG. 2 is a diagram exemplarily illustrating the appearance of a biometric-based vehicle control apparatus according to an embodiment of the present invention.
  • a side camera 111 and a distance sensor 160 are separately separated.
  • the side camera 111 and the distance sensor 160 communicate information with the controller 130 through the I/O interface 190.
  • the side camera 111 secures biometric information such as a face of a user who is close to the vehicle 10 and transmits it to the controller 130.
  • the distance sensor 190 determines whether the user is close to the vehicle 10 and transmits it to the controller 130.
  • the vehicle control device 100 includes a front camera 112 for photographing the front of the vehicle, a fingerprint reader 113 capable of acquiring user's fingerprint information, and a lamp ( LED).
  • the vehicle control apparatus 100 includes a front display 171 provided at the front and a rear display 172 provided at the rear.
  • FIG. 3 is a diagram illustrating an example in which the vehicle control device shown in FIG. 2 is installed in a vehicle.
  • a side camera 111 is provided in the side mirror part provided on the left side of the driver's seat, and the handle of the driver's seat of the vehicle 10
  • a distance sensor 161 is provided in the part.
  • the vehicle control device 100 is installed on the dashboard of the vehicle 10.
  • the front camera 112 of the vehicle control apparatus 100 is configured to face a driver's seat or a passenger seat in order to photograph a user in the vehicle 10.
  • the vehicle control apparatus 100 may communicate with a remote manager 200 through a network.
  • FIG. 4 is a diagram illustrating a first authentication procedure for a user who has access to a vehicle equipped with a vehicle control device according to an embodiment of the present invention.
  • the distance sensor 161 of the vehicle control device 150 detects the user's approach.
  • the first authentication information acquisition unit 111 acquires the user's face image as the first authentication information.
  • the first authentication information acquisition unit 111 transmits the obtained first authentication information to the authentication processing unit 120.
  • the authentication processing unit 120 compares the face image stored in the storage unit 180 with the captured image according to a deep learning algorithm to perform primary authentication for a corresponding user.
  • FIG. 5 is a diagram illustrating a second authentication procedure for a user in a vehicle equipped with a vehicle control device according to an embodiment of the present invention.
  • the second authentication information acquisition unit 112 acquires a face image of a passenger as second authentication information.
  • the second authentication information acquisition unit 112 transmits the obtained first authentication information to the authentication processing unit 120.
  • the authentication processing unit 120 compares the face image stored in the storage unit 180 with the captured face image according to a deep learning algorithm to perform secondary authentication for a corresponding user.
  • the third authentication information acquisition unit 113 acquires fingerprint pattern image information of a passenger as third authentication information.
  • the third authentication information acquisition unit 113 may be configured as a fingerprint reader.
  • the third authentication information obtaining unit 113 transmits the obtained third authentication information to the authentication processing unit 120.
  • the authentication processing unit 120 compares the fingerprint image stored in the storage unit 180 with the detected fingerprint image according to a deep learning algorithm, and performs third authentication for a corresponding user.
  • the controller 130 In the third authentication procedure, when there is no storage information of the storage unit 180 that matches the third authentication information, the controller 130 operates in a control mode. In the case of being recognized as a non-authenticated user in the first, second and third authentication procedures described above, the controller 130 may restrict a notification or vehicle control right to block access to the vehicle of the non-authenticated user. In addition, the controller 130 may operate the vehicle 10 in a control mode when an unauthorized user boards the vehicle 10.
  • the control mode of the vehicle 10 by the controller 130 will be described in detail.
  • FIG. 7 is a diagram illustrating an operation of a control mode for a vehicle in which an unauthenticated user boards in the third authentication procedure shown in FIG. 6.
  • the vehicle control device 100 transmits the unauthorized information to the remote manager 200, the owner terminal (not shown) of the vehicle 10, or a designated manager through the network. Delivered to the terminal (not shown).
  • the remote manager 200 is a server terminal of a vehicle management service company to which the vehicle 10 has already subscribed. A plurality of such remote managers 200 may exist, and unauthorized information can be transmitted to the remote manager 200 closest to the vehicle 10 or unauthorized information can be transmitted to the remote manager 200 previously designated by the user. have.
  • the remote manager 200 receives unauthorized information, it requests the location information of the vehicle 10 to update the latest location information.
  • the remote manager 200 calculates a path between the vehicle 10 and the remote manager 200 at the expense of the received location information and its own location information.
  • the remote manager 200 calculates the estimated time required by considering real-time traffic information on the calculated route.
  • the remote manager 200 is a case in which the estimated time required is less than a predetermined time (eg, 10 minutes) (if it is within the control area).
  • the remote manager 200 controls the vehicle 10 in the control area to move to a specific area in the control area or to a separate designated location outside the control area through direct control.
  • a specific area is an area in which location information such as large roadsides, public institutions, public offices, and parking lots is pre-designated.
  • the remote manager 200 receives unauthorized information, it requests the location information of the vehicle 10 to update the latest location information.
  • the remote manager 200 calculates a path between the vehicle 10 and the remote manager 200 at the expense of the received location information and its own location information.
  • the remote manager 200 calculates the estimated time required by considering real-time traffic information on the calculated route.
  • the remote manager 200 is a case in which the estimated time required is greater than a predetermined time (eg, 10 minutes) (out of the control area).
  • the remote manager 200 controls the vehicle control device 100 installed in the vehicle 10 to move the vehicle 10 from the current position to a recoverable position rather than directly controlling the vehicle 10 A signal is transmitted, and location information of the vehicle 10 is received in real time to monitor the location.
  • the vehicle control apparatus 100 detects a user approaching the vehicle 10 using the distance sensor 161 (step 1).
  • primary authentication information is obtained (second step).
  • the vehicle control device 100 acquires primary authentication information by capturing the user's face image information using the side camera 111.
  • the vehicle control device 100 performs primary authentication using the acquired primary authentication information (third step).
  • the first authentication procedure processes whether or not the captured image is authenticated using a matching rate with a user image registered in advance based on deep learning.
  • image classification is performed based on a convolution neural network (CNN) algorithm, and when the mapping rate exceeds a predetermined value, it is determined as an authenticated user for the corresponding user. If the matching rate for the captured image is less than a predetermined value, the corresponding user is determined as an unauthorized user. In the case of an authenticated user, it proceeds to the normal mode and unlocks the vehicle door (step 5).
  • CNN convolution neural network
  • the vehicle control apparatus 100 determines whether the door of the vehicle 10 is opened or closed (step 6). If the door of the vehicle 10 is not open, the first step of acquiring primary authentication information is repeated. The number of repetitions of the primary authentication procedure for an unauthenticated user may be one or more. If it is determined that the door of the vehicle 10 is open in the sixth step, the fact that the unauthorized user has approached the vehicle 10 is transmitted as a message to a predetermined terminal or to the remote manager 200. Then, when it is determined that the user is in the driver's seat of the vehicle 10, secondary authentication information for the corresponding occupant is obtained (step 7). At this time, the vehicle control device 100 acquires secondary authentication information by capturing the user's face image information using the side camera 111. The vehicle control device 100 performs secondary authentication using the acquired secondary authentication information (step 8).
  • authentication is performed using a matching rate with a user image registered in advance based on deep learning for a captured image. For example, image classification is performed based on a Convolution Neural Network (CNN) algorithm, and when the mapping rate exceeds a predetermined value, a corresponding occupant is determined as an authenticated user. If the matching rate for the captured image is less than a predetermined value, the corresponding occupant is determined as an unauthorized user. In the case of an authenticated user, control of the vehicle is allowed (Step 9).
  • CNN Convolution Neural Network
  • the vehicle control apparatus 100 determines that the corresponding occupant is a non-authenticated user, the vehicle control apparatus 100 proceeds with a procedure of obtaining third authentication information for the corresponding occupant (step 10).
  • the third authentication information is biometric information or non-biometric information of the corresponding occupant.
  • biometric information biometric information other than the face information of the corresponding occupant is obtained as third authentication information.
  • the vehicle control device 100 acquires the fingerprint information as tertiary authentication information by optically scanning the fingerprint of the corresponding occupant using the fingerprint reader 112. The vehicle control apparatus 100 performs third authentication using the obtained third authentication information (step 11).
  • authentication is performed using the matching rate of the scanned fingerprint image with the user's fingerprint image registered in advance based on deep learning. For example, image classification is performed based on a Convolution Neural Network (CNN) algorithm, and when the mapping rate exceeds a predetermined value, a corresponding occupant is determined as an authenticated user. If the matching rate for the scanned fingerprint image is smaller than a predetermined value, the corresponding occupant is determined as an unauthenticated user. In the case of an authenticated user, control of the vehicle is allowed (step 12).
  • CNN Convolution Neural Network
  • the vehicle control apparatus 100 determines that the occupant is an unauthorized user, the vehicle control apparatus 100 executes a control mode for the vehicle (step 13).
  • the vehicle control device 100 transmits information on a situation requiring control of the vehicle to the remote manager 100 or a predetermined user.
  • the remote manager 100 determines whether direct control of the vehicle 10 or indirect control is possible using the location information received from the vehicle 10 (step 14).
  • the remote manager 200 moves the vehicle 10 to a specific point by directly controlling the vehicle 10 (step 15). If direct control is not possible, the remote manager 200 transmits a control signal to the vehicle control device 100 of the vehicle 10 to move the vehicle 10 from the current location to a specific location to perform indirect d control. Run it (Step 16).
  • the vehicle control method described above essentially includes a first authentication procedure and a second authentication procedure, and proceeds with the third authentication procedure after the first authentication procedure, or sequentially proceeds with the first, second and third authentication procedures, or 1
  • the design can be variously changed to proceed with an additional authentication procedure.
  • the present invention is not necessarily limited to this embodiment. That is, within the scope of the object of the present invention, all of the constituent elements may be selectively combined and operated in one or more.
  • all of the components may be implemented as one independent hardware, a program module that performs some or all functions combined in one or more hardware by selectively combining some or all of the components. It may be implemented as a computer program having Codes and code segments constituting the computer program may be easily inferred by those skilled in the art of the present invention.
  • Such a computer program is stored in a non-transitory computer readable media that can be read by a computer and is read and executed by a computer, thereby implementing an embodiment of the present invention.
  • the non-transitory readable recording medium is not a medium that stores data for a short moment, such as a register, cache, memory, etc., but a medium that stores data semi-permanently and can be read by a device.
  • the above-described programs may be provided by being stored in a non-transitory readable recording medium such as a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, or the like.
  • the present invention can be applied to a vehicle and has industrial applicability as it is applied to a security system for preventing theft of a vehicle.

Landscapes

  • Engineering & Computer Science (AREA)
  • Mechanical Engineering (AREA)
  • Computer Security & Cryptography (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Human Computer Interaction (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Traffic Control Systems (AREA)

Abstract

Disclosed are a biometrics-based vehicle control device and a vehicle control method using same. A biometrics-based vehicle control device according to the present invention includes: a first authentication information acquisition unit which acquires first authentication information about users who have approached the outside of a vehicle in order to perform a first authentication of the users; a second authentication information acquisition unit which acquires second authentication information about users who have boarded the vehicle in order to perform a second authentication of the users; an authentication unit which uses the first authentication information or the second authentication information to perform an authentication of the corresponding users; and a control unit which allows the users authenticated according to the result from the authentication unit to control the vehicle, and does not allow unauthenticated users to control the vehicle, instead delegating control of the vehicle to a remote manager.

Description

바이오메트릭스 기반 차량 제어 장치 및 이를 이용한 차량 제어 방법 Biometrics-based vehicle control device and vehicle control method using the same

본 발명은 차량 제어 장치 및 차량 제어 방법에 관한 것으로써, 보다 상세하게는 바이오메트릭스(biometrics) 기반 차량 제어 장치 및 이를 이용한 차량 제어 방법에 관한 것이다.The present invention relates to a vehicle control apparatus and a vehicle control method, and more particularly, to a biometrics-based vehicle control apparatus and a vehicle control method using the same.

차량(vehicle)은 특성상 도난될 경우에 회수가 쉽지 않고, 2차 범죄에 이용되는 등의 문제가 있다. 차량의 도난을 예방하기 위하여 차량 경보기가 기본적으로 설치되어 있지만, 이는 차량에 대한 비정상적인 상황에 대해서 알림이나 경보 기능을 수행할 뿐이고, 차량 도난을 방지하지는 못한다.Due to the nature of the vehicle, it is not easy to recover it if it is stolen, and there are problems such as being used for secondary crime. In order to prevent vehicle theft, a vehicle alarm is basically installed, but it only performs a notification or alarm function for an abnormal situation on the vehicle, and does not prevent vehicle theft.

근본적으로 차량 도난을 방지하기 위해서 바퀴휠 잠금 장치 또는 핸들 잠금 장치가 제안되지만 이는 매번 잠금 설정 및 해제를 해야 하는 불편함이 있고, 잠금 장치를 파손하는 방식으로 얼마든지 해제시킬 수 있어서 근본적인 방지 대책이 되지는 못한다.Fundamentally, a wheel wheel lock or steering wheel lock is proposed to prevent vehicle theft, but this is inconvenient to lock and unlock each time, and the lock can be unlocked as much as possible by damaging the lock, so a fundamental preventive measure is required. It can't be done.

보다 근본적인 해결책으로 차량에 각종의 센서를 구비함으로써 사용자를 인증하여 차량의 도어를 개폐하고, 시동장치의 작동이 가능하게 하는 방법도 제안되고 있다. As a more fundamental solution, a method of authenticating a user by providing various sensors in the vehicle, opening and closing the vehicle door, and enabling the operation of the starting device has also been proposed.

하지만, 기술의 발달로 인하여 사용자의 특징을 피싱(Phishing)함으로써 종래의 차량 보안 시스템을 무력화시키는 사례가 발생되고, 이를 해결하기 위해서는 보다 높은 보안 절차를 거쳐야 하므로 사용자의 편의성에 악영향을 미치는 문제점을 내포하고 있다.However, due to the development of technology, there are cases in which the conventional vehicle security system is disabled by phishing the characteristics of the user, and a higher security procedure is required to solve this, so it has a problem that adversely affects the user's convenience. I'm doing it.

따라서, 사용자의 편의성에 최소한의 영향을 미치면서도 차량의 도난 방지를 근본적으로 방지하면서 도난시에는 회수 조치가 가능할 수 있는 새로운 방식의 차량 제어 장치의 개발의 필요성이 요구되는 실정이다.Accordingly, there is a need to develop a new type of vehicle control device capable of fundamentally preventing vehicle theft prevention while having minimal impact on user convenience and enabling recovery measures in the event of theft.

상술한 필요성에 의해서 안출된 본 발명은 차량의 외부에 접근한 사용자에 대해서 1차 인증 과정을 거치고, 차량에 탑승한 사용자에 대해서 2차 인증 과정을 거치며, 1차 및 2차 인증에서 비인증된 처리되는 진정한 사용자에게 보충적 인증 과정을 제공함으로써, 보다 진정한 사용자를 인증하여 차량의 제어를 허용하고, 차량의 도난시 차량의 위치 추적이 가능하며, 차량의 제어를 제한할 수 있는 바이오메트릭 기반 차량 제어 장치 및 이를 이용한 차량 제어 방법을 제공하는 것을 목적으로 한다.The present invention, conceived by the above-described necessity, undergoes a first authentication process for a user who has access to the outside of the vehicle, a second authentication process for a user who boards a vehicle, and is processed unauthenticated in the first and second authentication. A biometric-based vehicle control device that allows the vehicle to be controlled by authenticating a more true user by providing a supplementary authentication process to a true user, tracking the vehicle's location when the vehicle is stolen, and restricting the control of the vehicle. And a vehicle control method using the same.

상기 목적을 달성하기 위한 본 발명의 일 실시 예에 따른 바이오메트릭 기반 차량 제어 장치는, 차량의 외부에 접근한 사용자에 대한 제1 인증 처리를 수행하기 위해서 해당 사용자의 제1 인증 정보를 획득하는 제1 인증 정보 획득부; 차량에 탑승한 사용자에 대한 제2 인증 처리를 수행하기 위해서 해당 사용자의 제2 인증 정보를 획득하는 제2 인증 정보 획득부; 상기 제1 인증 정보 또는 상기 제2 인증 정보를 이용하여 해당 사용자에 대한 제1 및 제2 인증 처리를 수행하는 인증 처리부; 및 상기 인증 처리부의 결과에 따라 인증된 사용자에 대해서는 차량의 제어를 허용하고, 비인증된 사용자에 대해서는 차량의 제어를 허용하지 않으면서, 해당 차량의 제어를 원격의 관리자에게 허용하도록 처리하는 제어부;를 포함한다.A biometric-based vehicle control apparatus according to an embodiment of the present invention for achieving the above object is to obtain first authentication information of a corresponding user in order to perform a first authentication process for a user who accesses the outside of the vehicle. 1 authentication information acquisition unit; A second authentication information acquisition unit that acquires second authentication information of a corresponding user in order to perform a second authentication process for a user in the vehicle; An authentication processing unit that performs first and second authentication processing for a corresponding user by using the first authentication information or the second authentication information; And a control unit configured to allow control of the vehicle to an authenticated user according to the result of the authentication processing unit and to allow control of the vehicle to a remote administrator while not allowing control of the vehicle to an unauthorized user. Includes.

이 경우에, 상기 인증 처리부에 의해서 상기 제2 인증 처리의 결과에서 해당 사용자가 비인증 사용자로 판정되면, 상기 제1 인증 정보 및 상기 제2 인증 정보와 다른 종류의 생체 정보 또는 비생체 정보를 제3 인증 정보로 획득하는 제3 인증 정보 획득부;를 더 포함한다.In this case, when the user is determined to be a non-authenticated user from the result of the second authentication processing by the authentication processing unit, the first authentication information and the second authentication information and other types of biometric information or non-biometric information It further includes; a third authentication information acquisition unit that obtains the authentication information.

한편, 상기 제1 인증 정보 획득부는, 해당 사용자의 얼굴 정보, 홍체 정보, 정맥 정보, 제스처 정보 및 음성 정보 중 적어도 하나를 상기 제1 인증 정보로 획득한다.Meanwhile, the first authentication information acquisition unit acquires at least one of face information, iris information, vein information, gesture information, and voice information of a corresponding user as the first authentication information.

한편, 상기 제2 인증 정보 획득부는, 해당 사용자의 얼굴 정보, 홍체 정보, 정맥 정보, 제스처 정보 및 음성 정보 중 적어도 하나를 상기 제2 인증 정보로 획득한다.Meanwhile, the second authentication information acquisition unit acquires at least one of face information, iris information, vein information, gesture information, and voice information of a corresponding user as the second authentication information.

한편, 상기 제3 인증 정보 획득부는, 상기 제1 인증 정보 및 상기 제2 인증 정보와 다른 종류이되, 얼굴 정보, 홍체 정보, 정맥 정보, 제스처 정보 및 음성 정보 중 적어도 하나를 상기 제3 인증 정보로 획득하고, 상기 인증 처리부는, 상기 제3 인증 정보에 기초하여 해당 사용자를 인증한다.On the other hand, the third authentication information acquisition unit, the first authentication information and the second authentication information and a different type, at least one of face information, iris information, vein information, gesture information, and voice information as the third authentication information. Acquire, and the authentication processing unit authenticates the corresponding user based on the third authentication information.

한편, 상기 제어부는, 해당 차량에 탑승한 사용자가 비인증된 사용자로 판정되면, 해당 차량의 GPS 모듈, 무선 통신 모듈, 카메라 모듈, 각종의 센서 모듈을 활성화하도록 제어한다.On the other hand, the control unit controls to activate a GPS module, a wireless communication module, a camera module, and various sensor modules of the vehicle when it is determined that the user in the vehicle is an unauthorized user.

이 경우에, 상기 제어부는, 해당 차량의 위치에서 상기 원격의 관리자의 위치까지의 소요 시간이 기 결정된 크기 이하이면 해당 차량에 대한 제어를 상기 원격의 관리자에게 허용하고, 상기 경로 거리 또는 소요 시간이 기 결정된 크기를 초과하면 해당 차량을 특정 지점까지 이동하도록 제어한다.In this case, if the time required from the location of the vehicle to the location of the remote manager is less than or equal to a predetermined size, the control unit allows the control of the vehicle to the remote manager, and the route distance or the time required is When it exceeds a predetermined size, the vehicle is controlled to move to a specific point.

본 발명의 다른 실시 예에 따른 바이오메트릭 기반 차량 제어 방법은, 제1 인증 정보 획득부, 제2 인증 정보 획득부, 제3 인증 정보 획득부, 인증 처리부 및 제어부를 포함하는 차량 제어 장치를 이용한 바이오메트릭 기반 차량 제어 방법에 있어서, 상기 제1 인증 정보 획득부는, 차량의 외부에 접근한 사용자에 대한 제1 인증 정보를 획득하는 단계; 상기 인증 처리부는, 상기 제1 인증 정보를 이용하여 해당 사용자에 대한 제1 인증 처리를 수행하는 단계; 상기 제어부는, 상기 제1 인증 처리를 수행하는 단계에서 해당 사용자가 인증 사용자로 판정되면 차량에 탑승한 사용자에 대한 제2 인증 정보를 획득하게 하고, 해당 사용자가 비인증 사용자로 판정되면 차량 도어가 열린 경우에 메세지를 발생시키도록 처리하는 제1 제어 처리를 수행하는 단계; 상기 제2 인증 정보 획득부는, 차량에 탑승한 사용자에 대한 제2 인증 정보를 획득하는 단계; 상기 인증 처리부는, 상기 제2 인증 정보를 이용하여 해당 사용자에 대한 제2 인증 처리를 수행하는 단계; 및 상기 제어부는, 상기 제2 인증 처리를 수행하는 단계에서 해당 사용자가 인증 사용자로 판정되면 해당 차량의 제어를 해당 사용자에게 허용하고, 해당 사용자가 비인증 사용자로 판정되면 해당 차량의 제어를 원격의 관리자에게 허용하는 제2 제어 처리를 수행하는 단계;를 포함한다.A biometric-based vehicle control method according to another embodiment of the present invention includes a biometric device using a vehicle control device including a first authentication information acquisition unit, a second authentication information acquisition unit, a third authentication information acquisition unit, an authentication processing unit, and a control unit. A metric-based vehicle control method, wherein the first authentication information obtaining unit includes: obtaining first authentication information for a user who has access to the outside of the vehicle; The authentication processing unit may include performing a first authentication process for a corresponding user by using the first authentication information; In the step of performing the first authentication process, the control unit, when the user is determined to be an authenticated user, obtains second authentication information for the user who boarded the vehicle, and when the user is determined to be an unauthenticated user, the vehicle door is opened. Performing a first control process of processing to generate a message in case; The second authentication information obtaining unit may include: obtaining second authentication information for a user who has boarded the vehicle; The authentication processing unit may include performing a second authentication process for a corresponding user by using the second authentication information; And the control unit permits control of the vehicle to the user when the user is determined to be an authenticated user in the step of performing the second authentication process, and if the user is determined to be a non-authenticated user, the controller remotely controls the vehicle. It includes; performing a second control process to allow for.

이 경우에, 상기 제2 제어 처리를 수행하는 단계에서, 상기 제3 인증 정보 획득부는 비인증 사용자로 판정된 사용자로부터 상기 제1 인증 정보 및 상기 제2 인증 정보와 다른 종류의 생체 정보 또는 비생체 정보인 제3 인증 정보를 획득하는 단계; 상기 제2 제어 처리를 수행하는 단계에서, 상기 인증 처리부는 상기 제3 인증 정보를 이용하여 해당 사용자에 대한 제3 인증 처리를 수행하는 단계; 및 상기 제3 인증 처리를 수행하는 단계 이후에, 상기 제어부는 해당 사용자가 인증 사용자로 판정되면 해당 차량의 제어를 해당 사용자에게 허용하고, 해당 사용자가 비인증 사용자로 판정되면 해당 차량의 제어를 원격의 관리자에게 허용하도록 처리하는 제3 제어 처리를 수행하는 단계;를 포함한다.In this case, in the step of performing the second control processing, the third authentication information acquisition unit may provide biometric information or non-biometric information different from the first authentication information and the second authentication information from a user determined as a non-authenticated user. Obtaining third authentication information; In the step of performing the second control processing, the authentication processing unit performing a third authentication processing for a corresponding user by using the third authentication information; And after the step of performing the third authentication process, the controller allows the user to control the vehicle if the user is determined to be an authenticated user, and if the user is determined to be an unauthorized user, the controller remotely controls the vehicle. And performing a third control process for allowing an administrator to allow it.

이 경우에, 상기 제어부는, 상기 인증 처리부에 의해서 차량에 탑승한 사용자가 비인증된 사용자로 판정되면, 해당 차량의 GPS 모듈, 무선 통신 모듈, 카메라 모듈, 각종의 센서 모듈을 활성화하는 단계; 및 해당 차량의 위치에서 상기 원격의 관리자의 위치까지의 소요 시간이 기 결정된 크기 이하이면 해당 차량에 대한 통제권을 상기 원격의 관리자에게 허용하고, 상기 소요 시간이 기 결정된 크기를 초과하면 해당 차량을 특정 지점까지 이동하도록 제어하는 단계;를 포함한다.In this case, the control unit, when the user in the vehicle is determined to be an unauthorized user by the authentication processing unit, activating a GPS module, a wireless communication module, a camera module, and various sensor modules of the vehicle; And if the time required from the location of the vehicle to the location of the remote manager is less than or equal to a predetermined size, control of the vehicle is allowed to the remote manager, and when the time required exceeds the predetermined size, the vehicle is specified. It includes; controlling to move to the point.

본 발명의 다양한 실시 예에 따르면, 차량의 외부에 접근한 사용자에 대해서 1차 인증과 차량의 내부에 위치한 사용자에 대해서 2차 인증을 통해서 사용자의 인증에 대한 신뢰도를 높여주는 효과,According to various embodiments of the present disclosure, the effect of increasing the reliability of the user's authentication through primary authentication for a user accessing the outside of a vehicle and secondary authentication for a user located inside the vehicle,

1차, 2차 인증 정보와 다른 종류의 생체 또는 비생체 인증 정보를 이용하여 보충적 인증 프로세를 통해서 진정 사용자의 오류 인식으로 인한 불편함을 해소하는 효과, 그리고,The effect of relieving the inconvenience caused by the user's error recognition through a supplementary authentication process using the first and second authentication information and other types of biometric or non-biometric authentication information, and,

차량 도난 상황이 발생할 경우에 차량의 제어를 원격의 관리자에게만 허용함으로써 도난 차량의 회수 및 추적을 가능하게 하는 효과를 발휘한다.When a vehicle theft situation occurs, control of the vehicle is allowed only to a remote administrator, thereby enabling the recovery and tracking of the stolen vehicle.

도 1은 본 발명의 일 실시 예에 따른 바이오메트릭 기반 차량 제어 장치를 예시적으로 설명하는 블럭도,1 is a block diagram exemplarily illustrating a biometric-based vehicle control apparatus according to an embodiment of the present invention;

도 2는 본 발명의 일 실시 예에 따른 바이오메트릭 기반 차량 제어 장치의 외관을 예시적으로 설명하는 도면, 2 is a diagram exemplarily illustrating the appearance of a biometric-based vehicle control apparatus according to an embodiment of the present invention;

도 3은 도 2에 도시된 차량 제어 장치가 차량에 설치된 일 예를 예시적으로 설명하는 도면,3 is a diagram exemplarily illustrating an example in which the vehicle control device shown in FIG. 2 is installed in a vehicle;

도 4는 본 발명의 일 실시 예에 따른 차량 제어 장치가 설치된 차량에 접근한 사용자에 대한 1차 인증 절차를 예시적으로 도시한 도면,4 is a diagram illustrating a first authentication procedure for a user who has access to a vehicle equipped with a vehicle control device according to an embodiment of the present invention;

도 5는 본 발명의 일 실시 예에 따른 차량 제어 장치가 설치된 차량에 탑승한 사용자에 대한 2차 인증 절차를 예시적으로 도시한 도면,5 is a diagram illustrating a second authentication procedure for a user in a vehicle equipped with a vehicle control device according to an embodiment of the present invention;

도 6은 본 발명의 일 실시 예에 따른 차량 제어 장치가 설치된 차량에 탑승한 사용자에 대한 3차 인증 절차를 예시적으로 설명하는 도면,6 is a diagram exemplarily illustrating a third authentication procedure for a user in a vehicle equipped with a vehicle control device according to an embodiment of the present invention;

도 7은 도 6에 도시된 3차 인증 절차에서 비인증된 사용자가 탑승한 차량에 대한 통제 모드를 예시적으로 설명하기 위한 도면, 그리고,7 is a diagram for illustratively explaining a control mode for a vehicle in which an unauthorized user boards in the third authentication procedure shown in FIG. 6; and

도 8은 본 발명의 다른 실시 예에 따른 바이오메트릭 기반 차량 제어 장치를 이용한 차량 제어 방법의 과정을 예시적으로 설명하는 흐름도.8 is a flowchart illustrating a process of a vehicle control method using a biometric-based vehicle control device according to another embodiment of the present invention.

이하 도면을 참고하여 본 발명의 바라직한 실시 예에 대해서 설명한다.Hereinafter, a preferred embodiment of the present invention will be described with reference to the drawings.

도 1은 본 발명의 일 실시 예에 따른 바이오메트릭 기반 차량 제어 장치를 예시적으로 설명하는 블럭도이다. 도 1을 참고하면, 바이오메트릭 기반 차량 제어 장치(100)는 복수의 인증 정보 획득부(111 내지 113), 인증 처리부(120), 제어부(130)를 포함한다. 실시 예에 따라서는 통신부(140), GPS(150), 센서부(160), 듀얼 디스플레이부(170), 저장부(180) 및 I/O 인터페이스부(190)를 일부 또는 전부를 선택적 또는 필수적으로 포함할 수 있다.1 is a block diagram illustrating a biometric-based vehicle control apparatus according to an embodiment of the present invention. Referring to FIG. 1, the biometric-based vehicle control apparatus 100 includes a plurality of authentication information acquisition units 111 to 113, an authentication processing unit 120, and a control unit 130. Depending on the embodiment, some or all of the communication unit 140, the GPS unit 150, the sensor unit 160, the dual display unit 170, the storage unit 180, and the I/O interface unit 190 are selectively or essential. Can be included as.

복수의 인증 정보 획득부(111 내지 113)은 차량(10)의 다수 공간에 분산 설치되거나 하나의 모듈로 통합되서 특정 공간에 설치될 수도 있다. 구체적으로, 제1 인증 정보 획득부(111)는 차량(10)에 접근하는 사용자에 대한 1차 인증을 위한 제1 인증 정보를 획득한다. 이때, 제1 인증 정보는 생체 정보(예를 들어, 얼굴 정보, 지문 정보, 정맥 정보, 홍체 정보, 기타 생체 정보 등)이다. 차량 제어 장치(100)의 센서부(160)에 의해서 차량(10)으로부터 일정 거리 이내로 근접한 사용자를 감지하면, 제1 인증 정보 획득부(111)는 차량(10)에 접근하는 사용자의 신체 일부 또는 전부를 촬상하는 카메라로 구성될 수 있다. 제1 인증 정보 획득부(111)는 차량(10)의 외부 상황을 촬상해야 하므로, 차량(10)의 외부를 지향하도록 설치되는 것이 바람직하다. 제1 인증 정보 획득부(111)는 촬상한 디지털 이미지 정보를 제1 인증 정보로 인증 처리부(120)로 전달한다. The plurality of authentication information acquisition units 111 to 113 may be distributedly installed in a plurality of spaces of the vehicle 10 or may be integrated into one module and installed in a specific space. Specifically, the first authentication information acquisition unit 111 acquires first authentication information for primary authentication for a user accessing the vehicle 10. At this time, the first authentication information is biometric information (eg, face information, fingerprint information, vein information, iris information, other biometric information, etc.). When the sensor unit 160 of the vehicle control device 100 detects a user who is close to the vehicle 10 within a certain distance, the first authentication information acquisition unit 111 It can be composed of a camera that photographs everything. Since the first authentication information acquisition unit 111 needs to capture an image of an external situation of the vehicle 10, it is preferably installed to face the outside of the vehicle 10. The first authentication information acquisition unit 111 transmits the captured digital image information as the first authentication information to the authentication processing unit 120.

제2 인증 정보 획득부(112)는 차량(10)에 탑승한 사용자에 대한 2차 인증을 위한 제2 인증 정보를 획득한다. 이때, 제2 인증 정보는 생체 정보(예를 들어, 얼굴 정보, 지문 정보, 정맥 정보, 홍체 정보, 기타 생체 정보 등)이다. 차량 제어 장치(100)의 센서부(160)에 의해서 운전석에 사용자가 탑승한 것을 감지하면, 제2 인증 정보 획득부(112)는 차량(10)에 탑승한 사용자의 신체 일부를 촬상하는 카메라로 구성될 수 있다. 제2 인증 정보 획득부(112)는 차량(10)의 내부 상황을 촬상해야 하므로, 차량(10)의 내부에서 운전석 또는 조수석에 탑승한 사람의 얼굴을 지향하도록 설치되거나 렌즈 각도를 조절가능하도록 설치되는 것이 바람직하다. 제2 인증 정보 획득부(112)는 촬상한 디지털 이미지 정보를 제2 인증 정보로 인증 처리부(120)로 전달한다.The second authentication information acquisition unit 112 acquires second authentication information for secondary authentication for a user who has boarded the vehicle 10. At this time, the second authentication information is biometric information (eg, face information, fingerprint information, vein information, iris information, other biometric information, etc.). When the sensor unit 160 of the vehicle control device 100 detects that the user is in the driver's seat, the second authentication information acquisition unit 112 uses a camera that photographs a part of the body of the user who has boarded the vehicle 10. Can be configured. Since the second authentication information acquisition unit 112 needs to capture an image of the internal situation of the vehicle 10, it is installed to face the face of a person in the driver's seat or the passenger seat inside the vehicle 10, or to adjust the lens angle. It is desirable to be. The second authentication information acquisition unit 112 transmits the captured digital image information as the second authentication information to the authentication processing unit 120.

제3 인증 정보 획득부(113)는 차량(10)에 탑승한 사용자에 대한 3차 인증을 위한 제3 인증 정보를 획득한다. 이때, 제3 인증 정보는 생체 정보 또는 비생체 정보이다. 제3 인증 정보 획득부(113)는 2차 인증 단계에서 사용자에 대한 비인증 판단이 이루어진 경우에 해당 사용자에 대한 제3 인증 정보를 획득한다. 또는 제3 인증 정보 획득부(113)는 2차 인증 단계에서 사용자에 대한 인증 판단이 보류된 경우에 해당 사용자에 대한 제3 인증 정보를 획득한다. 제3 인증 정보는 제1 인증 정보 및 제2 인증 정보와는 다른 종류의 생체 정보를 획득하거나 생체 정보가 아닌 별도의 인증 수단으로 구성될 수 있다. 예를 들어, 제1 및 제2 인증 정보로 사람의 얼굴 이미지를 획득한 경우에 제3 인증 정보는 생체 인증 정보로 지문 정보, 정맥 정보, 홍체 정보 등이 될 수 있다. The third authentication information acquisition unit 113 acquires third authentication information for third authentication for a user who boards the vehicle 10. In this case, the third authentication information is biometric information or non-biometric information. The third authentication information acquisition unit 113 acquires third authentication information for the user when non-authentication determination is made for the user in the second authentication step. Alternatively, the third authentication information acquisition unit 113 acquires third authentication information for the user when the authentication determination for the user is suspended in the second authentication step. The third authentication information may acquire a different type of biometric information from the first authentication information and the second authentication information, or may be configured as a separate authentication means other than the biometric information. For example, when a person's face image is acquired using the first and second authentication information, the third authentication information may be fingerprint information, vein information, iris information, etc. as biometric authentication information.

차량 제어 장치(100)의 센서부(160)에 의해서 운전석에 사용자가 탑승한 것을 감지하면, 제3 인증 정보 획득부(113)는 차량(10)에 탑승한 사용자의 신체 일부의 정보를 획득할 수 있는 광학 스캐너로 구성될 수 있다. 제3 인증 정보 획득부(113)는 탑승한 사용자의 신체 일부(예를 들어, 손, 팔, 눈)에 관한 정보 또는 사용자의 목소리, 사용자의 동작 등을 제3 인증 정보로 획득한다. 예를 들어, 제3 인증 정보 획득부(113)는 광학 스캐너로 구현될 경우, 사용자의 손가락 지문, 손바닥 지문, 발가락 지문, 발바닥 지문 등 인식하여 지문의 패턴 정보를 제3 인증 정보로 획득할 수 있다.When the sensor unit 160 of the vehicle control device 100 detects that the user is in the driver's seat, the third authentication information acquisition unit 113 may obtain information on a part of the body of the user who has boarded the vehicle 10. It can be configured as an optical scanner. The third authentication information acquisition unit 113 acquires information on a part of the body (for example, hands, arms, eyes) of a boarding user, a user's voice, and a user's motion as the third authentication information. For example, when implemented as an optical scanner, the third authentication information acquisition unit 113 may recognize a user's finger print, palm print, toe print, foot print, etc. to obtain pattern information of the fingerprint as third authentication information. have.

인증 처리부(120)는 제1 내지 3 인증 정보 획득부(111 내지 113)로부터 획득한 제1 내지 3 인증 정보를 이용하여 개별적이고 독립적으로 사용자의 인증 또는 비인증 또는 판별불가 또는 판별보류 등으로 판단하는 인증 절차를 수행한다. 예를 들어, 사용자의 인증 정보로써 얼굴 정보 또는 목소리 정보가 등록되어 있으면, 인증 처리부(120)는 제1 인증 정보 획득부(111) 및 제2 인증 정보 획득부(112)로부터 사용자의 얼굴 정보를 획득한다. 또는 인증 처리부(120)는 제3 인증 정보 획득부(113)로부터 사용자의 목소리 정보를 획득한다.The authentication processing unit 120 uses the first to third authentication information obtained from the first to third authentication information acquisition units 111 to 113 to individually and independently determine whether the user is authenticated or unauthenticated, cannot be identified, or is pending determination. Perform the authentication process. For example, if face information or voice information is registered as the user's authentication information, the authentication processing unit 120 receives the user's face information from the first authentication information acquisition unit 111 and the second authentication information acquisition unit 112. Acquire. Alternatively, the authentication processing unit 120 acquires the user's voice information from the third authentication information acquisition unit 113.

인증 처리부(120)는 등록 얼굴 이미지와 평가 얼굴 이미지를 상호 대비하여 유사 여부를 판단하되, 얼굴의 유사 여부 판단은 딥러닝(Deep Learning)을 이용한 기계 학습 방식으로 실행된다. 또한, 인증 처리부(120)는 딥러닝을 실행시키기 위해서 파이썬과 같은 프로그래밍 언어를 이용하여 프로그래밍된 얼굴 인식 소프트웨어를 미리 설치한다. 또한, 텐서 플로우(Tensor Flow)와 같은 오픈 소스 라이브러리, 오픈씨브이(OpenCV)와 같은 실시간 컴퓨터 비전을 목적으로 한 프로그래밍 라이브러리 등을 이용하여 딥러닝 기술을 이용하여 얼굴의 유사 여부를 판단한다.The authentication processing unit 120 compares the registered face image and the evaluated face image to determine whether they are similar, but the determination of whether the face is similar is executed by a machine learning method using deep learning. In addition, the authentication processing unit 120 pre-installs face recognition software programmed using a programming language such as Python in order to execute deep learning. In addition, a deep learning technology is used to determine whether or not the face is similar using an open source library such as Tensor Flow and a programming library for real-time computer vision such as OpenCV.

제어부(130)는 인증 처리부(120)의 결과에 따라 인증된 사용자에 대해서는 차량의 제어를 허용한다. 또한 제어부(130)는 비인증된 사용자에 대해서는 차량의 제어를 허용하지 않는다. 또한 제어부(130)는 비인증된 사용자가 운전석에 탑승한 경우에 원격의 관리자(200)에게 해당 차량(10)의 제어를 허용하도록 처리한다.The control unit 130 permits control of the vehicle to the authenticated user according to the result of the authentication processing unit 120. In addition, the control unit 130 does not allow an unauthorized user to control the vehicle. In addition, the controller 130 processes to allow the remote manager 200 to control the vehicle 10 when an unauthorized user boards the driver's seat.

또한, 제어부(130)는 인증 처리부(120)에 의해서 해당 차량에 탑승한 사용자가 비인증된 사용자로 판정되면, 해당 차량(10)의 통신부(140), GPS부(150), 센서부(160)를 활성화하도록 제어한다.In addition, when the user who boards the vehicle is determined to be an unauthenticated user by the authentication processing unit 120, the control unit 130, the communication unit 140, the GPS unit 150, and the sensor unit 160 of the vehicle 10 Control to activate.

또한, 제어부(130)는 비인증된 차량에 대해서 해당 차량(10)의 위치에서 원격의 관리자의 위치까지의 소요 시간을 연산한다. 제어부(130)는 소요 시간이 기 결정된 크기 이하이면 해당 차량에 대한 제어를 원격의 관리자(200)에게 허용한다. 제어부(130)는 소요 시간이 기 결정된 크기를 초과하면 해당 차량(10)을 도난 지점에서 회수 지점까지 자율적으로 이동하도록 제어한다.In addition, the control unit 130 calculates a time required from the location of the vehicle 10 to the location of the remote manager for an unauthorized vehicle. If the required time is less than or equal to a predetermined size, the control unit 130 allows the remote manager 200 to control the vehicle. When the required time exceeds a predetermined size, the controller 130 controls the vehicle 10 to autonomously move from the stolen point to the collection point.

제어부(130)는 복수의 인증 정보 획득부(111 내지 113), 인증 처리부(120), 통신부(140), GPS부(150), 센서부(160), 듀얼 디스플레이부(170), 저장부(180) 및 I/O 인터페이스부(190)의 전반적인 동작을 제어한다.The control unit 130 includes a plurality of authentication information acquisition units 111 to 113, an authentication processing unit 120, a communication unit 140, a GPS unit 150, a sensor unit 160, a dual display unit 170, and a storage unit ( 180) and the overall operation of the I/O interface unit 190 are controlled.

통신부(140)는 원격의 관리자(200)와 유무선 통신을 수행한다. 통신부(140)는 차량 도난의 경우에는 도난 사실 정보를 원격의 관리자(200) 및 관공서 등에 자동으로 전송한다. 통신부(140)는 3G, 4G, 5G, 차세대 통신 규격에 의한 셀룰러 통신 모듈로 구현될 수 있다. 또는 통신부(140)는 지그비, 와이파이, 블루투스, 적외선 통신 방식으로 직접 통신하거나 인터넷 공유기(미도시)에 접속하여 원격의 관리자(200) 및 관공서 등에 설치된 단말과 통신할 수 있다.The communication unit 140 performs wired/wireless communication with the remote manager 200. In the case of vehicle theft, the communication unit 140 automatically transmits the information about theft to the remote manager 200 and government offices. The communication unit 140 may be implemented as a cellular communication module according to 3G, 4G, 5G, and next-generation communication standards. Alternatively, the communication unit 140 may communicate directly with a ZigBee, Wi-Fi, Bluetooth, or infrared communication method, or connect to an Internet sharer (not shown) to communicate with a remote manager 200 and a terminal installed in a public office.

GPS부(150)는 차량 제어 장치(100)에 구성된다. GPS부(150)는 차량 제어 장치(100)가 설치된 차량의 위치 좌표 정보를 GPS 위성으로부터 수신한 할 수 있다. 또는 GPS부(150)는 통신부(140)를 통해서 접속한 인접 기지국으로부터 위치 좌표를 수신할 수 있다. GPS부(150)는 수신한 위치 좌표 정보를 이용하여 경로 맵을 형성하고, 형성된 경로 맵을 제어부(130)로 전달한다. The GPS unit 150 is configured in the vehicle control device 100. The GPS unit 150 may receive position coordinate information of a vehicle in which the vehicle control device 100 is installed from a GPS satellite. Alternatively, the GPS unit 150 may receive location coordinates from an adjacent base station accessed through the communication unit 140. The GPS unit 150 forms a route map using the received location coordinate information, and transmits the formed route map to the controller 130.

센서부(160)는 차량 제어 장치(100)에 구성된다. 센서부(160)는 차량(10)의 속도, 가속도, 방향, 사람의 접근 여부, 사람의 탑승 여부 등을 센싱하기 위한 다양한 종류의 센서로 구성된다. 센서부(160)는 차량(10)에 인접한 사람을 인식하기 위한 거리 센서, 차량(10)에 사람의 탑승 여부를 인식하기 위한 무게 센서, 가속도 센서 등 다양한 종류로 구현될 수 있다.The sensor unit 160 is configured in the vehicle control device 100. The sensor unit 160 is configured with various types of sensors for sensing the speed, acceleration, direction of the vehicle 10, whether a person approaches, or whether a person is on board. The sensor unit 160 may be implemented in various types, such as a distance sensor for recognizing a person adjacent to the vehicle 10, a weight sensor for recognizing whether a person is on board the vehicle 10, and an acceleration sensor.

듀얼 디스플레이부(170)는 차량 제어 장치(100)의 전방 및 후방에 각각 구성된다. 제1 디스플레이(171)는 장치의 전방에 설치되고, 여기서 전방이란 운전자쪽을 지향하는 방향이다. 제2 디스플레이(172)는 장치의 후방에 설치되고, 여기서 후방이란 운전자측 반대 방향을 지향하는 방향이다.The dual display unit 170 is configured at the front and rear sides of the vehicle control apparatus 100, respectively. The first display 171 is installed in front of the device, where the front is a direction facing the driver. The second display 172 is installed at the rear of the device, where the rear is a direction facing the opposite direction to the driver.

저장부(180)는 차량 제어 장치(100)에 구성된다. 저장부(180)는 사용자에 관한 데이터 세트, 차량 제어 장치(100)를 구성하는 부품에 대한 정보, 차량(10)에 관한 정보, 차량 제어 장치(100)에서 실행되는 응용 소프트웨어 실행파일 등이 저장된다.The storage unit 180 is configured in the vehicle control device 100. The storage unit 180 stores a data set on a user, information on parts constituting the vehicle control device 100, information on the vehicle 10, an application software executable file executed in the vehicle control device 100, and the like. do.

I/O 인터페이스부(190)는 차량 제어 장치(100)에 구성된다. I/O 인터페이스부(190)는 차량 제어 장치(100)에 기타 장치를 연결하여 확장하기 위한 USB, UART, 음성 입/출력 단자, 비디오 입/출력 단자이다. The I/O interface unit 190 is configured in the vehicle control device 100. The I/O interface unit 190 is a USB, UART, audio input/output terminal, and video input/output terminal for connecting and expanding other devices to the vehicle control device 100.

도 2는 본 발명의 일 실시 예에 따른 바이오메트릭 기반 차량 제어 장치의 외관을 예시적으로 설명하는 도면이다. 도 2를 참고하면, 차량 제어 장치(100)는 측면 카메라(111)와 거리 센서(160)가 별도로 분리되어 있다. 측면 카메라(111) 및 거리 센서(160)는 I/O 인터페이스(190)에 의해서 제어부(130)와 정보를 커뮤니케이션한다. 특히, 측면 카메라(111)는 차량(10)에 근접하는 사용자의 얼굴 등의 생체 정보를 확보하여 제어부(130)로 전송한다. 거리 센서(190)는 사용자가 차량(10)에 근접하는지 여부를 판단하여 제어부(130)로 전송한다.2 is a diagram exemplarily illustrating the appearance of a biometric-based vehicle control apparatus according to an embodiment of the present invention. Referring to FIG. 2, in the vehicle control apparatus 100, a side camera 111 and a distance sensor 160 are separately separated. The side camera 111 and the distance sensor 160 communicate information with the controller 130 through the I/O interface 190. In particular, the side camera 111 secures biometric information such as a face of a user who is close to the vehicle 10 and transmits it to the controller 130. The distance sensor 190 determines whether the user is close to the vehicle 10 and transmits it to the controller 130.

차량 제어 장치(100)는 차량의 전방을 촬상하기 위한 전방 카메라(112), 사용자의 지문 정보를 획득할 수 있는 지문 인식기(113) 및 차량 제어 장치(100)의 동작 상태를 확인할 수 있는 램프(LED)를 포함한다. 또한, 차량 제어 장치(100)는 전방에 구비된 전방 디스플레이(171)와 후방에 구비된 후방 디스플레이(172)를 포함한다.The vehicle control device 100 includes a front camera 112 for photographing the front of the vehicle, a fingerprint reader 113 capable of acquiring user's fingerprint information, and a lamp ( LED). In addition, the vehicle control apparatus 100 includes a front display 171 provided at the front and a rear display 172 provided at the rear.

도 3은 도 2에 도시된 차량 제어 장치가 차량에 설치된 일 예를 예시적으로 설명하는 도면이다. 도 3을 참고하면, 평면의 수직상의 임의의 높이에서 차량(10)을 바라볼 경우에 운전석의 왼쪽에 구비된 사이드미러 부분에 측면 카메라(111)를 구비하고, 차량(10)의 운전석의 손잡이 부분에 거리 센서(161)를 구비한다. 그리고 차량(10)의 대쉬 보드에 차량 제어 장치(100)가 설치된다. 차량 제어 장치(100)의 전방 카메라(112)는 차량(10)에 탑승한 사용자를 촬영하기 위하여 운전석 또는 조수석을 지향하도록 구성된다. 또한, 도 3에 도시된 바와 같이 차량 제어 장치(100)는 네트워크를 통해서 원격의 관리자(200)와 통신할 수 있다. 3 is a diagram illustrating an example in which the vehicle control device shown in FIG. 2 is installed in a vehicle. Referring to FIG. 3, when looking at the vehicle 10 from an arbitrary height on the plane, a side camera 111 is provided in the side mirror part provided on the left side of the driver's seat, and the handle of the driver's seat of the vehicle 10 A distance sensor 161 is provided in the part. In addition, the vehicle control device 100 is installed on the dashboard of the vehicle 10. The front camera 112 of the vehicle control apparatus 100 is configured to face a driver's seat or a passenger seat in order to photograph a user in the vehicle 10. In addition, as shown in FIG. 3, the vehicle control apparatus 100 may communicate with a remote manager 200 through a network.

도 4는 본 발명의 일 실시 예에 따른 차량 제어 장치가 설치된 차량에 접근한 사용자에 대한 1차 인증 절차를 예시적으로 도시한 도면이다. 도 4를 참고하면, 사용자가 차량(10)으로부터 일정한 거리 떨어진 상태에 접근하면, 차량 제어 장치(150)의 거리 센서(161)는 사용자의 접근을 감지한다. 사용자의 접근이 감지되면 제1 인증 정보 획득부(111)는 사용자의 얼굴 이미지를 제1 인증 정보로 획득한다. 제1 인증 정보 획득부(111)는 획득된 제1 인증 정보를 인증 처리부(120)로 전송한다. 인증 처리부(120)는 딥러닝 알고리즘에 따라 저장부(180)에 저장된 얼굴 이미지와 촬상된 이미지를 비교하여 해당 사용자에 대한 1차 인증을 실시한다. 4 is a diagram illustrating a first authentication procedure for a user who has access to a vehicle equipped with a vehicle control device according to an embodiment of the present invention. Referring to FIG. 4, when a user approaches a state away from the vehicle 10 by a certain distance, the distance sensor 161 of the vehicle control device 150 detects the user's approach. When the user's approach is detected, the first authentication information acquisition unit 111 acquires the user's face image as the first authentication information. The first authentication information acquisition unit 111 transmits the obtained first authentication information to the authentication processing unit 120. The authentication processing unit 120 compares the face image stored in the storage unit 180 with the captured image according to a deep learning algorithm to perform primary authentication for a corresponding user.

도 5는 본 발명의 일 실시 예에 따른 차량 제어 장치가 설치된 차량에 탑승한 사용자에 대한 2차 인증 절차를 예시적으로 도시한 도면이다. 도 5를 참고하면, 센서부(160)에 의해서 운전석에 차량 탑승 여부를 감지하면, 제2 인증 정보 획득부(112)는 탑승객의 얼굴 이미지를 제2 인증 정보로 획득한다. 제2 인증 정보 획득부(112)는 획득된 제1 인증 정보를 인증 처리부(120)로 전송한다. 인증 처리부(120)는 딥러닝 알고리즘에 따라 저장부(180)에 저장된 얼굴 이미지와 촬상된 얼굴 이미지를 비교하여 해당 사용자에 대한 2차 인증을 실시한다.5 is a diagram illustrating a second authentication procedure for a user in a vehicle equipped with a vehicle control device according to an embodiment of the present invention. Referring to FIG. 5, when detecting whether a vehicle is boarded in the driver's seat by the sensor unit 160, the second authentication information acquisition unit 112 acquires a face image of a passenger as second authentication information. The second authentication information acquisition unit 112 transmits the obtained first authentication information to the authentication processing unit 120. The authentication processing unit 120 compares the face image stored in the storage unit 180 with the captured face image according to a deep learning algorithm to perform secondary authentication for a corresponding user.

도 6은 본 발명의 일 실시 예에 따른 차량 제어 장치가 설치된 차량에 탑승한 사용자에 대한 3차 인증 절차를 예시적으로 설명하는 도면이다. 도 6을 참고하면, 제3 인증 정보 획득부(113)는 탑승객의 지문 패턴 이미지 정보를 제3 인증 정보로 획득한다. 이때 제3 인증 정보 획득부(113)는 지문 인식기로 구성될 수 있다. 제3 인증 정보 획득부(113)는 획득된 제3 인증 정보를 인증 처리부(120)로 전송한다. 인증 처리부(120)는 딥러닝 알고리즘에 따라 저장부(180)에 저장된 지문 이미지와 감지된 지문 이미지를 비교하여 해당 사용자에 대한 3차 인증을 실시한다.6 is a diagram exemplarily illustrating a third authentication procedure for a user who boards a vehicle equipped with a vehicle control device according to an embodiment of the present invention. Referring to FIG. 6, the third authentication information acquisition unit 113 acquires fingerprint pattern image information of a passenger as third authentication information. In this case, the third authentication information acquisition unit 113 may be configured as a fingerprint reader. The third authentication information obtaining unit 113 transmits the obtained third authentication information to the authentication processing unit 120. The authentication processing unit 120 compares the fingerprint image stored in the storage unit 180 with the detected fingerprint image according to a deep learning algorithm, and performs third authentication for a corresponding user.

3차 인증 절차에서 제3 인증 정보와 일치하는 저장부(180)의 저장 정보가 없는 경우에 제어부(130)는 통제 모드로 동작하게 된다. 위에서 설명한 1차, 2차 3차 인증 절차에서 비인증 사용자로 인식된 경우에는 제어부(130)는 비인증 사용자의 차량 접근에 대해서 차단시키는 알림 또는 차량 제어권에 대해서 제한시킬 수 있다. 또한 제어부(130)는 비인증 사용자가 차량(10)에 탑승한 경우에는 차량(10)을 통제 모드로 동작시킬 수 있다. 이하에서는 통제 모드로 동작할 경우에 제어부(130)에 의한 차량(10)의 통제 모드에 대해서 자세히 설명한다.In the third authentication procedure, when there is no storage information of the storage unit 180 that matches the third authentication information, the controller 130 operates in a control mode. In the case of being recognized as a non-authenticated user in the first, second and third authentication procedures described above, the controller 130 may restrict a notification or vehicle control right to block access to the vehicle of the non-authenticated user. In addition, the controller 130 may operate the vehicle 10 in a control mode when an unauthorized user boards the vehicle 10. Hereinafter, when operating in the control mode, the control mode of the vehicle 10 by the controller 130 will be described in detail.

도 7은 도 6에 도시된 3차 인증 절차에서 비인증된 사용자가 탑승한 차량에 대한 통제 모드의 동작을 예시적으로 설명하기 위한 도면이다. 차량(10)에 탑승한 운전자가 비인증 사용자로 판단되면, 차량 제어 장치(100)는 비인증된 정보를 네트워크를 통해서 원격의 관리자(200), 차량(10)의 소유자 단말(미도시) 또는 지정된 관리자 단말(미도시)로 전달한다. 여기서, 원격의 관리자(200)는 해당 차량(10)이 이미 가입한 차량 관리 서비스 업체의 서버 단말이다. 이러한 원격의 관리자(200)는 복수개 존재할 수 있으며, 차량(10)에서 가장 인접한 원격의 관리자(200)에게 비인증된 정보를 전송하거나 사용자가 미리 지정한 원격의 관리자(200)에게 비인증된 정보를 전송할 수 있다.FIG. 7 is a diagram illustrating an operation of a control mode for a vehicle in which an unauthenticated user boards in the third authentication procedure shown in FIG. 6. When the driver who boards the vehicle 10 is determined to be an unauthorized user, the vehicle control device 100 transmits the unauthorized information to the remote manager 200, the owner terminal (not shown) of the vehicle 10, or a designated manager through the network. Delivered to the terminal (not shown). Here, the remote manager 200 is a server terminal of a vehicle management service company to which the vehicle 10 has already subscribed. A plurality of such remote managers 200 may exist, and unauthorized information can be transmitted to the remote manager 200 closest to the vehicle 10 or unauthorized information can be transmitted to the remote manager 200 previously designated by the user. have.

도 7(a)는 원격의 관리자(200)가 비인증된 정보를 수신한 후, 해당 차량(10)의 위치 정보를 요청하여 최신의 위치 정보를 갱신한다. 원격의 관리자(200)는 수신한 위취 정보와 자신의 위치 정보를 비용하여 해당 차량(10)과 원격의 관리자(200) 사이의 경로를 연산한다. 원격의 관리자(200)는 연산된 경로에 실시간 교통 정보 등을 고려하여 예상 소요 시간을 연산한다. 원격의 관리자(200)는 예상 소요 시간이 기 결정된 시간(예를 들어, 10분)보다 작은 경우(통제 영역 내에 있는 경우)이다. 7(a) shows that after the remote manager 200 receives unauthorized information, it requests the location information of the vehicle 10 to update the latest location information. The remote manager 200 calculates a path between the vehicle 10 and the remote manager 200 at the expense of the received location information and its own location information. The remote manager 200 calculates the estimated time required by considering real-time traffic information on the calculated route. The remote manager 200 is a case in which the estimated time required is less than a predetermined time (eg, 10 minutes) (if it is within the control area).

이 경우에는 통제 영역 내에 있는 것으로 판단한다. 원격의 관리자(200)는 통제 영역에 있는 차량(10)에 대해서 직접 제어를 통해서 통제 영역 내의 특정 지역 또는 통제 영역 외에 별도의 지정된 위치로 차량(10)을 이동하도록 제어한다. 이때 특정 지역은 큰 도로변, 공공기관, 관공소, 주차장 등 위치 정보가 미리 지정된 지역이다. In this case, it is determined that it is within the control area. The remote manager 200 controls the vehicle 10 in the control area to move to a specific area in the control area or to a separate designated location outside the control area through direct control. At this time, a specific area is an area in which location information such as large roadsides, public institutions, public offices, and parking lots is pre-designated.

도 7(b)는 원격의 관리자(200)가 비인증된 정보를 수신한 후, 해당 차량(10)의 위치 정보를 요청하여 최신의 위치 정보를 갱신한다. 원격의 관리자(200)는 수신한 위취 정보와 자신의 위치 정보를 비용하여 해당 차량(10)과 원격의 관리자(200) 사이의 경로를 연산한다. 원격의 관리자(200)는 연산된 경로에 실시간 교통 정보 등을 고려하여 예상 소요 시간을 연산한다. 원격의 관리자(200)는 예상 소요 시간이 기 결정된 시간(예를 들어, 10분)보다 큰 경우(통제 영역을 벗어난 경우)이다. 7(b) shows that after the remote manager 200 receives unauthorized information, it requests the location information of the vehicle 10 to update the latest location information. The remote manager 200 calculates a path between the vehicle 10 and the remote manager 200 at the expense of the received location information and its own location information. The remote manager 200 calculates the estimated time required by considering real-time traffic information on the calculated route. The remote manager 200 is a case in which the estimated time required is greater than a predetermined time (eg, 10 minutes) (out of the control area).

이 경우에는 원격의 관리자(200)는 해당 차량(10)에 대한 직접 통제보다는 해당 차량(10)을 현재 위치에서 회수 가능한 위치로 이동하도록 해당 차량(10)에 설치된 차량 제어 장치(100)로 제어 신호를 전송하고, 실시간으로 해당 차량(10)의 위치 정보를 수신하여 위치를 모니터링한다.In this case, the remote manager 200 controls the vehicle control device 100 installed in the vehicle 10 to move the vehicle 10 from the current position to a recoverable position rather than directly controlling the vehicle 10 A signal is transmitted, and location information of the vehicle 10 is received in real time to monitor the location.

도 8은 본 발명의 다른 실시 예에 따른 바이오메트릭 기반 차량 제어 장치를 이용한 차량 제어 방법의 과정을 예시적으로 설명하는 흐름도이다. 도 8을 참고하면, 차량 제어 장치(100)는 거리 센서(161)를 이용하여 차량(10)에 접근하는 사용자를 감지한다(제1 단계). 차량(10)에 인접한 사용자의 생체 정보를 획득할 수 있는 상황에서 1차 인증 정보를 획득한다(제2 단계). 이때 차량 제어 장치(100)는 측면 카메라(111)를 이용하여 사용자의 얼굴 이미지 정보를 촬상하여 1차 인증 정보를 획득한다. 차량 제어 장치(100)는 획득한 1차 인증 정보를 이용하여 1차 인증을 진행한다(제3 단계). 1차 인증 절차는 촬상한 이미지에 대해서 딥러닝 기반으로 미리 등록된 사용자 이미지와의 매칭율을 이용하여 인증 여부를 처리한다. 예컨대, CNN(Convolution Neural Network) 알고리즘에 기반하여 이미지 분류를 진행하고, 매핑율이 기 정해진 값을 초과할 경우에 해당 사용자에 대한 인증된 사용자로 판단한다. 만약 촬상한 이미지에 대한 매칭율이 기 정해진 값보다 작은 경우에는 해당 사용자를 비인증된 사용자로 판단한다. 인증된 사용자일 경우에는 정상모드로 진행하고, 차량 도어의 잠금을 해제시켜준다(제5 단계).8 is a flowchart illustrating a process of a vehicle control method using a biometric-based vehicle control device according to another embodiment of the present invention. Referring to FIG. 8, the vehicle control apparatus 100 detects a user approaching the vehicle 10 using the distance sensor 161 (step 1). In a situation in which biometric information of a user adjacent to the vehicle 10 can be obtained, primary authentication information is obtained (second step). At this time, the vehicle control device 100 acquires primary authentication information by capturing the user's face image information using the side camera 111. The vehicle control device 100 performs primary authentication using the acquired primary authentication information (third step). The first authentication procedure processes whether or not the captured image is authenticated using a matching rate with a user image registered in advance based on deep learning. For example, image classification is performed based on a convolution neural network (CNN) algorithm, and when the mapping rate exceeds a predetermined value, it is determined as an authenticated user for the corresponding user. If the matching rate for the captured image is less than a predetermined value, the corresponding user is determined as an unauthorized user. In the case of an authenticated user, it proceeds to the normal mode and unlocks the vehicle door (step 5).

만약, 차량 제어 장치(100)는 해당 사용자를 비인증으로 판단하면, 해당 차량(10)의 도어 개폐 여부를 판단한다(제6 단계). 만약 차량(10)의 도어가 열려있지 않은 경우에는 1차 인증 정보를 획득하는 제1 단계를 반복한다. 비인증된 사용자에 대한 1차 인증 절차의 반복 횟수는 1회 이상일 수 있다. 제6 단계에서 차량(10)의 도어가 열려진 것으로 판단되면, 비인증된 사용자가 차량(10)에 접근한 사실을 메세지로 기 정해진 단말 또는 원격의 관리자(200)로 전송한다. 그리고, 차량(10)에 사용자가 운전석에 탑승한 것으로 판단되면, 해당 탑승자에 대한 2차 인증 정보를 획득한다(제7 단계). 이때 차량 제어 장치(100)는 측면 카메라(111)를 이용하여 사용자의 얼굴 이미지 정보를 촬상하여 2차 인증 정보를 획득한다. 차량 제어 장치(100)는 획득한 2차 인증 정보를 이용하여 2차 인증을 진행한다(제8 단계). If the vehicle control apparatus 100 determines that the user is not authenticated, it determines whether the door of the vehicle 10 is opened or closed (step 6). If the door of the vehicle 10 is not open, the first step of acquiring primary authentication information is repeated. The number of repetitions of the primary authentication procedure for an unauthenticated user may be one or more. If it is determined that the door of the vehicle 10 is open in the sixth step, the fact that the unauthorized user has approached the vehicle 10 is transmitted as a message to a predetermined terminal or to the remote manager 200. Then, when it is determined that the user is in the driver's seat of the vehicle 10, secondary authentication information for the corresponding occupant is obtained (step 7). At this time, the vehicle control device 100 acquires secondary authentication information by capturing the user's face image information using the side camera 111. The vehicle control device 100 performs secondary authentication using the acquired secondary authentication information (step 8).

2차 인증 절차는 촬상한 이미지에 대해서 딥러닝 기반으로 미리 등록된 사용자 이미지와의 매칭율을 이용하여 인증 여부를 처리한다. 예컨대, CNN(Convolution Neural Network) 알고리즘에 기반하여 이미지 분류를 진행하고, 매핑율이 기 정해진 값을 초과할 경우에 해당 탑승자를 인증된 사용자로 판단한다. 만약 촬상한 이미지에 대한 매칭율이 기 정해진 값보다 작은 경우에는 해당 탑승자를 비인증된 사용자로 판단한다. 인증된 사용자일 경우에는 차량에 대한 제어를 허락한다(제9 단계).In the second authentication procedure, authentication is performed using a matching rate with a user image registered in advance based on deep learning for a captured image. For example, image classification is performed based on a Convolution Neural Network (CNN) algorithm, and when the mapping rate exceeds a predetermined value, a corresponding occupant is determined as an authenticated user. If the matching rate for the captured image is less than a predetermined value, the corresponding occupant is determined as an unauthorized user. In the case of an authenticated user, control of the vehicle is allowed (Step 9).

만약, 차량 제어 장치(100)는 해당 탑승자를 비인증 사용자로 판단하면, 해당 탑승자에 대한 3차 인증 정보를 획득하는 절차를 진행한다(제10 단계). 이때, 3차 인증 정보는 해당 탑승자의 생체 정보 또는 비생체 정보이다. 생체 정보일 경우에는 해당 탑승자의 얼굴 정보 이외의 생체 정보를 3차 인증 정보로 획득한다. 이때 이때 차량 제어 장치(100)는 지문 인식기(112)를 이용하여 해당 탑승자의 지문을 광학적인 방식으로 스캔하여 지문 정보를 3차 인증 정보로 획득한다. 차량 제어 장치(100)는 획득한 3차 인증 정보를 이용하여 3차 인증을 진행한다(제11 단계).If the vehicle control apparatus 100 determines that the corresponding occupant is a non-authenticated user, the vehicle control apparatus 100 proceeds with a procedure of obtaining third authentication information for the corresponding occupant (step 10). In this case, the third authentication information is biometric information or non-biometric information of the corresponding occupant. In the case of biometric information, biometric information other than the face information of the corresponding occupant is obtained as third authentication information. At this time, the vehicle control device 100 acquires the fingerprint information as tertiary authentication information by optically scanning the fingerprint of the corresponding occupant using the fingerprint reader 112. The vehicle control apparatus 100 performs third authentication using the obtained third authentication information (step 11).

3차 인증 절차는 스캔한 지문 이미지에 대해서 딥러닝 기반으로 미리 등록된 사용자 지문 이미지와의 매칭율을 이용하여 인증 여부를 처리한다. 예컨대, CNN(Convolution Neural Network) 알고리즘에 기반하여 이미지 분류를 진행하고, 매핑율이 기 정해진 값을 초과할 경우에 해당 탑승자를 인증된 사용자로 판단한다. 만약 스캔한 지문 이미지에 대한 매칭율이 기 정해진 값보다 작은 경우에는 해당 탑승자를 비인증된 사용자로 판단한다. 인증된 사용자일 경우에는 차량에 대한 제어를 허락한다(제12 단계). In the third authentication procedure, authentication is performed using the matching rate of the scanned fingerprint image with the user's fingerprint image registered in advance based on deep learning. For example, image classification is performed based on a Convolution Neural Network (CNN) algorithm, and when the mapping rate exceeds a predetermined value, a corresponding occupant is determined as an authenticated user. If the matching rate for the scanned fingerprint image is smaller than a predetermined value, the corresponding occupant is determined as an unauthenticated user. In the case of an authenticated user, control of the vehicle is allowed (step 12).

만약, 차량 제어 장치(100)는 해당 탑승자를 비인증 사용자로 판단하면, 해당 차량에 대한 통제 모드를 실행한다(제13 단계). 차량 제어 장치(100)는 차량에 대한 통제가 필요한 상황 정보를 원격의 관리자(100) 또는 미리 지정된 사용자에게 전달한다. 원격의 관리자(100)는 해당 차량(10)으로부터 수신한 위치 정보를 이용하여 해당 차량(10)에 대한 직접 통제가 가능하지 아니면 간접 통제가 가능한지 판단한다(제14 단계).If the vehicle control apparatus 100 determines that the occupant is an unauthorized user, the vehicle control apparatus 100 executes a control mode for the vehicle (step 13). The vehicle control device 100 transmits information on a situation requiring control of the vehicle to the remote manager 100 or a predetermined user. The remote manager 100 determines whether direct control of the vehicle 10 or indirect control is possible using the location information received from the vehicle 10 (step 14).

만약 직접 통제가 가능한 상황이면, 원격의 관리자(200)는 차량(10)을 직접 제어함으로써 특정 지점으로 차량(10)을 이동시킨다(제15 단계). 직접 통제가 불가능한 상황이라면, 원격의 관리자(200)는 해당 차량(10)을 현재 위치에서 특정 위치로 이동시키도록 제어 신호를 차량(10)의 차량 제어 장치(100)로 전송하여 간접 d제어를 실행시킨다(제16 단계).If direct control is possible, the remote manager 200 moves the vehicle 10 to a specific point by directly controlling the vehicle 10 (step 15). If direct control is not possible, the remote manager 200 transmits a control signal to the vehicle control device 100 of the vehicle 10 to move the vehicle 10 from the current location to a specific location to perform indirect d control. Run it (Step 16).

상술한 차량 제어 방법은 1차 인증 절차와 2차 인증 절차를 필수적으로 포함하고, 1차 인증 절차 이후에 3차 인증 절차를 진행하거나 1차, 2차 및 3차 인증 절차를 순차적으로 진행하거나 1차 내지 3차 인증 절차 이외에 추가적인 인증 절차를 진행하도록 설계를 다양하게 변경할 수 있다.The vehicle control method described above essentially includes a first authentication procedure and a second authentication procedure, and proceeds with the third authentication procedure after the first authentication procedure, or sequentially proceeds with the first, second and third authentication procedures, or 1 In addition to the second to third authentication procedures, the design can be variously changed to proceed with an additional authentication procedure.

한편, 본 발명의 실시 예를 구성하는 모든 구성 요소들이 하나로 결합하거나 결합하여 동작하는 것으로 설명되었다고 해서, 본 발명이 반드시 이러한 실시 예에 한정되는 것은 아니다. 즉, 본 발명의 목적 범위 안에서라면, 그 모든 구성 요소들이 하나 이상으로 선택적으로 결합하여 동작할 수도 있다. 또한, 그 모든 구성요소들이 각각 하나의 독립적인 하드웨어로 구현될 수 있지만, 각 구성 요소들의 그 일부 또는 전부가 선택적으로 조합되어 하나 또는 복수 개의 하드웨어에서 조합된 일부 또는 전부의 기능을 수행하는 프로그램 모듈을 갖는 컴퓨터 프로그램으로서 구현될 수도 있다. 그 컴퓨터 프로그램을 구성하는 코드들 및 코드 세그먼트들은 본 발명의 기술 분야의 당업자에 의해 용이하게 추론될 수 있을 것이다. 이러한 컴퓨터 프로그램은 컴퓨터가 읽을 수 있는 비일시적 저장매체(non-transitory computer readable media)에 저장되어 컴퓨터에 의하여 읽혀지고 실행됨으로써, 본 발명의 실시 예를 구현할 수 있다.On the other hand, even if all the constituent elements constituting an embodiment of the present invention are described as being combined into one or operating in combination, the present invention is not necessarily limited to this embodiment. That is, within the scope of the object of the present invention, all of the constituent elements may be selectively combined and operated in one or more. In addition, although all of the components may be implemented as one independent hardware, a program module that performs some or all functions combined in one or more hardware by selectively combining some or all of the components. It may be implemented as a computer program having Codes and code segments constituting the computer program may be easily inferred by those skilled in the art of the present invention. Such a computer program is stored in a non-transitory computer readable media that can be read by a computer and is read and executed by a computer, thereby implementing an embodiment of the present invention.

여기서 비일시적 판독 가능 기록매체란, 레지스터, 캐시(cache), 메모리 등과 같이 짧은 순간 동안 데이터를 저장하는 매체가 아니라, 반영구적으로 데이터를 저장하며, 기기에 의해 판독(reading)이 가능한 매체를 의미한다. 구체적으로, 상술한 프로그램들은 CD, DVD, 하드 디스크, 블루레이 디스크, USB, 메모리 카드, ROM 등과 같은 비일시적 판독가능 기록매체에 저장되어 제공될 수 있다.Here, the non-transitory readable recording medium is not a medium that stores data for a short moment, such as a register, cache, memory, etc., but a medium that stores data semi-permanently and can be read by a device. . Specifically, the above-described programs may be provided by being stored in a non-transitory readable recording medium such as a CD, DVD, hard disk, Blu-ray disk, USB, memory card, ROM, or the like.

이상에서는 본 발명의 바람직한 실시 예에 대하여 도시하고 설명하였지만, 본 발명은 상술한 특정의 실시 예에 한정되지 아니하며, 청구범위에 청구하는 본 발명의 요지를 벗어남이 없이 당해 발명이 속하는 기술분야에서 통상의 지식을 가진 자에 의해 다양한 변형실시가 가능한 것은 물론이고, 이러한 변형실시들은 본 발명의 기술적 사상이나 전망으로부터 개별적으로 이해되어서는 안 될 것이다.In the above, preferred embodiments of the present invention have been illustrated and described, but the present invention is not limited to the specific embodiments described above, and is generally used in the technical field to which the present invention pertains without departing from the gist of the present invention claimed in the claims. Of course, various modifications may be made by those skilled in the art, and these modifications should not be understood individually from the technical idea or perspective of the present invention.

본 발명은 차량에 적용될 수 있으며, 차량의 도난 방지를 위한 보안 시스템에 적용됨으로서 산업상 이용가능성이 있습니다.The present invention can be applied to a vehicle and has industrial applicability as it is applied to a security system for preventing theft of a vehicle.

Claims (10)

바이오메트릭 기반 차량 제어 장치에 있어서,In the biometric-based vehicle control device, 차량의 외부에 접근한 사용자에 대한 제1 인증 처리를 수행하기 위해서 해당 사용자의 제1 인증 정보를 획득하는 제1 인증 정보 획득부;A first authentication information acquisition unit that acquires first authentication information of a corresponding user in order to perform a first authentication process for a user who has approached the outside of the vehicle; 차량에 탑승한 사용자에 대한 제2 인증 처리를 수행하기 위해서 해당 사용자의 제2 인증 정보를 획득하는 제2 인증 정보 획득부;A second authentication information acquisition unit that acquires second authentication information of a corresponding user in order to perform a second authentication process for a user in the vehicle; 상기 제1 인증 정보 또는 상기 제2 인증 정보를 이용하여 해당 사용자에 대한 제1 및 제2 인증 처리를 수행하는 인증 처리부; 및An authentication processing unit that performs first and second authentication processing for a corresponding user by using the first authentication information or the second authentication information; And 상기 인증 처리부의 결과에 따라 인증된 사용자에 대해서는 차량의 제어를 허용하고, 비인증된 사용자에 대해서는 차량의 제어를 허용하지 않으면서, 해당 차량의 제어를 원격의 관리자에게 허용하도록 처리하는 제어부;를 포함하는 바이오메트릭 기반 차량 제어 장치.And a control unit that allows control of the vehicle to an authenticated user according to the result of the authentication processing unit, and does not allow control of the vehicle to an unauthorized user, and allows control of the vehicle to a remote administrator; and Biometric-based vehicle control device. 제1 항에 있어서,The method of claim 1, 상기 인증 처리부에 의해서 상기 제1 인증 처리 또는 상기 제2 인증 처리의 결과에서 해당 사용자가 비인증 사용자로 판정되면, 상기 제1 인증 정보 및 상기 제2 인증 정보와 다른 종류의 생체 정보 또는 비생체 정보를 제3 인증 정보로 획득하는 제3 인증 정보 획득부;를 더 포함하는 것을 특징으로 하는 바이오메트릭 기반 차량 제어 장치.If the user is determined to be a non-authenticated user from the result of the first authentication processing or the second authentication processing by the authentication processing unit, biometric information or non-biometric information of a different type from the first authentication information and the second authentication information A biometric-based vehicle control apparatus further comprising: a third authentication information acquisition unit that obtains the third authentication information as the third authentication information. 제1 항에 있어서,The method of claim 1, 상기 제1 인증 정보 획득부는, 해당 사용자의 얼굴 정보, 홍체 정보, 정맥 정보, 제스처 정보 및 음성 정보 중 적어도 하나를 상기 제1 인증 정보로 획득하는 것을 특징으로 하는 바이오메트릭 기반 차량 제어 장치. The first authentication information acquisition unit obtains at least one of face information, iris information, vein information, gesture information, and voice information of a corresponding user as the first authentication information. 제1 항에 있어서,The method of claim 1, 상기 제2 인증 정보 획득부는, 해당 사용자의 얼굴 정보, 홍체 정보, 정맥 정보, 제스처 정보 및 음성 정보 중 적어도 하나를 상기 제2 인증 정보로 획득하는 것을 특징으로 하는 바이오메트릭 기반 차량 제어 장치.The second authentication information obtaining unit obtains at least one of face information, iris information, vein information, gesture information, and voice information of a corresponding user as the second authentication information. 제2 항에 있어서,The method of claim 2, 상기 제3 인증 정보 획득부는, 상기 제1 인증 정보 및 상기 제2 인증 정보와 다른 종류이되, 얼굴 정보, 홍체 정보, 정맥 정보, 제스처 정보 및 음성 정보 중 적어도 하나를 상기 제3 인증 정보로 획득하고,The third authentication information acquisition unit acquires, as the third authentication information, at least one of face information, iris information, vein information, gesture information, and voice information, which is of a type different from the first authentication information and the second authentication information. , 상기 인증 처리부는, 상기 제3 인증 정보에 기초하여 해당 사용자를 인증하는 것을 특징으로 하는 바이오메트릭 기반 차량 제어 장치.The authentication processing unit, the biometric-based vehicle control device, characterized in that for authenticating the user based on the third authentication information. 제1 항에 있어서,The method of claim 1, 상기 제어부는, 해당 차량에 탑승한 사용자가 비인증된 사용자로 판정되면, 해당 차량의 GPS 모듈, 무선 통신 모듈, 카메라 모듈, 각종의 센서 모듈을 활성화하도록 제어하는 것을 특징으로 하는 바이오메트릭 기반 차량 제어 장치.The control unit controls to activate a GPS module, a wireless communication module, a camera module, and various sensor modules of the vehicle when it is determined that the user in the vehicle is an unauthorized user. . 제6 항에 있어서,The method of claim 6, 상기 제어부는, 해당 차량의 위치에서 상기 원격의 관리자의 위치까지의 소요 시간이 기 결정된 크기 이하이면 해당 차량에 대한 제어를 상기 원격의 관리자에게 허용하고, 상기 경로 거리 또는 소요 시간이 기 결정된 크기를 초과하면 해당 차량을 특정 지점까지 이동하도록 제어하는 것을 특징으로 하는 바이오메트릭 기반 차량 제어 장치.If the required time from the location of the vehicle to the location of the remote manager is less than or equal to a predetermined size, the control unit allows the control of the vehicle to the remote manager, and the route distance or the required time determines a predetermined size. If exceeded, the vehicle control device based on biometrics, characterized in that for controlling the vehicle to move to a specific point. 제1 인증 정보 획득부, 제2 인증 정보 획득부, 제3 인증 정보 획득부, 인증 처리부 및 제어부를 포함하는 차량 제어 장치를 이용한 바이오메트릭 기반 차량 제어 방법에 있어서,In a biometric-based vehicle control method using a vehicle control device including a first authentication information acquisition unit, a second authentication information acquisition unit, a third authentication information acquisition unit, an authentication processing unit, and a control unit, 상기 제1 인증 정보 획득부는, 차량의 외부에 접근한 사용자에 대한 제1 인증 정보를 획득하는 단계;The first authentication information obtaining unit may include: obtaining first authentication information for a user who has approached the outside of the vehicle; 상기 인증 처리부는, 상기 제1 인증 정보를 이용하여 해당 사용자에 대한 제1 인증 처리를 수행하는 단계;The authentication processing unit may include performing a first authentication process for a corresponding user by using the first authentication information; 상기 제어부는, 상기 제1 인증 처리를 수행하는 단계에서 해당 사용자가 인증 사용자로 판정되면 차량에 탑승한 사용자에 대한 제2 인증 정보를 획득하게 하고, 해당 사용자가 비인증 사용자로 판정되면 차량 도어가 열린 경우에 메세지를 발생시키도록 처리하는 제1 제어 처리를 수행하는 단계;In the step of performing the first authentication process, the control unit, when the user is determined to be an authenticated user, obtains second authentication information for the user who boarded the vehicle, and when the user is determined to be an unauthenticated user, the vehicle door is opened. Performing a first control process of processing to generate a message in case; 상기 제2 인증 정보 획득부는, 차량에 탑승한 사용자에 대한 제2 인증 정보를 획득하는 단계;The second authentication information obtaining unit may include: obtaining second authentication information for a user who has boarded the vehicle; 상기 인증 처리부는, 상기 제2 인증 정보를 이용하여 해당 사용자에 대한 제2 인증 처리를 수행하는 단계; 및The authentication processing unit may include performing a second authentication process for a corresponding user by using the second authentication information; And 상기 제어부는, 상기 제2 인증 처리를 수행하는 단계에서 해당 사용자가 인증 사용자로 판정되면 해당 차량의 제어를 해당 사용자에게 허용하고, 해당 사용자가 비인증 사용자로 판정되면 해당 차량의 제어를 원격의 관리자에게 허용하는 제2 제어 처리를 수행하는 단계;를 포함하는 바이오메트릭 차량 제어 장치를 이용한 차량 제어 방법.In the step of performing the second authentication process, the controller allows control of the vehicle to the user if the user is determined to be an authenticated user, and if the user is determined to be an unauthorized user, the control unit transfers control of the vehicle to a remote administrator. A vehicle control method using a biometric vehicle control device comprising a; performing a second control processing to be allowed. 제8 항에 있어서,The method of claim 8, 상기 제2 제어 처리를 수행하는 단계에서, 상기 제3 인증 정보 획득부는 비인증 사용자로 판정된 사용자로부터 상기 제1 인증 정보 및 상기 제2 인증 정보와 다른 종류의 생체 정보 또는 비생체 정보인 제3 인증 정보를 획득하는 단계; In the step of performing the second control processing, the third authentication information obtaining unit provides a third authentication of biometric information or non-biometric information different from the first authentication information and the second authentication information from a user determined to be an unauthorized user. Obtaining information; 상기 제2 제어 처리를 수행하는 단계에서, 상기 인증 처리부는 상기 제3 인증 정보를 이용하여 해당 사용자에 대한 제3 인증 처리를 수행하는 단계; 및In the step of performing the second control processing, the authentication processing unit performing a third authentication processing for a corresponding user by using the third authentication information; And 상기 제3 인증 처리를 수행하는 단계 이후에, 상기 제어부는 해당 사용자가 인증 사용자로 판정되면 해당 차량의 제어를 해당 사용자에게 허용하고, 해당 사용자가 비인증 사용자로 판정되면 해당 차량의 제어를 원격의 관리자에게 허용하도록 처리하는 제3 제어 처리를 수행하는 단계;를 포함하는 바이오메트릭 차량 제어 장치를 이용한 차량 제어 방법.After the step of performing the third authentication process, the controller allows the user to control the vehicle if the user is determined to be an authenticated user, and if the user is determined to be an unauthenticated user, the controller remotely controls the vehicle. A vehicle control method using a biometric vehicle control device comprising a; performing a third control processing to allow processing to be allowed. 제9 항에 있어서,The method of claim 9, 상기 제어부는, 상기 인증 처리부에 의해서 차량에 탑승한 사용자가 비인증된 사용자로 판정되면, 해당 차량의 GPS 모듈, 무선 통신 모듈, 카메라 모듈, 각종의 센서 모듈을 활성화하는 단계; 및The control unit may further include, when it is determined by the authentication processing unit that the user in the vehicle is an unauthorized user, activating a GPS module, a wireless communication module, a camera module, and various sensor modules of the vehicle; And 해당 차량의 위치에서 상기 원격의 관리자의 위치까지의 소요 시간이 기 결정된 크기 이하이면 해당 차량에 대한 통제권을 상기 원격의 관리자에게 허용하고, 상기 소요 시간이 기 결정된 크기를 초과하면 해당 차량을 특정 지점까지 이동하도록 제어하는 단계;를 포함하는 바이오메트릭 차량 제어 장치를 이용한 차량 제어 방법.If the time required from the location of the vehicle to the location of the remote manager is less than or equal to a predetermined size, control of the vehicle is allowed to the remote manager, and if the required time exceeds the predetermined size, the vehicle is placed at a specific point. Controlling to move to; vehicle control method using a biometric vehicle control device comprising a.
PCT/KR2019/017193 2019-10-01 2019-12-07 Biometrics-based vehicle control device and vehicle control method using same Ceased WO2021066252A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020190121300A KR102093858B1 (en) 2019-10-01 2019-10-01 Biometrics-based vehicle control device and vehicle control method using same
KR10-2019-0121300 2019-10-01

Publications (1)

Publication Number Publication Date
WO2021066252A1 true WO2021066252A1 (en) 2021-04-08

Family

ID=69958592

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2019/017193 Ceased WO2021066252A1 (en) 2019-10-01 2019-12-07 Biometrics-based vehicle control device and vehicle control method using same

Country Status (2)

Country Link
KR (1) KR102093858B1 (en)
WO (1) WO2021066252A1 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113696851A (en) * 2021-08-27 2021-11-26 上海仙塔智能科技有限公司 Vehicle control method, device, equipment and medium based on vehicle exterior gesture
US20230037991A1 (en) * 2021-08-03 2023-02-09 Subaru Corporation Occupant-dependent setting system for vehicle, and vehicle
US12252094B2 (en) 2020-05-21 2025-03-18 Lodestar Licensing Group Llc Security notification based on biometric identifier

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102681002B1 (en) * 2022-05-24 2024-07-03 광주대학교산학협력단 Vehicle control system and method using multi-factor authentication

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20040029211A (en) * 2002-09-25 2004-04-06 현대자동차주식회사 An antitheft device and the control method of automobile
JP2005232989A (en) * 2004-02-17 2005-09-02 Tokai Rika Co Ltd Engine starting control device
US20070290794A1 (en) * 2006-06-19 2007-12-20 Denso Corporation Vehicular control system
KR20090060506A (en) * 2007-12-10 2009-06-15 박완규 Driver authentication system
JP2018141812A (en) * 2013-10-17 2018-09-13 みこらった株式会社 Automatic driving car, theft prevention program for automatic driving car and rental method for automatic driving car

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100331641B1 (en) 1999-05-13 2002-04-09 이계안 Method for burglarproofing of vehicle
KR101165106B1 (en) 2006-11-09 2012-07-12 현대자동차주식회사 Driver certification device and method that do fetters in face realization
KR20120074820A (en) 2010-12-28 2012-07-06 대성전기공업 주식회사 Control system for vehicle using face recognition function
KR101271081B1 (en) 2011-10-31 2013-06-04 대성전기공업 주식회사 Driver recognition system and the method for controlling the same
KR101859761B1 (en) 2012-05-24 2018-05-21 현대모비스 주식회사 Face Authentication Apparatus and Method for vehicle
KR101909345B1 (en) 2016-12-19 2018-10-17 전자부품연구원 Vehicle Security Method and System using Iris Recognition and Face Recognition
KR101962750B1 (en) 2017-11-06 2019-04-01 주식회사 에스티씨 Vehicle starting Control System by Using Face Perception Data and Method thereof
KR101922376B1 (en) 2018-06-14 2018-11-26 정규택 Method for sharing and start controlling of vehicle driving information in user terminal using face recognition function
KR102005040B1 (en) 2019-02-28 2019-07-29 송혜선 Vehicle quick starting Control System by Using Face Perception Data and Smart Terminal and Method thereof

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20040029211A (en) * 2002-09-25 2004-04-06 현대자동차주식회사 An antitheft device and the control method of automobile
JP2005232989A (en) * 2004-02-17 2005-09-02 Tokai Rika Co Ltd Engine starting control device
US20070290794A1 (en) * 2006-06-19 2007-12-20 Denso Corporation Vehicular control system
KR20090060506A (en) * 2007-12-10 2009-06-15 박완규 Driver authentication system
JP2018141812A (en) * 2013-10-17 2018-09-13 みこらった株式会社 Automatic driving car, theft prevention program for automatic driving car and rental method for automatic driving car

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12252094B2 (en) 2020-05-21 2025-03-18 Lodestar Licensing Group Llc Security notification based on biometric identifier
US20230037991A1 (en) * 2021-08-03 2023-02-09 Subaru Corporation Occupant-dependent setting system for vehicle, and vehicle
CN113696851A (en) * 2021-08-27 2021-11-26 上海仙塔智能科技有限公司 Vehicle control method, device, equipment and medium based on vehicle exterior gesture

Also Published As

Publication number Publication date
KR102093858B1 (en) 2020-03-26

Similar Documents

Publication Publication Date Title
WO2021066252A1 (en) Biometrics-based vehicle control device and vehicle control method using same
WO2013100699A1 (en) Method, apparatus, and computer-readable recording medium for authenticating a user
JP7075702B2 (en) Entry / exit authentication system and entry / exit authentication method
US20040042643A1 (en) Instant face recognition system
JP7218837B2 (en) GATE DEVICE, AUTHENTICATION SYSTEM, GATE DEVICE CONTROL METHOD AND PROGRAM
JP4177629B2 (en) Personal authentication device, personal authentication method, entrance / exit management device, and entrance / exit management method
KR102153880B1 (en) Entering and Leaving Management System by Face Certification at office and Method thereof
JP2018169943A (en) Face authentication processing device, face authentication processing method, and face authentication processing system
WO2022045507A1 (en) Authentication method and apparatus for gate entrance
KR101596363B1 (en) Access Control Apparatus and Method by Facial Recognition
KR100914994B1 (en) Method and apparatus for entrance and exit control using recognition of identification card
KR20180085337A (en) Security gate system with tactile intrusion detection sensor
WO2022045508A1 (en) Authentication method and system for gate access
US12019722B2 (en) System, device and method for authentication with use of information code
KR102069567B1 (en) Structured Cabling System Using Biometric Authentication
JP7613485B2 (en) Biometric authentication control unit, system, control method for a biometric authentication control unit, and computer program
JP2010044619A (en) System and method for controlling access to object
JP2008158678A (en) Person authentication device, person authentication method, and entrance / exit management system
JP7768301B2 (en) Gate device, biometric authentication control unit, system, gate device control method, and computer program
KR20090041619A (en) Access control system
JP2006099687A (en) User authentication device
KR100804798B1 (en) Iris recognition system and method, security system and method using same
KR20050059359A (en) A system for controlling the exit and entry using a camera built-in no-touch type card reader
CN113554789A (en) Traffic control method and traffic equipment
JP2008059179A (en) Gate monitoring system and gate monitoring method

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19948139

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19948139

Country of ref document: EP

Kind code of ref document: A1