JP7571834B2 - Mobile object authentication system, mobile object authentication method, and mobile object authentication program - Google Patents

Description

The present invention relates to an authentication system for a mobile object, an authentication method for a mobile object, and an authentication program for a mobile object.

For example, when a driver of a car is a beginner, an elderly person, or a person with mild dementia, the driver is designated as a person to be protected, and a configuration has been disclosed in which the guardian sets restrictions on the operation of the person to be protected, thereby restricting the operation of the person to be protected (see, for example, Patent Document 1).

JP 2011-192031 A

However, the configuration disclosed in Patent Document 1 requires the guardian to set restrictions on the operation of the protected person, which requires the guardian's effort.

The present invention has been made in consideration of the above-mentioned circumstances, and its purpose is to provide a mobile object authentication system, a mobile object authentication method, and a mobile object authentication program that can automatically set restrictions on the operations of the protected person, who is the driver, and increase convenience.

According to the invention described in claim 1, the vehicle includes a driver identification unit (4c) that identifies a driver of a moving body using an authentication result of a mobile device authentication by a mobile device and an authentication result of biometric authentication by a biometric sensor , an authority condition information storage unit (4e) that stores a correspondence between at least one person and a functional restriction as authority condition information, and a functional restriction assignment unit (4f) that assigns a functional restriction associated with the identified driver when the driver is identified by the driver identification unit. The driver identification unit receives user position information indicating whether the position of a passenger carrying the mobile device is in the driver's seat or other than the driver's seat, which is determined based on a communication state of a communication module installed in each seat that communicates with the mobile device by short-range wireless communication, and user position information indicating whether the position of a passenger who is a target of biometric authentication is in the driver's seat or other than the driver's seat, which is determined based on a detection result of the biometric sensor , and identifies the driver based on the authentication result of the mobile device authentication, the authentication result of the biometric authentication , the user position information by the mobile device authentication , and the user position information by the biometric authentication .

Functional block diagram showing one embodiment. Diagram showing user authentication information Diagram showing permission condition information flowchart

An embodiment in which a moving body is applied to an automobile will be described below with reference to the drawings. As shown in FIG. 1, an automobile authentication system 1 includes a mobile terminal authentication device 2, a face authentication device 3, a control unit 4, and various electronic control units (ECUs: Electronic Control Units) 5-7. The various ECUs 5-7 are, for example, a motion control system ECU 5 that controls the motion control system, an HMI system ECU 6 that controls the HMI (Human Machine Interface) system, and a body system ECU 7 that controls the body system, and are connected to the control unit 4 via an in-vehicle network 8 such as a Controller Area Network (CAN) (registered trademark).

The mobile terminal authentication device 2 is a device that authenticates a mobile terminal brought into the vehicle cabin, and includes an individual authentication unit 2a, a mobile terminal authentication database 2b, and a user position detection unit 2c. The mobile terminal is, for example, a multi-function mobile information terminal called a smartphone, a mobile phone, etc. The individual authentication unit 2a compares the terminal identification information, for example, the telephone number of the mobile terminal, with the terminal identification information registered in the mobile terminal authentication database 2b in advance in correspondence with the mobile terminal authentication ID, and determines whether the two match. If the individual authentication unit 2a determines that the terminal identification information of the mobile terminal is the same as any of the terminal identification information registered in the mobile terminal authentication database 2b and that the two match, it transmits the mobile terminal authentication ID registered in correspondence with that terminal identification information to the control unit 4.

When the individual authentication unit 2a determines that the two match, the user position detection unit 2c detects the position of the mobile terminal. Specifically, for example, if a communication module that performs short-range wireless communication with the mobile terminal is installed in each seat, the user position detection unit 2c determines the communication state of the communication module, determines whether the passenger carrying the mobile terminal is in the driver's seat or outside the driver's seat, and transmits user position information indicating the determination result to the control unit 4.

The facial recognition device 3 is a device that recognizes the face of a passenger who is a person who boards a vehicle, and includes an individual authentication unit 3a, a facial recognition database 3b, and a user position detection unit 3c. The individual authentication unit 3a compares an image taken by an in-vehicle camera that captures the interior of the vehicle with a facial image that is previously associated with a facial recognition ID and registered in the facial recognition database 3b, determines whether or not a facial image registered in the facial recognition database 3b is included in the image taken by the in-vehicle camera, and determines whether or not a person registered in the facial recognition database 3b is present among the passengers. The individual authentication unit 3a compares, for example, the contour of the face, the positions of characteristic parts such as the eyes, nose, and mouth, and calculates a matching rate, and compares the calculated matching rate with a predetermined value to determine whether or not a person registered in the facial recognition database 3b is present among the passengers. When the individual authentication unit 3a determines that the matching rate is equal to or greater than a predetermined value and that the identity authentication probability is equal to or greater than a certain value (e.g., 80%), it determines that a person registered in the face recognition database 3b is present among the passengers, and transmits the face recognition ID registered in association with that person to the control unit 4. The in-vehicle camera may be a single camera with a wide-angle field of view capable of capturing the entire interior of the vehicle, or multiple cameras with narrow-angle fields of view capable of capturing images of each seat may be installed for each seat.

When the individual authentication unit 3a determines that one of the passengers is registered in the face recognition database, the user position detection unit 3c detects the position of the passenger from the image captured by the in-vehicle camera. Specifically, the user position detection unit 3c determines whether the passenger is in the driver's seat or somewhere other than the driver's seat, and transmits user position information indicating the determination result to the control unit 4.

The control unit 4 is composed of a microcomputer having a CPU (Central Processing Unit), ROM (Read Only Memory), RAM (Random Access Memory), and I/O (Input/Output). The microcomputer executes computer programs stored in a non-transient physical storage medium and executes processes corresponding to the computer programs. The processes executed by the microcomputer include processes corresponding to the mobile authentication program. The control unit 4 includes a user authentication information storage unit 4a, a user authentication unit 4b, a driver identification unit 4c, a simultaneous passenger identification unit 4d, an authority condition information storage unit 4e, a function restriction granting unit 4f, an authority condition information update unit 4g, and a function restriction release unit 4h.

As shown in FIG. 2, the user authentication information storage unit 4a stores user authentication information indicating the correspondence between the user type, the mobile terminal authentication ID, and the face authentication ID. When the user authentication unit 4b receives the mobile terminal authentication ID transmitted from the individual authentication unit 2a of the mobile terminal authentication device 2, it compares the received mobile terminal authentication ID with the mobile terminal authentication ID stored in the user authentication information storage unit 4a, and if the two match, it identifies the user type associated with the mobile terminal authentication ID. That is, if the mobile terminal authentication ID transmitted from the individual authentication unit 2a of the mobile terminal authentication device 2 is "****1", the user authentication unit 4b identifies the user type as "owner". Also, when the user authentication unit 4b receives the face authentication ID transmitted from the individual authentication unit 3a of the face authentication device 3, it compares the received face authentication ID with the face authentication ID stored in the user authentication information storage unit 4a, and if the two match, it identifies the user type associated with the face authentication ID. That is, if the face recognition ID sent from the individual authentication unit 3a of the face recognition device 3 is "****b", the user authentication unit 4b identifies the user type as "owner spouse."

When the driver identification unit 4c receives user position information transmitted from the user position detection unit 2c of the mobile terminal authentication device 2 or the user position detection unit 3c of the face authentication device 3, if the received user position information indicates the driver's seat, the driver identification unit 4c identifies the user type identified based on the mobile terminal authentication ID or face authentication ID as a driver.

When the simultaneous passenger identification unit 4d receives user position information transmitted from the user position detection unit 2c of the mobile terminal authentication device 2 or the user position detection unit 3c of the face authentication device 3, if the received user position information indicates a seat other than the driver's seat, it identifies the user type identified based on the mobile terminal authentication ID or face authentication ID as a simultaneous passenger rather than a driver. A simultaneous passenger is a passenger other than the driver, such as a passenger in the passenger seat or the rear seat.

As shown in FIG. 3, the authority condition information storage unit 4e stores authority condition information indicating the correspondence between the driver, simultaneous passengers, and functional restrictions. When the driver is identified by the driver identification unit 4c but the simultaneous passengers are not identified by the simultaneous passenger identification unit 4d, the functional restriction assignment unit 4f assigns the functional restrictions associated with the identified driver. When the driver is identified by the driver identification unit 4c and the simultaneous passengers are identified by the simultaneous passenger identification unit 4d, the functional restriction assignment unit 4f assigns the functional restrictions associated with the combination of the identified driver and simultaneous passengers.

The functional restrictions include, for example, "80km/h restriction," "prohibition of updating authority condition information," "restriction on use of billing apps," and "restriction on web use on HMI." "80km/h restriction" restricts the vehicle speed to 80km/h. "Prohibition of updating authority condition information" prohibits updating of authority condition information. "Restriction on use of billing apps" restricts the use of billing apps. "Restriction on web use on HMI" restricts web use on HMI. The types of functional restrictions may be other than those exemplified, such as "restriction on use of highways" that restricts use of highways, and "prohibition on driving during snowfall" that prohibits driving during snowfall. In addition, the types of functional restrictions include, for example, mechanical restrictions that are directly related to driving operations, such as "80km/h restriction," and mechanical restrictions that are not directly related to driving operations, such as "restriction on use of billing apps."

For example, when the driver is identified as the "owner", the function restriction assigning unit 4f does not assign any function restriction and sets the function restriction to "none" regardless of how the simultaneous passenger is identified. For example, when the driver is identified as the "owner's spouse" and the simultaneous passenger is identified as the "owner", the function restriction assigning unit 4f assigns a function restriction of "80 km/h limit" and sets the function restriction to "80 km/h limit".

For example, when the driver is identified as the "owner's child" and the simultaneous passenger is identified as the "owner and owner's spouse", the function restriction granting unit 4f grants a function restriction of "80 km/h limit" and sets the function restriction to "80 km/h limit". For example, when the driver is identified as the "owner's child" and the simultaneous passenger is identified as the "owner or owner's spouse", the function restriction granting unit 4f grants a function restriction of "80 km/h limit, authority condition information update prohibited" and sets the function restriction to "80 km/h limit, authority condition information update prohibited". When there are multiple user types of simultaneous passengers, the combination of the multiple user types may be a logical sum or a logical product.

The authority condition information update unit 4g updates the authority condition information stored in the authority condition information storage unit 4e, for example, when the owner performs an operation to update the authority condition information on a mobile terminal or an HMI device installed in the vehicle cabin. The operation to update the authority condition information performed by the owner is a registration operation, a change operation, and a deletion operation. When the owner performs an operation to register the authority condition information, new authority condition information is stored in the authority condition information storage unit 4e. When the owner performs an operation to change the authority condition information, the content of the authority condition information stored in the authority condition information storage unit 4e is changed. When the owner performs an operation to delete the authority condition information, the authority condition information stored in the authority condition information storage unit 4e is deleted. The function restriction release unit 4h releases the function restrictions that have been granted.

In the above configuration, the case where the user type is identified using both the authentication result of the mobile device authentication and the authentication result of the face authentication by providing both the mobile device authentication device 2 and the face authentication device 3 is exemplified, but the user type may be identified using either the authentication result of the mobile device authentication or the authentication result of the face authentication by providing either the mobile device authentication device 2 or the face authentication device 3. In face authentication, for example, the accuracy of the authentication result may be reduced when the lens of the in-vehicle camera is dirty or the illuminance is insufficient at night, but the mobile device authentication has the advantage that such a problem does not occur. On the other hand, in the mobile device authentication, passengers who do not carry a mobile device are not subject to authentication, but the face authentication has the advantage that such a problem does not occur. In addition, when the authentication results are different when both the authentication results of the mobile device authentication and the face authentication are used, one of the authentication results may be valid, or both authentication results may be invalid.

Next, the operation of the above-mentioned configuration will be described with reference to FIG.
The control unit 4 operates using a battery power source as its operating power source, monitors, for example, the release of a door lock, and starts authentication processing when it detects the release of the door lock. When the control unit 4 starts authentication processing, it waits to receive a mobile terminal authentication ID, a face authentication ID, and user position information transmitted from the mobile terminal authentication device 2 and the face authentication device 3.

Here, when any person gets on board, the mobile device authentication device 2 performs mobile device authentication for that person, and the facial authentication device 3 performs facial authentication. The mobile device authentication device 2 performs mobile device authentication, and if the mobile device authentication is successful, the mobile device authentication device 2 transmits a mobile device authentication ID and user location information to the control unit 4. The facial authentication device 3 performs facial authentication, and if the facial authentication is successful, the facial authentication device 3 transmits a facial authentication ID and user location information to the control unit 4. The control unit 4 receives the mobile device authentication ID, facial authentication ID, and user location information transmitted from the mobile device authentication device 2 and the facial authentication device 3, and thereby acquires the mobile device authentication ID, facial authentication ID, and user location information (S1). The control unit 4 determines whether or not the driver has been identified based on the acquired mobile device authentication ID, facial authentication ID, and user location information (S2).

When the control unit 4 determines that a person is not in the driver's seat and the driver has not been identified (S2: NO), it determines whether or not a function restriction is being applied (S3). When the control unit 4 determines that a function restriction is not being applied (S3: NO), it determines whether or not the end condition of the authentication process is met (S12). When the control unit 4 determines that the door lock is not detected and the end condition of the authentication process is not met (S12: NO), for example, it returns to the above-mentioned step S1 and waits for the reception of the mobile terminal authentication ID, face authentication ID, and user position information transmitted from the mobile terminal authentication device 2 and the face authentication device 3. When the control unit 4 determines that a function restriction is being applied (S3: YES), it releases the function restriction being applied, that is, it resets the function restriction (S4), and determines whether or not the end condition of the authentication process is met (S12). When the control unit 4 determines that the end condition of the authentication process is not met (S12: NO), it returns to the above-mentioned step S1.

When the control unit 4 determines that a person has boarded the driver's seat and that the driver has been identified (S2: YES, which corresponds to the driver identification procedure), it determines whether or not a simultaneous passenger has been identified based on the acquired mobile device authentication ID, face authentication ID, and user position information (S5).

When the control unit 4 determines that no other person is on board and that no simultaneous passenger has been identified (S5: NO), it determines whether the functional restriction being applied is the functional restriction associated with the identified driver (S6). When the control unit 4 determines that the functional restriction being applied is the functional restriction associated with the identified driver (S6: YES), it continues the functional restriction being applied (S7). The control unit 4 determines whether the termination condition for the authentication process is met (S12), and when it determines that the termination condition for the authentication process is not met (S12: NO), it returns to step S1 described above.

If the control unit 4 determines that the functional restriction being applied is not the functional restriction associated with the identified driver (S6: NO), it applies the functional restriction associated with the identified driver (S8, which corresponds to the functional restriction application procedure). The control unit 4 determines whether the termination condition for the authentication process is met (S12), and if it determines that the termination condition for the authentication process is not met (S12: NO), it returns to step S1 described above.

When the control unit 4 determines that another person has boarded a seat other than the driver's seat and identified a simultaneous passenger (S5: YES, corresponding to the simultaneous passenger identification procedure), it determines whether the functional restriction being applied is a functional restriction associated with the combination of the identified driver and simultaneous passenger (S9). When the control unit 4 determines that the functional restriction being applied is a functional restriction associated with the combination of the identified driver and simultaneous passenger (S9: YES), it continues the functional restriction being applied (S10). The control unit 4 determines whether the termination condition for the authentication process is met (S12), and when it determines that the termination condition for the authentication process is not met (S12: NO), it returns to step S1 described above.

If the control unit 4 determines that the function restriction being applied is not the function restriction associated with the combination of the specified driver and simultaneous passenger (S9: NO), it applies the function restriction associated with the combination of the specified driver and simultaneous passenger (S11, which corresponds to the function restriction application procedure). The control unit 4 determines whether the termination condition for the authentication process is met (S12), and if it determines that the termination condition for the authentication process is not met (S12: NO), it returns to step S1 described above.

The above is an example of a configuration that employs face recognition as biometric authentication, but fingerprint recognition, voiceprint recognition, retina recognition, iris recognition, vein recognition, etc. may also be employed. Furthermore, when multiple authentication results are used, the individual authentication results may be combined to identify the driver or simultaneous passengers. For example, when using the authentication results of face recognition and fingerprint recognition, if the probability of personal authentication by face recognition is not above a certain value and the probability of personal authentication by fingerprint authentication is not above a certain value, the authentication results of face recognition alone or fingerprint recognition alone will not identify the driver or simultaneous passengers, but by combining the authentication results of face recognition and fingerprint authentication, the driver or simultaneous passengers may be identified based on the sum of the multiple personal authentication probabilities.

As described above, according to this embodiment, the following advantageous effects can be obtained. In the automobile authentication system 1, the results of mobile device authentication and face authentication are used to identify the driver of the automobile, and functional restrictions associated with the identified driver are imposed. This eliminates the need for guardians to take the trouble of setting operation restrictions for the driver (person to be protected), and allows operation restrictions for the driver (person to be protected) to be set automatically, improving convenience.

In addition, in the automobile authentication system 1, the combination of the automobile driver and simultaneous passengers is identified, and functional restrictions that correspond to the identified combination of the driver and simultaneous passengers are imposed. The functional restrictions can be diversified depending on the combination of the driver and simultaneous passengers, and the degree of freedom in the functional restrictions can be increased. For example, if the simultaneous passenger is the owner, the owner can directly monitor the driver, so the functional restrictions can be set relatively loosely. On the other hand, if the simultaneous passenger is someone other than the owner, the owner cannot directly monitor the driver, so the functional restrictions can be set relatively strictly, thereby increasing the degree of freedom in the functional restrictions.

In addition, in the automobile authentication system 1, when multiple authentication results are used, the multiple authentication results are combined to identify the driver and simultaneous passengers based on the sum of the multiple personal authentication probabilities. By identifying the driver and simultaneous passengers based on the sum of the multiple personal authentication probabilities, it is possible to increase the possibility of identifying the driver and simultaneous passengers by combining multiple pieces of biometric information, whereas it is not possible to identify the driver and simultaneous passengers based on a single piece of biometric information, such as a face or fingerprint.

Furthermore, in the automobile authentication system 1, the authority condition information is updated. It is possible to respond appropriately according to the person using the automobile. For example, the authority condition information can be appropriately updated by relaxing the functional restrictions as the person using the automobile grows, or adding functional restrictions as a new person uses the automobile.

Although the present disclosure has been described with reference to the embodiment, it is understood that the disclosure is not limited to the embodiment or structure. The present disclosure also encompasses various modifications and modifications within the scope of equivalents. In addition, various combinations and forms, as well as other combinations and forms including only one element, more than one element, or less than one element, are also within the scope and concept of the present disclosure.

The control unit and the method described in the present disclosure may be realized by a dedicated computer provided by configuring a processor and memory programmed to execute one or more functions embodied in a computer program. Alternatively, the control unit and the method described in the present disclosure may be realized by a dedicated computer provided by configuring a processor with one or more dedicated hardware logic circuits. Alternatively, the control unit and the method described in the present disclosure may be realized by one or more dedicated computers configured by combining a processor and memory programmed to execute one or more functions with a processor configured with one or more hardware logic circuits. Furthermore, the computer program may be stored in a computer-readable non-transient tangible recording medium as instructions executed by the computer.

Although an automobile is used as a moving body in the above embodiment, the present invention can also be applied to an airplane, a ship, etc.
In the example shown, the control unit 4 is configured to start the authentication process when it detects that the door lock has been released. However, it is also possible to use a seat sensor to monitor whether the driver is sitting in the driver's seat and start the authentication process when it detects that the driver is sitting in the driver's seat, or to monitor the engine start and start the authentication process when it detects that the engine has started.

The authority condition information may also include elements of vehicle location and time period. For the same authentication result, for example, if the vehicle location is on a motorway, a functional restriction of "80 km/h limit" may be applied, and if the vehicle location is on a general road, a functional restriction of "50 km/h limit" may be applied. Furthermore, for the same authentication result, for example, if the time period is daytime, a functional restriction of "60 km/h limit" may be applied, and if the time period is nighttime, a functional restriction of "50 km/h limit" may be applied. Furthermore, functional restrictions may be applied by combining the vehicle location and time period.

In the drawing, 1 is an automobile authentication system (mobile body authentication system), 4 is a control unit, 4c is a driver identification unit, 4d is a simultaneous passenger identification unit, 4e is an authority condition information storage unit, 4f is a function restriction granting unit, and 4g is an authority condition information update unit.

Claims (6)

a driver identification unit (4c) that identifies a driver of the moving object by using an authentication result of the mobile terminal authentication by the mobile terminal and an authentication result of the biometric authentication by the biometric information sensor ;
an authority condition information storage unit (4e) for storing a correspondence relationship between at least one person and a function restriction as authority condition information;
a function restriction imposing unit (4f) that, when a driver is identified by the driver identifying unit, imparts a function restriction associated with the identified driver,
The driver identification unit receives user position information indicating whether the position of the passenger carrying the mobile terminal is in the driver's seat or other than the driver's seat, determined based on the communication state of a communication module installed in each seat that communicates with the mobile terminal by short-range wireless communication, and user position information indicating whether the position of the passenger who is the subject of biometric authentication is in the driver's seat or other than the driver's seat, determined from the detection result of the biometric information sensor, and identifies the driver based on the authentication result of the mobile terminal authentication, the authentication result of the biometric authentication, the user position information based on the mobile terminal authentication, and the user position information based on the biometric authentication . a simultaneous passenger identification unit (4d) for identifying simultaneous passengers of the moving body using an authentication result of the mobile terminal authentication by the mobile terminal;
An authentication system for a mobile object as described in claim 1, wherein the functional restriction granting unit grants functional restrictions corresponding to the combination of the identified driver and simultaneous passenger when the driver is identified by the driver identification unit and the simultaneous passenger is identified by the simultaneous passenger identification unit. The authentication system for a mobile body according to claim 1, wherein the driver identification unit identifies the driver of the mobile body upon at least one of the following triggers: detection of door lock release, detection of a driver sitting in the driver's seat detected by a seat sensor, and detection of engine start. 2. The authentication system for a mobile body according to claim 1, wherein the driver identification unit uses an in-vehicle camera as the biometric information sensor and determines facial authentication as the biometric authentication from an image captured by the in-vehicle camera, receives user position information indicating whether the position of the occupant subject to facial authentication determined from the image captured by the in-vehicle camera is in the driver's seat or outside the driver's seat, and identifies the driver based on the authentication result of the mobile device authentication, the authentication result of the facial authentication, the user position information by the mobile device authentication, and the user position information by the facial authentication. In a mobile authentication system (1) including an authority condition information storage unit (4e) for storing a correspondence relationship between at least one person and a function restriction as authority condition information,
a driver identification step of receiving user position information indicating whether a passenger carrying the mobile terminal is in the driver's seat or other than the driver's seat, determined based on a communication state of a communication module installed in each seat that communicates with the mobile terminal by short-range wireless communication, and user position information indicating whether a passenger who is the subject of biometric authentication is in the driver's seat or other than the driver's seat, determined from a detection result of a biometric information sensor , using an authentication result of the mobile terminal authentication by the mobile terminal , and identifying a driver based on the authentication result of the mobile terminal authentication, the authentication result of the biometric authentication , the user position information by the mobile terminal authentication, and the user position information by the biometric authentication ;
a function restriction granting step of granting a function restriction associated with the driver identified by the driver identification step . A control unit (4) of a mobile authentication system (1) including an authority condition information storage unit (4e) for storing a correspondence relationship between at least one person and a function restriction as authority condition information,
a driver identification step of receiving user position information indicating whether a passenger carrying the portable terminal is in the driver's seat or other than the driver's seat, determined based on a communication state of a communication module installed in each seat that communicates with the portable terminal by short-range wireless communication, and user position information indicating whether a passenger who is the subject of biometric authentication is in the driver's seat or other than the driver's seat, determined from a detection result of a biometric information sensor, using an authentication result of the portable terminal authentication by the portable terminal, receiving user position information indicating whether a passenger who is the subject of biometric authentication is in the driver's seat or other than the driver's seat, and identifying a driver based on the authentication result of the portable terminal authentication, the authentication result of the biometric authentication, the user position information by the portable terminal authentication, and the user position information by the biometric authentication;
a function restriction imposing step of imposing a function restriction associated with the driver identified by the driver identification step; and an authentication program for a mobile object that causes the mobile object to execute the function restriction imposing step.

Images