JP2006039841A - Processing device preventing spying through face detection, processing system, automatic teller, processing method, and program - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To process images of an area around a user when the user enters a password on a processing device such as a computer, an ATM, or communication equipment and to interrupt the process of entering the password if the device detects more than one face and determines that there is the danger of being spied on. <P>SOLUTION: The processing device includes a camera part 11 for capturing images of the user and the nearby area; an image processing part 22 that analyzes the images captured by the camera part 11 from when the user starts preparation for entering a password until authentication of the password is successful and that reports interruption if the face of someone other than the user who could be spying around the user is detected; and an ATM control part 21 that interrupts the processes of entering and authenticating the password if the interruption is reported from when the user starts preparation for entering the password until authentication of the password is successful. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a processing device, a processing system, an automatic teller machine, a processing method, and a program for preventing snooping by detecting a face, and in particular, a computer with a camera, a mobile communication device, and an automatic teller machine (ATM: automatic teller). The present invention relates to a technique for preventing snooping when a user inputs a password (including a password) in a processing apparatus such as a machine.

  In recent years, users of information processing-related processing devices such as information processing devices such as personal computers, server devices, and terminal devices, ATMs, mobile phones, and PDAs (personal digital assistants) have started up processing devices and have passwords. Authenticate the identity by entering a password when accessing a set file or logging on to a specific system, and the processing device itself or the file or system is fraudulent from a malicious third party Protects against access.

  In the method of authenticating the identity by the password, if the password is known to another person, the other person impersonates the person and starts up the processing device of the person, or illegally accesses a file protected by the password. It is possible to illegally access a highly confidential system protected by a password, or to operate an ATM to withdraw a deposit illegally.

  Accordingly, various techniques for password leakage have been created. In order to prevent leakage due to password sneaking in ATMs, the invention of Japanese Patent Laid-Open No. 2001-147663 is provided in front of the keyboard-type input means for inputting passwords in ATMs in front and back, right and left, and in front of it. A configuration is disclosed in which the input means is operated while visually confirming the position of the hand through a small window provided at the top by putting a hand through the gap.

  In addition, the invention disclosed in Japanese Patent Laid-Open No. 2001-31469 registers a camera that captures a user's face when a user erroneously inputs a password by attaching a camera that photographs the user's face to a cash handling machine. A technique for notifying unauthorized use of a cash card when a user with the same face repeats an error a certain number of times is disclosed. Therefore, according to the present invention, the user can know that the cash card is illegally used.

JP 2001-147663 A JP 2001-31469 A

  However, according to the invention of Japanese Patent Application Laid-Open No. 2001-147663, there is a problem that the operability in inputting a password is significantly impaired because the input means is covered with a shield.

  The invention of Japanese Patent Application Laid-Open No. 2001-31469 can allow a user to know that his / her cash card has been illegally used, but it does not take into account the leakage caused by password snooping. If the password is known, the person who knows the password by stealing can input the correct password and thus cannot prevent unauthorized use.

  An object of the present invention has been made in view of the above problems, and processes two or more images obtained by processing an image obtained by photographing a periphery of a user with a camera when the user inputs a password with a processing device. The processing device, processing system, automatic teller machine, processing method, and program that interrupts the password input process and prevents the leakage of the password. It is to provide.

  The first processing apparatus of the present invention includes a camera that captures images of a user and surroundings, and images captured by the camera from when the user starts preparing to input a password until password authentication is successful. From the start of password input preparation until password authentication succeeds, and an image processing unit that notifies interruption when a person other than the user who may be peeping around is detected after analysis And a control unit that interrupts the operation of inputting the password and the operation of authenticating the password when the interruption notification is received during the period.

  The second processing device according to the present invention is the first processing device according to the present invention, wherein when the face of two or more people including the user is detected in the video, the image processing unit It is determined that a person other than a user who may be peeping is detected.

  According to a third processing device of the present invention, in the second processing device of the present invention, when two or more human faces including a user are detected in the video, the video at that time is recorded. And

  According to the fourth processing apparatus of the present invention, in the first, second, or third processing apparatus of the present invention, the user is inquired whether to restart from the password input process again at the time of the interruption. When the resuming operation is performed, the process is resumed from the password input process, and when the user does not perform the resuming operation, the initial state is restored.

  According to a fifth processing apparatus of the present invention, in the first, second, third, or fourth processing apparatus of the present invention, the processing apparatus includes an information processing apparatus including a personal computer and a terminal device, and a communication apparatus including a mobile phone. Or an automatic teller machine.

A first processing system according to the present invention is a processing system in which a processing device for inputting a password and an image processing device for processing video sent from the processing device are connected via a network.
The processing device transmits a camera that captures images of the user and its surroundings, and images captured by the camera from when the user starts preparing to input a password until password authentication is successful. A control unit that interrupts an operation for a user to input a password and an operation to authenticate a password when receiving a suspension notification between the start of input preparation and the successful authentication of the password;
The image processing device includes an image processing unit that analyzes an image captured by the camera and notifies an interruption when a person other than a user who may be peeping around the user is detected. It is characterized by.

  According to a second processing system of the present invention, in the first processing system of the present invention, when the image processing unit detects the faces of two or more people including the user in the video, the image processing unit It is determined that a person other than a user who may be peeping is detected.

  According to a third processing system of the present invention, in the second processing system of the present invention, when two or more human faces including the user are detected in the video, the video at that time is recorded. And

  In the fourth processing system of the present invention, in the first, second, or third processing system of the present invention, the user is inquired whether to restart from the password input processing again at the time of the interruption. When the resuming operation is performed, the process is resumed from the password input process, and when the user does not perform the resuming operation, the initial state is restored.

  According to a fifth processing system of the present invention, in the first, second, third or fourth processing system of the present invention, the processing device is a computer including a personal computer or a terminal device, a communication device including a mobile phone, Or it is either an automatic teller machine (ATM).

  The automatic teller machine of the present invention includes a camera that shoots images of a user and its surroundings, a card input unit that reads personal identification information including an account number from an identification card, and personal identification information including an account number from a passbook. Photographed with the camera from the time when the user entered the password and the password authentication succeeded from the time when the user read the identification card to the card input unit or read the passbook to the passbook input unit Analyzing the video and detecting a person other than a user who may be peeping around the user, an image processing unit that notifies the interruption, and causing the card to be read by the user If the user receives a suspend notification between the time when the passbook is read by the passbook input unit and the time when the user enters the password and the password is successfully authenticated, the user And having a interrupting ATM control unit and the operation of the operation and password authentication for entering the mode.

  According to the first processing method of the present invention, when a password is input to the processing device, a face is detected by capturing a video of the user and its surroundings and detecting the face, and from the analysis result of the video Peeping is prevented by face detection characterized by interrupting the password input operation and password authentication operation when two or more faces are detected.

  According to a second processing method of the present invention, an image captured by a camera that captures images of the user and the surrounding area is analyzed from the time when the user starts preparing to input a password until the password is successfully authenticated. When a person other than a user who may be peeping around is detected in the vicinity of the user, a suspension notification is sent, and the suspension notification is received between the start of password input preparation and the successful password authentication. The operation of inputting the password by the user and the operation of authenticating the password are interrupted.

  According to a third processing method of the present invention, in the second processing method of the present invention, when two or more people's faces including the user are detected in the video, a snooping is performed around the user. It is determined that a person other than a user who may be present is detected.

  According to a fourth processing method of the present invention, in the third processing method of the present invention, when two or more human faces including a user are detected in the video, the video at that time is recorded. And

  According to a fifth processing method of the present invention, in the second, third, or fourth processing method of the present invention, the user is inquired whether to restart from the password input processing again at the time of the interruption. When the resuming operation is performed, the process is resumed from the password input process, and when the user does not perform the resuming operation, the initial state is restored.

  The first program of the present invention includes a procedure for detecting a face by photographing a video of a user and its surroundings when inputting a password to the processing device, and analyzing the video, and a result of analyzing the video When two or more faces are detected, the computer is caused to execute a procedure for interrupting the password input operation and the password authentication operation.

  The second program of the present invention analyzes and uses video shot by a camera that shoots the video of the user and its surroundings from when the user starts preparing to input a password until password authentication succeeds. Notification of interruption when a person other than a user who may be peeping in the vicinity of the user is detected, and a notification of interruption is issued between the start of password input preparation and the successful password authentication. When received, the computer causes the computer to execute a procedure for interrupting the operation of inputting the password and the operation of authenticating the password.

  The third program of the present invention may be seen in the vicinity of the user when two or more faces including the user are detected in the video in the second program of the present invention. It is determined that a person other than a characteristic user is detected.

  According to a fourth program of the present invention, in the third program of the present invention, when two or more human faces including a user are detected in the video, the video at that time is recorded. .

  According to the fifth program of the present invention, in the second, third, or fourth program of the present invention, a procedure for inquiring the user whether to resume from the password input process upon the interruption, and the user When the resuming operation is performed, the computer restarts from the password input process, and when the user does not perform the resuming operation, the computer is caused to execute a procedure for returning to the initial state.

  According to the present invention, the user who inputs the password and the surroundings are analyzed, and the captured video is analyzed. For example, if two or more faces are detected in the user and the background video, there is a possibility of snooping. By determining and suspending the password input process and subsequent processes to alert the user, there is an effect that it is possible to prevent others from stealing the password from the side or behind the user.

  Next, the best mode for carrying out the invention will be described in detail with reference to the drawings. The present invention has a camera function to provide an information processing device such as a terminal device operating under a personal computer or a host device, a special terminal device such as ATM, a portable terminal such as a PDA, and an information processing function. Although the present invention can be applied to a processing device that involves an operation of inputting a password in a processing device such as a communication device such as a mobile phone, hereinafter, an ATM will be described as an example.

  FIG. 1 is a block diagram of a processing apparatus (ATM 10) according to a first embodiment of the present invention and a host apparatus 30 connected thereto. FIG. 2 is an external view showing an example of the ATM 10, and in particular, the direction of the camera unit 11 is shown in order to explain an example of the installation position of the camera unit 11. However, the ATM 10 is actually stored in the casing of the ATM 10 and is transparent. You may attach so that it can image | photograph through a protection board.

  The host device 30 is an information processing device that is connected to the communication control unit 18 of the ATM 10 via a communication path and exchanges information with the ATM 10, and is usually a large number of ATMs 10 or business terminals of financial institutions (not shown). To handle financial institutions' business. The host device 30 is composed of two or more devices or a system including more devices.

  In addition, the host device 30 is a personal information such as the user's name, address, and contact information, ID information such as an account number, information related to a password such as a personal identification number, information such as deposit amount and transaction history. And processes transactions in response to requests from the ATM 10 and business terminals. Although not described here, some information such as a password is communicated using an encryption technique or is subjected to encryption processing and stored in order to prevent leakage on the communication path.

  The ATM 10 includes a camera unit 11 that captures a user and the background of the user and outputs the video, a display unit 12 that displays a screen for transaction and input contents, an input unit 13 that has a function of inputting a password, and a camera. The image processing unit 22 detects whether there is another person who is peeping around the user by performing image processing on the video shot by the unit 11, and records the video when the image processing unit 22 detects the peeping. A video storage unit 23, an ATM control unit 21 that controls the ATM 10 transaction and password (for example, a four-digit password) authentication process, and a communication control unit 18 that controls communication with the host device 30. .

  Further, the ATM 10 includes a card input unit 14 that reads personal identification information from an ID card that stores personal identification information such as an account number for using the ATM 10, a bankbook input unit 15 that reads personal identification information from a bankbook, and cash ( A cash in / out portion 16 for taking in and out cash for payment and payment, and a printing portion 17 for printing a transaction result.

  The input unit 13 may be realized by a touch panel and formed integrally with the display unit 12, and FIG. 2 shows this configuration. However, the input unit 13 is configured by an input device such as a keyboard separately from the display unit 12. May be.

  The ATM control unit 21 is realized by a processing device including a CPU (central processing unit) and storage means, and the storage means stores a program for executing transaction processing and password authentication processing while exchanging information with the host device 30. Then, transaction processing and password authentication processing are executed by executing a program on the CPU.

  The image processing unit 22 is realized by a processing device including a CPU and a storage unit, and may include a special configuration for image processing. The image processing unit 22 stores a program that captures video from the camera unit 11 and performs image processing to detect snooping, and executes image processing by executing the program on the CPU.

  Note that the ATM control unit 21 and the image processing unit 22 may share the CPU and storage means, may have separate CPUs and storage means, or have only a separate CPU. These configurations may be selected according to the required performance.

  The method of detecting snooping by image processing is, for example, analyzing whether there is a face other than the user in the video imaged by the camera unit 11, that is, whether there are two or more faces. If it is detected, it is determined that there is a risk of snooping by others. In this case, the eleventh position of the camera unit should be able to detect unauthorized snooping without showing the face of a person waiting for the turn at a position where snooping behind is not possible.

  For example, as shown in FIG. 2, the user is positioned in the central portion obliquely upward from the surface of the display unit 12 or the input unit 13, and the shooting range is a range in which another person can see from the side or the upper side of the user. By installing the camera unit 11 in the image processing unit 22, the image processing unit 22 can detect the risk of snooping when two or more faces are detected.

  In addition to this, when a photograph is taken at a wide angle around the user and the face of another person other than the user is detected, the position and orientation of the face of the other person is analyzed to determine whether the direction of the input unit 13 is being viewed. Alternatively, the risk of snooping may be detected by estimating the distance based on the size of the face and determining whether the distance is within a certain distance. There is no limitation on the method of detecting the sneaking of others by other methods.

  Next, the operation of the first embodiment of the present invention will be described with reference to the drawings. FIG. 3 is a flowchart showing the operation of the first embodiment of the present invention. Although FIG. 3 shows the processing of the ATM control unit 21 and the image processing unit 22 separately, the CPU and the storage means may be shared.

  Referring to FIG. 3, first, the user inserts an ID card such as a cash card or a bankbook into the card input unit 14 or the bankbook input unit 15 in order to use the ATM 10. When a normal ID card or passbook is inserted (determined in S61), the ATM control unit 21 starts a transaction process and notifies the image processing unit 22 of the start of the image process (S62).

  Subsequently, the ATM control unit 21 executes processing according to the input (S63), and monitors whether there is an interruption notification from the image processing unit 22 until the password authentication processing is completed (S65) (S64).

  For example, when a cash card is inserted into the card input unit 14, the ATM control unit 21 controls the card input unit 14 to read personal identification information including an account number from the inserted cash card and insert the cash It is determined whether the card is a cash card that can be used in the ATM 10, and if the card cannot be used, the card input unit 14 is controlled and discharged. For example, cash cards other than those specified in ATM 10 cannot be used, and cards that cannot read information cannot be used. Note that whether or not it can be used may be confirmed by inquiring the host device 30.

  If the inserted cash card is usable, the ATM control unit 21 confirms the insertion of the card in step S61, notifies the start of image processing, and displays a transaction content list screen on the display unit 12. For example, when a user selects and inputs a withdrawal transaction with the input unit 13, the ATM control unit 21 then displays a screen for the password input by the ATM control unit 21 on the display unit 12.

  When the user inputs a password with the input unit 13, the ATM control unit 21 sends the input password together with the personal identification information to the host device 30, performs authentication with the host device 30, and receives an authentication result.

  If the password authentication is successful, the ATM control unit 21 sends an end notification to the image processing unit 22 and ends the image processing unit 22 (S66). Next, the transaction process following the password is executed, and the process is continued. For example, if it is a withdrawal transaction, proceed to a process to display a screen prompting you to enter the withdrawal amount. If there is no problem in determining whether the entered withdrawal amount is appropriate compared to the deposit amount, enter it. The cash amount is collected and provided at the cash in / out unit 16, the cash card is discharged, information such as transaction details and the remaining amount is printed at the printing unit 17, and the transaction is terminated. As a result, the user can receive cash and obtain the transaction result on a receipt.

  If the password authentication fails, the ATM control unit 21 displays on the display unit 12 that the password is incorrect, prompts re-input, sends the re-entered password together with the personal identification information to the host device 30 and receives the authentication result. If the re-authentication is successful, the ATM control unit 21 terminates the password authentication. If the re-authentication is successful, the ATM control unit 21 controls the card input unit 14 to eject the cash card, terminates the authentication, and terminates the transaction.

  In step S64, the ATM control unit 21 monitors whether an interruption notification is received from the image processing unit 22 from the time when the inserted cash card is determined to be usable until the password authentication is completed. If there is an interruption notification from the image processing unit 22 during this time, the ATM control unit 21 interrupts the processing and displays a message on the display unit 12 informing the user that there is a risk of being stolen to alert the user. (S67).

  If another person steals from the side of the user before entering the password, a message will be displayed at that time, so the user can check the surroundings with caution. In addition, since the process is interrupted, it is possible to avoid being stolen by entering a password while being stolen.

  For example, in the case of the touch panel type input unit 13, the ATM control unit 21 can forcibly stop the user's password input operation by erasing the display of the input numeric buttons on the display unit 12 as an interruption process. The ATM control unit 21 turns off the display of the numeric buttons and displays the message “Please check the surroundings because there is a danger of being stolen.” When the confirmation is finished, press the resume button or stop button. Message, a resume button and a cancel button are displayed, and the user's intention is confirmed (S68).

  When the restart button is pressed, the ATM control unit 21 notifies the image processing unit 22 of the restart and restarts the process (S69). For example, if the process is interrupted before or during password input, the process restarts from the password input process. When the cancel button is pressed, the ATM control unit 21 notifies the image processing unit 22 of the end, discharges the bankbook or ID card, and ends the process (S70). The image processing unit 22 resumes monitoring of the snooping by the resumption notification, and if there is a snooping again, notifies the interruption.

  On the other hand, the image processing unit 22 monitors the start notification from the ATM control unit 21 (S71), and starts capturing video from the camera unit 11 when the start notification is received (S72). Image processing is performed on the video captured from the camera unit 11 to extract a human face portion (S73), and it is determined whether there are two or more human faces (S74).

  If two or more human faces are not detected, the image processing unit 22 continues the operation (S72 to S74) of detecting snooping by judging two or more faces until an end notification is received from the ATM control unit 21. When there is an end notification from the control unit 21, the operation for detecting the snooping is ended.

  If two or more human faces are detected, the image processing unit 22 notifies the ATM control unit 21 of interruption and records the video when two or more faces are detected in the video storage unit 23 (S75). Subsequently, the image processing unit 22 waits for an end notification or a restart notification from the ATM control unit 21 (S76, S77). The image processing unit 22 ends the process when the end notification is received, and returns to step S72 when the restart notification is received and restarts the monitoring operation of the snooping. Note that the video recorded in the video storage unit 23 can be used when it is necessary to identify a person who may have stolen a password, and the face shown in the video is important information for identifying the person.

  When the user makes a withdrawal transaction, when the user inserts a card or a passbook, the image processing unit 22 is started from the ATM control unit 21 and starts to capture the video taken by the camera unit 11. It is monitored whether there is a risk of snooping by determining whether two or more faces are extracted from the video. When the user finishes inputting the password and the password is authenticated, the image processing unit 22 receives an end notification from the ATM control unit 21 and ends the monitoring of the snooping.

  Here, as shown in FIG. 2, the camera is installed so that the user is facing the direction of the user, that is, toward the oblique ceiling, and the field of view of the camera covers the upper left and right of the user centering on the user himself. If another person's face is shown, it is determined that there is a risk of snooping, but it is also possible to detect the risk of snooping more accurately by estimating the distance from the face direction and face size. Good.

  If two or more human faces are detected during the monitoring, the image processing unit 22 sends an interruption notification to the ATM control unit 21 in step S75. Upon receipt of the interruption notification, the ATM control unit 21 interrupts the process being executed, alerts the user, and cancels or interrupts the user's password input to prevent password leakage due to snooping. Further, after confirming that the user has not been seen, the user can select whether to resume or cancel, and can select whether to perform the operation again or cancel. Further, if there is no user input even after a certain period of time after the interruption, it may be assumed that the cancel button has been pressed and the operation is canceled.

  As described above, in order to monitor whether there is a risk of eavesdropping by image processing until the user starts the transaction, enters the password, and the password authentication is completed, the user leaks the password due to eavesdropping by others. Can be avoided.

  In the above description, ATM is used as an example. However, it is obvious that the present invention can be applied to other processing apparatuses in the same manner. However, the ATM control unit 21 serves as a control unit for each processing device, and the configuration of the input / output device also changes. However, the camera unit 11 and the image processing unit 22 monitor the snooping when entering a password, and control each processing device. By performing interruption processing in the same manner as the ATM control unit 21, it is possible to avoid password leakage due to snooping.

  Note that the camera mounting position may be determined according to the installation location and usage characteristics of each processing device. For example, in the case of a mobile phone, it is assumed that the camera is incorporated into the mobile phone, so the camera's field of view is short. A method of determining whether there is another person's face based on the size of the face can be considered. In addition, the analysis start time of the video for detecting the snooping is, for example, the time when the screen for inputting the password is displayed is the time when the preparation for inputting the password is started, or the screen for inputting the password is displayed. Video analysis is started from an earlier point in time before the user enters the password (for example, the risk of snooping can be informed before the password entry screen is displayed). You just need to be informed.

  Next, a second embodiment of the present invention will be described. FIG. 4 is a block diagram showing the configuration of the processing system according to the second embodiment of the present invention. The processing system of FIG. 2 includes an image processing unit 22 and a video storage unit 23 included in the processing apparatus (ATM 10) of FIG. The ATM 40 is configured by removing the image processing unit 22 and the video storage unit 23 from the ATM 10, and the ATM 40, the image processing device 50, and the host device 30 are connected to each other via a network 39. .

  Components having the same functions as those in FIG. 1 are denoted by the same reference numerals in FIG. The network 39 is means for connecting the host device 30, the image processing device 50, and usually a large number of ATMs 40 to each other and enabling communication. Even if the network 39 is a highly reliable communication path connected using a dedicated communication line. Alternatively, an open communication path such as a public line or the Internet may be used, but it is also effective to use an encryption technique in order to prevent information leakage.

  The image processing apparatus 50 includes an image processing unit 52 and a video storage unit 53. The image processing unit 52 and the video storage unit 53 do not receive video directly from the camera unit 11 but receive video via the ATM control unit 41 and the network 39, but the processing related to the received image is the same. is there. However, the image processing unit 52 notifies the ATM control unit 41 of the ATM 40 of the interruption notification performed as a monitoring result of the snooping.

  The ATM control unit 41 basically has the same function as the ATM control unit 21, but the image processing unit 52 and the video storage unit 53 are connected because the image processing unit 52 and the video storage unit 53 are connected via the network 39. Some functions differ in the data exchange part. For example, the start notification and the end notification to the image processing unit 52 are notified via the network 39, the interruption notification is also received via the network 39, and the video of the camera unit 11 is sent to the image processing unit 52 via the network 39. do. This will be described in detail in the description of the operation including other differences.

  Next, the operation of the processing system according to the second embodiment of the present invention will be described. FIG. 5 is a flowchart showing the operation of the second embodiment. The basic operation is the same as that in the flowchart of FIG. 3, and steps having the same operation are denoted by the same reference numerals. In the following, steps with different operations will be described.

  In step S <b> 82, the ATM control unit 41 notifies the image processing unit 52 of the start via the network 39 and starts transmitting video data captured by the camera unit 11 to the image processing unit 52 via the network 39. Upon receiving the start notification in step S71, the image processing unit 52 receives video data photographed by the camera unit 11 via the ATM control unit 41 and the network 39 in subsequent step S92, and performs image processing in subsequent step S73.

  When the image processing unit 52 detects two or more faces in steps S73 and S74 and determines that there is a risk of snooping, in step S95, the image processing unit 52 notifies the ATM control unit 41 of interruption through the network 39. Are recorded in the video storage unit 53. Further, the image processing unit 52 determines whether an end notification or a restart notification is received from the ATM control unit 41 via the network 39 in steps S96, S97, and S98.

  In step S84, the ATM control unit 41 determines whether or not there is an interruption notification from the image processing unit 52 via the network 39. If there is an interruption notification, the ATM control unit 41 determines the user's input as to whether or not the transaction process of the ATM 40 should be interrupted and resumed (S67). If there is an input for resumption, the image processing unit 52 in step S89. In step S90, if the restart is not input, the image processing unit 52 is notified of the end via the network 39 and the transmission of the video data captured by the camera unit 11 is ended. .

  Thus, in the processing system according to the second aspect of the present invention, the image processing function can be provided to a plurality of ATMs 40 by providing only one image processing device 50 on the network 39. There is no need to incorporate an image processing function in the ATM 40, and the present invention can be easily applied only by attaching the camera unit 11 to the ATM 40.

  Also, in the second embodiment, ATM has been described as an example of a processing device that uses a password. However, as in the first embodiment, an information processing device such as a personal computer, a server device, or a terminal device, or a portable terminal such as a PDA. The present invention can also be easily applied to a processing device such as a communication device such as a mobile phone having an information processing function by providing a camera function and connecting to an image processing device via a network.

  In the above description, when two or more faces are detected from the video, it is determined that there is a possibility of snooping, but in order to avoid the face appearing on the camera, the face is outside the field of view of the camera. Assuming that a person sees a sneak peek, it may be determined that there is a risk of snooping even if a part of the human body other than the user is detected in the vicinity of the user other than the face. It is not necessary to limit it to the face.

  In addition to ATM, the present invention is also applicable to a processing device such as a computer such as a personal computer, a server device or a terminal device, a portable terminal such as a PDA, and a communication device such as a cellular phone having an information processing function. And can prevent snooping.

It is the figure which showed the structure of the 1st form of this invention. It is an external view of ATM10 of this invention. It is the flowchart which showed the operation | movement of the 1st form of this invention. It is the figure which showed the structure of the 2nd form of this invention. It is the flowchart which showed the operation | movement of the 2nd form of this invention.

Explanation of symbols

10 ATM
DESCRIPTION OF SYMBOLS 11 Camera part 12 Display part 13 Input part 14 Card input part 15 Passbook input part 16 Cash in / out part 17 Printing part 18 Communication control part 21 ATM control part 22 Image processing part 23 Image | video storage part 30 Host apparatus 39 Network 40 ATM
41 ATM control unit 50 Image processing device 52 Image processing unit 53 Video storage unit

Claims (21)

A camera that shoots images of the user and the surrounding area, and analyzes the video shot by the camera from the time when the user starts preparing to enter the password until the password is successfully authenticated, When a person other than a user who may have been detected is detected, an image processing unit that notifies the suspension and a user who receives a suspension notification between the start of password input preparation and the successful password authentication And a control unit that interrupts the password input operation and the password authentication operation. When the face of two or more people including the user is detected in the video, it is determined that the image processing unit has detected a person other than the user who may be peeping around the user The processing apparatus according to claim 1, wherein: 3. The processing apparatus according to claim 2, wherein when two or more human faces including a user are detected in the video, the video at that time is recorded. In the case of the interruption, the user is inquired whether to restart from the password input process again. When the user performs the restart operation, the user restarts from the password input process, and the user does not perform the restart operation. 4. The processing apparatus according to claim 1, wherein the processing device is returned to an initial state. 5. The processing device according to claim 1, wherein the processing device is any one of a computer including a personal computer and a terminal device, a communication device including a mobile phone, and an automated teller machine. . A processing system in which a processing device for inputting a password and an image processing device for processing video sent from the processing device are connected via a network,
The processing device transmits a camera that captures images of the user and its surroundings, and images captured by the camera from when the user starts preparing to input a password until password authentication is successful. A control unit that interrupts an operation for a user to input a password and an operation to authenticate a password when receiving a suspension notification between the start of input preparation and the successful authentication of the password;
The image processing device includes an image processing unit that analyzes an image captured by the camera and notifies an interruption when a person other than a user who may be peeping around the user is detected. A processing system characterized by When the face of two or more people including the user is detected in the video, it is determined that the image processing unit has detected a person other than the user who may be peeping around the user The processing system according to claim 6. 8. The processing system according to claim 7, wherein when a face of two or more people including a user is detected in the video, the video at that time is recorded. In the case of the interruption, the user is inquired whether to restart from the password input process again. When the user performs the restart operation, the user restarts from the password input process, and the user does not perform the restart operation. The processing system according to claim 6, 7, or 8, wherein the processing system is returned to an initial state. 10. The processing system according to claim 6, 7, 8, or 9, wherein the processing device is any one of a computer including a personal computer and a terminal device, a communication device including a mobile phone, and an automated teller machine. . The user identifies the camera that shoots the user and the surrounding image, the card input unit that reads the personal identification information including the account number from the identification card, the passbook input unit that reads the personal identification information including the account number from the passbook, and the user From the time when the card is read by the card input unit or the passbook input unit is read, the user inputs the password and analyzes the video taken with the camera until the password is successfully authenticated. An image processing unit that notifies interruption when a person other than a user who may be peeping is detected, and the user causes the card input unit to read the identification card or the bankbook to read the passbook When the user receives a suspend notification from when the user enters the password until the password is successfully authenticated, the user enters the password and the password is authenticated. Automatic cash deposit payment machine, characterized in that it comprises a ATM controller interrupts the operation of the. When a password is input to the processing apparatus, a face is detected by analyzing the captured video of the user and its surroundings, and two or more faces are detected from the analysis result of the video A processing method for preventing snooping by face detection, characterized in that a password input operation and a password authentication operation are interrupted. From the time when the user starts preparing to input the password until the password is successfully authenticated, the video taken by the camera that shoots the video of the user and the surrounding area is analyzed and the user is seen in the vicinity. When a person other than a potential user is detected, an interruption is notified, and when the interruption is received between the start of password input preparation and the successful password authentication, the user enters the password. A processing method characterized by interrupting a password authentication operation. It is determined that when a face of two or more people including the user is detected in the video, a person other than the user who may be peeping around the user is detected. The processing method according to claim 13. 15. The processing method according to claim 14, wherein when the faces of two or more people including users are detected in the video, the video at that time is recorded. In the case of the interruption, the user is inquired whether to restart from the password input process again. When the user performs the restart operation, the user restarts from the password input process, and the user does not perform the restart operation. The processing method according to claim 13, 14, or 15, wherein the initial state is restored. When inputting a password to the processing device, two or more faces were detected from the procedure of detecting the face by analyzing the video taken by the user and the surrounding video, and the analysis result of the video A program for causing a computer to execute a procedure for interrupting an operation of inputting a password and an operation of authenticating a password in such a case. From the time when the user starts preparing to input the password until the password is successfully authenticated, the video taken by the camera that shoots the video of the user and the surrounding area is analyzed and the user is seen in the vicinity. When a person other than a potential user is detected, the user enters the password when receiving a suspension notification between the start of password input preparation and the successful password authentication procedure. A program for causing a computer to execute a procedure for interrupting an operation and an operation for authenticating a password. It is determined that when a face of two or more people including the user is detected in the video, a person other than the user who may be peeping around the user is detected. The program according to claim 18. 20. The program according to claim 19, wherein when a face of two or more people including a user is detected in the video, the video at that time is recorded. The procedure for inquiring to the user whether to restart from the password input process again at the time of the interruption, and if the user performs a restart operation, the process restarts from the password input process, and the user does not perform the restart operation 21. The program according to claim 18, 19 or 20, which causes a computer to execute a procedure for returning to an initial state.

Images