WO2016010328A1 - Information processing system and method using wearable device - Google Patents

Abstract

The present invention relates to an information processing method using a wearable device, and a program. The information processing method using a wearable device according to an embodiment of the present invention comprises the steps in which: an eyeglass-type wearable device receives a camera deactivating signal from a first beacon when a restricted camera use area set by the first beacon is entered (S100); and the eyeglass-type wearable device recognizes that the restricted camera use area has been entered, and restricts camera functions. According to the present invention, the invasion of privacy in certain areas can be prevented. The problem of users photographing the body parts of others on stairs, escalators, and the like can be prevented. Also, copyright infringement can be prevented. The problem of users of eyeglass-type wearable devices capturing videos in movie theaters and distributing same without permission or capturing works in art galleries and making copies thereof can be prevented.

Description

Information processing system and method using wearable device

The present invention relates to an information processing system and method using a wearable device, and more particularly, to a system and method for information processing data acquired during an activity of a user having a wearable device.

As the information age evolves rapidly, the importance of a display device for realizing a realistic screen is emphasized. An example is a head mounted display (HMD). The head mounted display device is mainly made of a safety glasses or a helmet type device to see the screen in front of the eyes, and was developed to realize virtual reality.

Glass-type wearable devices generally have a small display such as a liquid crystal installed at a position close to both eyes (both eyes) to project an image. Currently, the wearable device is for use in space development, nuclear reactors, military institutions, and medical institutions. Various developments for games and the like are in progress. A glass type wearable device according to the prior art is also disclosed in US Pat. No. US8,427,396.

Although various types of glass wearable devices have been researched and emerged, methods or services that wearers can conveniently utilize in daily life are very limited, and UI (User Interface) or UX (User Experience) suitable for glass wearable devices is very limited. Neither is it being developed. In addition, recently, glass-type wearable devices that can perform most functions by themselves, as well as glass-type wearable devices used in conjunction with mobile terminals such as smartphones, have been developed. Different from the mobile terminal of the need for a service suitable for the characteristics of the glass-type wearable device.

In order to solve this problem, one object of the present invention is to provide a service suitable for a glass-type wearable device that can be utilized by the user or wearer of the glass-type wearable device.

Particularly, an object of the present invention is to provide a service specific to a user (for example, identifying a counterpart or using a camera) by receiving a wireless signal from an external device (for example, a beacon signal generator or an external device, etc.). To provide a system and method).

In the information processing method using the glass-type wearable device according to an embodiment of the present invention, the step of receiving the camera deactivation signal from the first beacon when the glass-type wearable device enters the camera usage limit zone set by the first beacon ; And limiting camera functions by the glass type wearable device recognizing entry into the restricted camera area.

The method may further include: receiving a camera activation signal from the second beacon when the glass type wearable device enters the camera active area set by the second beacon; And activating a camera function by the glass type wearable device recognizing entry into the camera active area, and after receiving the camera deactivation signal of the first beacon, the camera activation signal of the second beacon. The camera function may be limited until receiving the signal.

The method may further include displaying, by the glass type wearable device, whether to limit or activate the use of a camera on a screen.

The method may further include informing the user that activation of the application is restricted by the glass type wearable device when receiving a specific input for executing an application that performs the camera function from the user within the camera usage area. Can be.

The glass type wearable device may generate an alarm when a user manually executes a camera function within the camera usage limit area.

The method may further include transmitting, by the glass type wearable device, location information of the user to an administrator using wireless communication when the user manually executes a camera function within the camera usage limit area.

In addition, the camera function limitation may be characterized in that the blurring or mosaic processing of a specific area of the image or image to be photographed according to the type of the camera restriction zone.

The camera function limiting step may further include: measuring, by the glass type wearable device, a gaze direction; And limiting the camera function when the gaze direction is included in the shooting restriction direction in the camera usage limit area. The shooting restriction direction may be included in the deactivation signal.

In addition, the step of limiting the camera function may further include measuring a current indoor location, and the photographing restriction direction may be set based on the indoor location.

In accordance with another aspect of the present invention, an information processing method using a glass type wearable device includes: receiving, by the glass type wearable device, a wireless communication signal transmitted from the communication device or the wireless communication tag; Recognizing, by the glass type wearable device, an identification code included in the wireless communication signal; Searching for identity information of the other party corresponding to the identity identification code; And performing, by the glass type wearable device, a notification of the searched identity information to a user.

In accordance with another aspect of the present invention, an information processing method using a glass type wearable device includes: receiving, by the glass type wearable device, a wireless communication signal transmitted from the communication device or the wireless communication tag; Recognizing, by the glass type wearable device, an identification code included in the wireless communication signal; Acquiring, by the glass type wearable device, a front image including a face image of the counterpart; Extracting the face image from the acquired image and setting it as a test object; Searching for identity information of the other party corresponding to the identity identification code; And comparing the extracted image image with the image image included in the identification information and determining whether the same person is the same person.

The method may further include, when the plurality of face images are extracted from the front image, comparing each of the image images with the plurality of face images, and excluding a matching face image from the inspection object.

The method may further include displaying, by the glass-type wearable device, the face image in the mismatched face image on the screen when there is a face image in the inspection object that does not match the image image.

The identification information searching step may include searching for the identification information stored in the wearable device, or searching for the identification information corresponding to the identification identification code by transmitting the identification identification code to an identification information database server. It may be characterized by being carried out by any one of the methods.

In addition, the identification code corresponds to any one of a military number, employee number, resident registration number, user ID, the identity information, characterized in that it comprises at least one or more of the name, image image, rank or rank, other personal information Can be.

In accordance with another aspect of the present invention, an information processing method using a glass type wearable device includes: receiving, by the glass type wearable device, a wireless communication signal transmitted by the communication device or the wireless communication tag; Measuring, by the glass type wearable device, a transmission direction of the wireless communication signal; Acquiring a front image by the glass type wearable device to recognize a person in the front image; And comparing the transmission direction of the wireless communication signal with a direction in which the person is located in the front image, and recognizing the wireless communication signal corresponding to each person.

The method may further include: recognizing, by the glass type wearable device, an identification code included in the wireless communication signal; Searching for identity information of the other party corresponding to the identity identification code; And displaying the identification information corresponding to the recognized person on a screen.

Further, when the wireless communication signal corresponding to the direction in which the direction of the person is located in the front image is not transmitted, the glass type wearable device informs the user that the recognized person does not have the wireless communication tag. Notifying; may further include.

According to the present invention as described above, has the following various effects.

First, the camera function limitation system and method of the glass type wearable device using the beacon according to the embodiments of the present invention can prevent privacy invasion in a specific region. The user may prevent a problem such as photographing the body part of another person on the stairs, the escalator, or the like.

Second, the camera function limitation system and method of the glass type wearable device using beacons according to embodiments of the present invention can prevent copyright infringement. The user of the glass-type wearable device can prevent a problem of taking an image in a movie theater and distributing it or making a duplicate by photographing a work in a museum.

Third, the user receives the identification code from the other party having a wireless communication tag or communication device, it can be easily identified through the identification information. For example, if the user is a bodyguard or a veteran, it is necessary to identify the other party's identity, so that the glass type wearable device can easily identify the identity information by actively sensing a wireless communication signal transmitted from a wireless communication tag held by the other party. It works.

Fourth, when a plurality of people are located in front of the user, by comparing the position of the person on the image obtained by the first camera and the transmission direction of the wireless communication signal has the effect of accurately matching each person's identity information to provide to the user have. In addition, as a result of the comparison, it is possible to identify a person on the image that is not receiving a wireless communication signal and inform the user, so that a person who does not have a wireless communication tag at the time of identification is easily recognized.

Fifth, including a face recognition process for comparing a face image of the other person's face with the user's face information, there is an effect that can prevent the case of identity authentication by stealing another person's wireless communication tag or communication device. In addition, when the faces do not match, the glass-type wearable device may notify the user through the output unit to easily inform the person that the faces do not match.

1 is a block diagram of a glass type wearable device system according to an exemplary embodiment of the present invention.

2 is an exemplary view of a glass type wearable device related to one embodiment of the present invention.

3 is a diagram illustrating a connection relationship between a glass type wearable device, an external server, and an external device according to an exemplary embodiment of the present invention.

4 is a flowchart illustrating a method for limiting camera functions of a glass type wearable device according to an embodiment of the present invention.

FIG. 5 is a flowchart illustrating a method of limiting camera functions of a glass type wearable device in which a camera function is restricted by a first beacon and a camera function is activated by a second beacon according to an embodiment of the present invention.

6 is a diagram illustrating a beacon arrangement for limiting the camera function of the glass type wearable device using the beacon in the museum according to an embodiment of the present invention.

7 is a diagram illustrating a beacon arrangement for limiting the camera function of the glass type wearable device using a beacon in an escalator according to an embodiment of the present invention.

8 is an exemplary diagram in which a glass type wearable device displays a camera function limitation on a display unit, according to an exemplary embodiment.

9 is a block diagram of a camera function restriction system of the glass type wearable device using a beacon according to an embodiment of the present invention.

10 is a flowchart illustrating an identification method of the glass type wearable device according to an embodiment of the present invention.

11 is a flowchart illustrating a method of identifying an identity of a glass type wearable device using a face recognition method according to an embodiment of the present invention.

12 is a flowchart illustrating an identification method using a glass type wearable device by recognizing a wireless communication signal transmission direction according to an embodiment of the present invention.

FIG. 13 is an exemplary view showing a person who does not match a beacon signal transmission direction on a display unit of a glass type wearable device according to an embodiment of the present invention.

14 is an exemplary view showing a person who does not match the face image in the identity information on the display unit of the wearable device according to an embodiment of the present invention.

15 is an internal configuration diagram of an identification system using a glass type wearable device according to an embodiment of the present invention.

Advantages and features of the present invention and methods for achieving them will be apparent with reference to the embodiments described below in detail with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below, but may be implemented in various forms. It is provided to fully convey the scope of the invention to those skilled in the art, the invention being defined only by the scope of the claims. Meanwhile, the terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the invention. In this specification, the singular also includes the plural unless specifically stated otherwise in the phrase. As used herein, “comprises” and / or “comprising” refers to the presence of one or more other components, steps, operations and / or elements. Or does not exclude additions. In addition, detailed descriptions of well-known functions and configurations that may unnecessarily obscure the subject matter of the present invention will be omitted.

1 is a block diagram of a glass type wearable device system 10 according to an embodiment of the present invention.

Referring to FIG. 1, the glass type wearable device system 10 according to an exemplary embodiment of the present invention may include an input unit 100, a user input unit 110, a keyboard 111, a touch pad 112, and a camera unit 120. ), The first camera 121, the second camera 122, the third camera 123, the sensing unit 130, the gyro sensor 131, the acceleration sensor 132, the pressure sensor 133, iris recognition sensor 134, heart rate detection sensor 135, EMG sensor 136, voice input unit 140, information processing unit 210, voice recognition unit 220, situation evaluation module 230, voice-to-text conversion module 240 ), A wireless communication unit 250, a memory 260, an interface unit 230, an output unit 300, a display unit 310, an audio output unit 320, an alarm unit 330, and a haptic module 340. It includes all or part of. The components shown in FIG. 1 are not essential, so a glassy wearable device with more or less components may be implemented.

2 is an exemplary view of a glass type wearable device related to one embodiment of the present invention.

The components may be provided inside or on one side of the glass type wearable device as shown in FIG. 2.

Hereinafter, the components will be described in order.

The input unit 100 is for inputting an audio signal, a video signal, a user's manipulation signal, a biosignal, and the like. The input unit 100 includes a user input unit 110, a camera unit 120, a sensing unit 130, and a voice input unit 140.

The user input unit 110 generates key input data input by the user for controlling the operation of the device. The user input unit 110 may include a keypad, a keyboard 111, a dome switch, a touch pad (static pressure / capacitance) 112, a jog wheel, a jog switch, a finger mouse, and the like. In particular, when the touch pad forms a mutual layer structure with the display unit 310 to be described later, this may be referred to as a touch screen.

The camera 120 is for inputting a video signal or an image signal, and two or more cameras 120 may be provided according to a configuration aspect of the device. The camera 120 processes image frames such as still images or moving images obtained by an image sensor in a video call mode or a photographing mode. The processed image frame may be displayed on the display 310. In addition, the image frame processed by the camera 120 may be stored in the memory 260 or transmitted to the outside through the wireless communication unit 250. In addition, when an image signal or a video signal is used as an input for information processing, the control unit 210 transmits the image signal and the video signal.

The camera unit 120 may include one or more cameras according to the direction or purpose of the captured image. The first camera 121 may be provided at one side of the glass type wearable device to capture an image of the front side. The second camera 122 may be provided at one side of the glass type wearable device to acquire an image or an image in an eyeball direction. The third camera 123 may be provided at the rear or side of the glass type wearable device 10 to acquire an image or an image of the rear or side.

The sensing unit 130 generates a sensing signal for controlling the operation of the device by detecting the current state of the device, such as whether the user wears the glass-shaped wearable device 10 or the position of the device. In addition, the sensing unit 130 may perform a function of an input unit receiving an input signal for information processing of the device, and may perform various sensing functions such as whether an external device is connected or not.

The sensing unit 130 includes a proximity sensor, a pressure sensor 133, a motion sensor, a fingerprint recognition sensor, an iris recognition sensor 134, a heart rate detection sensor 135, a skin temperature sensor, a skin resistance sensor and an electrocardiogram sensor. And various sensors.

The proximity sensor can detect the presence or absence of an approaching object or an object present in the vicinity without mechanical contact. The proximity sensor can detect a proximity object by using a change in an alternating magnetic field or a change in a static magnetic field, or by using a change rate of capacitance. Two or more proximity sensors may be provided according to the configuration aspect.

The pressure sensor 133 may detect whether pressure is applied to the device, the magnitude of the pressure, and the like. The pressure sensor 133 may be installed at a portion of the device requiring detection of pressure according to the use environment. If the pressure sensor 133 is installed in the display 310, a touch input through the display 310 and a greater pressure than the touch input are applied according to the signal output from the pressure sensor 133. The pressure touch input can be identified. In addition, according to the signal output from the pressure sensor 133, it is also possible to know the magnitude of the pressure applied to the display 310 when the pressure touch input.

The motion sensor includes one or more of sensors such as a gyro sensor 131, an acceleration sensor 132, and a geomagnetic sensor, and detects the position or movement of the device using the same. The acceleration sensor 132 that can be used for a motion sensor is a device that converts an acceleration signal in one direction into an electrical signal, and is widely used with the development of micro-electromechanical systems (MEMS) technology. In addition, the gyro sensor 131 is a sensor for measuring the angular velocity, and may sense a direction returned to the reference direction.

The heart rate detection sensor 135 measures the change in the light blood flow rate according to the change in blood vessel thickness due to the heartbeat. The skin temperature sensor measures the skin temperature as the resistance value changes in response to the temperature change. Skin resistance sensors measure the electrical resistance of the skin.

The iris recognition sensor 134 performs a function of recognizing a person using iris information of an eye having unique characteristics for each person. The human iris is completed after 18 months of age, and then the circular iris pattern, which is raised near the inner edge of the iris, is almost unchanged once determined. Therefore, iris recognition is the application of security authentication technology by informatizing the characteristics of different iris for each person. In other words, it is an authentication method developed as a means of identifying people by analyzing the shape and color of the iris and the morphology of the retinal capillaries.

The iris recognition sensor 134 codes and compares the iris pattern with an image signal, and determines the comparison. The general operation principle is as follows. First, when the user's eyes are focused on the mirror in the center of the iris recognizer at a certain distance, the infrared camera adjusts the focus through the zoom lens. Then, the iris camera images the user's iris into a photograph, and the iris recognition algorithm analyzes the iris contrast patterns by area to generate a unique iris code. Finally, a comparison search is performed as soon as the iris code is registered in the database. The iris recognition sensor 134 may be provided inside the second camera 122 disposed in the eye direction, and in this case, the second camera 122 may perform a function of the iris recognition sensor.

The distance sensor includes a distance measurement method between two points, a triangulation method (infrared ray type, natural light type), and ultrasonic type. As in the conventional triangulation principle, the distance between two points is displayed when the measured objects from the two paths are reflected by a right-angle prism and incident on the two image sensors so that the relative positions match. In this case, there are a method of generating natural light (passive type) and a method of emitting infrared rays. The ultrasonic method is a method in which the distance is measured by transmitting an ultrasonic wave having a sharp directivity to the object to be measured and receiving a reflected wave from the object to be measured. The receiving sensor uses a piezoelectric element.

The Doppler radar is a radar that utilizes a phase change of the reflected wave, that is, a Doppler effect of the wave. The doppler radar includes a continuous wave radar that transmits and receives a sine wave which is not pulse modulated, and a pulse radar that uses pulse modulated radio waves as an electromagnetic wave signal waveform.

Continuous wave radar is unsuitable for long range radar because modulating frequency is relatively high in order to obtain the performance of Doppler frequency filter. There are features that can be. The pulse radar measures the distance to the target by the time from pulse transmission to reflection echo reception. There is a method called pulse compression radar that applies frequency modulation or phase modulation within the transmission pulse width.

The voice input unit 140 is for inputting a voice signal and may include a microphone. The microphone receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes it into electrical voice data. The processed voice data may be converted into a form transmittable to the mobile communication base station through the wireless communication unit 250 and output in the call mode. As a microphone, various noise canceling algorithms may be used to remove noise generated while receiving an external sound signal.

The output unit 300 is for outputting an audio signal, an image signal, a video signal or an alarm signal. The output unit 300 may include a display unit 310, a sound output unit 320, an alarm unit 330, and a haptic module 340.

The display 310 displays and outputs information processed by the device. For example, when the device is in a call mode, the device displays a user interface (UI) or a graphic user interface (GUI) related to the call. When the device is in a video call mode or a photographing mode, the captured or received images may be displayed at the same time or simultaneously, and the UI and the GUI may be displayed.

On the other hand, as described above, when the display unit 310 and the touch pad form a mutual layer structure to form a touch screen, the display unit 310 may be used as an input device in addition to the output device. If the display unit 310 is configured as a touch screen, the display unit 310 may include a touch screen panel and a touch screen panel controller.

In addition, the display unit 310 may include a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, and a three-dimensional display. It may include at least one of (3D display). In addition, two or more display units 310 may exist according to the implementation form of the device. For example, the external display unit 310 and the internal display unit 310 may be simultaneously provided in the device.

The display unit 310 may be implemented as a head up display (HUD), a head mounted display (HMD), or the like. HMD (Head mounted Display) is a video display device that you can wear on your head like glasses and enjoy large images. A head up display (HUD) is an image display device for projecting a virtual image onto glass in a user's visible area.

The sound output unit 320 outputs audio data received from the wireless communication unit or stored in the memory 260 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like. In addition, the sound output module 320 outputs a sound signal related to a function performed in the device, for example, a call signal reception sound and a message reception sound. The sound output module 320 may include a speaker, a buzzer, and the like.

The alarm unit 330 outputs a signal for notifying occurrence of an event of the device. Examples of events occurring in the device include call signal reception, message reception, and key signal input. The alarm unit 330 outputs a signal for notifying occurrence of an event in a form other than an audio signal or a video signal. For example, the signal may be output in the form of vibration. The alarm unit 330 may output a signal to notify the call signal when the call signal is received or a message is received. Also. When the key signal is input, the alarm unit 330 may output the signal as a feedback to the key signal input. The user may recognize the occurrence of an event through the signal output from the alarm unit 330. The signal for notifying the event occurrence in the device may also be output through the display 310 or the sound output unit 320.

The haptic module 340 generates various haptic effects that a user can feel. A representative example of the haptic effect generated by the haptic module 340 is a vibration effect. When the haptic module 340 generates vibration by the tactile effect, the intensity and pattern of the vibration generated by the haptic module 340 may be converted, and may be output by combining different vibrations or sequentially.

The wireless communication unit 250 may include a broadcast receiving module, a mobile communication module, a wireless internet module, a short range communication module, and a location information module.

The broadcast receiving module receives at least one of a broadcast signal and broadcast related information from an external broadcast management server through a broadcast channel. In this case, the broadcast channel may include a satellite channel, a terrestrial channel, and the like. The broadcast management server may mean a server that generates and transmits at least one of a broadcast signal and broadcast related information, or a server that receives at least one of the pre-generated broadcast signal and broadcast related information and transmits the same to a terminal.

The broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider. The broadcast related information may also be provided through a mobile communication network, and in this case, may be received by the mobile communication module. Broadcast related information may exist in various forms.

The broadcast receiving module may receive a broadcast signal using various broadcast systems, and receive a digital broadcast signal using a digital broadcast system. In addition, the broadcast receiving module may be configured to be suitable for all broadcast systems providing broadcast signals as well as such digital broadcast systems. The broadcast signal and / or broadcast related information received through the broadcast receiving module may be stored in the memory 260.

The mobile communication module transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data according to voice call signal, video call signal, or text / multimedia message transmission and reception.

The wireless internet module refers to a module for wireless internet access, and the wireless internet module may be embedded or external to the device. Wireless Internet technologies include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), long term evolution (LTE), LTE-A Long Term Evolution-Advanced and the like can be used.

The short range communication module refers to a module for short range communication. Beacon, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, etc. may be used as a short range communication technology.

The location information module refers to a module that receives the positioning signal and measures the position of the glass type wearable device. For example, the position information module may correspond to a Global Position System (GPS) module, and the positioning signal may correspond to a GPS signal. The Global Position System (GPS) module receives position information from a plurality of GPS satellites.

The memory 260 may store a program for processing and controlling the controller 210, and may perform a function for temporarily storing input or output data (eg, a message, a still image, a video, etc.). It may be.

The memory 260 may include a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (for example, SD or XD memory), RAM The storage medium may include at least one type of storage medium. In addition, the device may operate a web storage that performs a storage function of a memory on the Internet. The memory 260 may be referred to as a storage 260 hereinafter.

The interface unit 230 serves as an interface with all external devices connected to the device. Examples of external devices that connect to the device include wired / wireless headsets, external chargers, wired / wireless data ports, memory cards, card sockets such as Subscriber Identification Module (SIM) or User Identity Module (UIM) cards, Audio I / O (Input / Output) terminals, video I / O (Input / Output) terminals, earphones, and the like. The interface unit 230 may receive data from such an external device or receive power and transfer the power to each component inside the device, and allow the data inside the device to be transmitted to the external device.

The controller 210 typically controls the operation of each unit to perform a function of controlling the overall operation of the device. For example, perform related control and processing for voice calls, data communications, and the like. In addition, the controller 210 performs a function of processing data for multimedia reproduction. In addition, it performs a function of processing the data received from the input unit or the sensing unit 130.

In addition, the controller 210 performs face detection and face recognition for face recognition. That is, the controller 210 may include a face detection module and a face recognition module for face recognition. The face detection module may extract only the face area from the camera image acquired by the camera unit 120. For example, the face detection module extracts a face region by recognizing feature elements in the face such as eyes, nose, and mouth. The face recognition module may generate a template by extracting feature information from the extracted face region, and recognize a face by comparing a template with face information data in a face database.

In addition, the controller 210 may perform a function of extracting and recognizing a character from an image or an image acquired by the camera unit 120. That is, the controller 210 may include a character recognition module for character recognition. Optical character recognition (OCR) may be applied as a character recognition method of the character recognition module. The OCR method converts a typeface image of a document written by a person who can be obtained by an image scan or printed by a machine into a format such as a computer code that can be edited by a computer, and can be implemented by software. For example, the OCR method may compare several standard pattern letters and input characters prepared in advance and select the most similar to the standard pattern letters as the corresponding letters. If the character recognition module includes standard pattern letters of various languages, it is possible to read printed characters of various languages. Such a method is called a pattern matching method among the OCR methods, and the OCR method is not limited thereto, and various methods may be applied. In addition, the character recognition method of the character recognition module is not limited to the OCR method, various methods for recognizing the character on the offline already printed may be applied.

In addition, the controller 210 may perform a function of recognizing a gaze direction based on an eyeball image or an image acquired by the second camera 122. That is, the controller 210 may include a gaze analysis module that performs gaze direction recognition. After measuring the gaze direction and the gaze direction of the user, it is possible to determine the direction that the user looks by calculating by synthesis. The gaze direction refers to a direction of the face of the user and may be measured by the gyro sensor 131 or the acceleration sensor 132 of the sensing unit 130. The gaze direction may be grasped by the gaze analysis module in a direction viewed by the user's pupil. The gaze analysis module may detect a movement of a pupil through analysis of a real-time camera image, and apply a method of calculating a direction of a gaze based on a fixed position reflected by the cornea. For example, through the image processing method, the position of the corneal reflected light by the center of the pupil and the illumination may be extracted and the gaze position may be calculated through the positional relationship thereof.

The controller 210 may be represented by the information processor 210.

The power supply unit receives an external power source and an internal power source under the control of the controller 210 to supply power for operation of each component.

The speech recognition unit 220 performs a function of identifying linguistic meaning content from the speech by automatic means. Specifically, the process of identifying a word or word sequence and extracting meaning by inputting a speech waveform is classified into five categories: speech analysis, phoneme recognition, word recognition, sentence interpretation, and meaning extraction. The voice recognition unit 220 may further include a voice evaluation module for comparing whether the stored voice and the input voice are the same. In addition, the voice recognition unit 220 may further include a voice-to-text conversion module 240 for converting an input voice into text or converting a text into voice.

The EEG signal generation unit generates an EEG signal having a frequency and a waveform for tuning human EEG. That is, the EEG signal generator transmits the vibration of the EEG frequency to the skull to perform the function of tuning the EEG. EEG is the flow of electricity that occurs when a cranial nerve signal is transmitted. These brain waves are delta waves, which are very slow when you sleep, beta waves, which are fast when you are active, and alpha waves, which are medium speeds when you meditate. Therefore, the EEG signal generator may induce alpha waves and theta waves to exert the effects of learning assistance and mental concentration.

3 is a diagram illustrating a connection relationship between the glass type wearable device 10, the external server 20, and the external device 30 according to an embodiment of the present invention.

The glass type wearable device 10 may perform all the processing for information processing therein, but the external server 20 may perform some of the information processing. Accordingly, the glass type wearable device 10 may transmit the data acquired through the input unit 100 or data on which some information processing is performed to the external server 20 as information processing request data. The glass type wearable device 10 may receive information processing result data performed by the external server 20 through wireless communication. The glass type wearable device 10 may provide the received information processing result data to the user through the output unit 300 in various ways. The external server 20 may be different according to a service performed by the glass type wearable device 10.

The glass type wearable device 10 may provide the information processing result data to the user through its output unit 300, or may provide the information processing result data using the external device 30. That is, when the glass type wearable device 10 performs the entire information processing process, the external device 30 may output information processing result data received from the glass type wearable device 10. In addition, when the external server 20 receives the information processing request data from the glass type wearable device 10 to perform some information processing, the external device 30 receives the information processing result data received from the external server 20. You can output The external device 30 may include various devices such as a smartphone, a tablet PC, a smart TV, and an output unit (for example, a display unit provided in the vehicle glass or an internal vehicle sound output unit) provided in the vehicle. .

In addition, the glass type wearable device 10 may receive a wireless communication signal (for example, a beacon signal transmitted from a beacon tag that is a wireless communication tag 30) transmitted from the external device 30. The glass type wearable device 10 may perform information processing using the received wireless communication signal.

Hereinafter, a method, system, and program for limiting camera functions of a glass type wearable device using beacons according to embodiments of the present invention will be described with reference to the accompanying drawings.

Smartphone and wrist wearable devices may recognize whether to take a picture in the vicinity because the device needs to be directed toward the direction to be photographed, but the glass type wearable device 10 may measure the direction in which the user is photographing. Photographing may be performed only by an operation of staring while wearing the wearable device 10 and an execution command by a user's simple physical motion or voice. Accordingly, by using the glass-shaped wearable device 10, taking pictures in a state where others are not aware of the privacy violation and related crimes may increase rapidly. In addition, the problem of copyright infringement that is secretly photographed and distributed in a place where photographing of a movie theater or an art gallery is prohibited may increase rapidly. In order to solve this problem, there is a need for a method and program for restricting the use of the camera of the glass type wearable device 10 in a specific area using a beacon signal.

4 is a flowchart illustrating a method for limiting camera functions of the glass type wearable device 10 using beacons according to an exemplary embodiment of the present invention. 5 is a method for limiting camera functions of the glass type wearable device 10 in which the camera function is restricted by the first beacon 40 and the camera function is activated by the second beacon 50 according to an embodiment of the present invention. Flowchart.

Referring to FIG. 4, in the method for limiting camera functions of the glass type wearable device 10 using beacons according to an embodiment of the present invention, when the camera usage limit area set by the first beacon 40 is entered, the glass type Receiving, by the wearable device 10, a camera deactivation signal from the first beacon 40 (S100); And limiting camera functions by the glass type wearable device 10 recognizing entry into the restricted camera area (S110). A method of limiting camera functions of the glass type wearable device 10 using beacons according to an embodiment of the present invention will be described in order.

When the camera usage limit area set by the first beacon 40 is entered, the glass type wearable device 10 receives a camera deactivation signal from the first beacon 40 (S100). The first beacon 40 transmits a camera deactivation signal, which is a command signal for deactivating a camera function, to the glass type wearable device 10 using Bluetooth. The restricted camera zone means a range in which camera functions are limited by the camera deactivation signal of the first beacon 40. The camera usage limit zone is set within a range of the camera deactivation signal by the first beacon 40 or after receiving the camera deactivation signal by the first beacon 40 (eg, a camera activation signal). ) Can be set to any range before it is received. The method of setting the restricted camera area is not limited thereto, and may include any method of setting a zone using a beacon. The glass type wearable device 10 actively senses a camera deactivation signal transmitted from the first beacon 40.

The glass type wearable device 10 recognizes the entry into the restricted camera area and limits the camera function (S110). When the glass type wearable device 10 receives the camera deactivation signal, the glass wearable device 10 recognizes that the glass wearable device 10 has entered the camera usage limit area. That is, the glass type wearable device 10 determines whether the received signal corresponds to a camera deactivation signal, and when the glass type wearable device 10 corresponds to a camera deactivation signal, recognizes that the glass type wearable device 10 has entered the camera usage limit area. . Thereafter, the glass type wearable device 10 controls to limit the camera function. For example, when the camera use limit zone is set within the range of the camera deactivation signal, the controller 210 determines whether the camera deactivation signal is continuously received, and maintains the camera function limitation if received.

For example, as shown in FIG. 6, when the user wears the glass wearable device 10 and enters a place where image or photographing of a museum or the like is restricted, the glass wearable device 10 is disposed around the work. Use of the camera may be restricted within the range of the camera deactivation signal transmitted from the first beacon 40. Through this, it is possible to prevent people from making a replica after photographing a work of art with a glass-type wearable device 10 as an image or a photo.

In addition, referring to FIG. 5, according to one embodiment of the present invention, when the camera-use active area set by the second beacon 50 is entered, the glass type wearable device 10 may receive a camera from the second beacon 50. Receiving an activation signal (S120); And activating the camera function by the glass type wearable device 10 recognizing entry into the camera active area (S130). In this case, the glass type wearable device 10 may limit the camera function until the camera beacon signal of the second beacon 50 is received after receiving the camera deactivation signal of the first beacon 40.

First, when entering the camera use active area set by the second beacon 50, the glass type wearable device 10 receives a camera activation signal from the second beacon 50 (S120). The second beacon 50 may perform a function of setting a camera active area. That is, the second beacon 50 may perform a function of transmitting a camera activation signal, which is a command signal for activating a camera function, to the glass type wearable device 10 using Bluetooth. The camera use active zone means a range in which a camera function is activated by the camera activation signal of the second beacon 50, and is set to a range in which the camera activation signal by the second beacon 50 is applied, or the second beacon ( After receiving the camera deactivation signal by 50), it may be set to all ranges before another signal (for example, a camera deactivation signal) is received. The method of setting the camera active area is not limited thereto, and may include any method of setting a zone using a beacon. The glass type wearable device 10 may actively sense a camera activation signal transmitted from the second beacon 50.

The glass type wearable device 10 may recognize the entry of the camera active area and activate the camera function (S130). The glass type wearable device 10 determines whether the received signal corresponds to the camera activation signal, and if the glass type wearable device 10 corresponds to the camera activation signal, recognizes that the glass type wearable device 10 has entered the camera active area. Thereafter, the glass type wearable device 10 may be controlled to activate the camera function.

For example, as shown in FIG. 7, when a user enters an escalator that wears the glass type wearable device 10, it is necessary to limit the use of the camera to prevent a problem of voyeurizing another person. Therefore, the first beacon 40 may be installed at the inlet of the escalator to generate the camera deactivation signal, and the second beacon 50 may be installed at the outlet of the escalator to generate the camera activation signal. By controlling the intensity of the signal generated by the first beacon 40 and the second beacon 50, the beacon signal may be acquired only when the glass type wearable device 10 approaches the inlet or the outlet. When the glass type wearable device 10 acquires a camera deactivation signal at the inlet of the escalator, the camera function is limited. When the glass wearable device 10 acquires a camera activation signal at the outlet of the escalator, the camera function may be reactivated.

The method may further include displaying, by the glass type wearable device 10, whether to limit or activate the use of a camera on a screen. As shown in FIG. 8, the display 310 displays the entry into the camera active area, so that the user can recognize the entry into the camera active area by himself. In addition, when entering the camera restricted zone and executing an application other than the camera function, the application is executed when the application including the camera function is executed without displaying the entry of the camera restricted zone on the display 310. It can be implemented to display the entry into the restricted area while limiting the display 310.

In addition, when the user receives a specific input for executing an application that performs the camera function in the camera usage area, the glass type wearable device 10 notifies the user that the start of the application is limited. It may further include. When one embodiment of the glass type wearable device 10 includes the motion sensor, the application may be executed by an operation such as a motion of a user who wears the glass type wearable device 10. According to the characteristics of the glass type wearable device 10, within the camera usage limit area, the glass type wearable device 10 recognizes an operation for executing an application of a user through a motion sensor, and the operation is a camera. If an operation for executing an application including a function is executed, the execution of the application may be restricted. Thereafter, the glass type wearable device 10 may inform the user that activation of the application is limited. As a method of providing a notification to a user, a method of providing a voice notification, a method of displaying on a screen of the display unit, a method of providing a vibration alarm, and the like may be applied.

In addition, when the user manually executes a camera function within the camera usage limit zone, the glass type wearable device 10 may generate an alarm. That is, when the user manually executes the camera function as an administrator of the glass type wearable device 10, the glass type wearable device 10 generates an alarm. An alarm may be generated to the user through vibration or voice, thereby recognizing that the camera is within the restricted use area, and may be implemented to generate a voice alarm to the outside.

The method may further include transmitting, by the glass type wearable device 10, the location information of the user to an administrator using wireless communication when the user manually executes a camera function within the camera usage limit area. Can be. When a user manually executes a camera function as an administrator of the glass type wearable device 10, the glass type wearable device 10 transmits the user's location information to a wireless location within a corresponding place (for example, a movie theater or an art gallery). Use the communication to send to the manager of the place. For example, when a user sneaks a movie by manually executing a camera function based on an administrator's authority in a movie theater set as the camera restricted area by the camera deactivation signal, the glass type wearable device 10 The seat position of the user may be transmitted by using wireless communication in the movie theater. Through this, when the user manually executes the camera function of the wearable device, the administrator of the corresponding place may go to the user's location and sanction the user directly, and take further action.

In addition, the camera function limitation may blur or mosaic a specific region of an image or an image captured according to the type of the camera restriction zone. That is, when it is not possible to restrict the use of the camera in a specific place, it may be possible to blur or mosaic only a specific region in the image or image to be photographed.

In addition, the camera function limitation step (S120), the step of measuring the gaze direction by the glass type wearable device (10); And limiting the camera function when the gaze direction is included in the shooting restriction direction in the camera usage limit area. For example, as shown in FIG. 7, when the user wearing the glass-shaped wearable device 10 rides on an escalator, the user only needs to lift a head and take a picture or image. Therefore, the glass type wearable device 10 may measure the direction of attention of the wearer. The gaze direction refers to an azimuth or high and low angles measured by the motion sensor of the glass type wearable device 10 in the direction of the face viewed by the user. Thereafter, the glass type wearable device 10 may recognize the capturing direction information included in the deactivation signal transmitted by the first beacon 40. Thereafter, the control unit 210 of the glass type wearable device 10 may limit the camera function when the measured gaze direction is included in the shooting restriction direction in the camera usage limit area.

In addition, the step of limiting the camera function may further include measuring a current indoor location, and the photographing restriction direction may be set based on the indoor location. That is, the glass type wearable device 10 recognizes the current location of the user through an indoor positioning method using a wireless communication signal, an indoor positioning method through analysis of a real-time front image obtained by the first camera, and recognizes the current location. On the basis, it is possible to recognize whether shooting is restricted or shooting is restricted.

9 is a block diagram of a camera function restriction system of the glass type wearable device 10 using beacons according to an embodiment of the present invention. However, in FIG. 9, detailed description of the previously described configuration will be omitted.

9, the camera function limiting system of the glass type wearable device 10 using beacons according to another embodiment of the present invention includes the first beacon 40, the second beacon 50, and glass. Type wearable device 10.

The first beacon 40 performs a function of transmitting a camera deactivation signal. That is, the first beacon 40 is in a specific area (eg, when setting the camera function deactivation range through the reach of the first beacon 40) or the specific area entry point (eg For example, when the first beacon 40 signal is received, the second beacon 50 may be disposed in the case of limiting the camera function until the signal is received) to transmit the camera deactivation signal.

The second beacon 50 performs a function of transmitting a camera activation signal. That is, the second beacon 50 is disposed at a specific area exit point (for example, when the camera function is restricted until the second beacon 50 signal is received after the first beacon 40 signal is received). Camera function activation signal can be sent.

The glass type wearable device 10 may include a wireless communication unit 250 and a control unit 210. The wireless communication unit 250 may perform a function of receiving a wireless communication signal (for example, a beacon signal) from the first beacon 40 or the second beacon 50. The controller 210 may recognize a camera usage restriction area and perform a function of limiting a camera function.

In addition, the glass type wearable device 10 according to an embodiment of the present invention may further include a motion sensor. The user may perform a function of recognizing an application execution operation in the camera usage restriction area. The motion sensor may include at least one of an acceleration sensor 132, a geomagnetic sensor, and a gyro sensor 131.

In addition, the display unit 310 may further include. The display 310 performs a function of displaying to a user whether to restrict or activate the use of a camera.

In addition, the alarm unit 330 may be further included. The alarm unit 330 performs a function of generating a warning sound when the user manually executes a camera function within the camera usage limit area.

In addition, the wireless communication unit 250 may transmit the location information of the user to the administrator when the user manually executes a camera function within the camera usage limit area.

According to the present invention as described above, has the following various effects.

First, the camera function limitation system and method of the glass type wearable device 10 using beacons according to embodiments of the present invention can prevent privacy invasion in a specific region. The user may prevent a problem such as photographing the body part of another person on the stairs, the escalator, or the like.

Second, the camera function limitation system and method of the glass type wearable device 10 using beacons according to embodiments of the present invention can prevent copyright infringement. A user of the glass type wearable device 10 may prevent a problem in which a user shoots an image at a movie theater and distributes it illegally, or a photograph is made in a museum to create a duplicate.

Hereinafter, an identification system, a method, and a program using the glass type wearable device 10 according to embodiments of the present invention will be described with reference to the accompanying drawings.

10 is a flowchart illustrating an identification method using the glass type wearable device 10 according to an exemplary embodiment of the present invention.

Referring to FIG. 10, in the identification method using the glass type wearable device 10 according to an embodiment of the present invention, the glass type wearable device 10 may be connected to the external device 30 or the wireless communication tag 30. Receiving a wireless communication signal transmitted from the step (S200); Recognizing, by the glass type wearable device, an identification code included in the wireless communication signal (S210); Searching for identification information of the other party corresponding to the identification code (S220); And performing notification of the searched identity information to the user by the glass type wearable device 10 (S230). An identification method using the glass type wearable device 10 according to an exemplary embodiment of the present invention will be described in order.

The glass type wearable device 10 receives a wireless communication signal transmitted from the external device 30 or the wireless communication tag 30 (S100). The glass type wearable device 10 may receive and receive a wireless communication signal transmitted by an external external device 30 or a wireless communication tag 30. The wireless communication signal may correspond to a Bluetooth signal such as a beacon signal, a Zigbee signal, an RFID signal, an infrared ray (IR) signal, or the like. For example, when the wireless communication signal corresponds to the beacon signal, the wireless communication tag 30 may be a beacon tag, and the glass type wearable device 10 may actively sense a beacon signal transmitted by the beacon tag.

The glass type wearable device 10 recognizes an identification code included in the wireless communication signal (S210). The wireless communication signal includes an identification code, and the glass type wearable device 10 may recognize the identification code in the wireless communication signal by receiving the wireless communication signal. That is, the controller 210 analyzes the wireless communication signal and recognizes an identification code included in the wireless communication signal. The identity identification code may correspond to a group number, an employee number, a social security number, a user ID, and the like.

The glass type wearable device 10 searches for identification information of the other party corresponding to the identification code (S120). The identity information may include a name, image image, rank or rank, other personal information of the user of the external device 30 or the wireless communication tag 30. The glass type wearable device 10 searches for the identification information of the other party based on the identification code. As a method of searching for the identity information of the other party based on the identity identification code, a method of searching for the identity information stored in the storage unit 260 of the glass type wearable device 10 may be applied. In addition, as a way of searching for the identity information of the other party based on the identity identification code, the glass type wearable device 10 transmits the identification identification code to the identity information database server through wireless communication, and the identity information database server identifies the identity. The identification information corresponding to the code may be searched and transmitted to the glass type wearable device 10 through wireless communication.

The glass type wearable device 10 notifies the user of the discovered identity information (S130). The display 310 of the glass type wearable device 10 may visually display the identity information of the counterpart. In addition, the sound output unit 320 of the glass type wearable device 10 may perform notification in a manner of reading the identity information of the other party by voice.

11 is a flowchart of a method of identifying an identity of the glass type wearable device 10 using a face recognition method according to an embodiment of the present invention.

Referring to FIG. 11, in the identification method using the glass type wearable device 10 according to another embodiment of the present invention, the glass type wearable device 10 may be connected to an external device 30 or a wireless communication tag 30. Receiving a transmitted wireless communication signal (S300); A glass type wearable device 10 recognizing an identification code included in the wireless communication signal (S310); Obtaining, by the glass type wearable device, a front image including a face image of the counterpart (S320); Extracting the face image from the acquired image and setting it as a test object (S330); Searching for identification information of the other party corresponding to the identification code (S340); And comparing the extracted image image with the image image included in the identification information and determining whether the same person is the same (S350). An identification method using the glass type wearable device 10 according to an exemplary embodiment of the present invention will be described in order. Hereinafter, the steps described above will not be described in detail.

The glass type wearable device 10 receives a wireless communication signal transmitted from the external device 30 or the wireless communication tag 30 (S300; same as S200).

The glass type wearable device 10 recognizes an identification code included in a wireless communication signal (S310; same as S210).

The glass type wearable device 10 obtains a front image including the face image of the counterpart (S320). The first camera 121 is a camera provided at one side of the glass type wearable device 10 to acquire an image or an image of the front side. The first camera 121 may acquire an image in a direction viewed by the user of the glass type wearable device 10 in order to acquire an image including a face of the other party.

The glass type wearable device 10 extracts a face image from the acquired image and sets it as an inspection target (S330). That is, the face extraction module of the controller 210 may extract an image of the face region included in the obtained image.

The glass type wearable device 10 searches for identification information of the other party corresponding to the identification code (S340; same as S220).

The glass type wearable device 10 compares the image image included in the identification information with the extracted face image to determine whether the same person is the same (S350). The controller 210 may compare and determine the extracted feature information with the stored feature information of the acquaintance's face, and determine whether the person corresponding to the identification information and the person corresponding to the extracted face image are the same person. When the distance difference between the extracted feature information and the feature information of the stored counterpart face image is within a threshold value, the same person face may be recognized.

The method may further include displaying the comparison result on the display 310 or performing a voice notification when it is determined that the image information is not the same person by comparing the image image and the extracted face image. can do. That is, the glass-type wearable device 10 does not correspond to the same person by comparing the image image and the extracted face image among the identification information, as shown in FIG. The image may be visually displayed on the face image, or the sound output unit 320 may generate a notification sound to perform notification. Thus, when the user of the glass type wearable device 10 uses the external device 30 or the beacon tag 30 by someone other than the user of the external device 30 or the beacon tag 30. Can be prevented. For example, a security guard who uses the glass type wearable device 10 when an outsider wants to enter or exit a non-affiliated area for security by using the external device 30 or the beacon tag of a user who is allowed access. Alternatively, a bodyguard may recognize that the external device 30 or the beacon tag has been stolen.

The method may further include, when the plurality of face images are extracted from the front image, comparing each of the image images with the plurality of face images, and excluding a matching face image from the inspection object. When a user wears and wears the glass type wearable device 10, a plurality of face images may be extracted and a plurality of wireless communication signals may be received. Accordingly, the glass type wearable device 10 may compare each image image with a plurality of face images in order. The glass type wearable device 10 may compare the remaining face image with another image image by excluding a face image matching the image image from the inspection target. As a result, compared to the existing method of comparing the extracted face image with the entire face database, the number of comparisons is significantly reduced, so that face recognition for identification can be performed quickly.

12 is a flowchart illustrating an identification method using the glass type wearable device 10 by recognizing a wireless communication signal transmission direction according to an embodiment of the present invention.

Referring to FIG. 12, in the identification method using the glass type wearable device 10 according to another embodiment of the present invention, the glass type wearable device 10 may include the external device 30 or the wireless communication tag. Receiving a wireless communication signal transmitted by the 30 (S400); Measuring, by the glass type wearable device, a transmission direction of the wireless communication signal (S410); Acquiring a front image by the glass type wearable device 10 to recognize a person in the front image (S420); And comparing the direction in which the person is located in the front image with the transmission direction of the wireless communication signal to recognize the wireless communication signal corresponding to each person (S430). An identification method using the glass type wearable device 10 according to an exemplary embodiment of the present invention will be described in order. Hereinafter, the steps described above will not be described in detail.

The glass type wearable device 10 receives a wireless communication signal transmitted from the external device 30 or the wireless communication tag 30 (S400; same as S200).

The glass type wearable device 10 measures a transmission direction of the wireless communication signal (S410). The glass type wearable device 10 may recognize a direction in which the wireless communication signal is received based on the strength, direction, etc. of the beacon signal. In addition, when the glass type wearable device 10 includes one or more wireless communication modules, the transmission direction of the wireless communication signal may be determined based on the strength or direction of the measured signal of each wireless communication module. Through this, the location of the external device 30 or the other party having the beacon tag can be recognized, so that the other party corresponding to the recognized identity information can be recognized.

The glass type wearable device 10 acquires a front image and recognizes a person in the front image (S420). The first camera 121 of the glass type wearable device 10 may acquire an image or an image including a person located in front of the user of the glass type wearable device 10. Thereafter, the glass type wearable device 10 may recognize a person in the acquired image or image. The controller 210 may recognize the person in the image or image by analyzing the image or image based on the shape feature of the person.

The direction in which the person is located in the front image is compared with the transmission direction of the wireless communication signal to recognize the wireless communication signal corresponding to each person (S430). When the glass type wearable device 10 measures the transmission direction of the wireless communication signal with respect to the gaze direction, the transmission direction of the wireless communication signal and the position of the person in the front image may be directly compared. The glass type wearable device 10 may determine whether there is a wireless communication signal corresponding to the position of the person.

When the glass type wearable device 10 recognizes the transmission direction of the wireless communication signal as an azimuth, the direction in which the person in the front image is located may be expressed in the azimuth to be compared with the transmission direction of the wireless communication signal. To this end, a motion sensor (for example, a gyro sensor or a geomagnetic sensor) of the glass type wearable device 10 may recognize a direction (azimuth angle information) in which the image or image is obtained, and the glass type wearable device 10 may be used. May reflect the position of the person in the image or image to the obtained azimuth information to express the position of the person identified based on the user as an azimuth angle. Thereafter, the glass type wearable device 10 may compare a direction in which a person is located with a transmission direction of the wireless communication signal.

In this way, the glass type wearable device 10 may determine which of the other party's identity information the identity information corresponds to. In addition, the identification information is displayed on the display unit 310 together with the image of the other party so that the user of the glass type wearable device 10 can easily identify the identity. In particular, when the display unit 310 expresses the identity information by applying an augmented reality technology, the user can perform identification more quickly and accurately.

In addition, when the wireless communication signal corresponding to the direction in which the recognized person is located on the image or image is not transmitted, the recognized wearable device 10 may be a wireless communication tag 30 or an external device. Notifying the user that he does not have 30; may further include. In the case where it is necessary to identify a person who does not transmit a beacon signal for identification among a plurality of people, as shown in FIG. 13, in the image acquired by the first camera 121 on the display 310, as shown in FIG. 13. In FIG. 2, a person who does not correspond to a direction in which the beacon signal is transmitted may be displayed to the user.

In addition, the glass type wearable device 10 recognizes the identification code included in the wireless communication signal; Searching for identity information of the other party corresponding to the identity identification code; And displaying the identification information corresponding to the recognized person on a screen.

In addition, when the wireless communication signal corresponding to the direction in which the direction of the person in the front image is located is not transmitted, as shown in FIG. 13, the wearable device 10 recognizes that the person is wireless. Notifying the user that he does not have the communication tag 30; may further include.

15 is an internal configuration diagram of an identification system using the glass type wearable device 10 according to an exemplary embodiment of the present invention. However, in FIG. 15, detailed description of the previously described configuration will be omitted.

Referring to FIG. 15, an identification system using the glass type wearable device 10 according to another embodiment of the present invention includes a wireless communication unit 250; Control unit 210; Storage unit 260; And an output unit 300.

The wireless communication unit 250 performs a function of receiving a beacon signal transmitted by the external device 30 or the beacon tag. That is, the wireless communication unit 250 may receive a beacon signal including an identification code of the other party from the external device 30 or the beacon tag 30 through wireless communication.

The controller 210 performs a function of performing overall information processing in the system. The control unit 210 includes an identification code recognition module 211; And an identity information search module 212. The identification code recognition module 211 performs a function of recognizing the identification code included in the beacon signal. The identity information search module 212 performs a function of searching the identity information of the person corresponding to the identity identification code by using the identity identification code.

The storage unit 260 stores data so that the identification code and the identification information correspond.

The output unit 300 notifies the user of the searched identity information by the glass type wearable device 10. The output unit 300 may include a display unit 310 for visually displaying the identification information grasped by the controller 210 or an audio output unit 320 for reading the identification information by voice.

In addition, the first camera 121 may further include a. The first camera 121 is a camera provided at one side of the glass type wearable device 10 to acquire an image or an image in front of the glass type wearable device 10. The first camera 121 performs an image or image including a person located in front of the glass wearable device 10.

In addition, the control unit 210 includes an image extraction module; And a face recognition module. The image extraction module performs a function of extracting a person from an image or image obtained by the first camera 121 or extracting a face of a person included in the image or image. The face recognition module performs a function of recognizing a face of a person in the image or the image in order to compare the image image of the user and the extracted face image among the identification information.

According to the present invention as described above, has the following various effects.

First, the user can receive the identification code from the other party having a wireless communication tag or communication device, it can easily identify the identity information. For example, when the user is a bodyguard or a veteran, it is necessary to identify the other party's identity, so that the glass type wearable device 10 may actively sense a wireless communication signal transmitted from a wireless communication tag held by the other party to easily identify the identity information. There is an effect that can be grasped.

Second, when a plurality of people are located in front of the user, by comparing the position of the person on the image obtained by the first camera 121 and the transmission direction of the wireless communication signal can be provided to the user by accurately matching each person's identity information. It has an effect. In addition, as a result of the comparison, it is possible to identify a person on the image that is not receiving a wireless communication signal and inform the user, so that a person who does not have a wireless communication tag at the time of identification is easily recognized.

Third, there is an effect of preventing the case of identity authentication by stealing another person's wireless communication tag or communication device, including a face recognition process for comparing the face image of the other person's face with the identity information. In addition, when the faces do not match, the glass type wearable device 10 may notify the user through the output unit to easily inform the person that the faces do not match.

The information processing method using the glass type wearable device according to the embodiments of the present invention described above is implemented as a program (or an application) to be executed in combination with the glass type wearable device 10 which is hardware, and stored in a medium. Can be.

In the above-described program, in order for the glassy wearable device 10 to read the program and execute the methods implemented as a program, the processor CPU of the glassy wearable device 10 may execute the glassy wearable device ( 10) may include code coded in a computer language such as C, C ++, JAVA, or machine language that can be read through the device interface. Such code may include functional code associated with a function or the like that defines the necessary functions for executing the methods, the execution of which is required for the processor of the glassy wearable device 10 to execute according to a predetermined procedure. Procedure-related control codes. In addition, such code requires that additional information or media required to execute the functions by the processor of the glassy wearable device 10 is referred to at any position (address address) of the internal or external memory of the glassy wearable device 10. It may further include a memory reference code for whether or not. In addition, when the processor of the glass type wearable device 10 needs to communicate with any other computer or server that is remote in order to execute the functions, the code may be configured to communicate with the communication module of the glass type wearable device 10. It may further include communication-related code, such as how to communicate with any other computer or server in the remote, what information or media should be transmitted and received during communication.

The stored medium is not a medium for storing data for a short time such as a register, a cache, a memory, but semi-permanently, and means a medium that can be read by the device. Specifically, examples of the storage medium include, but are not limited to, a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like. That is, the program may be stored in various recording media on various servers accessible by the glass type wearable device 10 or various recording media on the glass type wearable device 10 of the user. The media may also be distributed over network coupled computer systems so that the computer readable code is stored in a distributed fashion.

While the above has been shown and described with respect to preferred embodiments and applications of the present invention, the present invention is not limited to the specific embodiments and applications described above, the invention without departing from the gist of the invention claimed in the claims Various modifications can be made by those skilled in the art, and these modifications should not be individually understood from the technical spirit or the prospect of the present invention.

Claims (18)

In the information processing method for limiting the camera function of the glass-type wearable device when entering a specific area by using a beacon which is a Bluetooth communication signal generator, Receiving, by the glass type wearable device, a camera deactivation signal from the first beacon when the camera usage limit area set by the first beacon is entered; And The glass type wearable device recognizes the entry of the camera usage limit zone to limit the camera function. The information processing method using the wearable device. The method of claim 1, Receiving, by the glass type wearable device, a camera activation signal from the second beacon when the camera active area is set by the second beacon; And Activating a camera function by the glass type wearable device recognizing entry into the camera active area; And after the camera deactivation signal of the first beacon is received until the camera activation signal of the second beacon is received, the camera function of the information processing method using the wearable device. The method according to claim 1 or 2, And displaying, by the glass type wearable device, whether to limit or activate the use of a camera on a screen. The method of claim 1, When a user receives a specific input for executing an application that performs the camera function within the camera usage area, The glass type wearable device further comprises the step of notifying the user of the activation of the application; information processing method using a wearable device. The method of claim 1, If the user manually executes the camera function within the camera usage area, the glass-type wearable device to generate an alarm; further comprising, the information processing method using a wearable device. The method of claim 1, When the user manually executes the camera function within the camera usage area, the wearable device further comprises the step of transmitting the location information of the user to the administrator using a wireless communication, using the wearable device Information processing method. The method of claim 1, The camera function limitation, And blur or mosaic a specific region of an image or an image captured according to the type of the camera restriction zone. The method of claim 1, The camera function limitation step, Measuring a gaze direction by the glass type wearable device; And Limiting the camera function when the gaze direction is included in a shooting restriction direction in the camera usage limit area. The photographing restriction direction is included in the deactivation signal and received, the information processing method using the wearable device. The method of claim 8, The camera function limitation step, Measuring a current indoor location; further comprising: The photographing restriction direction is set based on the indoor position. The information processing method using the wearable device. In the information processing method for confirming the identity of a wireless communication device for transmitting a wireless communication signal for identification using a glass type wearable device or the other party having a wireless communication tag, Receiving, by the glass type wearable device, a wireless communication signal transmitted from the communication device or the wireless communication tag; Recognizing, by the glass type wearable device, an identification code included in the wireless communication signal; Searching for identity information of the other party corresponding to the identity identification code; And And providing, by the glass type wearable device, a notification of the searched identity information to a user. In the information processing method for identifying the identity of a wireless communication device that transmits a wireless communication signal for identification identification using a glass type wearable device or the other party having a wireless communication tag, Receiving, by the glass type wearable device, a wireless communication signal transmitted from the communication device or the wireless communication tag; Recognizing, by the glass type wearable device, an identification code included in the wireless communication signal; Acquiring, by the glass type wearable device, a front image including a face image of the counterpart; Extracting the face image from the acquired image and setting it as a test object; Searching for identity information of the other party corresponding to the identity identification code; And And comparing the extracted image image with the image image included in the identification information to determine whether the same person is the same person. The method of claim 11, When a plurality of face images are extracted in the front image, And comparing each of the image images with the plurality of face images and excluding a matching face image from the inspection object. The information processing method using the wearable device. The method of claim 12, If there is a face image in the inspection object that does not match the image image, And displaying the glassy wearable device on the mismatched face image on a screen. The method according to any one of claims 10 to 13, The identity information search step, The identification information stored in the glass type wearable device, or the identification information code transmitted to the identification information database server to search the identification information corresponding to the identification identification code. An information processing method using a wearable device, characterized in that. The method according to any one of claims 10 to 13, The identification code is, It corresponds to any one of military number, employee number, social security number, and user ID. The identity information, An information processing method using a wearable device, characterized in that it comprises at least one or more of name, image image, rank or rank, other personal information. In the information processing method for identifying the identity of a wireless communication device that transmits a wireless communication signal for identification identification using a glass type wearable device or the other party having a wireless communication tag, Receiving, by the glass type wearable device, a wireless communication signal transmitted by the communication device or the wireless communication tag; Measuring, by the glass type wearable device, a transmission direction of the wireless communication signal; Acquiring a front image by the glass type wearable device to recognize a person in the front image; And And comparing the direction in which the person is located in the front image with the transmission direction of the wireless communication signal, and recognizing the wireless communication signal corresponding to each person. The method of claim 16, Recognizing, by the glass type wearable device, an identification code included in the wireless communication signal; Searching for identity information of the other party corresponding to the identity identification code; And And displaying the identification information corresponding to the recognized person on a screen. The method of claim 16, When the wireless communication signal corresponding to the direction in which the direction in which the person is located in the front image is located is not transmitted, And notifying the user that the recognized wearable device does not hold the wireless communication tag by the glass type wearable device.

Images