[go: up one dir, main page]

WO2016006951A2 - Système et procédé de traitement d'informations au moyen d'un dispositif portable - Google Patents

Système et procédé de traitement d'informations au moyen d'un dispositif portable Download PDF

Info

Publication number
WO2016006951A2
WO2016006951A2 PCT/KR2015/007146 KR2015007146W WO2016006951A2 WO 2016006951 A2 WO2016006951 A2 WO 2016006951A2 KR 2015007146 W KR2015007146 W KR 2015007146W WO 2016006951 A2 WO2016006951 A2 WO 2016006951A2
Authority
WO
WIPO (PCT)
Prior art keywords
image
wearable device
vehicle
user
information
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2015/007146
Other languages
English (en)
Korean (ko)
Other versions
WO2016006951A3 (fr
Inventor
한성철
엄정한
김진영
이경현
김대중
김석기
유철현
김주천
김주원
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Nexsys Co ltd
Original Assignee
Nexsys Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020140091839A external-priority patent/KR101592398B1/ko
Priority claimed from KR1020140113234A external-priority patent/KR20160025840A/ko
Priority claimed from KR1020150042540A external-priority patent/KR20160010294A/ko
Priority claimed from KR1020150042539A external-priority patent/KR101684264B1/ko
Application filed by Nexsys Co ltd filed Critical Nexsys Co ltd
Publication of WO2016006951A2 publication Critical patent/WO2016006951A2/fr
Publication of WO2016006951A3 publication Critical patent/WO2016006951A3/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G—PHYSICS
    • G08—SIGNALLING
    • G08G—TRAFFIC CONTROL SYSTEMS
    • G08G1/00—Traffic control systems for road vehicles
    • G08G1/123—Traffic control systems for road vehicles indicating the position of vehicles, e.g. scheduled vehicles; Managing passenger vehicles circulating according to a fixed timetable, e.g. buses, trains, trams

Definitions

  • the present invention relates to an information processing system and method using a wearable device, and more particularly, to a system and method for information processing data acquired during an activity of a user having a wearable device.
  • the head mounted display device is mainly made of a safety glasses or a helmet type device to see the screen in front of the eyes, and was developed to realize virtual reality.
  • glass wearable devices Although various types of glass wearable devices have been researched and emerged, methods or services that wearers can conveniently utilize in daily life are very limited, and UI (User Interface) or UX (User Experience) suitable for glass wearable devices is very limited. Neither is it being developed. In addition, recently, glass-type wearable devices that can perform most functions by themselves, as well as glass-type wearable devices used in conjunction with mobile terminals such as smartphones, have been developed. Different from the mobile terminal of the need for a service suitable for the characteristics of the glass-type wearable device.
  • UI User Interface
  • UX User Experience
  • one object of the present invention is to provide a service suitable for a glass-type wearable device that can be utilized by the user or wearer of the glass-type wearable device.
  • an object of the present invention is to provide a service that is specific to a user by acquiring an image or image in front of a glass type wearable device including a specific image (for example, a bus, a truck, a traffic light, a traffic violation, etc.).
  • a specific image for example, a bus, a truck, a traffic light, a traffic violation, etc.
  • the present invention provides a system and a method for providing a service such as a bus arrival notice, an arrangement notice, a traffic light change notice, or a traffic law violation vehicle notification.
  • An information processing method using a wearable device includes: specifying a route number of a specific bus; Acquiring a front image or a front image by the glass type wearable device; Recognizing a route number of the vehicle appearing in the front image or the front image; And providing a bus arrival notification to a user when the recognized route number is the same as the designated route number.
  • the route number designation may be characterized by acquiring the front image or the front image including the route number attached to the stop and specifying the character through text recognition.
  • the route number designation may be characterized by designating the route number corresponding to the hand gesture in the front image or the front image.
  • the route number designation may be characterized by designating the route number by voice recognition of the user.
  • the method may further include providing wireless communication by receiving driving information of the route number bus, wherein the driving information includes location information of the route number bus close to a current position and estimated time of arrival of the route number bus in real time. It may be at least one of the previous stop departure notification information of the line number bus.
  • the method may further include providing a user with a rotation direction for acquiring a road image approaching the vehicle through the analysis of the front image.
  • the bus arrival notification providing step if the recognized route number is the same as the designated route number, the step of real-time measuring the distance away from the current location of the bus; And performing a voice guidance corresponding to the separated distance.
  • the route number recognition step the glass-type wearable device for measuring a high or low angle or azimuth; Calculating an expected arrangement range in the forward image of the route number by reflecting the high or low angle; And searching and recognizing the route number within the expected arrangement range.
  • an information processing method using a wearable device includes: acquiring, by a glass type wearable device, a front image or an image; Extracting a vehicle image of a target vehicle in the image or image; Acquiring target vehicle identification information from the extracted vehicle image; And comparing the target vehicle identification information with the wanted vehicle identification information and transmitting notification information to the outside through wireless communication, wherein the wanted vehicle identification information is received from an external server in real time or periodically.
  • Type is stored in a wearable device.
  • the obtaining of the target vehicle identification information may include extracting the vehicle number through text recognition in the vehicle image.
  • the method may further include obtaining current location information by the glass type wearable device; And acquiring driving direction information of the arrangement vehicle by analyzing the image or the image based on the gazing direction at the time of capturing the image or the image.
  • the transmitting of the notification information comprises: the location information and the It may be characterized by transmitting the driving direction information of the arrangement vehicle.
  • An information processing method using a wearable device includes the steps of: acquiring, by a glass type wearable device, a front image or an image; Extracting a vehicle image of a target vehicle in the image or image; Extracting a vehicle number of the target vehicle through character recognition in the vehicle image; Transmitting the vehicle number to an external server through wireless communication; And when the target vehicle is an arranging vehicle, the glass type wearable device receiving detailed information of the arranging vehicle from the external server and providing the same to the user.
  • the front image or the image acquiring step may include acquiring the front image when the license plate occupies a specific ratio or more of the photographed image.
  • the method may further include excluding a matched region from the search region of the front image or the image compared with the previous front image or the previous front image photographed before a specific time, wherein the search region is configured to extract the vehicle image. It may be an area in the front image or the image to be searched.
  • the extracting of the vehicle image may include recognizing and extracting a shape corresponding to a previously stored vehicle outline from the front image or the image.
  • the vehicle number extracting step may include extracting the vehicle number by recognizing the license plate on the basis of an attachment position of the license plate in the vehicle image or a ratio of the vehicle license plate in the vehicle image. It may be performed by at least one or more of the manner of extracting the vehicle number in the vehicle image through a format.
  • an information processing method using a wearable device includes: acquiring an image or an image by the glass type wearable device; Analyzing the image or the image to recognize a usage state of the glass type wearable device; Determining a shape of a signal lamp or a shape of a signal to be recognized by the glass type wearable device based on the use situation; Searching for the traffic light by the glass type wearable device; Recognizing a signal change of the searched traffic light; And providing the signal change notification to a user.
  • the use situation recognition step it may be characterized in that whether the user performs the driving through the analysis of the image or image.
  • the user can quickly and easily report when there is an inconvenience caused by a traffic violation violation vehicle. It is very easy because the report is performed to the external server of the report center only by photographing the image or image including the vehicle in violation of the traffic laws.
  • FIG. 9 is an exemplary screen for providing arrangement notification information using a glass type wearable device according to an embodiment of the present invention.
  • FIG. 12 is an exemplary diagram showing a signal change of a pedestrian traffic light on a display unit according to an embodiment of the present invention.
  • FIG. 14 is an exemplary diagram in which a glass type wearable device obtains an image or an image including a traffic violation violation vehicle according to an embodiment of the present invention.
  • FIG 2 is an exemplary view of a glass type wearable device related to one embodiment of the present invention.
  • the camera 120 is for inputting a video signal or an image signal, and two or more cameras 120 may be provided according to a configuration aspect of the device.
  • the camera 120 processes image frames such as still images or moving images obtained by an image sensor in a video call mode or a photographing mode.
  • the processed image frame may be displayed on the display 310.
  • the image frame processed by the camera 120 may be stored in the memory 260 or transmitted to the outside through the wireless communication unit 250.
  • the control unit 210 transmits the image signal and the video signal.
  • the sensing unit 130 generates a sensing signal for controlling the operation of the device by detecting the current state of the device, such as whether the user wears the glass-shaped wearable device 10 or the position of the device.
  • the sensing unit 130 may perform a function of an input unit receiving an input signal for information processing of the device, and may perform various sensing functions such as whether an external device is connected or not.
  • the sensing unit 130 includes a proximity sensor, a pressure sensor 133, a motion sensor, a fingerprint recognition sensor, an iris recognition sensor 134, a heart rate detection sensor 135, a skin temperature sensor, a skin resistance sensor and an electrocardiogram sensor. And various sensors.
  • the distance sensor includes a distance measurement method between two points, a triangulation method (infrared ray type, natural light type), and ultrasonic type.
  • a triangulation method infrared ray type, natural light type
  • ultrasonic type As in the conventional triangulation principle, the distance between two points is displayed when the measured objects from the two paths are reflected by a right-angle prism and incident on the two image sensors so that the relative positions match.
  • the ultrasonic method is a method in which the distance is measured by transmitting an ultrasonic wave having a sharp directivity to the object to be measured and receiving a reflected wave from the object to be measured.
  • the receiving sensor uses a piezoelectric element.
  • the voice input unit 140 is for inputting a voice signal and may include a microphone.
  • the microphone receives an external sound signal by a microphone in a call mode, a recording mode, a voice recognition mode, etc., and processes it into electrical voice data.
  • the processed voice data may be converted into a form transmittable to the mobile communication base station through the wireless communication unit 250 and output in the call mode.
  • various noise canceling algorithms may be used to remove noise generated while receiving an external sound signal.
  • the output unit 300 is for outputting an audio signal, an image signal, a video signal or an alarm signal.
  • the output unit 300 may include a display unit 310, a sound output unit 320, an alarm unit 330, and a haptic module 340.
  • the display unit 310 may be used as an input device in addition to the output device. If the display unit 310 is configured as a touch screen, the display unit 310 may include a touch screen panel and a touch screen panel controller.
  • the sound output unit 320 outputs audio data received from the wireless communication unit or stored in the memory 260 in a call signal reception, a call mode or a recording mode, a voice recognition mode, a broadcast reception mode, and the like.
  • the sound output module 320 outputs a sound signal related to a function performed in the device, for example, a call signal reception sound and a message reception sound.
  • the sound output module 320 may include a speaker, a buzzer, and the like.
  • the haptic module 340 generates various haptic effects that a user can feel.
  • a representative example of the haptic effect generated by the haptic module 340 is a vibration effect.
  • the haptic module 340 When the haptic module 340 generates vibration by the tactile effect, the intensity and pattern of the vibration generated by the haptic module 340 may be converted, and may be output by combining different vibrations or sequentially.
  • the wireless communication unit 250 may include a broadcast receiving module, a mobile communication module, a wireless internet module, a short range communication module, and a location information module.
  • the broadcast related information may mean information related to a broadcast channel, a broadcast program, or a broadcast service provider.
  • the broadcast related information may also be provided through a mobile communication network, and in this case, may be received by the mobile communication module.
  • Broadcast related information may exist in various forms.
  • the broadcast receiving module may receive a broadcast signal using various broadcast systems, and receive a digital broadcast signal using a digital broadcast system.
  • the broadcast receiving module may be configured to be suitable for all broadcast systems providing broadcast signals as well as such digital broadcast systems.
  • the broadcast signal and / or broadcast related information received through the broadcast receiving module may be stored in the memory 260.
  • the mobile communication module transmits and receives a radio signal with at least one of a base station, an external terminal, and a server on a mobile communication network.
  • the wireless signal may include various types of data according to voice call signal, video call signal, or text / multimedia message transmission and reception.
  • the wireless internet module refers to a module for wireless internet access, and the wireless internet module may be embedded or external to the device.
  • Wireless Internet technologies include Wireless LAN (Wi-Fi), Wireless Broadband (Wibro), World Interoperability for Microwave Access (Wimax), High Speed Downlink Packet Access (HSDPA), long term evolution (LTE), LTE-A Long Term Evolution-Advanced and the like can be used.
  • the short range communication module refers to a module for short range communication.
  • Beacon, Bluetooth, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, etc. may be used as a short range communication technology.
  • RFID Radio Frequency Identification
  • IrDA Infrared Data Association
  • UWB Ultra Wideband
  • ZigBee ZigBee
  • the location information module refers to a module that receives the positioning signal and measures the position of the glass type wearable device.
  • the position information module may correspond to a Global Position System (GPS) module, and the positioning signal may correspond to a GPS signal.
  • GPS Global Position System
  • the Global Position System (GPS) module receives position information from a plurality of GPS satellites.
  • the controller 210 typically controls the operation of each unit to perform a function of controlling the overall operation of the device. For example, perform related control and processing for voice calls, data communications, and the like. In addition, the controller 210 performs a function of processing data for multimedia reproduction. In addition, it performs a function of processing the data received from the input unit or the sensing unit 130.
  • the controller 210 performs face detection and face recognition for face recognition. That is, the controller 210 may include a face detection module and a face recognition module for face recognition.
  • the face detection module may extract only the face area from the camera image acquired by the camera unit 120. For example, the face detection module extracts a face region by recognizing feature elements in the face such as eyes, nose, and mouth.
  • the face recognition module may generate a template by extracting feature information from the extracted face region, and recognize a face by comparing a template with face information data in a face database.
  • the controller 210 may perform a function of recognizing a gaze direction based on an eyeball image or an image acquired by the second camera 122. That is, the controller 210 may include a gaze analysis module that performs gaze direction recognition. After measuring the gaze direction and the gaze direction of the user, it is possible to determine the direction that the user looks by calculating by synthesis.
  • the gaze direction refers to a direction of the face of the user and may be measured by the gyro sensor 131 or the acceleration sensor 132 of the sensing unit 130.
  • the gaze direction may be grasped by the gaze analysis module in a direction viewed by the user's pupil.
  • FIG. 4 is a flowchart illustrating a bus arrival notification method of the glass type wearable device according to an exemplary embodiment of the present invention.
  • the bus arrival notification method using the glass-type wearable device the step of specifying the route number of the particular bus (S100); Acquiring a front image or a front image by the glass type wearable device (S110); Recognizing a route number of the vehicle appearing in the front image or the front image (S120); And providing a bus arrival notification to the user when the recognized route number is the same as the designated route number (S130).
  • S100 the route number of the particular bus
  • S110 Acquiring a front image or a front image by the glass type wearable device
  • a bus arrival notification method using a glass type wearable device according to an embodiment of the present invention will be described in order.
  • the glass type wearable device 10 may designate a route number to be boarded by voice recognition of the user. That is, the glass type wearable device 10 receives a user's voice input for specifying the bus route number by the voice input unit 140, and recognizes the user's voice input by the voice recognition unit 220 to board the vehicle. You can specify the bus route number. If the user is visually impaired, low vision or elderly person who is difficult to find the route number attached to the bus stop, the user needs to input the desired bus number by voice command.
  • the glass type wearable device acquires a front image or a front image (S110). That is, the glass type wearable device 10 obtains a front image or image (ie, an image or image including cars passing through the road) including the road situation through the first camera 121.
  • a front image or image ie, an image or image including cars passing through the road
  • the glass type wearable device 10 recognizes a route number of a vehicle appearing in the front image or the front image (S120). As shown in FIG. 6, the glass type wearable device 10 recognizes a route number by extracting a number included in a front image or a front image.
  • the glass type wearable device 10 recognizes the vehicle from the acquired front image or the front image, and recognizes the number attached to the vehicle. Since the vehicle may include a number such as a vehicle number, a bus route number, and the like, the route number of the bus is extracted from one or more recognized numbers using the position of the attached number or letters around the number. For example, if the number is attached to the lower end of the vehicle is attached to the registration number of the vehicle, except that, if attached to the front glass of the vehicle is the route number of the bus is extracted. In addition, if one Hangul syllable is attached in front of the four digit number, it may correspond to the registration number of the vehicle, and the glass type wearable device 10 may automatically exclude the number.
  • the vehicle may include a number such as a vehicle number, a bus route number, and the like
  • the route number of the bus is extracted from one or more recognized numbers using the position of the attached number or letters around the number. For example, if the number is attached to the lower end of the vehicle is attached to
  • the glass type wearable device 10 may extract the bus image through the shape of the vehicle, the outline of the vehicle, the color, and the like, and recognize the route number in the bus image. Since a general vehicle other than a bus may include the same number as a bus route number, if only the image corresponding to the bus is extracted and the route number search is performed only within the bus image, the possibility of an error may be reduced. Accordingly, the glass type wearable device 10 may extract a bus image corresponding to the bus shape for line number recognition without excluding a vehicle such as a passenger car based on the bus shape from the search range.
  • the method of recognizing the route number of the bus is not limited thereto, and may be implemented by various methods such as a method of recognizing all numbers included in an image or an image and comparing the number with a designated route number.
  • the glass type wearable device 10 provides a bus arrival notification to the user (S130).
  • a notification providing method a method of displaying on the screen of the display 310, a method of providing a voice alarm, a method of providing a vibration alarm, and the like may be applied. That is, when the recognized line number and the designated line number are the same, the glass type wearable device 10 displays the arrival information on the display 310, sounds an alarm, transmits the arrival information by voice, or vibrates. Can be issued to notify the arrival of the bus of the designated route number.
  • the method may further include receiving and providing driving information of the route number bus through wireless communication.
  • the driving information may include location information of the route number bus close to the current location of the user, real-time arrival time information of the route number, departure stop notification information of the route bus, and the like.
  • the glass type wearable device 10 may receive location information such as a GPS signal of a route number bus that is close to the current location of the user. The glass type wearable device 10 may more accurately grasp the arrival of the designated route number bus through the GPS signal periodically received, and the user may anticipate the arrival of the bus.
  • the glass type wearable device 10 may allow the first camera 121 to acquire an image or an image. That is, when the glass type wearable device 10 continuously acquires the front image or the front image through the first camera, the power consumption is large, so that the bus is within a certain range based on the GPS signal (for example, the current position of the user). Within a certain radius), it is possible to reduce the power consumption by performing the route number recognition through forward image or image acquisition.
  • the method may further include providing a user with a rotation direction for acquiring a road image approaching the vehicle through the analysis of the front image.
  • the vehicle may not be included in the front image or the front image unless the user wears the glass type wearable device 10 and observes the road direction in which the vehicle approaches.
  • the glass type wearable device 10 may determine the direction in which the user looks by analyzing the front image or the front image. For example, the glass type wearable device 10 may determine the user's gaze direction based on the position of the road in the front image, the position of the bus stop, the moving direction of the vehicle, and the like.
  • the glass type wearable device 10 may calculate and provide a direction in which the user rotates to observe the direction in which the vehicle approaches.
  • the glass type wearable device 10 may calculate and provide a degree of rotation (eg, a rotation angle) for the user to observe the vehicle approach direction.
  • the glass type wearable device 10 may recognize that the gaze direction has reached within an appropriate range for capturing the approach of the vehicle as a front image through rotation and provide a notification.
  • the glass type wearable device 10 may recognize that a specific vehicle approaches and increases in size in the front image to reach an appropriate viewing direction.
  • the bus arrival notification providing step (S130) if the recognized route number is the same as the designated route number, the step of real-time measuring the distance away from the current location of the bus; And performing a voice guidance corresponding to the separated distance.
  • the glass type wearable device 10 may measure a distance in which the bus is away from the current location in real time. The distance may be measured in real time through a Doppler sensor or a distance sensor. Thereafter, the glass type wearable device 10 may provide voice guidance corresponding to a distance separated in real time. For example, the glass type wearable device 10 may read a distance away by voice and may provide a voice notification by adjusting a period of generating a notification sound according to the distance.
  • the route number recognition step (S120) the glass-type wearable device for measuring a high or low angle or azimuth; Calculating an expected arrangement range in the forward image of the route number by reflecting the high or low angle; And searching and recognizing the route number within the expected arrangement range.
  • the glass type wearable device 10 performs the route number search and extraction in the entire front image, it may take a long time, and thus the area to search for the route number needs to be limited.
  • the area where the route number is located in the front image may vary according to a direction in which the user wears and watches the glass type wearable device 10.
  • the user may hold his / her head slightly while wearing the glass wearable device 10, and the route number may be located in the lower region of the front image as compared to the front view. Therefore, the glass type wearable device 10 needs to measure a high or low angle or azimuth corresponding to the user's gaze direction, and determine an area to search for a bus route number in the front image by reflecting this.
  • the glass wearable device may measure a high or low angle. Thereafter, the glass type wearable device 10 may calculate an expected range of placement in the front image of the route number by reflecting a high or low angle or the azimuth. The glass type wearable device 10 may determine a vertical range to search for a route number through the measured high and low angles, and determine a horizontal range to search for a route number through the measured azimuth angle. Thereafter, the glass type wearable device 10 may search for and recognize the route number within the determined expected arrangement range.
  • the step of calculating the expected placement range may be calculated by reflecting the body information of the user. Since the estimated range of the route number may vary according to the height or eye level of the user, the estimated range of the range may be calculated by applying previously stored user's body information.
  • Bus arrival notification system using a glass-type wearable device includes a first camera 121, the control unit 210, the display unit 310.
  • the alarm unit 330 may further include.
  • the alarm unit 330 may perform a function of notifying the user of the bus arrival through voice or vibration.
  • the GPS module may further include a GPS module.
  • the GPS module performs a function of receiving location information of a route number bus close to the user's location.
  • the GPS module can identify the bus arrival information more accurately by grasping the location information of the corresponding route number bus which is the closest from the user.
  • the first camera 121 acquires an image or an image and recognizes the bus route number through a GPS module. Power consumption due to bus line number recognition can be reduced.
  • a situation in which the user of the glass wearable device misses the bus while performing another task with the glass wearable device while waiting for the bus at the bus stop may occur.
  • the visually impaired, low vision users such as to help the user to observe the direction of the bus, the bus arrival notification can be provided. Through this, it is possible to assist the visually impaired, low vision, etc. to use public transportation.
  • FIG. 7 is a flowchart illustrating a method of providing a notification to an external device 30 by recognizing an arrangement through a glass type wearable device according to another embodiment of the present invention.
  • a method for notifying a vehicle using a glass type wearable device may include: acquiring, by the glass type wearable device, a front image or a front image (S200); Extracting a vehicle image of a target vehicle in the image or image (S210); Acquiring target vehicle identification information from the extracted vehicle image (S220); And comparing the target vehicle identification information with the arrangement vehicle identification information and transmitting notification information to the outside through wireless communication (S230).
  • S200 acquiring, by the glass type wearable device, a front image or a front image
  • S210 Extracting a vehicle image of a target vehicle in the image or image
  • S220 Acquiring target vehicle identification information from the extracted vehicle image
  • S230 wireless communication
  • the glass type wearable device 10 may acquire the front image by recognizing it as a timing to acquire the front image. For example, the glass type wearable device 10 may recognize the license plate based on the color, the attachment position, or the shape of the license plate, and if the recognized license plate area occupies a specific ratio or more in the photographed image, the front image You can shoot.
  • the glass type wearable device 10 extracts a vehicle image of a target vehicle by analyzing an image or an image (S210). For example, the glass type wearable device 10 may recognize and extract a shape corresponding to a previously stored vehicle outline from the front image or the image. The glass type wearable device 10 may include contour information corresponding to various vehicles.
  • Target vehicle identification information is obtained from the extracted vehicle image (S220).
  • the identification information may be one or more of a vehicle number, a vehicle model, color, or appearance characteristic information (for example, tuning and scratching).
  • the vehicle model may be identified through a mark attached to the vehicle, a shape of a light, and the like.
  • the glass type wearable device 10 compares the target vehicle identification information with the arrangement information and transmits notification information to the outside through wireless communication (S230).
  • the arrangement information may be received from the external server 20 in real time or periodically and stored in the glass type wearable device. That is, the wireless communication unit 250 of the glass type wearable device 10 may periodically receive the arrangement identification information from the server and update the arrangement identification information in the memory 260. Through this, it is possible to prevent the wagon vehicle identification information that the glass type wearable device 10 needs to recognize is missing.
  • the user receiving the notification information may correspond to a person previously stored by the user of the glass type wearable device in order to transmit the arrangement position information.
  • the counterpart may be a fellow police officer.
  • the obtaining of the target vehicle identification information may include extracting the vehicle number through text recognition in the vehicle image.
  • the glass type wearable device 10 recognizes the license plate and extracts the license plate number based on the attachment position of the license plate in the vehicle image or the ratio of the license plate in the vehicle image, the vehicle number format.
  • the vehicle number may be extracted through a method of extracting the vehicle number from the vehicle image.
  • the method may further include obtaining current location information by the glass type wearable device; And acquiring driving direction information of the arrangement by analyzing the image or the image based on the gazing direction at the time of capturing the image or the image.
  • the transmitting of the notification information may include: Information and the driving direction information of the arrangement vehicle. That is, the notification information may include location information of the glass type wearable device having found the arrangement vehicle or driving direction information of the arrangement vehicle.
  • the glass type wearable device 10 may obtain current location information through a GPS module.
  • the glass type wearable device 10 may obtain driving direction information of the arrangement by analyzing the image or the image based on the gaze direction when the image or the image is captured.
  • the glass type wearable device 10 measures the azimuth angle and recognizes the gazing direction, and the vehicle is traveling in the opposite direction of the gazing direction. Can be identified.
  • the azimuth angle may be measured by a motion sensor such as an acceleration sensor 132 or a gyro sensor 131 of the glass type wearable device 10.
  • the glass type wearable device 10 compares the position of the vehicle in the previous image with the position of the vehicle in the current image, calculates the moving direction of the vehicle in the image, and reflects the driving direction information of the arrangement vehicle by reflecting the user's gaze direction. Can be calculated.
  • the glass type wearable device 10 may provide the other party with the position and the movement path of the wanted vehicle in association with the GPS information.
  • the method may include a step of excluding a matched region from the search region of the front image or the image compared with the previous front image or the previous front image photographed before a specific time.
  • the glass type wearable device 10 may set the specific area within the image or the image as the search area to search the target vehicle image and search the target vehicle identification information. That is, the search area may be a specific area within the front image or the image searched to extract the vehicle image.
  • the glass type wearable device 10 may exclude the matching area from the search area by comparing the previous front image or the previous front image and the previous front image or the current front image photographed before a specific time.
  • FIG. 8 is a flow chart of a method for providing detailed information on arrangements received from an external server 20 using a glass type wearable device according to an embodiment of the present invention.
  • a method for notifying a vehicle using a glass type wearable device may include: obtaining, by the glass type wearable device, a front image or an image (S300); Extracting a vehicle image of a target vehicle in the image or image (S310); Extracting a vehicle number of the target vehicle through character recognition in the vehicle image (S320); Transmitting the vehicle number to an external server 20 through wireless communication (S330); And when the target vehicle is an arranging vehicle, receiving the detailed information of the arranging vehicle from the external server 20 by the glass type wearable device (S340).
  • the arrangement of the vehicle notification method using the glass-type wearable device according to an embodiment of the present invention will be described in order. Hereinafter, detailed description of the above-described steps will be omitted.
  • the glass type wearable device acquires a front image or an image (S300; coincides with S200).
  • the glass type wearable device 10 extracts a vehicle number of the target vehicle through character recognition in the vehicle image (S320).
  • the glass type wearable device 10 recognizes the license plate and extracts the license plate number based on the attachment position of the license plate in the vehicle image or the ratio of the license plate in the vehicle image, the vehicle number format.
  • the vehicle number may be extracted by a method of extracting the vehicle number from the vehicle image.
  • the glass type wearable device 10 transmits the vehicle number to the external server 20 through wireless communication (S330).
  • the glass type wearable device 10 receives detailed information of the arranging vehicle from the external server 20 and provides it to the user (S340).
  • a method of providing detailed information of the arrangement vehicle a method of providing a voice notification, a method of displaying on the screen of the display unit, and the like may be applied.
  • the glass type wearable device 10 may provide a display screen by enlarging a license plate of a vehicle. In this case, a warning sound or vibration may be provided to attract the user's attention.
  • the method may further include excluding a matched region from the search region of the front image or the image by comparing the previous front image or the previous front image photographed before a specific time, wherein the search region extracts the vehicle image. May be an area in the front image or the image searched for.
  • the wireless communication unit 250 may perform a function of receiving the identification information of the arrangement.
  • the wireless communication unit 250 pre-registers the position information of the glass-shaped wearable device 10 and the detailed information of the arrangement, if the analyzed vehicle identification information corresponds to the identification information of the arrangement. You can send it to a user or an adjacent user.
  • the camera 120 performs a function of scanning road conditions as an image or an image.
  • the camera 120 may be one or more of a plurality of cameras attached to the glass type wearable device 10.
  • the controller 210 analyzes identification information of the vehicle captured in the scanned image or the image.
  • the output unit 300 performs a function of notifying whether the user of the glass type wearable device corresponds.
  • the output unit 300 may be one or more of the display unit 310, the voice output module 320, or the haptic module 340.
  • the detection rate of the arranging vehicle can be increased by transmitting location information on which the arranging vehicle is found and detailed information of the arranging vehicle to a pre-registered user or a neighboring user as soon as the arranging vehicle is found.
  • FIG. 10 is a flowchart illustrating a signal change notification method using a glass type wearable device according to an exemplary embodiment of the present invention.
  • the signal change notification method using the glass type wearable device may include: searching for a traffic light by the first camera 121 of the glass type wearable device (S400); Recognizing a signal change of the found traffic light (S410); And notifying the user of the signal change (S420).
  • searching for a traffic light by the first camera 121 of the glass type wearable device S400
  • Recognizing a signal change of the found traffic light S410
  • S420 notifying the user of the signal change
  • a signal change notification method using a glass type wearable device according to an embodiment of the present invention will be described in order.
  • the first camera 121 of the glass wearable device searches for a traffic light (S400).
  • the first camera 121 receives an image or an image in a direction viewed by the user, and the controller 210 searches for a traffic light in the input image or image.
  • the shape of the traffic light to be searched by the control unit 210 is stored in the storage unit 260, so that the control unit 210 receives the shape of the traffic light from the storage unit 260 and compares it with the shapes in the image or images. Find out.
  • the glass type wearable device 10 recognizes a signal change of the searched traffic light (S410). That is, when a signal change of the searched signal lamp occurs, the control unit 210 of the glass type wearable device 10 recognizes the signal change.
  • the recognition of the signal change may be performed by recognizing the color change of the traffic light or the change of the shape displayed on the traffic light.
  • the controller 210 recognizes the signal change according to the color of the signal, the controller 210 recognizes the red light as a stop signal and recognizes the green light as the straight signal.
  • the control unit 210 recognizes the signal change considering the existing signal and the changed signal together, if it is changed from the red light to the green light is recognized as a straight signal, if it is changed from the green light to the red light, it is recognized as a stop signal, and red light If the red light (or yellow light) is recognized again (or yellow light) after the (or yellow light), it can be recognized as a caution progress signal.
  • the glass type wearable device 10 may provide information on whether the crackdown area or the crackdown time is applicable based on the current location so that the user may determine whether a specific vehicle corresponds to a traffic law violation and decide to perform a report. have.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Radar, Positioning & Navigation (AREA)
  • Remote Sensing (AREA)
  • Optics & Photonics (AREA)
  • User Interface Of Digital Computer (AREA)
  • Traffic Control Systems (AREA)

Abstract

La présente invention concerne un système et un procédé de traitement d'informations au moyen d'un dispositif portable. Le procédé de traitement d'informations au moyen d'un dispositif portable selon la présente invention comprend les étapes suivantes : (S100) désignation d'un numéro de trajet d'un bus particulier ; (S110) acquisition, par un dispositif portable de type lunettes, d'une vidéo ou d'une image de premier plan ; (S120) reconnaissance du numéro de trajet d'un véhicule apparaissant sur la vidéo ou l'image de premier plan ; et (S130) si le numéro de trajet reconnu correspond au numéro de trajet désigné, fourniture d'une indication de l'arrivée du bus à l'utilisateur. Selon la présente invention, il est possible d'empêcher que se produise une situation dans laquelle un utilisateur, qui porte un dispositif portable de type lunettes et attend un bus, manque un bus alors qu'il occupé dans une autre activité avec le dispositif portable de type lunettes.
PCT/KR2015/007146 2014-07-10 2015-07-09 Système et procédé de traitement d'informations au moyen d'un dispositif portable Ceased WO2016006951A2 (fr)

Applications Claiming Priority (12)

Application Number Priority Date Filing Date Title
KR20140086544 2014-07-10
KR10-2014-0086544 2014-07-10
KR10-2014-0090473 2014-07-17
KR20140090473 2014-07-17
KR1020140091839A KR101592398B1 (ko) 2014-07-21 2014-07-21 글라스형 웨어러블 디바이스를 이용한 신호변경 알림시스템 및 알림방법
KR10-2014-0091839 2014-07-21
KR1020140113234A KR20160025840A (ko) 2014-08-28 2014-08-28 글라스형 웨어러블 디바이스를 이용한 교통법규위반 차량 신고시스템 및 신고방법
KR10-2014-0113234 2014-08-28
KR1020150042540A KR20160010294A (ko) 2014-07-17 2015-03-26 글라스형 웨어러블 디바이스를 이용한 수배차량 알림 방법 및 프로그램
KR10-2015-0042539 2015-03-26
KR10-2015-0042540 2015-03-26
KR1020150042539A KR101684264B1 (ko) 2014-07-10 2015-03-26 글라스형 웨어러블 디바이스의 버스도착 알림방법 및 이를 이용한 글라스형 웨어러블 디바이스용 프로그램

Publications (2)

Publication Number Publication Date
WO2016006951A2 true WO2016006951A2 (fr) 2016-01-14
WO2016006951A3 WO2016006951A3 (fr) 2016-03-03

Family

ID=55065059

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2015/007146 Ceased WO2016006951A2 (fr) 2014-07-10 2015-07-09 Système et procédé de traitement d'informations au moyen d'un dispositif portable

Country Status (1)

Country Link
WO (1) WO2016006951A2 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10088911B2 (en) 2016-12-30 2018-10-02 Manuel Saez Programmable electronic helmet

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4082188B2 (ja) * 2002-11-20 2008-04-30 日本電気株式会社 交通車両利用案内システム、交通車両利用案内方法及び交通車両利用案内プログラム
KR101055301B1 (ko) * 2009-06-15 2011-08-09 (주)양진텔레콤 시각 장애인용 음성 버스 조회 안내 시스템 및 그 제어 방법
KR20130010394A (ko) * 2011-07-18 2013-01-28 주식회사 네비웨이 버스정보 안내시스템
KR101375868B1 (ko) * 2012-08-07 2014-03-17 한양대학교 산학협력단 감지 기능을 구비한 착용형 디스플레이 장치
KR102004265B1 (ko) * 2012-12-28 2019-07-26 엘지전자 주식회사 헤드 마운트 디스플레이 및 이를 이용한 영상 통화 방법

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10088911B2 (en) 2016-12-30 2018-10-02 Manuel Saez Programmable electronic helmet

Also Published As

Publication number Publication date
WO2016006951A3 (fr) 2016-03-03

Similar Documents

Publication Publication Date Title
WO2017034287A1 (fr) Système de prévention des collisions avec des piétons, et procédé de fonctionnement dudit système
WO2016175412A1 (fr) Terminal mobile et son procédé de commande
WO2018155892A1 (fr) Procédé d'affichage d'une image, support de stockage et dispositif électronique associé
WO2017164567A1 (fr) Dispositif électronique intelligent et son procédé de fonctionnement
WO2020017706A1 (fr) Dispositif électronique et procédé pour le commander
WO2020085694A1 (fr) Dispositif de capture d'image et procédé de commande associé
WO2019013517A1 (fr) Appareil et procédé pour contexte de commande vocale
WO2016021907A1 (fr) Système de traitement d'informations et procédé utilisant un dispositif à porter sur soi
WO2015199288A1 (fr) Terminal du type lunettes, et procédé de commande de ce terminal
WO2015102361A1 (fr) Appareil et procédé d'acquisition d'image pour une reconnaissance de l'iris à l'aide d'une distance de trait facial
WO2013085193A1 (fr) Appareil et procédé pour améliorer la reconnaissance d'un utilisateur
WO2018093005A1 (fr) Terminal mobile et procédé de commande associé
JP2017102516A (ja) 表示装置、通信システム、表示装置の制御方法、及び、プログラム
KR101661555B1 (ko) 비콘을 이용한 글라스형 웨어러블 디바이스의 카메라 기능 제한방법 및 프로그램
WO2018097683A1 (fr) Dispositif électronique, dispositif électronique externe et procédé de connexion de dispositif électronique et de dispositif électronique externe
KR101684264B1 (ko) 글라스형 웨어러블 디바이스의 버스도착 알림방법 및 이를 이용한 글라스형 웨어러블 디바이스용 프로그램
WO2017171157A1 (fr) Dispositif pouvant être porté
WO2016093633A1 (fr) Procédé et dispositif d'affichage de contenu
WO2018066962A1 (fr) Lunettes intelligentes
WO2016006920A1 (fr) Système et procédé pour traiter des informations à l'aide d'un dispositif vestimentaire
WO2016018063A2 (fr) Système et procédé de traitement d'informations utilisant un dispositif portable
WO2016010328A1 (fr) Système de traitement d'informations et procédé utilisant un dispositif portatif
WO2015099500A1 (fr) Appareil d'enregistrement d'accident de véhicule et son procédé
WO2019088338A1 (fr) Dispositif électronique et procédé de commande associé
WO2018097483A1 (fr) Procédé de génération d'informations de mouvement et dispositif électronique le prenant en charge

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 15819175

Country of ref document: EP

Kind code of ref document: A2

NENP Non-entry into the national phase in:

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 15819175

Country of ref document: EP

Kind code of ref document: A2