TWI670520B - Wearable glasses and method of providing content using the same - Google Patents

Abstract

The present invention provides a wearable eyewear. Wearable glasses include sensing circuitry, a communication interface, a display, and a controller. The sensing circuit senses movement information of a user wearing the wearable glasses. The communication interface receives notification message information. The display displays notification message information within the perspective of the user wearing the wearable glasses. The controller determines the movement state of the user based on the sensed movement information of the user, and controls the display to display the received notification message information according to the movement state of the user.

Description

Wearable glasses and methods of using the same

The present application claims the following patent applications filed by the Korea Intellectual Property Office: Korean Patent Application No. 10-2014-0098626, filed on July 31, 2014, and No. 10, filed on March 27, 2015 The Korean Patent Application No. 2015-0043300, the disclosure of which is hereby incorporated by reference in its entirety.

Apparatus, methods, and articles of manufacture consistent with the present disclosure are directed to a wearable eyeglass and a method of providing content corresponding to a notification event via wearable eyewear.

A wearable device is a device that can be worn by a person. With the active development of wearable devices, various types of wearable devices have been released on the market or are expected to be released on the market. Examples of such wearable devices are wearable watches, wearable glasses, and wearable belts.

Wearable glasses can be worn like typical glasses and provide users with a variety of information. While wearable glasses allow the user to freely use their hands, the user's field of view may be blocked by information displayed on the wearable glasses.

In accordance with an aspect of one or more exemplary embodiments, a wearable eyewear is provided, comprising: a sensing circuit configured to sense movement information of a user wearing the wearable eyeglass; a communication interface, via the group To receive notification message information; a display configured to display notification message information within a perspective of a user wearing the wearable glasses; and a controller configured to determine the user based on the sensed movement information of the user The mobile state, and the display is controlled to display the received notification message information according to the user's mobile status.

The controller can be further configured to determine whether the user is wearing wearable glasses by using at least one sensor included in the sensing circuit, and to control the sensing circuit when determining that the user is wearing the wearable glasses To sense the movement of the user.

The controller can be further configured to determine the user's movement state by using at least one of the following by the sensing circuit: acceleration information, tilt information, biometric information, altitude information, atmospheric pressure information , eye tracking information, and location information.

The controller can be further configured to determine the user's movement status using the user's movement information received from the external device.

The controller can be further configured to determine when to display the notification message information based on the user's movement status and to control the display to display the notification message information at the determined time.

When the user's moving speed is less than the threshold speed, the controller can go through The one-step configuration is to output the notification message information at the current time, and when the user's moving speed is equal to or greater than the threshold speed, the controller can be further configured to determine that the notification message information is output at a time different from the current time.

The different time may include at least one of the following time points: a time point when receiving a user input requesting to output the notification message information, a time point when the user's movement state is changed, and a time when the preset time has elapsed point.

The controller can be further configured to determine a display form for displaying the notification message information based on the movement state of the user, and to control the display to display the notification message information in accordance with the determined display form.

When the user's moving speed is equal to or greater than the threshold speed, the controller may be further configured to display a part of the notification message information, and when the user's moving speed is less than the threshold speed, the controller may further group Status to display all of the notification message information.

The controller can be further configured to determine at least one of the audio signal and the video signal as an output form of the notification message information based on environmental information about the environment within a certain distance from the wearable glasses.

The environmental information may include at least one of the following information: information about an external sound generated within a certain distance from the wearable glasses, and information about an external image obtained by using the image sensor.

In accordance with another aspect of one or more exemplary embodiments, a wearable eyewear is provided comprising: a sensing circuit configured to sense movement of a user and outputting a signal; a communication interface configured to receive Notification message information; a display configured to display notification message information; and a controller configured to control the display to be based on self-sensing The signal output by the circuit displays the received notification message information.

The controller can be further configured to determine whether the user is wearing wearable glasses based on signals output from at least one of the sensors included in the sensing circuit, and to control when the user is wearing the wearable glasses The device can be further configured to control the sensing circuit to sense movement of the user.

In accordance with yet another aspect of one or more exemplary embodiments, a method of providing information is provided, wherein the method is performed by wearable glasses and includes: receiving notification message information; sensing wearable wearable glasses The user's mobile information; determines the user's mobile status by using the user's sensed mobile information; and displays the received notification message information according to the user's mobile status.

Sensing the user's mobile information may include determining whether the user is wearing the wearable glasses by using at least one sensor included in the wearable glasses; and determining that the user is wearing the wearable glasses The user's mobile information is sensed.

The display of the received notification message information may include: determining when to display the notification message information; and displaying the notification message information at the determined time.

The determining of the time for displaying the notification message information may include: when the user's moving speed is less than the threshold speed, determining to output the notification message information at the current time; and when the user's moving speed is equal to or greater than the threshold speed, It is determined that the notification message information is output at a time different from the current time.

The displaying of the received notification message information may include: determining a display form for displaying the notification message information; and displaying the notification message information according to the determined display form.

The determination of the display form may include: determining a portion of the output notification message information when the user's moving speed is equal to or greater than the threshold speed; and determining to output the notification message information when the user's moving speed is less than the threshold speed All.

The determining of the display form may include: obtaining environmental information about an environment within a certain distance from the wearable glasses; and determining, according to the obtained environmental information, providing the notification message in the form of at least one of an audio signal and a video signal. News.

The wearable glasses may include wearable glasses.

In accordance with yet another aspect of one or more exemplary embodiments, a wearable eyewear includes: a sensor configured to sense movement information of a user wearing the wearable eyeglasses; and a controller, Configuring to determine a movement state of the user based on the sensed movement information, and controlling the display to display all of the received notification messages when the movement state indicates that the user is in a safe condition; indicating that the user is at risk in the movement state In the case, the received notification message is not displayed; and a part of the received notification message is displayed when the mobile state indicates that the user is neither in a safe condition nor in a dangerous situation.

When the mobile status indicates that the user is in a dangerous situation, the controller may store the received notification message for display at a different time than the current time.

When the movement status indicates that the user is in a dangerous situation, the controller can control the display to display the received notification information when the movement status indicates that the user is no longer in a dangerous situation.

The sensor can be one or more of the following sensors: acceleration sensor, tilt sensor, biometric information sensor, altitude sensor, atmospheric pressure sensing , eye tracking sensor, and position sensor.

10‧‧‧Content

100‧‧‧ Wearable Glasses/Head Mounted Display (HMS) Equipment

101‧‧‧Frame

102‧‧‧ lens

103‧‧‧Power supply

110‧‧‧Output device

111‧‧‧ display

112‧‧‧Sound output unit/sound output device

113‧‧‧Vibration motor

120‧‧‧ Controller

130‧‧‧User input unit/user input device

140‧‧‧Communication interface/communication unit

141‧‧‧Short-range wireless communication interface

142‧‧‧Mobile communication interface

143‧‧‧Broadcast receiving circuit

150‧‧‧Sensor circuit

151‧‧‧Magnetic sensor

152‧‧‧Acceleration sensor

153‧‧‧ tilt sensor

154‧‧‧Deep sensor

155‧‧‧Gyro sensor

156‧‧‧ position sensor

157‧‧‧Atmospheric pressure sensor

158‧‧‧ proximity sensor

159‧‧‧Optical sensor

160‧‧‧Audio/Video (A/V) input circuit

161‧‧‧Image Sensor/Camera

162‧‧‧ microphone

170‧‧‧ memory

171‧‧‧User Interface (UI) Module

172‧‧‧Notification module

173‧‧‧Discourse to Text (STT) Module

174‧‧‧Image Processing Module

200‧‧‧ mobile terminal

300‧‧‧Server

400‧‧‧External wearable device

400-1‧‧‧Smart Watch

700‧‧‧External devices

800‧‧‧News providing server

810‧‧‧Push message

820‧‧‧ operation

910‧‧‧ Schedule Information

920‧‧‧ Scheduled Notice Content

1000‧‧‧News content

1010‧‧‧ text message

1020‧‧‧Notice message

1030‧‧‧ display

1100‧‧‧ inquiry machine

1110‧‧‧Advertising content

1300‧‧‧External devices

1510‧‧‧Users

1511‧‧‧Simple indicator

1520‧‧‧Users

1521‧‧‧News content

1700‧‧‧ operation

1800‧‧‧ heading

1900‧‧‧ News articles

2110‧‧‧ Situation

2111‧‧‧ operation

2120‧‧‧ Situation

2121‧‧‧News content

2300‧‧‧Heading movement

2310‧‧‧ Situation

2311‧‧‧ part of the news content

2320‧‧‧ Situation

2321‧‧‧The entire news content

2400‧‧‧Heading movement

2410‧‧‧ Situation

2411‧‧‧Thumbnail image

2420‧‧‧ Situation

2421‧‧‧The entire advertising content

2500‧‧‧Shake movement

2510‧‧‧ Situation

2511‧‧‧ part of the news content

2520‧‧‧ Situation

Section 2521‧‧‧

2700-1‧‧‧ Situation

2700-2‧‧‧ Situation

2710‧‧‧The entire news content

2720‧‧‧The entire news content

2910‧‧‧ Situation

2911‧‧‧ opaque news content

2920‧‧‧ Situation

2921‧‧‧Translucent news content

3101‧‧‧ News video content

3102‧‧‧transcript

3110‧‧‧ Situation

3120‧‧‧ Situation

3201‧‧‧News video content

3202‧‧‧ text

3210‧‧‧ Situation

3220‧‧‧ Situation

3401‧‧‧News content

3402‧‧‧ audio signal

3410‧‧‧ Situation

3411‧‧‧ Sky Image

3420‧‧‧ Situation

3421‧‧ ‧ public image

3600-1‧‧‧ Situation

3600-2‧‧‧ Situation

3610‧‧‧ Surrounding images

3611‧‧‧Simple indicator

3620‧‧‧ wall image

3621‧‧‧News content

3800‧‧‧ Sky Image

3810‧‧‧Blue

3820‧‧‧Yellow

4000‧‧‧News content

4010‧‧‧ Situation

4020‧‧‧ Situation

4200‧‧‧Setting information

4201‧‧‧Location

4202‧‧‧Application

Category 4210‧‧

4220‧‧‧Details

4230‧‧‧Set conditions

4300‧‧‧The entire news content

4400‧‧‧News content

4600‧‧‧Emergency notice content

4610‧‧‧ Situation

4620‧‧‧ Situation

4630‧‧‧ Situation

4700‧‧‧External devices

4800‧‧‧Smart Watch

4800-1‧‧‧ Situation

4800-2‧‧‧ Situation

4810‧‧‧ part of the news content

4820‧‧‧Shake

4830‧‧‧The whole content

4900‧‧‧External devices

5000‧‧‧Smart Watch

5000-1‧‧‧ Situation

5000-2‧‧‧ Situation

5000-3‧‧‧ Situation

5010‧‧‧ part of the news content

5020‧‧‧ button

5030‧‧‧The whole content

5100‧‧‧External devices

5200‧‧‧Smart Watch

5200-1‧‧‧ Situation

5200-2‧‧‧ Situation

5210‧‧‧News content

5400-1‧‧‧ Situation

5400-2‧‧‧ Situation

5410‧‧‧Heading movement

5411‧‧‧List of non-exported content

5420‧‧‧Shake movement

5422‧‧‧ first content

5500‧‧‧Smart Watch

5501‧‧‧ first content

5502‧‧‧Intuitive view

5503‧‧‧ Head mounted display (HMD) view

5510‧‧‧ Situation

5520‧‧‧ Situation

5600‧‧‧Smart Watch

5601‧‧‧ eleventh content

5602‧‧‧Intuitive view

5603‧‧‧ Head mounted display (HMD) view

5610‧‧‧ Situation

5620‧‧‧ Situation

S510‧‧‧ operation

S520‧‧‧ operation

S530‧‧‧ operation

S610‧‧‧ operation

S620‧‧‧ operation

S630‧‧‧ operation

S640‧‧‧ operation

S710‧‧‧ operation

S720‧‧‧ operation

S730‧‧‧ operation

S740‧‧‧ operation

S1210‧‧‧ operation

S1220‧‧‧ operation

S1230‧‧‧ operation

S1240‧‧‧ operation

S1250‧‧‧ operation

S1310‧‧‧ operation

S1320‧‧‧ operation

S1330‧‧‧ operation

S1340‧‧‧ operation

S1350‧‧‧ operation

S1360‧‧‧ operation

S1370‧‧‧ operation

S1380‧‧‧ operation

S1410‧‧‧ operation

S1420‧‧‧ operation

S1430‧‧‧ operation

S1440‧‧‧ operation

S1450‧‧‧ operation

S1460‧‧‧ operation

S1470‧‧‧ operation

S1610‧‧‧ operation

S1620‧‧‧ operation

S1630‧‧‧ operation

S1640‧‧‧ operation

S1650‧‧‧ operation

S1660‧‧‧ operation

S1670‧‧‧ operation

S1710‧‧‧ operation

S1720‧‧‧ operation

S1730‧‧‧ operation

S1810‧‧‧ operation

S1820‧‧‧ operation

S1830‧‧‧ operation

S1910‧‧‧ operation

S1920‧‧‧ operation

S1930‧‧‧ operation

S2010‧‧‧ operation

S2020‧‧‧ operation

S2030‧‧‧ operation

S2040‧‧‧ operation

S2050‧‧‧ operation

S2060‧‧‧ operation

S2070‧‧‧ operation

S2210‧‧‧ operation

S2220‧‧‧ operation

S2230‧‧‧ operation

S2240‧‧‧ operation

S2250‧‧‧ operation

S2260‧‧‧ operation

S2270‧‧‧ operation

S2280‧‧‧ operation

S2610‧‧‧ operation

S2620‧‧‧ operation

S2630‧‧‧ operation

S2810‧‧‧ operation

S2820‧‧‧ operation

S2830‧‧‧ operation

S3010‧‧‧ operation

S3020‧‧‧ operation

S3030‧‧‧ operation

S3040‧‧‧ operation

S3310‧‧‧ operation

S3320‧‧‧ operation

S3330‧‧‧ operation

S3340‧‧‧ operation

S3510‧‧‧ operation

S3520‧‧‧ operation

S3530‧‧‧ operation

S3540‧‧‧ operation

S3550‧‧‧ operation

S3710‧‧‧ operation

S3720‧‧‧ operation

S3730‧‧‧ operation

S3740‧‧‧ operation

S3750‧‧‧ operation

S3910‧‧‧ operation

S3920‧‧‧ operation

S3930‧‧‧ operation

S3940‧‧‧ operation

S4110‧‧‧ operation

S4120‧‧‧ operation

S4130‧‧‧ operation

S4140‧‧‧ operation

S4510‧‧‧ operation

S4520‧‧‧ operation

S4530‧‧‧ operation

S4540‧‧‧ operation

S4550‧‧‧ operation

S4710‧‧‧ operation

S4720‧‧‧ operation

S4730‧‧‧ operation

S4740‧‧‧ operation

S4750‧‧‧ operation

S4760‧‧‧ operation

S4770‧‧‧ operation

S4910‧‧‧ operation

S4920‧‧‧ operation

S4930‧‧‧ operation

S4940‧‧‧ operation

S4950‧‧‧ operation

S4960‧‧‧ operation

S4970‧‧‧ operation

S5110‧‧‧ operation

S5120‧‧‧ operation

S5130‧‧‧ operation

S5140‧‧‧ operation

S5150‧‧‧ operation

S5160‧‧‧ operation

S5170‧‧‧ operation

S5310‧‧‧ operation

S5320‧‧‧ operation

S5330‧‧‧ operation

S5340‧‧‧ operation

The following description of the exemplary embodiments, taken in conjunction with the drawings,

FIG. 1 illustrates a diagram for describing a method of operating wearable glasses in accordance with an exemplary embodiment.

2 and 3 illustrate diagrams for describing an appearance of wearable glasses in accordance with an exemplary embodiment.

FIG. 4 illustrates a diagram for describing a notification system in accordance with an exemplary embodiment.

5A illustrates a flow diagram of a method for wearable glasses to provide content based on user's mobile information, in accordance with an illustrative embodiment.

5B and 5C illustrate diagrams for describing a method for the wearable glasses to determine the movement state of the user based on the user's movement information, according to an exemplary embodiment.

6 illustrates a flow diagram of a method for wearable glasses to provide content corresponding to a notification event based on whether a user is wearing wearable glasses, in accordance with an illustrative embodiment.

FIG. 7 illustrates a flow diagram of a method for wearable glasses to detect the occurrence of a notification event, in accordance with an illustrative embodiment.

FIG. 8 illustrates an example of sensing the occurrence of a notification event by a wearable glasses receiving a notification message by a wearable glasses, according to an exemplary embodiment.

FIG. 9 illustrates the use of wearable glasses by themselves, in accordance with an exemplary embodiment The mobile terminal receives an instance of the scheduling notification message sensing notification event.

FIG. 10 illustrates an example of the occurrence of a notification event by a wearable spectacles by receiving a text message via a mobile terminal, in accordance with an exemplary embodiment.

11 illustrates an example of sensing the occurrence of a notification event by receiving an advertisement content by wearable glasses, according to an exemplary embodiment.

12 illustrates a flow chart of a method for obtaining wearable glasses for a user's mobile information, in accordance with an illustrative embodiment.

13 illustrates a flow diagram of a method for wearable glasses to obtain user's mobile information from an external device, in accordance with an illustrative embodiment.

14 illustrates a flow chart of a method for wearable glasses to determine a time to output content corresponding to a notification event based on a user's moving speed, in accordance with an exemplary embodiment.

15A and 15B illustrate diagrams for describing an example of a time and method of outputting content corresponding to a notification event based on a user's moving speed adjustment by the wearable glasses, according to an exemplary embodiment.

16 illustrates a flow chart of a method of determining an output form of content corresponding to a notification event based on user's movement information, in accordance with an exemplary embodiment.

17 to 19 illustrate diagrams for describing an example of providing a portion or the entire content of content corresponding to a notification event based on a user's moving speed by the wearable glasses, according to an exemplary embodiment.

20 illustrates a flow diagram of a method for wearable glasses to output non-output content when an event has occurred, in accordance with an illustrative embodiment.

21 illustrates based on wearable glasses based on an exemplary embodiment. The user's move change event output corresponds to an instance of the content of the previously generated notification event.

FIG. 22 illustrates a diagram for describing a method for changing an output form of content based on a certain input of a user for use by the wearable glasses according to an exemplary embodiment.

23 and 24 illustrate diagrams for describing an example in which the entire content is output based on the head-up motion of the user by the wearable glasses.

25 illustrates a diagram for describing an example of blocking output of content based on user input by a wearable glasses that have output a portion of content, according to an exemplary embodiment.

26 illustrates a flow diagram of a method for wearable glasses to highlight keywords in content corresponding to an event, in accordance with an illustrative embodiment.

FIG. 27 illustrates a diagram for describing an example of highlighting keywords in content based on user's movement information by wearable glasses, according to an exemplary embodiment.

28 illustrates a flow diagram of a method for wearable glasses to adjust transparency of content corresponding to an event, in accordance with an illustrative embodiment.

FIG. 29 illustrates a diagram for explaining an example of adjusting transparency of content based on user's speed information while the user is driving, according to an exemplary embodiment.

30 illustrates a diagram for describing a method for a wearable eyeglass to determine a form of an output signal based on environmental information, according to an exemplary embodiment.

31 and 32 illustrate diagrams for explaining an example of a form in which an output signal is adjusted based on external sound information by wearable glasses, according to an exemplary embodiment.

FIG. 33 illustrates wearable glasses for use based on an exemplary embodiment. The external image information determines a flowchart of a method corresponding to an output form of the content of the notification event.

FIG. 34 illustrates an example of a form in which an output signal is adjusted based on external image information by wearable glasses, according to an exemplary embodiment.

FIG. 35 illustrates a flowchart for a method for the wearable glasses to determine whether to output a notification content based on change information of an external image, according to an exemplary embodiment.

FIG. 36 illustrates an example of an output form in which content corresponding to a notification event is changed based on change information of an external image by the wearable glasses, according to an exemplary embodiment.

37 illustrates a flow diagram of a method for wearable glasses to adjust at least one of transparency, color, and chrominance of content corresponding to a notification event based on external image information, in accordance with an illustrative embodiment.

FIG. 38 illustrates a diagram for describing an example of adjusting a color of content corresponding to a notification event based on external image information by the wearable glasses, according to an exemplary embodiment.

39 illustrates a flow chart of a method of determining an output location of content corresponding to a notification event for wearable glasses, in accordance with an illustrative embodiment.

FIG. 40 illustrates a diagram for describing an example of changing an output location of content corresponding to a notification event by wearable glasses, according to an exemplary embodiment.

41 illustrates a flow diagram of a method for a wearable eyeglass to determine a method of providing content corresponding to an event based on user setting information, in accordance with an illustrative embodiment.

42 illustrates setting and content corresponding to an event, according to an exemplary embodiment An example of the output of the information.

43 and 44 illustrate an example of outputting content corresponding to a notification event based on user's setting information by the wearable glasses, according to an exemplary embodiment.

45 illustrates a flow diagram of a method for wearable glasses to receive emergency notification information from an external wearable device, in accordance with an illustrative embodiment.

FIG. 46 illustrates an example of displaying pulse rate information received from an external wearable device by wearable glasses, in accordance with an exemplary embodiment.

FIG. 47 illustrates a flowchart of a method for wearable glasses to output content corresponding to a notification event via an external device, according to an exemplary embodiment.

FIG. 48 illustrates an example of outputting content corresponding to a notification event based on user input by wearable glasses, according to an exemplary embodiment.

49 illustrates a flow diagram of a method for a wearable eyeglass to transmit content corresponding to a notification event in response to a request from an external device, in accordance with an illustrative embodiment.

FIG. 50 illustrates an example of displaying content corresponding to a notification event by an external device based on user input received via an external device, wherein the external device is connected to the wearable glasses.

51 illustrates a flow diagram of a method for wearable glasses to output content corresponding to a notification event based on user's movement information, in accordance with an illustrative embodiment.

FIG. 52 illustrates an example of outputting content corresponding to a notification event based on user's movement information by wearable glasses, according to an exemplary embodiment.

53 illustrates a flow diagram of a method for wearable glasses to provide a list of non-output content, in accordance with an illustrative embodiment.

Figure 54 illustrates an example of a manifest providing non-output content based on a user input by wearable glasses, in accordance with an illustrative embodiment.

FIG. 55 illustrates an example of providing a list of content that has not been output from wearable glasses by a wearable device connected to the wearable glasses, according to an exemplary embodiment.

Figure 56 illustrates an example of a listing of content previously output from wearable glasses by a wearable device connected to wearable glasses, in accordance with an illustrative embodiment.

57 and 58 are block diagrams illustrating the structure of wearable glasses in accordance with an exemplary embodiment.

The terms used herein will now be briefly described, and the exemplary embodiments will be described in detail.

All terms including descriptive or technical terms used herein are to be interpreted as having a meaning as understood by those of ordinary skill in the art. However, the terms may have different meanings depending on the intention of the person skilled in the art, the precedent condition, or the appearance of new technology. Furthermore, the Applicant may select some terms, and in this case, the meaning of the selected terms will be described in detail in the embodiments. Therefore, the terms used herein must be defined based on the meaning of the terms along with the description throughout the specification.

In addition, when a component is "comprising" or "comprising" an element, the element. In the following description, terms such as "unit" and "module" indicate a unit for processing at least one function or operation, where unit and block may be embodied as hardware or software, or by combining hardware and software. To reflect.

The illustrative embodiments will now be described more fully with reference to the accompanying drawings. The illustrative embodiments may be embodied in many different forms and should not be construed as being limited to the illustrative embodiments set forth herein. The concept of one or more exemplary embodiments is fully conveyed to those of ordinary skill in the art. In the following description, well-known functions or constructions are not described in detail, as the .

The term "and/or" as used herein includes any and all combinations of one or more of the associated listed items. An expression such as "at least one of" is used to modify the entire list of elements before the list of elements, and does not modify the individual elements of the list.

FIG. 1 illustrates a diagram for describing a method of operating wearable glasses in accordance with an exemplary embodiment.

According to an exemplary embodiment, wearable eyewear 100 is a display device that is worn on a user's head to provide an image in front of the user's eyes. The inventive concept is not limited to a spectacles-type wearable device (for example, wearable spectacles 100), but is also applicable to a head mounted display (HMD) device, a part of which is fixed to a user's head so that Display information within the user's perspective.

According to an exemplary embodiment, the HMD device can be implemented in various forms. For example, the HMD device can be implemented as glasses, a helmet, and a hat, but is not limited thereto.

According to an exemplary embodiment, wearable glasses 100 may provide content 10 corresponding to a notification event. In this specification, the content providing may include, for example, displaying content, re-executing content, or outputting content.

In this specification, a notification event may refer to an event that generates information to be sent to a user. The notification event can be, for example, an event for notifying the user of a situation occurring in the wearable glasses 100 or external to the wearable glasses 100.

For example, the notification event may include at least one of the following events: a schedule notification event, a travel operation, a traffic information notification event, an advertisement notification event, an update notification event, a recommended content notification event, a health information notification event, and An emergency notification event, but is not limited to this.

In the present specification, "content corresponding to the notification event" may refer to the generated content to be transmitted to the user. The "content corresponding to the notification event" may be generated in the wearable glasses 100 or may be obtained from the outside of the wearable glasses 100. For example, when a notification event has occurred, the wearable glasses 100 can generate content 10 corresponding to the notification event. Furthermore, the wearable glasses 100 can receive content corresponding to the notification event from an external device or a server. In the following, "content corresponding to the notification event" may also be referred to as "notification information".

Throughout this specification, "content" means digital information provided via a wired or wireless communication network. Content according to an exemplary embodiment may include, for example, video content, still image content (eg, pictures, graphics, etc.), text content (eg, news articles, letters, web pages, etc.), music content (eg, music, Musical instrument, radio Broadcast, etc.), but not limited to this.

According to an exemplary embodiment, the "content corresponding to the notification event" may include at least one of the following contents: schedule notification content (eg, medication notification comment, schedule notification comment, etc.), tourist attraction notification content ( For example, the interpretation of historical sites, the opening and closing times of tourist attractions, etc., the content of notifications of traffic information (for example, bus schedule execution, notification of congestion, etc.), advertisement notification content (for example, coupons, sales start) /end time, etc.), update notification content (for example, update notification for software or hardware, update information for other notification content - for example, update of tourist attraction opening/closing schedule, etc.), recommended content (for example , recommended book information, recommended music information, etc.), health information notification content (eg, blood sugar content information, heart rate information, temperature information, etc.), and emergency notification content (eg, fire, earthquake, etc.), but not limited to . For convenience of description, hereinafter, "content corresponding to a notification event" may also be referred to as "notification content".

According to an exemplary embodiment, the wearable glasses 100 may provide notification content in various forms. For example, the wearable glasses 100 can display the notification content on the display in the form of augmented reality (AR), mixed reality (MR), or virtual reality (VR).

When the wearable glasses output the notification content immediately upon sensing the occurrence of the notification event regardless of the user's situation, the user may be exposed to a dangerous situation. Therefore, according to an exemplary embodiment, hereinafter, the wearable glasses 100 will be described based on the user's movement information (hereinafter also referred to as "moving state" or "mobile type information") to determine when to provide the notification content and A method of providing a form of notification content. First, the wearable glasses 100 will be described in detail with reference to FIGS. 2 and 3. Exterior.

2 and 3 illustrate diagrams for describing an appearance of the wearable eyewear 100 in accordance with an exemplary embodiment. According to the exemplary embodiment of FIGS. 2 and 3, it is assumed that the wearable glasses 100 are in the form of glasses.

2, the wearable glasses 100 can include a frame 101, a lens 102, a power source 103, a display 111, a sound output unit 112, a controller 120, a user input unit 130, an image sensor 161, and a depth sensor 154. . However, the elements illustrated in FIG. 2 are not all of the necessary elements of the wearable eyewear 100. Wearable eyewear 100 can include more or fewer components than those illustrated in FIG. For example, according to some exemplary embodiments, the wearable glasses 100 may omit the lens 102.

Some of the components included in the wearable eyewear 100 can be mounted inside the wearable eyewear 100, and some other components can be mounted on the exterior portion of the wearable eyewear 100. For example, the power source 103 and the controller 120 can be mounted inside the wearable eyewear 100. The display 111, the sound output unit 112, the user input unit 130, the image sensor 161, and the depth sensor 154 may be mounted on an outer portion of the wearable eyewear 100. The components mounted inside the wearable spectacles 100 and the components mounted on the outer portion of the wearable spectacles 100 are not limited to the components described above.

The frame 101 may comprise a material such as plastic and/or metal and may include wiring that connects the components included in the wearable eyewear 100 to each other.

According to an exemplary embodiment, the frame 101 may include a connecting member (not shown) having a partially foldable structure. Furthermore, according to an exemplary embodiment, wearable The spectacles 100 may further comprise an elastic strip that allows a user to wear the wearable spectacles 100 on the head regardless of the size of the head.

In the meantime, according to an exemplary embodiment, the lens 102 can be detachably mounted in the frame.

Lens 102 can include a transparent material that allows a user to see the area in front of it. For example, lens 102 can comprise a plastic or glass material such as polycarbonate, but is not limited thereto.

According to an exemplary embodiment, lens 102 can comprise at least one of: a light-reflective and anti-glare coating, an anti-fog coating, and an anti-ultraviolet (UV) coating.

The power source 103 can supply power to each element of the wearable glasses 100 to make the wearable glasses operable. The power source may include a rechargeable battery (not shown) and a cable (not shown) or a cable 埠 (not shown) for receiving power from the outside.

The power source 103 can be disposed at various locations on the frame 101 of the wearable eyewear 100. For example, the power source 103 can be disposed at the end of the frame 101 of the wearable eyewear 100.

Display 111 can include a translucent optical waveguide (eg, germanium). The translucent optical waveguide reflects light output from the projector to focus the image on the fovea of the retina of the user's eye. According to an exemplary embodiment, the display 111 may display content corresponding to the notification event when a notification event has occurred. The content can be notification message information. The notification message information may be an advertisement message intended to be advertised to an unspecified number of individuals or may be an advertisement message only for the wearable glasses 100 user. Moreover, according to an exemplary embodiment, the notification message information can be related to the application. Application can be scheduled of. The notification message information can be received via the communication interface. Furthermore, notification message information can be generated inside the wearable glasses 100. For example, a message indicating the remaining battery power can be generated inside the wearable glasses 100. As another example, a message indicating the current sound level or brightness level may be generated inside the wearable eyewear 100. As still another example, a message indicating the current tilt angle of the wearable glasses 100 or the diagnostic information of the wearable glasses 100 may be generated inside the wearable glasses 100.

Still further, display 111 can be used to replace lens 102 or a portion of lens 102 in accordance with the teachings of the present invention. That is, the display 111 can be used in place of the lens 102 or a portion of the lens 102.

Regarding the wearable glasses, the lens 102 and the display area may be the same. In this case, the notification message information can be received while the user is viewing the actual object through the lens 102, and the received notification message information can be displayed on the lens 102. If the notification message information is displayed outside the user's perspective throughout the entire area of the lens 102, the user must move the pupil to view the notification message information. On the other hand, if the notification message information is displayed on the area corresponding to the user's angle of view in the entire area of the lens 102, the user does not have to turn his head or move his pupil to view the notification message information.

Therefore, when the user wears the wearable glasses 100 in the form of wearable glasses, a first area corresponding to the user's perspective can be set on the display 111, and the notification message information can be displayed in the first area. The user's viewing angle may refer to the user's ability to perceive the angle or extent of the item without turning its head or turning its pupil when the user is looking at it. For example, the user's viewing angle may be 45 degrees on each of the upward and downward directions and on the left and right sides. 90 degrees on each of the directions, but is not limited to this. The perspective of each user can be determined experimentally. Alternatively, the viewing angle may be set at the manufacturer, or the viewing angle may be set by the user using the settings of the wearable glasses 100.

According to an exemplary embodiment, the first area corresponding to the user's viewing angle may be the same as or smaller than the entire display area. Furthermore, the first region corresponding to the user's viewing angle can be determined or adjusted based on the distance from the user's eyes to the lens 102.

The sound output unit 112 can be configured in the form of a headset that can be worn on the user's ear. In this case, the sound output unit 112 can be installed in the wearable glasses 100. For example, the sound output unit 112 can include a bone conduction speaker. In some exemplary embodiments, the sound output unit 112 may be spent to some extent in the user's ear.

Furthermore, the sound output unit 112 can be detachably mounted to the wearable glasses 100. In this case, the user of the wearable glasses 100 can selectively mount the sound output unit 112 to the ear.

The controller 120 can be connected to the wearable glasses 100 in a wired or wireless manner to control each element of the wearable glasses 100. For example, the controller 120 may receive data from the image sensor 161 or the user input unit 130, analyze the received data, and output the notification content via at least one of the display 111 and the sound output unit 112.

The user input unit 130 receives user input. User input may include, for example, a command or request from the user to begin or end the operation of the wearable eyewear 100. The operation can be predetermined.

According to an exemplary embodiment, the user input unit 130 may include a touch panel to receive a touch input. Throughout the specification, "touch input" refers to a gesture performed by a user on a touch panel to control the wearable glasses 100. For example, the touch input described in this specification can be touch, touch and hold, double click, drag, horizontal move, toggle, and drag and drop.

According to an exemplary embodiment, user input unit 130 may include a bend sensor for receiving a bend input. Throughout the specification, "bend input" refers to a user input for bending the entire HMS device 100 or for bending a partial region of the wearable eyewear 100 for controlling the wearable eyewear 100. According to an exemplary embodiment, the wearable eyewear 100 can sense, for example, a bending position (coordinate value), a bending direction, a bending angle, a bending speed, a number of times of bending, and a bending operation when using a bending sensor Time or period of time during which the bending operation is maintained.

According to an exemplary embodiment, user input unit 130 may receive multiple inputs. Throughout this specification, "multiple input" refers to a combination of at least two input methods. For example, the wearable eyewear 100 can receive a user's touch input and motion input or can receive a user's touch input and sound input. Moreover, the wearable glasses 100 can receive the user's touch input and eye input. The eyeball input refers to a user input for adjusting eye blink, gaze position, eye movement speed, or the like to control the wearable eyewear 100.

Meanwhile, according to an exemplary embodiment, the wearable eyewear 100 may further include a microphone (not shown). The microphone can receive sound corresponding to the user's voice and/or ambient sound generated around the wearable eyewear 100.

The image sensor 161 can be used, for example, for a smart phone or webcam A compact camera of the camera in the machine is implemented. When the user wears the wearable eyewear 100, the image sensor 161 can be mounted near the user's eyes and can capture images similar to images received via the user's eyes.

According to an exemplary embodiment, the wearable eyewear 100 may further include a depth sensor 154. The wearable glasses 100 can recognize a three-dimensional spatial gesture of the user. For example, depth sensor 154 can measure the depth value of an input device (eg, one or more hands, one or more fingers, or an electronic pen, etc.) or the like.

According to an exemplary embodiment, depth sensor 154 may obtain a depth value of the input appliance by using various methods. For example, depth sensor 154 can measure depth values by using at least one of the following methods: a time of flight (TOF) method, a stereoscopic method, and a structured light pattern method.

According to the TOF method, the time taken for the light to be reflected by the object and returned to the light source is analyzed to measure the distance from the light source to the object. In the TOF system, the infrared LED emits infrared light, and the time taken for the light to be reflected by the object and returned to the infrared LED is measured by using an infrared camera. In this case, the depth sensor 154 may include an infrared LED and an infrared camera. The depth sensor 154 can acquire the distance information in a video form by repeatedly emitting and receiving light dozens of times per second. Moreover, depth sensor 154 can establish a depth map that expresses distance information via the brightness or color of the pixel. The sampling time of dozens of times per second is only one instance, and the sampling time can be greater or smaller than dozens of times per second.

According to the stereo vision method, two cameras are used to capture a stereoscopic image of the object. In this case, depth sensor 154 can include two cameras. The depth sensor 154 can use the image based on the triangulation principle to view the images from the respective cameras. The different information of the image calculates the distance between the depth sensor 154 and the object. The human senses the stereoscopic image based on the difference between the respective images viewed by the left and right eyes, and the depth sensor 154 measures the depth sensor 154 and the object in a manner similar to the principle of the human eye by the respective cameras. the distance between. For example, if the distance between the depth sensor 154 and the object is small, the difference between the images captured by the two cameras respectively is large, and if the distance between the depth sensor 154 and the object is greater than Large, the difference between the images captured by the two cameras is small.

According to the structured light pattern method, patterned light is emitted from the light source to the object and the position of the pattern formed on the surface of the object is analyzed to measure the distance from the light source to the object. Depth sensor 154 typically emits linear or dot pattern light to the object and the pattern varies according to the curve of the object.

The structured light pattern method may correspond to a stereoscopic method in which one of the two cameras is replaced with an optical projector. For example, depth sensor 154 can instantaneously calculate a depth map by using a certain algorithm to analyze the position of the pattern formed by the light emitted from the infrared projector on the surface of the object.

According to an exemplary embodiment, image sensor 161 and depth sensor 154 may be different sensors. According to another exemplary embodiment, image sensor 161 and depth sensor 154 may be integrated into a single sensor.

According to an exemplary embodiment, in addition to the image sensor 161 and the depth sensor 154, the wearable eyewear 100 may further include other various sensors.

For example, wearable eyewear 100 can include a sensor for sensing a user's motion input. Throughout the specification, "motion input" refers to the movement of the wearable eyewear 100 by the user to control the movement of the wearable eyewear 100. For example The motion input may include user input for rotating the wearable glasses 100, tilting the wearable glasses 100, or moving the wearable in an upward or downward direction or to the left or right. Glasses 100. The wearable eyewear 100 can sense the user's motion by using, for example, an acceleration sensor, a tilt sensor, a gyroscope sensor, or a 3-axis magnetic sensor. The motion can be preset by the user. For example, the user can set a certain tilt angle to correspond to an input.

Furthermore, the wearable eyewear 100 can include a sensor for sensing whether the user is wearing the wearable eyewear 100. For example, the wearable eyewear 100 can include a temperature sensor, a pressure sensor, an acceleration sensor, a proximity sensor, or an iris scan sensor.

The wearable eyewear 100 can further include an eye tracking camera (not shown) that faces the face of the user. The eye tracking camera can include an infrared camera. The eye tracking camera can detect the user's gaze by tracking the user's pupil.

Referring to FIG. 3, the wearable eyewear 100 can be configured such that the lens 102 acts as the display 111. In this case, the lens 102 can be formed of a transparent display or a translucent display. When the lens 102 is formed of a translucent display, the lens 102 may be formed of at least one of an optical waveguide (eg, germanium), an electroluminescent display, and a liquid crystal display, but is not limited thereto.

Although the wearable glasses 100 implemented using glasses are described with reference to FIGS. 2 and 3, the wearable glasses 100 are not limited thereto. For example, the wearable eyewear 100 can be attached to a helmet structure or applied in the form of a goggle.

According to an exemplary embodiment, wearable eyewear 100 can be a stand-alone device that can be operated without the aid of other devices. Furthermore, the wearable eye The mirror 100 can be a device that is coupled to a mobile terminal or a cloud server. Hereinafter, an exemplary embodiment in which the wearable glasses 100 are coupled with other devices will be described with reference to FIG.

FIG. 4 illustrates a diagram for describing a notification system in accordance with an exemplary embodiment.

Referring to FIG. 4, the notification providing system according to an exemplary embodiment may include wearable glasses 100, a mobile terminal 200, and a server 300. However, not all of the elements illustrated in Figure 4 are essential components of the notification providing system. The notification providing system can be implemented using more or fewer components than those illustrated in FIG. For example, the notification providing system can be implemented by omitting the server 300 using the wearable glasses 100 and the mobile terminal 200, or by omitting the mobile terminal 200 using the wearable glasses 100 and the server 300.

The wearable glasses 100 are communicably connected to the mobile terminal 200 or the server 300. For example, wearable glasses 100 can perform short-range communication with mobile terminal 200. Examples of short-range communication are Wi-Fi, Near Field Communication (NFC), Bluetooth, Bluetooth Low Energy (BLE), Wi-Fi Direct (WFD), and ultra-wideband. (Ultra wideband; UWB), but not limited to this. The wearable glasses 100 can be connected to the server 300 via wireless communication or mobile communication. Moreover, in some exemplary embodiments, wearable glasses 100 can include a variety of communication methods. For example, wearable glasses 100 can include both short-range communication and wireless communication, or can include a variety of short-range communication methods.

The mobile terminal 200 can transmit data to the wearable glasses 100 or from The wearable glasses 100 receive the data. For example, the mobile terminal 200 can transmit a notification message or a control command to the wearable glasses 100. The information can be predetermined.

The mobile terminal 200 can be implemented in various forms. For example, the mobile terminal 200 described in this specification can be a mobile phone, a smart phone, a laptop, a tablet, an e-book terminal, a digital broadcast terminal, a personal digital assistant; ), portable multimedia player (PMP), navigation device, MP3 player or digital camera, but not limited to this.

The server 300 can be a cloud server that controls the wearable glasses 100. Moreover, the server 300 can be a content provider that provides a notification message.

According to an exemplary embodiment, the server 300 may include a smart engine and analyze the user's movement by using a smart engine. The operation of analyzing the movement of the user performed by the server 300 will be described in detail later with reference to FIG. In addition to using the server 300, the user's movement can be analyzed by using the wearable glasses 100 or the mobile terminal 200, and the mobile terminal 200 is connected to the wearable glasses 100 via short-range communication or communicatively connected to Wearable glasses 100.

In addition, the movement of the user analyzed by using the server 300 can be directly transmitted to the wearable glasses 100 or can be transmitted to the wearable glasses 100 via the mobile terminal 200, and the mobile terminal 200 can be connected to the mobile terminal 200 via short-range communication. The wearable eyewear 100 is communicatively coupled to the wearable eyewear 100.

Hereinafter, a method in which the wearable glasses 100 provides notification content based on the user's movement information according to an exemplary embodiment will be described in detail with reference to FIGS. 5A through 5C.

5A illustrates a flow diagram of a method for wearable glasses to provide content based on user's mobile information, in accordance with an illustrative embodiment.

In operation S510, the wearable glasses 100 can detect the occurrence of a notification event.

According to an exemplary embodiment, the wearable glasses 100 may sense internal system notification information or external notification information to be notified to the user. For example, when the remaining battery power is equal to or less than the threshold, the wearable glasses 100 may sense an event for generating a notification message regarding the remaining battery power.

Furthermore, when the notification message information is received from the mobile terminal 200 or the server 300, the wearable glasses 100 can sense that an event for outputting the notification message information has occurred. Here, the wearable glasses 100 can receive notification message information via a communication interface.

Furthermore, the wearable glasses 100 can change the color of the display 111 when an event for outputting the notification message information has occurred. That is, the controller 120 can control the display 111 to change the color of the display based on the receipt of the notification message information.

For example, when the notification message has arrived, the display 111 can display the entire screen in, for example, orange in one second. When the entire display 111 is changed to orange, the user can sense that the notification message has arrived. However, this situation is only an example, and alternatively, the display 111 can display a portion of the screen in a certain color. In addition, the time for displaying the notification message is also only an example, and the notification message can be displayed in a time longer than one second or shorter than one second.

In operation S520, when the occurrence of the notification event is detected, the wearable glasses 100 may obtain the movement information of the user who is wearing the wearable glasses 100, And determining the movement state of the user based on the movement information.

The user's mobile information may be information about the movement of the user wearing the wearable eyewear 100. In a narrow sense, the user's mobile information can be information about the user's movement. Alternatively or additionally, in a broad sense, the mobile information may include changes in the biometric information of the user. For example, the user's mobile information may include one or more of the following information: information about the user's movement, the user's movement speed information, the user's movement direction information, the user's tilt information, use Altitude information, user biometric information (eg, body temperature information, pulse rate information, sweat secretion information, etc.), user's eye tracking information (eg, pupil identification information, eye blink frequency information, eye blink speed information) , gaze direction information, etc., and user location information (eg, GPS coordinate information, regional information, building information, information about changes in location over a period of time, etc.), but are not limited thereto. The user's mobile information may also include voice information that is perceived by the user when the user speaks, alcohol smell information based on the user's drinking amount, or the like.

According to an exemplary embodiment, the wearable eyewear 100 can sense the user's movement information by using at least one sensor included in the wearable eyewear 100. For example, the wearable eyewear 100 can sense the user's movement information by using at least one of: an acceleration sensor, a position sensor, a tilt sensor, a pressure sensor, an altitude Height (atmospheric pressure) sensors, biometric sensors, iris scan sensors, image sensors, microphones, scent sensors, and temperature sensors.

Furthermore, the wearable glasses 100 can determine the movement state of the user based on the movement information of the user. The user's movement status can include, for example, walking status, Static state, running state, sleep state, driving state, commuting state, speaking state (or conversation state), or sports state (for example, jogging, swimming, tennis, basketball, or hiking), but are not limited thereto. An example of determining the movement state of the user based on the user movement information performed by the wearable glasses 100 will be described in detail.

5B and 5C illustrate diagrams for describing a method for the wearable glasses to determine the movement state of the user based on the user's movement information, according to an exemplary embodiment.

5B and 5C, the wearable glasses 100 can determine whether the user is in a stationary state or a running state by using at least one of an acceleration sensor, a tilt sensor, a position sensor, and a pressure sensor. For example, the wearable glasses 100 can be determined by using acceleration information measured using an acceleration sensor: 1) when the user moves at an average speed of 0.001 km/hour for a certain period of time, the user is at a stationary state (ie, rest); 2) when the user moves at an average speed of 4 km/hour during a certain period of time, the user is in a walking state; and 3) when the user presses within a certain period of time When the average speed of 15 km / h moves, the user is running. The certain period of time may be predetermined.

Alternatively, the wearable eyewear 100 can determine that the user is in a stationary state (eg, a position change <first change), and is in a walking state (eg, a first change) by using position change information measured using a position sensor. Position change <second change), or running state (second change) Position change). In addition, the wearable glasses 100 can use both acceleration information and position change information to increase the certainty of the determination or to provide a check.

Similarly, as another alternative, the wearable eyewear 100 can determine that the user is in a stationary state (eg, a tilt change <first threshold) and is in a walking state by using the tilt information measured using the tilt sensor. (eg, first threshold Tilt change <second threshold), or running (eg, second threshold) Tilt changes). The higher the user's movement speed, the higher the tilt variation measured using the tilt sensor. As discussed above, the wearable eyewear 100 can be more than one of acceleration information, position change information, and tilt information to provide additional certainty or to provide a check.

Similarly, the wearable eyewear 100 can determine that the user is at rest by using pressure information regarding the pressure applied to the pressure sensor attached to the nasal pad of the wearable eyeglass during movement of the user ( For example, the measured pressure <first pressure), in a walking state (eg, first pressure) The measured pressure <second pressure) or in a running state (eg, second pressure) The measured pressure). The higher the user's movement speed, the higher the pressure measured by the pressure sensor. As with other information, stress information can be used as a single point of information or can be combined with one or more other information to provide additional certainty or check.

The wearable eyewear 100 can also determine whether the user is in a standing state, a sitting state, or a lying down state by using an altitude sensor (atmospheric pressure sensor). For example, the wearable glasses 100 can be determined by using altitude information measured using an altitude sensor (atmospheric pressure sensor): 1) when the measured altitude value is the first altitude or greater than First altitude (altitude) When the first altitude value is), the user stands; 2) when the measured altitude value is less than the first altitude value and equal to or greater than the second altitude value, the user sits (first altitude value > Measured altitude The second altitude value); and 3) when the measured altitude value is less than the second altitude value, the user lie down (altitude <second altitude value). The altitude value measured using the altitude sensor may be smaller when the user is lying down than when the user is standing.

Turning to FIG. 5C, the wearable eyewear 100 can determine that the user is in a hiking state via at least one of an acceleration sensor, an altitude sensor, a position sensor, and a biometric sensor. For example, in each of the following cases, the wearable glasses 100 can determine that the user is hiking: when the altitude change measured using the altitude sensor during a certain period of time is equal to or greater than the threshold (elevation) Height change At a threshold value, and/or when the position information measured using the position sensor is "mountain", and/or the amount of sweat secretion, temperature change, and/or average pulse measured using a biometric sensor When the rate is greater than the threshold (sweat secretion > threshold, temperature change > threshold, average pulse rate > threshold).

The wearable eyewear 100 can determine that the user is in a sleep state via at least one of an iris scan sensor, an image sensor, a microphone, an acceleration sensor, and a tilt sensor. For example, in each of the following situations, the wearable glasses 100 can determine that the user is in a sleep state: the number of blinks of the user's eyes measured using the iris scan sensor is less than the number of thresholds (eg, detection) When the iris is not scanned every 10 minutes, and/or when the iris is not scanned during a certain period of time (for example, the iris is not scanned within 5 minutes). The certain period of time may be predetermined.

Additionally or alternatively, the wearable eyewear 100 can capture an image of the user's eye by using an image sensor for a certain period of time, and can detect the pupil by performing edge analysis on the image of the eye. The certain period of time may be predetermined. If the pupil is not detected from the image of the eye during a certain period of time (for example, if it is in 5 minutes or If the pupil is not detected within more than 5 minutes, the wearable glasses 100 can determine that the user is in a sleep state.

Additionally or alternatively, the wearable eyewear 100 can analyze the sound signal obtained via the microphone, and if the sound corresponding to the snore pattern is sensed, the wearable eyewear 100 can determine that the user is in a sleep state. Further, if the motion value of the head measured using the acceleration sensor or the tilt sensor is equal to or greater than the threshold value, the wearable glasses 100 may determine that the user is dozing while sitting.

Additionally or alternatively, the wearable glasses 100 may determine whether the user is in a speaking state (or is conducting a conversation) based on the sound information obtained via the microphone. For example, the wearable glasses 100 can analyze the sound information obtained via the microphone, and if the voice of the user is recognized, the wearable glasses 100 can determine that the user is speaking. Furthermore, if the sound information obtained through the microphone recognizes the voice of another person different from the voice of the user, the wearable glasses 100 can determine that the user is conducting a conversation.

The wearable glasses 100 can determine the drinking state of the user based on the odor information measured using the scent sensor. For example, the wearable glasses 100 can analyze the odor information measured using the scent sensor, and if the alcohol odor is recognized for a period of time, the wearable glasses 100 can determine that the user is drinking alcohol. The period of time can be predetermined.

The wearable glasses 100 can determine whether the user is in a driving state by using at least one of an acceleration sensor, an image sensor, and a short-range communication module. For example, when the velocity change measured using the acceleration sensor is equal to or greater than a threshold (eg, an average of 40 km/h) and/or captured from using an image sensor When the obtained image detects the steering wheel of the automobile (that is, when the steering wheel of the automobile is detected according to the angle of the eye of the user in front of the direct view), the wearable glasses 100 can determine that the user is in a driving state.

Additionally or alternatively, the wearable eyewear 100 can determine that the user is in a driving state based on information received from the car via short-range communication (eg, Bluetooth). For example, when the user touches the start button, the car recognizes the user's fingerprint and transmits the driving start information to the wearable glasses that match the fingerprint of the user having a certain fingerprint. In this case, the wearable glasses can recognize that the user starts driving based on the driving start information received from the car. The certain fingerprint may be predetermined.

According to an exemplary embodiment, the wearable glasses 100 may determine the commute status of the user based on the context information of the user. The context information can be stored in the user's personalization server or in the wearable glasses 100.

For example, the wearable glasses 100 can determine the user's commute status based on the user's schedule information or lifestyle information. If the user moves to a certain location (for example, a workplace) at 8 am on weekdays, the wearable glasses 100 can receive the user's commute time information, commute distance information, and workplace location information as context information. The certain location may be predetermined. When the current time is 8:20 am on Monday and the current location is near the subway station, the wearable glasses 100 can determine that the user is going to work.

Furthermore, if the average moving speed of the user within a period of time is 0.0001 km/h and the user is located in the office for a period of time, the wearable glasses 100 can determine that the user is working. The period of time can be predetermined.

According to an exemplary embodiment, the wearable glasses 100 may be based on use The biometric information measured by the wearable device analyzes the movement state of the user. The wearable device according to an exemplary embodiment may include a ring, a necklace, a strap, a watch, a shoe, an earring, a hair band, a garment, a glove, or a thimble, but is not limited thereto.

For example, the wearable eyewear 100 can receive pulse rate information, blood pressure information, heart rate information, body temperature information, or the like measured using the wearable device. The wearable eyewear 100 can receive biometric information from the wearable device via the mobile terminal 200 or can receive biometric information directly from the wearable device. If the average pulse rate of the user is equal to the threshold frequency or higher than the threshold frequency for a period of time, the wearable glasses 100 can determine that the user is exercising. The period of time can be predetermined.

According to an exemplary embodiment, the wearable eyewear 100 can determine that the user is at rest based on acceleration information, pressure information, and/or altitude information measured from a peripheral wearable device such as a running shoe or an insole. , walking status, running status or hiking status. For example, the pressure pattern of the insole measured when the user's moving speed is equal to or above the threshold and measured from the pressure sensor of the running shoe attached to the user is similar to that related to hiking. In the case of the pattern, the wearable glasses 100 can determine that the user is in a hiking state.

According to an exemplary embodiment, the wearable glasses 100 may determine the movement state of the user based on the mode information set by the user. For example, the user can manually set the operation mode of the wearable glasses 100 to the driving mode, the sport mode, or the commute mode. For example, if the user sets the operation mode of the wearable glasses 100 to the driving mode, the wearable glasses 100 can determine that the user is driving.

The controller 120 can determine the user's movement based on the user's movement information. Status, and the display 111 can be controlled to display the received notification message information according to the user's movement status.

According to an exemplary embodiment, the wearable eyewear 100 may request the user's mobile state information and receive the mobile state information from an external device connected to the wearable eyewear 100. The external device can be the mobile terminal 200 or the server 300. The operation of the external device to analyze the movement state of the user will be described in detail later with reference to FIG.

In operation S530, the wearable glasses 100 may determine a method of providing content (notification message information) corresponding to the notification event based on the determined movement state of the user.

According to an exemplary embodiment, the wearable glasses 100 may determine the time at which the notification content (notification message information) is provided. For example, the wearable glasses 100 can determine whether the user's moving speed is less than the threshold speed based on the user's moving state. When the user's moving speed is less than the threshold speed (for example, 3 km/h), the wearable glasses 100 may determine that the notification content is output at the current time. The current time may indicate a time period from a certain time (for example, within 30 seconds) from when the wearable glasses 100 detects the occurrence of the notification event. The certain time may be predetermined.

Meanwhile, when the moving speed of the user is equal to or greater than the threshold speed, the wearable glasses 100 may determine to output the notification content at different times. The different times can be the previously set time (for example, 10 pm). Alternatively, the different times may be a certain amount of time later than the current time (eg, within 10 minutes). Alternatively, the different times may be a certain amount of time later than the current time at which another determination regarding the state of movement of the user is made. For example, if the user is determined to be running In the state, the wearable glasses 100 can determine to wait for 10 minutes and then re-determine the user's movement state. If the state of the user's re-determination is the standing state, the wearable glasses 100 can output a notification. Furthermore, different times can indicate when an event has occurred. The certain event may be predetermined.

An event may include at least one of the following events: an event for receiving a user input requesting output of the notification content, an event of the amount of time elapsed therefrom, and an event for changing the movement state of the user, but Not limited to this.

According to an exemplary embodiment, the wearable glasses 100 may determine a method of providing content by determining a form in which the notification content is provided. The form in which the notification content is provided may include a display form for displaying the notification content. For example, the wearable eyewear 100 can determine whether the user's moving speed is less than a threshold speed (eg, 4 km/hour) based on the user's moving state. When the moving speed of the user is equal to or greater than the threshold speed, the wearable glasses 100 may determine to output a part of the notification content, and if the moving speed of the user is less than the threshold speed, the wearable glasses 100 may determine the output. The entire notification content.

A part of the content may include at least one of the following: a keyword of the content, an overview information of the content, and a title of the content, but is not limited thereto.

According to an exemplary embodiment, the wearable glasses 100 may provide the notification content in the form of at least one of an audio signal and a video signal based on the movement state of the user. For example, when the user is in a speaking state (for example, talking with another person), the wearable glasses 100 may determine that the notification content is output in the form of a video signal, and if the user is in a driving state, the wearable glasses 100 may It is determined that the notification content is output in the form of an audio signal.

Hereinafter, an operation of the wearable glasses 100 to provide notification content based on whether the user is wearing the wearable glasses 100 will be described in detail with reference to FIG.

6 illustrates a flow diagram of a method for wearable glasses to provide content corresponding to a notification event based on whether a user is wearing wearable glasses, in accordance with an illustrative embodiment.

In operation S610, the wearable glasses 100 can detect the occurrence of a notification event. Operation S610 corresponds to operation S510 of FIG. 5, and thus detailed description thereof will be omitted.

In operation S620, the wearable glasses 100 may determine whether the user is wearing the wearable glasses 100.

According to an exemplary embodiment, the wearable eyewear 100 can be used by using a sensor included in the wearable eyewear 100 (eg, a temperature sensor, a pressure sensor, an illuminance sensor, a proximity sensor) At least one of an iris scan sensor and a pressure sensor or the like determines whether the user is wearing the wearable glasses 100. For example, when the value of the temperature sensor attached to the nasal pad or temple of the glasses or the value of the pressure sensor is equal to or greater than the threshold, the wearable glasses 100 may determine that the user is wearing Wearable glasses 100. Alternatively, the wearable eyewear 100 can scan the user's iris. When the wearable eyewear 100 successfully scans the user's iris by using the iris scan sensor, the wearable eyewear 100 can determine that the user is wearing the wearable eyewear 100.

Alternatively, when the tilt value measured using the tilt sensor is continuously changed, the wearable glasses 100 may determine that the user is wearing the wearable glasses 100.

Alternatively, when the speaker and microphone are included inside the temple of the glasses, The wearable glasses 100 can output a sound signal via a speaker and obtain a reflected echo signal via a microphone. The wearable glasses 100 can determine whether the user is wearing the wearable glasses 100 based on information about the echo signals.

According to an exemplary embodiment, the wearable glasses 100 may combine segments of information measured by a plurality of sensors to further accurately determine whether the user is wearing the wearable glasses 100.

When it is determined that the user is wearing the wearable glasses 100 (S620, YES), in operation S630, the wearable glasses 100 can obtain the movement information of the user, and determine the movement state of the user based on the movement information. In operation S640, the wearable glasses 100 may determine a method of providing notification content based on the determined movement state of the user. Operations S630 and S640 correspond to operations S520 and S530 of FIG. 5, respectively, and thus detailed description thereof will be omitted.

On the other hand, when it is determined that the user is not wearing the wearable glasses 100 (S620, NO), the processing procedure ends, and the wearable glasses 100 do not provide the notification content even if the notification event is sensed.

FIG. 7 illustrates a flow diagram of a method for wearable glasses to detect the occurrence of a notification event, in accordance with an illustrative embodiment.

In operation S710, the external device 700 may generate a notification message. The notification message may be an advertisement message intended to be advertised to an unspecified number of individuals, or a message only to the user of the wearable glasses 100. Moreover, according to an exemplary embodiment, the notification message may be a message related to the application. The application can be scheduled.

The external device 700 may be at least one of a server 300 connected to the wearable glasses 100 and a mobile terminal connected to the wearable glasses 100 The machine 200, a wearable device connected to the wearable eyewear 100, and a device of another person. However, the external device 700 is not limited thereto, and may be any device that generates a notification message outside the wearable glasses 100.

In operation S720, the external device 700 may transmit the generated notification message to the wearable glasses 100. The external device 700 can transmit the generated notification message to the wearable glasses 100 via at least one of short-range communication, wireless communication, and mobile communication.

In operation S730, when the wearable glasses 100 receive the notification message, the wearable glasses 100 may determine whether to block the notification message. For example, the user of the wearable glasses 100 can block the reception of the push message related to the application by using the wearable glasses 100 or the mobile terminal 200, or can block the text received from a certain user. message. The application can be predetermined and a certain user can be predetermined.

When the wearable glasses 100 determine that the notification message is not blocked (S730, NO), the wearable glasses 100 may detect the occurrence of the notification event in operation S740. On the other hand, when the wearable glasses 100 determine that the notification message should be blocked (S730, YES), the processing routine ends.

According to an exemplary embodiment, operation S730 may be omitted. For example, when receiving a notification message from the external device 700, the wearable glasses 100 may determine that a notification event has occurred.

FIG. 8 illustrates an example of sensing the occurrence of a notification event by a wearable glasses receiving a notification message by a wearable glasses, according to an exemplary embodiment.

Referring to FIG. 8, the wearable glasses 100 can be provided from the news server 800. A push message 810 is received. For example, the wearable glasses 100 can receive a push message 810 containing the interstitial news from the news provider server 800. For example, the news can be "Sochi Olympics, Yuna Kim, Silver Medal!".

In this case, the wearable glasses 100 can sense that the content of the news has been displayed for display (for example, "Sochi Olympics, Yuna Kim, Silver Medal!"). Notification event.

According to an exemplary embodiment, wearable glasses 100 receive push message 810 directly from news feed server 800. Moreover, the wearable glasses 100 can receive the push message 810 from the host device (eg, the mobile terminal 200) when the host device is within the short range communication radius. The push message can then be displayed 820 by the wearable glasses 100 in accordance with one of the processing procedures discussed above.

FIG. 9 illustrates an example of sensing the occurrence of a notification event by a wearable glasses by receiving a schedule notification message from a mobile terminal, according to another exemplary embodiment.

Referring to FIG. 9, the user's schedule information 910 can be stored in the mobile terminal 200 connected to the wearable glasses 100. For example, the user can register the schedule information 910 by using the mobile terminal 200. Alternatively, the user may register the schedule information 910 using the computer and transmit or otherwise upload the schedule information 910 to the mobile terminal 200. The user can set the mobile terminal 200 so that the schedule notification message of "notifying medical treatment at 7 pm" is output by the wearable glasses 100.

When the time is 7 pm, the mobile terminal 200 can transmit a schedule notification message notifying the medication to the wearable glasses 100. The schedule notification message may include a command to display the schedule notification content 920.

According to an exemplary embodiment, the mobile terminal 200 can transmit a schedule notification message to the wearable glasses 100 via short-range communication (eg, Bluetooth, WFD, or NFC).

In this case, the wearable glasses 100 can sense that a notification event for displaying the schedule notification content 920 (eg, "taking time") has occurred.

FIG. 10 illustrates an example of sensing the occurrence of a notification event by receiving a text message via a mobile terminal by a wearable headset, in accordance with another exemplary embodiment.

Referring to FIG. 10, the mobile terminal 200 can receive the text message 1010 from the server 300. The server 300 can be, for example, a message server or a mobile communication server, but is not limited thereto.

Upon receiving the text message 1010, the mobile terminal 200 can determine whether the user is wearing the wearable glasses 100.

According to an exemplary embodiment, the mobile terminal 200 may request at least one of the following for the wearable glasses 100: temperature information, pressure information, iris scan information, and tilt information, or other information available for making a determination. . The mobile terminal 200 can receive at least one of the following from the wearable glasses 100: temperature information, pressure information, iris scan information, and tilt information or other information. The mobile terminal 200 can determine whether the user is wearing the wearable glasses 100 based on at least one of temperature information, pressure information, iris scan information, and tilt information or other information. For example, the mobile terminal 200 can analyze the temperature information received from the wearable glasses 100 and if the temperature measured using the wearable glasses 100 is similar to the body temperature (eg, 36.5 ° C), the mobile terminal 200 can determine the use. The wearable glasses 100 are being worn.

According to an exemplary embodiment, the mobile terminal 200 may request location information from the wearable glasses 100 and receive location information. The mobile terminal 200 can additionally determine whether the user is wearing the wearable glasses 100 based on the result of comparing the location information of the mobile terminal 200 with the location information of the wearable glasses 100. In the example discussed above, when the temperature is similar to body temperature and when the position difference between the mobile terminal 200 and the wearable glasses 100 is within the threshold, the mobile terminal 200 can determine that the action is being carried. The user of the terminal 200 is also wearing the wearable glasses 100.

Alternatively, according to an exemplary embodiment, when the wearable glasses 100 are discovered via short-range communication (eg, Bluetooth, WFD, etc.) and using another requested information, the mobile terminal 200 may determine that the user is wearing wearable Glasses 100.

According to an exemplary embodiment, when the user is wearing the wearable glasses 100, the mobile terminal 200 may transmit a command for outputting the text message 1010 received from the server 300 to the wearable glasses 100, and may A notification message 1020 notifying the arrival of the text message 1010 is displayed on the display 1030.

In this case, the wearable glasses 100 can sense a notification event in which a notification message 1020 for displaying the arrival of the notification text message 1010 (for example, "You have a text message.") has occurred.

FIG. 11 illustrates an example of sensing the occurrence of a notification event by receiving an advertisement content by wearable glasses, according to another exemplary embodiment.

According to an exemplary embodiment, wearable glasses 100 may receive advertising content from a kiosk 1100 via short-range communication. For example, when the wearable glasses 100 are located within the short-range communication radius of the kiosk 1100, the wearable glasses 100 can receive an action coupon broadcast from the kiosk 1100.

According to an exemplary embodiment, the wearable glasses 100 may receive advertising content (eg, action coupons) from the kiosk 1100 via the mobile terminal 200. According to another exemplary embodiment, wearable glasses 100 may receive advertising coupons (eg, action coupons) directly from the Query Machine 1100.

The wearable glasses 100 can sense that a notification event for displaying the advertising content 1110 received from the query machine 1100 has occurred.

Hereinafter, an operation of the wearable glasses 100 to obtain the user's movement information will be described in detail.

12 illustrates a flow chart of a method for obtaining wearable glasses for a user's mobile information, in accordance with an illustrative embodiment.

In operation S1210, the wearable glasses 100 can detect the occurrence of a notification event.

Operation S1210 corresponds to operation S510 of FIG. 5A, and thus detailed description thereof will be omitted.

In operation S1220, the wearable glasses 100 may measure at least one of acceleration information, tilt information, and position information by using at least one sensor.

According to an exemplary embodiment, when the wearable eyewear 100 detects the occurrence of a notification event, the wearable eyewear 100 can activate at least one sensor in an inactive state. The wearable eyewear 100 can measure at least one of acceleration information, tilt information, and location information by using at least one activated sensor.

For example, the wearable glasses 100 can measure the moving speed of the wearable glasses 100 by using an acceleration sensor. Alternatively or additionally, the wearable glasses 100 may measure the tilt of the wearable glasses 100 by using a tilt sensor. Chemical. In this case, the wearable glasses 100 can determine whether the user wearing the wearable glasses 100 is moving and the amount of movement of the user based on the change in the inclination of the wearable glasses 100.

Alternatively or additionally, the wearable eyewear 100 can obtain location information of a user wearing the wearable eyewear 100 by using a position sensor. Examples of the position sensor may include, but are not limited to, a global positioning system (GPS) module or a Wi-Fi module.

For example, the wearable glasses 100 can obtain the location information of the user wearing the wearable glasses 100 by using a GPS or Wi-Fi positioning system (WPS). The GPS is a satellite navigation system whereby the current position of the user is calculated by receiving signals transmitted from the satellite. WPS is a technique in which a terminal receives parameters (eg, MAC address, signal strength, etc.) of an RF signal transmitted from a Wi-Fi access point (AP), and the terminal is based on the received The parameter calculates the location of the user.

In operation S1230, the wearable glasses 100 may obtain the movement information of the user based on at least one of the acceleration information, the tilt information, and the position information, and determine the movement state of the user based on the movement information. That is, the wearable glasses 100 can determine the movement state of the user based on at least one of acceleration information, tilt information, and position information.

For example, when the user moves at an average speed of 4 km/hour over a period of time, the wearable glasses 100 can determine that the user is in a walking state of walking. Alternatively, when the user moves at an average speed of 20 km/hour over a period of time, the wearable glasses 100 can determine that the user is in a moving state of riding a bicycle.

Alternatively, when the average moving speed of the user during a period of time is 0.0001 km/h, and the user is in the office for a period of time, the wearable glasses 100 can determine that the user is in a moving state of work.

According to an exemplary embodiment, the wearable glasses 100 can obtain the user's movement information by using the image sensor 161. For example, the wearable glasses 100 can determine whether the user is in a moving state or in a resting state based on a change in an image obtained by using the image sensor 161.

In operation S1240, the wearable glasses 100 may determine a method of providing notification content based on the determined movement state of the user. According to an exemplary embodiment, the wearable glasses 100 may determine the time at which the notification content is provided based on the movement state of the user and provide a form of the notification content. Operation S1240 corresponds to operation S530 of FIG. 5, and thus detailed description thereof will be omitted.

In operation S1250, the wearable glasses 100 may provide notification content.

According to an exemplary embodiment, the wearable glasses 100 may provide the notification content in accordance with the timing of providing the notification content based on the user's movement state determination and/or providing the notification content. In the present specification, providing the notification content may include displaying the notification content, outputting the notification content, re-executing the notification content, and/or transmitting the notification content to an external device.

For example, the wearable glasses 100 may provide notification content at a current time or at a point in time when an event has occurred based on the user's movement state. The certain event may be predetermined. Furthermore, the wearable glasses 100 can output the entire notification content or notify a part of the content based on the determined movement state of the user.

The wearable glasses 100 can be wearable based on the user's movement state. The display 111 of the spectacles 100 or the user inputs or provides notification content via an external wearable device.

FIG. 13 illustrates a flow diagram of a method for a wearable eyeglass to obtain a user's movement state from an external device, in accordance with an illustrative embodiment.

In operation S1310, the wearable glasses 100 can detect the occurrence of a notification event. Operation S1310 corresponds to operation S510 of FIG. 5A, and thus detailed description thereof will be omitted.

In operation S1320, the wearable glasses 100 may request the user's mobile information from the external device 1300. The external device 1300 may be the mobile terminal 200 or the server 300, but is not limited thereto.

According to an exemplary embodiment, the wearable glasses 100 may initiate a communication interface when a notification event is detected. The wearable glasses 100 can request the user's mobile information from the external device 1300. According to an exemplary embodiment, the wearable glasses 100 may transmit acceleration information, tilt information, and position information measured using the wearable glasses 100 to the external device 1300.

In operation S1330, the external device 1300 may obtain at least one of the following: acceleration information of the wearable glasses 100, position information of the wearable glasses 100, and biometrics of the user wearing the wearable glasses 100. News.

According to an exemplary embodiment, the external device 1300 may receive acceleration information measured using the wearable glasses 100, position information of the wearable glasses 100, or the like from the wearable glasses 100. The external device 1300 can also receive acceleration information or location information measured by a wearable device (eg, a smart watch, a wig, a shoe, etc.) or the like.

Moreover, when the external device 1300 is the mobile terminal 200 of the user wearing the wearable glasses 100, the external device 1300 can directly measure the acceleration and/or position of the wearable glasses 100 by using the sensor.

According to an exemplary embodiment, the external device 1300 may collect biometric information from at least one wearable device connected to the external device 1300. For example, the external device 1300 can receive pulse rate information, blood pressure information, heart rate information, body temperature measured by a wearable device (eg, a smart watch, earrings, rings, necklaces, glasses, shoes, clothes, etc.) Information, sweat secretion information, respiratory rate information or the like.

In operation S1340, the external device 1300 may analyze the movement state of the user based on at least one of acceleration information, location information, and biometric information. That is, the external device 1300 can determine the movement state of the user based on at least one of the acceleration information, the position information, and the biometric information.

For example, when the average pulse rate, average breathing rate, amount of sweat secretion, and body temperature of the user increase over a period of time, the external device 1300 can determine that the user is exercising. The period of time can be predetermined. Alternatively, when the user stays home for a period of time and the biometric information of the user changes very little, the external device 1300 can determine that the user is in a moving state at home. When the user moves at an average speed of 4 km/h in the park, the external device 1300 can determine that the user is in a moving state of walking in the park.

In operation S1350, the external device 1300 may transmit the movement state of the user to the wearable glasses 100. The external device 1300 can transmit the mobile state of the user to at least one of short-range communication, mobile communication, and wireless communication. Wearable glasses 100. For example, the external device 1300 can transmit the user's mobile status information, moving speed information, and location information to the wearable glasses 100. In this case, in operation S1360, the wearable glasses 100 can obtain the movement state of the user from the external device 1300.

In operation S1370, the wearable glasses 100 may determine a method of providing notification content based on a movement state of the user. For example, the wearable glasses 100 may determine the time at which the notification content is provided and the form in which the notification content is provided.

In operation S1380, the wearable glasses 100 may provide notification content. For example, when the user is in a moving state of walking, the wearable glasses 100 may output a part of the notification content, and when the user is in a moving state at home, the wearable glasses 100 may output the entire notification content.

Operations S1370 and S1380 correspond to operations S1240 and S1250 of Fig. 12, respectively, and thus detailed description thereof will be omitted.

Hereinafter, an operation of the wearable glasses 100 determining the time at which the notification content is provided based on the movement state of the user will be described in detail with reference to FIG.

14 illustrates a flow chart of a method for wearable glasses to determine a time to output content corresponding to a notification event based on a user's moving speed, in accordance with an exemplary embodiment.

In operation S1410, the wearable glasses 100 can detect the occurrence of a notification event.

In operation S1420, when the occurrence of the notification event is detected, the wearable glasses 100 can obtain the user's movement information.

In operation S1430, the wearable glasses 100 may be based on the user's The obtained movement information determines whether the user's moving speed is less than the threshold speed. The threshold speed can be preset by the user or the system. The threshold speed can be determined, for example, based on the average moving speed of the user.

For example, the wearable glasses 100 can determine whether the user's moving speed is 4 km/h (the value is the average walking speed).

When the moving speed of the user is less than the threshold speed (S1430, YES), in operation S1440, the wearable glasses 100 may determine to output the notification content.

For example, when the user's moving speed is less than 4 km/hour (the value is the average walking speed), the wearable glasses 100 may determine that the notification content is output at the current time. The current time may be within a threshold period from the point in time when the wearable glasses 100 detects the occurrence of the notification event (eg, within 30 seconds). The threshold time period can be predetermined.

In operation S1450, the wearable glasses 100 may output the notification content at the current time. For example, when the notification content is video content or audio content, the wearable glasses 100 can re-execute the notification content at the current time. When the notification content is still image content or text content, the wearable glasses 100 can display the notification content at the current time.

On the other hand, when the moving speed is greater than or equal to the threshold speed (S1430, NO), the wearable glasses 100 may determine to output the notification content at different times in operation S1460. Different times may be preset and may, for example, be later.

Different times may indicate the previously set time (eg, 10 pm). Alternatively, different times may indicate when an event has occurred. The event Can be scheduled. An event may include at least one of the following events: receiving an event input by a user requesting to output a notification content, an event that has passed the preset time, and an event for changing a movement state of the user, but is not limited thereto this.

For example, the wearable glasses 100 may determine that the time point when the notification content is output is the time point when the input of the request notification output content is received. The input can be predetermined. Furthermore, the wearable glasses 100 can determine that the time point when the notification content is output is the time point when the user's moving speed becomes less than the threshold speed.

In operation S1470, the wearable glasses 100 may not output the notification content at the current time. Alternatively or additionally, the wearable glasses 100 may display an indicator indicating that a notification event has occurred.

According to an exemplary embodiment, when the user wearing the wearable glasses 100 moves at a threshold speed or greater than a threshold speed, the wearable glasses 100 may not display the notification content and/or the displayable indication has occurred. A simple indicator of the notification event so as not to block the user's field of view or distract the user. The operation of the wearable glasses 100 to determine the time at which the notification content is provided based on the movement state of the user will be described in more detail with reference to FIGS. 15A and 15B.

15A and 15B illustrate diagrams for describing an example of a time and method of outputting content corresponding to a notification event based on a user's moving speed adjustment by the wearable glasses, according to an exemplary embodiment.

Referring to FIG. 15A, when the user 1510 is passing through the pedestrian crossing, the wearable glasses 100 can receive a push message containing the news content from the server 300. In this case, the wearable glasses 100 can sense that the news content has been generated for display (for example, "Sochi Olympics, Yuna Kim," Silver Medal! Notification event.

According to an exemplary embodiment, the wearable glasses 100 may obtain the movement information of the user 1510 before displaying the news content, and determine whether the movement speed of the user 1510 is less than a threshold speed (eg, 2 km/hour). For example, when the user 1510 is passing through the pedestrian crossing, the user 1510 can move at a speed of 3 kilometers per hour. In this case, when the moving speed of the user 1510 (for example, 3 km/hour) is equal to or greater than the threshold speed (2 km/hour), the wearable glasses 100 may determine that the news content is not output at the current time. The wearable glasses 100 can display a simple indicator 1511 indicating the occurrence of a notification event.

According to an exemplary embodiment, when the user 1510 is passing through the pedestrian crossing, the wearable glasses 100 may determine not to display the news content, but may instead display the indicator 1511, thereby viewing the field of view of the user 1510. Blocking is minimized.

Referring to FIG. 15B, when the user 1520 wearing the wearable glasses 100 sits and rests at home, the wearable glasses 100 can receive a push message containing the news content from the server 300. In this case, the wearable glasses 100 can sense that a notification event for displaying the news content 1521 has occurred.

According to an exemplary embodiment, the wearable glasses 100 may obtain the movement information of the user 1520 before displaying the news content 1521, and determine whether the moving speed of the user 1520 is less than a threshold speed (eg, 2 km/hour). For example, when the user 1520 is at home, the user 1520 can move at a speed of about 0 km/hour. In this case, when the moving speed of the user 1520 (for example, 0 km/hour) is less than the threshold speed (2 km/h), the wearable glasses 100 may determine that the news content 1521 is output at the current time.

The wearable glasses 100 can display news content 1521 in the form of AR, MR or VR (for example, "Sochi Olympics", Silver Medal (Yuna Kim)! Fancy skater Kim Jong-il in Sochi The Winter Olympics won a valuable silver medal! (Figure skater Yuna Kim has won a valuable silver medal at the Sochi Olympics!)"). In this case, the user 1520 can safely check the news content 1521 via the wearable glasses 100 even if the field of view of the user 1520 may be blocked.

Hereinafter, the operation of the wearable glasses 100 to determine the output form of the notification content based on the movement information of the user will be described in detail with reference to FIG.

16 illustrates a flow chart of a method of determining an output form of content corresponding to a notification event based on user's movement information, in accordance with an exemplary embodiment.

In operation S1610, the wearable glasses 100 can detect the occurrence of a notification event. In operation S1620, the wearable glasses 100 can obtain the user's movement information. Operations S1610 and S1620 correspond to operations S1410 and S1420 of Fig. 14, respectively, and thus detailed description thereof will be omitted.

In operation S1630, the wearable glasses 100 may determine whether the moving speed of the user is less than the first threshold speed. The first threshold speed may be a reference speed used to determine whether to output content. The first threshold speed can be preset by the user or by the system.

For example, when the first threshold speed is 10 km/hour, the wearable glasses 100 can determine whether the user's moving speed is less than 10 km/hour based on the user's movement information.

When the user's moving speed is equal to or greater than the first threshold speed (S1630, No), in operation S1640, the wearable glasses 100 may not output the notification content at the current time. For example, when the user wearing the wearable glasses 100 is riding a motorcycle, the user's moving speed may be equal to or greater than the first threshold speed. The wearable glasses 100 may not output a notification content so as not to block the user's field of view.

On the other hand, when the moving speed of the user is less than the first threshold speed (S1630, YES), in operation S1650, the wearable glasses 100 can determine whether the moving speed of the user is between the first threshold speed. Between the second threshold speed. The second threshold speed may be a reference speed for determining whether to output the entire notification content or a portion of the notification content. The second threshold speed can be preset by the user or the system. Still further, according to an exemplary embodiment, the first threshold speed and the second threshold speed may be determined based on a normal moving speed of the user.

According to an exemplary embodiment, when the first threshold speed is 10 km/hour and the second threshold speed is 2 km/hour, the wearable glasses 100 may determine the user's based on the user's movement information. Whether the moving speed is between 10 km/h and 2 km/h.

When the moving speed of the user is between the first threshold speed and the second threshold speed (S1650, YES), the wearable glasses 100 may output a part of the notification content in operation S1660. A part of the notification content may include at least one of the following: a keyword for notifying the content, an overview information, and a title, but is not limited thereto.

For example, when the moving speed of the user is between the first threshold speed and the second threshold speed, the wearable glasses 100 can use the element for notifying the content. The data extracts at least one of a keyword, an overview information, and a title of the notification content. Next, the wearable glasses 100 can provide at least one of a keyword, an overview information, and a title of the notification content.

On the other hand, when the moving speed of the user is not between the first threshold speed and the second threshold speed (S1650, No), when the user's moving speed is less than the second threshold speed, In operation S1670, the wearable glasses 100 may output the entire notification content.

For example, when the user wearing the wearable glasses 100 is reading at home, the user's moving speed may be less than the second threshold speed. In this case, the wearable glasses 100 can output the entire notification content.

Hereinafter, an example in which the wearable glasses 100 determines the output form of the notification content based on the user's movement information will be described in detail with reference to FIGS. 17 to 19.

17 to 19 illustrate diagrams for describing an example of providing a portion or the entire content of content corresponding to a notification event based on a user's moving speed by the wearable glasses, according to an exemplary embodiment.

An example of riding a bicycle by a user wearing the wearable glasses 100 will be described with reference to FIG.

In operation S1710, the wearable glasses 100 may receive a push message including the news content 1000 from the server 300.

In operation S1720, the wearable glasses 100 may determine whether the user's moving speed is greater than the first threshold speed (eg, 15 km/hour) based on the user's movement information. When the user rides a bicycle, the average moving speed of the user can be 18 km/h.

When the user's moving speed (18 km/h) is greater than the first threshold speed (for example, 15 km/h), the wearable glasses 100 may determine not to output (1700) the news content 1000 in operation S1730.

Regarding FIG. 18, an example in which a user wearing the wearable glasses 100 is walking with a dog will be described.

In operation S1810, the wearable glasses 100 may receive a push message including the news content 1000 from the server 300.

In operation S1820, the wearable glasses 100 may determine whether the user's moving speed is between the first threshold speed (eg, 15 km/hour) and the second threshold speed based on the user's movement information (eg, Between 2 km / h). When the user walks, the average moving speed of the user can be 2.5 km / hour.

In operation S1830, when the user's moving speed (2.5 km/h) is between the first threshold speed (for example, 15 km/h) and the second threshold speed (for example, 2 km/h) At that time, the wearable glasses 100 may determine to output a portion of the news content 1000. For example, the wearable glasses 100 may extract a title 1800 from the news content 1000 (eg, "Yuna Kim, Silver Medal!"), and provide the title 1800 in the form of an AR.

Regarding FIG. 19, an example in which a user wearing the wearable glasses 100 works in an office will be described.

In operation S1910, the wearable glasses 100 may receive a push message including the news content 1000 from the server 300.

In operation S1920, the wearable glasses 100 may determine whether the moving speed of the user is less than the second threshold speed based on the movement information of the user (eg, 2 Km/h). When the user sits at the table in the office, the user can move at a speed of 0 km/h.

In operation S1930, when the user's moving speed (0 km/h) is less than the second threshold speed (for example, 2 km/h), the wearable glasses 100 may determine to output the entire news content 1000. For example, the wearable glasses 100 can provide the entire news article 1900 included in the news content 1000 in the form of an AR.

20 illustrates a flow diagram of a method for wearable glasses to output non-output content when an event has occurred, in accordance with an illustrative embodiment.

In operation S2010, the wearable glasses 100 can detect the occurrence of a notification event.

When the occurrence of the notification event is detected, the wearable glasses 100 can obtain the user's movement information in operation S2020.

In operation S2030, the wearable glasses 100 may determine whether the moving speed of the user is less than the threshold speed based on the movement information of the user. For example, the wearable glasses 100 can determine whether the user's moving speed is less than 4 km/h (the value is the average walking speed).

When the moving speed of the user is equal to or greater than the threshold speed (S2030, No), the wearable glasses 100 may not output the notification content or may output a part of the notification content. Here, according to an exemplary embodiment, when the moving speed of the user is equal to or greater than the threshold speed, the wearable glasses 100 may determine that the notification content is output at a time point when an event has occurred. The certain event may be predetermined.

An event may include at least one of the following events: receiving an event input by a user requesting to output a notification content, an event that has passed the preset time, and An event for changing the movement state of the user, but is not limited thereto. For example, the wearable glasses 100 may determine that the time point when the user's moving speed becomes less than the threshold speed is the time at which the notification content is output.

In operation S2050, the wearable glasses 100 may store the non-output notification content or the notification content of the portion included in the list of the non-output notification content.

In operation S2060, the wearable glasses 100 may determine whether an event has occurred. When a certain event has not occurred (S2060, NO), the wearable glasses 100 may continuously output the notification content.

On the other hand, when a certain event has occurred (S2060, YES), in operation S2070, the wearable glasses 100 can output the entire notification content. For example, when an event for changing the movement state of the user occurs, the wearable glasses 100 may output the entire notification content that has not been output or may output the remaining portion of the outputted portion.

When the notification content is video content or audio content, the wearable glasses 100 may re-execute the notification content. When the notification content is still image content or text content, the wearable glasses 100 can display the notification content at the current time.

Hereinafter, an operation in which the wearable glasses 100 outputs non-output content when a certain event has occurred will be described in detail with reference to FIG.

FIG. 21 illustrates an example of outputting content corresponding to a previously occurring notification event based on a user's movement change event by the wearable glasses.

Referring to 2110 of FIG. 21, when the user wearing the wearable glasses 100 rides a bicycle, the wearable glasses 100 can receive a push message containing the news content 2121 from the server 300. In this case, the wearable glasses 100 can detect that A notification event for displaying the news content 2121 occurs.

The wearable glasses 100 can determine whether the user's moving speed is greater than a threshold speed (for example, 15 km/hour) based on the user's movement information. The user is riding a bicycle, and thus the average moving speed of the user can be 18 km/h.

When the user's moving speed (18 km/h) is greater than the threshold speed (for example, 15 km/h), the wearable glasses 100 may not output the news content 2121 (2111) at the current time, and may determine that it is occurring. The news content 2121 is output at an event. The certain event may be a time point when the user's moving speed becomes 2 km/hour or less than 2 km/hour.

Referring to 2120 of FIG. 21, when the user wearing the wearable glasses 100 stops riding the bicycle, the wearable glasses 100 can detect that the movement speed has changed to 2 km/hour or less than 2 km/hour. event.

The wearable glasses 100 can provide news content 2121 that has not been outputted when an event is sensed. For example, the wearable glasses 100 can display the news content 2121 in the form of an AR.

According to an exemplary embodiment, when the user's moving speed becomes a certain level or less than a certain level, the wearable glasses 100 provide notification content, thereby preventing the user from being exposed to a dangerous situation.

FIG. 22 illustrates a diagram for describing a method for changing an output form of content based on a certain input of a user for use by the wearable glasses according to an exemplary embodiment.

In operation S2210, the wearable glasses 100 can detect the occurrence of a notification event.

In operation S2220, when the occurrence of the notification event is detected, the wearable glasses 100 can obtain the user's movement information.

In operation S2230, the wearable glasses 100 may output a notification portion of the content based on the user's movement information. For example, when it is determined that the user is walking along the street, the wearable glasses 100 may output a portion of the notification content.

In operation S2240, the wearable glasses 100 may determine whether a first user input for requesting output of the entire notification content is received.

According to an exemplary embodiment, an instance of a first user input for requesting output of the entire content may vary. For example, the first user input may be at least one of: motion input, touch input, key input, voice input, and multiple input, but is not limited thereto.

According to an exemplary embodiment, the first user input for requesting output of the entire notification content may be preset. For example, the heads up motion can be set to a first user input for requesting output of the entire content.

When receiving the first user input for requesting output of the entire notification content (S2240, YES), in operation S2250, the wearable glasses 100 may output the entire notification content in response to the first user input. For example, when the notification content is video content or audio content, the wearable glasses 100 may re-execute the entire notification content. When the notification content is still image content or text content, the wearable glasses 100 may display the entire notification content in an AR form.

On the other hand, when the first user input for requesting output of the entire notification content is not received (S2240, NO), in operation S2260, the wearable glasses 100 may determine whether or not the content for requesting to block the notification is received. Part of the output Second user input.

According to an exemplary embodiment, an instance of a second user input for requesting to block partial output of the notification content may vary. For example, the second user input may be at least one of: motion input, touch input, key input, voice input, and multiple input, but is not limited thereto.

According to an exemplary embodiment, the second user input for requesting to block partial output of the notification content may be preset. For example, the user can set the shaking motion that causes the head to swing to the left and right as a second user input for requesting to block partial output of the notification content.

When receiving the second user input for requesting the output of blocking the portion of the notification content (S2260, YES), in operation S2270, the wearable glasses 100 may block the partial output of the notification content according to the second user input. In this manual, "Block Output" can indicate the end output condition. For example, when the wearable glasses 100 block the output of the notification content, the notification content displayed in front of the user's eyes may disappear or may no longer output a sound signal.

On the other hand, when the second user input for requesting the blocking of the output of the part of the notification content is not received (S2260, NO), the wearable glasses 100 may wait for a certain amount of time to pass in operation S2280. When no additional user input is received after a certain period of time has elapsed, the wearable glasses 100 may block the output of the portion of the notification content in operation S2270. For example, when a first user input requesting output of the entire notification content is not received after outputting a portion of the notification content, the wearable glasses 100 may no longer output a portion of the notification content. That is, the user may decide to accept the output of the entire content, or alternatively, the user may decide The output of the portion of the notification is quickly blocked or no action is taken (in the case, the output of the portion of the notification is blocked after a certain period of time has elapsed).

Hereinafter, an example of an output form in which the content is modified by the wearable glasses 100 based on a certain input of the user will be described with reference to FIGS. 23 and 24.

23 and 24 illustrate diagrams for describing an example in which the entire content is output based on the head-up motion of the user by the wearable glasses. With respect to FIGS. 23 and 24, an example of a user input for requesting output of the entire content as a head-up motion will be described.

Referring to 2310 of FIG. 23, when a user wearing the wearable glasses 100 is crossing a pedestrian crossing, the wearable glasses 100 can receive a push message containing the news content from the server 300. In this case, the wearable glasses 100 can detect that a notification event for displaying the news content has occurred.

According to an exemplary embodiment, the wearable glasses 100 may obtain the user's mobile information prior to displaying the news content. For example, the wearable eyewear 100 can determine that the user is moving at a speed of 3 kilometers per hour, as previously discussed.

When the user moves, the wearable glasses 100 can output the portion 2311 of the news content so as not to block the user's field of view. For example, the wearable glasses 100 can extract a title from the news content and output the extracted title. In this case, the user can check the title of the news content as it passes through the pedestrian crossing.

According to an exemplary embodiment, after checking the title of the news content, in order to view the entire news content 2321, the user may stop and look up at the sky after completely crossing the pedestrian crossing.

In this case, the wearable glasses 100 can sense the user's head-up motion 2300 when outputting a portion 2311 (eg, a title) of the news content. For example In other words, the wearable eyewear 100 can sense the user's head-up motion 2300 via a tilt sensor, an acceleration sensor, a gyroscope sensor, or the like as previously described.

Referring to 2320 of FIG. 23, the wearable glasses 100 can output the entire news content 2321 according to the user's head-up motion 2300. In this case, the user can safely check the entire news content 2321.

According to another exemplary embodiment, in order to prevent output of the entire news content 2321 regardless of the user's intention, the wearable glasses 100 may output the entire news content 2321 only when the time period of the head-up motion 2300 is equal to or greater than the threshold time. For example, when the user's head-up motion 2300 is sensed, the wearable eyewear 100 can measure the time period of the head-up motion 2300. When the time period of the head-up motion 2300 is equal to or greater than the threshold time (for example, two seconds), the wearable glasses 100 may output the entire news content 2321. That is, to prevent unintentional output of the entire content, for example, when the user is looking up at an airplane or bird in the sky, the wearable eyewear 100 can check to ensure that the head-up motion 2400 is a given motion for viewing the entire content.

Referring to 2410 of FIG. 24, when a user wearing the wearable glasses 100 is crossing a pedestrian crossing, the wearable glasses 100 can receive a push message containing the advertisement content. In this case, the wearable glasses 100 can sense that a notification event for displaying the advertisement content has occurred.

According to an exemplary embodiment, the wearable glasses 100 may obtain the user's mobile information prior to displaying the advertising content. For example, the wearable eyewear 100 can determine that the user is moving at a speed of 3 kilometers per hour.

When the user moves, the wearable glasses 100 can output a portion of the advertisement content in order not to block the user's field of view in a large amount. For example, wearable The glasses 100 can display a thumbnail image 2411 of the advertisement content. In this case, the user can determine that the advertisement content is received while crossing the pedestrian crossing.

According to an exemplary embodiment, the user may stop after completely crossing the pedestrian crossing and look up at the sky after reviewing the thumbnail 2411 of the advertising content to view the entire advertising content 2421. In this case, the wearable glasses 100 can sense the heads up motion 2400 when outputting a portion of the advertising content (eg, the thumbnail image 2411). For example, wearable eyewear 100 can sense heading motion 2400 by using a tilt sensor, an acceleration sensor, a gyroscope sensor, or the like.

Referring to 2420 of FIG. 24, the wearable eyewear 100 can output the entire advertising content 2421 based on the user's head-up motion 2400. In this case, the user can check the entire advertisement content 2421 under security conditions.

According to another exemplary embodiment, in order to prevent output of the entire advertisement content 2421 regardless of the user's intention, the wearable glasses 100 may only be when the time period of the head-up motion 2400 is equal to or greater than the threshold time (eg, three seconds) The entire advertisement content 2421 is output. That is, to prevent unintentional output of the entire content, for example, when the user is looking up at an airplane or bird in the sky, the wearable eyewear 100 can check to ensure that the head-up motion 2400 is a given motion for viewing the entire content.

FIG. 25 illustrates a diagram for describing an example of blocking output of content based on user input by a wearable glasses that have outputted a portion of the content. With regard to FIG. 25, an example of a user input for requesting prevention of output of content as a shaking motion will be described.

Referring to 2510 of FIG. 25, the wearable glasses 100 can receive the package from the server 300 when the user wearing the wearable glasses 100 is passing through the pedestrian crossing. Push messages with news content. In this case, the wearable glasses 100 can detect that a notification event for displaying the news content has occurred.

According to an exemplary embodiment, the wearable glasses 100 may obtain the user's mobile information prior to displaying the news content. For example, the wearable eyewear 100 can determine that the user is moving at a speed of 3 kilometers per hour.

When the user moves, the wearable glasses 100 may output a portion 2511 (eg, a title) of the news content in order not to obstruct the user's field of view in a large amount. The user can check the title of the news content as it passes through the pedestrian crossing.

According to an exemplary embodiment, after checking the title of the news content, if the user does not wish to view the news content, the user can shake the head to the left and right. In this case, the wearable glasses 100 can sense the user's shaking motion 2500 while outputting the portion 2511 (eg, the title) of the news content. For example, the wearable eyewear 100 can sense the head to the left and right by using a tilt sensor, an acceleration sensor, a gyroscope sensor, or the like as described previously (eg, Two times) the shaking motion is 2,500.

Referring to 2520 of FIG. 25, the wearable glasses 100 may no longer display a portion 2521 (eg, a title) of news content based on the user's shaking motion 2500. According to an exemplary embodiment, wearable glasses 100 may add news content to a list of non-output content, as previously described.

Although the motion input is described as an example of user input with reference to FIGS. 23 to 25, the embodiment is not limited thereto. For example, the user may input a voice for requesting output of the entire notification content or a voice for requesting blocking of the output of the notification content to the wearable glasses 100, or may select a button included in the wearable glasses 100. Request or block the output.

26 illustrates a flow diagram of a method for wearable glasses to highlight keywords in content corresponding to a notification event, in accordance with an illustrative embodiment.

In operation S2610, the wearable glasses 100 can detect the occurrence of a notification event.

In operation S2620, when the occurrence of the notification event is detected, the wearable glasses 100 can obtain the user's movement information.

In operation S2630, the wearable glasses 100 may determine to highlight a keyword in the notification content based on the user's movement information.

For example, based on the user's movement information, when the user's moving speed is equal to or greater than the threshold speed (eg, 4 km/hour), the wearable glasses 100 may extract the keyword from the notification content. According to an exemplary embodiment, information about the keyword may be stored in the metadata of the notification content.

According to an exemplary embodiment, the wearable glasses 100 may highlight keywords in the notification content. For example, the wearable eyewear 100 can adjust the size or color of the keyword or can underline the keyword. The operation of the wearable glasses 100 to highlight keywords in the notification content will be described in more detail with reference to FIG.

FIG. 27 illustrates a diagram for describing an example of highlighting keywords in content based on user's movement information by wearable glasses, according to an exemplary embodiment.

Referring to 2700-1 of FIG. 27, the wearable glasses 100 can receive a push message containing the news content from the server 300. In this case, the wearable glasses 100 can detect that a notification event for displaying the news content has occurred.

According to an exemplary embodiment, the wearable glasses 100 may obtain the user's mobile information prior to displaying the news content. For example, when the average moving speed of the user in a period of time is 0.0001 km / h, and the user is in the office for a period of time, the wearable glasses 100 can determine that the user is sitting in the chair and jobs. The period of time can be predetermined.

When the user sits in the chair and is working, since the situation is not dangerous even if the user's field of vision is blocked, the wearable glasses 100 can output the entire news content received from the server 300 at the current time. 2710 (For example, "At the Sochi Winter Olympics, Kim Jong-il scored 70.2 points, only 0.6 points less than the gold medal winner, and unfortunately only won the silver medal. (At the Sochi Olympics, Yuna Kim achieved 70.2 points,less by only 0.6 points Than the gold medalist, and unfortunately achieved just the silver medal.)").

Referring to 2700-2 of FIG. 27, when a user wearing the wearable glasses 100 walks, the wearable glasses 100 can receive a push message containing the news content from the server 300. In this case, the wearable glasses 100 can detect that a notification event for displaying the news content has occurred.

According to an exemplary embodiment, the wearable glasses 100 may obtain the user's mobile information prior to displaying the news content. For example, the wearable glasses 100 can determine that the user is moving at an average speed of 3 kilometers per hour for a period of time.

When the user moves at a threshold speed (for example, 2 km/h) or greater than the threshold speed, the user cannot concentrate on the entire news content 2720 (for example, "At the Sochi Winter Olympics, Kim Miner won 70.2. Point, only 0.6 points less than the gold medal winner, unfortunately only get the silver medal. (At the Sochi Olympics, Yuna Kim Achieved 70.2 points, less by only 0.6 points than the gold medalist, and unfortunately achieved just the silver medal.)"), so the wearable glasses 100 can extract the keywords contained in the news content and highlight the keywords .

For example, the wearable glasses 100 can extract "Yuna Kim", "Sochi Olympics", and "silver medal" as keywords from the news content and adjust "Yuna Kim" ), "Sochi Olympics" and "silver medal" size, thickness and color.

28 illustrates a flow diagram of a method for wearable glasses to adjust transparency of content corresponding to a notification event, in accordance with an illustrative embodiment.

In operation S2810, when the notification event has occurred, the wearable glasses 100 can obtain the user's movement information.

In operation S2820, the wearable glasses 100 may determine whether the user wearing the wearable glasses 100 is driving based on the user's movement information.

According to an exemplary embodiment, the wearable eyewear 100 can measure the moving speed of the user by using an acceleration sensor included in the wearable eyewear 100. If the user is moving at 80 km/hour, the wearable glasses 100 can determine that the user is driving.

According to an exemplary embodiment, the wearable eyewear 100 may determine whether the user is driving based on acceleration information received from the mobile terminal 200 connected to the wearable eyewear 100 or a navigation device included in the automobile.

According to an exemplary embodiment, when the user will wear the wearable glasses 100 When the operation mode is set to the navigation mode, the wearable glasses 100 can determine that the user is driving.

In operation S2830, when it is determined that the user is driving, the wearable glasses 100 may set the transparency of the notification content. For example, when it is determined that the user is driving, the wearable glasses 100 can display the notification content by setting the transparency of the notification content to 50%.

According to an exemplary embodiment, the wearable glasses 100 may adjust the transparency of the notification content based on the driving speed. For example, as the driving speed increases, the wearable glasses 100 may increase the transparency of the notification content to become more transparent.

FIG. 29 illustrates a diagram for explaining an example of wearable glasses that adjust transparency of content based on user's speed information while the user is driving, according to an exemplary embodiment.

Referring to 2910 of FIG. 29, a user wearing wearable glasses 100 can receive a push message containing news content from server 300. In this case, the wearable glasses 100 can detect that a notification event for displaying the news content has occurred.

According to an exemplary embodiment, the wearable glasses 100 may obtain the user's mobile information prior to displaying the news content. For example, the wearable glasses 100 can determine that the average moving speed of the user during a period of time is 0 km/h. The period of time can be predetermined.

When the user is at a standstill, the wearable glasses 100 can set the transparency of the news content to 0% and thus display the opaque news content 2911.

Referring to 2920 of FIG. 29, on the other hand, when the user wearing the wearable glasses 100 is driving, the wearable glasses 100 can receive the package from the server 300. Push messages with news content. In this case, the wearable glasses 100 can detect that a notification event for displaying the news content has occurred.

According to an exemplary embodiment, the wearable glasses 100 may obtain the user's mobile information prior to displaying the news content. For example, the wearable glasses 100 can determine that the average moving speed of the user during a period of time is 80 km/hour and that the user is driving.

When the user is in a driving state, the wearable glasses 100 can set the transparency of the news content to 50% and display the translucent news content 2921.

According to an exemplary embodiment, the wearable eyewear 100 may adjust the transparency of the notification content to prevent blocking of the field of view of the user who is driving.

30 illustrates a diagram for describing a method for a wearable eyeglass to determine a form of an output signal based on environmental information, according to an exemplary embodiment.

In operation S3010, the wearable glasses 100 can detect the occurrence of a notification event.

In operation S3020, the wearable glasses 100 may obtain environmental information about an environment within a certain distance from the wearable glasses 100. The certain distance may be predetermined. The environmental information may include at least one of the following information: information about an external sound generated within a certain distance from the wearable spectacles 100, and information about an external image obtained using the image sensor 161.

For example, the wearable glasses 100 can capture an image of the surrounding environment by using the image sensor 161. When the user wears the wearable eyewear 100, the image sensor 161 can be mounted near the user's eyes to capture an image similar to the image recognized by the user's eyes. Wearable glasses 100 can be analyzed for capture Image to get information about external images. For example, the wearable glasses 100 can obtain object information, edge information, atmosphere information, and color information contained in the captured image.

The wearable glasses 100 can detect surrounding sound via a microphone. The wearable glasses 100 can analyze the detected surrounding sounds to obtain external sound information. For example, the wearable glasses 100 can obtain information on the amount of surrounding noise, information on whether or not there is a plurality of voices, or the like.

The wearable eyewear 100 can also obtain an environment within a certain distance from the other wearable device that is within the radius of the short-range communication of the user wearing the wearable eyewear 100 or separated from the mobile terminal 200. Environmental information. For example, when the mobile terminal 200 obtains information about an external image by analyzing an image captured using a necklace, the wearable glasses 100 can receive information about the external image from the mobile terminal 200.

Furthermore, the wearable glasses 100 can receive information about external sounds obtained using the mobile terminal 200 or the watch from the mobile terminal 200 or the watch.

In operation S3030, the wearable glasses 100 can determine the output signal form of the notification content by considering the environmental information.

According to an exemplary embodiment, the wearable glasses 100 may determine to provide the notification content in the form of at least one of an audio signal and a video signal by considering environmental information. For example, when the level of the surrounding noise is equal to or greater than the threshold or a plurality of voices are detected, the wearable glasses 100 may determine to output the notification content in the form of a video signal. Moreover, when more than a certain number of edges are detected from the captured image, the wearable glasses 100 can determine to output the notification content in the form of an audio signal. Said A certain number can be a predetermined number.

In operation S3040, the wearable glasses 100 may output the notification content in the form of the determined output signal form. This operation will be described with reference to FIGS. 31 and 32.

31 and 32 illustrate diagrams for explaining an example of a form in which an output signal is adjusted based on external sound information by wearable glasses, according to an exemplary embodiment.

Referring to 3110 of FIG. 31, when a user wearing the wearable glasses 100 waits for a train, the wearable glasses 100 can receive a push message including the news video content 3101 from the server 300. In this case, the wearable glasses 100 can detect that a notification event for displaying the news video content 3101 has occurred.

According to an exemplary embodiment, the wearable glasses 100 may obtain the user's mobile information prior to displaying the news video content 3101. For example, the wearable glasses 100 can determine that the average moving speed of the user during a period of time is 0 km/hour and the user is at rest.

When the user is at a standstill, the wearable glasses 100 may determine to output the news video content 3101. The wearable eyewear 100 can further include information about the environment within a certain distance therefrom. For example, the wearable glasses 100 can activate a microphone to detect ambient sound. The wearable glasses 100 may re-execute the news video content 3101 when the level of the surrounding sound is equal to a threshold (eg, 70 decibels) or less than a threshold.

Referring to 3120 of Figure 31, the subway train enters the platform and, therefore, the level of ambient sound (e.g., 85 decibels) may be greater than a threshold (e.g., 70 decibels). In this case, the wearable glasses 100 can transmit the audio signal of the news video content 3101. Convert to text signal and display text signal.

For example, the wearable glasses 100 can convert the voices included in the news video content 3101 into text based on a speech to text (STT) technology, thereby generating a transcript corresponding to the news video content 3101 ( Transcript) 3102. In this specification, a transcript may refer to a record containing text converted from a utterance.

According to an exemplary embodiment, when the ambient sound is equal to or greater than the threshold, the wearable glasses 100 may provide a transcript corresponding to the audio content such that the user can visually recognize the notification content.

Referring to 3210 of FIG. 32, when the user wearing the wearable glasses 100 is sitting in the park and reading a book, the wearable glasses 100 can receive a push message including the news video content 3201 from the server 300. In this case, the wearable glasses 100 can detect that a notification event for displaying the news video content 3201 has occurred.

According to an exemplary embodiment, the wearable glasses 100 may obtain the user's mobile information prior to displaying the news video content 3201. For example, the wearable glasses 100 can determine that the average moving speed of the user during a period of time is 0 km/hour and the user is at rest.

When the user is at a standstill, the wearable glasses 100 may determine to output the news video content 3201. The wearable eyewear 100 can further include environmental information about the environment within a certain distance therefrom. For example, the wearable glasses 100 can activate a microphone to detect ambient sound. The wearable glasses 100 may re-execute the news video content 3201 when the level of the surrounding sound is equal to a threshold (eg, 70 decibels) or less than a threshold.

Referring to 3220 of FIG. 32, when the user wearing the wearable glasses 100 is worn Wearable glasses can detect multiple voices when talking to another person. When a plurality of voices are detected, if the HMS device 100 re-executes the news video content 3201, the scrambled session is re-executed, and thus, the HMS device 100 can convert the audio signal of the news video content 3201 into a text signal and display the text signal. . For example, the wearable glasses 100 can convert the speech contained in the news video content 3201 into the text 3202 and display the text 3202 based on the STT technology.

33 illustrates a flow diagram of a method for wearable glasses to determine an output form of content corresponding to a notification event based on external image information, in accordance with an illustrative embodiment.

In operation S3310, the wearable glasses 100 can detect the occurrence of a notification event.

In operation S3320, the wearable glasses 100 can obtain information about an external image by using the image sensor 161 included in the wearable glasses 100.

The information about the external image may include at least one of the following information: information on the change of the external image, color information of the external image, and object information about the object contained in the external image, but is not limited thereto.

According to an exemplary embodiment, the wearable eyewear 100 can obtain information about an external image by analyzing an external image captured using the image sensor 161.

According to another exemplary embodiment, when the captured external image is transmitted to the mobile terminal 200 or the server 300, the wearable glasses 100 may request analysis of an external image. The wearable glasses 100 can receive at least one of the following information from the mobile terminal 200 or the server 300: change information of the external image, color information of the external image, and object information about the object contained in the external image.

In operation S3330, the wearable glasses 100 may determine an output form of the notification content based on the information about the external image.

According to an exemplary embodiment, the wearable glasses 100 may determine that the notification content is provided by at least one of an audio signal and a video signal based on information about the external image. For example, when the captured image detects an edge exceeding a threshold number of edges or a change in the captured image is equal to or greater than a threshold, the wearable glasses 100 may determine to output in the form of an audio signal. Notification content. The threshold number of edges may be preset.

According to an exemplary embodiment, the wearable glasses 100 may determine to output a portion of the notification content or the entire notification content based on the information regarding the external image. For example, when a threshold number of edges exceeding the threshold value or a change in the captured image is detected to be equal to or greater than a threshold value in the captured image, the wearable glasses 100 may determine to output a portion of the notification content. A part of the notification content may include at least one of the following: a keyword for notifying the content, an overview information, and a title, but is not limited thereto.

In operation S3340, the wearable glasses 100 may output the notification content in the determined output form. For example, the wearable glasses 100 can provide notification content in the form of at least one of an audio signal and a video signal. The wearable glasses 100 may first output a part of the notification content, and then when the user input for outputting the entire notification content is received, the entire notification content may be output.

The operation of the wearable glasses 100 to output the notification content in different forms based on the information on the external image will be described in detail with reference to FIG.

FIG. 34 illustrates an example of a form in which an output signal is adjusted based on external image information by wearable glasses, according to an exemplary embodiment.

Referring to 3410 of FIG. 34, when the user wearing the wearable glasses 100 stops and looks up at the sky, the wearable glasses 100 can receive a push message containing the news content 3401 from the server 300. The wearable glasses 100 can obtain information about external images. For example, the wearable glasses 100 can capture the sky image 3411 and analyze the sky image 3411. When there are a few edges in the sky image 3411 that are less than the number of thresholds (as a result of the analysis), the wearable glasses 100 can display the news content 3401 in the form of a video signal.

Referring to 3420 of FIG. 34, when a user wearing the wearable glasses 100 walks in a public place where many people are present, the wearable glasses 100 can receive a push message containing the news content 3401 from the server 300. The wearable glasses 100 can obtain information about external images. For example, the wearable glasses 100 can capture the public place image 3421 and analyze the public place image 3421.

As a result of the analysis, there are a number of edges in the public place image 3421 that are larger than the number of thresholds, and thus, the wearable glasses 100 can display the news content 3401 in the form of the audio signal 3402.

According to an exemplary embodiment, if the external image viewed through the user's eyes is complicated, it is difficult for the user to visually recognize the notification content, and thus, the wearable glasses 100 may be in the form of an audio signal instead of a video signal. Provide notification content.

FIG. 35 illustrates a flowchart for a method for the wearable glasses to determine whether to output a notification content based on change information of an external image, according to an exemplary embodiment.

In operation S3510, the wearable glasses 100 can detect a notification event. occur.

In operation S3520, when the occurrence of the notification event is detected, the wearable glasses 100 can obtain information on the change of the external image. The change information about the external image may indicate information on the degree of change of the external image observed by the user.

According to an exemplary embodiment, the wearable eyewear 100 can obtain a plurality of external images by using the image sensor 161. The wearable glasses 100 can calculate the change of the external image by comparing the respective frames of the plurality of external images obtained over a period of time. For example, when the user wearing the wearable glasses 100 is moving, the change of the external image calculated by the wearable glasses 100 may be greater than the external image when the user wearing the wearable glasses 100 is at rest. The change.

According to an exemplary embodiment, when the captured external image is transmitted to the mobile terminal 200 or the server 300, the wearable glasses 100 may request analysis of an external image. The wearable glasses 100 can receive change information of external images from the mobile terminal 200 or the server 300.

In operation S3530, the wearable glasses 100 may determine whether the change in the external image is less than a threshold.

For example, the wearable glasses 100 can determine whether the difference between the first frame obtained in the nth second and the second frame obtained in the (n+1)th second is less than a threshold (for example, 30%).

When the change of the external image is less than the threshold (S3530, YES), in operation S3540, the wearable glasses 100 may determine to output the notification content. The wearable glasses 100 can output the notification content at the current time.

For example, when the user's moving speed is less than the threshold speed, or if the user's gaze is not distracted, the change in the external image may be less than the threshold. In this case, even when the notification content is output, the user may not be in a dangerous situation, and therefore, the wearable glasses 100 may determine to output the notification content.

On the other hand, when the change of the external image is equal to or larger than the threshold (S3530, NO), the wearable glasses 100 may not output the notification content in operation S3550, and may determine to display an indication indicating the occurrence of the notification event symbol.

For example, when the change in the external image is equal to or greater than the threshold, the wearable glasses 100 may not display the notification content, or may display a simple indicator indicating the occurrence of the notification event so as not to block the user's field of view. The operation of the wearable glasses 100 to determine whether or not to output the notification content based on the change information of the external image will be described in detail with reference to FIG.

FIG. 36 illustrates an example of an output form in which the content corresponding to the notification event is changed by the wearable glasses based on the change information of the external image.

Referring to 3600-1 of FIG. 36, when a user wearing the wearable glasses 100 is crossing a pedestrian crossing, the wearable glasses 100 can receive a push message containing the news content from the server 300. In this case, the wearable glasses 100 can detect that a notification event for displaying the news content has occurred.

According to an exemplary embodiment, the wearable glasses 100 may obtain change information of an external image before displaying the news content, and determine whether the change of the external image is less than a threshold. For example, when the user is crossing a pedestrian crossing, the wearable glasses 100 can obtain a varying image of the surrounding image 3610 around the pedestrian crossing. In this case, when the change of the surrounding image 3610 around the pedestrian crossing is equal to or greater than At the threshold, the wearable glasses 100 can determine that the news content is not output at the current time. The wearable glasses 100 can display a simple indicator 3611 indicating the occurrence of a notification event.

According to an exemplary embodiment, when the user is crossing a pedestrian crossing, the wearable glasses 100 may not display the news content, while the indicator 3611 is displayed to thereby minimize blocking of the user's field of view.

Referring to 3600-2 of FIG. 36, when the user wearing the wearable glasses 100 sits and looks at the wall, the wearable glasses 100 can receive a push message containing the news content 3621 from the server 300. In this case, the wearable glasses 100 can detect that a notification event for displaying the news content 3621 has occurred.

According to an exemplary embodiment, the wearable glasses 100 may obtain change information of the external image before displaying the news content 3621, and determine whether the change of the external image is less than a threshold. For example, when the user is looking at the wall at home, the wearable glasses 100 can obtain information on the change of the wall image 3620. In this case, when the change of the wall image 3620 is less than the threshold, the wearable glasses 100 may determine that the news content 3621 is output at the current time.

The wearable glasses 100 can display news content 3621 in the form of AR, MR or VR (for example, "Sochi Olympics", Silver Medal (Yuna Kim)! Fancy skater Kim Jong-il in Sochi The Winter Olympics won a valuable silver medal! (Figure skater Yuna Kim has won a valuable silver medal at the Sochi Olympics!)"). In this case, the user can check the news content 3621 via the wearable glasses 100 in a non-hazardous situation, even if the user's field of view is blocked.

Hereinafter, an operation of the wearable glasses 100 to adjust the transparency, color, and chromaticity of the notification content will be described in detail with reference to FIG.

37 illustrates a flow diagram of a method for wearable glasses to adjust at least one of transparency, color, and chrominance of content corresponding to a notification event based on external image information, in accordance with an illustrative embodiment.

In operation S3710, the wearable glasses 100 can detect the occurrence of a notification event.

In operation S3720, the wearable glasses 100 can obtain information about an external image by using the image sensor 161. The information about the external image may include at least one of the following information: the change information of the external image, the color information of the external image, and the object information about the object contained in the external image, but is not limited thereto.

Operations S3710 and S3720 correspond to operations S3310 and S3320 of Fig. 33, respectively, and thus detailed description thereof will be omitted.

In operation S3730, the wearable glasses 100 may determine whether to output the notification content based on the information about the external image.

According to an exemplary embodiment, when the number of edges detected from the external image is greater than or equal to the number of thresholds, the wearable glasses 100 may determine not to output the notification content. The number of thresholds may be preset. Conversely, when the number of edges detected from the external image is less than the threshold number, the wearable glasses 100 may determine to output the notification content.

According to an exemplary embodiment, when the change of the external image is equal to or greater than the threshold, the wearable glasses 100 may determine not to output the notification content. Conversely, when When the change in the partial image is less than the threshold, the wearable glasses 100 can determine the output of the notification content.

When it is determined that the notification content is output, the wearable glasses 100 may adjust at least one of transparency, color, and chromaticity of the notification content in operation S3740.

According to an exemplary embodiment, the wearable eyewear 100 may adjust at least one of transparency, color, and chromaticity of the notification content based on the illuminance information. For example, the wearable glasses 100 can measure the illuminance value by using an illuminance sensor. When the measured illuminance value is less than the threshold value, the wearable glasses 100 may reduce the transparency of the notification content and increase the chromaticity of the notification content.

According to an exemplary embodiment, the wearable glasses 100 may adjust at least one of transparency, color, and chromaticity of the notification content based on the acceleration information. For example, when the user's moving speed increases, the wearable glasses 100 may increase the transparency of the notification content.

According to an exemplary embodiment, the wearable eyewear 100 may adjust at least one of transparency, color, and chromaticity of the notification content based on color information of the external image. For example, the wearable glasses 100 can display the notification content in a color complementary to the color of the external image.

In operation S3750, the wearable glasses 100 may output the notification content based on at least one of the adjusted transparency, color, and chromaticity. This operation will be described below with reference to FIG.

FIG. 38 illustrates a diagram for describing an example of adjusting a color of content corresponding to a notification event based on external image information by the wearable glasses.

Referring to FIG. 38, when the user wearing the wearable glasses 100 looks up at the sky At the time, the wearable glasses 100 can detect the occurrence of a notification event. In this case, the wearable glasses 100 can obtain a sky image 3800.

The wearable glasses 100 can adjust the color of the notification content based on the color information of the sky image 3800. For example, when the basic color of the notification content is blue 3810, the user may have difficulty recognizing the notification content displayed on the sky image 3800 in blue 3810 and in AR form.

Accordingly, the wearable glasses 100 can change the color of the notification content from blue 3810 to yellow 3820 and display the notification content in yellow 3820.

39 illustrates a flow diagram of a method for a wearable eyeglass to determine an output location of content corresponding to a notification event, in accordance with an illustrative embodiment.

In operation S3910, the wearable glasses 100 can detect the occurrence of a notification event.

In operation S3920, the wearable glasses 100 can obtain information about an external image by using the image sensor 161. The information about the external image may include at least one of the following information: color information of the external image, and information about the object of the object contained in the external image, but is not limited thereto.

Operations S3910 and S3920 correspond to operations S3310 and S3320 of Fig. 33, respectively, and thus detailed description thereof will be omitted.

In operation S3930, the wearable glasses 100 may determine an output position of the notification content based on at least one of the following information: object information about an object included in the external image, and color information of the external image.

For example, the wearable glasses 100 can be determined based on the object information about the objects contained in the external image and are not heavy with the actual object (eg, the conversation partner). The position of the stack is the output location of the notification content. Furthermore, the wearable glasses 100 can determine that the basic color of the notification content and the area of its complementary color are the output positions of the notification content.

In operation S3940, the wearable glasses 100 may output the notification content at the determined output position. This operation will be described below with reference to FIG.

FIG. 40 illustrates a diagram for describing an example of changing an output position of content corresponding to a notification event by wearable glasses.

Referring to FIG. 40, when a first user wearing the wearable glasses 100 has a conversation with a second user, the wearable glasses 100 can receive a push message containing the news content 4000 from the server 300. In this case, the wearable glasses 100 can detect that a notification event for displaying the news content 4000 has occurred.

As shown in 4010 of FIG. 4, when the wearable glasses 100 display the news content 4000 in the center portion, the second user's face may be covered by the news content 4000.

Therefore, the wearable glasses 100 can obtain information about external images before displaying the news content 4000. For example, the wearable glasses 100 can obtain a captured image containing the second user by using the image sensor 161. The wearable eyewear 100 can analyze the captured image to detect the location of the second user. The area in which the wearable glasses 100 can determine that it does not overlap with the second user is the display position of the news content 4000.

As shown in 4020 of FIG. 40, the wearable glasses 100 can display the news content 4000 in an area that does not overlap the face of the second user.

According to an exemplary embodiment, when the face of the second user is displaced, The wearable glasses 100 can adaptively change the display position of the news content 4000.

41 illustrates a flow diagram of a method for a wearable eyeglass to determine a method of providing content corresponding to a notification event based on user setting information, in accordance with an illustrative embodiment.

In operation S4110, the wearable glasses 100 may receive setting information related to providing the notification content. For example, the wearable glasses 100 may receive setting information regarding at least one of: providing a time to notify the content, providing a location of the notification content, and providing a form of the notification content.

According to an exemplary embodiment, the wearable glasses 100 may receive setting information related to providing the notification content from the mobile terminal 200 or the server 300. For example, the user can set whether to output the following by using the mobile terminal 200: the notification content, the time when the notification content is output, the output form of the notification content, and the location at which the notification content is output.

In operation S4120, the wearable glasses 100 may detect the occurrence of a notification event.

In operation S4130, when the occurrence of the notification event is detected, the wearable glasses 100 may determine a method of providing the notification content based on the setting information. For example, the wearable glasses 100 may determine the time at which the notification content is provided based on the setting information, the location at which the notification content is provided, and the form in which the notification content is provided.

In operation S4140, the wearable glasses 100 may provide notification content. For example, the wearable glasses 100 can provide notification content at a time and in one form according to the setting information. The time and form can be predetermined.

Hereinafter, the wearable eye will be described in detail with reference to FIGS. 42 to 44. The mirror 100 provides an operation of notifying the content based on the setting information.

FIG. 42 illustrates an example of setting information 4200 related to outputting content corresponding to a notification event.

As illustrated in FIG. 42, the user can select whether to output the notification content according to the location 4201 or the application 4202.

For example, when the user is in the library, the user can be set to block the output of the notification content; when the user is at home, the user can be set to output the entire notification content output; and when the user is in the office The user can be set to output a part of the notification content.

Furthermore, the user can be configured to output a portion of the notification content corresponding to the first application and to block the output of the notification content corresponding to the second application.

According to an exemplary embodiment, the wearable glasses 100 may obtain the setting information 4200 related to the output of the notification content from the mobile terminal 200 or the server 300, and store the setting information 4200 in the memory.

Furthermore, when a notification event has occurred, the wearable glasses 100 can output a notification content based on the setting information. This case will be described below with reference to FIGS. 43 and 44.

43 and 44 illustrate an example in which the content corresponding to the notification event is output based on the setting information of the user by the wearable glasses.

Referring to FIG. 43, when the user wearing the wearable glasses 100 is at home, the wearable glasses 100 can receive a push message containing the news content from the server 300. In this case, the wearable glasses 100 can detect that a notification event for displaying the news content has occurred.

The wearable glasses 100 can check and notify before outputting a notification event The setting information about the output of the piece is 4200. When the setting information 4200 is set to output the entire notification content when the user wearing the wearable glasses 100 is at home, the wearable glasses 100 may output the entire news content 4300.

Referring to FIG. 44, when the user wearing the wearable glasses 100 is in the office, the wearable glasses 100 can receive a push message containing the news content via the mobile terminal 200. In this case, the wearable glasses 100 can detect that a notification event for displaying the news content has occurred.

The wearable glasses 100 can check the setting information 4200 related to the output of the notification event before outputting the notification event. When the setting information 4200 is set to output a portion of the notification content when the user wearing the wearable glasses 100 is in the office, the wearable glasses 100 may output a portion (eg, a title) of the news content 4400.

45 illustrates a flow diagram of a method for wearable glasses to receive emergency notification information from external wearable device 400, in accordance with an illustrative embodiment.

In operation S4510, the external wearable device 400 can measure biometric information of the user.

The external wearable device 400 can include, for example, a ring, a necklace, a strap, a watch, a shoe, an earring, a hair band, a garment, a glove, or a thimble, but is not limited thereto.

According to an exemplary embodiment, the external wearable device 400 can measure pulse rate information, blood pressure information, heart rate information, body temperature information, or the like.

In operation S4520, the external wearable device 400 may determine an emergency based on the biometric information.

For example, when the user has a pulse rate equal to or greater than a period of time The external wearable device 400 can determine that an emergency occurs at a threshold rate (eg, 100 times per minute) or when the user's body temperature is equal to a threshold temperature (eg, 38 ° C) or above a threshold temperature. Happening.

In operation S4530, when it is determined that an emergency situation occurs, the external wearable device 400 may transmit emergency notification information to the wearable glasses 100. The emergency notification information may include biometric information measured by the external wearable device 400, a message notifying the user of an emergency, an illustration indicating an emergency, and the like.

According to an exemplary embodiment, the external wearable device 400 may transmit emergency notification information to the wearable glasses 100 via short-range communication (eg, Bluetooth, WFD, NFC, etc.).

According to an exemplary embodiment, the external wearable device 400 may transmit emergency notification information to the wearable glasses 100 via the mobile terminal 200 or the server 300.

In operation S4540, the wearable glasses 100 can detect the occurrence of a notification event. For example, the wearable glasses 100 can detect that a notification event has occurred that is used to output an emergency notification message.

In operation S4550, the wearable glasses 100 may provide notification content.

According to an exemplary embodiment, since the situation is an emergency, the wearable glasses 100 can provide an emergency notification message in real time regardless of the user's mobile information or external image information. The operation of the wearable glasses 100 to output an emergency notification message will be described in detail with reference to FIG.

Figure 46 illustrates the display of wearable glasses from an external wearable device An example of received pulse rate information.

Referring to 4610 of Fig. 46, the smart watch 400-1 can measure the pulse rate of the user. The smart watch 400-1 measures the user's pulse rate over a certain period of time. The smart watch 400-1 measures the user's pulse rate when an event has occurred. An event may include the following events: an event for setting a motion mode by a user, and an event for selecting a button requesting to measure a pulse rate, and the like, but is not limited thereto.

For example, the user's pulse rate measured by the smart watch 400-1 may be 97 beats per minute (BPM). The user's normal pulse rate can be 81 BPM.

Referring to 4620 of Figure 46, the smart watch 400-1 can compare the measured pulse rate (97 BPM) to the user's typical normal pulse rate (81 BPM). The smart watch 400-1 can determine the user's pulse when the difference between the measured pulse rate (97 BPM) and the user's normal pulse rate (81 BPM) exceeds the threshold (eg, 10 BPM). The rate is abnormal.

In this case, the smart watch 400-1 can output a notification message "abnormal pulse rate". Furthermore, the smart watch 400-1 can transmit emergency notification information notifying the user of the abnormal pulse rate to the wearable glasses 100.

Referring to 4630 of FIG. 46, the wearable eyewear 100 can receive emergency information directly from the smart watch 400-1 or via the mobile terminal 200.

The wearable glasses 100 may output an emergency notification content 4600 based on the received emergency notification information (eg, "emergency! pulse rate has decreased.").

According to an exemplary embodiment, the user can instantly check biometric information and emergency notification content measured using the external wearable device 400 by using the wearable glasses 100.

FIG. 47 illustrates a flowchart of a method for wearable glasses to output content corresponding to a notification event via an external device, according to an exemplary embodiment.

In operation S4710, the wearable glasses 100 can detect the occurrence of a notification event.

In operation S4720, when the occurrence of the notification event is detected, the wearable glasses 100 can obtain the user's movement information. The user's mobile information may include at least one of the following information: the user's mobile status information, the moving speed information, and the location information, but is not limited thereto.

In operation S4730, the wearable glasses 100 may determine a method of providing notification content. According to an exemplary embodiment, the wearable glasses 100 may determine when to provide the notification content. Still further, according to an exemplary embodiment, the wearable glasses 100 may determine a form in which the notification content is provided.

Operations S4710 to S4730 correspond to operations S510 to S530 of FIG. 5, respectively, and thus detailed description thereof will be omitted.

In operation S4740, the wearable glasses 100 may output a notification content. According to an exemplary embodiment, the wearable glasses 100 may output a notification content according to a method of providing notification content. For example, the wearable glasses 100 can output a portion of the notification content.

In operation S4750, the wearable glasses 100 may receive a user input for requesting transmission of the notification content to the external device 4700. User input can vary. For example, the user input may be at least one of the following: motion input, touch input, key input, voice input, and multiple input, but is not limited thereto.

According to an exemplary embodiment, the external device 4700 can be other wearable devices than the wearable eyewear 100. For example, the external device 4700 can be a smart watch, a strap, or a necklace. Moreover, the external device 4700 can be the mobile terminal 200 connected to the wearable eyewear 100.

According to an exemplary embodiment, the wearable glasses 100 may receive an input for selecting an external device 4700 to transmit notification content. For example, the wearable eyewear 100 can receive an input for selecting a smart watch or an input for requesting transmission of the notification content to the smart watch.

According to an exemplary embodiment, the external device 4700 to transmit the notification content may be preset.

Still further, according to an exemplary embodiment, the wearable eyewear 100 can search for a wearable device located within a short range communication radius and transmit the notification content to the discovered wearable device.

In operation S4760, the wearable glasses 100 may transmit the notification content to the external device 4700 according to a user input. For example, the wearable glasses 100 can transmit the notification content to the external device 4700 via short-range communication (eg, Bluetooth) or mobile communication (eg, 3G/4G/5G).

According to an exemplary embodiment, the wearable glasses 100 may directly transmit the notification content to the external device 4700 or transmit the notification content to the external device 4700 via the mobile terminal device 200.

For example, when the external device 4700 is a wearable device, it can be worn. The wearing glasses 100 can transmit the notification content to the external device 4700 via the mobile terminal 200 that connects the wearable device with the wearable glasses 100.

In operation S4770, the external device 4700 may output the notification content. For example, the external device 4700 can display the notification content on the screen. When the notification content is video, the external device 4700 can re-execute the notification content. The operation of the external device 4700 connected to the wearable glasses 100 and outputting the notification content will be described in detail with reference to FIG.

FIG. 48 illustrates an example of outputting content corresponding to a notification event based on user input by wearable glasses.

Referring to 4800-1 of FIG. 48, when a user wearing the wearable glasses 100 is crossing a pedestrian crossing, the wearable glasses 100 can receive a push message containing the news content from the server 300. In this case, the wearable glasses 100 can detect that a notification event for displaying the news content has occurred.

According to an exemplary embodiment, the wearable glasses 100 may obtain the user's mobile information prior to displaying the news content. For example, the wearable eyewear 100 can determine that the user is moving at a speed of 3 kilometers per hour.

When the user moves, the wearable glasses 100 can output a portion 4810 of the news content so as not to obstruct the user's field of view in a large amount. For example, the wearable glasses 100 can extract a title from the news content and output the extracted title.

Referring to 4800-2 of FIG. 48, the user can perform a shaking gesture 4820 of shaking the hand before the wearable glasses 100 after checking the title of the news content to check the entire content 4830 of the news content on the smart watch 4800.

In this case, the wearable glasses 100 can be in the department that outputs the news content. The user's shaking gesture 4820 is sensed when sub-4810 (eg, a title). For example, the wearable eyewear 100 can sense the shaking gesture 4820 of the user's shaking hand by using, for example, the depth sensor 154 or the image sensor 161.

The wearable glasses 100 can transmit news content according to the user's shaking gesture 4820. According to an exemplary embodiment, the wearable glasses 100 may transmit the news content directly to the smart watch 4800 or transmit the news content to the smart watch 4800 via the mobile terminal 200.

According to an exemplary embodiment, the smart watch 4800 can display the entire content 4830 of the news content received from the wearable glasses 100 on the screen. Wearable glasses 100 may now no longer output portion 4810 of the news content.

According to another exemplary embodiment, in order to prevent transmission of news content from the wearable glasses 100 to the smart watch 4800 regardless of the user's intention, the wearable glasses 100 may transmit the news content to the smart watch under the following circumstances 4800: Only when the time period in which the shaking action 4820 is equal to or greater than the threshold time period, or when the number of shaking times is a number of thresholds (eg, twice) or greater than the number of thresholds. That is, to prevent unintentional transmission of news content to the smart watch 4800, for example, when the user is scratching, the wearable glasses 100 can check to ensure that the shaking gesture 4820 is a predetermined motion for transmitting news content.

Meanwhile, although the shaking gesture 4820 is described as an example of user input for transmitting notification content in FIG. 48, the user input is not limited thereto. For example, the user may input a voice for requesting transmission of the notification content to the wearable eyewear 100 or press a button included in the wearable eyewear 100.

Figure 49 illustrates a wearable eyeglass for use in accordance with an illustrative embodiment. A flowchart of a method of transmitting content corresponding to a notification event in response to a request from an external device.

In operation S4910, the wearable glasses 100 can detect the occurrence of a notification event.

In operation S4920, the wearable glasses 100 can obtain the user's movement information.

In operation S4930, the wearable glasses 100 may output the notification content according to a method of providing notification content based on the user's movement information determination.

Operations S4910 to S4930 correspond to operations S4710 to S4730 of Fig. 47, respectively, and thus detailed description thereof will be omitted.

In operation S4940, the external device 4900 may receive a user input for requesting output of the notification content from the external device 4900.

According to an exemplary embodiment, the external device 4900 may be another wearable device that is different from the wearable eyewear 100. For example, the external device 4900 can be a smart watch, a strap, or a necklace. Moreover, the external device 4900 can be the mobile terminal 200 connected to the wearable eyewear 100.

According to an exemplary embodiment, user input for requesting output of notification content may vary. For example, the user input may be at least one of the following: motion input, touch input, key input, voice input, and multiple input, but is not limited thereto.

In operation S4950, the external device 4900 may request the wearable glasses 100 to transmit the notification content. The external device 4900 may request the wearable glasses 100 to directly transmit the notification content or request the wearable glasses 100 to transmit via the mobile terminal 200 Notification content.

In operation S4960, the wearable glasses 100 may transmit the notification content to the external device 4900. For example, the wearable glasses 100 can transmit the notification content to the external device 4900 via short-range communication (eg, Bluetooth) or mobile communication (eg, 3G/4G/5G).

According to an exemplary embodiment, the wearable glasses 100 may directly transmit the notification content to the external device 4900 or transmit the notification content to the external device 4900 via the mobile terminal device 200. For example, when the external device 4900 is a wearable device, the wearable glasses 100 can transmit the notification content to the external device 4900 via the mobile terminal 200 that connects the wearable device with the wearable glasses 100.

In operation S4970, the external device 4900 may output the notification content. For example, the external device 4900 can display the notification content on the screen. When the notification content is video, the external device 4900 can re-execute the notification content. The operation of the external device 4900 connected to the wearable glasses 100 and outputting the notification content will be described in detail with reference to FIG.

FIG. 50 illustrates an example of displaying content corresponding to a notification event by an external device based on user input received via an external device, wherein the external device is connected to the wearable glasses, according to an exemplary embodiment.

Referring to 5000-1 of FIG. 50, when a user wearing the wearable glasses 100 is crossing a pedestrian crossing, the wearable glasses 100 can receive a push message containing the news content from the server 300. In this case, the wearable glasses 100 can detect that a notification event for displaying the news content has occurred.

According to an exemplary embodiment, the wearable glasses 100 can display news Get the user's mobile information before the content. For example, the wearable eyewear 100 can determine that the user is moving at a speed of 3 kilometers per hour.

When the user moves, the wearable glasses 100 can output a portion 5010 of the news content so as not to obstruct the user's field of view in a large amount. For example, the wearable glasses 100 can extract a title from the news content and output the extracted title.

Referring to 5000-2 of FIG. 50, the user can select the button 5020 of the smart watch 5000 after checking the title of the news content to check the entire content 5030 of the news content on the smart watch 5000. Buttons can be predetermined or pre-assigned. The button may correspond to a command intended to display the notification content displayed via the wearable glasses 100 on the smart watch 5000. According to an exemplary embodiment, the button may be a physical button or a virtual button in the form of a graphical user interface (GUI).

The smart watch 5000 may request the wearable glasses 100 to transmit the news content displayed by the wearable glasses 100.

The wearable glasses 100 can transmit the news content to the smart watch 5000 in response to a request from the smart watch 5000. According to an exemplary embodiment, the wearable glasses 100 may directly transmit the news content to the smart watch 5000 or transmit the news content to the smart watch 5000 via the mobile terminal 200.

Referring to 5000-3 of FIG. 50, the smart watch 5000 can display the entire content 5030 of the news content received from the wearable glasses 100 on the screen. The wearable glasses 100 may no longer output the portion 5010 of the news content.

FIG. 51 illustrates a flow of a method for a wearable glasses to output content corresponding to a notification event based on movement information of a user, according to an exemplary embodiment. Figure.

In operation S5110, the wearable glasses 100 may establish a communication link with the external device 5100.

For example, the wearable glasses 100 can establish a short-range communication or mobile communication link (eg, 3G, 4G, or 5G) with the external device 5100. Examples of short-range communication may include Bluetooth, BLE, WFD, UWB, Zigbee, NFC, and Ant+, but are not limited thereto.

In operation S5120, the wearable glasses 100 can detect the occurrence of a notification event.

In operation S5130, when the occurrence of the notification event is detected, the wearable glasses 100 can obtain the user's movement information.

According to an exemplary embodiment, the wearable eyewear 100 can obtain the user's movement information by using at least one of an acceleration sensor, a tilt sensor, and a position sensor. According to an exemplary embodiment, the wearable glasses 100 can also obtain the user's mobile information by using the user's schedule information or lifestyle information. According to an exemplary embodiment, the wearable eyewear 100 can analyze the user's mobile information by using biometric information measured using an external wearable device.

In operation S5140, the wearable glasses 100 may determine that the notification content is output via the external device 5100 based on the movement information of the user.

For example, the wearable glasses 100 can determine whether the user's moving speed is less than a threshold speed (eg, 4 km/hour) based on the user's movement information. When the moving speed of the user is equal to or greater than the threshold speed, the wearable glasses 100 may determine that the notification content is output via the external device 5100, and if the user moves the speed Below the threshold speed, the wearable glasses 100 may determine that the notification content is output from the wearable glasses 100 immediately.

In operation S5150, when it is determined that the notification content is output via the external device 5100, the wearable glasses 100 may transmit the notification content to the external device 5100. According to an exemplary embodiment, the wearable glasses 100 may transmit the notification content to the external device 5100 via a previously established communication link.

In operation S5160, the external device 5100 may output content corresponding to the notification event. For example, the external device 5100 can display the notification content on the screen. When the notification content is video, the external device 5100 may re-execute the notification content.

In operation S5170, when it is determined that the notification content is not output via the external device 5100, the wearable glasses 100 may output the notification content.

FIG. 52 illustrates an example of outputting content corresponding to a notification event based on the user's movement information by the wearable glasses.

Referring to 5200-1 of FIG. 52, when a user wearing the wearable glasses 100 walks in a public space where many people exist, the wearable glasses 100 can receive a push message including the news content 5210 from the server 300. In this case, the wearable glasses 100 can detect that a notification event for displaying the news content 5210 has occurred.

The wearable glasses 100 can obtain the user's movement information before displaying the news content 5210 and determine whether the user's movement speed is less than the threshold speed (for example, 2 km/hour). For example, a user walking in a public space can move at a speed of 3 km/hour. In this case, when the user's moving speed (for example, 3 km/h) is equal to or greater than the threshold speed (2 km/h), The wearable glasses 100 can determine that the news content 5210 is output, but are not output from the wearable glasses 100 but are output via the smart watch 5200.

Referring to 5200-2 of FIG. 52, when the news content 5210 is transmitted to the smart watch 5200, the wearable glasses 100 may request the output of the news content 5210. The smart watch 5200 can display the news content 5210 on the screen according to the request of the wearable glasses 100.

According to an exemplary embodiment, when the user wearing the wearable glasses 100 moves at a threshold speed or greater than a threshold speed, the wearable glasses 100 may output the notification content to another wearable device (eg, , smart watch 5200) so as not to block the user's field of vision.

53 illustrates a flow diagram of a method for wearable glasses to provide a list of non-output content, in accordance with an illustrative embodiment.

In operation S5310, the wearable glasses 100 may receive a user input for requesting a list of non-outputted content. The list of non-output content may include the following: a notification content that is not output when a notification event has occurred, and a notification content that includes a portion that is output when a notification event has occurred.

According to an exemplary embodiment, user input for requesting a list of non-outputted content may vary. For example, a user input for requesting a list of non-output content may include: an input for a certain area of the frame of the touch glasses, an input for selecting a button included in the frame of the glasses, A voice sound input requesting a list of non-output contents, a head motion input for raising the head, or the like, but is not limited thereto. A certain area of the frame of the glasses can be predetermined.

In operation S5320, the wearable glasses 100 can respond to the user's loss. Enter a list of non-output content. For example, the wearable glasses 100 can display a list of non-output content in AR form.

According to an exemplary embodiment, when it is not possible to display non-output content on a single screen, the wearable glasses 100 can receive a scroll request from a user. The wearable glasses 100 can scroll non-output content vertically or horizontally in response to a user's scroll request.

Throughout the specification, "scrolling" refers to the operation of the wearable glasses 100 when the amount of information to be displayed on the screen is greater than the amount of displayable information to be displayed on the screen of the wearable glasses 100. The information displayed on the screen is moved horizontally or horizontally so that new information corresponding to the amount of information disappearing from the moving screen appears from the opposite direction.

In operation S5330, the wearable glasses 100 may receive an input for selecting a segment of the content included in the list. For example, when a panning motion input for vertically shaking the head is sensed, the wearable glasses 100 can recognize the same input as the content for the user to select the content displayed in the center of the list.

Further, the wearable glasses 100 can receive an eyeball input for selecting a segment of the content included in the list. For example, the wearable glasses 100 may select content in the list based on the following inputs: a threshold number of times or more than a number of thresholds, or a gaze content within a threshold period or greater than a threshold period Eyeball input.

In operation S5340, the wearable glasses 100 may output the selected content. For example, the wearable glasses 100 can display or re-execute non-output notification content on the screen.

According to an exemplary embodiment, the wearable glasses 100 may provide a list of non-outputted content such that the user can select and review the notification content desired to be inspected from the list.

Meanwhile, according to an exemplary embodiment, the wearable glasses 100 may provide a list of output notification contents. The user can select the notification content from the list of output notification contents and check the notification content again.

Figure 54 illustrates an example of a list of non-output content provided by wearable glasses based on a user input. Referring to FIG. 54, the user input for requesting the list 5411 for providing non-output content is the head-up motion 5410, and the user input for requesting scrolling is the panning motion 5420.

Referring to 5400-1 of FIG. 54, when the occurrence of the notification event is not sensed, the wearable glasses 100 can receive the head-up motion 5410 of the user's head up. For example, wearable eyewear 100 can sense a user's head-up motion 5410 by using, for example, a tilt sensor, an acceleration sensor, or a gyroscope sensor.

The wearable eyewear 100 can display a list 5411 of non-output content in response to the user's head-up motion 5410.

According to another exemplary embodiment, in order to prevent the list 5411 displaying non-output content regardless of the user's intention, the wearable glasses 100 may be equal to or longer than the threshold time (for example, two seconds) during the time period of the head-up motion 5410. A list 5411 of non-output content is displayed. That is, to prevent unintentional display of the list 5411 when, for example, the user is looking up at an airplane or bird in the sky, the wearable glasses 100 can be checked to ensure that the head movement 5410 is a given motion for displaying the list.

Referring to 5400-2 of FIG. 54, when the list 5411 of non-output contents is displayed, The wearable eyewear 100 senses a rocking motion 5420 that the user shakes the head to the left and right.

For example, the wearable eyewear 100 can sense the number of times (eg, twice) by shaking the head to the left and right by using, for example, a tilt sensor, an acceleration sensor, or a gyroscope sensor. A shaking motion 5420 that is greater than a threshold number of times. The wearable glasses 100 can scroll through the list 5411 of non-output content according to the user's shaking motion 5420.

According to an exemplary embodiment, when the user selects the first content 5422 from the list 5411 of non-outputted content, the wearable glasses 100 may display or re-execute the first content 5422.

FIG. 55 illustrates an example of providing a list of content that has not been output from the wearable glasses by a wearable device connected to the wearable glasses.

Referring to 5510 of FIG. 55, the smart watch 5500 connected to the wearable glasses 100 can display a list of content that has not been output from the wearable glasses 100. The user can check the list of non-output content and select the first content 5501 from the list of non-output content.

Referring to 5520 of FIG. 55, the smart watch 5500 can provide a selection window for selecting a device to display the first content 5501.

When the user selects the visual view 5502 from the selection window, the smart watch 5500 can display the first content 5501 that has not been output from the wearable glasses 100 on the screen of the smart watch 5500.

When the user selects the HMD view 5503 from the selection window, the smart watch 5500 can request the wearable glasses 100 to output the first content 5501. Wearable The glasses 100 can display the first content 5501 according to the request of the smart watch 5500.

Figure 56 illustrates an example of a listing of content previously output from wearable glasses by a wearable device attached to the wearable glasses.

Referring to 5610 of FIG. 56, the smart watch 5600 connected to the wearable glasses 100 can display a list of contents previously output from the wearable glasses 100. The user can check the list of previously outputted content and select the eleventh content 5601 from the list of previously outputted content.

Referring to 5620 of FIG. 56, the smart watch 5600 can provide a selection window from which a device can be selected to display the eleventh content 5601.

When the user selects the visual view 5602 from the selection window, the smart watch 5600 can display the eleventh content 5601 previously output from the wearable glasses 100 on the screen of the smart watch 5600.

When the user selects the HMD view 5603 on the selection window, the smart watch 5500 may request the wearable glasses 100 to output the eleventh content 5601. The wearable glasses 100 can display the eleventh content 5601 according to the request of the smart watch 5600.

57 and 58 are block diagrams illustrating the structure of wearable glasses in accordance with an exemplary embodiment.

As illustrated in FIG. 57, the wearable eyewear 100 according to an exemplary embodiment may include an output device 110 and a controller 120. However, not all illustrated components are essential components. The wearable eyewear 100 can be implemented by more or fewer components than the illustrated components.

For example, as illustrated in FIG. 58, in addition to the output device 110 and the controller 120, the wearable glasses 100 according to an exemplary embodiment may also be included. The user input device 130, the communication interface 140, the sensing circuit 150, the audio/video (A/V) input circuit, and the memory 170 are included. Sensing circuit 150 may also be referred to as a sensor circuit.

Hereinafter, the elements described above will be described in detail.

The output device 110 is configured to output an audio signal, a video signal, or a vibration signal, and may include a display 111, a sound output device 112, and a vibration motor 113.

The display 111 can display information processed by the wearable glasses 100. For example, the display 111 can display content corresponding to the notification event (notification message information). The display 111 can display the content corresponding to the notification event in the form of AR, MR or VR. Again, display 111 can display an indicator indicating the occurrence of a notification event.

Display 111 can display a list of non-output content. The list of non-output content may include the following: a notification content that is not output when a notification event has occurred, and a notification content that includes a portion that is output when a notification event has occurred.

Meanwhile, when the display 111 is configured as a touch screen by forming a layered structure with a touch panel, the display 111 can also be used as a user input device and an output device. The display 111 may include at least one of a liquid crystal display (LCD), a thin film transistor-liquid crystal display (TFT-LCD), and an organic light-emitting diode (organic) Light-emitting diodes; OLEDs, flexible displays, 3D displays, and electrophoretic displays. According to an exemplary embodiment of the wearable eyewear 100, the wearable eyewear 100 can include at least two displays 111.

The sound output device 112 outputs audio material received from the communication interface 140 or stored in the memory 170. Furthermore, the sound output device 112 outputs and A function-related sound signal performed by the wearable eyewear 100, such as a call signal receiving sound, a message receiving sound, or a notification sound. The sound output device 112 can include a speaker or a buzzer.

The vibration motor 113 can output a vibration signal. For example, the vibration motor 113 may output a vibration signal corresponding to an output of the audio material or the video material, for example, a call signal reception sound or a message reception sound. Furthermore, the vibration motor 113 can output a vibration signal when the touch screen is touched.

The output device 110 may provide content corresponding to the notification event according to a method based on the user's movement information determination.

The controller 120 generally controls the overall operation of the wearable eyewear 100. For example, the controller 120 can generally control the output device 110, the user input device 130, the communication interface 140, the sensing circuit 150, and the A/V input circuit 160 by executing a program stored in the memory 170.

When the occurrence of the notification event is detected, the controller 120 can obtain the movement information of the user wearing the wearable glasses 100. The user's mobile information may include at least one of the following: the user's mobile status information, the moving speed information, and the location information.

The controller 120 may determine whether the user is wearing the wearable glasses 100 based on at least one sensor included in the wearable glasses 100, and when determining that the user is wearing the wearable glasses, the controller 120 may obtain the use Mobile information.

The controller 120 may also obtain the user's mobile information by analyzing the user's movement based on at least one of the following: acceleration information, tilt information, and location information measured using the wearable glasses 100.

The controller 120 may determine a time to provide content corresponding to the notification event based on the user's movement information.

When the moving speed of the user is less than the threshold speed, the controller 120 may determine that the notification content is output at the current time, and when the moving speed of the user is equal to or greater than the threshold speed, it is determined that the notification content is output at a different time. The different time may include at least one of: receiving a time point for requesting output of a user input corresponding to the content of the notification event, a time point when the user's movement is changed, and a time when the preset time elapses Point, but not limited to this.

The controller 120 may determine a method of providing content corresponding to the notification event based on the user's movement information. For example, when the moving speed of the user is equal to or greater than the threshold speed, the controller 120 may determine to output a part of the notification content, and if the moving speed of the user is less than the threshold speed, the controller 120 may determine the output. The entire notification content.

The controller 120 may determine to output the notification content in the form of at least one of an audio signal or a video signal in consideration of environmental information about the environment within a certain distance from the wearable glasses 100. The environmental information may include at least one of the following information: external sound information about sound generated within a certain distance from the wearable glasses 100, and information about an external image obtained using the image sensor 161.

The controller 120 can control the display 111 to display the received notification message information based on the signal output from the sensing circuit 150.

The controller 120 may determine whether the user is wearing wearable glasses based on signals output from at least one of the sensors included in the sensing circuit 150, and When the user is wearing the wearable glasses, the controller 120 can control the sensing circuit 150 to sense the movement of the user.

The user input device 130 is for the user to input data for controlling the wearable glasses 100. Examples of the user input device 130 include a keypad, a hemispherical switch, a touch pad (touch capacitance type, pressure resistance film type, infrared light detection type, surface ultrasonic conduction type, integral tensile force measurement type or piezoelectric effect type). ), jog wheel and slow switch, but are not limited to this.

The user input device 130 has been described above with reference to FIG. 2, and thus the repeated description will be omitted.

User input device 130 can receive user input for requesting output of notification content.

User input device 130 can receive a first user input for requesting output of the entire content. For example, the first user input may be at least one of: motion input, touch input, key input, voice input, and multiple input, but is not limited thereto. According to an exemplary embodiment, the first user input for requesting output of the entire notification content may be preset. For example, the user can set the head-up head movement to a first user input for requesting output of the entire notification content.

The user input device 130 can receive a second user input for requesting an output that blocks a portion of the notification content. The second user input can also be various.

User input device 130 can receive user input for requesting a list of non-output content. The user input for requesting a list of non-output content may include the following: input for a certain area of the frame of the touch glasses, input for selecting a button included in the frame of the glasses, for requesting non-output Loss of the list of contents Input, head movement input for raising the head, or the like, but is not limited thereto.

The user input device 130 can receive user input for requesting transmission of the notification content to the external device. The user input device 130 can receive an input for selecting an external device to transmit the notification content. For example, the user input device 130 can receive input for selecting a smart watch and input for requesting transmission of the notification content to the smart watch.

Communication interface 140 may include at least one component that enables wearable glasses 100 to communicate with an external device or server. For example, communication interface 140 can include short-range wireless communication interface 141, mobile communication interface 142, and broadcast receiving circuitry 143.

The short-range wireless communication interface 141 may include a Bluetooth communication interface, a BLE communication interface, an NFC interface, a wireless local area network (WLAN) communication interface, a Zigbee communication interface, and an infrared data association. The IrDA) communication interface, the WFD communication interface, the UWB communication interface, and the Ant+ communication interface, but the components included in the short-range wireless communication interface 141 are not limited thereto.

The mobile communication interface 142 transmits the wireless signal over the mobile communication network to at least one of and receives wireless signals from at least one of: a base station, an external terminal, and a server. Here, the wireless signal may include data in various formats according to the transmission and reception of a voice call signal, a video call signal, or a text/multimedia message.

The broadcast receiving circuit 143 receives a broadcast signal and/or broadcast associated information from an external source via a broadcast channel. The broadcast channel can include satellite channels or terrestrial broadcast channels. In some embodiments, wearable glasses 100 may not include broadcast receiving circuitry 143.

The communication interface 140 can receive notification message information.

The communication interface 140 can request the user's mobile information and receive the mobile information from an external device connected to the wearable glasses 100. When the acceleration information, tilt information, location information, or the like measured using the wearable glasses 100 is transmitted to an external device, the communication interface 140 may request the user's mobile information.

When the captured external image is transmitted to the mobile terminal 200 or the server 300, the communication interface 140 may request analysis of the captured external image. The communication interface 140 can receive at least one of the following information from the mobile terminal 200 or the server 300: change information of the external image, color information of the external image, and object information about the object contained in the external image.

The sensing circuit 150 can sense the state of the wearable glasses 100, the state of the surrounding environment of the wearable glasses 100, the state of the user wearing the wearable glasses 100, the movement of the user, and can sense the information. Transfer to controller 120. For example, the sensing circuit 150 can sense the movement of the user and output a signal related to the movement of the user to the controller 120. The signal can be an electrical signal.

The sensing circuit 150 can include at least one of: a magnetic sensor 151, an acceleration sensor 152, a tilt sensor 153, a depth sensor 154, a gyroscope sensor 155, such as a global positioning system The position sensor 156 (global positioning system; GPS), the atmospheric pressure sensor 157, the proximity sensor 158, and the optical sensor 159, but the components included in the sensing circuit 150 are not limited thereto. The sensing circuit 150 can also include a temperature sensor, an illuminance sensor, a pressure sensor, or a rainbow Membrane scanning sensor. Since the person skilled in the art can intuitively infer the function of each sensor based on the name of the sensor, the details are not described herein.

The A/V input circuit 160 is configured to receive an audio signal or a video signal, and may include a camera (image sensor 161) and a microphone 162. The camera (image sensor) 161 can obtain a still image of the videophone mode or the photographing mode or an image screen of the video. Images captured by the camera (image sensor) 161 can be processed by the controller 120 or a separate image processor (not shown).

The image frame processed by the camera (image sensor) 161 can be stored in the memory 170 or transmitted to the external device via the communication interface 140. According to an exemplary embodiment of the wearable eyewear 100, the wearable eyewear 100 can include at least two cameras (image sensors) 161.

The microphone 162 receives the external sound signal and processes the external sound signal into electronic voice material. For example, the microphone 162 can receive a sound signal from an external device or a reader. The microphone 162 can use any of a variety of noise removal algorithms to remove noise generated when an external sound signal is received.

The memory 170 can store programs for processing and control of the controller 120, and can store input/output data, such as a list of non-output contents, a list of previously outputted contents, captured images, biometric information, use. Schedule information, or user's lifestyle information.

The memory 170 may include at least one of the following storage media: flash memory, hard disk, multimedia card micro memory, card type memory (for example, secure digital (SD) card or extreme digit (extreme) Digital; XD) card), random access memory (RAM), static random Static random access memory (SRAM), read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), Programmable read-only memory (PROM), magnetic memory, disk, and optical disc. Moreover, the wearable glasses 100 can operate a network storage server or a cloud server that performs a storage function of the memory 170 in the Internet.

The programs stored in the memory 170 can be classified into a plurality of modules based on functions, and are classified into, for example, a UI module 171, a notification module 172, an STT module 173, and an image processing module 174.

The UI module 171 can provide a specialized UI or GUI linked to the wearable glasses 100 according to an application. The notification module 172 can generate a signal for notifying that an event has occurred in the wearable eyewear 100. The notification module 172 can output the notification signal in the form of a video signal via the display 111 or in the form of an audio signal via the sound output device 112 or in the form of a vibration signal via the vibration motor 113.

The STT module 173 can convert the speech contained in the multimedia content into text, thereby generating a transcript corresponding to the multimedia content.

The image processing module 174 can obtain object information, edge information, atmosphere information, and color information about the objects included in the captured image by analyzing the captured image.

The methods described above can be implemented as program commands that can be executed using various computer components and that can be recorded on a computer readable recording medium. The computer readable recording medium can include separate or combined program commands, data files, data structures, and the like. Recorded in Program commands in a computer readable recording medium may be specially designed or known to those skilled in the computer software arts. Examples of the computer readable recording medium include a magnetic storage medium (for example, a hard disk, a magnetic disk, a magnetic medium such as a magnetic tape, etc.), an optical recording medium (for example, a CD-ROM or a DVD), and a magneto-optical medium (for example, a floppy disk) ), as well as hardware devices (eg, ROM, RAM, flash memory, etc.) that are specifically configured to store and execute program commands. Examples of program commands include mechanical code prepared by the compiler and high-level languages that can be executed by a computer using an interpreter.

As described above, according to one or more of the above-described exemplary embodiments, the wearable glasses 100 can determine the time at which the notification content is provided based on the movement information of the user and provide a form of the notification content, thereby preventing the user's field of vision. Blocked in a dangerous situation for the user to check the notification content.

The exemplary embodiments described herein are to be considered in a Descriptions of features or aspects within each exemplary embodiment should generally be considered as other similar features or aspects that may be used in other exemplary embodiments.

Although one or more exemplary embodiments have been described with reference to the drawings, it will be understood by those skilled in the art that the invention may be practiced herein without departing from the spirit and scope as defined by the following claims. And various changes in the details.

Claims (13)

A wearable eyewear comprising: a sensing circuit configured to sense movement information of a user wearing the wearable eyeglass; a communication interface configured to receive notification message information; a display configured to Displaying the notification message information within a perspective of the user wearing the wearable glasses; and a controller configured to determine the user based on the sensed movement information of the user a moving state, determining, based on the moving state of the user, at least one of a time for displaying the notification message information and a display form for displaying the notification message information, and controlling the display to display the time at the time The notification message information is displayed or displayed according to the display form, wherein the display form is in the form of at least one of an audio signal and a video signal. The wearable spectacles of claim 1, wherein the controller is further configured to determine whether the user is wearing by using at least one sensor included in the sensing circuit The wearable spectacles and controlling the sensing circuit to sense movement of the user when it is determined that the user is wearing the wearable spectacles. The wearable spectacles of claim 1, wherein the controller is further configured to determine the use by using at least one of the following by the sensing circuit The movement state of the person: acceleration information, tilt information, biometric information, altitude information, atmospheric pressure information, eye tracking information, and location information. The wearable eyewear of claim 1, wherein the controller is further configured to determine the movement state of the user using the user's movement information received from an external device. The wearable spectacles of claim 1, wherein the controller is further configured to output the notification message information at a current time when the movement speed of the user is less than a threshold speed. And when the moving speed of the user is equal to or greater than the threshold speed, the controller is further configured to determine that the notification message information is output at a time different from the current time. The wearable glasses of claim 5, wherein the different time comprises at least one of the following time points: a time point when receiving a user input requesting output of the notification message information, The time point when the user's movement state is changed, and the time point when the preset time has elapsed. The wearable spectacles of claim 1, wherein the controller is further configured to display a portion of the notification message information when the movement speed of the user is equal to or greater than a threshold speed And when the moving speed of the user is less than the threshold speed, the controller is further configured to display all of the notification message information. The wearable spectacles of claim 7, wherein the controller is further configured to determine an audio signal and video based on environmental information about an environment within a certain distance from the wearable spectacles At least one of the signals is an output form of the notification message information. The wearable spectacles of claim 8, wherein the environmental information comprises at least one of: information about an external generated within the certain distance from the wearable spectacles Sound information, as well as about borrowing Information from external images obtained using an image sensor. A wearable eyewear comprising: a sensing circuit configured to sense movement of a user and outputting a signal; a communication interface configured to receive notification message information; and a display configured to display the notification message information And a controller configured to determine a movement state of the user based on the movement of the user, determine a time to display the notification message information based on the movement state of the user, and display the And displaying at least one of the display forms of the notification message information, and controlling the display to display the notification message information at the time or displaying the notification message information according to the display form, wherein the display form is an audio signal and a video signal In the form of at least one of them. The wearable spectacles of claim 10, wherein the controller is further configured to determine whether the user is based on a signal output from at least one sensor included in the sensing circuit The wearable glasses are being worn, and when it is determined that the user is wearing the wearable glasses, the controller is further configured to control the sensing circuit to sense movement of the user . A method of providing information, wherein the method is performed by wearable glasses and includes: receiving notification message information; sensing movement information of a user wearing the wearable glasses; and using the user The sensed movement information determines a movement state of the user; and at least one of a time for displaying the notification message information and a display form for displaying the notification message information based on the movement state of the user And displaying the notification message information at the time or displaying the notification message information according to the display form, wherein the display form is in the form of at least one of an audio signal and a video signal. The method of providing information according to claim 12, wherein the sensing of the user's movement information comprises: determining by using at least one sensor included in the wearable glasses Whether the user is wearing the wearable glasses; and sensing the movement information of the user when determining that the user is wearing the wearable glasses.