KR20160016540A - Method and wearable glasses for providing a content - Google Patents

Abstract

A sensing unit for sensing motion information of a wearer wearing a wearable glass; A communication unit for receiving notification message information; A display unit for displaying notification message information within a viewing angle of the wearer wearing the wearable glass; And a control unit for controlling the display unit to display the received notification message information according to the motion state of the user by determining the motion state of the user using the sensed user motion information.

Description

METHOD AND WEARABLE GLASSES FOR PROVIDING A CONTENT BACKGROUND OF THE INVENTION 1. Field of the Invention [0001] The present invention relates to a wearable glass,

The present invention relates to a method for providing content corresponding to a notification event in wearable glass and wearable glass.

A wearable device is a wearable device. As wearable devices have been actively studied, various types of wearable devices are expected to be released or released. Wearable watches, wearable glasses, and wearable belts are wearable devices that are currently in the market or expected to be released.

Wearable glass is a device that can be worn as wearing glasses and provide various information. The wearable glass frees the user's two hands, but there is a risk that the user's view may be obscured by the information displayed on the wearable glass.

The present invention relates to a content providing method of a wearable glass for determining a method of providing a content corresponding to a notification event using a user's movement pattern information when a notification event occurs.

A wearable glass according to an embodiment of the present invention includes a sensing unit for sensing motion information of a wearer wearing a wearable glass; A communication unit for receiving notification message information; A display unit for displaying the alert message information within a viewing angle of the wearer wearing the wearable glass; And a controller for determining the motion state of the user using the motion information of the sensed user and controlling the display unit to display the received notification message information according to the motion state of the user.

The controller of the wearable glass according to an embodiment of the present invention determines whether the wearable wearable glass is worn by the user based on at least one sensor included in the sensing unit and if the user wears the wearable glass It is possible to control the sensing unit to sense the motion of the user.

The control unit of the wearable glass according to an embodiment of the present invention may use at least one of acceleration information, tilt information, biometric information, altitude information, atmospheric pressure information, eyeball tracking information, and position information measured at the sensing unit, The motion state of the user can be determined.

The controller of the wearable glass according to the embodiment of the present invention can determine the motion state of the user by further using the motion information of the user received from the external wearable device.

The control unit of the wearable glass according to an embodiment of the present invention determines a timing for displaying the notification message information based on the movement state of the user and controls the display unit to display the notification message information at the determined timing can do.

The control unit of the wearable glass according to the embodiment of the present invention determines to output the notification message information at the present time when the moving speed of the user is less than the threshold speed and if the moving speed of the user is equal to or higher than the threshold speed, It is possible to decide to output the information at a predetermined time. Here, the predetermined time may include at least one of a time at which a user input requesting the output of the notification message is received, a time at which the user's movement state changes, and a time at which a preset time has elapsed.

The controller of the wearable glass according to an embodiment of the present invention determines a display form for displaying the alert message information based on the motion state of the user and displays the alert message information according to the determined display form The display unit can be controlled.

The control unit of the wearable glass according to the embodiment of the present invention determines to display a part of the notification message information when the moving speed of the user is equal to or higher than the threshold speed and if the moving speed of the user is less than the threshold speed, It is possible to decide to display the entire image.

The controller of the wearable glass according to an embodiment of the present invention may determine the output form of the notification message information as at least one of an audio signal and a video signal in consideration of environment information within a predetermined distance from the wearable glass. The environment information may include at least one of information on an external sound generated within a predetermined distance from the wearable glass, and information on an external image obtained through the image sensor.

A wearable glass according to an embodiment of the present invention includes a sensing unit sensing a motion of a user and outputting a signal; A communication unit for receiving notification message information; A display unit for displaying the notification message information; And a controller for controlling the display unit to display the received notification message information on the display unit based on the signal output from the sensing unit.

The control unit of the wearable glass according to an embodiment of the present invention determines whether the wearable wearable glass is worn by a user based on a signal output from at least one sensor included in the sensing unit, It is possible to control the sensing unit to sense the motion of the user.

A method of providing information in a wearable glass according to an embodiment of the present invention includes receiving notification message information; Sensing movement information of a wearer wearing the wearable glass; Determining a motion state of the user using the sensed user motion information; And displaying the received notification message information according to the motion state of the user.

In the method of providing information in a wearable glass according to an exemplary embodiment of the present invention, sensing the user's motion information may include sensing wearable wearable glasses based on at least one sensor included in the wearable glass, ; And sensing the motion information of the user when it is determined that the wearable wearer is wearing the wearable glass.

In the method of providing information in the wearable glass according to an embodiment of the present invention, the step of displaying the received notification message information may include: determining a timing for displaying the notification message information; And displaying the notification message information at the determined time.

In the method for providing information in the wearable glass according to an embodiment of the present invention, the step of determining the timing for displaying the notification message information may include: when the moving speed of the user is less than the threshold speed, And outputting the notification message information at a predetermined time when the moving speed of the user is equal to or greater than the threshold speed.

In the method of providing information in the wearable glass according to an embodiment of the present invention, the step of displaying the received notification message information may include: determining a display form for displaying the notification message information; And displaying the notification message information according to the determined display form.

In the method of providing information in the wearable glass according to an embodiment of the present invention, the step of determining the display form may include determining to output a part of the alert message information when the moving speed of the user is equal to or greater than a threshold speed, And if the moving speed of the user is less than the threshold speed, determining to output the entire notification message information.

In the method of providing information in the wearable glass according to an embodiment of the present invention, the step of determining the providing form of the content corresponding to the notification event may include acquiring the environment information within a predetermined distance from the wearable glass; And determining that the notification message information is provided in the form of at least one of an audio signal and a video signal in consideration of the environment information.

The wearable glass according to an embodiment of the present invention acquires movement pattern information of a user who wears the HMD device upon detecting the occurrence of a notification event and displays the movement pattern information of the content corresponding to the notification event A control unit for determining a providing method; And an output unit for providing the content corresponding to the notification event according to the determined providing method.

The controller of the wearable glass according to an embodiment of the present invention judges whether the wearable glass is worn by the user based on at least one sensor included in the wearable glass, and when it is judged that the wearable glass is worn by the user The motion pattern information of the user can be obtained.

The at least one sensor according to an embodiment of the present invention may include at least one of a temperature sensor, a pressure sensor, an illuminance sensor, a proximity sensor, an iris recognition sensor, and an air pressure sensor.

The movement pattern information of the user according to an embodiment of the present invention may include at least one of the operation state information of the user, the movement speed information of the user, and the location information of the user.

The controller of the wearable glass according to an embodiment of the present invention analyzes at least one of the acceleration information, the slope information, and the position information measured in the wearable glass to obtain the user's movement pattern information can do.

The wearable glass according to an embodiment of the present invention may further include a communication unit for requesting an external device connected to the wearable glass of the user's movement pattern information and receiving the movement pattern information of the user from the external device.

The control unit of the wearable glass according to the embodiment of the present invention can determine the providing time of the content corresponding to the notification event based on the user's movement pattern information.

The controller of the wearable glass according to the embodiment of the present invention determines to output the content corresponding to the notification event at the present time when the moving speed of the user is less than the threshold speed, It may be determined to output the content corresponding to the content at a predetermined time.

The predetermined time according to an embodiment of the present invention may include a time point at which a user input requesting output of a content corresponding to a notification event, a time at which a user's movement pattern changes, One can be included.

The controller of the wearable glass according to an embodiment of the present invention can determine the providing form of the content corresponding to the notification event based on the user's movement pattern information.

The controller of the wearable glass according to the embodiment of the present invention determines to output a part of the content corresponding to the notification event when the moving speed of the user is equal to or higher than the threshold speed, It may decide to output the entirety of the corresponding content.

The control unit of the wearable glass according to the embodiment of the present invention can determine the output form of the content corresponding to the notification event as at least one of an audio signal and a video signal in consideration of environmental information within a predetermined distance from the wearable glass.

The environmental information according to an embodiment of the present invention may include at least one of information about an external sound generated within a predetermined distance from the wearable glass, and information about an external image obtained through the image sensor.

A wearable glass according to an embodiment of the present invention includes a sensing unit sensing a motion of a user and outputting a signal; A communication unit for receiving notification message information; A display unit for displaying the notification message information; And a controller for controlling the display unit to display the received notification message information on the display unit based on the signal output from the sensing unit.

The control unit determines whether the user wears the wearable glass based on a signal output from at least one sensor included in the sensing unit, and senses the movement of the user when it is determined that the user wears the wearable glass The sensing unit can be controlled.

A method of providing a content of a wearable glass according to an embodiment of the present invention includes: detecting occurrence of a notification event; Obtaining movement pattern information of a wearer wearing a wearable glass; And determining a method of providing the content corresponding to the notification event based on the movement pattern information of the user.

The step of acquiring the user's movement pattern information according to an embodiment of the present invention includes the steps of: determining whether the wearable glass is worn by a user based on at least one sensor included in the wearable glass; And acquiring movement pattern information of the user when it is determined that the user wears the wearable glass.

The step of determining a method of providing a content corresponding to a notification event according to an embodiment of the present invention includes determining at least one of a providing time and a providing form of the content corresponding to the notification event based on the user's movement pattern information Step < / RTI >

The determining of the providing time according to an embodiment of the present invention may include determining that the content corresponding to the notification event is outputted at the present time when the moving speed of the user is less than the threshold speed, , It may include determining to output the content corresponding to the notification event at a predetermined time.

The step of determining the providing form according to an exemplary embodiment of the present invention determines to output a part of the content corresponding to the notification event when the moving speed of the user is equal to or greater than the threshold speed, And determining to output the entirety of the content corresponding to the event.

The step of determining the providing form of the content corresponding to the notification event according to an embodiment of the present invention includes: acquiring environment information within a predetermined distance from the wearable glass; And considering the environmental information, determining to provide the content corresponding to the notification event in the form of at least one of an audio signal and a video signal.

The method of providing a content of a wearable glass according to an embodiment of the present invention may further include providing content corresponding to a notification event based on the determined providing method.

1 is a view for explaining a method of operating a wearable glass according to an embodiment of the present invention.
2 and 3 are views for explaining the appearance of a wearable glass according to an embodiment of the present invention.
4 is a diagram for explaining a notification providing system according to an embodiment of the present invention.
FIG. 5A is a flowchart for explaining a method in which a wearable glass provides content based on a user's movement pattern information, according to an embodiment of the present invention. FIG.
FIGS. 5B and 5C are diagrams for explaining a method of determining the motion state of the user by using the motion information of the HMD device.
6 is a flowchart illustrating a method of providing a content corresponding to a notification event based on whether a wearable glass wears wearable glass according to an embodiment of the present invention.
7 is a flowchart illustrating a method of detecting occurrence of a notification event of a wearable glass according to an embodiment of the present invention.
8 is a diagram showing an example in which a wearable glass receives a notification message from a server and detects occurrence of a notification event.
9 is a diagram illustrating an example in which a wearable glass detects the occurrence of a notification event by receiving a schedule notification message from a mobile terminal.
10 is a diagram illustrating an example in which a wearable glass detects a notification event by receiving a text message through a mobile terminal.
11 is a diagram showing an example in which a wearable glass detects the occurrence of a notification event by receiving an advertisement content.
12 is a flowchart for explaining a method of acquiring movement pattern information of a user in a wearable glass according to an embodiment of the present invention.
13 is a flowchart for explaining a method in which wearable glass acquires movement pattern information of a user from an external device, according to an embodiment of the present invention.
FIG. 14 is a flowchart for explaining a method of determining the output timing of content corresponding to a notification event based on a moving speed of a wearable glass according to an embodiment of the present invention. FIG.
15A and 15B are diagrams for explaining an example in which wearable glass controls the output timing and method of content corresponding to a notification event according to the moving speed of the user.
16 is a flowchart for explaining a method of determining an output form of content corresponding to a notification event based on user's movement pattern information according to an embodiment of the present invention.
17 to 19 are diagrams for explaining an example in which the wearable glass provides a part or all of the content corresponding to the notification event based on the moving speed of the user.
FIG. 20 is a flowchart for explaining a method of outputting an unreported content when a wearable glass generates a predetermined event according to an embodiment of the present invention. FIG.
21 is a diagram showing an example in which the wearable glass outputs a content corresponding to a previously generated notification event based on a user's movement pattern change event.
22 is a diagram for explaining how a wearable glass changes an output form of content based on a certain input of a user according to an embodiment of the present invention.
23 to 24 are diagrams for explaining an example in which the wearable glass outputting a part of the content outputs the entire content based on the head-up motion of the user.
25 is a diagram for explaining an example in which the wearable glass outputting a part of the content blocks the output of the content based on the user's input.
26 is a flowchart for explaining how a wearable glass highlights a keyword in content corresponding to a notification event, according to an embodiment of the present invention.
FIG. 27 is a diagram for explaining an example in which a wearable glass emphasizes a keyword in content based on a user's movement pattern information according to an embodiment of the present invention. FIG.
28 is a flowchart for explaining a method of controlling the transparency of content corresponding to a notification event in a wearable glass according to an embodiment of the present invention.
29 is a diagram showing an example in which the wearable glass adjusts the transparency based on the speed information when the user is in operation.
30 is a diagram for explaining a method of determining the shape of an output signal based on environment information in a wearable glass according to an embodiment of the present invention.
31 and 32 are views showing an example in which wearable glass according to an embodiment of the present invention adjusts the shape of an output signal based on external sound information.
Fig. 33 is a flowchart for explaining a method in which a wearable glass determines an output form of content corresponding to a notification event based on information about an external image, according to an embodiment of the present invention. Fig.
34 is a view showing an example in which wearable glass according to an embodiment of the present invention adjusts the shape of an output signal based on information about an external image.
35 is a flowchart for explaining a method for determining whether or not wearable glass according to an embodiment of the present invention is to be output based on variation information of an external image.
36 is a diagram showing an example in which the wearable glass changes the output form of the content corresponding to the notification event based on the change amount information of the external image.
37 is a flowchart for explaining a method in which a wearable glass adjusts at least one of transparency, hue, and saturation of a content corresponding to a notification event based on information about an external image, according to an embodiment of the present invention.
38 is a diagram for explaining an example in which the wearable glass adjusts the color of the content corresponding to the notification event based on the information about the external image.
39 is a flowchart for explaining a method for determining the output position of content corresponding to a notification event, in accordance with an embodiment of the present invention.
40 is a diagram for explaining an example in which the wearable glass changes the output position of the content corresponding to the notification event.
FIG. 41 is a flowchart for explaining a method of determining a method of providing content corresponding to a notification event based on user's setting information, according to an embodiment of the present invention.
42 is a diagram showing an example of setting information related to the output of the content corresponding to the notification event.
43 and 44 show an example in which the wearable glass outputs the content corresponding to the notification event based on the setting information of the user.
45 is a flowchart for explaining a method in which wearable glass receives emergency alert information from an external wearable device according to an embodiment of the present invention;
46 is a diagram showing an example in which the wearable glass displays pulse rate information received from an external wearable device;
47 is a flowchart for explaining how a wearable glass outputs content corresponding to a notification event via an external device, according to an embodiment of the present invention.
48 is a diagram showing an example in which a wearable glass outputs content corresponding to a notification event through an external device based on user input.
49 is a flowchart for explaining how wearable glass transmits content corresponding to a notification event to an external device in response to a request from an external device, according to an embodiment of the present invention.
50 is a diagram showing an example of displaying content corresponding to a notification event in an external device based on a user input received through an external device connected to the wearable glass.
51 is a flowchart for explaining a method in which wearable glass outputs content corresponding to a notification event through an external device based on user's movement pattern information according to an embodiment of the present invention.
52 is a view showing an example in which the wearable glass outputs the content corresponding to the notification event through the external device based on the movement pattern information of the user.
53 is a flowchart for explaining a method of providing a list of contents in which wearable glass is not output, according to an embodiment of the present invention.
54 is a diagram showing an example in which the wearable glass provides a list of unreported contents based on a user's specific input.
FIG. 55 is a diagram showing an example in which a wearable device connected to wearable glass provides a list of contents that have not yet been output in the wearable glass. FIG.
56 is a diagram showing an example in which a wearable device connected to a wearable glass provides a list of contents output in a wearable glass.
57 and 58 are block diagrams for explaining the configuration of a wearable glass according to an embodiment of the present invention.

The terms used in this specification will be briefly described and the present invention will be described in detail.

While the present invention has been described in connection with what is presently considered to be the most practical and preferred embodiment, it is to be understood that the invention is not limited to the disclosed embodiments. Also, in certain cases, there may be a term selected arbitrarily by the applicant, in which case the meaning thereof will be described in detail in the description of the corresponding invention. Therefore, the term used in the present invention should be defined based on the meaning of the term, not on the name of a simple term, but on the entire contents of the present invention.

When an element is referred to as "including" an element throughout the specification, it is to be understood that the element may include other elements as well, without departing from the spirit or scope of the present invention. Also, the terms "part," " module, "and the like described in the specification mean units for processing at least one function or operation, which may be implemented in hardware or software or a combination of hardware and software .

Hereinafter, embodiments of the present invention will be described in detail with reference to the accompanying drawings so that those skilled in the art can easily carry out the present invention. The present invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments set forth herein. In order to clearly illustrate the present invention, parts not related to the description are omitted, and similar parts are denoted by like reference characters throughout the specification.

1 is a view for explaining a method of operating a wearable glass according to an embodiment of the present invention.

According to one embodiment of the present invention, a head mounted display (HMD) device 100 refers to a display device mounted on a head of a user and capable of providing an image in front of the user's eyes. According to an embodiment of the present invention, the HMD device 100 may be implemented in various forms. For example, the HMD device 100 may be in the form of at least one of glasses, a helmet, and a cap, but is not limited thereto. The present invention is not limited to the glasses wearable glass, but may be applied to various types of HMD devices capable of displaying information within a user viewing angle by fixing a part of the main body to the user's head.

According to one embodiment of the present invention, the wearable glass 100 can provide the content 10 corresponding to the notification event. In this specification, providing content may include displaying the content, playing the content, or outputting the content.

In this specification, the notification event may mean an event in which information to be notified to the user is generated. The notification event may be an event for notifying a situation occurring inside the wearable glass 100 or an event for delivering a situation occurring outside the wearable glass 100. [

For example, the notification event may include at least one of a schedule notification event, a tourist information notification event, a traffic information notification event, an advertisement notification event, an update notification event, a recommended content notification event, a health information notification event, and an emergency notification event But is not limited thereto.

In this specification, 'content 10 corresponding to a notification event' may mean content generated for informing a user. The content 10 corresponding to the notification event may be generated in the wearable glass 100 or may be acquired from the outside of the wearable glass 100. For example, the wearable glass 100 can generate the content 10 corresponding to the notification event when the notification event is generated. In addition, the wearable glass 100 may receive the content 10 corresponding to the notification event from an external device or a server. Hereinafter, the 'content 10 corresponding to the notification event' may be expressed as 'notification message information'.

Throughout the specification, 'content' refers to digital information provided through wired and wireless communication networks. The content according to an exemplary embodiment of the present invention may include at least one of a moving picture content, a still picture content (e.g., a picture and a picture), a text content (e.g., a newspaper article, a letter and a web page), a music content Radio broadcast, etc.), but are not limited thereto.

According to an embodiment of the present invention, the 'content 10 corresponding to a notification event' includes a predetermined notification content (a dosage notification message, a schedule notification message), a tourist information notification content (e.g., (E.g., bus schedule), advertisement notification content (e.g., coupon), update notification content (e.g., software or hardware update notification), recommendation content Such as, for example, blood glucose level information, heart rate information, temperature information, and the like, and emergency alert content, but is not limited thereto. Hereinafter, the 'content 10 corresponding to the notification event' may be described as 'notification content' for convenience of explanation.

According to one embodiment of the present invention, the wearable glass 100 can provide alert content in various forms. For example, the wearable glass 100 may display the alert content on the display unit in the form of Augmented Reality (AR), Mixed Reality (MR), or Virtual Reality (VR).

According to an embodiment of the present invention, when the wearable glass 100 outputs the notification content as soon as the occurrence of the notification event is detected without considering the situation of the user, the user's view is obscured, Can be exposed. Therefore, in the following, a detailed description will be given of how the wearable glass 100 determines the providing time and providing form of the notification content based on the user's movement pattern information (hereinafter, also referred to as "motion state") Let's look at it. Before this, the appearance of the wearable glass 100 will be described in detail with reference to FIG. 2 to FIG.

2 and 3 are views for explaining the appearance of a wearable glass according to an embodiment of the present invention. 2 and 3, the case where the wearable glass 100 is in the form of glasses will be described as an example.

2, the wearable glass 100 includes a frame 101, a lens 102, a power supply unit 103, a display unit 111, a sound output unit 112, a control unit 120, a user input unit 130, an image sensor 161, and a depth sensor 154. However, not all of the components shown in Fig. 2 are essential components of the wearable glass 100. Fig. The wearable glass 100 may be implemented by more components than the components shown in Fig. 2, or the wearable glass 100 may be implemented by fewer components than the components shown in Fig. For example, according to one embodiment of the present invention, the wearable glass 100 may not include the lens 102.

Some components included in the wearable glass 100 may be embedded in the wearable glass 100 and some other components may be mounted outside the wearable glass 100. [ For example, the power supply unit 103 and the control unit 120 may be embedded in the wearable glass 100. The display unit 111, the sound output unit 112, the user input unit 130, the image sensor 161, and the depth sensor 154 may be mounted outside the wearable glass 100. The components incorporated in the wearable glass 100 and the components mounted on the outside of the wearable glass 100 are not limited to those described above.

The frame 101 may be made of a material such as plastic and / or metal, and may include wires connecting components included in the wearable glass 100 to each other.

According to one embodiment of the present invention, the frame 101 includes a connecting member (not shown) so that at least a part of the frame 101 can be configured to be foldable. According to an embodiment of the present invention, the wearable glass 100 may further include elastic bands such that the wearable glass 100 is fixed to the user's head regardless of the size of the user's head.

Meanwhile, according to an embodiment of the present invention, the frame 101 may be configured to enable the lens 102 to be detachable.

The lens 102 may be made of a transparent material through which the user can see the actual space through the lens 102. [ For example, the lens 102 may comprise, but is not limited to, plastic, such as polycarbonate, or glass material.

According to one embodiment of the present invention, the lens 102 may include at least one of a light reflection and anti-glare coating, an anti-fog coating, and an ultraviolet blocking coating.

The power supply unit 103 can supply a power required for the operation of the wearable glass 100 to each configuration. The power supply unit 103 may include a battery (not shown) capable of charging electric power, and may include a cable (not shown) or a cable port (not shown) capable of receiving electric power from the outside.

The power supply unit 103 may be disposed at various positions on the frame 1010 of the wearable glass 100. For example, the power supply unit 103 may be located at the end of the frame 101 of the wearable glass 100.

The display portion 111 may include a semi-transparent optical waveguide (e.g., a prism). A translucent light wavelength guide (e.g., a prism) can focus the image on the fovea of the retina of the user's eye that wears the wearable glass 100 by reflecting the light output from the projector. According to an embodiment of the present invention, when the notification event occurs, the display unit 111 may display the content corresponding to the notification event. The content may be notification message information. The notification message information may be an advertisement message for advertising to a specific number of users or may be a message for only a user of the wearable glass 100. Also, according to one embodiment of the present invention, the notification message information may be a message related to a specific application. The notification message information may be received through the communication unit. In addition, the notification message information can be generated within the wearable glass 100 itself. For example, a message indicating the remaining amount of the battery may be generated inside the wearable glass 100. [

In addition, the display portion 111 may replace the lens 102 of the present invention or replace a portion of the lens 102.

For example, in the case of a wearable glass, the lens 102 and the display area can be the same. In this case, while the user is viewing an actual object through the lens 102, the notification message information is received, and the received notification message information may be displayed on the lens 102. [ If the notification message information is displayed in an area of the entire area of the lens 102 that is outside the viewing angle of the user, the user must move the pupil to view the notification message information. On the other hand, when the alert message information is displayed in the entire area of the lens 102 in the area corresponding to the viewing angle of the user, the user does not need to turn his or her head to check the alert message information.

Accordingly, when the user wears an HMD 100 device such as a wearable glass, a first area corresponding to the viewing angle of the user can be set on the display unit 111, and notification message information can be displayed in the first area have. The viewing angle of the user may mean an angle or a range at which the user can recognize the object without turning the head or the eye while watching the front. For example, the viewing angle of the user may be 45 degrees vertically and 90 degrees horizontally, but it is not limited thereto.

According to an embodiment of the present invention, the first area corresponding to the viewing angle of the user may be the same as the entire display area, or may be smaller than the entire display area. In addition, the first area corresponding to the viewing angle of the user may be determined or adjusted based on the distance from the user's eyes to the lens 102. [

The sound output unit 112 may be configured in the form of an earphone that can be mounted on a user's ear. In this case, the sound output unit 112 can be mounted in a fixed form to the wearable glass 100. For example, the sound output section 112 may include a bone conduction speaker.

The sound output unit 112 may be configured to be detachable from the wearable glass 100. In this case, the user of the wearable glass (000) can selectively mount the sound output unit 112 on the ear.

The control unit 120 may be connected to the wearable glass 100 in a wired or wireless manner to control each configuration of the wearable glass 100. For example, the control unit 120 may receive data from the image sensor 161 or the user input 130, analyze the received data, and transmit the data through at least one of the display 111 and the sound output unit 112 The alert content can be output.

The user input unit 130 receives a user input. The user input may include a command or request from the user for causing the wearable glass 100 to start or end a predetermined operation.

According to an embodiment of the present invention, the user input unit 130 may include a touch panel for receiving a touch input. The "touch input" in the entire specification means a gesture or the like which the user performs on the touch panel to control the wearable glass 100. For example, the touch input described herein may include a tap, a touch & hold, a double tap, a drag, a panning, a flick, a drag and drop,

According to one embodiment of the present invention, the user input 130 may include a bending sensor for receiving a bending input. The "bending input" throughout the specification refers to an input in which the user bends all or a part of the wearable glass 100 to control the wearable glass 100. According to an embodiment of the present invention, the wearable glass 100 uses a bending sensor to measure a bending position (coordinate value), a bending direction, a bending angle, a bending speed, a bending frequency, Lt; / RTI >

According to an embodiment of the present invention, the user input unit 130 may receive multiple inputs. Throughout the specification, " multiple input " means that at least two input methods are combined. For example, the wearable glass 100 may receive the touch input and the motion input of the user or the touch input and the voice input of the user. In addition, the wearable glass 100 may receive a user's touch input and eye input. The eyeball input means an input for controlling the wearer's eyeglasses 100 to control the blinking of the eye, the gazing position, the eyeball moving speed, and the like.

Meanwhile, according to an embodiment of the present invention, the wearable glass 100 may further include a microphone (not shown). The microphone can receive the user's voice, the sound of the surrounding environment of the wearable glass 100, and the like.

The image sensor 161 may be a small camera such as a camera or a webcam used in a smart phone. When the wearable glass 100 is worn by the user, the image sensor 161 is mounted at a position adjacent to the user's eyes, so that the image sensor 161 can photograph a video similar to the image recognized through the user's eyes.

According to one embodiment of the present invention, the wearable glass 100 may further include a depth sensor 154. The wearable glass 100 can recognize the gesture on the user's three-dimensional space using the depth sensor 154. [ For example, the depth sensor 154 may measure the depth value of an input tool (e.g., a hand, a finger or an electronic pen, etc.).

According to one embodiment of the present invention, the depth sensor 154 may obtain the depth value of the input tool in a variety of ways. For example, the depth sensor 112 may measure the depth value using at least one of a time of flight (TOF) method, a stereoscopic vision method, and a structured light pattern method. have.

The TOF (Time of flight) method refers to a method of measuring the distance to an object by analyzing the time that light returns from the object. In a TOF system, an infrared LED emits an infrared pulse, and an infrared camera measures the arrival time of the light reflected from the object. In this case, the depth sensor 154 may include an infrared LED and an infrared camera. The depth sensor 154 can shoot distance information in the form of a moving picture by repeating firing and receiving light several times per second. The depth sensor 154 may also generate a depth map that expresses distance information in terms of brightness or color of each pixel.

Stereoscopic vision means a method of shooting three-dimensional objects using two cameras. In this case, the depth sensor 154 may include two cameras. The depth sensor 154 can calculate the distance based on the principle of triangulation using the difference information of the images viewed by each camera. The person feels a three-dimensional feeling through the difference between the left eye and the right eye, and the depth sensor 154 measures the distance in a manner similar to that of the human eye. For example, if the distance is close, the difference between the images captured by the two cameras is large. If the distance is long, the difference between the images captured by the two cameras is small.

In the structured light pattern method, light with a pattern is projected onto an object, and the position of the pattern formed on the object surface is analyzed to measure the distance to the object. The depth sensor 154 generally projects a linear pattern or a dot pattern onto an object, and the pattern changes depending on the bending of the object.

The structured light pattern system is a structure in which one of the two cameras used in the stereoscopic vision system is replaced with a light projector. For example, the depth sensor 154 can calculate the depth map in real time by analyzing the position of the pattern formed by the light emitted by the infrared projector on the surface of the object by an algorithm.

According to one embodiment of the present invention, the image sensor 161 and the depth sensor 154 may be separate sensors. Further, according to another embodiment of the present invention, the image sensor 161 and the depth sensor 112 may be in the form of a single sensor.

According to an embodiment of the present invention, the wearable glass 100 may further include various sensors in addition to the image sensor 161 and the depth sensor 154.

For example, the wearable glass 100 may include sensors for sensing a user's motion input. In the specification, "motion input" means a motion that the user applies to the wearable glass 100 to control the wearable glass 100. For example, the motion input may include an input by which a user rotates the wearable glass 100, tilts the wearable glass 100, or moves the wearable glass 100 up, down, left, and right. The wearable glass 100 is provided with a motion input predetermined by a user by using an acceleration sensor, a tilt sensor, a gyro sensor, a 3-axis magnetic sensor, Can be detected.

In addition, the wearable glass 100 may include a sensor capable of detecting whether the wearable glass 100 is worn by the user. For example, the wearable glass 100 may include a temperature sensor, a pressure sensor, an acceleration sensor, a proximity sensor, an iris recognition sensor, and the like.

The wearable glass 100 may further include an eye tracking camera (not shown) facing the user's face. At this time, the eye tracking camera may include an infrared camera. The eye tracking camera can detect the user's gaze by tracking the user's eyes.

3, the wearable glass 100 may be configured such that the lens 102 functions as the display unit 111. [ In this case, the lens 102 may be composed of a transparent display or a translucent display. When the lens 102 is configured as a translucent display, the lens 102 may be made of a material such as at least one optical waveguide (e.g., a prism), an electroluminescent display, or a liquid crystal display But is not limited thereto.

2 and 3, the case where the wearable glass 100 is in the form of glasses has been described as an example. But is not limited thereto. For example, the wearable glass 100 may be attached to a helmet structure or deformed into a goggle shape.

Meanwhile, according to an embodiment of the present invention, the wearable glass 100 may be a stand-alone device that can operate without the help of any other device. In addition, the wearable glass 100 may be a device cooperating with a mobile terminal or a cloud server. Hereinafter, a case where the wearable glass 100 is interlocked with another apparatus will be described with reference to FIG.

4 is a diagram for explaining a notification providing system according to an embodiment of the present invention.

Referring to FIG. 4, a notification providing system according to an embodiment of the present invention may include a wearable glass 100, a mobile terminal 200, and a server 300. However, not all of the components shown in Fig. 4 are essential components of the notification providing system. The notification providing system may be implemented by more components than the components shown in Fig. 4, or the notification providing system may be implemented by fewer components than the components shown in Fig. For example, the notification providing system may be implemented by the wearable glass 100 and the mobile terminal 200, or by the wearable glass 100 and the server 300.

The wearable glass 100 may be communicatively coupled with the mobile terminal 200 or the server 300. [ For example, the wearable glass 100 may perform close-range communication with the mobile terminal 200. Examples of local area communication may include Wi-Fi, Near Field Communication (NFC), Bluetooth, Bluetooth Low Energy (BLE), ZigBee, WFD (Wi-Fi Direct), UWB (ultra wideband) The wearable glass 100 may be connected to the server 300 through wireless communication or mobile communication.

The mobile terminal 200 can transmit predetermined data to the wearable glass 100 or receive predetermined data from the wearable glass 100. [ For example, the mobile terminal 200 may deliver a notification message or control command to the wearable glass 100.

Meanwhile, the mobile terminal 200 can be implemented in various forms. For example, the mobile terminal 200 described in the present specification may be used in a mobile phone, a smart phone, a laptop computer, a tablet PC, an electronic book terminal, a digital broadcast terminal, a PDA (Personal Digital Assistants) A portable multimedia player (PMP), a navigation device, an MP3 player, a digital camera, and the like.

The server 300 may be a cloud server managing the wearable glass 100. In addition, the server 300 may be a contents provider that provides a notification message.

According to an embodiment of the present invention, the server 300 may include an intelligence engine, and the server 300 may analyze the movement pattern (state) of the user through the intelligence engine. The operation of the server 300 for analyzing the movement pattern (state) of the user will be described later in detail with reference to FIG. The user's movement pattern (state) can be analyzed by the mobile terminal 200 connected to the wearable glass 100 itself or the wearable glass 100 in a short distance communication or communication manner in addition to the server 300.

The movement pattern analyzed by the server 300 may be transmitted directly to the wearable glass 100 or transmitted to the wearable glass 100 through the mobile terminal 200 connected to the wearable glass 100 in a short- .

Hereinafter, a method in which the wearable glass 100 provides alert content based on the user's movement pattern information will be described in detail with reference to FIG.

FIG. 5A is a flowchart for explaining a method in which a wearable glass provides content based on a user's movement pattern information, according to an embodiment of the present invention. FIG.

In step S510, the wearable glass 100 can detect occurrence of a notification event.

According to an embodiment of the present invention, the wearable glass 100 can detect that internal system notification information or external notification information that should be notified to the user has occurred. For example, the wearable glass 100 can detect that an event has occurred that should display a notification message about the battery remaining amount when the battery remaining amount is equal to or smaller than the threshold value.

In addition, when the wearable glass 100 receives notification message information from the mobile terminal 200 or the server 300, the wearable glass 100 can detect that an event to output the notification message information has occurred. At this time, the wearable glass 100 can receive notification message information through the communication unit.

In addition, the wearable glass 100 can change the color of the display unit 111 when an event to output the notification message information occurs. That is, the control unit 120 may control the display unit 111 to change the color of the display unit 111 based on reception of the notification message information.

For example, when a notification message arrives, the display unit 111 can display the entire screen in orange for one second. The user can recognize that the notification message has arrived as the entire color of the display unit 111 is changed to orange.

In step S520, the wearable glass 100 can acquire the motion information of the wearer wearing the wearable glass 100 when the occurrence of the notification event is detected.

The user's motion information may be information on the motion of the wearer wearing the wearable glass 100. The user's motion information may be, in a narrow sense, information about the motion of the user, and in a broad sense may include a change in the user's biometric information. For example, the motion information of the user may include motion information of a user, moving speed information of a user, moving direction information of a user, slope information of a user, altitude information of a user, biometric information of a user such as body temperature information, Eye blinking speed information, eye blinking speed information, gaze direction information, etc.), and user's location information (e.g., GPS coordinate value information, local information, building information, etc.) Information of position change amount for a predetermined time, etc.), but the present invention is not limited thereto. The user's motion information includes pressure information applied to the nose of the wearable glass as the user moves, voice information of the user recognized through the microphone while the user speaks, alcohol smell information measured according to the user's drinking It is possible.

According to an embodiment of the present invention, the wearable glass 100 can sense motion information of a user by using at least one sensor included in the wearable glass 100. For example, at least one of an acceleration sensor, a position sensor, a tilt sensor, a pressure sensor, an altitude (air pressure) sensor, a living body sensor, an iris recognition sensor, an image sensor, a microphone, an odor sensor, Can be sensed.

The wearable glass 100 can determine the motion state of the user by using the motion information of the user. Here, the user's movement state may be a walking state, a stopped state, a beating state, a sleeping state, a driving state, a running state, a speaking state (or conversation state), an exercise (for example, jogging, swimming, , Climbing, etc.), a drinking state, a standing state, a sitting state, a lying state, and the like, but is not limited thereto. 5B, an example in which the wearable glass 100 determines the motion state of the user using the motion information of the user will be described in detail.

FIGS. 5B and 5C are diagrams for explaining a method of determining wearer's movement state of a wearable glass.

5B and 5C, the wearable glass 100 can determine whether the user is in a stopped state, walking state, or beating state by using at least one of an acceleration sensor, a tilt sensor, a position sensor, and a pressure sensor . For example, the wearable glass 100 uses the acceleration information measured by the acceleration sensor to determine that 1) the user is stationary when the user moves on average 0.001 km / h for a certain period of time, 2) If the user moves on average 4 km / h during the time, the user is judged to be walking. 3) If the user moves on average 15 km / h for a certain period of time, the user can be judged to be running.

In addition, the wearable glass 100 uses the position change amount information measured by the position sensor to determine whether or not the user is in a stop state (e.g., a position change amount < a first change value) (E.g., a second change value) or a beating state (e.g., a second change value? A position change amount).

The wearable glass 100 uses the tilt information measured by the tilt sensor to determine whether the user is in a stopped state (for example, a tilt change <the first threshold value), a walking state (e.g., a first threshold value tilt variation < Threshold value) or a skipping state (e.g., a second threshold value? Slope change amount). As the moving speed of the user increases, the tilt variation measured by the tilt sensor may also increase.

The wearable glass 100 is configured to determine whether the user is in a stopped state (e.g., a measured pressure < a first pressure value) or a walking state (a first pressure value) by using pressure information applied to a pressure sensor attached to a nose of a wearable glass, The first pressure value? The measurement pressure? The second pressure value) or the beating state (the second pressure value? The measurement pressure). As the user moves faster, the pressure value measured by the pressure sensor may increase.

The wearable glass 100 may use an altitude sensor (air pressure sensor) to determine whether the user is standing, sitting, or lying down. For example, the wearable glass 100 uses the altitude information measured by the altitude sensor (atmospheric pressure sensor) to determine whether the altitude of the wearable glass 100 is 1) the altitude of the altitude is greater than or equal to the first altitude value 2) If the measured altitude value is smaller than the first altitude value and equal to or greater than the second altitude value (first altitude value> measured altitude ≥ second altitude value), it is determined that the user is in a sitting state, and 3 ) If the measured altitude value is smaller than the second altitude value (altitude < second altitude value), it can be judged that the user is lying. The altitude value measured by the altitude sensor may be small when the user is lying down than when standing.

The wearable glass 100 may use at least one of an acceleration sensor, an altitude sensor, a position sensor, and a living body sensor to determine that the user is in a state of being climbed. For example, in the wearable glass 100, the positional information measured by the position sensor is 'mountainous zone' and the altitude change during the predetermined time measured by the altitude sensor is not less than the threshold value (altitude change amount? Threshold value) (Sweat discharge amount> threshold value, body temperature change amount> threshold value, average pulse number> threshold value) when the sweat discharge amount, the body temperature change amount, and the average pulse number measured by the sensor are larger than the threshold value.

The wearable glass 100 may use at least one of an iris recognition sensor, an image sensor, a microphone, an acceleration sensor, and a tilt sensor to determine that the user is sleeping. For example, the wearable glass 100 may detect that iris is not recognized for a predetermined period of time if the number of eye blinking times of the user measured through the iris recognition sensor is less than the threshold number of times (for example, blink detection is performed once for 10 minutes) (E.g., no iris recognition for 5 minutes), the user can be judged to be in the sleep state.

In addition, the wearable glass 100 can capture an image of the user's eye at predetermined intervals using an image sensor, and detect the pupil through edge analysis of the captured eye image. At this time, when the pupil is not detected in the image of the eye captured for a predetermined time (for example, the pupil is not detected for 5 minutes or more), the wearable glass 100 can judge that the user is sleeping.

The wearable glass 100 may analyze the sound signal obtained through the microphone, and may determine that the user is sleeping when a sound of the snoring pattern is sensed. At this time, if the motion value of the head measured by the acceleration sensor or the tilt sensor is equal to or greater than the threshold value, the wearable glass 100 may determine that the user is sitting and sleeping.

The wearable glass 100 may use the voice information obtained through the microphone to determine whether the user is talking (or talking). For example, the wearable glass 100 may analyze the voice information obtained through the microphone, and may determine that the user is speaking when the voice of the user is recognized. In addition, the wearable glass 100 can determine that the user is in conversation when not only the voice of the user but also the voice of the other person is recognized in the voice information obtained through the microphone.

The wearable glass 100 may determine the movement state of the user by using the smell information measured by the smell sensor. For example, the wearable glass 100 can determine that the user is drinking when the smell of the alcohol is recognized for a predetermined period of time as a result of analyzing the smell information measured by the smell sensor.

The wearable glass 100 can determine the state in which the user is driving by using at least one of the acceleration sensor, the image sensor, and the near field communication module. For example, the wearable glass 100 is configured such that the speed change amount measured over a predetermined period of time by the acceleration sensor is equal to or greater than a threshold value (average 40 km / h) and the vehicle handle is detected in the image captured through the image sensor When the automobile handle is detected at a viewing angle), the wearable glass 100 can determine that the user is driving.

Further, the wearable glass 100 may determine that the user is driving by using information received from the vehicle through close-range communication (e.g., Bluetooth). For example, when the user touches the start button, the automobile identifies the fingerprint of the user and transmits the start information of the user to the wearable glass matched with the fingerprint of the user. In this case, the wearable glass can recognize that the user is starting the operation based on the operation start information received from the automobile.

Meanwhile, according to an embodiment of the present invention, the wearable glass 100 may determine the movement state of the user using the context information of the user. The context information may be stored in the personalization server or the wearable glass 100 of the user.

For example, the wearable glass 100 can determine the movement state of the user using the user's schedule information and life pattern information. If the user moves from home to a specific location (for example, a company) at 8:00 on a weekday morning, the wearable glass 100 stores information on the user's working time, work distance information, and company location information as context information Can be managed. Therefore, if the current time is Monday at 8:20 in the morning and the present location is near the subway station, the wearable glass 100 can judge that the user is coming to work.

In addition, if the average moving speed of the user is 0.0001 km / h for a predetermined time and the user is located in the office for a predetermined time, the wearable glass 100 may determine that the user is working.

According to an embodiment of the present invention, the wearable glass 100 may analyze the motion state of the user by using biometric information measured in an external wearable device. A wearable device according to an embodiment of the present invention may include, but is not limited to, rings, necklaces, bands, wrist watches, shoes, earrings, hair bands, clothes, gloves,

For example, the wearable glass 100 can receive pulse rate information, blood pressure information, heart rate information, body temperature information, and the like measured at the wearable device. At this time, the wearable glass 100 may receive biometric information from the wearable device through the mobile terminal 200, or may receive the biometric information directly from the wearable device. The wearable glass 100 can determine that the user is exercising when the average pulse rate of the user is equal to or greater than the threshold number of times for a predetermined period of time.

According to one embodiment of the present invention, the wearable glass 100 is configured to determine whether the user is in a stopped state, a walking state, or a beating state by using acceleration information, pressure information, altitude information, , Climbing state, and the like. For example, when the user's movement speed is equal to or higher than the threshold value and the pressure pattern of the sole measured by the pressure sensor attached to the running shoes is similar to the pattern of climbing, the wearable glass 100 judges that the user is climbing can do.

According to an embodiment of the present invention, the wearable glass 100 may determine the movement state of the user based on the mode information set by the user. For example, the user can manually set the operation mode of the wearable glass 100 to the operation mode, the exercise mode, the work mode, and the like. If the user sets the operation mode of the wearable glass 100 to the operation mode, the wearable glass 100 can determine that the user is driving.

The control unit 120 may determine the motion state of the user using the motion information of the user and may control the display unit 111 to display the received notification message information according to the motion state of the user.

Meanwhile, according to an embodiment of the present invention, the wearable glass 100 may request and receive the user's motion state information from an external device connected to the wearable glass 100. [ At this time, the external device may be the mobile terminal 200 or the server 300. The operation of analyzing the user's motion state in the external device will be described in detail later with reference to FIG.

In step S530, the wearable glass 100 can determine how to provide the content (notification message information) corresponding to the notification event based on the movement state of the user.

According to one embodiment of the present invention, the wearable glass 100 can determine when to provide the notification content (notification message information). For example, the wearable glass 100 can determine whether the movement speed of the user is less than a critical speed by using the movement state information of the user. When the moving speed of the user is less than the critical speed (for example, 3 km / h), the wearable glass 100 can decide to output the notification content at the present time. The present time point may be within a predetermined time (for example, within 30 seconds) from the time when the wearable glass 100 senses the occurrence of the notification event.

On the other hand, when the moving speed of the user is equal to or higher than the critical speed, the wearable glass 100 can decide to output the notification content at a predetermined time. The preset time may be a predetermined time (for example, 10:00 at night). In addition, the preset time may refer to a time when a predetermined event occurs.

The predetermined event may include at least one of an event for receiving a user input requesting the output of the notification content, an event for which a predetermined time elapses, and an event for which a movement pattern of the user changes, but the present invention is not limited thereto.

According to one embodiment of the present invention, the wearable glass 100 may determine the providing form of the notification content. For example, the wearable glass 100 can determine whether the moving speed of the user is less than a critical speed (for example, 4 km / h) by using the user's movement pattern information. When the moving speed of the user is equal to or greater than the threshold speed, the wearable glass 100 may decide to output a part of the notification content, and may determine to output the entire notification content when the moving speed of the user is less than the threshold speed.

A portion of the content may include, but is not limited to, a keyword of the content, a summary of the content, and a title of the content.

According to one embodiment of the present invention, the wearable glass 100 may determine to provide the notification content in the form of at least one of an audio signal and a video signal, based on the user's movement pattern information. For example, the wearable glass 100 may determine to output the alert content as a video signal when the user is talking to someone else, and to output the alert content as an audio signal if the user is driving.

Hereinafter, an operation of providing the notification content based on whether the wearable glass 100 wears the wearable glass 100 will be described in detail with reference to FIG.

6 is a flowchart illustrating a method of providing a content corresponding to a notification event based on whether a wearable glass wears wearable glass according to an embodiment of the present invention.

In step S610, the wearable glass 100 can detect occurrence of a notification event. Since step S610 corresponds to step S510 of FIG. 5, a detailed description will be omitted.

In step S620, the wearable glass 100 may determine whether the wearable glass 100 is worn by the user.

According to an embodiment of the present invention, the wearable glass 100 is provided with at least one of sensors (for example, a temperature sensor, a pressure sensor, an illuminance sensor, a proximity sensor, an iris recognition sensor, and an air pressure sensor) included in the wearable glass 100 ) Can be used to judge whether or not the wearable glass 100 is worn by the user. For example, the wearable glass 100 can determine that the user wears the wearable glass 100 when the value of the temperature sensor or the pressure sensor attached to the eyeglass nose pad or the eyeglass legs is equal to or greater than the threshold value. In addition, when the wearable glass 100 succeeds in recognizing the user's iris by using the iris recognition sensor, the wearable glass 100 can determine that the wearable glass 100 is worn by the user.

The wearable glass 100 may determine that the user wears the wearable glass 100 when the tilt value measured using the tilt sensor continuously changes.

When the wearable glass 100 includes a speaker and a microphone inside the eyeglass legs, a sound signal is output to the speaker and a reflected echo signal can be acquired by the microphone. At this time, the wearable glass 100 can determine whether or not the wearer wears the wearable glass 100 by using the information about the echo signal.

Meanwhile, according to one embodiment of the present invention, the wearable glass 100 can more accurately determine whether or not the user wears the wearable glass 100 by combining information measured using a plurality of sensors.

In step S630, the wearable glass 100 can acquire the movement pattern information of the user when it is determined that the wearable glass 100 is worn by the user. In step S640, the wearable glass 100 can determine how to provide the notification content based on the user's movement pattern information. Steps S630 and S640 correspond to steps S520 and S530 of FIG. 5, and a detailed description thereof will be omitted.

On the other hand, when it is determined that the wearable glass 100 is not worn by the user, the wearable glass 100 may not provide the notification content even if it detects the occurrence of the notification event.

7 is a flowchart illustrating a method of detecting occurrence of a notification event of a wearable glass according to an embodiment of the present invention.

In step S710, the external device 700 can generate a notification message. The notification message may be an advertisement message for advertising to a specific number of users or may be a message for only the user of the wearable glass 100. Further, according to an embodiment of the present invention, the notification message may be a message related to a specific application.

The external device 700 may be at least one of a server 300 connected to the wearable glass 100, a mobile terminal 200 connected to the wearable glass 100, a wearable device connected to the wearable glass 100, have.

In step S720, the external device 700 can transmit a notification message to the wearable glass 100. [ The external device 700 can transmit a notification message to the wearable glass 100 in at least one of a short-range communication, a wireless communication, and a mobile communication.

In step S730, when receiving the notification message, the wearable glass 100 can confirm whether blocking of the notification message is set. For example, the user of the wearable glass 100 can set the receiving blocking of the push message related to the specific application by using the wearable glass 100 or the mobile terminal 200, or the notification of the text message received from the specific user You can set blocking.

In step S740, the wearable glass 100 can detect occurrence of a notification event when blocking of the notification message is not set.

According to an embodiment of the present invention, step S730 may be omitted. For example, when a notification message is received from the external device 700, the wearable glass 100 may determine that a notification event has occurred.

8 is a diagram showing an example in which a wearable glass receives a notification message from a server and detects occurrence of a notification event.

Referring to FIG. 8, the wearable glass 100 may receive a push message 810 from the news providing server 800. For example, the wearable glass 100 may receive a push message 810 including emergency news from the news providing server 800. [

In this case, the wearable glass 100 may detect that a notification event has occurred that should display emergency news content (e.g., Sochi Olympics, Kim Yu-na!) 820.

According to an embodiment of the present invention, the wearable glass 100 can receive the push message 810 directly from the news providing server 800. [ The wearable glass 100 may also receive a push message 810 via a host device (e.g., mobile terminal 200), or the like, if the host device (e.g., mobile terminal 200) have.

9 is a diagram illustrating an example in which a wearable glass detects the occurrence of a notification event by receiving a schedule notification message from a mobile terminal.

Referring to FIG. 9, the user's schedule information 910 may be stored in the mobile terminal 200 connected to the wearable glass 100. For example, the user can register the schedule information 910 using the mobile terminal 200. The user can set the mobile terminal 200 to output a notification message to the wearable glass 100 to take the medicine at 7 pm.

When the mobile terminal 200 reaches 7 PM, the mobile terminal 200 can transmit a schedule notification message to the wearable glass 100 to take the medicine. The schedule notification message may include an instruction to display the schedule notification content 920. [

According to an embodiment of the present invention, the mobile terminal 200 can transmit a schedule notification message to the wearable glass 100 using short-range communication (e.g., Bluetooth, Wi-Fi Direct, NFC, etc.).

In this case, the wearable glass 100 may sense that a notification event has occurred that should display the schedule notification content (for example, the time to take the medicine) 920.

10 is a diagram illustrating an example in which a wearable glass detects a notification event by receiving a text message through a mobile terminal.

Referring to FIG. 10, the mobile terminal 200 may receive a text message 1010 from the server 300. The server 300 may be a messenger server, a mobile communication server, or the like, but is not limited thereto.

When receiving the text message 1010, the mobile terminal 200 can determine whether or not the user wears the wearable glass 100.

According to an embodiment of the present invention, the mobile terminal 200 may request at least one of temperature information, pressure information, iris recognition information, and tilt information to the wearable glass 100. The mobile terminal 200 can receive at least one of temperature information, pressure information, iris recognition information, and tilt information from the wearable glass 100. The mobile terminal 200 can determine whether the user wears the wearable glass 100 by using at least one of temperature information, pressure information, iris recognition information, and tilt information received from the wearable glass 100. For example, if the temperature measured in the wearable glass 100 is similar to the body temperature (e.g., 36.5 DEG C) as a result of analyzing the temperature information received from the wearable glass 100, It can be determined that the glass 100 is worn.

According to an embodiment of the present invention, the mobile terminal 200 can request and receive location information from the wearable glass 100. At this time, the mobile terminal 200 may determine whether the user wears the wearable glass 100 based on a result of comparing the position information of the wearable glass 100 with the position information of the mobile terminal 200. For example, when the positional difference between the mobile terminal 200 and the wearable glass 100 is within the critical range, the mobile terminal 200 may be configured such that the user wearing the mobile terminal 200 wears the wearable glass 100 It can be judged.

In addition, according to an embodiment of the present invention, when the wearable glass 100 is searched using the local communication (for example, Bluetooth, WiFi Direct), the mobile terminal 200 searches for the wearable glass 100 It may be judged that it is wearing.

According to an embodiment of the present invention, when the wearable glass 100 is worn by the user, the mobile terminal 200 can receive the text message 1010 and the text message 1010 received from the server 300 The notification may send an instruction to the wearable glass 100 to output the notification message 1020. [

In this case, the wearable glass 100 may sense that a notification event has occurred that should indicate a notification message 1020 (e.g., a text message has arrived) informing the arrival of the text message 1010. [

11 is a diagram showing an example in which a wearable glass detects the occurrence of a notification event by receiving an advertisement content.

According to an embodiment of the present invention, the wearable glass 100 can receive advertisement contents via the short distance communication from the kiosk 1100. [ For example, when the wearable glass 100 is located within the local communication radius of the kiosk 1100, the wearable glass 100 may receive the mobile coupon broadcasted in the kiosk 1100. [

According to one embodiment of the present invention, the wearable glass 100 may receive ad content (e.g., mobile coupons) from the kiosk 1100 via the mobile terminal 200. According to another embodiment of the present invention, the wearable glass 100 may receive advertisement content (e.g., mobile coupons) directly from the kiosk 1100.

The wearable glass 100 may detect that a notification event has occurred that should display the advertisement content 1110 received from the kiosk 1100. [

Hereinafter, an operation of the HMD device 100 to acquire the movement pattern information (movement state) of the user will be described in detail with reference to FIG. 12 and FIG.

12 is a flowchart for explaining a method of acquiring movement pattern information (movement state) of a user in wearable glass according to an embodiment of the present invention.

In step S1210, the wearable glass 100 can detect occurrence of a notification event.

Since step S1210 corresponds to step S510 of FIG. 5, a detailed description will be omitted.

In step S1220, the wearable glass 100 can measure at least one of acceleration information, tilt information, and position information using at least one sensor.

According to an embodiment of the present invention, the wearable glass 100 can activate at least one sensor in an inactive state when it detects the occurrence of a notification event. The wearable glass 100 can measure at least one of acceleration information, tilt information, and position information using at least one activated sensor.

For example, the wearable glass 100 can measure the moving speed of the wearable glass 100 using an acceleration sensor. In addition, the wearable glass 100 can measure a change in the inclination of the wearable glass 100 using a tilt sensor. In this case, the wearable glass 100 can determine whether the wearer wears the wearable glass 100 and whether or not the user wears the wearable glass 100 based on the inclination change.

The wearable glass 100 can acquire position information of a wearer wearing the wearable glass 100 by using a position sensor. The position sensor may include, but is not limited to, a Global Positioning System (GPS) module or a Wifi module.

For example, the wearable glass 100 can acquire position information of a wearer wearing the wearable glass 100 by using a GPS or a Wifi positioning system (WPS). GPS (Global Positioning System) is a satellite navigation system that receives signals from satellites and calculates the user's current position. A Wifi positioning system (WPS) receives a parameter (MAC address, signal strength, etc.) of an RF signal radiated from a Wi-Fi access point (AP) at a terminal and transmits the parameter (MAC address, signal strength, Is a technique for calculating the position of the object.

In step S1230, the wearable glass 100 can acquire the user's movement pattern information using at least one of acceleration information, tilt information, and position information. That is, the wearable glass 100 can determine the movement state of the user by using at least one of acceleration information, tilt information, and position information.

For example, if the user moves on average 4 km / h for a certain period of time, the wearable glass 100 may determine that the user is walking. In addition, when the user moves for an average of 20 km / h for a certain period of time, the wearable glass 100 can determine that the user is riding a bicycle.

In addition, if the average moving speed of the user is 0.0001 km / h for a predetermined time and the user is located in the office for a predetermined time, the wearable glass 100 may determine that the user is working.

Meanwhile, according to an embodiment of the present invention, the wearable glass 100 may acquire movement pattern information (movement state) of the user using the image sensor 161. [ For example, the wearable glass 100 can determine whether the user is moving or stopping, based on the amount of change in the image obtained through the image sensor 161. [

In step S1240, the wearable glass 100 can determine how to provide the notification content based on the user's movement pattern information (movement state). According to one embodiment of the present invention, the wearable glass 100 can determine the providing time and the providing form of the notification content based on the movement pattern information (movement state) of the user. The step S1240 corresponds to the step S530 of FIG. 5, and a detailed description thereof will be omitted.

In step S1250, the wearable glass 100 can provide notification content.

According to an embodiment of the present invention, the wearable glass 100 can provide alert content according to a providing timing or a providing mode determined based on the user's movement pattern information (movement state). In this specification, providing alert content may include displaying alert content, outputting alert content, playing alert content, or sending alert content to an external device.

For example, the wearable glass 100 may provide the notification content at the present time point or at the time of occurrence of the predetermined event, based on the movement pattern information (movement state) of the user. In addition, the wearable glass 100 may output the whole of the notification content or a part of the notification content based on the movement pattern information (movement state) of the user.

The wearable glass 100 may provide notification contents via the display unit 111 of the wearable glass 100 based on the user's movement pattern information (movement state) or user input, Content may be provided.

13 is a flowchart for explaining a method in which wearable glass acquires movement pattern information (movement state) of a user from an external device, according to an embodiment of the present invention.

In step S1310, the wearable glass 100 can detect occurrence of a notification event. Since step S1310 corresponds to step S510 of FIG. 5, a detailed description will be omitted.

In step S1320, the wearable glass 100 may request the external device 1300 for movement pattern information (movement state) of the user. The external device 1300 may be the mobile terminal 200 or the server 300, but is not limited thereto.

According to an embodiment of the present invention, the wearable glass 100 can activate the communication unit when the occurrence of the notification event is detected. The wearable glass 100 can request the external device 1300 for movement pattern information (movement state) of the user through the activated communication unit. According to an embodiment of the present invention, the wearable glass 100 may transmit acceleration information, inclination information, position information, and the like measured by the wearable glass 100 to the external device 1300.

In step S1330, the external device 1300 can acquire at least one of acceleration information of the wearable glass 100, positional information of the wearable glass 100, and biometric information of a wearer wearing the wearable glass 100. [

According to an embodiment of the present invention, the external device 1300 can receive the acceleration information measured by the wearable glass 100 from the wearable glass 100, the position information of the wearable glass 100, and the like. The external device 1300 may receive acceleration information, position information, and the like measured from a wearable device (e.g., smart watch, wig, shoe, etc.).

In addition, when the external device 1300 is the mobile terminal 200 of the user wearing the wearable glass 100, the external device 1300 may directly measure the acceleration and / or the position using the sensors.

According to an embodiment of the present invention, the external device 1300 may collect biometric information from at least one wearable device connected to the external device 1300. For example, the external device 1300 may store pulse rate information, blood pressure information, heart rate information, body temperature information, and sweat discharge amount information measured in a wearable device (e.g., a smart watch, an earring, a ring, a necklace, a glass, , Respiration rate information, and the like.

In step S1340, the external device 1300 can analyze the movement pattern of the user using at least one of acceleration information, position information, and biometric information. That is, the external device 1300 can determine the movement state of the user by using at least one of acceleration information, position information, and biometric information.

For example, if the average pulse rate, average respiratory rate, sweat discharge amount, and body temperature of the user have increased for a predetermined time, the external device 1300 can determine that the user is exercising. In addition, the external device 1300 can determine that the user is at home for a certain period of time and that the user is resting at home if the biometric information is hardly changed. The external device 1300 may determine that the user is walking in the park when the user moves at an average of 4 km / h in the park.

In step S1350, the external device 1300 can transmit the movement pattern information (movement state) of the user to the wearable glass 100. [ The external device 1300 can transmit the movement pattern information (movement state) of the user to the wearable glass 100 using at least one of the short-range communication, the mobile communication, and the wireless communication. For example, the external device 1300 can transmit the operation state information of the user, the movement speed information of the user, the location information of the user, and the like to the wearable glass 100. In this case, in step S1360, the wearable glass 100 can acquire the movement pattern information (movement state) of the user from the external device 1300. [

In step S1370, the wearable glass 100 can determine the method of providing the notification content based on the movement pattern information (movement state) of the user. For example, the wearable glass 100 can determine when to provide the notification content, the form of providing the notification content, and the like.

In step S1380, the wearable glass 100 can provide notification content. For example, the wearable glass 100 may output a part of the notification content when the user is walking, and output the entire notification content when the user is resting at home.

Since steps S1370 and S1380 correspond to steps S1240 and S1250 in Fig. 12, a detailed description will be omitted.

Hereinafter, an operation of the wearable glass 100 in determining the providing time of the notification content based on the movement pattern information (movement state) of the user will be described in detail with reference to FIG.

FIG. 14 is a flowchart for explaining a method of determining the output timing of content corresponding to a notification event based on a moving speed of a wearable glass according to an embodiment of the present invention. FIG.

In step S1410, the wearable glass 100 can detect occurrence of a notification event.

In step S1420, when the wearable glass 100 detects the occurrence of the notification event, it can acquire the movement pattern information of the user.

In step S1430, the wearable glass 100 can determine whether the moving speed of the user is less than the threshold speed based on the user's movement pattern information. The threshold speed can be preset by the user or the system. The threshold speed may also be determined based on the average moving speed of the user.

For example, the wearable glass 100 can determine whether the moving speed of the user is less than an average walking speed of 4 km / h.

In step S1440, the wearable glass 100 may decide to output the notification content if the moving speed of the user is less than the threshold speed.

For example, the wearable glass 100 can decide to output the notification content at the present time when the moving speed of the user is less than the average walking speed of 4 km / h. The current time may be within a predetermined time (for example, within 30 seconds) from the time when the wearable glass 100 senses the occurrence of the notification event.

In step S1450, the wearable glass 100 can output the notification content at the present time. For example, the wearable glass 100 can play the alert content at the current point of time when the alert content is moving image content or audio content. The wearable glass 100 can display the alert content at the current time when the alert content is the still image content or the text content.

In step S1460, the wearable glass 100 can determine to output the notification content at a predetermined time when the moving speed of the user is equal to or higher than the threshold speed.

The preset time may be a predetermined time (for example, 10:00 at night). In addition, the preset time may refer to a time when a predetermined event occurs. The predetermined event may include at least one of an event for receiving a user input requesting the output of the notification content, an event for which a predetermined time elapses, and an event for which a movement pattern of the user changes, but the present invention is not limited thereto.

For example, the wearable glass 100 may determine the time at which the notification content is output as the time at which the specific input requesting the output of the notification content is received. Further, the wearable glass 100 may determine the time at which the notification content is output to be the time when the moving speed of the user becomes less than the critical speed.

In step S1470, the wearable glass 100 may not output the notification content at the present time. In addition, the wearable glass 100 can display an indicator indicating occurrence of a notification event.

According to an embodiment of the present invention, when the wearer wears the wearable glass 100 at a speed higher than a predetermined speed, the wearable glass 100 does not display the notification content, Can be displayed. 15A and 15B, the operation of the wearable glass 100 for determining the providing timing of the notification content based on the movement pattern information (movement state) of the user will be described in more detail.

15A and 15B are diagrams for explaining an example in which wearable glass controls the output timing and method of content corresponding to a notification event according to the moving speed of the user.

15A, while the user 1510 wearing the wearable glass 100 crosses the crosswalk, the wearable glass 100 may receive a push message including news content from the server 300. [ In this case, the wearable glass 100 can detect that a notification event has occurred that should display news content (e.g., Sochi Olympics, Kim Yu-na!).

According to an embodiment of the present invention, the wearable glass 100 acquires movement pattern information of the user 1510 before displaying the news content, and when the moving speed of the user 1510 reaches a critical speed (for example, 2 km / h) Can be determined. For example, since the user 1510 is crossing the pedestrian crossing, the traveling speed of the user 1510 may be 3 km / h. In this case, the wearable glass 100 can decide not to output the news content at the current time since the movement speed (e.g., 3 km / h) of the user 1510 is equal to or greater than the threshold speed (2 km / h). The wearable glass 100 may display a simple indicator 1511 indicating the occurrence of a notification event.

According to one embodiment of the present invention, the wearable glass 100 may display the news content instead of displaying the news content while the user 1510 crosses the crosswalk, instead of displaying the indicator 1511, Can be minimized.

Referring to FIG. 15B, the wearable glass 100 can receive a push message including news content from the server 300 while the user 1520 wearing the wearable glass 100 sits at home. In this case, the wearable glass 100 can detect that a notification event that should display the news content 1521 has occurred.

According to an embodiment of the present invention, the wearable glass 100 acquires movement pattern information of the user 1520 before displaying the news content 1521, and when the moving speed of the user 1520 reaches a critical speed / h). &lt; / RTI &gt; For example, since the user 1520 is at home at rest, the movement speed of the user 1520 may be about 0 km / h. In this case, the wearable glass 100 can determine to output the news content 1521 at the current time since the moving speed (e.g., 0 km / h) of the user 1520 is less than the threshold speed (2 km / h).

The wearable glass 100 is a game in which the news contents 1521 (for example, Sochi Olympics, Kim Yu-na silver medal, Kim Yu-na won valuable silver medals at the Sochi Olympics ...), augmented reality : Mixed Reality, or Virtual Reality (VR). In this case, the user 1520 can check the news content 1521 through the wearable glass 100 in a situation where the view is not obstructed.

Hereinafter, the operation of the wearable glass 100 to determine the output form of the notification content based on the user's movement pattern information (movement state) will be described in detail with reference to FIG.

16 is a flowchart for explaining a method of determining an output form of content corresponding to a notification event based on user's movement pattern information according to an embodiment of the present invention.

In step S1610, the wearable glass 100 can detect occurrence of a notification event. In step S1620, the wearable glass 100 can acquire the movement pattern information of the user. Since steps S1610 and S1620 correspond to steps S1410 and S1420 in Fig. 14, a detailed description thereof will be omitted.

In step S1630, the wearable glass 100 can determine whether the moving speed of the user is less than the first threshold speed. The first threshold rate may be a rate that is a criterion for determining whether to output the content. The first threshold rate may be preset by the user or may be preset by the system.

For example, the wearable glass 100 can determine whether the moving speed of the user is less than 10 km / h based on the user's movement pattern information when the first threshold speed is 10 km / h.

In step S1640, if the moving speed of the user is equal to or greater than the first threshold speed, the wearable glass 100 may not output the notification content at the present time. For example, when the user wearing the wearable glass 100 is driving the motorcycle, the moving speed of the user may be equal to or greater than the first threshold speed. At this time, the wearable glass 100 may not output the notification content in order not to block the view of the user.

In step S1650, the wearable glass 100 can determine whether the moving speed of the user is between the first threshold speed and the second threshold speed. The second threshold rate may be a rate that is a criterion for determining whether all or a part of the notification content is output. The second threshold rate may be preset by the user or may be preset by the system. Further, according to an embodiment of the present invention, the first threshold speed and the second threshold speed may be determined based on the normal traveling speed of the user.

According to an embodiment of the present invention, when the first threshold speed is 10 km / h and the second threshold speed is 2 km / h, the user wears the wearable glass 100 based on the movement pattern information of the user It can be judged whether it is between 10 km / h and 2 km / h.

In step S1660, the wearable glass 100 can output a part of the notification content when the moving speed of the user is between the first threshold speed and the second threshold speed. A part of the notification content may include, but is not limited to, keywords of the notification content, summary information of the notification content, and title of the notification content.

For example, when the moving speed of the user is between the first threshold speed and the second threshold speed, the wearable glass 100 uses the metadata of the notification content to generate keywords of the notification content, summary information of the notification content, At least one of the titles of the notification contents can be extracted. The wearable glass 100 may provide at least one of a keyword of the notification content, a summary information of the notification content, and a title of the notification content.

In step S1670, the wearable glass 100 can output the entire notification content if the moving speed of the user is less than the second threshold speed.

For example, if the user wearing the wearable glass 100 is reading a book at home, the moving speed of the user may be less than the second threshold speed. At this time, the wearable glass 100 can output the entire notification content.

Hereinafter, an example in which the wearable glass 100 determines the output form of the notification content based on the user's movement pattern information (movement state) will be described in detail with reference to FIGS. 17 to 19.

17 to 19 are diagrams for explaining an example in which the wearable glass provides a part or all of the content corresponding to the notification event based on the moving speed of the user.

In FIG. 17, a case where a wearer wearing a wearable glass 100 is in a state of riding a bicycle will be described as an example.

In step S1710, the wearable glass 100 may receive a push message including the news content 1000 from the server 300. [

In step S1720, the wearable glass 100 can determine whether the moving speed of the user is greater than a first threshold speed (e.g., 15 km / h) using the user's motion state information. Since the user is riding a bicycle, the moving speed of the user may be an average of 18 km / h.

In step S1730, the wearable glass 100 can determine that the news content 1000 should not be output 1700 because the user's moving speed (18km / h) is greater than the first threshold speed (e.g. 15km / h) have.

In FIG. 18, a case in which a wearer wearing a wearable glass 100 walks with a dog will be described as an example.

In step S1810, the wearable glass 100 may receive a push message including the news content 1000 from the server 300. [

In step S1820, the wearable glass 100 determines whether the moving speed of the user is between a first threshold speed (for example, 15 km / h) and a second threshold speed (for example, 2 km / h) It can be judged. Since the user is walking, the average moving speed of the user may be 2.5 km / h.

In step S1830, the wearable glass 100 determines whether or not the movement speed (2.5km / h) of the user is between the first threshold speed (e.g., 15km / h) and the second threshold speed It may be determined to output a part of the image 1000. [ For example, the wearable glass 100 may extract the headline 1800 (e.g., Kim Yu-na silver medal) from the news content 1000 and provide the headline 1800 in AR form.

In FIG. 19, a case in which a wearer wears the wearable glass 100 is in the office, will be described as an example.

In step S1910, the wearable glass 100 may receive a push message including the news content 1000 from the server 300. [

In step S1920, the wearable glass 100 can determine whether the moving speed of the user is less than a second threshold speed (for example, 2 km / h) using the user's motion state information. Since the user is sitting at the office desk, the moving speed of the user may be 0 km / h.

In step S1930, the wearable glass 100 can determine to output the entire news content 1000 because the moving speed of the user (0 km / h) is less than the second threshold speed (for example, 2 km / h). For example, the wearable glass 100 can provide the entire article 1900 included in the news content 1000 in AR format.

FIG. 20 is a flowchart for explaining a method of outputting an unreported content when a wearable glass generates a predetermined event according to an embodiment of the present invention. FIG.

In step S2010, the wearable glass 100 can detect occurrence of a notification event.

In step S2020, the wearable glass 100 can acquire the movement pattern information of the user when the occurrence of the notification event is detected.

In step S2030, the wearable glass 100 can determine whether the movement speed of the user is less than the threshold speed, based on the movement pattern information of the user. For example, the wearable glass 100 can determine whether the moving speed of the user is less than an average walking speed of 4 km / h.

In step S2040, when the moving speed of the user is equal to or higher than the threshold speed, the wearable glass 100 can output the notification content or output a part of the notification content. At this time, according to an embodiment of the present invention, the wearable glass 100 may determine to output the notification content at a time when a predetermined event occurs, when the moving speed of the user is equal to or higher than the threshold speed.

The predetermined event may include at least one of an event for receiving a user input requesting the output of the notification content, an event for which a predetermined time elapses, and an event for which a movement pattern of the user changes, but the present invention is not limited thereto. For example, the wearable glass 100 can determine the point of time when the user's moving speed becomes less than the threshold speed when the notification content is output.

In step S2050, the wearable glass 100 can store the alert content that has not yet been output or only partially output in the list of unreported contents.

In step S2060, the wearable glass 100 can determine whether or not a predetermined event has occurred. When the predetermined event does not occur, the wearable glass 100 can continuously output the notification content.

In step S2070, the wearable glass 100 can output the entire notification content when a predetermined event occurs. For example, when an event in which the user's movement pattern changes occurs, the wearable glass 100 can output the entirety of the alert content that is not yet output or partially output.

The wearable glass 100 can play the alert content if the alert content is video content or audio content. The wearable glass 100 can display the alert content at the current time when the alert content is the still image content or the text content.

Hereinafter, referring to FIG. 21, the operation of the wearable glass 100 for outputting an unreleased content upon occurrence of a predetermined event will be described in further detail.

21 is a diagram showing an example in which the wearable glass outputs a content corresponding to a previously generated notification event based on a user's movement pattern change event.

21, the wearable glass 100 can receive a push message including the news content 1000 from the server 300 while a wearer wearing the wearable glass 100 rides a bicycle. In this case, the wearable glass 100 can detect that a notification event that should display the news content 1521 has occurred.

The wearable glass 100 can determine whether the moving speed of the user is greater than a critical speed (e.g., 15 km / h) by using the user's motion state information. Since the user is riding a bicycle, the moving speed of the user may be an average of 18 km / h.

The wearable glass 100 does not output the news content to the current time point 2111 because the moving speed of the user (18km / h) is larger than the threshold speed (e.g. 15km / h) It can be decided to output. The predetermined event may be the time when the moving speed of the user becomes 2 km / h or less.

21, when the wearer wears the wearable glass 100, the wearable glass 100 can detect occurrence of a predetermined event in which the movement speed is 2 km / h or less .

Since the wearable glass 100 has detected a predetermined event, it can provide the news content 2121 that has not yet been output. For example, the wearable glass 100 can display the news content 2121 in an AR format.

According to the embodiment of the present invention, the wearable glass 100 can prevent the user from being exposed to a dangerous situation by providing the notification content when the moving speed of the user becomes less than a certain level.

22 is a diagram for explaining how a wearable glass changes an output form of content based on a certain input of a user according to an embodiment of the present invention.

In step S2210, the wearable glass 100 can detect occurrence of a notification event.

In step S2220, the wearable glass 100 can acquire the movement pattern information of the user when the occurrence of the notification event is detected.

In step S2230, the wearable glass 100 can output a part of the notification content based on the movement pattern information of the user. For example, the wearable glass 100 can output a part of the notification content when it is determined that the user is walking the distance.

In step S2240, the wearable glass 100 can determine whether or not the first user input requesting the entire output of the notification content is received.

According to one embodiment of the present invention, the first user input requesting the full output of the content may be varied. For example, the first user input may be at least one of a motion input, a touch input, a key input, a voice input, and a multiplex input, but is not limited thereto.

According to an embodiment of the present invention, a first user input for requesting a total output of the notification content may be preset. For example, the user may set the head-up motion to lift the head to the first user input requesting full output.

In step S2250, the wearable glass 100 may output the entire notification content in response to the first user input. For example, the wearable glass 100 can play the entire notification content if the notification content is movie content or audio content. The wearable glass 100 may display the entire notification content in AR format if the notification content is still image content or text content.

In step S2260, the wearable glass 100 may determine whether or not a second user input requesting a partial output blocking of the notification content is received.

According to an embodiment of the present invention, the second user input for requesting to cut off a partial output of the notification content may be various. For example, the second user input may be at least one of a motion input, a touch input, a key input, a voice input, and a multiplex input, but is not limited thereto.

According to an embodiment of the present invention, a second user input for requesting a partial output blocking of the notification content may be preset. For example, the user may set a shaking motion that shakes the head to the left or right as a second user input requesting to block some output of the notification content.

In step S2270, the wearable glass 100 may block some output of the notification content according to the second user input. In this specification, the term &quot; shutting off the output &quot; may mean that the outputting state is terminated. For example, when the wearable glass 100 blocks the output of the alert content, the alert content displayed before the user's eyes may disappear or the sound signal may no longer be output.

In step S2280, the wearable glass 100 may block part of the notification content when a predetermined time has elapsed without receiving a separate input from the user after outputting a part of the notification content. For example, the wearable glass 100 may no longer output a portion of the notification content if a first user input requesting a full output after outputting a portion of the notification content is not received within 30 seconds.

Hereinafter, an example in which the wearable glass 100 changes the output form of the content based on a certain input of the user will be described with reference to FIGS. 23 and 24. FIG.

23 to 24 are diagrams for explaining an example in which the wearable glass outputting a part of the content outputs the entire content based on the head-up motion of the user. 23 to 24, the case where the user input requesting the total output of the content is the head-up motion will be described as an example.

Referring to 2310 of FIG. 23, the wearable glass 100 can receive a push message including news content from the server 300 while a wearer wearing the wearable glass 100 crosses the crosswalk. In this case, the wearable glass 100 can detect that a notification event to display the news content has occurred.

According to an embodiment of the present invention, the wearable glass 100 may acquire the movement pattern information of the user before displaying the news content. For example, the wearable glass 100 may be a confirmation that the user is moving at a speed of 3 km / h.

Since the user wears the wearable glass 100, the wearable glass 100 can output a part 2311 of the news content in order to avoid a lot of visibility of the user. For example, the wearable glass 100 can extract a headline from a news content and output the extracted headline. In this case, the user can check the headline of the news content by crossing the crosswalk.

According to one embodiment of the present invention, the user may check the headline of the news content and then cross the crosswalk to view the entire content 2321 of the news content and then stop and look at the sky.

In this case, the wearable glass 100 may sense the user's head-up motion 2300 while outputting a part 2311 (e.g., a headline) of the news content. For example, the wearable glass 100 can sense the user's head-up motion 2300 using a tilt sensor, an acceleration sensor, a gyroscope sensor, or the like.

Referring to 2320 of FIG. 23, the wearable glass 100 may output the entire news content 2321 according to the head-up motion 2300 of the user. In this case, the user can check the entire content 2321 of the news content in a safe situation.

According to an embodiment of the present invention, in order to prevent the entire contents 2321 of the news content from being output irrespective of the intention of the user, the wearable glass 100 is configured such that the holding time of the head- It is possible to output the entire content 2321 of the news content. For example, the wearable glass 100 may measure the holding time of the head-up motion 2300 when the user's head-up motion 2300 is sensed. At this time, the wearable glass 100 can output the entire news content 2321 if the holding time of the head-up motion 2300 is a threshold time (for example, 2 seconds) or more.

Referring to 2410 of FIG. 24, while the wearer wearing the wearable glass 100 crosses the crosswalk, the wearable glass 100 may receive a push message including the advertisement content. In this case, the wearable glass 100 can sense that a notification event that should display the advertisement content has occurred.

According to an embodiment of the present invention, the wearable glass 100 may obtain the user's movement pattern information before displaying the advertisement content. For example, the wearable glass 100 may be a confirmation that the user is moving at a speed of 3 km / h.

The wearable glass 100 can output a part of the advertisement content because the user is moving, so that the wearer's eye 100 does not cover the user's view much. For example, the wearable glass 100 may display a thumbnail image 2411 of the advertisement content. In this case, the user can confirm that the advertisement content has been received by crossing the crosswalk.

According to an embodiment of the present invention, the user can check the thumbnail image 2411 of the advertisement content and then cross the crosswalk to see the entire content 2421 of the advertisement content, and then stop and look at the sky. In this case, the wearable glass 100 may sense the user's head-up motion 2400 while outputting a portion of the advertisement content (e.g., thumbnail image 2411). For example, the wearable glass 100 can sense the user's head-up motion 2400 using a tilt sensor, an acceleration sensor, a gyroscope sensor, or the like.

Referring to 2420 of FIG. 24, the wearable glass 100 may output the entirety 2421 of the advertisement content according to the head-up motion 2400 of the user. In this case, the user can confirm the entirety of the advertisement content 2421 in a safe situation.

According to an embodiment of the present invention, in order to prevent the entire contents 2421 of the advertisement content from being output regardless of the user's intention, the wearable glass 100 is configured such that the holding time of the head- (E.g., 3 seconds) or more of the advertisement content.

25 is a diagram for explaining an example in which the wearable glass outputting a part of the content blocks the output of the content based on the user's input. In FIG. 25, the case where the user input requesting interruption of the output of the content is the shaking motion will be described as an example.

25, the wearable glass 100 can receive a push message including news content from the server 300 while a wearer wearing the wearable glass 100 crosses the crosswalk. In this case, the wearable glass 100 can detect that a notification event to display the news content has occurred.

According to an embodiment of the present invention, the wearable glass 100 may acquire the movement pattern information of the user before displaying the news content. For example, the wearable glass 100 may be a confirmation that the user is moving at a speed of 3 km / h.

The wearable glass 100 can output a portion 2511 of the news content (e.g., a headline) in order to avoid a lot of visibility of the user because the wearer is moving. The user can check the headline of the news content by crossing the crosswalk.

According to an embodiment of the present invention, when the user does not want to view the news content after confirming the headline of the news content, the user can shake the head from side to side. In this case, the wearable glass 100 may sense the user's shaking motion 2500 while outputting a portion 2511 of the news content (e.g., a headline). For example, the wearable glass 100 can sense a shaking motion 2500 that swings the head more than a predetermined number of times (for example, twice) using a tilt sensor, an acceleration sensor, a gyroscope sensor, or the like.

Referring to 2520 of FIG. 25, the wearable glass 100 may no longer display a portion 2511 of the news content (e.g., headline) according to the user's shaking motion 2500 (2521). According to an embodiment of the present invention, the wearable glass 100 may add the news content to the list of unreported contents.

23 to 25, the case where the user input is the motion input has been described as an example, but the present invention is not limited thereto. For example, the user may input a voice to the wearable glass 100 to request the entire output of the notification content or to request the output of the notification content, or may select a specific button included in the wearable glass 100 have.

26 is a flowchart for explaining how a wearable glass highlights a keyword in content corresponding to a notification event, according to an embodiment of the present invention.

In step S2610, the wearable glass 100 can detect occurrence of a notification event.

In step S2620, the wearable glass 100 can acquire the movement pattern information of the user when the occurrence of the notification event is detected.

In step S2630, the wearable glass 100 may determine to highlight the keyword in the notification content based on the user's movement pattern information.

For example, the wearable glass 100 can extract keywords from the notification content when the moving speed of the user is not less than a critical speed (for example, 4 km / h) based on the user's movement pattern information. According to an embodiment of the present invention, the information about the keywords may be stored in the metadata of the alert content.

According to an embodiment of the present invention, the wearable glass 100 can highlight the keywords in the notification content. For example, the wearable glass 100 may adjust the size of the keywords, adjust the color of the keywords, or add an underline to the keywords. Referring to Fig. 27, the operation of the wearable glass 100 to highlight the keyword in the notification content will be described in more detail.

FIG. 27 is a diagram for explaining an example in which a wearable glass emphasizes a keyword in content based on a user's movement pattern information according to an embodiment of the present invention. FIG.

Referring to 2700-1 in Fig. 27, the wearable glass 100 can receive from the server 300 a push message including news content. In this case, the wearable glass 100 can detect that a notification event to display the news content has occurred.

According to an embodiment of the present invention, the wearable glass 100 may acquire the movement pattern information of the user before displaying the news content. For example, if the average moving speed of the user is 0.0001 km / h for a certain period of time, and the user is located in the office for a predetermined time, the wearable glass 100 may determine that the user is sitting in a chair.

The wearable glass 100 is not dangerous to the user even if the user's view is obscured when the user is sitting in a chair and therefore the whole news content 2710 received from the server 300 70.2 points, and silver medal was 0.6 points.) Can be displayed at the present time.

Referring to 2700-2 in Fig. 27, while the wearer wears the wearable glass 100, the wearable glass 100 can receive from the server 300 a push message including news content. In this case, the wearable glass 100 can detect that a notification event to display the news content has occurred.

According to an embodiment of the present invention, the wearable glass 100 may acquire the movement pattern information of the user before displaying the news content. For example, the wearable glass 100 can confirm that the user is moving at an average speed of 3 km / h for a certain period of time.

The wearable glass 100 is a game in which when the user is moving at a critical speed (for example, 2 km / h) or more, the whole of the news content 2710 (e.g., Kim Yu Na is 70.2 points in Sochi Olympic games, ), It is possible to extract the keywords included in the news content and highlight the keywords.

For example, the wearable glass 100 extracts 'Kim Yu-na', 'Sochi Olympics' and 'Silver Medal' as keywords in the news contents and extracts the size, thickness, and color of 'Kim Yeon-ah', 'Sochi Olympic' And so on.

28 is a flowchart for explaining a method of controlling the transparency of content corresponding to a notification event in a wearable glass according to an embodiment of the present invention.

In step S2810, the wearable glass 100 can acquire the movement pattern information of the user when the notification event occurs.

In step S2820, the wearable glass 100 can determine whether a wearer wearing the wearable glass 100 is driving, based on the user's movement pattern information.

According to the embodiment of the present invention, the wearable glass 100 can measure the movement speed of the user by using the acceleration sensor included in the wearable glass 100. [ The wearable glass 100 can determine that the user is driving when the user is moving at 80 km / h.

According to one embodiment of the present invention, the wearable glass 100 determines whether or not the user is driving based on the acceleration information received from the mobile terminal 200 or the in-vehicle navigation device connected to the wearable glass 100 It is possible.

According to an embodiment of the present invention, when the user sets the operation mode of the wearable glass 100 to the navigation mode, the wearable glass 100 may determine that the user is driving.

In step S2830, the wearable glass 100 can set the transparency of the notification content when it is determined that the user is driving. For example, the wearable glass 100 can display the alert content after setting the transparency of the alert content to 50% when it is determined that the user is driving.

According to one embodiment of the present invention, the wearable glass 100 may adjust the transparency of the notification content based on the operation speed. For example, the wearable glass 100 can increase the transparency of the notification content as the operation speed increases.

29 is a diagram showing an example in which the wearable glass adjusts the transparency based on the speed information when the user is in operation.

Referring to 2910 of FIG. 29, the wearable glass 100 may receive a push message including the news content from the server 300 before the user wearing the wearable glass 100 starts operating. In this case, the wearable glass 100 can detect that a notification event to display the news content has occurred.

According to an embodiment of the present invention, the wearable glass 100 may acquire the movement pattern information of the user before displaying the news content. For example, the wearable glass 100 can confirm that the average moving speed of the user is 0 km / h for a predetermined time.

The wearable glass 100 can display the opaque news content 2911 without setting the transparency of the news content since the user is in a stopped state.

Referring to 2920 of FIG. 29, the wearable glass 100 can receive a push message including news content from the server 300 while the wearer wears the wearable glass 100. In this case, the wearable glass 100 can detect that a notification event to display the news content has occurred.

According to an embodiment of the present invention, the wearable glass 100 may acquire the movement pattern information of the user before displaying the news content. For example, the wearable glass 100 can confirm that the average moving speed of the user is 80 km / h for a predetermined time, and determine that the user is driving.

Since the user wears the wearable glass 100, the transparency of the news content can be set to 50% and the semi-transparent news content 2912 can be displayed.

According to an embodiment of the present invention, the wearable glass 100 can prevent the visibility of a driving user from being obscured by adjusting the transparency of the notification content.

30 is a diagram for explaining a method of determining the shape of an output signal based on environment information in a wearable glass according to an embodiment of the present invention.

In step S3010, the wearable glass 100 can detect occurrence of a notification event.

In step S3020, the wearable glass 100 can acquire environmental information within a predetermined distance from the wearable glass 100. [ The environmental information may include at least one of information on an external sound generated within a predetermined distance from the wearable glass 100 and information on an external image obtained through the image sensor 161. [

For example, the wearable glass 100 can capture an image of the surroundings using the image sensor 161. [ When the wearable glass 100 is worn by the user, the image sensor 161 is mounted at a position adjacent to the user's eyes, so that the image sensor 161 can photograph a video similar to the image recognized through the user's eyes. The wearable glass 100 may analyze the captured image to obtain information about the external image. For example, the wearable glass 100 may acquire object information, edge information, atmosphere information, color information, and the like included in the captured image.

The wearable glass 100 can detect ambient sounds using a microphone. The wearable glass 100 can analyze the detected ambient sound to obtain external sound information. For example, the wearable glass 100 can acquire information on the magnitude of ambient noise, information on whether a plurality of voices exist, and the like.

The wearable glass 100 may acquire environment information within a predetermined distance from another wearable device of the wearer wearing the wearable glass 100 existing in the radius of short range communication or the mobile terminal 200. [ For example, if the mobile terminal 200 analyzes images taken from the necklace to obtain information about the external image, the wearable glass 100 may receive information about the external image from the mobile terminal 200 .

The wearable glass 100 may also receive information about the external sound obtained from the mobile terminal 200 or the wristwatch from the mobile terminal 200 or the wristwatch.

In step S3030, the wearable glass 100 can determine the output signal form of the notification content in consideration of the environmental information.

According to one embodiment of the present invention, the wearable glass 100 can determine to provide the notification content in the form of at least one of an audio signal and a video signal in consideration of environmental information. For example, the wearable glass 100 may decide to output the alert content in the form of a video signal when the surrounding noise level is greater than or equal to the threshold value or when a plurality of voices are detected. In addition, the wearable glass 100 may determine to output the notification content in the form of an audio signal when a predetermined number of edges are detected in the captured image.

In step S3040, the wearable glass 100 can output the alert content in the form of the determined output signal. 31 and 32 will be referred to.

31 and 32 are views showing an example in which wearable glass according to an embodiment of the present invention adjusts the shape of an output signal based on external sound information.

31, the wearable glass 100 can receive a push message including the news moving picture content 3101 from the server 300 while the user wearing the wearable glass 100 waits for the train . In this case, the wearable glass 100 can detect that a notification event that should display the news video content 3101 has occurred.

According to an embodiment of the present invention, the wearable glass 100 may acquire the movement pattern information of the user before displaying the news video content 3101. [ For example, the wearable glass 100 can confirm that the average moving speed of the user is 0 km / h for a predetermined time, and can determine that the user is in a stopped state.

The wearable glass 100 can decide to output the news video content 3101 since the user is in a stopped state. At this time, the wearable glass 100 can acquire more environment information within a predetermined distance. For example, the wearable glass 100 can activate the microphone to detect ambient sounds. The wearable glass 100 can reproduce the news video content 3101 since the size of the surrounding sound is less than a threshold value (for example, 70 decibels).

Referring to 3120 of FIG. 31, since the subway is entering the platform, the size of surrounding sounds (for example, 85 decibels) may be larger than a threshold value (for example, 70 decibels). In this case, the wearable glass 100 can display an audio signal in the news moving picture content 3101 by converting it into a text signal.

For example, the wearable glass 100 transforms a voice included in the news moving picture content 3101 into text based on the Speech to Text (STT) technique, thereby generating a transcript corresponding to the news moving picture content 3101 3102). In this specification, a transcript may mean a record that transcribes the written contents.

According to one embodiment of the present invention, the wearable glass 100 may provide a transcript corresponding to the audio content when the ambient sound is greater than a threshold value, thereby allowing the user to visually recognize the notification content have.

Referring to 3210 of Fig. 32, the wearable glass 100 is configured such that when the user wearing the wearable glass 100 sits in the park and reads a book, the wearable glass 100 displays a push message including the news video content 3201 From the server (300). In this case, the wearable glass 100 can detect that a notification event that should display the news video content 3201 has occurred.

According to an embodiment of the present invention, the wearable glass 100 may acquire the movement pattern information of the user before displaying the news video content 3201. [ For example, the wearable glass 100 can confirm that the average moving speed of the user is 0 km / h for a predetermined time, and can determine that the user is in a stopped state.

According to an embodiment of the present invention, the wearable glass 100 can determine to output the news video content 3201 because the user is in a stopped state. At this time, the wearable glass 100 can acquire more environment information within a predetermined distance. For example, the wearable glass 100 can activate the microphone to detect ambient sounds. The wearable glass 100 can reproduce the news moving picture content 3201 since the size of the surrounding sound is not more than a threshold value (for example, 70 decibels) and a plurality of sounds are not detected.

Referring to 3220 of FIG. 32, since the user wearing the wearable glass 100 is in conversation with another person, the wearable glass 100 can detect a plurality of sounds. When a plurality of voices are detected, the wearable glass 100 may interfere with the conversation if the wearable glass 100 reproduces the news video content 3201, so that the wearable glass 100 displays the audio signal in the news video content 3201 Signal can be displayed. For example, the wearable glass 100 can convert the voice contained in the news moving picture content 3201 into text and display the converted text 3202, based on the Speech to Text (STT) technique.

Fig. 33 is a flowchart for explaining a method in which a wearable glass determines an output form of content corresponding to a notification event based on information about an external image, according to an embodiment of the present invention. Fig.

In step S3310, the wearable glass 100 can detect occurrence of a notification event.

In step S3320, the wearable glass 100 can acquire information on the external image using the image sensor 161 included in the wearable glass.

The information on the external image may include, but is not limited to, information on the amount of change in the external image, color information on the external image, and object information on the external image.

According to one embodiment of the present invention, the wearable glass 100 may analyze the external image captured through the image sensor 161 to obtain information about the external image.

According to another embodiment of the present invention, the wearable glass 100 may request an analysis of an external image while transmitting an external image captured by the mobile terminal 200 or the server 300. [ The wearable glass 100 may receive at least one of change information of an external image, color information of an external image, and object information included in an external image from the mobile terminal 200 or the server 300.

In step S3330, the wearable glass 100 can determine the output form of the notification content based on the information about the external image.

According to one embodiment of the present invention, the wearable glass 100 may determine to provide alert content in the form of at least one of an audio signal and a video signal, based on information about an external image. For example, the wearable glass 100 may determine to output a notification content in the form of an audio signal when edges of a predetermined number or more are detected in the captured image or when the captured image variation amount is equal to or greater than a threshold value.

According to one embodiment of the present invention, the wearable glass 100 may determine to output a part or all of the notification content based on the information about the external image. For example, the wearable glass 100 may determine to output a portion of the notification content if more than a predetermined number of edges are detected in the captured image or if the captured image variation amount is greater than or equal to a threshold value. A part of the notification content may include, but is not limited to, keywords of the notification content, summary information of the notification content, and title of the notification content.

In step S3340, the wearable glass 100 can output the alert content in the determined output format. For example, the wearable glass 100 may provide alert content in the form of at least one of an audio signal and a video signal. The wearable glass 100 may output a part of the notification content first and output the entire notification content when a user input requesting the total output of the notification content is received.

Referring to FIG. 34, the operation of the wearable glass 100 to output different types of notification contents based on information about an external image will be described in more detail.

34 is a view showing an example in which wearable glass according to an embodiment of the present invention adjusts the shape of an output signal based on information about an external image.

34, the wearable glass 100 can receive a push message including the news content from the server 300 while the user wearing the wearable glass 100 is stopped and looking at the sky. At this time, the wearable glass 100 can acquire information about the external image. For example, the wearable glass 100 may capture the sky image 3411 and analyze the sky image 3411. As a result of analysis, since there are less than a predetermined number of edges in the sky image 3411, the wearable glass 100 can display the news content in the form of a video signal 3401.

34, when the user wearing the wearable glass 100 is walking in a public place with many people, the wearable glass 100 sends a push message including the news content 3401 from the server 300 . At this time, the wearable glass 100 can acquire information about the external image. For example, the wearable glass 100 may capture the public place image 3421 and analyze the public place image 3421.

As a result of analysis, since there are more than a predetermined number of edges in the public place image 3421, the wearable glass 100 can display the news content in an audio signal form 3402.

According to an embodiment of the present invention, when the external image recognized through the eyes of the user is complicated, the user can not visually identify the notification content, so that the wearable glass 100 can display the notification content as an audio signal .

35 is a flowchart for explaining a method for determining whether or not wearable glass according to an embodiment of the present invention is to be output based on variation information of an external image.

In step S3510, the wearable glass 100 can detect occurrence of a notification event.

In step S3520, when the wearable glass 100 detects the occurrence of the notification event, the wearable glass 100 can obtain the change amount information of the external image. The change amount information of the external image may mean information about the degree of change of the external image observed through the user's eyes for a predetermined time.

According to one embodiment of the present invention, the wearable glass 100 can acquire a plurality of external images using the image sensor 161 for a predetermined time. The wearable glass 100 can compare the frames of each of a plurality of external images obtained for a predetermined time to calculate a variation amount of the external image. For example, the amount of change in the external image calculated by the wearable glass 100 when the wearer wears the wearable glass 100 is determined by the amount of change in the external image in the case where the wearer wears the wearable glass 100, .

According to an embodiment of the present invention, the wearable glass 100 may request an analysis of an external image while transmitting an external image captured by the mobile terminal 200 or the server 300. [ The wearable glass 100 may receive the change amount information of the external image from the mobile terminal 200 or the server 300. [

In step S3530, the wearable glass 100 can determine whether the amount of change in the external image is less than a threshold value.

For example, the wearable glass 100 may determine whether the difference between the first frame obtained at the n-th second and the second frame obtained at the (n + 1) -th second is less than a threshold value (e.g., 30%).

In step S3540, the wearable glass 100 may decide to output the notification content if the amount of change in the external image is less than the threshold value. Then, the wearable glass 100 can output the notification content at the present time.

For example, the amount of change in the external image may be less than a threshold value if the user's moving speed is less than a predetermined speed or the user's line of sight is not distracting. In this case, even if the notification content is output, the wearable glass 100 may decide to output the notification content because the user may not be in great danger.

In step S3550, when the amount of change in the external image is equal to or larger than the threshold value, the wearable glass 100 can determine not to output the notification content and display an indicator indicating the occurrence of the notification event.

For example, when the amount of change in the external image is equal to or greater than the threshold value, the wearable glass 100 may display a simple indicator that does not display the notification content or indicates the occurrence of the notification event, so as not to obscure the user's view. Referring to FIG. 36, the operation of the wearable glass 100 to determine whether to output the alert content based on the change amount information of the external image will be described in more detail.

36 is a diagram showing an example in which the wearable glass changes the output form of the content corresponding to the notification event based on the change amount information of the external image.

Referring to 3600-1 in Fig. 36, the wearable glass 100 can receive the push message including the news content from the server 300 while the wearer wearing the wearable glass 100 crosses the crosswalk. In this case, the wearable glass 100 can detect that a notification event to display the news content has occurred.

According to an embodiment of the present invention, the wearable glass 100 can acquire the amount-of-change information of the external image before displaying the news content, and determine whether the amount of change of the external image is less than the threshold value. For example, since the user is crossing the pedestrian crossing, the wearable glass 100 can obtain the change amount information of the pedestrian crossing image 3610. [ At this time, since the variation amount of the crosswalk peripheral image 3610 is equal to or larger than the threshold value, the wearable glass 100 can decide not to output the news content at the present time. The wearable glass 100 may display a simple indicator 3611 indicating occurrence of a notification event.

According to one embodiment of the present invention, the wearable glass 100 may minimize the user's view of the user's view by displaying the indicator 3611 instead of displaying the news content while the user crosses the crosswalk .

Referring to 3600-2 in Fig. 36, when the user wearing the wearable glass 100 is sitting at home and watching the wall, the wearable glass 100 sends a push message including the news content 3621 from the server 300 Lt; / RTI &gt; In this case, the wearable glass 100 can sense that a notification event that should display the news content 3621 has occurred.

According to an embodiment of the present invention, the wearable glass 100 may acquire change amount information of the external image before displaying the news content 3621, and may determine whether the change amount of the external image is less than the threshold value. For example, since the user is viewing the wall at home, the wearable glass 100 can obtain the change amount information of the image 3620 of the wall. At this time, since the variation amount of the image 3620 of the wall is less than the threshold value, the wearable glass 100 can decide to output the news content 3621 at the present time.

The wearable glass 100 can be classified into a news content 3621 (for example, Sochi Olympics, Kim Yu-na silver medal, Kim Yu-na won valuable silver medals at Sochi Olympics), Augmented Reality (AR) : Mixed Reality, or Virtual Reality (VR). In this case, the user can check the news content 3621 through the wearable glass 100 in a situation where the view is not obstructed.

Hereinafter, the operation of the wearable glass 100 to adjust the transparency, color, and saturation of the notification content will be described in detail with reference to FIG.

37 is a flowchart for explaining a method in which a wearable glass adjusts at least one of transparency, hue, and saturation of a content corresponding to a notification event based on information about an external image, according to an embodiment of the present invention.

In step S3710, the wearable glass 100 can detect occurrence of a notification event.

In step S3720, the wearable glass 100 can use the image sensor 161 to obtain information on the external image. The information on the external image may include, but is not limited to, information on the amount of change in the external image, color information on the external image, and object information on the external image.

Since steps S3710 and S3720 correspond to steps S3310 and S3320 of FIG. 33, a detailed description thereof will be omitted.

In step S3730, the wearable glass 100 can determine whether to output the notification content based on the information about the external image.

According to an embodiment of the present invention, the wearable glass 100 may decide not to output the alert content when a predetermined number of edges are detected in the external image. Conversely, the wearable glass 100 may decide to output the alert content if less than a predetermined number of edges are detected in the external image.

According to an embodiment of the present invention, the wearable glass 100 can decide not to output the notification content when the amount of change of the external image is equal to or larger than the threshold value. Conversely, the wearable glass 100 may decide to output the notification content when the amount of change of the external image is less than the threshold value.

In step S3740, the wearable glass 100 may adjust at least one of transparency, hue, and saturation of the notification content when it is determined to output the notification content.

According to one embodiment of the present invention, the wearable glass 100 can adjust at least one of transparency, hue, and saturation of the content based on the illuminance information. For example, the wearable glass 100 can measure the illuminance value by using an illuminance sensor. When the measured illumination value is less than the threshold value, the wearable glass 100 can lower the transparency of the notification content and increase the saturation value of the notification content.

According to one embodiment of the present invention, the wearable glass 100 can adjust at least one of transparency, hue, and saturation of the content based on the acceleration information. For example, the wearable glass 100 can increase the transparency of the notification content as the moving speed of the user increases.

According to one embodiment of the present invention, the wearable glass 100 may adjust at least one of transparency, hue, and saturation of the notification content based on the color information of the external image. For example, the wearable glass 100 may display alert content in a color that is in a complementary relationship with the color of the external image.

In step S3750, the wearable glass 100 may output alert content based on at least one of the adjusted transparency, the adjusted color, and the adjusted saturation. See FIG.

38 is a diagram for explaining an example in which the wearable glass adjusts the color of the content corresponding to the notification event based on the information about the external image.

Referring to FIG. 38, while the user wearing the wearable glass 100 is looking at the sky, the wearable glass 100 can detect occurrence of a notification event. In this case, the wearable glass 100 may acquire the sky image 3800.

The wearable glass 100 can adjust the color of the notification content based on the color information of the sky image 3800. [ For example, if the default color of the alert content is blue, the user may have difficulty identifying the blue alert content 3810, which is displayed in AR form over the sky image 3800.

Therefore, the wearable glass 100 can change the color of the notification content from blue to yellow, and display the yellow notification content 3820. [

39 is a flowchart for explaining a method for determining the output position of content corresponding to a notification event, in accordance with an embodiment of the present invention.

In step S3910, the wearable glass 100 can detect occurrence of a notification event.

In step S3920, the wearable glass 100 can use the image sensor 161 to acquire information on the external image. The information on the external image may include at least one of color information of the external image and object information included in the external image, but is not limited thereto.

Since steps S3910 and S3920 correspond to steps S3310 and S3320 of FIG. 33, a detailed description will be omitted.

In step S3930, the wearable glass 100 can determine the output position of the notification content based on at least one of the object information included in the external image and the color information of the external image.

For example, the wearable glass 100 can determine, as an output position of the notification content, a position that does not overlap with an actual object (e.g., a communication partner), based on object information included in the external image. In addition, the wearable glass 100 may determine an area in which the basic color and the complementary color of the notification content are displayed as the output position of the notification content.

In step S3940, the wearable glass 100 can output the notification content at the determined position. Please refer to FIG.

40 is a diagram for explaining an example in which the wearable glass changes the output position of the content corresponding to the notification event.

40, while the first user wearing the wearable glass 100 is in conversation with the second user, the wearable glass 100 receives a push message including the news content 4000 from the server 300 can do. In this case, the wearable glass 100 can detect that a notification event that should display the news content 4000 has occurred.

40, when the wearable glass 100 displays the news content 4000 at the center, the face of the second user may be obscured by the news content 4000. [

Thus, the wearable glass 100 may obtain information about the external image before displaying the news content 4000. [ For example, the wearable glass 100 may use the image sensor 161 to obtain a captured image including a second user. The wearable glass 100 can analyze the captured image and determine the position of the second user. The wearable glass 100 can determine an area that is not overlapped with the second user as the display position of the news content 4000. [

As shown in 4020 of FIG. 40, the wearable glass 100 can display the news content 4000 in an area not overlapping with the face of the second user.

According to an embodiment of the present invention, as the face of the second user moves, the wearable glass 100 can also adaptively change the display position of the news content 4000. [

FIG. 41 is a flowchart for explaining a method of determining a method of providing content corresponding to a notification event based on user's setting information, according to an embodiment of the present invention.

In step S4110, the wearable glass 100 can receive setting information related to the provision of the notification content. For example, the wearable glass 100 may receive setting information regarding at least one of a providing time, a providing place, and a providing form of the notification content.

According to an embodiment of the present invention, the wearable glass 100 may receive setting information related to the provision of notification content from the mobile terminal 200 or the server 300. [ For example, the user can set whether to output the alert content generated in the wearable glass 100, the output timing, the output format, and the output location by using the mobile terminal 200.

In step S4120, the wearable glass 100 can detect occurrence of a notification event.

In step S4130, when the wearable glass 100 detects the occurrence of the notification event, it can determine the method of providing the notification content based on the setting information. For example, the wearable glass 100 can determine the providing time, the providing form, the providing place, and the like of the notification content according to the setting information.

In step S4140, the wearable glass 100 can provide notification content. For example, the wearable glass 100 can provide alert content in a specific form at a specific time according to the setting information.

Hereinafter, with reference to FIG. 42 to FIG. 44, the operation of the wearable glass 100 to provide alert content according to the setting information will be described in detail.

42 is a diagram showing an example of setting information 4200 related to the output of the content corresponding to the notification event.

As shown in FIG. 42, the user can set whether to output the notification content by the location 4201 or the application 4202.

For example, the user can block the output of the notification content when located in a library, output the entire notification content when the user is located at home, and output a part of the notification content when the user is located in the office.

Further, the user may set a part of the notification content corresponding to the first application to be output, and the notification content corresponding to the second application may block the output.

According to one embodiment of the present invention, the wearable glass 100 acquires the setting information 4200 related to the output of the notification content from the mobile terminal 200 or the server 300, and stores the setting information 4200 in the memory Can be stored.

When the notification event occurs, the wearable glass 100 can output the notification content based on the setting information. 43 and 44 will be referred to.

43 and 44 show an example in which the wearable glass outputs the content corresponding to the notification event based on the setting information of the user.

43, the wearable glass 100 can receive a push message from the server 300 including the news content while the user wearing the wearable glass 100 is at home. In this case, the wearable glass 100 can detect that a notification event to display the news content has occurred.

The wearable glass 100 can confirm the setting information 4200 related to the output of the notification event before outputting the notification event. Since the setting information 4200 is set so as to output the whole of the notification content when the user wearing the wearable glass 100 is at home, the wearable glass 100 outputs the entire content 4300 of the news content .

Referring to FIG. 44, while the user wearing the wearable glass 100 is in the office, the wearable glass 100 may receive a push message including the news content through the mobile terminal 200. FIG. In this case, the wearable glass 100 can detect that a notification event to display the news content has occurred.

The wearable glass 100 can confirm the setting information 4200 related to the output of the notification event before outputting the notification event. The wearable glass 100 is a part of the news content (for example, a headline) because the setting information 4200 is set to output a part of the notification content when the user wearing the wearable glass 100 is located in the office. (4400).

45 is a flowchart for explaining a method in which wearable glass receives emergency alert information from an external wearable device according to an embodiment of the present invention;

In step S4510, the external wearable device 400 can measure the biometric information of the user.

The outer wearable device 400 may include, but is not limited to, rings, necklaces, bands, wrist watches, shoes, earrings, hair bands, clothes, gloves,

According to one embodiment of the present invention, the external wearable device 400 can measure pulse rate information, blood pressure information, heart rate information, body temperature information, and the like.

In step S4520, the external wearable device 400 can determine whether it is an emergency situation based on the biometric information.

For example, the external wearable device 400 determines that the user is in an emergency situation when the pulse rate of the user is equal to or greater than a threshold number of times (for example, 100 times per minute) or the user's body temperature is equal to or higher than a critical temperature can do.

In step S4530, the external wearable device 400 can transmit the emergency notification information to the wearable glass 100 when it is determined to be an emergency. The emergency notification information may include biometric information measured by the external wearable device 400, a message indicating an emergency situation, an icon indicating an emergency situation, and the like.

According to an embodiment of the present invention, the external wearable device 400 may transmit emergency alert information to the wearable glass 100 using local communication (e.g., Bluetooth, Wi-Fi Direct, NFC, etc.).

According to an embodiment of the present invention, the external wearable device 400 may transmit the emergency notification information to the wearable glass 100 through the mobile terminal 200 or the server 300.

In step S4530, the wearable glass 100 can detect occurrence of a notification event. For example, the wearable glass 100 may detect that a notification event has occurred that should output an emergency notification message.

In step S4550, the wearable glass 100 may provide alert content.

According to an embodiment of the present invention, since the wearable glass 100 is in an emergency state, it can immediately provide an emergency notification message regardless of the user's movement pattern information or external image information. Referring to FIG. 46, the operation of the wearable glass 100 for outputting an emergency notification message will be described in more detail.

46 is a diagram showing an example in which the wearable glass displays pulse rate information received from an external wearable device;

Referring to 4610 in FIG. 46, the smart clock 400-1 can measure the pulse number of the user. The smart clock 400-1 can measure the pulse number of the user at a predetermined cycle. The smart clock 400-1 may measure the pulse number of the user at the occurrence of a specific event. The specific event may include, but is not limited to, an event for which a user sets a motion mode or an event for selecting a button for requesting a pulse rate measurement.

The smart watch 400-1 may be 97 beats per minute (BPM) as a result of measuring the user's pulse rate. The user's typical pulse rate may be 81 BPM.

Referring to 4620 of FIG. 46, the smart clock 400-1 can compare the measured pulse rate (97 BPM) with the user's normal pulse rate (81 BPM). Since the difference between the measured pulse rate (97 BPM) and the user's general pulse rate (81 BPM) exceeds a threshold value (for example, 10 BPM), the smart clock 400-1 determines that an anomaly occurs in the user's pulse number It can be judged.

In this case, the smart clock 400-1 can output a notification message &quot; abnormal pulse rate &quot;. In addition, the smart clock 400-1 can transmit the emergency notification information indicating that the number of pulses is abnormal to the wearable glass 100. [

Referring to 4630 in FIG. 46, the wearable glass 100 may receive the emergency alert information directly from the smart clock 400-1 or receive the emergency alert information through the mobile terminal 200 .

At this time, the wearable glass 100 can output the emergency situation notification content (for example, emergency! Pulse rate is low!) Based on the received emergency situation notification information.

According to an embodiment of the present invention, the user can check biometric information and emergency alert content measured in the external wearable device 400 through the wearable glass 100 in real time.

47 is a flowchart for explaining how a wearable glass outputs content corresponding to a notification event via an external device, according to an embodiment of the present invention.

In step S4710, the wearable glass 100 can detect occurrence of a notification event.

In step S4720, the wearable glass 100 can acquire the movement pattern information of the user when the occurrence of the notification event is detected. The movement pattern information of the user may include at least one of the operation state information of the user, the movement speed information of the user, and the location information of the user, but is not limited thereto.

In step S4730, the wearable glass 100 can determine how to provide the notification content. According to an embodiment of the present invention, the wearable glass 100 can determine when to provide the notification content. Further, according to the embodiment of the present invention, the wearable glass 100 may determine the form of providing the notification content.

Since steps S4710 to S4730 correspond to steps S510 to S530 in Fig. 5, detailed description thereof will be omitted.

In step S4740, the wearable glass 100 can output the notification content. According to an embodiment of the present invention, the wearable glass 100 can output alert content according to a method of providing alert content. For example, the wearable glass 100 can output a part of the notification content.

In step S4750, the wearable glass 100 may receive a user input requesting transmission of the notification content to the external device 4700. [ At this time, the user input may be various. For example, the user input may be at least one of a motion input, a touch input, a key input, a voice input, and a multiplex input, but is not limited thereto.

According to an embodiment of the present invention, the external device 4700 may be a wearable device other than the wearable glass 100. For example, the external device 4700 may be a smart clock, a band, a necklace, and the like. Also, the external device 4700 may be a mobile terminal 200 connected to the wearable glass 100.

According to one embodiment of the present invention, the wearable glass 100 may receive an input to select an external device 4700 for transmitting alert content. For example, wearable glass 100 may receive input to select a smart clock and input to request transmission of the alert content to a smart clock.

According to an embodiment of the present invention, an external device 4700 for transmitting alert content may be predetermined.

In addition, according to an embodiment of the present invention, the wearable glass 100 may search for a wearable device located within a short-distance communication radius, and may transmit alert content to the searched wearable device.

In step S4760, the wearable glass 100 may transmit the notification content to the external device 4700 according to user input. For example, the wearable glass 100 may transmit alert content to the external device 4700 using local area communication (e.g., Bluetooth) or mobile communication (e.g., 3G / 4G / 5G, etc.).

According to an embodiment of the present invention, the wearable glass 100 may transmit the notification content directly to the external device 4700 or may transmit the notification content to the external device 4700 via the mobile terminal 200. [

For example, when the external device 4700 is a wearable device, the wearable glass 100 transmits the notification content to the external device 4700 through the mobile terminal 200 connecting the wearable device to the wearable glass 100 .

In step S4770, the external device 4700 can output the notification content. For example, the external device 4700 can display the notification content on the screen. If the notification content is a moving image, the external device 4700 may play back the notification content. Referring to FIG. 48, the operation of outputting the notification content in the external device 4700 connected to the wearable glass 100 will be described in further detail.

48 is a diagram showing an example in which a wearable glass outputs content corresponding to a notification event through an external device based on user input.

Referring to 4800-1 in FIG. 48, the wearable glass 100 can receive the push message including the news content from the server 300 while the wearer wearing the wearable glass 100 crosses the crosswalk. In this case, the wearable glass 100 can detect that a notification event to display the news content has occurred.

According to an embodiment of the present invention, the wearable glass 100 may acquire the movement pattern information of the user before displaying the news content. For example, the wearable glass 100 may be a confirmation that the user is moving at a speed of 3 km / h.

The wearable glass 100 can output a part 4810 of the news content because the user is moving, so as not to block the user's view much. For example, the wearable glass 100 can extract a headline from a news content and output the extracted headline.

Referring to 4800-2 in FIG. 48, the user confirms the headline of the news content, and then shakes a shaking gesture in front of the wearable glass 100 to check the entire content 4830 of the news content in the smart clock 4800 4820).

In this case, the wearable glass 100 may sense the user's shaking gesture 4820 while outputting a portion 4810 of the news content (e.g., a headline). For example, the wearable glass 100 can detect the shaking gesture 4820 by which the user shakes the hand, using the depth sensor 154, the image sensor 161, and the like.

The wearable glass 100 may transmit the news content to the smart clock 4800 according to the user's shaking gesture 4820. [ According to an embodiment of the present invention, the wearable glass 100 may transmit the news content directly to the smart watch 4800 or may transmit the news content to the smart watch 4800 through the mobile terminal 200.

According to an embodiment of the present invention, the smart clock 4800 can display the entire news content 4830 received from the wearable glass 100 on the screen. At this time, the wearable glass 100 may no longer output part 4810 of the news content.

According to an embodiment of the present invention, in order to prevent the news content from being transmitted from the wearable glass 100 to the smart watch 4800 regardless of the intention of the user, the wearable glass 100 may include a shaking gesture 4820 May transmit the news content to the smart clock 4800 only when the holding time of the news content is more than the threshold time or the number of shaking times is a predetermined number (e.g., twice).

48, the case where the user input requesting transmission of the notification content is the shaking gesture 4820 has been described as an example, but the present invention is not limited thereto. For example, the user may input a voice for requesting the transmission of the notification content to the wearable glass 100, or may select a specific button included in the wearable glass 100.

49 is a flowchart for explaining how wearable glass transmits content corresponding to a notification event to an external device in response to a request from an external device, according to an embodiment of the present invention.

In step S4910, the wearable glass 100 can detect occurrence of a notification event.

In step S4920, the wearable glass 100 can acquire the movement pattern information of the user.

In step S4930, the wearable glass 100 can output the notification content according to the providing method determined based on the user's movement pattern information.

Since steps S4910 to S4930 correspond to steps S4710 to S4730 in Fig. 47, detailed description thereof will be omitted.

In step S4940, the external device 4900 can receive a user input requesting output of the notification content in the external device 4900. [

According to an embodiment of the present invention, the external device 4900 may be a wearable device other than the wearable glass 100. For example, the external device 4900 may be a smart clock, a band, a necklace, and the like. Also, the external device 4900 may be a mobile terminal 200 connected to the wearable glass 100.

According to an embodiment of the present invention, the user input for requesting the output of the notification content may vary. For example, the user input may be at least one of a motion input, a touch input, a key input, a voice input, and a multiplex input, but is not limited thereto.

In step S4950, the external device 4900 can request the wearable glass 100 to transmit the notification content. The external device 4900 may directly request the wearable glass 100 to transmit the notification content or request the wearable glass 100 to transmit the notification content through the mobile terminal 200. [

In step S4960, the wearable glass 100 can transmit the notification content to the external device 4900. [ For example, the wearable glass 100 may transmit alert content to an external device 4900 using near field communication (e.g., Bluetooth) or mobile communication (e.g., 3G / 4G / 5G, etc.).

According to an embodiment of the present invention, the wearable glass 100 may transmit the notification content directly to the external device 4900 or may transmit the notification content to the external device 4900 via the mobile terminal 200. [ For example, when the external device 4900 is a wearable device, the wearable glass 100 transmits the notification content to the external device 4900 via the mobile terminal 200 connecting the wearable device to the wearable glass 100 .

In step S4970, the external device 4900 can output the notification content. For example, the external device 4900 can display the notification content on the screen. If the notification content is a video, the external device 4900 may play back the notification content. Referring to FIG. 50, the operation of outputting notification content in the external device 4900 connected to the wearable glass 100 will be described in further detail.

50 is a diagram showing an example of displaying content corresponding to a notification event in an external device based on a user input received through an external device connected to the wearable glass.

Referring to 5000-1 in FIG. 50, the wearable glass 100 can receive the push message including the news content from the server 300 while the wearer wearing the wearable glass 100 crosses the crosswalk. In this case, the wearable glass 100 can detect that a notification event to display the news content has occurred.

According to an embodiment of the present invention, the wearable glass 100 may acquire the movement pattern information of the user before displaying the news content. For example, the wearable glass 100 may be a confirmation that the user is moving at a speed of 3 km / h.

The wearable glass 100 can output a part 5010 of the news content because the user is moving, so as not to block the user's view much. For example, the wearable glass 100 can extract a headline from a news content and output the extracted headline.

Referring to 5000-2 of FIG. 50, the user can select a specific button of the smart clock 5000 to check the entire content 5030 of the news content on the smart clock 5000 after confirming the headline of the news content have. The specific button may be a button corresponding to an instruction to display the notification content displayed through the wearable glass 100 in the smart watch 5000. According to an embodiment of the present invention, the specific button may be a physical button or a virtual button in GUI form.

The smart clock 5000 can request the wearable glass 100 to transmit the news content displayed in the wearable glass 100. [

The wearable glass 100 may transmit the news content to the smart clock 5000 in response to the request of the smart clock 5000. According to an embodiment of the present invention, the wearable glass 100 may transmit the news content directly to the smart watch 5000 or may transmit the news content to the smart watch 5000 through the mobile terminal 200.

Referring to 5000-3 in FIG. 50, the smart clock 5000 can display the entire news content 5030 received from the wearable glass 100 on the screen. At this time, the wearable glass 100 may no longer output a part 5010 of the news content.

51 is a flowchart for explaining a method in which wearable glass outputs content corresponding to a notification event through an external device based on user's movement pattern information according to an embodiment of the present invention.

In step S5110, the wearable glass 100 may form a communication link with the external device 5100. [

For example, the wearable glass 100 may form a short-range communication link with the external device 5100 and form a mobile communication link (e.g., 3G, 4G, 5G, etc.). The local communication may include, but is not limited to, Bluetooth, Bluetooth low energy (BLE), Wi-Fi direct, ultra wideband (UWB), Zigbee, Near Field Communication unit (NFC)

In step S5120, the wearable glass 100 can detect occurrence of a notification event.

In step S5130, the wearable glass 100 can acquire the movement pattern information of the user when detecting the occurrence of the notification event.

According to an embodiment of the present invention, the wearable glass 100 can acquire movement pattern information of a user using at least one of an acceleration sensor, a tilt sensor, and a position sensor. According to an embodiment of the present invention, the wearable glass 100 may acquire movement pattern information of the user using the user's schedule information and life pattern information. According to an embodiment of the present invention, the wearable glass 100 may analyze a user's movement pattern using biometric information measured in an external wearable device.

In step S5140, the wearable glass 100 can determine to output the notification content via the external device 5100 based on the user's movement pattern information.

For example, the wearable glass 100 can determine whether the moving speed of the user is less than a critical speed (for example, 4 km / h) by using the user's movement pattern information. When the moving speed of the user is equal to or higher than the threshold speed, the wearable glass 100 determines to output the notification content through the external device 5100. When the moving speed of the user is less than the threshold speed, As shown in FIG.

In step S5150, when the wearable glass 100 determines to output the notification content through the external device 5100, the wearable glass 100 can transmit the notification content to the external device 5100. [ According to an embodiment of the present invention, the wearable glass 100 may transmit alert content to the external device 5100 using the preformed communication link.

In step S5160, the external device 5100 can output the content corresponding to the notification event. For example, the external device 5100 can display the notification content on the screen. When the notification content is a moving image, the external device 5100 may play back the notification content.

When it is determined in step S5170 not to output the notification content through the external device 5100, the wearable glass 100 can output the notification content from the wearable glass 100. [

52 is a view showing an example in which the wearable glass outputs the content corresponding to the notification event through the external device based on the movement pattern information of the user.

Referring to 5200-1 in FIG. 52, when the user wearing the wearable glass 100 is walking in a public place with many people, the wearable glass 100 can receive the push content including the news content 5210 from the server 300 Message can be received. In this case, the wearable glass 100 can detect that a notification event that should display the news content 5210 has occurred.

The wearable glass 100 may obtain the movement pattern information of the user before displaying the news content 5210 and determine whether the moving speed of the user is less than a critical speed (for example, 2 km / h). For example, the moving speed of a user walking in a public place may be 3 km / h. In this case, the wearable glass 100 does not output the news content 5210 from the wearable glass 100 because the moving speed of the user (for example, 3 km / h) is equal to or higher than the threshold speed (2 km / h) It may decide to output the news content 5210 via the content server 5200.

Referring to 5200-2 in FIG. 52, the wearable glass 100 may request the output of the news content 5210 while transmitting the news content 5210 to the smart clock 5200. [ The smart clock 5200 can display the news content 5210 on the screen in response to a request from the wearable glass 100.

According to an embodiment of the present invention, when the wearer wears the wearable glass 100 at a speed higher than a predetermined speed, the wearable glass 100 may change the notification content to another wearable device , Smart clock 5200).

53 is a flowchart for explaining a method of providing a list of contents in which wearable glass is not output, according to an embodiment of the present invention.

In step S5310, the wearable glass 100 may receive a user input requesting a list of unreported contents. The list of unreported contents may include an alert content that is not output when a notification event occurs and a notification content that is partially output when a notification event occurs.

According to an embodiment of the present invention, user input for requesting a list of unreported contents may be various. For example, a user input for requesting a list of unreported contents may include an input for touching a certain area of the spectacle frame, an input for selecting a schedule button included in the spectacle frame, a voice input for requesting a list of unreleased contents, Up may include, but is not limited to, head-up motion input.

In step S5320, the wearable glass 100 may provide a list of unreported contents in response to user input. For example, the wearable glass 100 can display a list of contents that have not yet been output in AR format.

According to the embodiment of the present invention, the wearable glass 100 can receive a scroll request from the user when the undischarged content can not be displayed on one screen. The wearable glass 100 can scroll up and down or right and left in response to a scrolling request of the user.

If the wearable glass 100 moves the information displayed on the screen in the vertical or horizontal direction when the amount of information to be displayed on the screen is larger than the screen displayable amount of the wearable glass 100, This means that new information is displayed on the opposite side as the disappearing part of the moved screen.

In step S5330, the wearable glass 100 may receive an input for selecting one content included in the list. For example, the wearable glass 100 may recognize that when a shaking motion input is shaken up and down, the user selects the content displayed at the center of the list.

The wearable glass 100 may also receive an eye input that selects one content included in the list. For example, the wearable glass 100 may select specific content in the list based on an eye input that blinks more than a predetermined number of times or gazes at a specific content for a predetermined time or more.

In step S5340, the wearable glass 100 can output the selected content. For example, the wearable glass 100 can display or reproduce the alert content that has not yet been output on the screen.

 According to one embodiment of the present invention, the wearable glass 100 provides a list of unreported contents so that the user can select and confirm the notification content to be checked out of the list of unreported contents.

Meanwhile, according to an embodiment of the present invention, the wearable glass 100 may provide a list of the outputted notification contents. The user can select a specific notification content from the list of the output notification contents to check the specific notification content again.

54 is a diagram showing an example in which the wearable glass provides a list of unreported contents based on a user's specific input. 54, the case where the user input requesting the provision of the list 5411 of unreported contents is the head up motion 5410 and the user input requesting the scroll is the shaking motion 5420 will be described as an example.

Referring to 5400-1 in Fig. 54, the wearable glass 100 can receive a head-up motion 5410 in which the user lifts his / her head while the occurrence of the notification event is not detected. For example, the wearable glass 100 can sense a user's head-up motion 5410 using a tilt sensor, an acceleration sensor, a gyroscope sensor, or the like.

The wearable glass 100 may display a list 5411 of undisplayed content in response to the user's head-up motion 5410. [

According to an embodiment of the present invention, in order to prevent the list 5411 of undischarged contents from being displayed irrespective of the intention of the user, the wearable glass 100 has a maintenance time of the head-up motion 5410 It is possible to display the list 5411 of unreported contents only when the threshold value is equal to or greater than a threshold time (for example, 2 seconds).

Referring to 5400-2 in Fig. 54, the wearable glass 100 can sense a shaking motion 5420 in which the user shakes the head in the state in which the list 5411 of unreleased contents is displayed.

For example, the wearable glass 100 can sense a shaking motion 5420 that shakes the head more than a predetermined number of times (for example, twice) using a tilt sensor, an acceleration sensor, a gyroscope sensor or the like. At this time, the wearable glass 100 can scroll the list 5411 of the contents that have not yet been output according to the user's shaking motion 5420. [

According to an embodiment of the present invention, when the user selects the first content 5422 of the list 5411 of unreported contents, the wearable glass 100 can display or play the first content 5422 have.

FIG. 55 is a diagram showing an example in which a wearable device connected to wearable glass provides a list of contents that have not yet been output in the wearable glass. FIG.

55, a smart clock 5500 connected to the wearable glass 100 may display a list of contents that have not yet been output from the wearable glass 100. [ The user can check the list of unreported contents and select the first content 5501 from the list of unreported contents.

55, the smart clock 5500 may provide a selection window from which a device for displaying the first content 5501 can be selected.

When the user selects the direct view 5502 in the selection window, the smart clock 5500 can display the first content 5501 that has not been output from the wearable glass 100 on the screen of the smart clock 5500.

When the user selects the wearable glass view 5503 in the selection window, the smart watch 5500 can request the output of the first content 5501 to the wearable glass 100. The wearable glass 100 may display the first content 5501 at the request of the smart clock 5500. [

56 is a diagram showing an example in which a wearable device connected to wearable glass provides a list of contents output from wearable glass.

Referring to 5610 of FIG. 56, a smart clock 5600 connected to the wearable glass 100 can display a list of contents output from the wearable glass 100. The user can confirm the list of previously output contents and select the eleventh content 5601 from the list of previously output contents.

Referring to 5620 of FIG. 56, the smart clock 5600 may provide a selection window from which a device for displaying the eleventh content 5601 can be selected.

When the user selects the direct view 5602 in the selection window, the smart clock 5600 can display the eleventh content 5601 output from the wearable glass 100 on the screen of the smart clock 5600.

When the user selects the HMD view 5603 in the selection window, the smart clock 5500 can request the output of the eleventh content 5601 to the wearable glass 100. [ The wearable glass 100 may display the eleventh content 5601 at the request of the smart clock 5600. [

57 and 58 are block diagrams for explaining the configuration of a wearable glass according to an embodiment of the present invention.

As shown in FIG. 57, the wearable glass 100 according to an embodiment of the present invention may include an output unit 110 and a control unit 120. However, not all illustrated components are required. The wearable glass 100 may be implemented by more components than the components shown, or the wearable glass 100 may be implemented by fewer components.

58, the wearable glass 100 according to an exemplary embodiment of the present invention includes a user input unit 130, a communication unit 140, a sensing unit 140, and a control unit 120 in addition to the output unit 110 and the control unit 120. [ A memory unit 150, an A / V input unit 160, and a memory 170. The sensing unit 150 may be expressed as a sensor unit.

Hereinafter, the components will be described in order.

The output unit 110 is for outputting an audio signal, a video signal, or a vibration signal. The output unit 110 may include a display unit 111, an acoustic output unit 112, a vibration motor 113, and the like.

The display unit 111 can display information processed in the wearable glass 100. For example, the display unit 111 may display the content (notification message information) corresponding to the notification event. At this time, the display unit 111 may display the content corresponding to the notification event in the form of Augmented Reality (AR), Mixed Reality (MR), or Virtual Reality (VR). Also, the display unit 111 may display an indicator indicating occurrence of a notification event.

The display unit 111 can display a list of unrecorded contents. The list of unreported contents may include an alert content that is not output when a notification event occurs and a notification content that is partially output when a notification event occurs.

Meanwhile, when the display unit 111 and the touch pad have a layer structure and are configured as a touch screen, the display unit 111 can be used as an input device in addition to the output device. The display unit 111 may be a liquid crystal display, a thin film transistor-liquid crystal display, an organic light-emitting diode, a flexible display, a three-dimensional display A 3D display, and an electrophoretic display. According to the embodiment of the wearable glass 100, the wearable glass 100 may include two or more display units 111.

The sound output unit 112 outputs audio data received from the communication unit 140 or stored in the memory 170. [ The sound output unit 112 outputs a sound signal related to a function (e.g., a call signal reception sound, a message reception sound, a notification sound) performed in the wearable glass 100. The sound output unit 112 may include a speaker, a buzzer, and the like.

The vibration motor 113 can output a vibration signal. For example, the vibration motor 113 may output a vibration signal corresponding to an output of audio data or video data (e.g., a call signal reception tone, a message reception tone, etc.). In addition, the vibration motor 113 may output a vibration signal when a touch is input to the touch screen.

The output unit 110 may provide the content corresponding to the notification event in accordance with the providing method determined based on the user's movement pattern information.

The control unit 120 typically controls the overall operation of the wearable glass 100. For example, the control unit 120 may include an output unit 110, a user input unit 130, a communication unit 140, a sensing unit 150, an A / V input unit 160 ) Can be generally controlled.

The control unit 120 can acquire movement pattern information of a wearer wearing the wearable glass 100 upon detecting occurrence of a notification event. The movement pattern information of the user may include at least one of the operation state information of the user, the movement speed information of the user, and the location information of the user.

The control unit 120 determines whether the wearable glass 100 is worn by the user based on at least one sensor included in the wearable glass. If it is determined that the wearable glass is worn by the wearer, .

The control unit 120 may acquire movement pattern information of the user by analyzing the movement pattern of the user using at least one of the acceleration information, the slope information, and the position information measured in the wearable glass 100.

The control unit 120 may determine a providing time of the content corresponding to the notification event based on the user's movement pattern information.

The control unit 120 may determine to output the notification content at the present time if the movement speed of the user is less than the threshold speed and to output the notification content at a predetermined time when the movement speed of the user is equal to or higher than the threshold speed. The predetermined time may include at least one of a time at which a user input requesting output of a content corresponding to a notification event, a time at which a user's movement pattern changes, and a time at which a preset time has elapsed, But is not limited thereto.

The control unit 120 may determine a method of providing the content corresponding to the notification event based on the movement pattern information of the user. For example, the control unit 120 may determine to output a part of the notification content when the moving speed of the user is equal to or higher than the threshold speed, and to output the entire notification content if the moving speed of the user is less than the threshold speed .

The control unit 120 may determine the output form of the notification content as at least one of an audio signal and a video signal in consideration of environmental information within a predetermined distance from the wearable glass 100. [ The environmental information may include at least one of information on an external sound generated within a predetermined distance from the wearable glass 100 and information on an external image obtained through the image sensor 161. [

The control unit 120 may control the display unit 111 to display the received notification message information on the display unit 111 based on the signal output from the sensing unit 150. [

The control unit 120 determines whether the wearable glass is worn by the user based on a signal output from at least one sensor included in the sensing unit 150. If it is determined that the user wears the wearable glass, It is possible to control the sensing unit 150 to sense motion.

The user input unit 130 means means for the user to input data for controlling the wearable glass 100. For example, the user input unit 130 may include a key pad, a dome switch, a touch pad (contact type capacitance type, pressure type resistive type, infrared ray detection type, surface ultrasonic wave conduction type, A tension measuring method, a piezo effect method, etc.), a jog wheel, a jog switch, and the like, but is not limited thereto.

Since the user input unit 130 has been described with reference to FIG. 2, a duplicate description will be omitted.

The user input unit 130 may receive a user input requesting output of the notification content.

The user input 130 may receive a first user input requesting a full output of the content. The first user input may be at least one of a motion input, a touch input, a key input, a voice input, and a multiplex input, but is not limited thereto. According to an embodiment of the present invention, a first user input for requesting a total output of the notification content may be preset. For example, the user may set the head-up motion to lift the head to the first user input requesting full output.

The user input unit 130 may receive a second user input requesting to block some output of the notification content. The second user input may also vary.

The user input unit 130 may receive a user input requesting a list of unreported contents. The user input for requesting a list of uncompressed contents includes an input for touching a predetermined area of the spectacle frame, an input for selecting a schedule button included in the spectacle frame, a voice input for requesting a list of uncompleted contents, a head- Input, and the like, but is not limited thereto.

The user input unit 130 may receive a user input requesting transmission of the notification content to an external device. At this time, the user input unit 130 may receive an input for selecting an external device for transmitting the notification content. For example, the user input 130 may receive an input for selecting a smart clock and an input for requesting transmission of the alert content to a smart clock.

The communication unit 140 includes at least one component that enables communication between the wearable glass 100 and the mobile terminal 200, the wearable glass 100 and the server 300, or between the wearable glass 100 and the external wearable device can do. For example, the communication unit 140 may include a short-range communication unit 141, a mobile communication unit 142, and a broadcast reception unit 143.

The short-range wireless communication unit 141 includes a Bluetooth communication unit, a BLE (Bluetooth Low Energy) communication unit, a Near Field Communication unit, a WLAN communication unit, a Zigbee communication unit, IrDA, an infrared data association) communication unit, a WFD (Wi-Fi Direct) communication unit, an UWB (ultra wideband) communication unit, an Ant + communication unit, and the like.

The mobile communication unit 142 transmits and receives radio signals to at least one of a base station, an external terminal, and a server on a mobile communication network. Here, the wireless signal may include various types of data depending on a voice call signal, a video call signal, or a text / multimedia message transmission / reception.

The broadcast receiver 143 receives broadcast signals and / or broadcast-related information from outside through a broadcast channel. The broadcast channel may include a satellite channel and a terrestrial channel. The wearable glass 100 may not include the broadcast receiver 143 according to the embodiment.

The communication unit 140 may receive notification message information.

The communication unit 140 may request the user's movement pattern information from the external device connected to the wearable glass 100 and receive the user's movement pattern information from the external device. At this time, the communication unit 140 may request the user's movement pattern information while transmitting acceleration information, inclination information, position information, and the like measured by the wearable glass 100 to an external device.

The communication unit 140 can request the analysis of the external image while transmitting the external image captured by the mobile terminal 200 or the server 300. [ The communication unit 140 may receive at least one of the change amount information of the external image, the color information of the external image, and the object information included in the external image from the mobile terminal 200 or the server 300.

The sensing unit 150 senses the state of the wearable glass 100, the state around the wearable glass 100, the state of the user wearing the wearable glass 100, the movement of the user, 120). For example, the sensing unit 150 senses the motion of the user and outputs a signal related to the motion of the user to the controller 120. [ Where the signal can be an electrical signal.

The sensing unit 150 includes a magnetism sensor 151, an acceleration sensor 152, a tilt sensor 153, a depth sensor 154, a gyroscope sensor 155, a position sensor (GPS) 156, an air pressure sensor 157, a proximity sensor 158, and an optical sensor 159. The present invention is not limited thereto. The sensing unit 150 may include a temperature sensor, a brightness sensor, a pressure sensor, an iris recognition sensor, and the like. The function of each sensor can be intuitively deduced from the name by those skilled in the art, so a detailed description will be omitted.

An A / V (Audio / Video) input unit 160 is for inputting an audio signal or a video signal, and may include a camera (image sensor) 161 and a microphone 162. The camera (image sensor) 161 can obtain an image frame such as a still image or a moving image in a video communication mode or a photographing mode. The image captured through the camera (image sensor) 161 can be processed through the control unit 120 or a separate image processing unit (not shown).

The image frame processed by the camera (image sensor) 161 can be stored in the memory 170 or transmitted to the outside through the communication unit 140. [ The camera (image sensor) 161 may be provided in two or more according to the configuration of the wearable glass 100.

The microphone 162 receives an external acoustic signal and processes it as electrical voice data. For example, the microphone 162 may receive acoustic signals from an external device or speaker. The microphone 162 may use various noise reduction algorithms to remove noise generated in receiving an external sound signal.

The memory 170 may store a program for processing and control of the control unit 120 and may store programs to be input / output (e.g., a list of unreleased contents, a list of output contents, a captured image, , User's schedule information, user's life pattern information, etc.).

The memory 170 may be a flash memory type, a hard disk type, a multimedia card micro type, a card type memory (e.g., SD or XD memory), a RAM (Random Access Memory) SRAM (Static Random Access Memory), ROM (Read Only Memory), EEPROM (Electrically Erasable Programmable Read-Only Memory), PROM (Programmable Read-Only Memory) , An optical disc, and the like. In addition, the wearable glass 100 may operate a web storage or a cloud server that performs a storage function of the memory 170 on the Internet.

The programs stored in the memory 170 can be classified into a plurality of modules according to their functions. For example, the UI module 171, the notification module 172, the STT (Speak to Text) module 173, Processing module 174, and the like.

The UI module 171 can provide a specialized UI, a GUI, and the like that are interlocked with the wearable glass 100 for each application. The notification module 172 may generate a signal for notifying the occurrence of an event of the wearable glass 100. The notification module 172 may output a notification signal in the form of a video signal through the display unit 111 or may output a notification signal in the form of an audio signal through the sound output unit 112, It is possible to output a notification signal in the form of a vibration signal.

The STT (Speech to Text) module 173 can generate a transcript corresponding to the multimedia content by converting a voice included in the multimedia content into text.

The image processing module 174 can obtain object information, edge information, atmosphere information, color information, and the like included in the captured image through analysis of the captured image.

The method according to an embodiment of the present invention can be implemented in the form of a program command which can be executed through various computer means and recorded in a computer-readable medium. The computer-readable medium may include program instructions, data files, data structures, and the like, alone or in combination. The program instructions recorded on the medium may be those specially designed and constructed for the present invention or may be available to those skilled in the art of computer software. Examples of computer-readable media include magnetic media such as hard disks, floppy disks and magnetic tape; optical media such as CD-ROMs and DVDs; magnetic media such as floppy disks; Magneto-optical media, and hardware devices specifically configured to store and execute program instructions such as ROM, RAM, flash memory, and the like. Examples of program instructions include machine language code such as those produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter or the like.

According to one embodiment of the present invention, the wearable glass 100 determines the timing of providing the alert content, the mode of providing the alert content, and the like on the basis of the movement pattern information of the user, It is possible to prevent the visual field from being blocked.

While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it is to be understood that the invention is not limited to the disclosed exemplary embodiments, It belongs to the scope of right.

Claims (20)

A sensing unit for sensing motion information of a wearer wearing a wearable glass;
A communication unit for receiving notification message information;
A display unit for displaying the alert message information within a viewing angle of the wearer wearing the wearable glass; And
And a control unit for controlling the display unit to display the received alert message information according to the motion state of the user by determining the motion state of the user using the sensed user motion information. The apparatus of claim 1,
Wherein the controller is configured to determine whether the user wears the wearable glass based on at least one sensor included in the sensing unit and to determine whether the user wears the wearable glass, Wearable glass to control wealth. The apparatus of claim 1,
Wherein the movement state of the user is determined using at least one of acceleration information, tilt information, biometric information, altitude information, atmospheric pressure information, eyeball tracking information, and position information measured by the sensing unit. The apparatus of claim 1,
Wherein the motion state of the user is determined by further using user's motion information received from an external wearable device. The apparatus of claim 1,
Determines a time for displaying the notification message information based on the movement state of the user and controls the display unit to display the notification message information at the determined time. 6. The apparatus of claim 5,
Determining to output the notification message information at the current time when the moving speed of the user is less than the threshold speed and determining to output the notification message information at a predetermined time when the moving speed of the user is equal to or higher than the threshold speed, Glass. 7. The method of claim 6,
Wherein the wearable glass includes at least one of a time at which a user input requesting the output of the notification message information is received, a time at which the user's movement state changes, and a time at which a preset time has elapsed. The apparatus of claim 1,
Determines a display form for displaying the alert message information based on the movement state of the user and controls the display unit to display the alert message information according to the determined display form. 9. The apparatus according to claim 8,
Determines to display a part of the notification message information if the moving speed of the user is equal to or greater than the threshold speed and determines to display the entire notification message information if the moving speed of the user is less than the threshold speed. 10. The apparatus according to claim 9,
Wherein the output format of the notification message information is determined as at least one of an audio signal and a video signal in consideration of environmental information within a predetermined distance from the wearable glass. The information processing apparatus according to claim 10,
Information about an external sound generated within a predetermined distance from the wearable glass, and information about an external image obtained through the image sensor. A sensing unit sensing a movement of a user and outputting a signal;
A communication unit for receiving notification message information;
A display unit for displaying the notification message information; And
And a control unit for controlling the display unit to display the received notification message information on the display unit based on a signal output from the sensing unit. The apparatus of claim 1,
Wherein the control unit determines whether the user wears the wearable glass based on a signal output from at least one sensor included in the sensing unit, and when the user determines that the wearable glass is worn, Wherein the sensing unit is configured to control the sensing unit. A method of providing information in a wearable glass,
Receiving notification message information;
Sensing movement information of a wearer wearing the wearable glass;
Determining a motion state of the user using the sensed user motion information; And
And displaying the received notification message information according to a movement state of the user. 15. The method of claim 14, wherein sensing the motion information of the user comprises:
Determining whether the user is wearing the wearable glass based on at least one sensor included in the wearable glass; And
And sensing the user's motion information when it is determined that the user is wearing the wearable glass. 15. The method of claim 14, wherein the step of displaying the received notification message information comprises:
Determining a timing for displaying the alert message information; And
And displaying the notification message information at the determined time. 17. The method of claim 16, wherein determining when to display the alert message information comprises:
Determines to output the notification message information at the current time when the moving speed of the user is less than the threshold speed and decides to output the notification message information at a predetermined time when the moving speed of the user is equal to or higher than the threshold speed &Lt; / RTI &gt; 15. The method of claim 14, wherein the step of displaying the received notification message information comprises:
Determining a display form for displaying the alert message information; And
And displaying the notification message information according to the determined display form. 19. The method of claim 18,
Determining to output a part of the notification message information if the moving speed of the user is equal to or greater than the threshold speed and determining to output the entire notification message information if the moving speed of the user is less than the threshold speed, Information delivery method. 19. The method of claim 18, wherein the step of determining a presentation format of the content corresponding to the notification event comprises:
Obtaining environment information within a predetermined distance from the wearable glass; And
And determining to provide the notification message information in the form of at least one of an audio signal and a video signal in consideration of the environment information.

Images