WO2024071903A1 - Head-mounted display apparatus, and method for detecting wearing state thereof - Google Patents

Abstract

Disclosed is a head-mounted display apparatus comprising: a frame including a first surface facing in a first direction and a second surface facing in a second direction opposite to the first direction; a display exposed to the outside through the second surface; wearing parts connected to respective ends of the frame and extending in one direction; and a processor disposed inside at least one of the frame and the wearing parts, wherein each of the wearing parts includes an inner surface that is in contact with a portion of the head when the head-mounted display apparatus is worn on a user's head, and an outer surface that faces the inner surface, and at least one wearing part from among the wearing parts includes a first touch circuit disposed on the inner surface. In addition, various embodiments identified through the present document are also possible.

Description

Head mounted display device and method for detecting wearing state thereof

Various embodiments of the present disclosure relate to a head mounted display device and technology for detecting a wearing state thereof.

Recently, wearable electronic devices that can be worn directly on the body have been actively distributed. Wearable electronic devices can improve mobility and portability because they can be used by being mounted on any part of the body, such as the wrist, ankle, neck, waist, or head. As an example of such a wearable electronic device, a head-mounted display apparatus (hereinafter referred to as HMD) that is mounted on the user's head and displays images may be provided with a wearing portion so that it can be mounted on the head. These HMDs may include an AR device that implements augmented reality (AR) and a VR device that implements virtual reality (VR).

Meanwhile, when the HMD is worn on the user's head, it can activate the display to display information such as AR content or VR content. Additionally, the HMD can disable the display when not worn on the user's head. To control the activation or deactivation of these displays, the HMD can detect the wearing state.

The above information may be provided as background art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing can be applied as prior art to the present disclosure.

Existing HMDs may be equipped with separate sensors, such as proximity sensors, to detect the wearing state. However, if the HMD is equipped with a separate sensor, not only does the manufacturing cost increase, but the mounting space for other electronic components may become narrow due to the sensor mounting space. In particular, in the case of HMDs provided in the form of glasses, space restrictions may be imposed because many electronic components are intensively mounted on the glasses frame, including the temples.

Various embodiments of the present disclosure can provide an HMD that detects a wearing state using a touch circuit disposed on the inner surface of the wearable unit without a separate sensor and a method for detecting the wearing state thereof.

The problems to be solved by the embodiments disclosed in this document are not limited to the above, and may be expanded in various ways without departing from the spirit and scope disclosed in this document.

A head mounted display device according to various embodiments of the present disclosure includes a frame including a first surface facing in a first direction and a second surface facing in a second direction opposite to the first direction, and a frame including a second surface facing in a second direction opposite to the first direction. It may include a display exposed to the outside, wearing parts respectively connected to both ends of the frame and extending in one direction, and a processor disposed inside at least one of the frame or the wearing parts. Each of the wearing units may include an inner surface that is in contact with a portion of the head when the head mounted display device is worn on the user's head, and an outer surface that faces the inner surface. At least one of the wearing parts may include a first touch circuit disposed on the inner surface.

In addition, the method for detecting the wearing state of a head mounted display device according to various embodiments of the present disclosure includes detecting the inner surface of at least one of the wearing parts connected to both ends of the frame of the head mounted display device and extending in one direction. An operation of detecting a first touch input through a first touch circuit disposed in the head mounted display device, and in response to detection of the first touch input, based on first touch information corresponding to the first touch input. It may include an operation of determining the wearing state of .

According to various embodiments of the present disclosure, the wearing state is detected using a touch circuit disposed on the inner surface of the wearable unit without a separate sensor, thereby reducing manufacturing costs and making it easy to secure mounting space for electronic components. .

In addition, various effects that can be directly or indirectly identified through this document may be provided.

Effects derived from the embodiments disclosed in this document are not limited to the effects described above, and may be expanded in various ways without departing from the spirit and scope disclosed in this document.

1 is a block diagram of an electronic device in a network environment according to various embodiments.

FIG. 2 is a diagram for explaining the configuration of an AR device among HMDs according to an embodiment of the present disclosure.

FIG. 3 is a diagram illustrating a touch circuit disposed in an AR device among HMDs according to an embodiment of the present disclosure.

Figure 4 is a front perspective view of a VR device among HMDs according to an embodiment of the present disclosure.

Figure 5 is a rear perspective view of a VR device among HMDs according to an embodiment of the present disclosure.

FIG. 6 is a diagram illustrating a touch circuit disposed on a wearable portion of an HMD according to an embodiment of the present disclosure.

FIG. 7 is a diagram for explaining a method of operating an HMD when worn, according to an embodiment of the present disclosure.

FIG. 8 is a diagram for explaining another method of operating an HMD when worn, according to an embodiment of the present disclosure.

FIG. 9 is a diagram for explaining a method of operating an HMD when removing the HMD according to an embodiment of the present disclosure.

FIG. 10 is a diagram for explaining a method of operating an HMD when the wearing parts of the HMD are separated according to an embodiment of the present disclosure.

FIG. 11 is a diagram for explaining another method of operating the HMD when the wearing parts of the HMD are separated according to an embodiment of the present disclosure.

FIG. 12 is a diagram illustrating a method for detecting contact and separation of wearing parts of an HMD according to an embodiment of the present disclosure.

FIG. 13 is a diagram illustrating another method for detecting contact and separation of wearing parts of an HMD according to an embodiment of the present disclosure.

FIG. 14 is a diagram for explaining a method of operating an HMD when wearing parts of the HMD are in contact according to an embodiment of the present disclosure.

FIG. 15 is a diagram for explaining another method of operating an HMD when wearing parts of the HMD are in contact, according to an embodiment of the present disclosure.

FIG. 16 is a diagram for explaining a method of operating an HMD when the HMD enters a charger according to an embodiment of the present disclosure.

FIG. 17 is a diagram for explaining a method of operating an HMD related to a wearing posture of the HMD according to an embodiment of the present disclosure.

FIG. 18 is a diagram for explaining another method of operating an HMD related to the wearing posture of the HMD according to an embodiment of the present disclosure.

FIG. 19 is a diagram for explaining another method of operating an HMD related to a wearing posture of the HMD according to an embodiment of the present disclosure.

In relation to the description of the drawings, identical or similar reference numerals may be used for identical or similar components.

Hereinafter, various embodiments of the present disclosure will be described with reference to the attached drawings. For convenience of explanation, the sizes of components shown in the drawings may be exaggerated or reduced, and the present disclosure is not necessarily limited to what is shown.

1 is a block diagram of an electronic device 101 in a network environment 100, according to various embodiments. Referring to FIG. 1, in the network environment 100, the electronic device 101 communicates with the electronic device 102 through a first network 198 (e.g., a short-range wireless communication network) or a second network 199. It is possible to communicate with at least one of the electronic device 104 or the server 108 through (e.g., a long-distance wireless communication network). According to one embodiment, the electronic device 101 may communicate with the electronic device 104 through the server 108. According to one embodiment, the electronic device 101 includes a processor 120, a memory 130, an input module 150, an audio output module 155, a display module 160, an audio module 170, and a sensor module ( 176), interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, subscriber identification module 196 , or may include an antenna module 197. In some embodiments, at least one of these components (eg, the connection terminal 178) may be omitted or one or more other components may be added to the electronic device 101. In some embodiments, some of these components (e.g., sensor module 176, camera module 180, or antenna module 197) are integrated into one component (e.g., display module 160). It can be.

The processor 120, for example, executes software (e.g., program 140) to operate at least one other component (e.g., hardware or software component) of the electronic device 101 connected to the processor 120. It can be controlled and various data processing or calculations can be performed. According to one embodiment, as at least part of data processing or computation, the processor 120 stores instructions or data received from another component (e.g., sensor module 176 or communication module 190) in volatile memory 132. The commands or data stored in the volatile memory 132 can be processed, and the resulting data can be stored in the non-volatile memory 134. According to one embodiment, the processor 120 includes the main processor 121 (e.g., a central processing unit or an application processor) or an auxiliary processor 123 that can operate independently or together (e.g., a graphics processing unit, a neural network processing unit ( It may include a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device 101 includes a main processor 121 and a secondary processor 123, the secondary processor 123 may be set to use lower power than the main processor 121 or be specialized for a designated function. You can. The auxiliary processor 123 may be implemented separately from the main processor 121 or as part of it.

The auxiliary processor 123 may, for example, act on behalf of the main processor 121 while the main processor 121 is in an inactive (e.g., sleep) state, or while the main processor 121 is in an active (e.g., application execution) state. ), together with the main processor 121, at least one of the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190) At least some of the functions or states related to can be controlled. According to one embodiment, co-processor 123 (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module 180 or communication module 190). there is. According to one embodiment, the auxiliary processor 123 (eg, neural network processing device) may include a hardware structure specialized for processing artificial intelligence models. Artificial intelligence models can be created through machine learning. For example, such learning may be performed in the electronic device 101 itself on which the artificial intelligence model is performed, or may be performed through a separate server (e.g., server 108). Learning algorithms may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but It is not limited. An artificial intelligence model may include multiple artificial neural network layers. Artificial neural networks include deep neural network (DNN), convolutional neural network (CNN), recurrent neural network (RNN), restricted boltzmann machine (RBM), belief deep network (DBN), bidirectional recurrent deep neural network (BRDNN), It may be one of deep Q-networks or a combination of two or more of the above, but is not limited to the examples described above. In addition to hardware structures, artificial intelligence models may additionally or alternatively include software structures.

The memory 130 may store various data used by at least one component (eg, the processor 120 or the sensor module 176) of the electronic device 101. Data may include, for example, input data or output data for software (e.g., program 140) and instructions related thereto. Memory 130 may include volatile memory 132 or non-volatile memory 134.

The program 140 may be stored as software in the memory 130 and may include, for example, an operating system 142, middleware 144, or application 146.

The input module 150 may receive commands or data to be used in a component of the electronic device 101 (e.g., the processor 120) from outside the electronic device 101 (e.g., a user). The input module 150 may include, for example, a microphone, mouse, keyboard, keys (eg, buttons), or digital pen (eg, stylus pen).

The sound output module 155 may output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. Speakers can be used for general purposes such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part of it.

The display module 160 can visually provide information to the outside of the electronic device 101 (eg, a user). The display module 160 may include, for example, a display, a hologram device, or a projector, and a control circuit for controlling the device. According to one embodiment, the display module 160 may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of force generated by the touch.

The audio module 170 can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module 170 acquires sound through the input module 150, the sound output module 155, or an external electronic device (e.g., directly or wirelessly connected to the electronic device 101). Sound may be output through the electronic device 102 (e.g., speaker or headphone).

The sensor module 176 detects the operating state (e.g., power or temperature) of the electronic device 101 or the external environmental state (e.g., user state) and generates an electrical signal or data value corresponding to the detected state. can do. According to one embodiment, the sensor module 176 includes, for example, a gesture sensor, a gyro sensor, an air pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, It may include a temperature sensor, humidity sensor, or light sensor.

The interface 177 may support one or more designated protocols that can be used to connect the electronic device 101 directly or wirelessly with an external electronic device (eg, the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

The connection terminal 178 may include a connector through which the electronic device 101 can be physically connected to an external electronic device (eg, the electronic device 102). According to one embodiment, the connection terminal 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (eg, a headphone connector).

The haptic module 179 can convert electrical signals into mechanical stimulation (e.g., vibration or movement) or electrical stimulation that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

The camera module 180 can capture still images and moving images. According to one embodiment, the camera module 180 may include one or more lenses, image sensors, image signal processors, or flashes.

The power management module 188 can manage power supplied to the electronic device 101. According to one embodiment, the power management module 188 may be implemented as at least a part of, for example, a power management integrated circuit (PMIC).

The battery 189 may supply power to at least one component of the electronic device 101. According to one embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

Communication module 190 is configured to provide a direct (e.g., wired) communication channel or wireless communication channel between electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108). It can support establishment and communication through established communication channels. Communication module 190 operates independently of processor 120 (e.g., an application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module 190 may be a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., : LAN (local area network) communication module, or power line communication module) may be included. Among these communication modules, the corresponding communication module is a first network 198 (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network 199 (e.g., legacy It may communicate with an external electronic device 104 through a telecommunication network such as a cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., LAN or WAN). These various types of communication modules may be integrated into one component (e.g., a single chip) or may be implemented as a plurality of separate components (e.g., multiple chips). The wireless communication module 192 uses subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module 196 to communicate within a communication network such as the first network 198 or the second network 199. The electronic device 101 can be confirmed or authenticated.

The wireless communication module 192 may support 5G networks after 4G networks and next-generation communication technologies, for example, NR access technology (new radio access technology). NR access technology provides high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and access to multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low latency). -latency communications)) can be supported. The wireless communication module 192 may support high frequency bands (eg, mmWave bands), for example, to achieve high data rates. The wireless communication module 192 uses various technologies to secure performance in high frequency bands, for example, beamforming, massive array multiple-input and multiple-output (MIMO), and full-dimensional multiplexing. It can support technologies such as input/output (FD-MIMO: full dimensional MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module 192 may support various requirements specified in the electronic device 101, an external electronic device (e.g., electronic device 104), or a network system (e.g., second network 199). According to one embodiment, the wireless communication module 192 supports Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mmTC, or U-plane latency (e.g., 164 dB or less) for realizing URLLC. Example: Downlink (DL) and uplink (UL) each of 0.5 ms or less, or round trip 1 ms or less) can be supported.

The antenna module 197 may transmit or receive signals or power to or from the outside (eg, an external electronic device). According to one embodiment, the antenna module 197 may include an antenna including a radiator made of a conductor or a conductive pattern formed on a substrate (eg, PCB). According to one embodiment, the antenna module 197 may include a plurality of antennas (eg, an array antenna). In this case, at least one antenna suitable for the communication method used in the communication network, such as the first network 198 or the second network 199, is connected to the plurality of antennas by, for example, the communication module 190. can be selected. Signals or power may be transmitted or received between the communication module 190 and an external electronic device through the at least one selected antenna. According to some embodiments, in addition to the radiator, other components (eg, radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module 197.

According to various embodiments, the antenna module 197 may form a mmWave antenna module. According to one embodiment, a mmWave antenna module includes a printed circuit board, an RFIC disposed on or adjacent to a first side (e.g., bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., mmWave band); And a plurality of antennas (e.g., array antennas) disposed on or adjacent to the second side (e.g., top or side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band. can do.

At least some of the components are connected to each other through a communication method between peripheral devices (e.g., bus, general purpose input and output (GPIO), serial peripheral interface (SPI), or mobile industry processor interface (MIPI)) and signal ( (e.g. commands or data) can be exchanged with each other.

According to one embodiment, commands or data may be transmitted or received between the electronic device 101 and the external electronic device 104 through the server 108 connected to the second network 199. Each of the external electronic devices 102 or 104 may be of the same or different type as the electronic device 101. According to one embodiment, all or part of the operations performed in the electronic device 101 may be executed in one or more of the external electronic devices 102, 104, or 108. For example, when the electronic device 101 needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device 101 may perform the function or service instead of executing the function or service on its own. Alternatively, or additionally, one or more external electronic devices may be requested to perform at least part of the function or service. One or more external electronic devices that have received the request may execute at least part of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may process the result as is or additionally and provide it as at least part of a response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology can be used. The electronic device 101 may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device 104 may include an Internet of Things (IoT) device. Server 108 may be an intelligent server using machine learning and/or neural networks. According to one embodiment, the external electronic device 104 or server 108 may be included in the second network 199. The electronic device 101 may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

In the following description, the shape, structure, and operation (or operating method) of a head-mounted display apparatus (hereinafter referred to as HMD) that is mounted on the user's head and displays images is mentioned, but the configuration is It may be the same or similar to the configuration of the electronic device 101 of FIG. 1 described above. In addition, the HMD may include an AR device that implements augmented reality and a VR device that implements virtual reality. Figures 2 and 3 describe the shape and structure of the AR device among the HMD, and Figures 4 and 5 In this section, the shape and structure of the VR device among HMD devices will be explained. However, the shape and structure of the HMD are not limited to those described in FIGS. 2 to 5, and may include a component for detecting the wearing state of the HMD, for example, a touch circuit disposed on the inner surface of the wearing portion of the HMD. The shape and structure of the remaining components may be modified.

FIG. 2 is a diagram for explaining the configuration of an AR device among HMDs according to an embodiment of the present disclosure, and FIG. 3 is a diagram for explaining a touch circuit disposed in an AR device among HMDs according to an embodiment of the present disclosure. .

2 and 3, the HMD 200 (e.g., the electronic device 101 of FIG. 1) may include a main frame 210, displays 211 and 212, and wearable units 221 and 222. there is.

The main frame 210 may be worn on at least part of the user's head (eg, face) and may be supported on the user's face by various components. The main frame 210 may include a first surface facing in a first direction and a second surface facing in a second direction opposite to the first direction. According to one embodiment, the main frame 210 may be made of a material light enough to allow the user to feel comfortable wearing it. As an example, the main frame 210 may be made of plastic material. In addition, the main frame 210 is made of at least one of various materials, such as glass, ceramic, metal (e.g., aluminum), or metal alloy (e.g., steel, stainless steel, titanium, or magnesium alloy) for strength or aesthetics. More may be included. 2 and 3 show the HMD 200 in the form of glasses, and the main frame 210 represents a structure including a rim, bar, and bridge of the glasses, These HMDs 200 may be referred to as AR glasses.

The displays 211 and 212 may be exposed through the second side of the main frame 210. According to one embodiment, the first display 211 of the displays 211 and 212 is disposed on the right edge of the main frame 210 to face the user's right eye, and the first display 211 of the displays 211 and 212 is disposed on the right edge of the main frame 210 to face the user's right eye. 2 The display 212 may be placed on the left edge of the main frame 210 to face the user's left eye. According to one embodiment, either the first display 211 or the second display 212 may be omitted.

The displays 211 and 212 may be, for example, a liquid crystal display (LCD), a digital mirror device (DMD), a liquid crystal on silicon (LCoS) device, or a liquid crystal display (LCoS). It may include a light emitting diode (LED) on silicon (LEDoS), an organic light emitting diode (OLED), or a micro LED (micro light emitting diode, micro LED). Although not shown, when the displays 211 and 212 are made of one of a liquid crystal display device, a digital mirror display device, or a silicon liquid crystal display device, the HMD 200 transmits light to the screen output area of the displays 211 and 212. It may include a light source for irradiation. In another embodiment, when the displays 211 and 212 are capable of generating light on their own, for example, when they are made of one of organic light emitting diodes or micro LEDs, the HMD 200 may emit light even if it does not include a separate light source. It is possible to provide good quality images to users. In one embodiment, if the displays 211 and 212 are implemented with organic light emitting diodes or micro LEDs, a light source is not required, so the HMD 200 can be lightweight.

Transparent members 213 and 214 may be disposed on the first surface of the main frame 210. The transparent members 213 and 214 may be formed of a glass plate, a plastic plate, or a polymer, and may be made transparent or translucent. According to one embodiment, the first transparent member 213 among the transparent members 213 and 214 is disposed on the right edge of the main frame 210, and the second transparent member among the transparent members 213 and 214 ( 214) may be placed on the left edge of the main frame 210. According to various embodiments, when the displays 211 and 212 are transparent, the transparent members 213 and 214 may be disposed at a position facing the user's eyes to form a screen display unit. According to one embodiment, either the first transparent member 213 or the second transparent member 214 may be omitted.

The displays 211 and 212 may include an optical waveguide 215. The optical waveguide 215 may serve to transmit the light source generated by the displays 211 and 212 to the user's eyes. The optical waveguide 215 may be made of glass, plastic, or polymer, and may include a nanopattern formed on some of the interior or exterior surfaces, for example, a polygonal or curved grating structure. According to one embodiment, light incident on one end of the waveguide may be propagated inside the optical waveguide 215 by a nano-pattern and provided to the user. Additionally, the optical waveguide 215, which is composed of a free-form prism, can provide incident light to the user through a reflection mirror. The optical waveguide 215 may include at least one of at least one diffractive element (eg, a diffractive optical element (DOE) or a holographic optical element (HOE)) or a reflective element (eg, a reflective mirror). The optical waveguide 215 may guide the display light emitted from the light source unit to the user's eyes using at least one diffractive element or reflective element included in the optical waveguide 215.

According to one embodiment, the diffractive element may include an input optical member 216 and an output optical member (not shown). For example, the input optical member 216 may refer to an input grating area, and the output optical member may refer to an output grating area. The input grating area serves as an input terminal that diffracts (or reflects) the light output from the displays 211 and 212 (e.g., Micro LED) to transmit the light to the transparent members 213 and 214 of the screen display unit. You can. The output grating area may serve as an outlet that diffracts (or reflects) light transmitted to the transparent members 213 and 214 of the optical waveguide 215 to the user's eyes.

According to one embodiment, the reflective element may include a total reflection optical element or a total reflection waveguide for total internal reflection (TIR). For example, total reflection is a method of guiding light, and an angle of incidence is created such that light (e.g., an image) input through the input grating area is 100% reflected from one side (e.g., a specific side) of the optical waveguide 215. , which may mean ensuring that 100% of the output is transmitted to the output grating area.

According to one embodiment, the light emitted from the displays 211 and 212 may be guided to an optical path through the input optical member 216 to the optical waveguide 215. Additionally, light moving inside the optical waveguide 215 may be guided toward the user's eyes through the output optical member. The screen display may be determined based on the light emitted in the eye direction.

The wearing parts 221 and 222 may be connected to a portion of the main frame 210 so that the user can wear the HMD 200. According to one embodiment, the first wearing part 221 of the wearing parts 221 and 222 is connected to an end of the right edge of the main frame 210 and extends in one direction (e.g., the second direction). , the second wearing part 222 of the wearing parts 221 and 222 may be connected to an end of the left edge of the main frame 210 and extend in one direction (eg, the second direction). According to one embodiment, the wearing parts 221 and 222 may be connected to the main frame 210 through hinges 223 and 224. 2 and 3 show the HMD 200 in the form of glasses, and the wearing parts 221 and 222 may represent temples of the glasses.

Each of the wearing parts 221 and 222 includes an inner surface 221b and 222b that contact a part of the head (e.g., temple) when the HMD 200 is worn on the user's head. It may include outer surfaces 221a and 222a facing 222b). According to one embodiment, touch circuits 291 and 292 may be disposed on the inner surfaces 221b and 222b of at least one of the wearable parts 221 and 222. According to one embodiment, the touch circuits 291 and 292 may include touch cells. For example, the touch circuits 291 and 292 may have a plurality of touch cells arranged adjacent to each other. According to one embodiment, the touch circuits 291 and 292 may include a touch processor that processes touch input. The touch processor may include a microprocessor.

The touch circuits 291 and 292 may be used to detect the wearing state of the HMD 200. For example, when the HMD 200 is worn on the user's head, the touch circuits 291 and 292 disposed on the inner surfaces 221b and 222b of the wearing parts 221 and 222 are attached to a portion of the head. It can be contacted, and touch information corresponding to the touch input according to the contact can be obtained. The touch information may include, for example, touch location (e.g., location of a touched touch cell among touch cells), touch area (e.g., total area of touched touch cells among touch cells), and touch type (e.g., touch among touch cells). It may include at least one of the arrangement type of the touch cells) or the number of touches (e.g., the number of touched touch cells among touch cells). The touch information may be referred to as a touch pattern expressed by at least one of touch location, touch area, touch type, or number of touches. For example, the touch information may be expressed as a different touch pattern when at least one of the touch position, touch area, touch type, or number of touches is different.

According to one embodiment, the touch circuits 291 and 292 may detect the wearing state of the HMD 200 using the acquired touch information. For example, if the pattern of the touch input detected through the touch circuits 291 and 292 has a designated pattern (e.g., a first pattern), the touch circuits 291 and 292 allow the HMD 200 to be placed on the user's head. It can be judged that it has been worn. The designated pattern may be, for example, the touch position is a first position, the touch area is a first size or more, the touch shape has a first shape, the number of touches is a first number or a combination thereof. It can indicate a state of being. According to one embodiment, the state in which the touch position is the first position is the wearing part (221, 222) among the plurality of touch cells disposed on the inner surfaces (221b, 222b) of the wearing part (221, 222). At least one touch cell disposed in the end direction (e.g., away from the main frame 210) may indicate a state in which it is in contact with the user's ear or a portion of the temple adjacent to the ear. According to one embodiment, the state in which the touch area is greater than or equal to the first size is when at least one touch cell is in contact among a plurality of touch cells disposed on the inner surfaces 221b and 222b of the wearing units 221 and 222. It may indicate a state where the total area is greater than or equal to the first size. According to one embodiment, the state in which the touch shape has the first shape is when at least one touch cell is contacted among a plurality of touch cells disposed on the inner surfaces 221b and 222b of the wearing units 221 and 222. The arrangement form may indicate a state corresponding to the first form. The first shape may be, for example, a square or oval with one long side. According to one embodiment, the state in which the number of touches is greater than the first number is when at least one touch cell touched among a plurality of touch cells disposed on the inner surfaces 221b and 222b of the wearing units 221 and 222. It may indicate a state where the number is greater than or equal to the first number. As another example, when the pattern of the touch input detected through the touch circuits 291 and 292 changes from the designated pattern (e.g., the first pattern) to another pattern (e.g., the second pattern), the touch circuits (291, 292, 292) may determine that the HMD 200 has been removed from the user's head.

According to one embodiment, the touch circuits 291 and 292 transmit the acquired touch information to a processor, and the processor can use the touch information to determine the wearing state of the HMD 200.

According to one embodiment, the HMD 200 may further include a lens (not shown). The lens may serve to adjust the focus so that the screen output to the displays 211 and 212 can be viewed by the user's eyes. The lens may be comprised of, for example, a Fresnel lens, a Pancake lens, or a multi-channel lens.

According to one embodiment, the HMD 200 may include at least one camera. The at least one camera may include at least one of a first camera unit 231 and 232, a second camera unit 233 and 234, or a third camera unit 235.

The first camera units 231 and 232 may be used for 3Dof (degrees of freedom) or 6Dof head tracking, hand detection and tracking, and space recognition. For example, the first camera units 231 and 232 may perform at least one of a spatial recognition function for 6Dof, a simultaneous localization and mapping (SLAM) function through depth shooting, or a user gesture recognition function. . The first camera units 231 and 232 may be disposed on the first side of the main frame 210. According to one embodiment, one camera 231 of the first camera units 231 and 232 is disposed on the right rim of the main frame 210, and the other camera 231 of the first camera units 231 and 232 The camera 232 may be placed on the left edge of the main frame 210. According to one embodiment, the first camera units 231 and 232 may include global shutter cameras.

The second camera units 233 and 234 may be used to detect and track the user's pupils. For example, the second camera units 233 and 234 may be used to ensure that the center of the image projected on the AR glasses is located according to the direction in which the wearer's eyes are looking. The second camera units 233 and 234 may be disposed on the second side of the main frame 210. According to one embodiment, one camera 233 of the second camera units 233 and 234 is disposed on the right rim of the main frame 210, and the other camera 233 of the second camera units 233 and 234 The camera 234 may be placed on the left edge of the main frame 210. According to one embodiment, the second camera units 233 and 234 may include global shutter cameras.

The third camera unit 235 may be used to photograph an external subject. The third camera unit 235 may be disposed on the first side of the commercial main frame 210. According to one embodiment, the third camera unit 235 may be placed on the bridge of the main frame 210. According to one embodiment, the third camera unit 235 is called a high resolution (HR) or photo video (PV) camera and may include a high resolution camera. According to one embodiment, the third camera unit 235 has at least one function for obtaining high-definition images, such as an auto focus (AF) function and/or an optical image stabilization (OIS) function. This may include a color camera. According to one embodiment, the third camera unit 235 may include a global shutter camera or a rolling shutter camera.

According to one embodiment, the at least one camera may further include a fourth camera unit (not shown). The fourth camera unit may be used to detect and track the user's facial expression. The fourth camera may be disposed on the second side of the main frame 210.

According to one embodiment, the HMD 200 may include light emitting units 241 and 242 (eg, LED). The light emitting units 241 and 242 may have different purposes depending on their placement location. As an example, when the light emitting units 241 and 242 are disposed around the main frame 210, the light emitting units 241 and 242 detect movement of the user's eyes with the second camera units 233 and 234. When tracking, it can be used as an auxiliary means to facilitate line-of-sight detection, and in this case, IR LEDs with infrared wavelengths can be mainly used. As another example, the light emitting units 241 and 242 are connected to cameras (e.g., the first camera unit 231) disposed around the hinges 223 and 224 connecting the main frame 210 and the wearing units 221 and 222. , 232)) or when disposed adjacent to a camera disposed around the bridge of the main frame 210 (e.g., the third camera unit 235), the light emitting units 241 and 242 are used to capture images of the camera. It can be used as a means of supplementing ambient brightness. For example, the light emitting units 241 and 242 may emit light when it is difficult to detect a subject in a dark environment.

According to one embodiment, the HMD 200 may include microphones 251, 252, and 253 and speakers 254 and 255. The microphones 251, 252, and 253 can convert sound into electrical signals and transmit the converted electrical signals to the processor. The speakers 254 and 255 can output voice signals. For example, the speakers 254 and 255 may convert electrical signals generated inside the HMD 200 into sound and output it to the outside. According to one embodiment, the microphones 251, 252, and 253 may be placed on the main frame 210 to be placed close to the user's mouth, and the speakers 254, 255 may be placed close to the user's ears. In order to be placed in a close position, it may be placed on the wearing parts 221 and 222.

According to one embodiment, the HMD 200 may include printed circuit boards 261 and 262. The printed circuit boards 261 and 262 may be placed inside the wearing portions 221 and 222, and various electronic components may be mounted thereon. Electronic components mounted on the printed circuit boards 261 and 262 may include, for example, at least one of a processor, memory, or communication circuit. According to one embodiment, the printed circuit boards 261 and 262 may include flexible printed circuit boards. In addition, the printed circuit boards 261 and 262 are connected to at least one component of the HMD 200 (e.g., displays 211 and 212 or cameras 231, 232, 233, 234, and 235) through a flexible printed circuit board. ) can transmit electrical signals. According to one embodiment, the printed circuit boards 261 and 262 may include a first substrate, a second substrate, and an interposer disposed between the first substrate and the second substrate.

The processor (eg, processor 120 in FIG. 1) can control at least one component of the HMD 200 and perform various data processing or calculations. According to one embodiment, the processor may perform a function related to detecting a wearing state of the HMD 200 by executing instructions stored in the memory included in the HMD 200.

The memory (eg, memory 130 of FIG. 1) may store various data used by at least one component of the HMD 200. According to one embodiment, the memory may store commands and data related to detection of the wearing state of the HMD 200. In this case, the instruction may be executed by the processor.

The communication circuit (e.g., communication module 190 of FIG. 1) may support communication between the HMD 200 and an external electronic device. For example, the communication circuit may establish wired or wireless communication with the external electronic device according to a specified communication protocol, and may transmit and receive signals or data.

According to one embodiment, the HMD 200 may include batteries 271 and 272. The batteries 271 and 272 may supply power to at least one component of the HMD 200. According to one embodiment, the batteries 271 and 272 may be disposed inside the ends of the wearing parts 221 and 222.

The configuration of the HMD 200 is not limited to this. According to various embodiments, the HMD 200 may omit at least one of the above-described components and may further include at least one other component. As an example, the HMD 200 may further include at least one of an antenna or a sensor.

FIG. 4 is a front perspective view of a VR device among HMDs according to an embodiment of the present disclosure, and FIG. 5 is a rear perspective view of a VR device among HMDs according to an embodiment of the present disclosure.

Referring to FIGS. 4 and 5 , the HMD 400 (e.g., the electronic device 101 of FIG. 1 ) may include a main frame 410, a display (not shown), and wearable units 421 and 422. .

The main frame 410 may be worn on at least part of the user's head (eg, face) and may be supported on the user's face by various components. The main frame 410 may include a first surface 410a facing in a first direction and a second surface 410b facing in a second direction opposite to the first direction. According to one embodiment, the main frame 410 may be made of a material light enough to allow the user to feel comfortable wearing it. As an example, the main frame 410 may be made of plastic material. In addition, the main frame 410 is made of at least one of various materials, such as glass, ceramic, metal (e.g., aluminum), or metal alloy (e.g., steel, stainless steel, titanium, or magnesium alloy) for strength or aesthetics. More may be included. 4 and 5 show a VR device among the HMD 400, and a transparent member may not be disposed on the first surface 410a of the main frame 410. In some embodiments, the main frame 410 ) An external electronic device (eg, a smartphone) may be fastened to the first surface 410a. According to one embodiment, the HMD 400 may further include a cover coupled to more firmly support the external electronic device to the main frame 410 while the external electronic device is fastened to the main frame 410. You can. The cover may be physically coupled to the main frame 410 in the form of a hook, or may be coupled to the main frame 410 in a manner such as a magnet or electromagnet. For example, the cover can prevent the external electronic device from being separated from the main frame 410, and can also enhance the aesthetics by forming the appearance of the main frame 410.

The display is placed inside the main frame 410 and can be viewed through a lens 411. In one embodiment, the display may be exposed through the second side 410b of the main frame 410. The display may include, for example, a liquid crystal display device, a digital mirror display device, a silicon liquid crystal display device, an organic light emitting diode, or a micro LED. Although not shown, when the display is made of one of a liquid crystal display device, a digital mirror display device, or a silicon liquid crystal display device, the HMD 400 may include a light source that radiates light to the screen output area of the display. In one embodiment, when the display is capable of generating light on its own, for example, when it is made of one of organic light emitting diodes or micro LEDs, the HMD 400 provides good quality to the user even if it does not include a separate light source. Video can be provided. In one embodiment, if the display is implemented with organic light emitting diodes or micro LEDs, a light source is not required, so the HMD 400 can be lightweight.

The wearing parts 421 and 422 may be connected to a portion of the main frame 410 so that the user can wear the HMD 400. According to one embodiment, the first wearing part 421 of the wearing parts 421 and 422 is connected to the right end of the main frame 410 and extends in one direction (e.g., the second direction), Among the wearing parts 421 and 422, the second wearing part 422 may be connected to the left end of the main frame 410 and extend in one direction (eg, the second direction). According to one embodiment, the wearing parts 421 and 422 may be connected to the main frame 410 through a hinge. 4 and 5 show the wearing parts 421 and 422 in the form of glasses legs, but the present invention is not limited thereto. According to various embodiments, the wearing parts 421 and 422 may be provided in the form of a band and may be fastened to the user's head in a manner that surrounds a portion of the user's head. As an example, the wearing parts 421 and 422 may be provided in the form of a single band and may be fixed to the user's head so as to cross the temporal region, including the temples. In this case, the wearing parts (421, 422) may be made of a material with elasticity of a specified size or more, and include a length adjustment part that can adjust the length of the wearing parts (421, 422) to fit the circumference of the user's head. can do. For example, the length of the wearing parts 421 and 422 can be adjusted through the length adjusting part, so that the main frame 410 can fit tightly around the eyes of the user's face. According to one embodiment, the length adjusting part may include gears, Velcro, or magnets. However, in the following description, for convenience of explanation, a case where the wearing parts 421 and 422 are provided in the shape of temples of glasses will be described.

Each of the wearing parts 421 and 422 includes an inner surface 421b and 422b that contact a part of the head (e.g., temple) when the HMD 400 is worn on the user's head. It may include outer surfaces 421a and 422a facing 422b). According to one embodiment, touch circuits 491 and 492 may be disposed on the inner surfaces 421b and 422b of at least one of the wearable parts 421 and 422. According to one embodiment, the touch circuits 491 and 492 may include touch cells. For example, the touch circuits 491 and 492 may have a plurality of touch cells arranged adjacent to each other. According to one embodiment, the touch circuits 491 and 492 may include a touch processor that processes touch input. The touch processor may include a microprocessor.

The touch circuits 491 and 492 may be used to detect the wearing state of the HMD 400. For example, when the HMD 400 is worn on the user's head, the touch circuits 491 and 492 disposed on the inner surfaces 421b and 422b of the wearing parts 421 and 422 are attached to a portion of the head. It can be contacted, and touch information corresponding to the touch input according to the contact can be obtained. The touch information may include, for example, touch location (e.g., location of a touched touch cell among touch cells), touch area (e.g., total area of touched touch cells among touch cells), and touch type (e.g., touch among touch cells). It may include at least one of the arrangement type of the touch cells) or the number of touches (e.g., the number of touched touch cells among touch cells). The touch information may be referred to as a touch pattern expressed by at least one of touch location, touch area, touch type, or number of touches. For example, the touch information may be expressed as a different touch pattern when at least one of the touch position, touch area, touch type, or number of touches is different.

According to one embodiment, the touch circuits 491 and 492 may detect the wearing state of the HMD 400 using the acquired touch information. For example, if the pattern of the touch input detected through the touch circuits 491 and 492 has a designated pattern (e.g., the first pattern), the touch circuits 491 and 492 allow the HMD 400 to be placed on the user's head. It can be judged that it has been worn. The designated pattern may be, for example, the touch position is a first position, the touch area is a first size or more, the touch shape has a first shape, the number of touches is a first number or a combination thereof. It can indicate a state of being. According to one embodiment, the state in which the touch position is the first position is the wearing part (421, 422) among the plurality of touch cells disposed on the inner surfaces (421b, 422b) of the wearing part (421, 422). At least one touch cell disposed in the end direction (e.g., away from the main frame 410) may indicate a state in which it is in contact with the user's ear or a temple portion adjacent to the ear. According to one embodiment, the state in which the touch area is greater than or equal to the first size is when at least one touch cell contacted among a plurality of touch cells disposed on the inner surfaces 421b and 422b of the wearing units 421 and 422 It may indicate a state where the total area is greater than or equal to the first size. According to one embodiment, the state in which the touch shape has the first shape is when at least one touch cell is contacted among a plurality of touch cells disposed on the inner surfaces 421b and 422b of the wearing parts 421 and 422. The arrangement form may indicate a state corresponding to the first form. The first shape may be, for example, a square or oval with one long side. According to one embodiment, the state in which the number of touches is greater than or equal to the first number is when at least one touch cell touched among a plurality of touch cells disposed on the inner surfaces 421b and 422b of the wearing units 421 and 422. It may indicate a state where the number is greater than or equal to the first number. As another example, when the pattern of the touch input detected through the touch circuits 491 and 492 changes from the designated pattern (e.g., the first pattern) to another pattern (e.g., the second pattern), the touch circuits (491, 492, 492) may determine that the HMD 400 has been removed from the user's head.

According to one embodiment, the touch circuits 491 and 492 transmit the acquired touch information to a processor, and the processor can use the touch information to determine the wearing state of the HMD 400.

According to one embodiment, the HMD 400 may include a lens 411. The lens 411 may serve to adjust the focus so that the screen displayed on the display can be viewed by the user's eyes. For example, a lens assembly including at least one lens may be inserted inside the main frame 410 at a position facing the user's two eyes. In addition, when the user wears the HMD 400, at least one surface of the lens 411 is provided through the second surface 410b of the main frame 410 so that the user can view the screen of the display with the user's eyes. This may be exposed. The lens 411 may be composed of, for example, a Fresnel lens, a Pencake lens, or a multi-channel lens.

According to one embodiment, the HMD 400 may include at least one camera. The at least one camera may include at least one of a first camera unit 431, a third camera unit 432, or a fourth camera unit 433.

The first camera unit 431 can be used for 3Dof or 6Dof head tracking, hand detection and tracking, and spatial recognition. For example, the first camera unit 431 may perform at least one of a spatial recognition function for 6Dof, a SLAM function through depth shooting, or a user gesture recognition function. The first camera unit 431 may be disposed on the first surface 410a of the main frame 410. According to one embodiment, the first camera unit 431 may include a global shutter camera.

The third camera unit 432 may be used to photograph an external subject. The third camera unit 432 may be disposed on the first side 410a of the commercial main frame 410. According to one embodiment, the third camera unit 432 is called HR or PV and may include a high-resolution camera. According to one embodiment, the third camera unit 432 may include a color camera equipped with at least one function for acquiring high-definition images, such as an autofocus function and/or a shake correction function. According to one embodiment, the third camera unit 432 may include a global shutter camera or a rolling shutter camera.

The fourth camera unit 433 may be used to detect and track the user's facial expression. The fourth camera 433 may be disposed on the second side 410b of the main frame 410.

According to one embodiment, the HMD 400 may include a depth sensor 440. The depth sensor 440 can be used to measure the distance to an object. For example, the depth sensor 440 may include a light emitting unit and a light receiving unit, and may be used to determine the distance to an object through a method of measuring time of flight (TOF).

Although not shown, the HMD 400 may further include a light emitting unit, microphone, speaker, printed circuit board, and battery. According to one embodiment, the light emitting unit may be disposed adjacent to the at least one camera. According to one embodiment, the microphone may be placed on the main frame 410 to be placed close to the user's mouth, and the speaker may be placed on the wearing unit 421 to be placed close to the user's ears. , 422). According to one embodiment, the printed circuit board may be placed inside the main frame 410, and various electronic components may be mounted. Electronic components mounted on the printed circuit board may include, for example, at least one of a processor, memory, or communication circuit. According to one embodiment, the battery may be placed inside the main frame 410.

The processor (eg, processor 120 of FIG. 1) can control at least one component of the HMD 400 and perform various data processing or calculations. According to one embodiment, the processor may perform a function related to detecting a wearing state of the HMD 400 by executing instructions stored in the memory included in the HMD 400.

The memory (eg, memory 130 of FIG. 1) may store various data used by at least one component of the HMD 400. According to one embodiment, the memory may store commands and data related to detection of the wearing state of the HMD 400. In this case, the instruction may be executed by the processor.

The communication circuit (e.g., communication module 190 of FIG. 1) may support communication between the HMD 400 and an external electronic device. For example, the communication circuit may establish wired or wireless communication with the external electronic device according to a specified communication protocol, and may transmit and receive signals or data.

The configuration of the HMD 400 is not limited to this. According to various embodiments, the HMD 400 may omit at least one of the above-described components and may further include at least one other component. As an example, the HMD 400 may further include at least one of an antenna or a sensor.

FIG. 6 is a diagram illustrating a touch circuit disposed on a wearable portion of an HMD according to an embodiment of the present disclosure.

Referring to Figure 6, an HMD (e.g., HMD 200 in Figures 2 and 3 or HMD 400 in Figures 4 and 5) includes a wearing unit 600 (e.g., HMD 400 in Figures 4 and 5) so that a user can wear the HMD. It may include the wearing parts 221 and 222 of FIGS. 2 and 3 or the wearing parts 421 and 422 of FIGS. 4 and 5. The wearable unit 600 may be connected to a portion of the main frame of the HMD (eg, the main frame 210 in FIGS. 2 and 3 or the main frame 410 in FIGS. 4 and 5).

The wearing portion 600 includes an outer surface 601 (e.g., the outer surface of an eyeglass temple), an inner surface 603 opposing the outer surface 601 (e.g., an inner surface of a temple), and the outer surface. It may include an upper surface 602 (eg, the upper surface of a temple) extending from 601 to the inner surface 603. Here, when the HMD is worn on the user's head, the inner surface 603, which is the surface in contact with a part of the head (e.g., temple), is the inner surface 221b and 222b of FIGS. 2 and 3 or the inner surface 221b and 222b of FIGS. 4 and 3. It may correspond to the inner surfaces 421b and 422b of 5, and the outer surface 601 opposite to the inner surface 603 is the outer surface 221a and 222a of FIGS. 2 and 3 or the outer surfaces 221a and 222a of FIGS. 4 and 5. It may correspond to the outer surfaces 421a and 422a.

A first touch circuit 613 (e.g., the touch circuits 291 and 292 in FIG. 3 or the touch circuits 491 and 492 in FIGS. 4 and 5) is disposed on the inner surface 603 of the wearing unit 600. It can be. The first touch circuit 613 can be used to detect the wearing state of the HMD. For example, when the HMD is worn on the user's head, the first touch circuit 613 disposed on the inner surface 603 of the wearing unit 600 may contact a portion of the head, and the contact Touch information according to can be acquired, and the wearing state of the HMD can be detected using the obtained touch information. According to one embodiment, the first touch circuit 613 may include a touch cell. For example, the first touch circuit 613 may have a plurality of touch cells arranged adjacent to each other.

According to one embodiment, a second touch circuit 611 may be disposed on the outer surface 601 of the wearing unit 600. The second touch circuit 611 may receive a user's input. As an example, the second touch circuit 611 may receive a user input for controlling the HMD. For example, the user input may correspond to signals related to settings (e.g., sound settings or communication settings) and controls (e.g., sound control or video playback control) related to functions supported by the HMD. According to one embodiment, the second touch circuit 611 may include a touch cell. For example, the second touch circuit 611 may have a plurality of touch cells arranged adjacent to each other.

According to one embodiment, the first touch circuit 613 and the second touch circuit 611 may be formed integrally. For example, one touch circuit 611, 612, and 613 may be disposed from the outer surface 601 to the inner surface 603 of the wearable unit 600. In this case, the touch circuits 611, 612, and 613 are connected to the first part 631 disposed on the outer surface 601 of the wearing part 600, from a part of the first part 631 to the wearing part ( A second part 632 extending in the direction of the inner surface 603 of the 600, and a third part 633 connected to the second part 632 and disposed on the inner surface 603 of the wearing part 600. ) may include. Additionally, the third portion 633 of the touch circuits 611, 612, and 613 may be disposed over a smaller area than the first portion 631 of the touch circuits 611, 612, and 613. For example, the third portion 633 of the touch circuits 611, 612, and 613 is limited to the surface that contacts a part of the head (e.g., temple) when the HMD is worn on the user's head. can be placed.

As described above, according to various embodiments, a head mounted display device (e.g., HMD 200 of FIGS. 2 and 3 or HMD 400 of FIGS. 4 and 5) has a first surface facing in a first direction. and a frame including a second surface facing in a second direction opposite to the first direction (e.g., the main frame 210 in FIGS. 2 and 3 or the main frame 410 in FIGS. 4 and 5), A display exposed to the outside through the second side (e.g., the displays 211 and 212 in FIGS. 2 and 3 or the displays in FIGS. 4 and 5), respectively connected to both ends of the frame and extending in one direction. Parts (e.g., the wearing parts 221 and 222 of FIGS. 2 and 3, the wearing parts 421 and 422 of FIGS. 4 and 5, or the wearing parts 600 of FIG. 6), and the frame or one of the wearing parts It includes at least one processor disposed on the inside, and each of the wearing units has an inner surface (e.g., in FIGS. 2 and 3) that is in contact with a portion of the head when the head mounted display device is worn on the user's head. Inner surfaces 221b and 222b, inner surfaces 421b and 422b in FIGS. 4 and 5 or inner surfaces 603 in FIG. 6) and outer surfaces opposing the inner surfaces (e.g., outer surfaces in FIGS. 2 and 3) It includes side surfaces 221a and 222a, outer surfaces 421a and 422a in FIGS. 4 and 5, or outer surfaces 601 in FIG. 6, and at least one of the wearing parts is disposed on the inner surface. A first touch circuit (e.g., the touch circuits 291 and 292 of FIG. 3, the touch circuits 491 and 492 of FIGS. 4 and 5, or the first touch circuit of FIG. 6 (or a third portion of the touch circuit formed integrally) )(613)) may be included.

According to various embodiments, the head mounted display device is provided in the form of glasses, and the wearing parts may form legs of the glasses.

According to various embodiments, the wearing parts may be integrally provided in the form of a band and tightened to surround a portion of the head.

According to various embodiments, the first touch circuit may have a plurality of touch cells arranged adjacent to each other.

According to various embodiments, the first touch circuit may be arranged to extend from the inner surface to the outer surface.

According to various embodiments, at least one of the wearing parts includes a second touch circuit (e.g., the second touch circuit of FIG. 6 (or the first part of the touch circuit formed integrally) 611 disposed on the outer surface. ) or the touch circuit 1221 of FIG. 12).

According to various embodiments, the wearing parts include a first wearing part connected to one end of the frame and a second wearing part connected to the other end of the frame, and the first touch circuit is connected to the first wearing part of the first wearing part. It may be disposed on the inner surface, and the second touch circuit may be disposed on the outer surface of the second wearing part.

According to various embodiments, at least one of the wearing parts may include a conductor (eg, the conductor 1321 in FIG. 13) disposed on the outer surface.

According to various embodiments, the wearing parts include a first wearing part connected to one end of the frame and a second wearing part connected to the other end of the frame, and the first touch circuit is connected to the first wearing part of the first wearing part. It may be disposed on the inner surface, and the conductor may be disposed on the outer surface of the second wearing part.

FIG. 7 is a diagram for explaining a method of operating an HMD when worn, according to an embodiment of the present disclosure.

Referring to FIG. 7 , in operation 710, the HMD (eg, HMD 200 in FIGS. 2 and 3 or HMD 400 in FIGS. 4 and 5) may determine whether the first touch input has been detected. The HMD has a wearable part (e.g., FIG. 2 and It may include the wearing parts 221 and 222 of FIG. 3, the wearing parts 421 and 422 of FIGS. 4 and 5, or the wearing part 600 of FIG. 6. Additionally, the HMD can detect the user's finger touching the wearing unit. Here, when the user's finger touches the wearing part, the HMD can detect the first touch input. A situation in which the user's finger touches the wearing part may include, for example, a situation in which the user pinches the wearing part with a finger to wear the HMD.

According to one embodiment, the HMD uses a touch circuit (e.g., the second touch circuit 611 of FIG. 6 (or the first part 631 of the touch circuit formed integrally)) disposed on the outer surface of the wearable unit. The first touch input can be detected. For example, when a user picks up an HMD using a finger, the user's finger may first contact the outer surface of the wearing portion of the HMD, and the first touch input may be performed through a touch circuit disposed on the outer surface of the wearing portion. can be detected. According to one embodiment, the touch circuit may include a touch processor that processes the first touch input. The touch processor may include a microprocessor.

If it is determined that the first touch input is not detected (operation 710 - No), the HMD may re-perform operation 710. For example, the HMD may monitor detection of the first touch input continuously or at regular intervals until the first touch input is detected.

If it is determined that the first touch input is detected (operation 710 - Yes), the HMD may perform preprocessing in operation 720. According to one embodiment, the HMD may increase the activation level of the processor. As an example, the HMD can control the processor to operate from a low-power mode to a normal mode. As another example, the HMD can increase the driving frequency of the processor. The processor may include, for example, an application processor. According to one embodiment, the HMD may pre-load execution data of a designated application into memory to prevent additional delays such as memory load.

In operation 730, the HMD may determine whether a second touch input has been detected. The HMD includes a touch circuit disposed on the inner surface of the wearable unit (e.g., the touch circuits 291 and 292 in FIG. 3, the touch circuits 491 and 492 in FIGS. 4 and 5, or the first touch circuit 613 in FIG. 6). (or the third part 633 of the touch circuit formed integrally)) can be used to detect the second touch input. For example, when the HMD is worn on the user's head, the touch circuit disposed on the inner surface of the wearing unit may be in contact with a portion of the head and may detect the second touch input according to the contact. Additionally, the HMD may acquire touch information corresponding to the second touch input and detect the wearing state of the HMD using the acquired touch information.

If it is determined that the second touch input is not detected (operation 730 - No), the HMD may re-perform operation 710.

If it is determined that the second touch input is detected (operation 730 - Yes), the HMD may activate the display and display information through the activated display in operation 740. For example, when the second touch input is detected, the HMD may determine that the HMD is worn on the user's head, and in order to perform an operation according to wearing the HMD, turn on the screen of the display and display the Information according to operation can be displayed.

According to one embodiment, if the HMD determines that the second touch input is not maintained, it may deactivate the display and lower the activation level of the processor. For example, the HMD can turn off the screen of the display. Additionally, the processor can be controlled to operate from a normal mode to a low-power mode. Alternatively, the HMD may lower the driving frequency of the processor.

FIG. 8 is a diagram for explaining another method of operating an HMD when worn, according to an embodiment of the present disclosure.

Referring to FIG. 8 , in operation 810, the HMD (eg, HMD 200 in FIGS. 2 and 3 or HMD 400 in FIGS. 4 and 5) may determine whether a first touch input has been detected. The HMD has a wearable part (e.g., FIG. 2 and It may include the wearing parts 221 and 222 of FIG. 3, the wearing parts 421 and 422 of FIGS. 4 and 5, or the wearing part 600 of FIG. 6. Additionally, the HMD can detect the user's finger touching the wearing unit. Here, when the user's finger touches the wearing part, the HMD can detect the first touch input. A situation in which the user's finger touches the wearing part may include, for example, a situation in which the user pinches the wearing part with a finger to wear the HMD.

According to one embodiment, the HMD uses a touch circuit (e.g., the second touch circuit 611 of FIG. 6 (or the first part 631 of the touch circuit formed integrally)) disposed on the outer surface of the wearable unit. The first touch input can be detected. For example, when a user picks up an HMD using a finger, the user's finger may first contact the outer surface of the wearing portion of the HMD, and the first touch input may be performed through a touch circuit disposed on the outer surface of the wearing portion. can be detected. According to one embodiment, the touch circuit may include a touch processor that processes the first touch input. The touch processor may include a microprocessor.

If it is determined that the first touch input is not detected (operation 810 - No), the HMD may re-perform operation 810. For example, the HMD may monitor detection of the first touch input continuously or at regular intervals until the first touch input is detected.

If it is determined that the first touch input is detected (operation 810 - Yes), the HMD may perform preprocessing and activate the display in operation 820. According to one embodiment, the HMD may increase the activation level of the processor. As an example, the HMD can control the processor to operate from a low-power mode to a normal mode. As another example, the HMD can increase the driving frequency of the processor. The processor may include, for example, an application processor. According to one embodiment, the HMD may preload execution data of a designated application into memory to prevent additional delays such as memory loading. Additionally, the HMD can turn on the screen of the display.

In operation 830, the HMD may determine whether a second touch input has been detected. The HMD includes a touch circuit disposed on the inner surface of the wearable unit (e.g., the touch circuits 291 and 292 in FIG. 3, the touch circuits 491 and 492 in FIGS. 4 and 5, or the first touch circuit 613 in FIG. 6). (or the third part 633 of the touch circuit formed integrally)) can be used to detect the second touch input. For example, when the HMD is worn on the user's head, the touch circuit disposed on the inner surface of the wearing unit may be in contact with a portion of the head and may detect the second touch input according to the contact. Additionally, the HMD may acquire touch information corresponding to the second touch input and detect the wearing state of the HMD using the acquired touch information.

If it is determined that the second touch input is not detected (operation 830 - No), the HMD may re-perform operation 810.

If it is determined that the second touch input is detected (operation 830 - Yes), the HMD may display information through the activated display in operation 840. For example, when the second touch input is detected, the HMD may determine that the HMD is worn on the user's head, and in order to perform an operation according to wearing the HMD, information according to the operation may be displayed on the screen of the display. It can be displayed.

According to one embodiment, if the HMD determines that the second touch input is not maintained, it may deactivate the display and lower the activation level of the processor. For example, the HMD can turn off the screen of the display. Additionally, the processor can be controlled to operate from a normal mode to a low-power mode. Alternatively, the HMD may lower the driving frequency of the processor.

According to one embodiment, the HMD may deactivate the display if the second touch input is not detected within a specified time (eg, 10 seconds) after the first touch input is detected. For example, the HMD can turn off the screen of the display.

FIG. 9 is a diagram for explaining a method of operating an HMD when removing the HMD according to an embodiment of the present disclosure.

Referring to Figure 9, an HMD (e.g., HMD 200 in Figures 2 and 3 or HMD 400 in Figures 4 and 5) has a main frame (e.g., HMD 200 in Figures 2 and 3) so that the user can wear it. A wearing part (e.g., the wearing parts 221 and 222 of FIGS. 2 and 3, the wearing parts of FIGS. 4 and 5) connected to a portion of the main frame 210 or the main frame 410 of FIGS. 4 and 5. It may include (421, 422) or the wearing part 600 of FIG. 6. In addition, the HMD includes a touch circuit (e.g., the touch circuits 291 and 292 in FIG. 3, the touch circuits 491 and 492 in FIGS. 4 and 5, or the first touch circuit in FIG. 6) disposed on the inner surface of the wearable unit. The wearing state of the HMD can be detected using 613) (or the third part 633 of the integrated touch circuit). For example, when the HMD is worn on the user's head, the touch circuit disposed on the inner surface of the wearing unit may contact a portion of the head and detect a touch input according to the contact. Additionally, the HMD may acquire touch information corresponding to the touch input and detect the wearing state of the HMD using the acquired touch information. The touch information may include, for example, touch location (e.g., location of a touched touch cell among touch cells), touch area (e.g., total area of touched touch cells among touch cells), and touch type (e.g., touch among touch cells). It may include at least one of the arrangement type of the touch cells) or the number of touches (e.g., the number of touched touch cells among touch cells). The touch information may be referred to as a touch pattern expressed by at least one of touch location, touch area, touch type, or number of touches. For example, the touch information may be expressed as a different touch pattern when at least one of the touch position, touch area, touch type, or number of touches is different.

If the pattern of the touch input detected through the touch circuit disposed on the inner surface of the wearing unit has a first pattern, the HMD may determine that the HMD is worn on the user's head. The first pattern may be, for example, the touch position is a first position, the touch area is a first size or more, the touch shape has a first shape, the number of touches is a first number or more, or It can represent a combination state. According to one embodiment, when the touch position is the first position, at least one touch cell arranged in the end direction of the wearable part among the plurality of touch cells arranged on the inner surface of the wearable part is connected to the user's ear or the ear. It may indicate contact with the adjacent temple area. According to one embodiment, the state in which the touch area is greater than or equal to the first size indicates a state in which the total area of at least one touch cell contacted among the plurality of touch cells disposed on the inner surface of the wearing unit is greater than or equal to the first size. You can. According to one embodiment, the state in which the touch shape has the first shape is when the arrangement shape of at least one touched touch cell among the plurality of touch cells disposed on the inner surface of the wearing unit corresponds to the first shape. It can indicate status. The first shape may be, for example, a square or oval with one long side. According to one embodiment, the state in which the number of touches is greater than or equal to the first number may indicate a state in which the number of at least one touched touch cell among a plurality of touch cells disposed on the inner surface of the wearing unit is greater than or equal to the first number. there is.

When the HMD is worn on the user's head (i.e., the pattern of the touch input has the first pattern), the HMD changes the pattern of the touch input from the first pattern to the second pattern in operation 910. You can determine whether it has been done. The second pattern may be, for example, the touch position is a second position different from the first position, the touch area is less than the first size, or the touch shape has a second shape different from the first shape. Alternatively, it may indicate a state in which the number of touches is less than the first number, or a combination thereof.

If it is determined that the pattern of the touch input has not changed from the first pattern to the second pattern (operation 910 - No), the HMD may re-perform operation 910. For example, the HMD may monitor changes in the pattern of the touch input continuously or at regular intervals until the pattern of the touch input changes.

If it is determined that the pattern of the touch input has changed from the first pattern to the second pattern (operation 910 - Yes), the HMD may maintain activation of the system of the HMD and deactivate the display in operation 920. For example, the HMD can maintain the processor's activation level and data loaded into memory. Additionally, the HMD can turn off the screen of the display.

In operation 930, the HMD may determine whether the touch input has ended. For example, the HMD can check whether the touch input is not detected through the touch circuit disposed on the inner surface of the wearable unit.

If it is determined that the touch input has ended (operation 930 - Yes), the HMD may enter the HMD's system into a rest period in operation 940. For example, if the touch input is not detected through the touch circuit disposed on the inner surface of the wearable unit, the HMD may determine that the HMD has been removed from the user's head. Accordingly, the HMD can control the processor to operate from a normal mode to a low-power mode, thereby lowering the activation level of the processor.

If it is determined that the touch input has not ended (operation 930 - No), the HMD may determine whether the pattern of the touch input has changed from the second pattern to the first pattern in operation 950. For example, the HMD may determine whether a touch input detected through the touch circuit disposed on the inner surface of the wearable unit has the first pattern again.

If it is determined that the pattern of the touch input has not changed from the second pattern to the first pattern (operation 950 - No), the HMD may re-perform operation 920. For example, the HMD may keep the HMD's system activated and the display deactivated.

If it is determined that the pattern of the touch input has changed from the second pattern to the first pattern (operation 950 - Yes), the HMD may activate the display in operation 960. For example, if the touch input detected through the touch circuit disposed on the inner surface of the wearing unit again has the first pattern, the HMD may determine that the HMD has been reworn on the user's head. Accordingly, the HMD can turn on the screen of the display again.

FIG. 10 is a diagram for explaining a method of operating an HMD when the wearing parts of the HMD are separated according to an embodiment of the present disclosure.

Referring to Figure 10, an HMD (e.g., HMD 200 in Figures 2 and 3 or HMD 400 in Figures 4 and 5) has a main frame (e.g., HMD 200 in Figures 2 and 3) so that the user can wear it. A wearing part (e.g., the wearing parts 221 and 222 of FIGS. 2 and 3, the wearing parts of FIGS. 4 and 5) connected to a portion of the main frame 210 or the main frame 410 of FIGS. 4 and 5. It may include (421, 422) or the wearing part 600 of FIG. 6. At least one of the wearable parts includes a touch circuit disposed on the inner side (e.g., the touch circuits 291 and 292 in FIG. 3, the touch circuits 491 and 492 in FIGS. 4 and 5, or the first touch circuit in FIG. 6 ( The wearing state of the HMD can be detected using 613) (or the third part 633 of the integrated touch circuit). In addition, at least one of the wearable parts may have a touch circuit (e.g., the second touch circuit 611 of FIG. 6 (or the first part 631 of the integrated touch circuit 631)) or a conductor disposed on the outer surface. .

In operation 1010, the HMD may determine whether separation of the wearing parts has been detected. For example, a situation in which the wearing parts are separated may indicate a situation in which the wearing parts are spaced apart from each other, and when the wearing parts are provided in the form of legs of glasses, it may represent a situation in which the legs of the glasses are spread out. According to one embodiment, the HMD detects a first touch input through a touch circuit disposed on the inner surface of one of the wearable parts, and a touch circuit disposed on the outer surface of another one of the wearable parts. If the pattern of the first touch input and the second touch input is changed or terminated while the second touch input is detected, it may be determined that the wearable parts are separated. According to one embodiment, the HMD has a first pattern of touch input detected through a touch circuit disposed on the inner surface of one of the wearable parts, and the pattern of the touch input is the first pattern. When the pattern is changed to the second pattern or the touch input is terminated, it may be determined that the wearing parts are separated. A situation in which the pattern of the touch input has the first pattern is, for example, a touch circuit disposed on the inner surface of one of the wearable parts and a conductor disposed on the outer surface of the other one of the wearable parts. It can indicate a situation where a person is close to or in contact with a body. In addition, a situation in which the pattern of the touch input has the second pattern is, for example, a touch circuit disposed on the inner surface of one of the wearable parts is disposed on the outer surface of the other one of the wearable parts. It can represent a situation where the conductor is separated by a certain distance or more.

If it is determined that separation of the wearing parts has not been detected (operation 1010 - No), the HMD may re-perform operation 1010. For example, the HMD may monitor the separation of the wearing parts continuously or at regular intervals until the separation of the wearing parts is detected.

If it is determined that the separation of the wearing parts is detected (operation 1010 - Yes), the HMD may perform preprocessing in operation 1020. According to one embodiment, the HMD may increase the activation level of the processor. As an example, the HMD can control the processor to operate from a low-power mode to a normal mode. As another example, the HMD can increase the driving frequency of the processor. The processor may include, for example, an application processor. According to one embodiment, the HMD may pre-load execution data of a designated application into memory to prevent additional delays such as memory loading.

In operation 1030, the HMD may determine whether a touch input has been detected. The HMD can detect the touch input using a touch circuit disposed on the inner surface of at least one of the wearable parts. For example, when an HMD is worn on a user's head, a touch circuit disposed on the inner surface of at least one of the wearing units may be in contact with a portion of the head and may detect the touch input according to the contact. there is. Additionally, the HMD may acquire touch information corresponding to the touch input and detect the wearing state of the HMD using the acquired touch information.

If it is determined that the touch input is not detected (operation 1030 - No), the HMD may re-perform operation 1010.

If it is determined that the touch input is detected (operation 1030 - Yes), the HMD may activate the display in operation 1040 and display information through the activated display. For example, when the touch input is detected, the HMD may determine that the HMD is worn on the user's head, turn on the screen of the display to perform an operation according to wearing the HMD, and display the operation on the screen. Information can be displayed.

According to one embodiment, if the HMD determines that the touch input is not maintained, it may deactivate the display and lower the activation level of the processor. For example, the HMD can turn off the screen of the display. Additionally, the processor can be controlled to operate from a normal mode to a low-power mode. Alternatively, the HMD may lower the driving frequency of the processor.

FIG. 11 is a diagram for explaining another method of operating the HMD when the wearing parts of the HMD are separated according to an embodiment of the present disclosure.

Referring to Figure 11, an HMD (e.g., HMD 200 in Figures 2 and 3 or HMD 400 in Figures 4 and 5) has a main frame (e.g., HMD 200 in Figures 2 and 3) so that the user can wear it. A wearing part (e.g., the wearing parts 221 and 222 of FIGS. 2 and 3, the wearing parts of FIGS. 4 and 5) connected to a portion of the main frame 210 or the main frame 410 of FIGS. 4 and 5. It may include (421, 422) or the wearing part 600 of FIG. 6. At least one of the wearable parts includes a touch circuit disposed on the inner side (e.g., the touch circuits 291 and 292 in FIG. 3, the touch circuits 491 and 492 in FIGS. 4 and 5, or the first touch circuit in FIG. 6 ( The wearing state of the HMD can be detected using 613) (or the third part 633 of the integrated touch circuit). In addition, at least one of the wearable parts may have a touch circuit (e.g., the second touch circuit 611 of FIG. 6 (or the first part 631 of the integrated touch circuit 631)) or a conductor disposed on the outer surface. .

In operation 1110, the HMD may determine whether separation of the wearing parts has been detected. For example, a situation in which the wearing parts are separated may indicate a situation in which the wearing parts are spaced apart from each other, and when the wearing parts are provided in the form of legs of glasses, it may represent a situation in which the legs of the glasses are spread out. According to one embodiment, the HMD detects a first touch input through a touch circuit disposed on the inner surface of one of the wearable parts, and a touch circuit disposed on the outer surface of another one of the wearable parts. If the pattern of the first touch input and the second touch input is changed or terminated while the second touch input is detected, it may be determined that the wearable parts are separated. According to one embodiment, the HMD has a first pattern of touch input detected through a touch circuit disposed on the inner surface of one of the wearable parts, and the pattern of the touch input is the first pattern. When the pattern is changed to the second pattern or the touch input is terminated, it may be determined that the wearing parts are separated. A situation in which the pattern of the touch input has the first pattern is, for example, a touch circuit disposed on the inner surface of one of the wearable parts and a conductor disposed on the outer surface of the other one of the wearable parts. It can indicate a situation where a person is close to or in contact with a body. In addition, a situation in which the pattern of the touch input has the second pattern is, for example, a touch circuit disposed on the inner surface of one of the wearable parts is disposed on the outer surface of the other one of the wearable parts. It can represent a situation where the conductor is separated by a certain distance or more.

If it is determined that separation of the wearing parts has not been detected (operation 1110 - No), the HMD may re-perform operation 1110. For example, the HMD may monitor the separation of the wearing parts continuously or at regular intervals until the separation of the wearing parts is detected.

If it is determined that the separation of the wearing parts is detected (operation 1110 - Yes), the HMD may perform preprocessing and activate the display in operation 1120. According to one embodiment, the HMD may increase the activation level of the processor. As an example, the HMD can control the processor to operate from a low-power mode to a normal mode. As another example, the HMD can increase the driving frequency of the processor. The processor may include, for example, an application processor. According to one embodiment, the HMD may preload execution data of a designated application into memory to prevent additional delays such as memory loading. Additionally, the HMD can turn on the screen of the display.

In operation 1130, the HMD may determine whether a touch input has been detected. The HMD can detect the touch input using a touch circuit disposed on the inner surface of at least one of the wearable parts. For example, when an HMD is worn on a user's head, a touch circuit disposed on the inner surface of at least one of the wearing units may be in contact with a portion of the head and may detect the touch input according to the contact. there is. Additionally, the HMD may acquire touch information corresponding to the touch input and detect the wearing state of the HMD using the acquired touch information.

If it is determined that the touch input is not detected (operation 1130 - No), the HMD may re-perform operation 1110.

If it is determined that the touch input is detected (operation 1130 - Yes), the HMD may display information through the activated display in operation 1140. For example, when the touch input is detected, the HMD may determine that the HMD is worn on the user's head, and in order to perform an operation according to wearing the HMD, information according to the operation may be displayed on the screen of the display. You can.

According to one embodiment, if the HMD determines that the touch input is not maintained, it may deactivate the display and lower the activation level of the processor. For example, the HMD can turn off the screen of the display. Additionally, the processor can be controlled to operate from a normal mode to a low-power mode. Alternatively, the HMD may lower the driving frequency of the processor.

According to one embodiment, the HMD may deactivate the display if the touch input is not detected within a specified time (eg, 10 seconds) after the separation of the wearable parts is detected. For example, the HMD can turn off the screen of the display.

FIG. 12 is a diagram illustrating a method for detecting contact and separation of wearing parts of an HMD according to an embodiment of the present disclosure.

Referring to Figure 12, the HMD 1200 (e.g., the HMD 200 in Figures 2 and 3 or the HMD 400 in Figures 4 and 5) has a main frame (e.g., HMD 200 in Figures 2 and 5) so that the user can wear it. Wearing parts 1210 and 1220 connected to a portion of the main frame 210 in Figure 3 or the main frame 410 in Figures 4 and 5 (e.g., wearing parts 221 and 222 in Figures 2 and 3, It may include the wearing parts 421 and 422 of FIGS. 4 and 5 or the wearing part 600 of FIG. 6 . At least one of the wearing parts 1210 and 1220 (e.g., the first wearing part 1210) has a touch circuit 1211 disposed on the inner side (e.g., the touch circuits 291 and 292 in FIG. 3, FIG. 4 and The wearing state of the HMD 1200 can be detected using the touch circuits 491 and 492 of FIG. 5 or the first touch circuit 613 of FIG. 6 (or the third part 633 of the touch circuit formed integrally). You can. In addition, at least one of the wearing parts 1210 and 1220 (e.g., the second wearing part 1220) has a touch circuit 1221 (e.g., the second touch circuit 611 of FIG. 6 (or integrally) on the outer surface. The first portion 631) of the formed touch circuit may be disposed.

According to one embodiment, when the HMD 1200 detects separation of the wearing parts 1210 and 1220, it may determine that the wearing parts 1210 and 1220 are spaced apart from each other. For example, as shown in FIG. 12 , when the wearing parts 1210 and 1220 are provided in the form of glasses legs, the HMD 1200 may determine that the glasses legs are spread.

According to one embodiment, the HMD 1200 includes a touch circuit (e.g., a first touch circuit) disposed on the inner surface of one of the wearable parts 1210 and 1220 (e.g., the first wearable part 1210). A first touch input is detected through the circuit 1211, and a touch circuit (e.g., a touch circuit) disposed on the outer surface of another of the wearable parts 1210 and 1220 (e.g., the second wearing part 1220). : When the second touch input is detected through the second touch circuit 1221 and the pattern of the first touch input and the second touch input are changed or terminated, the wearing parts 1210 and 1220 are separated. It can be judged that it has been done.

FIG. 13 is a diagram illustrating another method for detecting contact and separation of wearing parts of an HMD according to an embodiment of the present disclosure.

Referring to FIG. 13, the HMD 1300 (e.g., the HMD 200 in FIGS. 2 and 3 or the HMD 400 in FIGS. 4 and 5) has a main frame (e.g., HMD 200 in FIGS. 2 and 3) so that the user can wear it. Wearing parts 1310 and 1320 connected to a portion of the main frame 210 in Figure 3 or the main frame 410 in Figures 4 and 5 (e.g., wearing parts 221 and 222 in Figures 2 and 3, It may include the wearing parts 421 and 422 of FIGS. 4 and 5 or the wearing part 600 of FIG. 6 . At least one of the wearing parts 1310 and 1320 (e.g., the first wearing part 1310) has a touch circuit 1311 disposed on the inner side (e.g., the touch circuits 291 and 292 in FIG. 3, FIG. 4 and The wearing state of the HMD 1300 can be detected using the touch circuits 491 and 492 of FIG. 5 or the first touch circuit 613 of FIG. 6 (or the third part 633 of the touch circuit formed integrally). You can. Additionally, a conductor 1321 may be disposed on the outer surface of at least one of the wearing parts 1310 and 1320 (eg, the second wearing part 1320).

According to one embodiment, when the HMD 1300 detects separation of the wearing parts 1310 and 1320, it may determine that the wearing parts 1310 and 1320 are spaced apart from each other. For example, as shown in FIG. 13 , when the wearing parts 1310 and 1320 are provided in the form of glasses legs, the HMD 1300 may determine that the glasses legs are spread.

According to one embodiment, the HMD 1300 detects the sensor through the touch circuit 1311 disposed on the inner surface of any one of the wearable parts 1310 and 1320 (e.g., the first wearing part 1310). In a state where the pattern of the touch input has a first pattern, when the pattern of the touch input changes from the first pattern to the second pattern or the touch input is terminated, it is determined that the wearable parts 1310 and 1320 are separated. can do. A situation in which the pattern of the touch input has the first pattern is, for example, a touch disposed on the inner surface of any one of the wearing parts 1310 and 1320 (e.g., the first wearing part 1310). It may represent a situation in which the circuit 1311 is close to or in contact with the conductor 1321 disposed on the outer surface of another one of the wearing parts 1310 and 1320 (e.g., the second wearing part 1320). there is. In addition, a situation in which the pattern of the touch input has the second pattern is, for example, disposed on the inner surface of one of the wearing parts 1310 and 1320 (e.g., the first wearing part 1310). A situation in which the touch circuit 1311 is separated from the conductor 1321 disposed on the outer surface of another of the wearing parts 1310 and 1320 (e.g., the second wearing part 1320) by a certain distance or more. can indicate.

FIG. 14 is a diagram for explaining a method of operating an HMD when wearing parts of the HMD are in contact according to an embodiment of the present disclosure.

Referring to Figure 14, the HMD (e.g., the HMD 200 in Figures 2 and 3, the HMD 400 in Figures 4 and 5, the HMD 1200 in Figure 12, or the HMD 1300 in Figure 13) is used by the user. A wearing portion (e.g., the main frame 210 in FIGS. 2 and 3 or the main frame 410 in FIGS. 4 and 5) is connected to a part of the main frame so that it can be worn. Wearing parts 221 and 222, wearing parts 421 and 422 of FIGS. 4 and 5, wearing parts 600 of FIG. 6, wearing parts 1210 and 1220 of FIG. 12 or wearing parts 1310 of FIG. 13, 1320)) may be included. At least one of the wearable parts includes a touch circuit disposed on the inner side (e.g., the touch circuits 291 and 292 in FIG. 3, the touch circuits 491 and 492 in FIGS. 4 and 5, and the first touch circuit in FIG. 6 ( 613) (or the third part 633 of the integrated touch circuit), the first touch circuit 1211 of FIG. 12, or the touch circuit 1311 of FIG. 13) can be used to detect the wearing state of the HMD. . In addition, at least one of the wearable parts has a touch circuit (e.g., the second touch circuit 611 of FIG. 6 (or the first part 631 of the integrated touch circuit) of FIG. 6 or the second touch circuit of FIG. 12) on the outer surface. (1221)) or a conductor (eg, conductor 1321 in FIG. 13) may be disposed.

In operation 1410, the HMD may determine whether contact between the wearing parts is detected. For example, a situation in which the wearing parts are in contact may represent a situation in which the legs of the glasses are folded when the wearing parts are provided in the form of legs of glasses. According to one embodiment, the HMD detects a first touch input through a touch circuit disposed on the inner surface of one of the wearable parts, and a touch circuit disposed on the outer surface of another one of the wearable parts. When a second touch input is detected, it may be determined that the wearing parts are in contact. According to one embodiment, when the pattern of a touch input detected through a touch circuit disposed on the inner surface of any one of the wearable parts has a designated pattern (e.g., a first pattern), the HMD makes contact with the wearable parts. It can be judged that it has been done. A situation in which the pattern of the touch input has the specified pattern is, for example, a touch circuit disposed on the inner surface of one of the wearable parts and a conductor disposed on the outer surface of the other one of the wearable parts. It can indicate a situation where one is close to or in contact with.

If it is determined that the contact of the wearing parts is not detected (operation 1410 - No), the HMD may re-perform operation 1410. For example, the HMD may monitor the contact of the wearing parts continuously or at regular intervals until the contact of the wearing parts is detected.

If it is determined that the contact of the wearing parts is detected (operation 1410 - Yes), the HMD may deactivate the display and lower the activation level of the processor in operation 1420. For example, the HMD can turn off the screen of the display. Additionally, the processor can be controlled to operate from a normal mode to a low-power mode. Alternatively, the HMD may lower the driving frequency of the processor.

FIG. 15 is a diagram for explaining another method of operating an HMD when wearing parts of the HMD are in contact, according to an embodiment of the present disclosure.

Referring to Figure 15, the HMD (e.g., the HMD 200 in Figures 2 and 3, the HMD 400 in Figures 4 and 5, the HMD 1200 in Figure 12, or the HMD 1300 in Figure 13) is used by the user. A wearing portion (e.g., the main frame 210 in FIGS. 2 and 3 or the main frame 410 in FIGS. 4 and 5) is connected to a part of the main frame so that it can be worn. Wearing parts 221 and 222, wearing parts 421 and 422 of FIGS. 4 and 5, wearing parts 600 of FIG. 6, wearing parts 1210 and 1220 of FIG. 12 or wearing parts 1310 of FIG. 13, 1320)) may be included. At least one of the wearable parts includes a touch circuit disposed on the inner side (e.g., the touch circuits 291 and 292 in FIG. 3, the touch circuits 491 and 492 in FIGS. 4 and 5, and the first touch circuit in FIG. 6 ( 613) (or the third part 633 of the integrated touch circuit), the first touch circuit 1211 of FIG. 12, or the touch circuit 1311 of FIG. 13) can be used to detect the wearing state of the HMD. . In addition, at least one of the wearable parts has a touch circuit (e.g., the second touch circuit 611 of FIG. 6 (or the first part 631 of the integrated touch circuit) of FIG. 6 or the second touch circuit of FIG. 12) on the outer surface. (1221)) or a conductor (eg, conductor 1321 in FIG. 13) may be disposed.

In operation 1510, the HMD may determine whether contact between the wearing parts is detected. For example, a situation in which the wearing parts are in contact may represent a situation in which the legs of the glasses are folded when the wearing parts are provided in the form of legs of glasses. According to one embodiment, the HMD detects a first touch input through a touch circuit disposed on the inner surface of one of the wearable parts, and a touch circuit disposed on the outer surface of another one of the wearable parts. When a second touch input is detected, it may be determined that the wearing parts are in contact. According to one embodiment, when the pattern of a touch input detected through a touch circuit disposed on the inner surface of any one of the wearable parts has a designated pattern (e.g., a first pattern), the HMD makes contact with the wearable parts. It can be judged that it has been done. A situation in which the pattern of the touch input has the specified pattern is, for example, a touch circuit disposed on the inner surface of one of the wearable parts and a conductor disposed on the outer surface of the other one of the wearable parts. It can indicate a situation where one is close to or in contact with.

If it is determined that the contact of the wearing parts is not detected (operation 1510 - No), the HMD may re-perform operation 1510. For example, the HMD may monitor the contact of the wearing parts continuously or at regular intervals until the contact of the wearing parts is detected.

If it is determined that the contact of the wearing parts is detected (operation 1510 - Yes), the HMD may deactivate the display in operation 1520. For example, the HMD can turn off the screen of the display.

In operation 1530, the HMD may determine whether the HMD is seated in the case. The case can accommodate the HMD and protect the HMD from external shock. According to one embodiment, the case may include a sensor that can check whether the HMD is seated. According to one embodiment, the case may include a charging terminal, and when the HMD is seated, the HMD may be connected to the charging terminal. In this case, the case may charge the HMD.

If it is determined that the HMD is not seated in the case (operation 1530 - No), the HMD may re-perform operation 1520. For example, the HMD may remain inactive with the display.

If it is determined that the HMD is seated in the case (operation 1530 - Yes), the HMD may lower the activation level of the processor in operation 1540. As an example, the HMD can control the processor to operate from a normal mode to a low-power mode. As another example, the HMD may lower the driving frequency of the processor.

FIG. 16 is a diagram for explaining a method of operating an HMD when the HMD enters a charger according to an embodiment of the present disclosure.

Referring to Figure 16, the HMD (e.g., the HMD 200 in Figures 2 and 3, the HMD 400 in Figures 4 and 5, the HMD 1200 in Figure 12, or the HMD 1300 in Figure 13) is used by the user. A wearing portion (e.g., the main frame 210 in FIGS. 2 and 3 or the main frame 410 in FIGS. 4 and 5) is connected to a part of the main frame so that it can be worn. Wearing parts 221 and 222, wearing parts 421 and 422 of FIGS. 4 and 5, wearing parts 600 of FIG. 6, wearing parts 1210 and 1220 of FIG. 12 or wearing parts 1310 of FIG. 13, 1320)) may be included. At least one of the wearable parts includes a touch circuit disposed on the inner side (e.g., the touch circuits 291 and 292 in FIG. 3, the touch circuits 491 and 492 in FIGS. 4 and 5, and the first touch circuit in FIG. 6 ( 613) (or the third part 633 of the integrated touch circuit), the first touch circuit 1211 of FIG. 12, or the touch circuit 1311 of FIG. 13) can be used to detect the wearing state of the HMD. . In addition, at least one of the wearable parts has a touch circuit (e.g., the second touch circuit 611 of FIG. 6 (or the first part 631 of the integrated touch circuit) of FIG. 6 or the second touch circuit of FIG. 12) on the outer surface. (1221)) or a conductor (eg, conductor 1321 in FIG. 13) may be disposed.

At operation 1610, the HMD may determine whether the HMD has entered the charger. For example, when the HMD is connected to the charging terminal of the charger, the HMD and the charger may determine that the HMD has entered the charger.

If it is determined that the HMD has not entered the charger (operation 1610 - No), the HMD may re-perform operation 1610. For example, the HMD may monitor entry into the charger continuously or at regular intervals until the HMD enters the charger.

If it is determined that the HMD has entered the charger (operation 1610 - Yes), the HMD may determine whether contact with the wearing parts has been detected in operation 1620. For example, a situation in which the wearing parts are in contact may represent a situation in which the legs of the glasses are folded when the wearing parts are provided in the form of legs of glasses. According to one embodiment, the HMD detects a first touch input through a touch circuit disposed on the inner surface of one of the wearable parts, and a touch circuit disposed on the outer surface of another one of the wearable parts. When a second touch input is detected, it may be determined that the wearing parts are in contact. According to one embodiment, when the pattern of a touch input detected through a touch circuit disposed on the inner surface of any one of the wearable parts has a designated pattern (e.g., a first pattern), the HMD makes contact with the wearable parts. It can be judged that it has been done. A situation in which the pattern of the touch input has the specified pattern is, for example, a touch circuit disposed on the inner surface of one of the wearable parts and a conductor disposed on the outer surface of the other one of the wearable parts. It can indicate a situation where one is close to or in contact with.

If it is determined that the contact of the wearing parts is detected (operation 1620 - Yes), the HMD may receive charging power from the charger in operation 1630. For example, the charger can charge an HMD.

If it is determined that contact of the wearing parts is not detected (operation 1620 - No), the HMD may provide a notification in operation 1640. For example, if the HMD determines that no contact between the wearing parts is detected, it may determine that the glasses have entered the charger with the legs not properly stacked. That is, the HMD may determine that the HMD is incompletely connected to the charging terminal of the charger. Accordingly, the HMD can provide information indicating that the HMD has been incompletely inserted into the charger. According to one embodiment, the HMD may transmit the information to an external electronic device (e.g., a smartphone) connected through a communication circuit, and the external electronic device may output the information through at least one of a display or a speaker. . According to one embodiment, the HMD may output the information through a speaker or output a signal corresponding to the information through a light emitting unit (eg, LED). According to one embodiment, the charger may output the information through a speaker or output a signal corresponding to the information through a light emitting unit (eg, LED).

FIG. 17 is a diagram for explaining a method of operating an HMD related to a wearing posture of the HMD according to an embodiment of the present disclosure.

Referring to Figure 17, the HMD (e.g., the HMD 200 in Figures 2 and 3, the HMD 400 in Figures 4 and 5, the HMD 1200 in Figure 12, or the HMD 1300 in Figure 13) is used by the user. A wearing portion (e.g., the main frame 210 in FIGS. 2 and 3 or the main frame 410 in FIGS. 4 and 5) is connected to a part of the main frame so that it can be worn. Wearing parts 221 and 222, wearing parts 421 and 422 of FIGS. 4 and 5, wearing parts 600 of FIG. 6, wearing parts 1210 and 1220 of FIG. 12 or wearing parts 1310 of FIG. 13, 1320)) may be included. At least one of the wearable parts includes a touch circuit disposed on the inner side (e.g., the touch circuits 291 and 292 in FIG. 3, the touch circuits 491 and 492 in FIGS. 4 and 5, and the first touch circuit in FIG. 6 ( 613) (or the third part 633 of the integrated touch circuit), the first touch circuit 1211 of FIG. 12, or the touch circuit 1311 of FIG. 13) can be used to detect the wearing state of the HMD. . For example, when an HMD is worn on a user's head, a touch circuit disposed on the inner surface of at least one of the wearing units may be in contact with a portion of the head and may detect a touch input according to the contact. . Additionally, the HMD may acquire touch information corresponding to the touch input and detect the wearing state of the HMD using the acquired touch information. The touch information may include, for example, touch location (e.g., location of a touched touch cell among touch cells), touch area (e.g., total area of touched touch cells among touch cells), and touch type (e.g., touch among touch cells). It may include at least one of the arrangement type of the touch cells) or the number of touches (e.g., the number of touched touch cells among touch cells). The touch information may be referred to as a touch pattern expressed by at least one of touch location, touch area, touch type, or number of touches. For example, the touch information may be expressed as a different touch pattern when at least one of the touch position, touch area, touch type, or number of touches is different.

If the pattern of the touch input detected through the touch circuit disposed on the inner surface of at least one of the wearable units has a first pattern, the HMD may determine that the HMD is worn on the user's head. The first pattern may be, for example, the touch position is a first position, the touch area is a first size or more, the touch shape has a first shape, the number of touches is a first number or more, or It can represent a combination state. According to one embodiment, when the touch position is the first position, at least one touch cell arranged in the end direction of the wearable part among the plurality of touch cells arranged on the inner surface of at least one of the wearable parts is used by the user. It may indicate contact with the ear or the part of the temple adjacent to the ear. According to one embodiment, the state in which the touch area is equal to or greater than the first size means that the total area of at least one touch cell contacted among the plurality of touch cells disposed on the inner surface of at least one of the wearing units is the first size. It can indicate an abnormal state. According to one embodiment, the state in which the touch shape has the first shape means that the arrangement shape of at least one touch cell contacted among the plurality of touch cells disposed on the inner surface of at least one of the wearable parts is the first shape. It can represent the state corresponding to the shape. The first shape may be, for example, a square or oval with one long side. According to one embodiment, the state in which the number of touches is greater than or equal to the first number means that the number of at least one touch cell contacted among a plurality of touch cells disposed on the inner surface of at least one of the wearing units is greater than or equal to the first number. It can indicate status.

If it is determined that the HMD is worn on the user's head, in operation 1710, the HMD may determine the distance between the lens of the HMD and the user's eyes. The HMD can calculate the distance between the lens and the eye using the acquired touch information. According to one embodiment, the HMD may determine the distance between the lens and the eye based on at least one of the touch location, the touch area, the touch type, or the number of touches. According to one embodiment, the HMD may determine the distance between the lens and the eye using history information of touch input detected through the touch circuit disposed on the inner surface of at least one of the wearable parts. For example, the touch input history information may include touch information corresponding to a touch input detected through the touch circuit disposed on the inner surface of at least one of the wearing parts when the user previously wore the HMD. You can. That is, the touch input history information may include the touch information acquired at a previous time or accumulated up to a previous time.

In operation 1720, the HMD may determine whether the determined distance is within a reference range. For example, the HMD may determine whether the distance between the lens and the eye is within the reference range.

If it is determined that the determined distance is within the reference range (operation 1720 - Yes), the HMD may display information through the display in operation 1730. For example, if it is determined that the distance between the lens and the eye is within the reference range, the HMD may determine that the HMD is normally worn on the user's head. Accordingly, in order to perform an operation according to wearing the HMD, the HMD may display information according to the operation on the screen of the display.

If it is determined that the determined distance is not within the reference range (operation 1720 - No), the HMD may provide a notification in operation 1740. For example, if it is determined that the distance between the lens and the eye is not within the reference range, the HMD may determine that the HMD is abnormally worn on the user's head. Accordingly, the HMD can provide information indicating that the HMD is abnormally worn on the user's head. For example, the HMD can display the information on the display screen or output it through speakers. Afterwards, the HMD may re-perform operation 1720. For example, the HMD can continuously or at regular intervals monitor whether the HMD is properly worn on the user's head.

FIG. 18 is a diagram for explaining another method of operating an HMD related to the wearing posture of the HMD according to an embodiment of the present disclosure.

Referring to Figure 18, the HMD (e.g., the HMD 200 in Figures 2 and 3, the HMD 400 in Figures 4 and 5, the HMD 1200 in Figure 12, or the HMD 1300 in Figure 13) is used by the user. A wearing portion (e.g., the main frame 210 in FIGS. 2 and 3 or the main frame 410 in FIGS. 4 and 5) is connected to a part of the main frame so that it can be worn. Wearing parts 221 and 222, wearing parts 421 and 422 of FIGS. 4 and 5, wearing parts 600 of FIG. 6, wearing parts 1210 and 1220 of FIG. 12 or wearing parts 1310 of FIG. 13, 1320)) may be included. At least one of the wearable parts includes a touch circuit disposed on the inner side (e.g., the touch circuits 291 and 292 in FIG. 3, the touch circuits 491 and 492 in FIGS. 4 and 5, and the first touch circuit in FIG. 6 ( 613) (or the third part 633 of the integrated touch circuit), the first touch circuit 1211 of FIG. 12, or the touch circuit 1311 of FIG. 13) can be used to detect the wearing state of the HMD. . For example, when an HMD is worn on a user's head, a touch circuit disposed on the inner surface of at least one of the wearing units may be in contact with a portion of the head and may detect a touch input according to the contact. . Additionally, the HMD may acquire touch information corresponding to the touch input and detect the wearing state of the HMD using the acquired touch information. The touch information may include, for example, touch location (e.g., location of a touched touch cell among touch cells), touch area (e.g., total area of touched touch cells among touch cells), and touch type (e.g., touch among touch cells). It may include at least one of the arrangement type of the touch cells) or the number of touches (e.g., the number of touched touch cells among touch cells). The touch information may be referred to as a touch pattern expressed by at least one of touch location, touch area, touch type, or number of touches. For example, the touch information may be expressed as a different touch pattern when at least one of the touch position, touch area, touch type, or number of touches is different.

If the pattern of the touch input detected through the touch circuit disposed on the inner surface of at least one of the wearable units has a first pattern, the HMD may determine that the HMD is worn on the user's head. The first pattern may be, for example, the touch position is a first position, the touch area is a first size or more, the touch shape has a first shape, the number of touches is a first number or more, or It can represent a combination state. According to one embodiment, when the touch position is the first position, at least one touch cell arranged in the end direction of the wearable part among the plurality of touch cells arranged on the inner surface of at least one of the wearable parts is used by the user. It may indicate contact with the ear or the part of the temple adjacent to the ear. According to one embodiment, the state in which the touch area is equal to or greater than the first size means that the total area of at least one touch cell contacted among the plurality of touch cells disposed on the inner surface of at least one of the wearing units is the first size. It can indicate an abnormal state. According to one embodiment, the state in which the touch shape has the first shape means that the arrangement shape of at least one touch cell contacted among the plurality of touch cells disposed on the inner surface of at least one of the wearable parts is the first shape. It can represent the state corresponding to the shape. The first shape may be, for example, a square or oval with one long side. According to one embodiment, the state in which the number of touches is greater than or equal to the first number means that the number of at least one touch cell contacted among a plurality of touch cells disposed on the inner surface of at least one of the wearing units is greater than or equal to the first number. It can indicate status.

If it is determined that the HMD is worn on the user's head, in operation 1810, the HMD may determine the distance between the HMD's lenses and the user's eyes. The HMD can calculate the distance between the lens and the eye using the acquired touch information. According to one embodiment, the HMD may determine the distance between the lens and the eye based on at least one of the touch location, the touch area, the touch type, or the number of touches. According to one embodiment, the HMD may determine the distance between the lens and the eye using history information of touch input detected through the touch circuit disposed on the inner surface of at least one of the wearable parts. For example, the touch input history information may include touch information corresponding to a touch input detected through the touch circuit disposed on the inner surface of at least one of the wearing parts when the user previously wore the HMD. You can. That is, the touch input history information may include the touch information acquired at a previous time or accumulated up to a previous time.

In operation 1820, the HMD may determine whether the determined distance is within a reference range. For example, the HMD may determine whether the distance between the lens and the eye is within the reference range.

If it is determined that the determined distance is within the reference range (operation 1820 - Yes), the HMD may display information through the display in operation 1830. For example, if it is determined that the distance between the lens and the eye is within the reference range, the HMD may determine that the HMD is normally worn on the user's head. Accordingly, in order to perform an operation according to wearing the HMD, the HMD may display information according to the operation on the screen of the display.

If it is determined that the determined distance is not within the reference range (operation 1820 - No), the HMD may adjust the focal length of the lens in operation 1840. For example, if the determined distance is smaller than the reference range, the HMD may determine that the distance between the lens and the eye is close. In this case, the HMD can closely adjust the focal length of the lens. As another example, if the determined distance is greater than the reference range, the HMD may determine that the distance between the lens and the eye is long. In this case, the HMD can adjust the focal length of the lens to a greater distance. Afterwards, the HMD may re-perform operation 1820. For example, the HMD can continuously or at regular intervals monitor whether the HMD is properly worn on the user's head.

FIG. 19 is a diagram for explaining another method of operating an HMD related to a wearing posture of the HMD according to an embodiment of the present disclosure.

Referring to Figure 19, the HMD (e.g., the HMD 200 in Figures 2 and 3, the HMD 400 in Figures 4 and 5, the HMD 1200 in Figure 12, or the HMD 1300 in Figure 13) is used by the user. A wearing portion (e.g., the main frame 210 in FIGS. 2 and 3 or the main frame 410 in FIGS. 4 and 5) is connected to a part of the main frame so that it can be worn. Wearing parts 221 and 222, wearing parts 421 and 422 of FIGS. 4 and 5, wearing parts 600 of FIG. 6, wearing parts 1210 and 1220 of FIG. 12 or wearing parts 1310 of FIG. 13, 1320)) may be included. The wearable parts include touch circuits disposed on the inner side (e.g., touch circuits 291 and 292 in Figure 3, touch circuits 491 and 492 in Figures 4 and 5, and first touch circuit 613 in Figure 6 ( Alternatively, the wearing state of the HMD can be detected using the third part 633 of the integrated touch circuit, the first touch circuit 1211 of FIG. 12, or the touch circuit 1311 of FIG. 13). For example, when the HMD is worn on the user's head, the touch circuit disposed on the inner surface of the wearing parts may contact a portion of the head and detect a touch input according to the contact. In other words, the first touch circuit disposed on the inner surface of the first wearable part among the wearable parts detects the first touch input according to the contact, and the second touch circuit disposed on the inner surface of the second wearable part among the wearable parts. Can detect a second touch input according to the contact.

In operation 1910, the HMD may determine the wearing state of each of the wearing parts. For example, the HMD determines the wearing state of the first wearable part using the first touch information corresponding to the first touch input detected through the first touch circuit disposed on the inner surface of the first wearable part among the wearable parts. And, the wearing state of the second wearing part can be determined using second touch information corresponding to the second touch input detected through the second touch circuit disposed on the inner surface of the second wearing part among the wearing parts.

The first touch information and the second touch information include, for example, a touch location (e.g., the position of a touched touch cell among touch cells), a touch area (e.g., the total area of a touched touch cell among touch cells), and touch It may include at least one of a shape (e.g., arrangement form of touched touch cells among touch cells) or the number of touches (e.g., number of touch cells among touch cells). The first touch information and the second touch information may be referred to as a touch pattern expressed by at least one of a touch location, touch area, touch shape, or number of touches. For example, when the first touch information and the second touch information are different in at least one of the touch location, touch area, touch type, or number of touches, the touch patterns may be expressed as being different.

In operation 1920, the HMD may determine whether the deviation of the wearing positions of the wearing parts is within a reference range. According to one embodiment, the HMD may determine the wearing position of the first wearing part using the first touch information, and determine the wearing position of the second wearing part using the second touch information. The wearing position may correspond to the distance between the lens of the HMD and the user's eyes. For example, when the wearing positions of the wearing parts are pulled toward the user's eyes, the distance between the lens and the eye is smaller than the reference range, and when the wearing positions of the wearing parts are worn far from the user's eyes, the The distance between the lens and the eye may be greater than the reference range. In addition, the deviation of the wearing positions of the wearing parts may be, for example, when the wearing position of the first wearing part is the first position and the wearing position of the second wearing part is the second position, the first position and the second position. It can correspond to the difference value of .

If it is determined that the deviation of the wearing position is within the reference range (operation 1920 - Yes), the HMD may display information through the display in operation 1930. For example, if it is determined that the deviation of the wearing positions of the wearing parts is within the reference range, the HMD may determine that the HMD is normally worn on the user's head. Accordingly, in order to perform an operation according to wearing the HMD, the HMD may display information according to the operation on the screen of the display.

If it is determined that the deviation of the wearing position is not within the reference range (operation 1920 - No), the HMD may provide a notification in operation 1940. For example, if it is determined that the deviation of the wearing positions of the wearing parts is not within the reference range, the HMD may determine that the HMD is worn abnormally (eg, crookedly) on the user's head. Accordingly, the HMD can provide information indicating that the HMD is abnormally worn on the user's head. For example, the HMD can display the information on the display screen or output it through speakers. Afterwards, the HMD may re-perform operation 1920. For example, the HMD can continuously or at regular intervals monitor whether the HMD is properly worn on the user's head.

As described above, according to various embodiments, a head mounted display device (e.g., the HMD 200 of FIGS. 2 and 3, the HMD 400 of FIGS. 4 and 5, the HMD 1200 of FIG. 12, or the HMD 1200 of FIG. 13 The method of detecting the wearing state of the HMD (1300) includes wearing parts (e.g., wearing parts 221 and 222 in FIGS. 2 and 3) that are respectively connected to both ends of the frame of the head mounted display device and extend in one direction. , at least one of the wearing parts 421 and 422 of FIGS. 4 and 5, the wearing part 600 of FIG. 6, the wearing parts 1210 and 1220 of FIG. 12, or the wearing parts 1310 and 1320 of FIG. 13. A first touch circuit disposed on the inner surface of the wearing part (e.g., the touch circuits 291 and 292 in FIG. 3, the touch circuits 491 and 492 in FIGS. 4 and 5, and the first touch circuit 613 in FIG. 6). An operation of detecting a first touch input through (or the third part 633 of the touch circuit formed integrally), the first touch circuit 1211 of FIG. 12, or the touch circuit 1311 of FIG. 13 (e.g., FIG. Operation 730 of 7, operation 830 of FIG. 8, operation 1030 of FIG. 10, or operation 1130 of FIG. 11), and in response to detection of the first touch input, based on the first touch information corresponding to the first touch input This may include an operation of determining a wearing state of the head mounted display device.

According to various embodiments, a method of detecting a wearing state of a head mounted display device includes, before detecting the first touch input, a second touch circuit disposed on the outer surface of at least one of the wearing parts (e.g., in FIG. 6). An operation of detecting a second touch input through the second touch circuit 611 (or the first portion 631 of the touch circuit formed integrally) or the second touch circuit 1221 of FIG. 12 (e.g., of FIG. 7) Operation 710), an operation of increasing the activation level of the processor of the head mounted display device in response to detection of the second touch input (e.g., operation 720 of FIG. 7), and an operation of increasing the activation level of the processor of the head mounted display device based on the first touch information. When the wearing state of the display device is determined, an operation of activating the display of the head mounted display device (eg, operation 740 of FIG. 7) may be further included.

According to various embodiments, a method of detecting a wearing state of a head mounted display device includes, before detecting the first touch input, a second touch circuit disposed on the outer surface of at least one of the wearing parts (e.g., in FIG. 6). An operation of detecting a second touch input through the second touch circuit 611 (or the first portion 631 of the touch circuit formed integrally) or the second touch circuit 1221 of FIG. 12 (e.g., of FIG. 8 Operation 810), in response to detection of the second touch input, increasing the activation level of the processor of the head mounted display device and activating the display of the head mounted display device (e.g., operation 820 of FIG. 8), and If the first touch input is not detected within a specified time after detecting the second touch input, the method may further include deactivating the display.

According to various embodiments, a method for detecting a wearing state of a head mounted display device maintains activation of the system of the head mounted display device when the pattern of the first touch input changes from a first pattern to a second pattern, An operation of deactivating the display of the head mounted display device (e.g., operation 920 of FIG. 9), and a pattern of the first touch input in a state where the pattern of the first touch input is changed from the first pattern to the second pattern. When the second pattern is changed to the first pattern, an operation of activating the display (eg, operation 960 of FIG. 9) may be further included.

According to various embodiments, a method of detecting a wearing state of a head mounted display device includes, before detecting the first touch input, a second touch circuit disposed on an outer surface of at least one of the first touch circuit and the wearable portion. (e.g., the second touch circuit 611 of FIG. 6 (or the first part 631 of the touch circuit formed integrally) or the second touch circuit 1221 of FIG. 12) or a conductor (e.g., the conductor of FIG. 13) An operation of detecting separation of the worn parts using a sieve 1321 (e.g., operation 1010 of FIG. 10), and an operation of increasing the activation level of the processor of the head mounted display device when the worn parts are separated (e.g., operation 1010 of FIG. : Operation 1020 of FIG. 10), and when the wearing state of the head mounted display device is determined based on the first touch information, operation of activating the display of the head mounted display device (e.g., operation 1040 of FIG. 10). More may be included.

According to various embodiments, a method of detecting a wearing state of a head mounted display device includes, before detecting the first touch input, a second touch circuit disposed on an outer surface of at least one of the first touch circuit and the wearable portion. (e.g., the second touch circuit 611 of FIG. 6 (or the first part 631 of the touch circuit formed integrally) or the second touch circuit 1221 of FIG. 12) or a conductor (e.g., the conductor of FIG. 13) An operation of detecting separation of the worn parts using a sieve 1321 (e.g., operation 1110 of FIG. 11). When the worn parts are separated, the activation level of the processor of the head mounted display device is increased and the head mounted display device is activated. The method may further include activating the display of the display device (e.g., operation 1120 of FIG. 11 ), and deactivating the display if the first touch input is not detected within a specified time after the wearable parts are separated. there is.

According to various embodiments, a method of detecting a wearing state of a head mounted display device includes the first touch circuit and a second touch circuit disposed on an outer surface of at least one of the wearing parts (e.g., the second touch in FIG. 6). Using the circuit 611 (or the first portion 631 of the integrated touch circuit or the second touch circuit 1221 of FIG. 12) or a conductor (e.g., the conductor 1321 of FIG. 13), An operation to detect contact of the wearable parts (e.g., operation 1410 of FIG. 14), and when the wearable parts are contacted, an operation to deactivate the display of the head mounted display device and lower the activation level of the processor of the head mounted display device. (e.g. operation 1420 of FIG. 14) may be further included.

According to various embodiments, a method of detecting a wearing state of a head mounted display device includes the first touch circuit and a second touch circuit disposed on an outer surface of at least one of the wearing parts (e.g., the second touch in FIG. 6). Using the circuit 611 (or the first portion 631 of the integrated touch circuit or the second touch circuit 1221 of FIG. 12) or a conductor (e.g., the conductor 1321 of FIG. 13), An operation of detecting contact of the wearable parts (e.g., operation 1510 of FIG. 15), an operation of deactivating the display of the head mounted display device when the wearable parts are contacted (e.g., operation 1520 of FIG. 15), and the head mount An operation of determining whether the display device is seated in the case (e.g., operation 1530 of FIG. 15), and if it is determined that the head mounted display device is seated in the case, an operation of lowering the activation level of the processor of the head mounted display device. (e.g. operation 1540 of FIG. 15) may be further included.

According to various embodiments, a method of detecting a wearing state of a head mounted display device includes an operation of determining whether the head mounted display device is connected to a charging terminal of a charger (e.g., operation 1610 of FIG. 16), the first touch circuit, and An operation of detecting contact between the wearing parts using a second touch circuit or a conductor disposed on the outer surface of at least one of the wearing parts (e.g., operation 1620 of FIG. 16), when the wearing parts are contacted , an operation of charging the head-mounted display device (e.g., operation 1630 of FIG. 16), and an operation of providing information indicating that the head-mounted display device is incompletely inserted into the charger if the wearing parts are not in contact (e.g. : Operation 1630 of FIG. 16) may be further included.

According to various embodiments, a method for detecting a wearing state of a head mounted display device includes the operation of determining the distance between the lens of the head mounted display device and the user's eyes based on the first touch information (e.g., in FIG. 17 Operation 1710 or operation 1810 of FIG. 18), an operation of determining whether the determined distance is within the reference range (e.g., operation 1720 of FIG. 17 or operation 1820 of FIG. 18), and an operation of determining whether the determined distance is within the reference range. If it is determined that it is not included, information is provided indicating that the head mounted display device is abnormally worn on the head (e.g., operation 1740 of FIG. 17), or an operation of adjusting the focal length of the lens (e.g., operation of FIG. 18) 1840) may be further included.

According to various embodiments, the wearing parts include a first wearing part connected to one end of the frame and a second wearing part connected to the other end of the frame, and the first touch circuit is connected to the first wearing part. A method for detecting a wearing state of a head mounted display device comprising a second touch circuit disposed on an inner surface and a third touch circuit disposed on an inner surface of the second wearing unit, the second touch circuit detected through the second touch circuit. An operation of determining a wearing position of the first wearing unit based on second touch information corresponding to the touch input (e.g., operation 1910 of FIG. 19), and a third touch input corresponding to the third touch input detected through the third touch circuit. 3 An operation of determining the wearing position of the second wearing part based on touch information (e.g., operation 1910 of FIG. 19), and whether the difference between the wearing position of the first wearing part and the wearing position of the second wearing part is within a reference range. An operation of determining (e.g., operation 1920 of FIG. 19), if it is determined that the deviation is not within the reference range, an operation of providing information indicating that the head mounted display device is abnormally worn on the head (e.g., operation 1920 of FIG. Operation 1940 of 19 may further be included.

Electronic devices according to various embodiments disclosed in this document may be of various types. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to embodiments of this document are not limited to the above-described devices.

The various embodiments of this document and the terms used herein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various changes, equivalents, or replacements of the embodiments. In connection with the description of the drawings, similar reference numbers may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the above items, unless the relevant context clearly indicates otherwise. As used herein, “A or B”, “at least one of A and B”, “at least one of A or B”, “A, B or C”, “at least one of A, B and C”, and “A Each of phrases such as “at least one of , B, or C” may include any one of the items listed together in the corresponding phrase, or any possible combination thereof. Terms such as "first", "second", or "first" or "second" may be used simply to distinguish one element from another, and may be used to distinguish such elements in other respects, such as importance or order) is not limited. One (e.g. first) component is said to be "coupled" or "connected" to another (e.g. second) component, with or without the terms "functionally" or "communicatively". When mentioned, it means that any of the components can be connected to the other components directly (e.g. wired), wirelessly, or through a third component.

The term “module” used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and is interchangeable with terms such as logic, logic block, component, or circuit, for example. It can be used as A module may be an integrated part or a minimum unit of the parts or a part thereof that performs one or more functions. For example, according to one embodiment, the module may be implemented in the form of an application-specific integrated circuit (ASIC).

Various embodiments of this document are one or more stored in a storage medium (e.g., built-in memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). It may be implemented as software (e.g., program 140) including instructions. For example, a processor (e.g., processor 120) of a device (e.g., electronic device 101) may call at least one command among one or more commands stored from a storage medium and execute it. This allows the device to be operated to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. A storage medium that can be read by a device may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' only means that the storage medium is a tangible device and does not contain signals (e.g. electromagnetic waves), and this term refers to cases where data is semi-permanently stored in the storage medium. There is no distinction between temporary storage cases.

According to one embodiment, methods according to various embodiments disclosed in this document may be provided and included in a computer program product. Computer program products are commodities and can be traded between sellers and buyers. The computer program product may be distributed in the form of a machine-readable storage medium (e.g. compact disc read only memory (CD-ROM)), or through an application store (e.g. Play Store ^TM ) or on two user devices (e.g. It can be distributed (e.g. downloaded or uploaded) directly between smart phones) or online. In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

According to various embodiments, each component (e.g., module or program) of the above-described components may include a single or plural entity, and some of the plurality of entities may be separately placed in other components. there is. According to various embodiments, one or more of the components or operations described above may be omitted, or one or more other components or operations may be added. Alternatively or additionally, multiple components (eg, modules or programs) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each component of the plurality of components in the same or similar manner as those performed by the corresponding component of the plurality of components prior to the integration. . According to various embodiments, operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, or omitted. Alternatively, one or more other operations may be added.

Claims (15)

In the head mounted display device, a frame including a first surface facing in a first direction and a second surface facing in a second direction opposite to the first direction; a display exposed to the outside through the second surface; Wearing parts each connected to both ends of the frame and extending in one direction; and Comprising a processor disposed inside at least one of the frame or the wearing portion, Each of the wearing units includes an inner surface that is in contact with a portion of the head when the head mounted display device is worn on the user's head, and an outer surface that faces the inner surface, At least one of the wearing parts includes a first touch circuit disposed on the inner surface. In claim 1, The head mounted display device is provided in the form of glasses, A head mounted display device wherein the wearing parts constitute legs of the glasses. In claim 1, A head mounted display device in which the wearing parts are integrally provided in the form of a band and tightened to surround a portion of the head. In claim 1, The first touch circuit is a head mounted display device in which a plurality of touch cells are arranged adjacent to each other. In claim 1, The first touch circuit is arranged to extend from the inner side to the outer side. In claim 1, At least one of the wearing parts includes a second touch circuit disposed on the outer surface, The wearing parts include a first wearing part connected to one end of the frame and a second wearing part connected to the other end of the frame, The first touch circuit is disposed on the inner surface of the first wearing part, The second touch circuit is a head mounted display device disposed on the outer surface of the second wearing unit. In claim 1, At least one of the wearing parts includes a conductor disposed on the outer surface, The wearing parts include a first wearing part connected to one end of the frame and a second wearing part connected to the other end of the frame, The first touch circuit is disposed on the inner surface of the first wearing part, A head mounted display device wherein the conductor is disposed on the outer surface of the second wearing part. In the method of detecting the wearing state of a head mounted display device, detecting a first touch input through a first touch circuit disposed on the inner surface of at least one of the wearable parts respectively connected to both ends of the frame of the head mounted display device and extending in one direction; and In response to detection of the first touch input, a method for detecting a wearing state of a head mounted display device comprising determining a wearing state of the head mounted display device based on first touch information corresponding to the first touch input. . In claim 8, Before detecting the first touch input, detecting a second touch input through a second touch circuit disposed on an outer surface of at least one of the wearable parts; In response to detection of the second touch input, increasing the activation level of the processor of the head mounted display device; and When the wearing state of the head mounted display device is determined based on the first touch information, the method of detecting the wearing state of the head mounted display device further includes activating a display of the head mounted display device. In claim 8, Before detecting the first touch input, detecting a second touch input through a second touch circuit disposed on an outer surface of at least one of the wearable parts; In response to detection of the second touch input, increasing the activation level of the processor of the head mounted display device and activating the display of the head mounted display device; and A method of detecting a wearing state of a head mounted display device further comprising deactivating the display if the first touch input is not detected within a specified time after detecting the second touch input. In claim 8, When the pattern of the first touch input changes from the first pattern to the second pattern, maintaining activation of the system of the head mounted display device and deactivating the display of the head mounted display device; and When the pattern of the first touch input is changed from the first pattern to the second pattern, and the pattern of the first touch input is changed from the second pattern to the first pattern, an operation of activating the display A method for detecting a wearing state of a head mounted display device further comprising: In claim 8, Before detecting the first touch input, detecting separation of the wearable parts using the first touch circuit and a second touch circuit or conductor disposed on an outer surface of at least one of the wearable parts; increasing the activation level of a processor of the head mounted display device when the wearable parts are separated; and When the wearing state of the head mounted display device is determined based on the first touch information, the method of detecting the wearing state of the head mounted display device further includes activating a display of the head mounted display device. In claim 8, Before detecting the first touch input, detecting separation of the wearable parts using the first touch circuit and a second touch circuit or conductor disposed on an outer surface of at least one of the wearable parts; When the wearable parts are separated, increasing the activation level of the processor of the head mounted display device and activating the display of the head mounted display device; and A method of detecting a wearing state of a head mounted display device further comprising deactivating the display if the first touch input is not detected within a specified time after the wearing parts are separated. In claim 8, An operation of detecting contact between the wearable parts using the first touch circuit and a second touch circuit or conductor disposed on an outer surface of at least one of the wearable parts; and When the wearing parts are contacted, the method of detecting a wearing state of a head mounted display device further comprising deactivating the display of the head mounted display device and lowering the activation level of the processor of the head mounted display device. In claim 8, An operation of detecting contact between the wearable parts using the first touch circuit and a second touch circuit or conductor disposed on an outer surface of at least one of the wearable parts; Deactivating the display of the head mounted display device when the wearable parts are contacted; An operation of determining whether the head mounted display device is seated in a case; and When it is determined that the head mounted display device is seated in the case, the method of detecting a wearing state of a head mounted display device further comprising lowering the activation level of a processor of the head mounted display device.

Images