KR102001852B1 - A tooth mirror for monitering oral - Google Patents

Abstract

Oral monitoring alveolar according to an embodiment, the oral monitoring alveolar having a mirror for observing the oral cavity, disposed in the mirror is a camera for acquiring the oral image by shooting in the oral cavity; A communication unit for transmitting the acquired oral image; An air injection for injecting air to the mirror side; And a processor configured to control the camera to provide an oral monitoring function, wherein the processor controls the communication unit to transmit the oral image to the head mounted display, the virtual image on the head mounted display. It may be controlled to display the oral cavity image.

Description

Oral Monitoring Alveolar {A TOOTH MIRROR FOR MONITERING ORAL}

The present invention relates to oral monitoring alveolar. More specifically, the present invention relates to an oral monitoring alveolar that can easily and precisely observe a user's mouth using a head mounted display.

In general, the dentist examines the patient's mouth, checks the patient's oral cavity and tooth decay, and performs the dental treatment of the patient.At this time, the device is a device that checks the teeth from the comfort of the patient to every corner of the mouth. Dental alveolar was developed to.

However, the conventional dental alveolar is configured to check the dental state of the patient through the use of a dentist or a third party, there is a problem that can not determine the state of the tooth when the patient is self-diagnosing itself.

In order to solve this problem, Prior Art 1 (Korean Patent Laid-Open Publication No. 10-2012-0069794) proposed a dental monitoring apparatus for installing a camera on an alveolar and monitoring an image taken from an alveolar with an external device. However, the tooth monitoring device of Prior Art 1 cannot be observed at the same time as the image reflected on the actual alveolar by allowing the captured image to be viewed on an external display device. This is far from a technique for easy observation.

KR 10-2012-0069794 A

The present invention is to propose an oral monitoring alveolar to assist in easily and precisely observing the oral cavity of others.

In detail, an object of the present invention is to provide an oral monitoring alveolar that allows the user to easily and precisely observe the oral cavity of another person by photographing the oral cavity and analyzing the photographed image and providing the same to the user through the head mounted display.

Oral monitoring alveolar according to an embodiment, the oral monitoring alveolar having a mirror for observing the oral cavity, disposed in the mirror is a camera for acquiring the oral image by shooting in the oral cavity; A communication unit for transmitting the acquired oral image; An air injection for injecting air to the mirror side; And a processor configured to control the camera to provide an oral monitoring function, wherein the processor controls the communication unit to transmit the oral image to the head mounted display, the virtual image on the head mounted display. It may be controlled to display the oral cavity image.

The display apparatus may further include a head mounted display including a glass and a display unit configured to receive the oral image on the glass and display the virtual image on the glass, wherein the display unit displays the oral image in a divided area of one corner of the glass. Can be.

The head mounted display may provide an interface for enlarging or reducing the size of the divided area according to a user's input, and for enlarging or reducing a partial area of the oral cavity image according to the user's input.

In addition, when the processor detects an object for oral trouble in the oral cavity image, the processor acquires oral trouble information based on the object, transmits the oral trouble information to the head mounted display, and the head mounted display The oral trouble information may be displayed as an augmented reality image.

The processor may calculate the turbidity of the oral cavity image, and when the turbidity is less than a predetermined value, operate the air injection to remove moisture from the mirror.

The processor may generate a panoramic oral image by synthesizing the plurality of oral images, and transmit the generated oral image to the head mounted display when receiving the plurality of oral images taken along the teeth through the camera unit. Can be.

In addition, the processor extracts a boundary between a tooth and a gum from the plurality of oral images, respectively, and determines the boundary between the teeth and the teeth in the vertical direction. The plurality of oral images may be synthesized based on the synthesis criteria by determining the synthesis criteria.

The processor may implement a 3D model of the tooth through the plurality of oral images when the camera receives an oral image of the inside, the top, and the outside of the tooth.

The apparatus may further include an illumination unit including a plurality of LEDs disposed at different positions, and the processor may sequentially drive the LEDs, and the photometric stereo (based on the oral image taken as the LEDs are sequentially driven). Photometric Stereo) can implement a 3D model for the tooth.

According to an embodiment, a method for providing an oral monitoring function in an oral monitoring alveolar having a mirror for observing an oral cavity, the method comprising: photographing an oral image by controlling a camera disposed in the mirror; Transmitting the oral cavity image to a head mounted display; And displaying the oral cavity image as an augmented reality image on the head mounted display.

Oral monitoring alveolar according to the embodiment, while assisting to observe the inside of the oral cavity through the mirror and at the same time taking the inside of the oral cavity and outputs the image taken through the head mounted display, the user can use the oral monitoring alveolar to Easy and precise monitoring

1 is an internal block diagram of an oral monitoring alveolar in accordance with an embodiment of the present invention.
2 is a perspective view of an oral monitoring alveolar in accordance with an embodiment of the present invention.
3 is a perspective view of a head mounted display according to an embodiment of the invention.
Figure 4 shows the sense of sensing the movement of the oral monitoring alveolar in accordance with an embodiment of the present invention.
5 is a flow chart showing the operation of the oral cavity monitoring alveolar according to an embodiment of the present invention.
6 illustrates a state in which an oral monitoring image is displayed in a head mounted display according to an embodiment of the present invention.
7 is a view illustrating an augmented reality image displayed in a field of view viewed through a head mounted display according to an embodiment of the present invention.
FIG. 8A illustrates a state in which the oral cavity image is taken by changing the shooting direction in the first direction according to an exemplary embodiment of the present invention, and FIG. 8B illustrates the oral panorama image generated by synthesizing the image taken in FIG. 8A.
9A illustrates a state in which the oral cavity image is taken while changing the photographing direction in the second direction according to an embodiment of the present invention, and FIG. 9B is an image displaying the oral cavity image captured in FIG. 9A as a 2D oral cavity image. 9C is an image of the oral image taken in FIG. 9A as a 3D oral image.

As the invention allows for various changes and numerous embodiments, particular embodiments will be illustrated in the drawings and described in detail in the written description. Effects and features of the present invention, and methods of achieving them will be apparent with reference to the embodiments described below in detail together with the drawings. However, the present invention is not limited to the embodiments disclosed below but may be implemented in various forms. In the following embodiments, the terms first, second, etc. are used for the purpose of distinguishing one component from other components rather than a restrictive meaning. Also, the singular forms “a”, “an” and “the” include plural forms unless the context clearly indicates otherwise. In addition, the terms including or have means that the features or components described in the specification are present, and does not preclude the possibility of adding one or more other features or components. In addition, in the drawings, components may be exaggerated or reduced in size for convenience of description. For example, the size and thickness of each component shown in the drawings are arbitrarily shown for convenience of description, and thus the present invention is not necessarily limited to the illustrated.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings, and the same or corresponding components will be denoted by the same reference numerals, and redundant description thereof will be omitted. .

Oral monitoring according to the embodiment assists to observe the inside of the oral cavity through a mirror, and at the same time the inside of the oral cavity and outputs the image taken through the head mounted display, so that the user can easily and precisely monitor the oral cavity of others Can help.

Hereinafter, the internal configuration of the oral monitoring alveolar will be described in detail with reference to FIG. 1.

Referring to FIG. 1, the oral cavity monitoring alveolar according to the embodiment may include an input unit 110, a communication unit 120, an interface unit 130, a memory 140, a camera 150, a sensor unit 160, and a processor 170. ), The air injection 180 and the lighting unit 190 may be included. However, the components shown in FIG. 1 are not essential to implementing the oral monitoring alveolar, and thus the oral monitoring alveolar described herein may have more or fewer components than those listed above.

In addition, the oral cavity monitoring alveolar according to the embodiment may be understood as directly including the head mounted display 200 since the oral cavity communicates wirelessly through the communication unit 120 and transmits and displays the oral image to the head mounted display 200. Data processing in the process of analyzing and displaying the taken oral image is processed by at least one processor of the processor 170 and the head mounted display 200 of the oral monitoring alveolar. Although the processor 170 of the monitoring alveolar performs data processing, an embodiment in which some data processing is performed in the head mounted display 200 is also possible.

 Returning to the description of the internal configuration again, the oral cavity monitoring alveolar may include an input unit 110 for sensing a user's input.

For example, the input unit 110 may detect an execution input for turning on / off the power of the oral cavity monitoring alveolar, a setting, execution input, etc. for various functions of the oral cavity monitoring alveolar.

The input unit 110 may include a gesture input unit (for example, an optical sensor) for detecting a user gesture, a touch input unit (for example, a touch sensor, a touch key, and a push) for detecting a touch. And at least one of a microphone for sensing a voice key) and a voice input, to detect a user input.

In addition, the oral cavity monitoring alveolar may include a communication unit 120 for wireless communication with the head mounted display 200.

In detail, the communicator 120 may transmit the captured oral image or the oral cavity information to the head mounted display 200 and display it on the head mounted display 200.

In addition, the communicator 120 may receive feedback or control signals for oral cavity information transmitted from the head mounted display 200.

The communication unit 120 may include a following communication scheme (for example, Global System for Mobile Communication (GSM), Code Division Multi Access (CDMA), High Speed Downlink Packet Access (HSDPA), High Speed Uplink Packet Access (HSUPA), Long Term Evolution (LTE), Long Term Evolution-Advanced (LTE-A), Wireless LAN (WLAN), Wireless-Fidelity (Wi-Fi), Wireless Fidelity (Wi-Fi) Direct, Digital Living Network Alliance ), A wireless signal may be transmitted and received with at least one of a base station, an external terminal, and a server on a network network constructed according to WiBro (Wireless Broadband) and WiMAX (World Interoperability for Microwave Access).

In addition, the communication unit 120 may transmit / receive a wireless signal through a short range wireless communication method. For example, the communication unit 120 may include Bluetooth ™, Radio Frequency Identification (RFID), Infrared Data Association (IrDA), Ultra Wideband (UWB), ZigBee, Near Field Communication (NFC), Wi- Local area communication may be supported using at least one of wireless (Fi- delity), Wi-Fi Direct, and wireless universal serial bus (Wireless USB) technologies.

Meanwhile, referring to FIG. 3, the head mounted display 200 according to the embodiment is a glasses type glass display device that displays a virtual image on glass G and glass G that transmit light. It may include a display unit 210. That is, in the embodiment, the head mounted display 200, while observing the outside through the glass (G) like the glasses, and outputs a virtual image displayed on the glass (G), the augmented reality (AR) to the user Can provide.

In detail, referring to FIG. 3, the head mounted display according to the embodiment is formed in the form of glasses wearable on a user's face (head), and includes a glass frame forming a main body, and end portions of both sides of the glass frame. It may include a support that is in contact with the ear, glass (G) for transmitting light, and a display for displaying a virtual image on the glass (G).

The head mounted display may further include a second support for supporting the nose area at the user's face for more robust support as the glasses, although not shown, eyeglasses positioned in front of both eyes of the user are further coupled to the glass frame. Can be.

When the user wears the head mounted display having such a structure, the user can observe the outside through the glass G, and at the same time, the user can enjoy multimedia such as various images and texts displayed on the glass G according to the display of the display unit. have.

The oral cavity monitoring alveolar may include an interface unit 130 that receives data or transmits a signal processed or generated by the processor 170 to the outside.

In an exemplary embodiment, the interface unit 130 may control to transmit and display the oral cavity information or the oral cavity image to the terminal display except for the head mounted display 200 by wire / wireless.

In detail, the interface unit 130 may serve as a passage with various kinds of external devices connected to the oral cavity monitoring alveolar. The interface unit 130 may include a wired / wireless headset port, an external charger port, a wired / wireless data port, a memory 140 card card, and an identification module. It may include at least one of a port (port) for connecting, an audio input / output (I / O) port, a video input / output (I / O) port, and an earphone port. In the oral cavity monitoring alveolar, in response to an external device being connected to the interface unit 130, appropriate control related to the connected external device may be performed.

In addition, the oral monitoring alveolar may include a memory 140 that stores data supporting various functions of the oral monitoring alveolar.

In detail, the memory 140 may store a plurality of application programs or applications driven in the oral cavity monitoring alveolar, data for operating the oral cavity monitoring alveolar, and instructions.

The application program may be stored in the memory 140 and installed on the oral monitoring alveolar, and may be driven by the processor 170 to perform an operation (or function) of the oral monitoring alveolar.

In addition, in an embodiment, the memory 140 may store oral information and oral image of a person who has been previously monitored to display information previously stored when augmented reality is implemented later as an additional image.

In addition, the memory 140 may be hardware, and various storage devices such as a ROM, a RAM, an EPROM, a flash drive, a hard drive, and the like, and the memory 140 stores a storage function of the memory 140 on the Internet. It may also be web storage.

In addition, the oral monitoring alveolar may further include a camera 150 for photographing the inside of the oral cavity.

In detail, in an embodiment, the camera 150 may be disposed around the alveolar or inside the alveolar to photograph a side in which the alveolar reflects light (eg, a normal direction of the alveolar mirror plane).

For example, referring to FIG. 2, the camera 150 is disposed in the center of the mirror portion M of the alveolar and photographs the same direction as the direction in which the alveolar reflects, so that the user intuitively recognizes the direction of the alveolar. Can be arranged.

More specifically, the alveolar may include a handle portion having a rod shape, a mirror portion M disposed on the head H, and a neck portion N connecting the head and the handle portion M to each other. have. The camera 150 may be disposed at the center of the mirror portion M, and the central mirror portion M of the image of the camera 150 may have a relatively high light transmittance as compared to the other mirror portion M regions. ) Can assist the shooting.

For example, the mirror portion M may include a reflective layer disposed on the glass and the lower surface of the glass, and the reflective layer may not be formed only at the center portion of the glass, or may be formed relatively thinner than other regions to lower the light transmittance. .

The camera 150 may include an image sensor and an image processing module. The camera 150 may process a still image or a moving image obtained by an image sensor (eg, CMOS or CCD). The image processing module may process the still image or the moving image acquired through the image sensor, extract necessary information, and transfer the extracted information to the processor 170.

In addition, the oral monitoring alveolar may include a sensor unit 160 for detecting the movement of the oral monitoring alveolar.

For example, the sensor unit 160 may include at least one of an acceleration sensor, a magnetic sensor, a gravity sensor (G-sensor), a gyroscope sensor, and a motion sensor. Including a sensor of the handle (M) can detect the three-dimensional movement.

In detail, in an embodiment, the sensor unit 160 may be disposed on the handle portion M of the oral cavity monitoring alveolar to detect a three-dimensional movement of the handle portion M, and the movement information may then be analyzed in the oral image. Can be utilized.

For example, referring to FIG. 4, the processor 170 obtains up, down, left, right, and forward movement information (X, Y, Z) of the handle part M from the sensor part 160 disposed in the handle part M. FIG. In addition, the movement information of the handle portion M may be converted into movement information (X ', Y', Z ') of the alveolar head and used to analyze the oral image taken by the camera 150 located in the alveolar head. have.

In addition, the oral monitoring alveolar may further include an air injection 180 that emits air to the mirror portion M of the alveolar.

In detail, in the exemplary embodiment, the air injection 180 outputs air toward the mirror portion M to remove foreign matters from the mirror portion M, thereby improving the reflectance of the mirror portion M, and Can assist with shooting.

The air injection 180 may be disposed on the handle portion M or the neck portion, and the air output hole may be disposed to face the upper surface of the mirror portion M. FIG.

For example, a bent surface facing the mirror surface is disposed between the handle portion M and the neck portion, and an air output hole of the air injection 180 is formed in the bent surface, such that the air injection 180 is toward the mirror portion M side. It can release air.

In addition, the oral monitoring alveolar may further include an illumination unit 190 that emits light into the oral cavity.

In an embodiment, the lighting unit 190 may emit light toward the upper surface normal direction of the mirror unit M with the LED lighting to help the inside of the mouth of the camera 150.

For example, referring to FIG. 2, a plurality of lighting units 190 may be disposed along a circumference of a head surrounding the mirror unit M. Referring to FIG. In more detail, four lighting units 190 may be disposed at equal intervals along the circumference of the head to irradiate light.

In this case, the processor 170 may operate the four lighting units 190 sequentially, and may implement the oral cavity environment as a 3D image through the oral images photographed by the sequentially operating lighting unit 190. That is, the processor 170 may implement a 3D model of the oral environment in a photometric stereo manner by photographing synchronously driving the LED and driving the LED.

It may include a processor 170 for controlling the overall operation of each unit.

The processor 170 may include application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, and microcontrollers. It may be implemented using at least one of a controller (micro-controllers), microprocessors (microprocessors), an electrical unit for performing other functions.

In addition to the operations associated with the application, the processor 170 typically controls the overall operation of the oral monitoring alveolar. The processor 170 may provide or process information or a function appropriate to a user by processing signals, data, information, and the like input or output through the above-described components, or by running an application program stored in the memory 140.

Hereinafter, a method for providing various oral monitoring functions by operating the oral monitoring alveolar composed of such units will be described in detail.

First, when the user observes the oral cavity of the patient through the alveolar, the camera 150 of the alveolar may operate to photograph the oral cavity. (S101)

In detail, the camera 150 of the embodiment is disposed in the center of the mirror portion M of the alveolar to capture an image in the same direction as the reflection image of the mirror portion M, so that the user intuitively recognizes the shooting direction of the camera 150. And the area to be observed in the oral cavity can be taken.

In this case, the lighting unit 190 may assist the photographing of the camera 150 by irradiating illumination to the photographing direction of the alveolar camera 150. The processor 170 may determine the intensity of the lighting unit 190 by determining the brightness of the captured oral image, and control the output amount of the lighting unit 190 according to the determined intensity of the lighting unit 190.

When the oral cavity is photographed to obtain an oral image, the communicator 120 may control the oral cavity image to be transmitted and displayed on a display.

In detail, the display displays the oral image on a portion of the glass G so that the user observes the oral cavity with the alveolar through the glass G and at the same time the oral image is displayed on the portion of the glass G. The mouth of the user can be observed more precisely. (S102)

For example, referring to FIG. 6, the display may divide a portion of one side of the corner side of the glass G and display an oral image in the divided region to assist the user in accurately monitoring the oral cavity. .

In this case, the display may provide an interface function for easily monitoring a desired area by providing a function of enlarging / reducing the size of the oral image display area or enlarging / reducing a partial area of the oral image according to a user input. can do.

Meanwhile, the processor 170 may detect oral trouble by analyzing the captured oral image. (S103)

In detail, the processor 170 may store features of the stored oral troubles (eg, tooth decay, stomatitis, or dental restoration) stored in the memory 140, and if an object having the stored features is detected in the oral cavity image, the processor 170 may analyze the object. Oral trouble information can be obtained.

In more detail, the processor 170 may separate the background and the foreground by performing segmentation and clustering after performing image preprocessing. Thereafter, the processor 170 may detect the object from the foreground separated by the image segment. Next, the processor 170 may classify and verify the separated object. For example, processor 170, identification using neural network, support vector machine (SVM), identification by AdaBoost using Haar-like features, or histograms of oriented gradients (HOG), etc. Can be used.

In addition, the processor 170 may transmit the acquired oral trouble information to the display through the communication unit 120 to display the information on the oral trouble that the user may miss. (S104)

In detail, the display may display the oral trouble information to the user by displaying the oral trouble information as an augmented reality image so as to match the corresponding oral trouble object.

For example, referring to FIG. 7, when receiving oral trouble information about tooth decay, the display may display an augmented reality image on the glass that highlights the tooth decay and displays information about the tooth decay on the glass, thereby providing the oral cavity to the user. It is possible to provide an oral monitoring function that informs trouble information.

In addition, the display stores the oral image and oral trouble information taken during the previous oral monitoring of the same patient in the memory 140, and when the oral monitoring later, oral image / oral trouble information stored during the previous monitoring augmented reality It can be displayed as an image to assist in oral care.

On the other hand, the processor 170 may compare the turbidity (or sharpness) of the oral images photographed according to time, and detect that the oral image is captured below a predetermined turbidity. (S105)

That is, the processor 170 may detect that the moisture of the glass of the alveolar is filled in the wet oral cavity through the change in the sharpness of the oral cavity image.

When the oral cavity image is captured at a predetermined turbidity or less, the processor 170 may automatically drive the air injection 180 to remove moisture from the glass of the alveolar, thereby improving the oral cavity monitoring convenience of the user. (S108)

On the other hand, when performing a health check for the entire oral cavity, it may be difficult to meticulously monitor the entire oral area only by the mirror of the alveolar. Alveolar can provide a panoramic oral monitoring function as a function of monitoring the entire area of the mouth.

In detail, when the panoramic mouth monitoring function is executed, the processor 170 may change the direction of the camera 150 in accordance with the movement (or rotation) of the alveolar to sequentially photograph the inside of the mouth. (S107)

In more detail, referring to FIG. 8A, a user may execute a panoramic oral monitoring function, move the camera 150 of the alveolar along the dentition, and photograph a plurality of teeth. For example, the camera 150 may acquire an oral image of the entire mandibular tooth by photographing the other outermost tooth while rotating in the first direction d1 in the lowermost tooth of the mandible.

The processor 170 may synthesize a plurality of oral images photographed sequentially, generate a panoramic oral image, and display the image on a display to provide a panoramic oral image that can confirm a plurality of regions in the oral cavity at a time. (S108)

In detail, the processor 170 may analyze the oral images to detect a boundary between the tooth and the gum, synthesize the plurality of oral images to match the boundary, and easily determine a sink criterion between the oral images.

In addition, the processor 170 may easily determine and synthesize the synthesis reference boundary between the oral images through the boundary between the tooth and the tooth. For example, the first oral cavity image and the second oral cavity so that the boundary between the molars 2 and 3 of the first oral cavity image coincide with the boundary between the molars 2 and 3 of the second oral cavity image of the second oral cavity image. By synthesizing the images, it may be possible to accurately set the position reference between the oral images.

As shown in FIG. 8B, the display displays a panoramic oral image including a plurality of oral images P1, P2, P3, and P4, so that a user may view a plurality of oral cavity at a glance.

A panoramic oral monitoring function may be provided to assist in identifying an area (eg, the entire interior of the mandibular tooth).

On the other hand, the alveolar may provide a function of monitoring the oral cavity with a three-dimensional model in order to precisely monitor the specific teeth or between the teeth.

In detail, when the 3D oral cavity monitoring function is executed, the processor 170 may acquire oral images sequentially photographed according to the photographing direction of the camera 150 changed according to the movement of the alveolar. (S109)

For example, referring to FIG. 9A, the user executes a 3D oral monitoring function and moves the alveolar to move in the direction of photographing the inner side, the upper side, and the outer side of the tooth in order (d2), and the oral image is taken. Can be obtained.

In this case, the processor 170 may operate the four lighting units 190 sequentially, and may acquire the oral image photographed according to the lighting unit 190 sequentially operated.

In addition, the processor 170 may further acquire the motion information of the alveolar through the sensor unit 160.

In addition, the processor 170 may transmit the captured oral image to a display as it is and display it as a 2D image. For example, referring to FIG. 9B, the display may display a two-dimensional image that can be displayed while moving the top image, the inside image of the tooth, and the outside image of the tooth, respectively.

In addition, the processor 170 may model the oral cavity region as a 3D model through a plurality of oral images and motion information, and display the oral cavity image as a 3D image. (S110)

In detail, the processor 170 may implement a 3D model oral image of the oral environment in a photometric stereo method based on the motion information, the oral image captured in synchronization with the LED driving and the LED driving.

In addition, by transmitting the implemented 3D model oral image and displaying it on the display as shown in FIG. 9C, it is possible to precisely monitor a specific oral region by converting the 3D viewpoint.

Embodiments according to the present invention described above can be implemented in the form of program instructions that can be executed by various computer components and recorded in a computer-readable recording medium. The computer-readable recording medium may include program instructions, data files, data structures, etc. alone or in combination. Program instructions recorded on the computer-readable recording medium may be specially designed and configured for the present invention, or may be known and available to those skilled in the computer software arts. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks and magnetic tape, optical recording media such as CD-ROMs and DVDs, and magneto-optical media such as floptical disks. medium) and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory 140, and the like. Examples of program instructions include not only machine code generated by a compiler, but also high-level language code that can be executed by a computer using an interpreter or the like. The hardware device may be modified with one or more software modules to perform the processing according to the present invention, and vice versa.

Particular implementations described in the present invention are embodiments and do not limit the scope of the present invention in any way. For brevity of description, descriptions of conventional electronic configurations, control systems, software, and other functional aspects of the systems may be omitted. In addition, the connection or connection members of the lines between the components shown in the drawings by way of example shows a functional connection and / or physical or circuit connections, in the actual device replaceable or additional various functional connections, physical It may be represented as a connection, or circuit connections. In addition, unless specifically mentioned, such as "essential", "important" may not be a necessary component for the application of the present invention.

In addition, although the detailed description of the present invention has been described with reference to a preferred embodiment of the present invention, those skilled in the art or those skilled in the art having ordinary knowledge in the technical field described in the claims to be described later It will be understood that various modifications and variations can be made in the present invention without departing from the scope of the present invention. Therefore, the technical scope of the present invention should not be limited to the contents described in the detailed description of the specification but should be defined by the claims.

Claims (10)

In the oral monitoring alveolar having a mirror for observing the oral cavity,
A camera disposed inside the mirror to capture an oral cavity and acquire an oral image;
A communication unit for transmitting the acquired oral image;
An air injection for injecting air to the mirror side; And
A processor which provides a mouth monitoring function by controlling the camera;
The processor,
Controlling the communication unit to transmit the oral image photographed by the camera to a head mounted display to display the oral image as a virtual image on the head mounted display,
And a head mounted display including a glass and a display unit configured to receive the oral image on the glass and display the oral image as a virtual image.
The display unit,
The oral cavity image is displayed on a divided area of one corner of the glass,
The head mounted display,
Enlarge or reduce the size of the divided area according to a user input;
Providing an interface for enlarging or reducing a partial region of the oral cavity image according to the user input;
The processor,
When the object of the oral cavity is detected in the oral cavity image, oral trouble information is obtained based on the object, and the oral trouble information is transmitted to the head mounted display.
The head mounted display,
Display the oral trouble information as an augmented reality image,
The processor in the display unit,
The turbidity of the oral cavity image is calculated, and when the turbidity is less than a predetermined value, the air injection is operated to remove moisture from the mirror.
Oral monitoring alveolar. delete delete delete delete The method of claim 1,
The processor,
When receiving a plurality of oral images taken along the dent through the camera, the plurality of oral images are synthesized to generate a panoramic oral image, and to transmit the generated oral image to the head mounted display
Oral monitoring alveolar. The method of claim 6,
The processor,
The boundary between the teeth and the gums is extracted from the plurality of oral images, respectively, and determined based on the synthesis criteria in the vertical direction.
In the plurality of oral images, the boundary between the teeth and the teeth is determined as a synthesis standard in the horizontal plane between the oral images to synthesize the plurality of oral images according to the synthesis criteria.
Oral monitoring alveolar. The method of claim 1,
The processor,
When the camera receives an oral image of the inner surface, the upper surface and the outer surface of the tooth, and implements a three-dimensional model of the tooth through the plurality of oral images,
Further comprising a lighting unit including a plurality of LEDs disposed at different positions,
The processor,
By sequentially driving the LEDs, and sequentially driving the LEDs to implement a 3D model for the tooth in a photometric stereo (Photometric Stereo) method based on the oral image taken
Oral monitoring alveolar. delete delete

Images