WO2019187449A1 - Image processing device and image processing program - Google Patents

Abstract

Provided is an image processing device capable of assisting in reading an image of one or more teeth referred to by an operator during medical treatment. An image processing device (1) is provided with: a treatment position setting means (12) that sets a position of treatment by an operator; and a display control means (13) that causes a display means (5) to display an image of one or more teeth and that causes the display means (5) to display a marker image indicating the position of the treatment such that the marker image is superimposed on the image of the one or more teeth.

Description

Image processing apparatus and image processing program

The present invention relates to an image processing apparatus and an image processing program.

Patent Document 1 describes that, in dentistry, an X-ray image of a tooth is displayed simultaneously with a root canal length measurement screen on a display unit, and an operator performs root canal treatment while checking the X-ray image of the tooth. Yes. By displaying the tooth image on the display unit when performing root canal treatment in this manner, the surgeon can easily grasp the internal information of the treated tooth.

JP 2001-327519 A

However, the appearance of the treated tooth differs depending on the orientation of the surgeon in contact with the patient during medical treatment. Therefore, when performing treatment while checking the tooth image, the surgeon may cause a reading error of the tooth image unless his / her medical position is considered. Therefore, it is a burden for an operator who performs treatment while checking a tooth image to accurately read the tooth image.

Therefore, the present invention has been made in view of the above problems, and provides an image processing apparatus and an image processing program capable of supporting reading of a tooth image referred to by an operator during treatment. Let it be an issue.

In order to solve the above problems, an image processing apparatus according to the present invention displays a medical treatment position setting unit for setting a medical treatment position of an operator, a tooth image on a display unit, and a mark image indicating the medical treatment position. Display control means for displaying on the display means so as to be superimposed on a tooth image.

According to the present invention, it is possible to support reading of a tooth image referred to by an operator during treatment. Therefore, according to the present invention, it is possible to reduce a burden of reading an image of a tooth by an operator during treatment, and to prevent a reading error.

1 is a block diagram schematically showing a configuration of an image processing apparatus according to an embodiment of the present invention. It is a schematic diagram which shows an example of a dental treatment facility. It is a schematic diagram which shows an operator's medical treatment position, (a) has shown the 12:00 position which is a 1st position, (b) has shown the 9 o'clock position which is a 2nd position. It is a schematic diagram which shows the example of a screen displayed in the case of the 9 o'clock position which is a 2nd position. It is a flowchart which shows an example of a process of the image processing apparatus which concerns on embodiment of this invention. (A)-(d) is a schematic diagram which shows the relationship between an operator's medical treatment position and CT tomographic image. It is a schematic diagram which shows the example of a screen displayed in the case of the 12:00 position which is the 1st position. It is a schematic diagram which shows the modification of the example of a screen of FIG. It is a schematic diagram which shows the other example of a screen display, Comprising: (a) respond | corresponds to the 2nd position, (b) respectively corresponds to the 1st position. It is a schematic diagram which shows an example of a head mounted display.

Hereinafter, an image processing apparatus according to an embodiment of the present invention will be described in detail with reference to the drawings.
FIG. 1 is a block diagram schematically showing the configuration of an image processing apparatus according to an embodiment of the present invention.
The image processing apparatus 1 can be realized by, for example, a general computer, and includes a central processing unit (CPU), a random access memory (RAM), a read only memory (ROM), a hard disk drive (HDD), and the like. And an input / output interface. The computer is installed with an image display program for generating and displaying X-ray CT tomographic images and 3D images from the three-dimensional CT data 21, and an operation program for superimposing the operator's medical position on the tooth image. Yes. The tooth image is, for example, a cross-sectional image taken by an X-ray CT (Computed Tomography) apparatus, a 3D image created from CT data, or a virtual endoscopic image created from CT data. Also good. The tooth image may be a dental image or a panoramic image taken by an X-ray imaging apparatus.

The image processing apparatus 1 is connected with, for example, a microscope 2, a detection unit 3, an input unit 4, and a display unit 5.

As the microscope 2, a conventionally known microscope for dental surgery can be used. As a usage form of the microscope, there are a case where the dentist looks directly into the eyepiece part of the microscope and a case where the camera is attached to the eyepiece part side of the microscope. In the present embodiment, as an example, a camera is attached to the microscope 2 for use. An output signal from this camera is output to the image processing apparatus 1. Depending on the treatment policy of the dentist, the dentist may look directly into the eyepiece of the microscope or may not use the microscope. In such a case, there is no input signal from the microscope 2 to the image processing apparatus 1.

Detecting means 3 detects the operator's medical position. The detection means 3 is, for example, a sensor or a camera. A general human sensor can be used as the sensor. The human sensor is a sensor for detecting a human location using infrared rays, ultrasonic waves, visible light, or the like. The human sensor may be a reflection type or a transmission type. When the detection means 3 is, for example, a reflective sensor using infrared light, the infrared light projected from the light projecting element of the sensor is reflected by the human body (operator) and reaches the light receiving element of the sensor. Person can be detected.

The place where such a detection means 3 is installed may be an arbitrary place such as a wall, a desk, or a dental unit in an examination room of a dental clinic. As shown in FIG. 2, the detection means 3 may be attached to a patient chair 31, for example. Here, on the base of the patient chair 31, the detection means 3 composed of a reflective sensor is disposed at a position corresponding to the position below the backrest and a position corresponding to the position below the armrest. The detection means 3 may detect the human body (operator) itself, or may detect the position of the foot controller 34, for example. This is because when the surgeon uses the foot controller 34, the foot controller 34 is installed in a range where his / her feet can reach at his / her medical position.

When the detecting means 3 is a transmissive sensor, the light projecting element and the light receiving element are separated from each other, and the light receiving element is located on the base of the patient chair 31 at a position corresponding to the backrest and under the armrest. Each may be arranged at a location corresponding to. In this case, it is possible to detect the operator's medical position by disposing the light projecting element at a fixed location such as a wall or desk of the examination room and blocking the light.

When the detection means 3 is a camera, the type of camera is not particularly limited. A general visible light camera or an infrared camera may be used. The camera may be installed on the surgeon's hanger, assistant hanger, arm, columnar stand or surgical light (not shown), or the operator's chair 33 of the dental unit 32. In addition, the camera marker is preferably installed at a position corresponding to the operator's medical position, for example, a fixed position such as under the backrest or under the armrest. Accordingly, the medical position of the surgeon can be detected by detecting the camera marker together with the surgeon.

Returning to FIG. 1, the description of the configuration of the image processing apparatus 1 will be continued.
The input unit 4 inputs information necessary for control such as processing performed by the image processing apparatus 1 and setting of a tomogram displayed on the display unit 5, and is a device such as a keyboard or a mouse. The display means 5 displays a tooth image or the like, and is, for example, a liquid crystal display. On the screen of the display means 5 connected to the image processing apparatus 1, windows, icons, buttons, and the like are displayed by a GUI (Graphical User Interface), and the operator performs an operation of selecting them with the input means 4 such as a mouse. It can be performed.

The image processing apparatus 1 includes a processing unit 10 and a storage unit 20.
The storage means 20 stores various data used for image processing, processing results, an image display program, an operation program for superimposing a surgeon's medical position on a tooth image, and the like. The storage means 20 is composed of, for example, a magnetic disk, an optical disk, a general image memory, and the like.
In FIG. 1, the storage means 20 has memorize | stored the three-dimensional CT data 21, the dental image 22, the panorama image 23, and the virtual endoscopic image 24 as an example. The medical position 25 is information obtained as a processing result of the processing means 10.

The three-dimensional CT data 21 is based on three-dimensional data (volume data) obtained by imaging using dental CT (CBCT: Cone-Beam Computed Tomography) using a cone beam. This volume data is divided into 512 × 512 × 512 voxels, for example. The three-dimensional CT data 21 is data obtained by reconstructing an image by calculating the pixel value of each voxel. As the three-dimensional CT data 21, for example, data in which the pixel value of each voxel is calculated in advance is input in advance.

The dental image 22 is an X-ray image acquired by dental imaging that images a part of the teeth in the oral cavity.
The panoramic image 23 is an X-ray image acquired by panoramic imaging for imaging the entire tooth.
The virtual endoscopic image 24 is an image created by CG (Computer Graphics) from CT data.

The processing unit 10 includes a microscope image input unit 11, a medical position setting unit 12, and a display control unit 13. The processing means 10 is realized, for example, when the CPU stores the program stored in the storage means 20 in the RAM and executes it.
Hereinafter, each means will be described in detail.

The microscope image input means 11 is a predetermined interface for inputting a microscope image transmitted from a camera (not shown) attached to the microscope 2. The microscope image is a moving image and is displayed on the display unit 5 by the display control unit 13.

The medical care position setting means 12 is for setting the medical care position of the surgeon. Here, the operator's medical position indicates any direction of 360 ° surrounding the patient. For example, when the shape of the patient chair 31 provided with the detection means 3 of FIG. 2 is rounded, one sensor (detection means 3) can be used anywhere in the 180 ° area around the patient. A medical location can be set. Further, when the detection means 3 is a camera, it is possible to set the operator's medical position in any direction around the patient.
In dentistry, a method in which the operator's medical position is indicated by the position of a clock hand may be employed. Corresponding to this method, the operator's medical position may be any position such as 9 o'clock position, 10 o'clock position, 11 o'clock position, 12 o'clock position, and the like. Below, two typical positions will be described as an example of the surgeon's medical position. The first position is the 12 o'clock position and the second position is the 9 o'clock position. Hereinafter, the first position and the second position may be appropriately referred to as a 12 o'clock position or a 9 o'clock position.

The medical care position setting means 12 sets, for example, one of a first position indicating the patient's parietal side and a second position indicating the patient's cheek side as the operator's medical position. It may be. FIG. 3A is a diagram illustrating an example of an operator D who is currently treating a patient P at the first position. FIG. 3B is a diagram illustrating an example of an operator D who is currently treating a patient P at the second position.

In this embodiment, as an example, the medical position setting unit 12 sets the medical position by acquiring a detection signal from the detection unit 3 that detects the medical position of the surgeon. That is, the medical position setting means 12 automatically sets the medical position.

The display control means 13 displays a tooth image on the display means 5. The display control means 13 reads, for example, the three-dimensional CT data 21, constructs a CT tomographic image, and displays it on the display means 5. The display control unit 13 causes the display unit 5 to display a mark image indicating the medical position so as to be superimposed on the tooth image. In the case of automatic detection, when the medical position is changed midway, the display of the mark image is also changed along with the change.

Here, an example of the screen display will be described with reference to FIG. In this example, a state in which X-ray image windows 41 to 43 and option image windows 44 to 46 are simultaneously displayed on the screen of the display means 5 is schematically shown. However, these windows may be displayed individually.

In the window 41, an axial (axial misalignment, crossing) image is displayed. In the window 42, a coronal (coronal cut, forehead cut) image is displayed. In the window 43, a sagittal image is displayed. Here, two orthogonal straight lines are displayed only in the axial image and omitted in the other images, but in the CT image viewer, a straight line indicating the tomographic position is generally displayed in each image. Is done. By changing the position and angle of these straight lines, it is possible to easily extract a target fault.

In the window 44, a 3D image (3D image) is displayed. Here, a 3D image of a tooth created from the three-dimensional CT data 21 is displayed. The display control unit 13 can display the 3D image side by side with the X-ray image of the tooth. Here, the 3D image may be an image of a tooth included in an area irradiated with a CTBT cone beam. For example, it may be an image obtained by rendering a patient's head, upper jaw, entire lower jaw, a plurality of teeth, or a single tooth included in the beam irradiation range. The rendering processing may be, for example, volume rendering processing (volume 処理 rendering), surface rendering processing (surface rendering), or the like.

In the windows 41 to 44, the mark image 50 is superimposed on the tooth image. FIG. 4 is a schematic diagram showing an example of a screen displayed in the case of the 9 o'clock position, which is the second position, as an example. The shape of the mark image 50 is not particularly limited as long as it can indicate the medical treatment position of the operator, and may be, for example, a triangle, a quadrangle, a polygon, a circle, an ellipse, or the like. In the present embodiment, the mark image 50 has the shape of an arrow and is an image showing the line of sight of the operator. That is, the base end portion of the arrow indicates the medical treatment position, and the tip end portion of the arrow indicates the point of the operator's line of sight. Thus, when the mark image 50 is an image showing the surgeon's line-of-sight direction, the surgeon can intuitively recognize the orientation of the tooth image on which the mark image 50 is superimposed.

In the window 45, the virtual endoscopic image 24 is displayed. The virtual endoscopic image 24 is a 3D image created by CG from the three-dimensional CT data 21. Here, two broken circles indicate root canals, respectively. According to this, even if the actual endoscope is not used for medical care, the display control means 13 uses the three-dimensional CT data 21 so that the internal structure of the tooth as if it was photographed by the endoscope. It can be presented as a stereoscopic image. The display control means 13 can display the virtual endoscopic image 24 side by side with the tooth X-ray image.

When the microscope 2 connected to the camera is used for medical care, a microscope image is displayed in the window 46. The display control means 13 can display the tooth microscope image acquired by the microscope 2 along with the tooth X-ray image.

FIG. 4 shows a screen display example in which the tooth images on which the mark images 50 are superimposed are simultaneously displayed. The tooth image on which the mark image 50 is superimposed in this way may be an image acquired by X-ray imaging or an image created from the three-dimensional CT data 21. Here, the image acquired by X-ray imaging includes the dental image 22, the panoramic image 23, and the CT tomographic image shown in FIG. The CT tomographic image includes a sagittal image, a coronal image, and an axial image. In addition, the image created from the three-dimensional CT data 21 includes a 3D image (three-dimensional image) of a tooth and a virtual endoscope image 24.

That is, the tooth image on which the mark image 50 is superimposed is a dental image 22, a panoramic image 23, a CT tomographic image, a 3D image created from the 3D CT data 21, and a virtual image created from the 3D CT data 21. It is preferable to include at least one selected from the group consisting of the endoscopic images 24.

Furthermore, the tooth image on which the mark image 50 is superimposed may be an image acquired by the microscope 2. That is, the mark image 50 may be superimposed on the microscope image. For example, when performing a root canal treatment while checking a CT image of a tooth, when using the microscope 2 to which a camera is connected, usually one tooth of the CT image of the tooth is enlarged and displayed with a high-magnification microscope image. Is displayed. In such a case, unlike an image seen with the naked eye, a microscope image with a high magnification reduces the field of view of the microscope by the amount of enlargement. For the surgeon observing the displayed microscope image, information is narrowed down because the field of view is narrow, so it is likely to cause confusion in the relatively large positional relationship such as the orientation of the patient's face and his / her medical position. Become. However, if the mark image 50 is superimposed on the microscope image, reading of the tooth image is supported. Thereby, even when the surgeon is performing an operation while observing a high-magnification microscope image, it is possible to prevent a reading error of a tooth image.

Next, the flow of processing by the image processing apparatus 1 will be described with reference to FIG. 5 (see FIG. 1 as appropriate). Here, an example of a tooth image is described as a CT cross-sectional image. First, the image processing apparatus 1 reads the three-dimensional CT data 21 by the display control means 13 according to the operation of the operator (step S1). Although the three-dimensional CT data 21 is read from the storage means 20 inside the image processing apparatus 1 by the display control means 13 here, the three-dimensional CT data 21 may be read from an external CT apparatus. .

Next, for example, when the operator designates a predetermined slice using the input unit 4, the image processing apparatus 1 causes the display control unit 13 to display a tooth image on the display unit 5 (step S2). Specifically, for example, the operator designates one tooth as a treatment target tooth (treatment tooth) from an axial image that lists all upper teeth and all lower teeth. An axial image is a cross-sectional image of a tooth in the horizontal direction. As for the coordinates indicating the position of the specified tooth, each coordinate can be matched between each tomographic image like between an axial image and a sagittal image. For example, the operator designates a desired tomographic position by the input unit 4 on the axial image. Accordingly, it is possible to display a sagittal image or coronal image corresponding to the designated tomographic position and designate a region of interest in the tomographic image.

Next, the detection means 3 outputs a signal indicating the operator's medical position to the image processing apparatus 1. Thereby, the image processing apparatus 1 sets the surgeon's medical position by the medical position setting means 12 (step S3). Then, the display unit 5 superimposes and displays the mark image 50 indicating the medical position on the X-ray image (step S4). In addition, when using the detection means 3 like this embodiment, the order of the step (step S3) which sets a medical treatment position is arbitrary.

Here, as the details of step S4, the relationship between the operator's medical position and the CT tomographic image of the patient's teeth will be described with reference to FIGS. 6 (a) to 6 (d).
FIG. 6A is a schematic diagram in the case where the medical treatment position of the operator D is 12:00 and the image of the axial cross section A (axial image) and the coronal image on the teeth of the patient P are referred to.
FIG. 6B is a schematic diagram in the case where the medical treatment position of the operator D is 9 o'clock and an image (sagittal image) of the sagittal section S in the tooth of the patient P is referred to.
FIG. 6C is a schematic diagram in the case where the medical treatment position of the operator D is 12:00 and the image of the sagittal section S (sagittal image) on the tooth of the patient P is referred to.
FIG. 6D is a schematic diagram in the case where the medical treatment position of the operator D is 9 o'clock and an image of the axial section A (axial image) and coronal image of the tooth of the patient P is referred to.

For example, when the X-ray image is an axial image or a coronal image and the surgeon D is at the 12 o'clock position (see FIG. 6A), the surgeon D naturally recognizes the X-ray image. be able to. However, when the surgeon D is at the 9 o'clock position (see FIG. 6D), caution is required in the conventional technique. On the other hand, in the present embodiment, the display control unit 13 causes the display unit 5 to superimpose the mark image 50 indicating the current medical position on the tooth image based on the set medical position 25 (see FIG. 1). Display. Thereby, the display means 5 superimposes and displays the mark image 50 which shows a medical treatment position on this X-ray image (an axial image or a coronal image).

On the other hand, for example, when the X-ray image is a sagittal image, when the operator D is at the 9 o'clock position (see FIG. 6B), the operator D recognizes the X-ray image naturally. Can do. However, when the surgeon D is at the 12 o'clock position as the medical position (see FIG. 6C), caution is required in the prior art. On the other hand, in the present embodiment, the display control unit 13 causes the display unit 5 to superimpose the mark image 50 indicating the current medical position on the tooth image based on the set medical position 25 (see FIG. 1). Display. Thereby, the display means 5 superimposes and displays the mark image 50 which shows a medical treatment position on this X-ray image (sagittal image).

In summary, in the case of FIGS. 6 (a) and 6 (b), the orientation of the image to be referred to during the treatment matches the orientation of the tooth actually observed during the treatment. Is less burdensome for image reading and reading errors are less likely to occur. On the other hand, in the case of FIG. 6C and FIG. 6D, the orientation of the image referred to during the treatment and the orientation of the tooth actually observed during the treatment do not coincide with each other. It is easy to feel a burden in reading the image, and a reading mistake is likely to occur. According to this embodiment, especially in the case of FIG. 6C and FIG. 6D, the effect of preventing the reading error of the tooth image is great.

For example, when only one image similar to the tooth image displayed in the window 43 in FIG. 4 is displayed on the screen, the tooth root appears to be bent to the right on the image. If there is no information such as a mark image, the patient's treatment tooth root tends to be bent to the right, but this image may be an image indicating that this image is bent to the front or back. . In such a case, there is a possibility that the root canal is damaged due to a misunderstanding, for example, when a therapeutic device such as a file is stuck in an unexpected direction. However, according to the present embodiment, reading the tooth image is supported by displaying the mark image 50 superimposed on the tooth image. Therefore, an operator who performs treatment while checking the tooth image can reduce the burden of reading the tooth image and improve the success rate of the treatment.

The present invention is not limited to the above-described embodiment, and various modifications can be made. Moreover, you may deform | transform as follows. For example, it can be realized by operating a general computer with an image processing program that functions as an image processing apparatus. This program can be provided via a communication line, or can be written on a recording medium such as a CD-ROM and distributed.

According to the present embodiment, when a single operator always performs treatment at a predetermined medical location in a dental clinic, the reading load is reduced, for example, for example, setting of the medical location of each of a plurality of surgeons. It doesn't matter. In this case, the medical treatment position 25 (see FIG. 1), which is the processing result of the processing means 10, is information in which, for example, information for identifying the surgeon and the medical treatment position of the surgeon are associated with each other. Here, the information for identifying the surgeon may be information that can identify an individual such as a name. In the operation mode before treatment in the image processing apparatus 1, the surgeon inputs information for identifying the surgeon. Thereby, once the medical treatment position 25 for each operator is registered, the mark image 50 can be displayed at a position corresponding to each medical treatment position following the change of the operator.

Similarly, the medical position 25 (see FIG. 1), which is the processing result of the processing means 10, may be information that associates information for identifying the patient with the medical position of the surgeon, for example. Here, the information for identifying a patient may be, for example, information for distinguishing an adult from a child, sex information, or a patient name. In the operation mode before treatment in the image processing apparatus 1, the surgeon inputs information for identifying a patient. Thereby, once the medical treatment position 25 for each patient is registered, the mark image 50 can be displayed at a position corresponding to the medical treatment position of the operator so as to correspond to each of a plurality of patients.

Similarly, the medical position 25 (see FIG. 1), which is the processing result of the processing means 10, may be information that associates information for identifying the treatment type with the medical position of the surgeon, for example. Here, the information for identifying the treatment type may be, for example, information such as the type of treatment method, the type of treatment stage, the position of the treatment tooth, the type of treatment instrument, and the presence / absence of the use of a microscope. Further, in the operation mode before treatment in the image processing apparatus 1, the surgeon inputs information for identifying the treatment type. Thereby, once the medical treatment position 25 for each treatment type is registered, the mark image 50 can be displayed at a position corresponding to the medical treatment position of the operator so as to correspond to each of the plurality of treatment types.

That is, it is preferable that the medical care position setting unit 12 sets the medical care position in association with at least one of an operator, a patient, and a treatment type.

In the above-described embodiment, with reference to FIG. 4, the arrow-shaped mark image 50 has been described in the example of the screen displayed when the surgeon's medical position is the second position at 9 o'clock. The present invention is not limited to this. When the surgeon's medical position is the 12:00 position which is the first position, the arrow-shaped mark image 50 is displayed in the orientation shown in FIG. Further, FIG. 8 shows a modification of the screen display example of FIG. In the case of the 12 o'clock position, the orientation of the image (coronal image) displayed in the window 42 is the same as the orientation of the patient that the operator is viewing in front. Therefore, the surgeon's line-of-sight direction may be represented by a white arrow shown in FIG. 7, or for example, a mark other than the arrow may be used (see FIG. 8). In FIG. 8, a cross sign 51 as if the screw is viewed from the base end side of the window 42 indicates that the operator's line of sight is a front view. When the surgeon's line of sight indicates that it is opposite to the direction of the X-ray image, it can also be indicated by a dot symbol 52 as if the screw was viewed from the tip side. The cross symbol 51 and the dot symbol 52 are not displayed for one image at a time. Further, for the 3D image displayed in the window 44, when the operator's line of sight is a front view, the surgeon's line of sight may be represented by an upward white arrow as shown in FIG. For example, a 3D arrow 53 may be used (see FIG. 8). According to the 3D arrow 53, it is easier to understand that the operator is viewing the front more intuitively than the upward white arrow.

In the above embodiment, the X-ray image has been described with the screen examples displayed in FIGS. 4 and 7, but the displayed X-ray image is not limited to one tooth. For example, it may be 2 to 3 teeth, or the entire dentition of the upper jaw or the lower jaw. In the X-ray image window 47 shown in FIGS. 9A and 9B, an axial image of the maxillary dentition is displayed. FIG. 9A is an example of a screen displayed when the surgeon's medical position is the second position at 9 o'clock. An arrow-shaped mark image 50 shows the surgeon's line-of-sight direction. The inside is facing left. FIG. 9B is an example of a screen that is displayed when the surgeon's medical position is the first position at 12:00. The arrow-shaped mark image 50 shows the surgeon's line-of-sight direction. The inside is upward. Further, the X-ray image on which the mark image is superimposed and the plurality of teeth are displayed is not limited to the axial image, and may be a coronal image or a sagittal image, for example. Furthermore, it is an image which superimposes a mark image, Comprising: The image of several teeth and dentition is not restricted to a cross-sectional image, A 3D image and CG image may be sufficient.

The display means 5 has been described as being a liquid crystal display, for example, but may be a head mounted display. The head-mounted display 71 shown in FIG. 10 is of a transmissive type (see-through) used by the operator D who is an operator as wearing glasses. As the head mounted display 71, for example, so-called optical see-through glass may be employed. Thereby, the operator can recognize the X-ray image etc. which were displayed on the small screen arrange | positioned at glass, looking at the external field (patient) through the glass which permeate | transmits light. Thus, by realizing the display means 5 with the head mounted display 71, it is possible to save time and effort for reciprocating between the patient position and the stationary monitor device.

When the head-mounted display is a transmission type, a so-called video transmission (video see-through) type device may be employed in addition to the optical see-through glass. The video see-through type device includes a camera that captures the outside world in front of the user's eyes, and projects the outside state through the camera on a screen (see-through screen) that the user wearing this device observes. The outside appearance projected on the see-through screen through the camera corresponds to the view seen when the user does not wear the head mounted display. This apparatus can synthesize and display a patient in a real environment in front of the user's eyes and an X-ray image or the like that shows the imaging position of the endoscope. The projection system of the head mounted display may be retinal projection in addition to virtual image projection.

The head mounted display may be a non-transmissive type, for example, so-called VR (Virtual Reality) goggles may be used. The VR goggles allow a user wearing this apparatus to experience VR, AR (Augmented Reality), or MR (Mixed Reality). The VR goggles may be of a type in which a mobile with a camera such as a smartphone is mounted, in addition to a type that includes a camera for photographing the outside world in advance. The VR goggles camera can project the outside view through the camera on the display that the user wearing it observes. According to this, the information acquired from the VR goggles camera and the X-ray image showing the treatment position of the surgeon can be displayed together.
Note that the user wearing the head mounted display may be a dental hygienist, a dental assistant, or the like in addition to a dentist.

In the above embodiment, a general human sensor or camera is exemplified as the detection means 3, but a tactile sensor, a pressure sensor, a vibration sensor, a magnetic sensor, or the like can also be used.

The detection means 3 is not essential, and in this case, the medical care position setting means 12 may set the medical care position by receiving, for example, the input of the first position or the second position from the input means 4. That is, it is possible to manually set the medical position. In this case, in the flowchart of FIG. 5, following the step S <b> 2, for example, when a sagittal image of the treatment tooth is displayed, the operator designates the operator's medical position by the input means 4. Thereby, the image processing apparatus 1 receives the input of the medical position in the sagittal image of the treatment tooth by the medical position setting means 12 (step S3). At this time, the operator may set the medical position by performing an operation of clicking an icon (not shown) corresponding to the medical position on the image with a mouse or the like.

Further, when a head-mounted display capable of automatically detecting the wearer's line-of-sight direction is adopted as the display means 5, the head-mounted display (display means 5) can also be used as the detection means 3. Therefore, for example, using a head-mounted display capable of detecting the gaze direction as a modification of the form of inputting the medical position without arranging the detection means 3 such as a sensor in the medical room, the manual input is troublesome. From the viewpoint that it can be omitted, it is preferable for the operator.

DESCRIPTION OF SYMBOLS 1 Image processing apparatus 2 Microscope 3 Detection means 4 Input means 5 Display means 10 Processing means 11 Microscope image input means 12 Medical treatment position setting means 13 Display control means 20 Storage means 50 Mark image 71 Head mounted display

Claims (12)

A medical position setting means for setting the medical position of the surgeon;
An image processing apparatus comprising: a display control unit configured to display a tooth image on a display unit and to display a mark image indicating the medical treatment position on the display unit so as to be superimposed on the tooth image. 2. The medical position setting means sets one of a first position indicating a patient's parietal side and a second position indicating a patient's cheek side as the medical position. The image processing apparatus described. The image processing apparatus according to claim 1, wherein the mark image indicating the medical position is an image indicating a gaze direction of the surgeon. The image processing apparatus according to any one of claims 1 to 3, wherein the medical position setting unit sets the medical position by receiving an input from an operator. 4. The image processing apparatus according to claim 1, wherein the medical position setting unit sets the medical position by acquiring a detection signal from a detection unit that detects a medical position of the surgeon. The image processing apparatus according to claim 5, wherein the detection means is a camera. The image processing apparatus according to claim 5, wherein the detection means is a sensor. 4. The image processing apparatus according to claim 1, wherein the medical position setting means sets the medical position in association with at least one of an operator, a patient, and a treatment type. The dental image includes at least one selected from the group consisting of a dental image, a panoramic image, a CT tomographic image, a 3D image created from X-ray CT data, and a CG image acquired by X-ray imaging. The image processing apparatus according to any one of claims 1 to 8. The image processing apparatus according to any one of claims 1 to 9, wherein the image of the tooth includes an image acquired by a microscope. The image processing apparatus according to any one of claims 1 to 10, wherein the display unit is a head mounted display. An image processing program for causing a computer to function as the image processing apparatus according to any one of claims 1 to 11.

Images