WO2025197506A1 - Display device and display control method - Google Patents

Abstract

The present technology relates to a display device and a display control method that make it possible to display an image having suitable image quality corresponding to an application in a medical facility. A display device according to one aspect of the present technology comprises a display unit that displays a screen image including input video from the outside including surgical video, and a detection unit that detects ambient brightness. In the display device, a display mode corresponding to at least one of a medical department and an operation formula using the display device is set, and the image quality of the screen image displayed by the display unit is adjusted in accordance with the display mode and the ambient brightness. The present technology can be applied to medical monitors.

Description

Display device and display control method

This technology relates to a display device and a display control method, and in particular to a display device and a display control method that enable the display of images with image quality appropriate for the intended use in a medical facility.

Medical displays installed in operating rooms and other settings are required to display images of the surgical field that are easy for surgeons to see. There are a variety of displays on the market that are equipped with ambient light sensors and have the ability to automatically adjust the brightness of the image.

Japanese Patent Application Publication No. 5-165450 Japanese Patent Application Publication No. 6-348245

The required image characteristics vary depending on the medical department and surgical procedure. Images adjusted in the same way using the detection results of an ambient light sensor cannot meet each individual requirement.

This technology was developed in light of these circumstances, enabling medical facilities to display images with the appropriate image quality for their intended use.

A display device according to one aspect of the present technology includes a display unit that displays a screen containing externally input images, including surgical images; a detection unit that detects the ambient brightness; and an information processing unit that sets a display mode according to at least one of the medical department and surgical procedure that will be using the display device, and adjusts the image quality of the screen displayed by the display unit according to the display mode and the ambient brightness.

In one aspect of this technology, a display mode is set according to at least one of the medical department and surgical procedure using the display device, and the image quality of the screen displayed by the display unit is adjusted according to the display mode and the ambient brightness.

FIG. 1 is a block diagram illustrating a configuration example of a medical monitor according to an embodiment of the present technology. 10 is a flowchart illustrating a brightness and color tone adjustment process. FIG. 10 is a diagram showing an example of a display of a department selection screen. FIG. 1 is a diagram illustrating an example of a schematic configuration of an endoscope system. FIG. 5 is a block diagram showing an example of the functional configuration of the camera and the CCU shown in FIG. 4 . FIG. 1 is a diagram illustrating an example of a schematic configuration of a microsurgery system.

Hereinafter, embodiments of the present technology will be described in the following order.
1. Example of medical monitor configuration 2. Operation of medical monitor 3. Modifications 4. Application examples

<<Example of medical monitor configuration>>
FIG. 1 is a block diagram showing an example configuration of a medical monitor according to an embodiment of the present technology.

Medical monitor 1 is a medical display device installed in rooms in medical facilities, such as operating rooms and examination rooms. Doctors and medical staff are users of medical monitor 1. Video signals captured by a camera are input to medical monitor 1, and the input video is displayed. The input video displayed includes surgical video such as video of the surgical field captured by an endoscopic camera, video of the surgical field captured by a surgical field camera installed above the operating table, and video of the operating room captured by a camera installed in the operating room. In addition to video, still images of surgical video are also displayed on medical monitor 1 as appropriate.

As will be described in more detail later, the medical monitor 1 is equipped with a function that automatically adjusts the image quality of the screen in response to factors such as the ambient brightness. The image quality adjusted by the medical monitor 1 includes brightness and color tone. For example, brightness is adjusted by adjusting the brightness of the backlight provided on the display of the medical monitor 1. Color tone is adjusted by signal processing using an LUT (Look-Up Table) or similar. Automatic adjustment of brightness and color tone is also performed in response to the clinical department and surgical procedure in which the medical monitor 1 is used.

The medical monitor 1 is composed of a display unit 11, a control unit 12, an optical input unit 13, an information processing unit 14, an external input unit 15, an operation input unit 16, and a memory unit 17.

The display unit 11 is composed of a display device such as an LCD. The display unit 11 displays various screens, including screens containing surgical images. The display unit 11 may also be composed of an organic EL display.

The control unit 12 is composed of a drive circuit that controls the driving of the backlight of the display unit 11, a drive circuit that controls the driving of the liquid crystal panel of the display unit 11, and the like. The control unit 12 adjusts the brightness of the backlight of the display unit 11 in accordance with control by the information processing unit 14. The control unit 12 also drives the liquid crystal panel of the display unit 11 based on the video signal supplied from the information processing unit 14, and controls the screen display of the display unit 11.

The optical input unit 13 is a sensor device that functions as a detector that detects the brightness around the medical monitor 1. The optical input unit 13 is provided in a predetermined position, such as on the top of the housing of the medical monitor 1. The optical input unit 13 is provided with an ambient light sensor unit 13A and a filter unit 13B.

The ambient light sensor unit 13A is composed of, for example, multiple illuminance sensors with different characteristics. By switching the illuminance sensor used to detect brightness, the range (wavelength band) of ambient light to be detected can be switched. In addition to sensors that support the normal range, it is possible to realize, for example, dark-specialized sensors that have improved detection accuracy in dark ranges.

Filter unit 13B is a filter that adjusts the range of ambient light that enters ambient light sensor unit 13A. By switching the filter, the range of ambient light that enters ambient light sensor unit 13A is adjusted. Filter unit 13B enables the range of ambient light that enters ambient light sensor unit 13A to be widened or narrowed to a dark range.

In this way, the optical input unit 13 is an ambient light sensor that can change the range of ambient light that it detects. The characteristics of the optical input unit 13 are controlled by the information processing unit 14. The ambient light sensor value, which indicates the ambient brightness, is output to the information processing unit 14 as the detection result of the optical input unit 13.

The information processing unit 14 is composed of a microprocessor. The information processing unit 14 executes a predetermined program and controls the overall operation of the medical monitor 1. By executing the predetermined program, the information processing unit 14 realizes a mode setting unit 14A, a sensor adjustment unit 14B, and a brightness/color adjustment unit 14C.

The mode setting unit 14A controls the control unit 12 to display a selection screen for the medical department and surgical procedure on the display unit 11. The selection of the medical department and surgical procedure is made at a predetermined timing, such as before the start of surgery. The mode setting unit 14A sets the display mode according to the medical department and surgical procedure selected by the user. As the display mode for images on the medical monitor 1, multiple display modes are prepared according to combinations of medical departments and surgical procedures.

The mode setting unit 14A reads and acquires mode information, which is information relating to the set display mode, from the storage unit 17. The mode information indicates the adjustment details of the optical input unit 13 and the adjustment details of the screen brightness and color tone.

The sensor adjustment unit 14B references the mode information and adjusts the detection characteristics of the optical input unit 13 according to the display mode.

The brightness and color tone adjustment unit 14C refers to the mode information and adjusts the brightness and color tone of the screen according to the display mode and the ambient brightness. In other words, the brightness and color tone adjustment unit 14C controls the control unit 12 to adjust the brightness of the backlight of the display unit 11. The brightness and color tone adjustment unit 14C also adjusts the content of the signal processing used to adjust the color tone. Color tone adjustment includes adjustment of at least one of the following: hue, lightness, saturation, and edge emphasis.

For example, the brightness and color tone adjustment unit 14C sets the brightness and color tone adjustment details in accordance with the display mode. After setting the adjustment details, the brightness and color tone adjustment unit 14C adjusts the brightness and color tone of the screen according to the ambient brightness represented by the ambient light sensor value. Ambient light is detected at a predetermined timing, for example, after the start of surgery, and the ambient light sensor value is supplied from the optical input unit 13. Basically, when the surroundings become dark, the brightness is lowered and the color tone is adjusted accordingly, thereby adjusting the brightness and color tone. Also, when the surroundings become brighter, the brightness is raised and the color tone is adjusted accordingly, thereby adjusting the brightness and color tone.

Furthermore, the brightness and color tone adjustment unit 14C adjusts the brightness and color tone according to the display mode, and then adjusts the brightness and color tone of the screen according to the input video information. The input video information is information that indicates the type of video to be displayed. The input video information, along with the video signal of the surgical video to be displayed on the display unit 11, is transmitted from an external device that serves as the source, and is received by the external input unit 15. The input video information received by the external input unit 15 is supplied to and acquired by the information processing unit 14.

In this way, the ambient light sensor value and input video information are used as control parameters for brightness and color tone. The ambient light sensor value, which is repeatedly acquired during surgery, becomes a control parameter that indicates changes in the surrounding brightness during surgery. Furthermore, the input video information, which is repeatedly acquired during surgery, becomes a control parameter that indicates changes in the image during surgery.

The external input unit 15 receives video signals input from an external device and outputs them to the information processing unit 14. Video signals captured by various cameras, such as an endoscopic camera or surgical field camera, are input to the external input unit 15.

The operation input unit 16 is composed of buttons provided on the housing of the medical monitor 1 and a touch panel provided over the display unit 11. The operation input unit 16 detects user operations and outputs information indicating the content of the operation to the information processing unit 14. The medical monitor 1 may be operated using a remote controller, or may be operated using a device capable of communicating with the medical monitor 1.

The storage unit 17 is a memory configured using a flash memory or the like. The storage unit 17 stores various information such as programs executed by the information processing unit 14 and mode information.

<<Operation of medical monitor>>
The brightness and color tone adjustment process of the medical monitor 1 will be described with reference to the flowchart of Fig. 2. The process of Fig. 2 is started, for example, before the start of surgery.

In step S1, the mode setting unit 14A of the information processing unit 14 displays a department selection screen on the display unit 11.

Figure 3 shows an example of the department selection screen.

In the example in Figure 3, a message prompting the user to select a medical specialty is displayed, and below the message are buttons that can be operated to select general surgery, neurosurgery, ophthalmology, internal medicine, dentistry, and other. The user can operate one of the buttons to select the desired medical specialty.

After the medical department is selected, in step S2 of FIG. 2, the mode setting unit 14A displays a surgical procedure selection screen on the display unit 11. Here, for example, a different selection screen is displayed for each selected medical department. In this example, selectable surgical procedures are provided for each medical department.

In step S3, the mode setting unit 14A sets the display mode according to the combination of medical department and surgical procedure selected by the user. For example, the following display modes are available:

General incision surgery mode General incision surgery mode is set when general incision surgery is selected as the surgical procedure. The general incision surgery procedure can be selected regardless of the medical department selected. General incision surgery mode is a display mode that adjusts brightness and color tone according to the ambient brightness represented by the ambient light sensor value, and does not adjust brightness and color tone according to the input video information.

Brain surgery mode The brain surgery mode is set when brain surgery is selected as the surgical procedure. Brain surgery includes cerebral vascular resection, brain tumor removal, cerebral aneurysm resection, etc. Brain surgery procedures can be selected when brain surgery is selected.

In brain surgery mode, the characteristics of the optical input unit 13 are adjusted to narrow the detection range to a dark range by using a dark-specializing sensor and a dark filter. The brightness and color tone are adjusted according to the ambient brightness represented by the ambient light sensor value, and according to the input video information, so that the contrast between red and gray-white is clear and whiteout is not present.

Ophthalmic Surgery Mode The ophthalmic surgery mode is set when ophthalmic surgery is selected as the surgical procedure. Ophthalmic surgery includes surgeries such as cataracts, glaucoma, and retinal detachment. Ophthalmic surgery procedures can be selected when ophthalmology is selected.

In ophthalmic surgery mode, the characteristics of the optical input unit 13 are adjusted to narrow the detection range to a dark range by using a dark-specializing sensor and a dark filter. The brightness and color tone are adjusted according to the ambient brightness represented by the ambient light sensor value, and according to the input video information, so that the contrast between black and white is clear and white blowout is avoided.

Rigid endoscopic surgery mode The rigid endoscopic surgery mode is set when rigid endoscopic surgery is selected as the surgical procedure. Rigid endoscopic surgery includes laparoscopic surgery. The rigid endoscopic surgery procedure can be selected when general surgery or internal medicine is selected.

In rigid endoscopic surgery mode, the characteristics of the optical input unit 13 are adjusted to widen the detection range. The brightness and color tone are adjusted in accordance with the ambient brightness represented by the ambient light sensor value by lowering the brightness as the surroundings become darker and emphasizing the color of the fluorescent material. The brightness and color tone are adjusted in accordance with the input video information by making red more vivid as the surroundings become brighter and emphasizing the color of the fluorescent material as the surroundings become darker.

- Flexible endoscopic resection mode, flexible endoscopic observation mode Flexible endoscopic resection mode is set when flexible endoscopic resection is selected as the surgical procedure. Flexible endoscopic resection includes polypectomy and mucosal resection. Furthermore, flexible endoscopic observation mode is set when flexible endoscopic observation is selected as the surgical procedure. Flexible endoscopic observation includes observation using a gastroscope, colonoscope, and small intestine camera. Flexible endoscopic resection and flexible endoscopic observation can be selected when internal medicine is selected.

The flexible endoscopic resection mode and flexible endoscopic observation mode are display modes that do not adjust brightness and color tone according to the ambient brightness represented by the ambient light sensor value. Brightness and color tone adjustment according to the input video information is performed so as to emphasize the fluorescent color of the target tissue when special light is used.

Dental surgery mode, dental observation mode Dental surgery mode is set when dental surgery is selected as the procedure. Dental surgery includes tooth extraction and implant surgery. Dental observation mode is set when dental observation is selected as the procedure. Dental surgery and dental observation can be selected when dentistry is selected.

Dental surgery mode and dental observation mode are display modes that do not adjust brightness and color tone according to the ambient brightness represented by the ambient light sensor value. Brightness and color tone adjustment according to the input video information is performed by emphasizing red and white.

Returning to the explanation of Figure 2, in step S4, the sensor adjustment unit 14B adjusts the detection characteristics (sensor characteristics) of the optical input unit 13 according to the display mode. As mentioned above, depending on the display mode, adjustment of the sensor characteristics and adjustment of the screen brightness and color tone may not be performed.

In step S5, the brightness and color tone adjustment unit 14C sets the brightness and color tone adjustment content according to the display mode. For example, after the adjustment content according to the display mode is set, surgery begins.

In step S6, the ambient light sensor unit 13A detects the ambient brightness.

In step S7, the external input unit 15 receives input video information.

In step S8, the brightness and color tone adjustment unit 14C adjusts the brightness and color tone of the screen. The brightness and color tone of the screen are adjusted appropriately based on the display mode, ambient light sensor value, and input video information.

In step S9, the information processing unit 14 determines whether the surgery has ended. If it is determined in step S9 that the surgery has not ended, the process returns to step S6, and the subsequent processing is repeated. The brightness and color tone are repeatedly adjusted based on the ambient brightness detected at predetermined times during the surgery.

If it is determined in step S9 that the surgery has ended, the brightness and color adjustment process in Figure 2 ends.

As described above, the medical monitor 1 is equipped with display modes that accommodate a variety of uses in medical facilities. By providing display modes that correspond to different medical departments and surgical procedures, it is possible to adjust the brightness and color tone to suit the surgical environment. For example, ophthalmological surgery is performed in a dark operating room. By using a dark-specific sensor or dark-specific filter to increase the resolution in a dark environment, the surgeon can perform surgery in a more suitable environment.

In addition, brightness and color tone are adjusted in accordance with changes in brightness during surgery, allowing surgeons to perform surgery in a constantly appropriate environment. This reduces surgeon eye fatigue, improves the visibility of displayed content, and enables displays that do not interfere with surgery.

<<Modifications>>
<Automatic display mode setting>
Although the display mode is set based on the medical department and surgical procedure selected by the user, the display mode may be set automatically without user operation.

Example of setting by a central control system If the environment in which the medical monitor 1 is installed is an environment in which each device is set by a central control system, the display mode is automatically set according to the control of the central control system. In this case, the information processing unit 14 receives information on the setting contents of the display mode transmitted from the central control system, and sets the display mode based on the received information.

Example of setting using patient information or surgery information When patient information or surgery information is input from an external device, the display mode is automatically set based on the patient information or surgery information. In this case, the information processing unit 14 receives at least one of the patient information and surgery information transmitted from the external device and sets the display mode based on the received information. The patient information includes information about symptoms. The surgery information includes information about the details of the surgery.

Example of setting using location information When location information indicating the location (room) where the medical monitor 1 is installed is input from an external device, the display mode is automatically set based on the location information. In this case, the information processing unit 14 receives the location information transmitted from the external device and sets the display mode based on the received information.

Example of setting using input video information: The display mode is automatically set based on the input video information input from the device that is the source of the surgical video. In this case, the information processing unit 14 receives the input video information transmitted from the device that is the source of the surgical field video, and sets the display mode based on the received information.

By automatically setting the display mode, it is possible to eliminate the need to select a medical department or surgical procedure.

<Others>
Although the display mode is set according to the combination of the medical department and the surgical procedure, it is also possible to have only the medical department selected and the display mode set according to the selected medical department. Alternatively, it is also possible to have only the surgical procedure selected and the display mode set according to the selected surgical procedure. It is possible to have the display mode set based on at least one of the medical department and the surgical procedure. In this case, a selection screen for at least one of the medical department and the surgical procedure is displayed.

Although the above description deals with the case where brightness and color tone are adjusted as the image quality of the screen, various adjustments relating to image quality other than brightness and color tone may also be performed. Image quality adjustment parameters include, for example, the following:
・Color temperature ・Gamma ・Sharpness ・Contrast

The embodiments of this technology are not limited to the above-described embodiments, and various modifications are possible without departing from the spirit of this technology.

<<Application Examples>>
The technology disclosed herein can be applied to a medical imaging system, which is a medical system that uses imaging technology, such as an endoscope system or a microscope system.

[Endoscope system]
An example of an endoscopic system will be described with reference to FIGS. 4 and 5 . FIG. 4 is a diagram illustrating an example of the schematic configuration of an endoscopic system 5000 to which the technology according to the present disclosure can be applied. FIG. 5 is a diagram illustrating an example of the configuration of an endoscope 5001 and a CCU (Camera Control Unit) 5039. FIG. 4 illustrates a state in which an operator (e.g., a doctor) 5067, who is a surgical participant, is performing surgery on a patient 5071 on a patient bed 5069 using the endoscopic system 5000. As shown in FIG. 4 , the endoscopic system 5000 includes an endoscope 5001, which is a medical imaging device, a CCU 5039, a light source device 5043, a recording device 5053, an output device 5055, and a support device 5027 that supports the endoscope 5001.

In endoscopic surgery, an insertion aid called a trocar 5025 is inserted into the patient 5071. Then, a scope 5003 and surgical tools 5021 connected to an endoscope 5001 are inserted into the body of the patient 5071 via the trocar 5025. The surgical tools 5021 are, for example, energy devices such as electric scalpels, or forceps.

Surgical images, which are medical images showing the inside of the body of a patient 5071 captured by an endoscope 5001, are displayed on a display device 5041. A surgeon 5067 performs treatment on the surgical subject using surgical tools 5021 while viewing the surgical images displayed on the display device 5041. Note that medical images are not limited to surgical images, and may also be diagnostic images captured during a diagnosis.

[Endoscope]
The endoscope 5001 is an imaging unit that captures images of the inside of the patient's 5071. For example, as shown in FIG. 5 , the endoscope 5001 is a camera 5005 that includes a focusing optical system 50051 that focuses incident light, a zoom optical system 50052 that changes the focal length of the imaging unit to enable optical zoom, a focus optical system 50053 that changes the focal length of the imaging unit to enable focus adjustment, and a light-receiving element 50054. The endoscope 5001 generates pixel signals by focusing light onto the light-receiving element 50054 via a connected scope 5003, and outputs the pixel signals to the CCU 5039 via a transmission system. The scope 5003 has an objective lens at its tip and is an insertion section that guides light from a connected light source device 5043 into the inside of the patient's 5071. The scope 5003 is, for example, a rigid scope for rigid endoscopes or a flexible scope for flexible endoscopes. The scope 5003 may be a direct endoscope or an oblique endoscope. Furthermore, the pixel signal may be a signal based on a signal output from a pixel, such as a RAW signal or an image signal. Furthermore, a configuration may be adopted in which a memory is installed in the transmission system connecting the endoscope 5001 and the CCU 5039, and parameters related to the endoscope 5001 and the CCU 5039 are stored in the memory. The memory may be located, for example, in a connection portion of the transmission system or on a cable. For example, parameters at the time of shipment of the endoscope 5001 and parameters that change when power is applied may be stored in the memory of the transmission system, and the operation of the endoscope may be changed based on parameters read from the memory. Furthermore, the endoscope and the transmission system may be collectively referred to as an endoscope. The light-receiving element 50054 is a sensor that converts received light into a pixel signal, and is, for example, a CMOS (Complementary Metal Oxide Semiconductor) type image sensor. It is preferable that the light-receiving element 50054 be an image sensor capable of color imaging with a Bayer array. Furthermore, the light receiving element 50054 is preferably an imaging element having a number of pixels corresponding to a resolution of, for example, 4K (3840 horizontal pixels × 2160 vertical pixels), 8K (7680 horizontal pixels × 4320 vertical pixels), or square 4K (3840 or more horizontal pixels × 3840 or more vertical pixels). The light receiving element 50054 may be a single sensor chip or multiple sensor chips. For example, a prism may be provided to separate incident light into predetermined wavelength bands, and each wavelength band may be captured by a different light receiving element. Multiple light receiving elements may also be provided for stereoscopic vision. The light receiving element 50054 may also be a sensor including an arithmetic processing circuit for image processing within its chip structure, or a Time of Flight (ToF) sensor. The transmission system may be, for example, an optical fiber cable or wireless transmission. The wireless transmission may be any method as long as it is capable of transmitting pixel signals generated by the endoscope 5001. For example, the endoscope 5001 and the CCU 5039 may be connected wirelessly, or the endoscope 5001 and the CCU 5039 may be connected via a base station in the operating room. In this case, the endoscope 5001 may simultaneously transmit not only the pixel signals but also information related to the pixel signals (for example, the processing priority of the pixel signals, a synchronization signal, etc.). Note that the endoscope may be configured such that the scope and camera are integrated, or a light-receiving element is provided at the tip of the scope.

[CCU (Camera Control Unit)]
The CCU 5039 is a control device that comprehensively controls the connected endoscope 5001 and light source device 5043, and is, for example, an information processing device having an FPGA 50391, a CPU 50392, a RAM 50393, a ROM 50394, a GPU 50395, and an I/F 50396, as shown in FIG. 5 . The CCU 5039 may also comprehensively control the connected display device 5041, recording device 5053, and output device 5055. For example, the CCU 5039 controls the irradiation timing, irradiation intensity, and type of irradiation light source of the light source device 5043. The CCU 5039 also performs image processing such as development processing (e.g., demosaic processing) and correction processing on pixel signals output from the endoscope 5001, and outputs the processed pixel signals (e.g., an image) to an external device such as the display device 5041. Furthermore, the CCU 5039 transmits a control signal to the endoscope 5001 to control the driving of the endoscope 5001. The control signal is, for example, information regarding imaging conditions such as the magnification and focal length of the imaging unit. The CCU 5039 may have an image down-conversion function and be configured to be able to simultaneously output a high-resolution (e.g., 4K) image to the display device 5041 and a low-resolution (e.g., HD) image to the recording device 5053.

The CCU 5039 may also be connected to external devices (e.g., recording devices, display devices, output devices, support devices) via an IP converter that converts signals into a specified communication protocol (e.g., IP (Internet Protocol)). The connection between the IP converter and external devices may be configured as a wired network, or part or all of the network may be constructed as a wireless network. For example, the IP converter on the CCU 5039 side may have wireless communication capabilities, and may transmit received video to an IP switcher or output-side IP converter via a wireless communication network such as a fifth-generation mobile communication system (5G) or sixth-generation mobile communication system (6G).

[Light source device]
The light source device 5043 is a device capable of emitting light in a predetermined wavelength band and includes, for example, multiple light sources and a light source optical system that guides the light from the multiple light sources. The light sources are, for example, a xenon lamp, an LED light source, or an LD light source. The light source device 5043 has, for example, LED light sources corresponding to the three primary colors R, G, and B, and emits white light by controlling the output intensity and output timing of each light source. Furthermore, the light source device 5043 may include a light source capable of emitting special light used for special light observation, in addition to a light source that emits normal light used for normal light observation. The special light is light in a predetermined wavelength band different from the normal light used for normal light observation, such as near-infrared light (light with a wavelength of 760 nm or more), infrared light, blue light, or ultraviolet light. The normal light is, for example, white light or green light. Narrowband light observation, a type of special light observation, alternately emits blue light and green light, thereby utilizing the wavelength-dependence of light absorption in body tissue to enable high-contrast imaging of specific tissue, such as blood vessels on the surface of mucous membranes. Furthermore, in fluorescence observation, a type of special light observation, excitation light is applied to excite a drug injected into the body tissue, and fluorescence emitted by the drug as a marker is received to obtain a fluorescence image, thereby making it easier for the surgeon to visualize body tissues that are difficult for the surgeon to see under normal light. For example, in fluorescence observation using infrared light, infrared light having an excitation wavelength band is applied to a drug such as indocyanine green (ICG) injected into the body tissue, and the fluorescence of the drug is received, making it easier to visualize the structure of the body tissue and affected areas. Furthermore, in fluorescence observation, a drug (e.g., 5-ALA) that is excited by special light in the blue wavelength band and emits fluorescence in the red wavelength band may be used. The type of light irradiated by the light source device 5043 is set under the control of the CCU 5039. The CCU 5039 may have a mode in which normal light observation and special light observation are alternately performed by controlling the light source device 5043 and the endoscope 5001. In this case, it is preferable to superimpose information based on pixel signals obtained by special light observation on pixel signals obtained by normal light observation. The special light observation may be infrared light observation, which irradiates infrared light to view areas deeper than the surface of an organ, or multispectral observation using hyperspectral spectroscopy. Furthermore, photodynamic therapy may be combined.

[Recording device]
The recording device 5053 is a device, such as a recorder, that records pixel signals (e.g., images) acquired from the CCU 5039. The recording device 5053 records images acquired from the CCU 5039 on a HDD, SSD, or optical disk. The recording device 5053 may be connected to an intra-hospital network and may be accessible from devices outside the operating room. The recording device 5053 may also have an image down-conversion or up-conversion function.

[Display device]
The display device 5041 is a device capable of displaying an image, such as a display monitor. The display device 5041 displays an image based on pixel signals acquired from the CCU 5039. The display device 5041 may also function as an input device that enables gaze recognition, voice recognition, and instruction input using gestures by including a camera and a microphone.

[Output device]
The output device 5055 is a device, such as a printer, that outputs information acquired from the CCU 5039. The output device 5055 prints, for example, a print image based on pixel signals acquired from the CCU 5039 onto paper.

[Support device]
The support device 5027 is an articulated arm including a base 5029 having an arm control device 5045, an arm 5031 extending from the base 5029, and a holder 5032 attached to the tip of the arm 5031. The arm control device 5045 is configured with a processor such as a CPU and controls the drive of the arm 5031 by operating according to a predetermined program. The support device 5027 controls the position and posture of the endoscope 5001 held by the holder 5032, for example, by controlling parameters such as the length of each link 5035 constituting the arm 5031 and the rotation angle and torque of each joint 5033 using the arm control device 5045. This allows the endoscope 5001 to be changed to a desired position or posture, allowing the scope 5003 to be inserted into the patient 5071 and the observation area within the body to be changed. The support device 5027 functions as an endoscope support arm that supports the endoscope 5001 during surgery. This allows the support device 5027 to take the place of an assistant scopist who holds the endoscope 5001. The support device 5027 may also be a device that supports a microscope device 5301 (described later) and may also be called a medical support arm. The support device 5027 may be controlled autonomously by the arm control device 5045, or may be controlled by the arm control device 5045 based on user input. For example, the control method may be a master-slave method in which the support device 5027, which serves as a slave device (replica device) serving as a patient cart, is controlled based on the movement of a master device (primary device) that serves as an operator console near the user. The support device 5027 may also be remotely controlled from outside the operating room.

The above describes an example of an endoscope system 5000 to which the technology disclosed herein can be applied. For example, the technology disclosed herein may also be applied to a microscope system.

[Microscope system]
6 is a diagram showing an example of the schematic configuration of a microsurgical system to which the technology according to the present disclosure can be applied. In the following description, components similar to those in the endoscope system 5000 are designated by the same reference numerals, and redundant description thereof will be omitted.

Figure 6 shows a schematic diagram of an operator 5067 performing surgery on a patient 5071 on a patient bed 5069 using a microsurgical system 5300. For simplicity, Figure 6 omits the illustration of the cart 5037 of the microsurgical system 5300, and also shows a simplified illustration of the microscope device 5301 that replaces the endoscope 5001. However, in this explanation, the microscope device 5301 may refer to the microscope unit 5303 provided at the tip of the link 5035, or may refer to the entire configuration including the microscope unit 5303 and the support device 5027.

As shown in Figure 6, during surgery, a microsurgical system 5300 is used to display an enlarged image of the surgical site captured by a microscope device 5301 on a display device 5041 installed in the operating room. The display device 5041 is installed in a position facing the surgeon 5067, who performs various procedures on the surgical site, such as resecting the affected area, while observing the state of the surgical site using the image displayed on the display device 5041. Microsurgical systems are used, for example, in ophthalmic surgery and brain surgery.

The foregoing describes examples of an endoscopic system 5000 and a microsurgery system 5300 to which the technology disclosed herein can be applied. Note that the systems to which the technology disclosed herein can be applied are not limited to these examples. For example, the support device 5027 may support another observation device or another surgical tool at its tip instead of the endoscope 5001 or microscope unit 5303. Examples of such other observation devices include forceps, a surgeon, an insufflation tube for insufflation, or an energy treatment tool for incising tissue or sealing blood vessels by cauterization. By supporting these observation devices or surgical tools with a support device, it is possible to fix the position more stably than if medical staff were to support them manually, and it is also possible to reduce the burden on medical staff. The technology disclosed herein may also be applied to support devices that support components other than such a microscope unit.

The technology disclosed herein can be suitably applied to image quality adjustment in the display device 5041 of the configurations described above. By applying the technology disclosed herein to image quality adjustment in the display device 5041, it becomes possible to display clearer surgical images.

<Configuration combination example>
The present technology can also be configured as follows.

(1)
a display unit that displays a screen containing externally input images including surgical images;
a detection unit that detects the ambient brightness;
and an information processing unit that sets a display mode according to at least one of the medical department and surgical procedure that uses the display device, and adjusts the image quality of the screen displayed by the display unit according to the display mode and the ambient brightness.
(2)
The display device according to (1), wherein the information processing unit adjusts the brightness and color tone of the screen displayed by the display unit according to the ambient brightness detected at a predetermined timing during surgery.
(3)
The display device according to (1) or (2), wherein the information processing unit sets adjustment contents of brightness and color tone of the screen displayed by the display unit according to the display mode.
(4)
The display device according to any one of (1) to (3), wherein the information processing unit displays a selection screen for at least one of a medical department and a surgical procedure on the display unit, and sets the display mode according to the selection made by the user.
(5)
The display device according to (4) above, wherein when both a medical department and a surgical procedure are selected, selectable surgical procedures are provided for each medical department.
(6)
The display device according to any one of (1) to (5), wherein the information processing unit adjusts a brightness detection characteristic of the detection unit in accordance with the display mode.
(7)
the detection unit has a plurality of sensors that detect ambient light in different wavelength bands,
The display device according to (6), wherein the information processing unit adjusts the detection characteristics by switching a sensor used to detect brightness.
(8)
the detection unit includes a sensor that detects ambient light and a filter that adjusts the wavelength band of the ambient light incident on the sensor;
The display device according to (6) or (7), wherein the information processing unit adjusts the detection characteristics by switching the filter.
(9)
The display device according to any one of (1) to (8), wherein the information processing unit acquires input video information indicating the type of the input video transmitted from a device that is the input source of the input video, and adjusts the brightness and color tone of the screen displayed by the display unit according to the type of the input video.
(10)
a display unit that displays a screen containing externally input images including surgical images;
a detection unit for detecting the ambient brightness;
setting a display mode according to at least one of the medical department and surgical procedure using the display device;
The display control method adjusts the image quality of the screen displayed by the display unit according to the display mode and the ambient brightness.

1 Medical monitor, 11 Display unit, 12 Control unit, 13 Optical input unit, 14 Information processing unit, 15 External input unit, 16 Operation input unit, 17 Memory unit

Claims (10)

a display unit that displays a screen containing externally input images including surgical images;
a detection unit that detects the ambient brightness;
and an information processing unit that sets a display mode according to at least one of the medical department and surgical procedure that uses the display device, and adjusts the image quality of the screen displayed by the display unit according to the display mode and the ambient brightness. The display device according to claim 1 , wherein the information processing unit adjusts the brightness and color tone of the screen displayed by the display unit in accordance with the ambient brightness detected at a predetermined timing during surgery. The display device according to claim 1 , wherein the information processing unit sets adjustment contents for brightness and color tone of the screen displayed by the display unit in accordance with the display mode. The display device according to claim 1 , wherein the information processing unit displays a selection screen for at least one of a medical department and a surgical procedure on the display unit, and sets the display mode according to a selection made by a user. The display device according to claim 4 , wherein when both a medical department and a surgical procedure are selected, selectable surgical procedures are provided for each medical department. The display device according to claim 1 , wherein the information processing unit adjusts a brightness detection characteristic of the detection unit in accordance with the display mode. the detection unit has a plurality of sensors that detect ambient light in different wavelength bands,
The display device according to claim 6 , wherein the information processing section adjusts the detection characteristics by switching a sensor used to detect brightness. the detection unit includes a sensor that detects ambient light and a filter that adjusts the wavelength band of the ambient light incident on the sensor;
The display device according to claim 6 , wherein the information processing unit adjusts the detection characteristics by switching the filter. The display device according to claim 1, wherein the information processing unit acquires input video information indicating the type of the input video transmitted from a device that is a source of the input video, and adjusts the brightness and color tone of the screen displayed by the display unit according to the type of the input video. a display unit that displays a screen containing externally input images including surgical images;
a detection unit for detecting the ambient brightness;
setting a display mode according to at least one of the medical department and surgical procedure using the display device;
The display control method adjusts the image quality of the screen displayed by the display unit according to the display mode and the ambient brightness.