JP2000270318A - Method for displaying surgical operation information - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a method for displaying surgical operation information which aids a surgical operation instruction or the like while a doctor observes an endoscope picture and easily confirms a state of surgical implements. SOLUTION: A 1st signal transmitter 27 placed in an operation room 5 and a 2nd signal transmitter 28 placed at a remote room 6 at a remote place are connected by a public line 4. An endoscope image pickup device 10 having an image pickup element to generate an endoscope picture of a patient 7 in the operation room 5 and surgical implements 20 used for surgical operation to the patient 7 are connected to a controller 24 controlling them, and the endoscope picture by the endoscope image pickup device 10 and control contents by the controller 24 and patient data entered to a magnetic card reader 26 are displayed on a 3rd monitor connected to the 2nd signal transmitter 28 and a display device 33 via a controller 32 respectively so as to allow the remote control room 6 to always confirm the endoscope picture, a state of the surgical implements 20 and the patient data so as to easily assist the instruction or the like for the surgical operation.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method for displaying surgical information in a case where a surgical operation is performed by connecting a remote place and an operating side via a communication line.

[0002]

2. Description of the Related Art Usually, an operation in an operating room performs an operation on a patient. For example, when an operation in an operating room requires an operation with little experience in the past, the operation is performed. The surgeon is connected to a remote operator (remote support surgeon) who is familiar with the public line via a public line, and is able to receive instructions from the remote support surgeon during surgery to perform the resection. A system that assists an operator in performing an operation so that an appropriate operation can be performed on a patient in an operating room can be considered.

As a prior art of such a system for remotely supporting surgery, there is Japanese Patent Application No. 10-318019. According to this prior art, when performing an operation for controlling the operation of a surgical instrument via a manipulator, an operation signal for controlling the surgical instrument by a remote support operator is made to be understood by the operator in the operating room. In this way, joint surgery can be performed smoothly.

[0004]

In the prior art, since the state of the surgical instrument in the operating room cannot be monitored in the remote room, the operation of the surgical tool is instructed from the remote room to the operating room. In such a case, the operation was frequently interrupted because the state of the surgical instrument could only be confirmed verbally. On the other hand, there is a case of an endoscope system in which an operation is performed under endoscopic observation by an endoscope apparatus under remote support (remote support), and in this case, an endoscope image is also generated at a remote room side. It is desirable to be able to observe.

(Remote support) In the prior art of the endoscope system, it is not possible to monitor the state of the surgical tool in the operating room together with the endoscope image, so that the operating tool is operated from the remote room to the operating room. In order to instruct the patient, the state of the surgical instrument had to be confirmed verbally, and the operation was often interrupted.

Further, in the prior art, there is no means for confirming patient data, so that it is necessary to separately send patient information.
Therefore, in the case of emergency surgery, patient information could not be seen in a remote location in a timely manner.

(Object of the Invention) The present invention has been made in view of the above-mentioned points, and it is an object of the present invention to provide a surgical information display method capable of easily confirming the state of a surgical instrument while observing an endoscopic image. It is the purpose of 1. It is a second object of the present invention to provide a surgical information display method capable of easily confirming the state of a surgical tool and / or patient information while observing an endoscope image.

[0008]

In a surgical information display method for performing a surgical operation under endoscopic observation, a step of inputting control contents of a surgical tool on a surgical side to a controller; Transmitting an endoscopic image of the operation side to a remote location via a communication line via the controller;
Displaying a control content and an endoscope image of the surgical tool on the remote site on a monitor on the remote site, thereby forming a surgical information display method on the remote site having a display screen of the monitor on the remote site. Since the endoscopic image and the state of the surgical tool are displayed, the operator at the remote site can check the endoscope image and the state of the surgical tool so that they can assist with accurate surgical instructions etc. I have.

Further, in a method for displaying operation information when performing an operation under endoscopic observation, a step of inputting control contents of a surgical tool on a surgical side and / or patient information to a controller, and controlling the surgical tool. And / or transmitting patient information and an endoscope image of the operation side to a remote place via a communication line via the controller; and controlling a surgical tool on the operation side and / or patient information on a monitor of the remote side. And displaying the endoscopic image on the display screen of the monitor on the remote site side by displaying the endoscopic image, the state of the surgical instrument and / or the patient information on the display screen of the remote site side. Is displayed, and the operator at the remote place can confirm the endoscope image, the state of the surgical instrument and / or the patient information, and can provide an appropriate instruction for the operation.

[0010]

Embodiments of the present invention will be described below with reference to the drawings. (First Embodiment) FIGS. 1 to 4 relate to a first embodiment of the present invention, and FIG. 1 shows an entire configuration of a remote support endoscope system according to the first embodiment. 2 shows a more detailed configuration of FIG. 1, FIG. 3 shows a configuration of the second controller, and FIG. 4 shows display contents of the display device.

In this embodiment, the operating room is connected to a remote room at a remote place via a communication line, and the operator in the operating room receives the support information from the remote room and performs remote operation. The present invention relates to a method for displaying surgical information in an endoscope system.

As shown in FIG. 1 or FIG.
The remote assisted endoscope system 1 adopting the operation information display method according to the embodiment of the present invention includes an endoscope operation apparatus unit (hereinafter simply abbreviated as operation apparatus unit) 2 for performing an operation under endoscopic observation, The surgical device 2 is connected to a remote support device 3 at a remote location via a public line 4.
The remote support unit 3 is disposed in an operating room 5 and a remote room (remote support room) 6, respectively.

The operating device 2 disposed in the operating room 5 includes an endoscope imaging device 10 for observing the inside of the body cavity of the patient 7, and a surgical operation for treating the patient 7 under the observation of the endoscope imaging device 10. (Surgical tool) 20 for performing

More specifically, as shown in FIG.
For example, a surgical instrument main body 8 for performing a surgical operation and an optical endoscope 9 for observing the state of the operation by the surgical instrument main body 8 are inserted into the abdomen.

The surgical tool main body 8 is a device for performing a treatment such as incision or coagulation using an electric scalpel. The surgical tool main body 8 supplies drive power to the surgical tool main body 8 through a cord or the like to cut or coagulate. Power supply unit (or power supply & control unit) with the function of variably setting the output value according to the mode
The surgical tool 20 is configured by the surgical tool main body 8 and the power supply unit (power supply & control unit depending on the treatment tool) 11.

The endoscope 9 has a rigid insertion portion 12 for example.
In a rigid endoscope having an eyepiece section 13 provided at the rear end side of the insertion section 12, a television camera 15 having, for example, a charge-coupled device (abbreviated as CCD) 14 is mounted as an imaging element. A means for capturing an endoscope image is formed.

A light guide cable 16 of the endoscope 9 is connected to a light source device 17. The illumination light of a lamp (not shown) inside the light source device 17 is transmitted to a light guide in the light guide cable 16 and a light guide in the endoscope 9. Transmitted through
The transmitted illuminating light is emitted from the distal end surface of the light guide fixed to the illumination window on the distal end side of the insertion section 12, and illuminates the subject side such as a body cavity organ.

An objective lens (not shown) is attached to an observation window adjacent to the illumination window, and forms an optical image of a subject.
This optical image is transmitted to the rear side by, for example, a relay lens system as an optical image transmission means disposed in the insertion section 12, and can be magnified and observed through an eyepiece (not shown) of the eyepiece 13.

The optical image transmitted to the CCD 14 via the imaging lens 18 of the television camera 15 detachably mounted on the eyepiece 13 is formed. The CCD 14 is connected to a camera control unit (hereinafter abbreviated as CCU) 21 via a signal cable 19, and performs signal processing on a signal photoelectrically converted by the CCD 14 to generate a standard video signal. The device 20 is constituted.

A video signal is output from the CCU 14 to the first monitor 22 to display an endoscopic image of the internal organ of the body cavity taken by the CCD 14 and the distal end side of the surgical tool 8 for operating the internal organ. Further, the CCU 21 and the power supply unit 11 are connected to a (first) controller 24 that performs these controls and the like. The controller 24 is also connected to, for example, a touch panel 25 for inputting control instructions and a magnetic card reader 26 for inputting patient data and the like.

Then, for example, the touch panel 25 can be operated to control a change in color tone by the CCU 21 via the controller 24, and the output of the surgical instrument body 8 can be controlled. When the surgical instrument body 8 is, for example, an electric scalpel, setting control of an output level for performing incision, coagulation, and the like with the electric scalpel can be performed. In addition, treatment tool 2
When 0 is the insufflator, the value such as the set pressure can be variably set and controlled.

Further, the patient data recorded on the magnetic card is read by the magnetic card reader 26, the patient data is input to the controller 24, output to the CCU 21 via the controller 24, and the patient data is superimposed on the endoscope image. When the display is selected, the patient data can be superimposed on the endoscope image.

The CCU 21 and the controller 24 provided in the operating room 5 are connected to a (first) signal transmission device 27. Then, the video signal of the endoscope image output from the CCU 21 and displayed on the first monitor 22 is converted by the signal transmission device 27 into a signal that can be transmitted through the public line 4 such as an integrated digital communication network (ISDN). Public line 4
, The signal can be transmitted to the (second) signal transmission device 28 on the remote room 6 side.

The signal transmitted from the signal transmission device 28 in the remote room 6 to the signal transmission device 27 via the public line 4 is converted into a video signal, and is converted to a video signal by the second monitor 29 connected to the signal transmission device 27. Then, image information and the like from the signal transmission device 28 side can be displayed on the second monitor 29.

A control signal from the controller 24 or patient data is transmitted by the signal transmission device 27 to the public line 4.
The signal can be converted into a signal that can be transmitted and transmitted to the signal transmission device 28 of the remote control room 6 via the public line 4. A keyboard or the like (not shown) is also connected to the controller 24 so that character information and the like can be transmitted from the keyboard to the remote support surgeon on the signal transmission device 28 side via the controller 24.

On the other hand, in the remote support device section 3 in the remote room 6, a third monitor 31 is connected to the signal transmission device 28,
The third monitor 31 has, for example, the CCU 21 on the operating room 5 side.
Is displayed.

This signal transmission device 28 is (second)
A display device 33 serving as a fourth monitor is connected to the controller 32. The controller 32 includes, for example, a touch panel,
Alternatively, input means such as a keyboard 34 is connected.
A pointing device such as a mouse (not shown) is also connected.

The controller 32 is connected to the CC on the operating room 5 side.
The endoscopic image sent from the U21 via the signal transmission device 27, 28 is captured (captured) as a still image, and the signal from the first controller 24 to the signal transmission device 27,
The patient information and the like sent via the input unit 28 are input and displayed on the display device 33 in a superimposed manner or the like. In order to provide support information such as instruction information of the patient, for example, a display by marking of a position to be resected, a display input of a position of an artery to be careful at the time of resection, and the like are performed, and an image of the display input is displayed on the display device 33. Display overlay.

The image information and the like displayed on the display device 33 are transmitted to the second monitor 29 in the operating room 5 through the signal transmission devices 28 and 27.
The content is displayed on the display surface of. And
The operator in the operating room 5 observes the image displayed on the second monitor 29 on which the support information by the remote support operator is displayed, and performs an operation, so that an appropriate operation can be performed. I have.

FIG. 3 shows the configuration of the controller 32. The controller 32 includes a central processing unit (abbreviated as CPU) 40 for performing a control operation, a hard disk (abbreviated as HDD) 41 for storing an operation program of the CPU 40 and images, and a memory used for temporary storage of images and a work area. 42, an input / output interface for inputting and outputting control signals and the like via the signal transmission device 28 (abbreviated as I / O)
43, a video capture control unit 44 for performing a video signal (video signal) capture operation and a superimposed display operation, and a keyboard interface (abbreviated as a keyboard I / F) 45 connected to, for example, a keyboard 34, and these are buses Are connected to each other.

Communication of control signals and the like from the second signal transmission device 28 is performed via the I / O 43. The operation program of the controller 32 is stored in the HDD 41. For example, when a setting or the like for controlling the operation of the surgical tool 20 is made from the touch panel 25 or the like via the first controller 24 on the operating room 5 side, the control content is transmitted to the controller 32 via the signal transmission devices 27 and 28 in the controller 32. The data is stored in the memory 42 or the like from the I / O 43. Similarly, the patient information is also stored in the memory 42 or the like from the I / O 43 in the controller 32.

The video capture control unit 44 is connected to the signal transmission device 28 and converts the input video signal into an A / A signal.
An A / D converter 46 for D-conversion and a D / A converter 47 for D / A-converting and outputting the video signal are provided.

The A / D converter 46 and the D / A converter 47 are connected to an overlay control unit 48 for performing overlay control. The overlay control unit 48 has a video memory therein and controls overlay display and transmits and receives data. Are connected to a control circuit 49 for performing the above-mentioned operations. The control circuit 49 is connected to a bus.

In this embodiment, the image communication by the signal transmission device 28 is performed by the video capture control unit 44
This is performed via a / D converter 46 and a D / A converter 47. The video signal input from the A / D converter 46 is image-converted by the overlay control section 48 under the control of the control circuit 49.

The output of the overlay control unit 48 is transmitted to the signal transmission device 28 via the D / A converter 47. The communication between the signal transmission device 28 and the controller 32
The CPU 40 controls according to the program stored in D41.

The HDD 41 can store an image captured through the video capture control unit 44. When an image stored in the HDD 41 is selected from the keyboard 34, the CPU 40 outputs a reduced image (thumbnail image) of the selected image to the video capture control unit 44, and outputs the image via the overlay control unit 48. It can also be superimposed on the video signal (sent from the first signal transmission device 27 side). The video signal from the D / A converter 47 is also output to the display device 33, and the display device 33 can perform the display shown in FIG. 4, for example.

The display screen 33a of the display device 33 includes an endoscope image display area 50, a thumbnail display area 51,
Surgical tool status display area 52, patient information display area 53,
A comment display area 54 is provided.

In the endoscope image display area 50, an endoscope image from the CCU 21 constituting the endoscope imaging means is displayed, and in the thumbnail display area 51 next to this area 50, the selected thumbnail image is displayed. Is displayed. For example, in the thumbnail display area 51, a reduced image (thumbnail image) of the image data stored in the HDD 41 of the second controller 32 is displayed. The HDD 41 receives a key input for saving or storing an image from the keyboard 34 or the like for an image obtained by capturing a video signal corresponding to an endoscope image from the CCU 21 side of the operating room 5 as a still image by the video capture control unit 44. By doing so, the corresponding image is saved.

The setting state of the surgical tool 20 transmitted from the first controller 24 is displayed in the surgical tool state display area 52. In the patient information display area 53, the first
The patient information from the controller 24 is displayed.

The comment display area 5 between the surgical tool state display area 52 and the patient information display area 53 shown in FIG.
4 displays character information transmitted from the operating room 5 side. As for the standards for transmitting images, sounds, and signals in ISDN, the H320 standard and the like have been established as a method for transmitting images, sounds, and data over a public line.

The operation of the present embodiment by the endoscope system 1 having such a configuration will be described. As shown in FIG. 1 or FIG. 2, the operation device 2 and the remote support device 3 are connected by a public line 4 such as ISDN, and each power is turned on. Also, the first
The patient information such as the name of the patient 7 is input from the magnetic card reader 26 to the controller 24.

The endoscope 9 is connected to a light source device 17 via a light guide cable 16 so that illumination light is supplied, and a television camera 15 is connected to the eyepiece 13 of the endoscope 9.
And connect the signal cable 19 of this TV camera 15 to C
It is connected to the CU 21 so that the endoscope image picked up by the CCD 14 is displayed on the first monitor 22.

The abdomen of the patient 7 is first inserted through a trocar (not shown) to insufflate the abdomen. Then, the insertion section 12 of the endoscope 9 is inserted through the trocar so that an image of the affected part in the abdomen is displayed on the first monitor 22. A surgical instrument body 8 such as an electric scalpel to be operated on is inserted into the abdomen of the patient 7 via a trocar.

When it is desired to change the color tone of the endoscope image displayed on the first monitor 22, the touch panel 25 is operated to send a control signal from the first controller 24 to the CCU 21 to change the color tone. .

The video signal of the endoscope image output from the CCU 21 to the first monitor 22 is transmitted from the first signal transmission device 27 to the second signal transmission device 28 via the public line 4 and is transmitted to the third monitor 22. 31 is displayed.

The video signal is connected to the second controller 32 so as to be able to be input. The remote support operator indicates, for example, a resection site at the time of surgery in the endoscopic image displayed on the third monitor 31. When an appropriate image is obtained, the endoscope image (still image) is taken in through the video capture control unit 44 of the controller 32 by issuing a take-in instruction from the keyboard 34 and connected to the controller 32. The captured endoscope image is displayed on the screen display area 50 of the display device 33 as shown in FIG.

The controller 32 stores the patient information from the magnetic card reader 26 in the first controller 24.
Are input from the I / O 43 via the signal transmission devices 27 and 28 and stored in, for example, the memory 42 in the controller 32. And the patient information is displayed on the display device 3.
3, the patient information is always displayed in the patient information display area 53 as shown in FIG.

Further, the remote support surgeon displays the endoscope image and the patient information sent from the operating room 5 on the display device 33 in an overlay manner, and performs resection when the affected part is to be resected by the surgical instrument body 8. The position to be set is set in a still image state, and is input from a mouse or keyboard 34 (not shown) to mark on the still image or, if there is an artery to be careful near the part to be resected, that part The support information is displayed by, for example, marking it in a color different from that in the case of excision.

For example, the operator of the operating room 5 uses the touch panel 25 to set an output value for an incision using an electric scalpel and an output set value for coagulation. Then, the control contents including the output setting for the surgical tool 20 are transmitted from the first controller 24 to the I / O4 of the second controller 32.
3 and stored in, for example, the memory 42,
As shown in FIG. 4, in the surgical tool state display area 52, control information (setting information) for the surgical tool 20 is displayed. In FIG. 4, the setting information of the insufflator is also displayed in the surgical instrument state display area 52. That is, in the surgical tool state display area 52, control information of a plurality of surgical tools can be displayed.

The operator in the operating room 5 touches the touch panel 25.
When a setting such as a change in the output value of the electric scalpel is made from, the changed content is sent to the I / O 43 of the second controller 32, and the updated content is displayed in the surgical tool state display area 52. That is, the control contents (setting contents) of the surgical instrument 20 are displayed on the display device 33 almost in real time, and the remote support operator can check the state of the surgical instrument 20 almost in real time.

Further, when there is a comment or the like noticed by the operator in the operating room 5 when performing an operation, the comment is displayed on the comment display area 5 shown in FIG.
4 displays the comment. If an answer from the remote support operator is desired for this comment, the comment of the answer is input from the keyboard 34 or the like, displayed on the comment display area 54, and sent to the operating room 5 side. The operator can check the answer by referring to the comment display area 54 displayed on the second monitor 29 or the like.

The remote support surgeon can record the endoscope image captured by the video capture control unit 44. For example, when a recording instruction is input from the keyboard 34, the image of the still image is stored in the HDD 41. Be recorded. In addition, the endoscope image stored in the HDD 41 can be reduced and a reduced screen selected for display can be displayed in the thumbnail display area 51 shown in FIG.

In addition to the endoscope image, a medical image such as an X-ray image of the patient 7 is transmitted from the first controller 24 to the second controller 32 of the remote room 6 and the HDD 4
1, a reduced image of the image stored or accumulated can be selected and displayed.

Then, the remote support operator can display these images and the like on the display device 33 and make an accurate diagnosis when operating on the patient 7 with reference to them.
It is possible to provide the operating room 5 with support information for performing an operation in accordance with the diagnosis.

The image information superimposed on the display device 33 is transmitted to the second monitor 29 via the signal transmission devices 28 and 27.
Will be displayed. Therefore, the operator in the operating room 5 performs an operation by referring to the content including the support information displayed on the second monitor 29, so that the operator in the operating room 5 can perform an appropriate operation.

According to the present embodiment, the remote support surgeon can observe the endoscopic image during the operation on the third monitor 31 almost in real time, and can refer to the display device 33 to operate the operating room 5. The state of the surgical tool 20 can be easily confirmed almost always in real time, and the patient information can be easily confirmed. Therefore, not only normal surgery but also emergency surgery can be performed. Since the state and patient information can be constantly grasped, support information for performing an appropriate operation can be promptly provided to the operator in the operating room 5, so that the operator in the operating room 5 can refer to the information in the case of a fine operation or the like. In addition, a smooth and quick operation can be performed.

Incidentally, the optical endoscope 9 is not limited to the one that transmits an optical image by a relay lens system, but may be one that employs an image guide that transmits an optical image by a fiber bundle. Although not shown, the operator in the operating room 5 and the remote support operator in the remote control room 6 can also transmit and receive audio signals.

As shown in FIG. 2, the endoscope for taking an image is not limited to the optical endoscope 9 having a television camera 15 having a built-in image pickup device mounted thereon. May be used.

(Second Embodiment) Next, a second embodiment of the present invention will be described with reference to FIG. In the present embodiment, for example, in the endoscope system 1 according to the first embodiment, the content displayed on the third monitor 31 is shared by the display device 33 without providing the third monitor 31 on the remote room 6 side. Is displayed. FIG. 5 shows a specific example of the content displayed on the display screen 33a of the display device 33 in the present embodiment.

As shown in FIG. 5, a display screen 33a of the display device 33 has a moving image display area 61 for displaying a moving image of the endoscope.
, A comment display area 62 for displaying character information, and a still image display area 63 for displaying a captured still image
And a surgical tool state display area 64 for displaying the state of the surgical tool
And a patient information display area 65 for displaying patient information, an endoscope information display area 66 for displaying endoscope information such as illumination by a light source device, and a setting state of signal processing for an image sensor, and a thumbnail image. And a thumbnail image display area 67 to be displayed.

In the present embodiment, for example, on the first monitor 22, a moving image display area 61, a surgical instrument state display area 64, a patient information display area 65 in FIG.
An endoscope information display area 66 is provided to display a moving image of an endoscope image, a state of a surgical instrument, patient information, and endoscope information.

That is, on the first monitor 22, an endoscope image captured by the CCD and subjected to signal processing by the CCU 21 is displayed in the moving image display area 61, and the surgical instrument state display area 64 is set via the controller 24. The state of the surgical instrument is displayed, and the patient information display area 65 includes the controller 24.
And displays the patient information input from the magnetic card reader 26 through the endoscope information display area 66.
4 to display the endoscope information such as the setting state of the color tone of the signal processing by the CCU 21 and the setting state of the light source device such as the dimming state.

The content displayed on the first monitor 22 is the CCU
From the signal transmission device 27 to the controller 32 via the signal transmission device 28 in the remote room 6 from the signal transmission device 27, the display device 33
Will show the same content.

When there is a comment to be sent from the operator side of the operating room 5 to the remote room 6 side, the signal processor 27 from the keyboard (not shown) through the controller 24 and the signal transmission device 28 in the remote room 6 through the controller 24. The content is input to the controller 32, and the content is displayed in the comment display area 62 of the display device 33.

In the remote room 6, when there is an image to be taken in with respect to the moving image displayed on the display device 33, a key for taking in the image is inputted from a keyboard 34 connected to the controller 32, thereby stopping the moving image. The still image is captured as an image, and the still image is displayed in the still image display area 62. Further, a marking or the like indicating a portion to be cut can be added to the still image displayed in the still image display area 63.

When a thumbnail image of an image stored in the HDD 41 is to be displayed, the display instruction is input and the thumbnail image is displayed in the thumbnail image display area 63. In addition, for the comment displayed in the comment display area 67, a comment of an answer can be input. In addition, it is possible to add a comment such as a point to be noted when resecting.

In response to the display content displayed on the display device 33 in this manner, the controller 32 transmits, for example, image information including a still image in the still image display area 62 and the comment content in the comment display area 67 from the signal transmission device 28. The information is sent to the controller 32 via the signal transmission device 27 in the operating room 5, and the information including the still image and the comment are displayed on the second monitor 29.

The operator in the operating room 5 performs an operation such as resection with reference to the second monitor 29 on which the support information sent from the remote room 6 is displayed. When a plurality of surgical tools are used, the states of the plurality of surgical tools A and B are displayed in the surgical tool state display area 64 as shown in FIG.

According to the present embodiment, the same contents as those on the operating room 5 side are constantly displayed on the display device 33 of the remote room 6 for the endoscope image, the state of the surgical instrument, the patient information, and the endoscope information. Thus, it is possible to always know the setting or control state of most electric devices related to the operation under the endoscope observation on the operating room 5 side.

For example, when the setting contents of the surgical tool are changed by operating the touch panel 25, the changed information is sent from the controller 24 to the CCU 21 and displayed on the surgical tool state display area 64 of the first monitor 22. The displayed setting state of the surgical tool is changed and displayed, and the CCU 2 is displayed.
Similarly, the setting state of the surgical tool in the image information sent to the remote room 6 through the signal warping device 27 from 1 is also changed, and the setting state of the surgical tool displayed in the surgical tool state display area 64 of the display device 33 is also changed. Thus, the setting information in the operating room 5 can be obtained almost in real time in the remote room 6 (without performing an operation or the like for obtaining necessary information).

The operator on the operating room 5 side can use the second monitor 29
In consideration of the information displayed on the first monitor 22, the operation can be performed by observing the endoscope image displayed on the first monitor 22. The other effects are almost the same as those of the first embodiment.

The patient information is displayed in the comment display area 62.
May be displayed. The endoscope information is the first
The endoscope information may be sent from the controller 24 to the remote room 6 without being displayed on the monitor 22 so that the display can be selected on the remote room 6 side.

The moving image, surgical instrument status, patient information, and the like displayed on the first monitor 2 are sent to the remote room 6 and displayed on, for example, the third monitor 31, and other still images serving as support information are displayed. The information may be displayed on the device 33.

That is, the endoscope image, surgical instrument state, patient information, etc. displayed on the first monitor 22 of the operating room 5 are displayed in the same state in the remote room 6 as they are, and the remote room 6 further displays the information. If assistance is required, the support information including the marked still image or the like or the assistance information including the comment is referred to the operating room with reference to the still image (including the information such as the marking) and the thumbnail image displayed on the display device 33. 5 may be sent to the second monitor 29 for display.

In this way, the control for displaying the operating room 5 when the operating room 5 is connected to the remote room 6 via the public line 4 and the case when the operating room 5 is not connected can be simplified. Even in this case, since the display form displayed on the first monitor 22 does not change, the operation can always be performed in the same display form without any difficulty.

Also, on the remote room 6 side, the endoscope image, the operating tool state, and the patient information in the same display form as the first monitor 22 on the operating room 5 side can be constantly referred to, for example, by the third monitor 31. In addition, instead of the public line 4, a LAN (Local Area
Network) or WAN (Wide Area Network).

In each of the above embodiments, the magnetic card reader is used as the patient information input means. However, the present invention is not limited to this, and other information recording such as an IC card and an optical card may be used. Storage) media may be used. In addition, embodiments and the like configured by combining the above-described embodiments and the like in part or the like also belong to the present invention.

[Supplementary Notes] In a method for displaying surgical information when performing a surgical operation under endoscopic observation, a step of inputting control contents of a surgical tool on a surgical side to a controller, the control contents of the surgical tool, and an endoscopic image on the surgical side. A method for displaying surgical operation information on the operation side, comprising the steps of: transmitting to a remote site via a communication line via a controller; and displaying, on a monitor at the remote site, control contents and an endoscope image of the surgical tool on the operation side.

1 '. In a method for displaying surgical information in the case of performing a surgical operation under endoscopic observation, a step of inputting control contents and / or patient information of a surgical tool on a surgical side to a controller, and controlling contents of the surgical tool and / or patient information Transmitting the endoscopic image of the operating side to a remote location via a communication line via the controller; and transmitting the control content and / or patient information and the endoscopic image of the surgical instrument on the operating side to a monitor on the remote side. Displaying the operation information on the operation side.

2. In Supplementary Note 1, when the status of the surgical tool is displayed on the display screen of the monitor at the remote place, when there are a plurality of surgical tools, the status of a plurality of surgical tools is displayed. 3. In Supplementary Note 1, the display screen of the remote-side monitor includes an image display area for displaying an endoscopic image, a surgical tool status display area for displaying a status of a surgical tool, and a patient information display area for displaying patient information. It is provided. 4. In Supplementary Note 3, a comment is further displayed on the display screen of the remote-side monitor.

5. In Supplementary Note 1, support information from the remote room is displayed on a display screen of a monitor on the operation side. 6. In Supplementary Note 1, an endoscope image, a state of a surgical instrument, and patient information are displayed on a display screen of a monitor on the operation side. 7. In Supplementary Note 1, a reduced image of the endoscope image and / or a medical image other than the endoscope image are displayed on the display screen of the monitor at the remote place.

8. In a method for displaying operation information when performing an operation under endoscopic observation, a step of inputting control contents and patient information of a surgical tool on a surgical side to a controller; controlling contents of the surgical tool and patient information; Transmitting the endoscope image of the surgical instrument to a remote place via a communication line via the controller; anddisplaying, on a monitor at the remote place, the control content of the surgical instrument on the operation side, patient information, and an endoscope image. Surgical information display method on the operating side. 9. In Supplementary Note 8, the endoscope image, the state of the surgical tool, and patient information are displayed in the same display form on the display screens of the monitors on the operation side and the remote side.

[0083]

As described above, according to the present invention, in the operation information display method for performing an operation under endoscopic observation, a step of inputting control contents of a surgical tool on the operation side to a controller, Transmitting the control content of the surgical tool, an endoscopic image of the surgical side to a remote place via the controller via a communication line, and controlling the surgical tool on the remote side and viewing the endoscope on a monitor of the remote place. And a step of displaying a mirror image, the operation information display method on the operation side having the step of displaying the mirror image, the endoscope image and the state of the surgical instrument are displayed on the display screen of the monitor on the remote side, and the remote side is displayed. The operator can confirm the endoscope image and the state of the surgical tool, and can provide an appropriate instruction for surgery.

Further, in the operation information display method in the case of performing an operation under endoscopic observation, a step of inputting control contents of a surgical tool on the operating side and patient information to a controller; Transmitting information and an endoscopic image of the operation side to a remote place via a communication line via the controller; and displaying, on a monitor of the remote side, the control contents of the surgical instrument on the operation side, patient information, and an endoscope image. The operation information display method of the operation side having the step of performing the operation, the endoscope image, the state of the surgical instrument and the patient information are displayed on the display screen of the remote side monitor, The operator can confirm the endoscope image, the state of the surgical instrument, and the patient information, and can provide an appropriate instruction for the operation.

[Brief description of the drawings]

FIG. 1 is an overall schematic configuration diagram of a remote surgery support endoscope system according to a first embodiment of the present invention.

FIG. 2 is a more detailed configuration diagram of FIG. 1;

FIG. 3 is a block diagram showing a configuration of a second controller on the remote support device side.

FIG. 4 is a view showing contents displayed on a display screen of a display device.

FIG. 5 is a diagram showing contents displayed on a display screen of a display device according to a second embodiment of the present invention.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 ... Remote support endoscope system 2 ... Surgical apparatus part 3 ... Remote support apparatus part 4 ... Public line 5 ... Operating room 6 ... Remote support apparatus room 7 ... Patient 8 ... Surgical tool main body 9 ... Endoscope 10 ... Endoscope Mirror imaging device 11 ... surgical tool control unit 12 ... insertion unit 14 ... CCD 15 ... television camera 17 ... light source device 20 ... surgical tool 21 ... CCU 22 ... first monitor 24 ... (first) controller 25 ... touch panel 26 ... magnetic Card reader 27 (first) signal transmission device 28 (second) signal transmission device 29 second monitor 31 third monitor 32 controller (second) 40 CPU 41 hard disk (HDD) 43 ... I / O 44 ... Video capture control unit 46 ... A / D converter 47 ... D / A converter 48 ... Overlay control unit 49 ... Control circuit 50 ... Image display area 51 ... Thumbnail display Rear 52 ... a surgical instrument status display area 53 ... patient information display area 54 ... comment display area

 ──────────────────────────────────────────────────続 き Continued on the front page F term (reference) 4C061 AA24 BB02 CC06 DD01 FF45 JJ19 LL03 NN03 NN05 UU02 UU08 WW01 WW04 WW10 WW11 WW15 YY03 YY14 5C054 AA01 CA04 CC07 CH01 DA01 EA03 FA09 FE13 FE14 FE18 FE18

Claims (2)

[Claims] An operation information display method for performing an operation under endoscopic observation, comprising: inputting control contents of a surgical tool on a surgical side to a controller; controlling contents of the surgical tool; A step of transmitting an endoscope image to a remote place via a communication line via the controller; anda step of displaying, on a monitor at a remote place, control contents of the surgical tool and the endoscope image of the surgical side. Surgery information display method. 2. A method for displaying surgical information when performing a surgical operation under endoscopic observation, comprising the steps of: inputting control contents of a surgical tool on a surgical side and / or patient information to a controller; and controlling the surgical tool. And / or transmitting patient information and an endoscope image of the operation side to a remote place via a communication line via the controller; and controlling a surgical instrument on the operation side and / or patient information on a monitor on the remote side. And a step of displaying an endoscopic image.