CN106920451A - A kind of operation teaching display systems based on virtual reality technology - Google Patents

Abstract

The present invention provides a surgical teaching and display system based on virtual reality technology, including a basic data storage unit, a surgical fine operation simulation unit, a surgical process and scene display unit, a virtual reality imaging unit, and a surgical live broadcast unit; the surgical process and scene display The units are respectively connected with the basic data storage unit, the surgical fine operation simulation unit, the virtual reality imaging unit, and the surgical live broadcast unit, and the basic data storage unit is connected with the surgical fine operation simulation unit. The teaching and display system based on virtual reality technology provided by the present invention enables medical staff to have a more intuitive view of various types of operations including orthopedics, obstetrics and gynecology, tumor surgery, cardiothoracic surgery and other clinical surgery departments while experiencing virtual reality technology. During the whole operation simulation process, the medical technology can be better trained and the purpose of learning and communication can be achieved, and the process and specifications of various operations can be learned and understood more realistically.

Description

A teaching display system for surgery based on virtual reality technology

technical field

The invention relates to the field of virtual reality technology, in particular to a virtual reality technology-based operation teaching display system.

Background technique

Virtual reality technology is a multiple signal transmission between the virtual scene system, the perception management system and the user, so that the user can integrate into the virtual scene. The computer completes the design and production of the virtual scene, and the VR device realizes the user's sensory feedback, which is the content input of virtual reality; the user receives the sensory signal and inputs the user's sensory perception into the computer through the capture device to complete the scene response, which is the user's signal output; The perception management system continuously transmits signals between the virtual scene system and users, forming a complete signal closed loop. However, the biggest problem with VR technology at present is the resolution of dizziness and the establishment of industry standards, which are trapped in the complex integration of multiple industries and multiple scenarios.

The ultimate goal of medical education is clinical operation, but traditional flat textbooks lack interactive and three-dimensional features, making it difficult to provide learners with substantive and efficient guidance, especially resources with high value but few opportunities, such as solid anatomy and surgery, are scarce. It is the advantage of cutting into the VR. VR can provide students with enhanced medical training that cannot be provided in a classroom setting. With the help of technologies such as three-dimensional modeling, positioning and ranging, and five-dimensional coordinates (three-dimensional space + parallel universe), VR has great advantages that traditional teaching cannot match in terms of simulated organ anatomy and virtual surgery.

In ordinary VR technology, only the operator himself can have a complete experience of the entire system, while the surrounding observers can only follow the perspective of the operator, which will easily lead to severe dizziness for the observers and the inability to monitor the operator. accurate guidance. And if you want to broadcast the influence of the virtual world to the outside world, you also need to use expensive auxiliary equipment.

Contents of the invention

Aiming at the problems existing in the background technology, the present invention provides a surgical teaching and display system based on virtual reality technology, which is a multi-view live broadcast based on VR technology that broadcasts the whole operation process from a third-person perspective and demonstrates it to observers. system.

The present invention adopts following technical scheme to realize:

A surgical teaching and display system based on virtual reality technology, including a basic data storage unit, a surgical fine operation simulation unit, a surgical process and scene display unit, a virtual reality imaging unit, and a surgical live broadcast unit; the surgical process and scene display unit are respectively It is connected with the basic data storage unit, the surgical fine operation simulation unit, the virtual reality imaging unit, and the surgical live broadcast unit, and the basic data storage unit is connected with the surgical fine operation simulation unit;

The basic data storage unit: stores high-precision models and operation animations of all medical devices used in various types of operations, as well as corresponding device function information, etc.;

The operation fine operation simulation unit: according to the fine operation requirements of different types of operations, a fine operation and display unit for simulating various types of operations is set up; in this unit, the accuracy of the operator's operation is the same as the accuracy of the actual action , to restore the experience of various fine surgical operations to the greatest extent.

The operation process and scene display unit: call the data in the basic data storage unit to build a virtual operating room and surgical tools and materials, and collect and process the model data in the basic data storage unit according to the specific operation process to complete the entire operation process. The operation process is displayed through the virtual reality imaging unit and the operation live broadcast unit; this unit can be specifically divided into a scene display unit and a surgical process unit. The scene display unit: calls the data in the basic data storage unit in the virtual environment to construct a A virtual operating room that corresponds highly to the surgical scene and extremely simulated surgical tools and materials. Surgical procedure unit: According to the specific procedure of the operation, the model data in the basic data storage unit is collected and processed to complete the entire operation procedure, which is imaged and displayed by the virtual reality imaging unit and the surgical live broadcast unit.

The virtual reality imaging unit: imaging and displaying from the perspective of the operator; there are two types of displayed output, one is the operator's VR imaging display, that is: displayed by a virtual imaging device worn on the operator's head; the other One is to display through the flat-panel display, the virtual imaging display device of the operator can clearly observe the scene display unit, and the flat-panel display can provide third-party personnel to see the scene display unit observed by the operator in real time.

The surgical live broadcast unit: imaging and displaying from the perspective of the observers; it is a display unit provided to the observers that can observe the entire operation process in an all-round way, allowing the operators to view the entire process of the operation to the observers without worrying about their own perspective. The explanation of the operation process can also allow the observers to guide the operator in real time during the whole operation.

The surgical fine operation simulation unit includes a virtual operation control unit, a surgical customization processing unit, a surgical instrument and surgical target simulation unit, and a fine operation input unit; the virtual operation control unit is connected with the surgical customization processing unit, surgical instrument and surgical target simulation unit, The fine operation input unit is connected, and the fine operation input unit, the surgical instrument, the surgical target simulation unit, and the surgical custom processing unit are sequentially connected;

The virtual operation control unit controls the overall process. The fine operation input unit obtains the real-time position of the operator's hand and the ongoing operation. When the operation information performed by the operator enters the surgical instrument and surgical target simulation unit, the surgical operation process is checked. As well as the precision inspection, after the inspection is passed, the operation process is promoted to continue, and the operation customization processing unit determines the corresponding display mode according to different operation types. This unit clearly presents every small movement of the operation operation in front of the operator in real time .

The virtual reality imaging unit includes an operator's head control module, an operator's camera, an operator's VR imaging unit, a virtual reality imaging output unit, an operator's non-VR imaging unit, and a flat panel display; , the operator's head control module, the operator's VR imaging unit, and the operator's non-VR imaging unit are connected, the operator's VR imaging unit is connected to the virtual reality imaging output unit, and the operator's non-VR imaging unit is connected to the flat-panel display;

The graphic data information of the scene and action of the surgical operation is sent to the operator's camera by the operation process and scene display unit, and the direction and angle of the operator's camera are controlled by the operator's head control module, which displays the operator's first perspective The viewing angle is displayed by two imaging units, namely the operator VR imaging unit and the operator non-VR imaging unit, which are output by the virtual reality imaging output unit and the flat-panel display respectively.

The operation live broadcast unit includes an observer camera, an observer imaging display unit, and a flat-panel display; the surgical procedure and scene display unit, the observer camera, the observer imaging unit, and the flat-panel display are sequentially connected;

The graphic data information of the scene and action of the surgical operation is sent to the camera of the observer by the operation process and the scene display unit. The purpose of the camera position is to show the whole operation to the observers.

The operation teaching and display system based on virtual reality (VR) technology provided by the present invention enables medical staff to experience virtual reality technology and at the same time to provide comprehensive medical knowledge including orthopedics, obstetrics and gynecology, tumor surgery, cardiothoracic surgery, general surgery, neurosurgery, ophthalmology, etc. , ENT and other clinical surgery departments have a relatively intuitive experience of various types of surgery. During the entire surgical simulation process, medical technology can be better trained and the purpose of learning and communication can be achieved. It is possible to learn and understand various types of surgery more realistically. The procedure and specification of the operation, the present invention also creates a surgical live broadcast unit specially for the observers to watch. After starting the surgical live broadcast unit, the surgical operator can easily explain the operation to the observers, and the observers can also observe in all directions Throughout the surgical process and give instructions.

Description of drawings

Figure 1 is a schematic diagram of the overall structure of the system;

Fig. 2 is a structural schematic diagram of the fine operation simulation unit in the system;

Fig. 3 is a structural schematic diagram of the virtual reality imaging unit and the surgical live broadcast unit in the system.

detailed description

The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

As shown in Figure 1, the present invention includes a basic data storage unit, a surgical fine operation simulation unit, a surgical procedure and a scene display unit, a virtual reality imaging unit, and a surgical live broadcast unit; , the surgical fine operation simulation unit, the virtual reality imaging unit, and the surgical live broadcast unit are connected, and the basic data storage unit is connected with the surgical fine operation simulation unit.

Basic data storage unit: store the model data composed of various surgical instruments, the corresponding functional information of the surgical instruments, the 1:1 scale high-precision model of the surgical instruments and the operation animation and other information.

Surgical fine operation simulation unit: used to simulate the fine operation environment of surgery, so as to provide operators with an experience close to real surgical operation. In Fig. 2, the composition of the whole operation fine operation simulation unit is specifically described. The unit is controlled by the virtual operation control unit. The operator holds the simulated handle representing the surgical instrument. All the information of the handle is provided by the basic data storage unit. The output information of the handle is processed by the fine operation unit, and the fine operation input unit To obtain the real-time position of the operator's hand and the ongoing operation. When the operation information of the operator enters the surgical instrument and surgical target simulation unit, a large number of surgical operation process checks and accuracy checks will be carried out. Only after the check is passed can it be promoted The surgical procedure continues. The specific operation customization processing unit determines the corresponding display mode according to different operation types, and this unit will clearly present every small movement of the operation operation in front of the operator in real time.

The operation process and scene display unit is used to simulate the real operating room scene to bring the operator an environment experience close to the real operation, while controlling the entire operation process and giving voice prompts.

Both the virtual reality imaging unit and the surgical live broadcast unit display the process pictures of the surgical operation, but their rendering processes are different. As shown in Figure 3, the left branch is the process of the virtual reality imaging unit, and the right branch is the process of the surgical live broadcast unit. The surgical process and the scene display unit in the surgical operation scene and graphic data information of the action will be sent to the operator’s camera respectively. And the observer camera, the operator camera has the operator's own head control module to control the direction and angle, etc., showing the operator's first perspective, while the observer camera is a preset fixed position, the purpose is to show the operator's first perspective. Observers show the whole picture of the operation. For the perspective of the operator, two imaging units are separated in the usual virtual display system, namely the binocular display unit for the operator and the single plane display unit for the bystanders, but the display content of these two display units is usually it's the same. In the present invention, a surgical live broadcast unit dedicated to watchers is created separately. After starting the surgical live broadcast unit, the surgical operator can easily explain the operation to the observers, and the observers can also observe the entire operation process in an all-round way and give guidance.

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the scope of the present invention. Therefore, on the premise of not departing from the design spirit of the present invention, ordinary engineers and technicians in the field understand the structure, features and principles of the present invention. All equivalent changes or decorations should fall within the protection scope of the present invention, and the content not elaborated in the present invention belongs to the prior art.

Claims (4)

1. An operation teaching display system based on virtual reality technology, characterized in that: it includes a basic data storage unit, an operation fine operation simulation unit, an operation process and a scene display unit, a virtual reality imaging unit, and an operation live broadcast unit; the operation process and the scene display unit are respectively connected with the basic data storage unit, the surgical fine operation simulation unit, the virtual reality imaging unit, and the surgical live broadcast unit, and the basic data storage unit is connected with the surgical fine operation simulation unit; The basic data storage unit: storing high-precision models and operation animations of all medical devices used in various types of operations, as well as corresponding device function information; The operation fine operation simulation unit: according to the fine operation requirements of different types of operations, a fine operation and display unit for simulating various types of operations is provided; The operation process and scene display unit: call the data in the basic data storage unit to build a virtual operating room and surgical tools and materials, and collect and process the model data in the basic data storage unit according to the specific operation process to complete the entire operation process. The operation process is displayed through the virtual reality imaging unit and the live operation unit; The virtual reality imaging unit: imaging and displaying from the perspective of the operator; The surgical live broadcast unit: imaging and displaying images from the perspective of observers. 2. A surgical teaching display system based on virtual reality technology according to claim 1, characterized in that: the fine surgical operation simulation unit includes a virtual operation control unit, a surgical customization processing unit, a surgical instrument and a surgical target simulation unit , fine operation input unit; the virtual operation control unit is respectively connected with the surgical customization processing unit, the surgical instrument and surgical target simulation unit, and the fine operation input unit, and the fine operation input unit, the surgical instrument and surgical target simulation unit, and the surgical customization processing unit are sequentially connected ; The virtual operation control unit controls the overall process. The fine operation input unit obtains the real-time position of the operator's hand and the ongoing operation. When the operation information performed by the operator enters the surgical instrument and surgical target simulation unit, the surgical operation process is checked. As well as the precision inspection, after the inspection is passed, the operation process is promoted to continue, and the operation customization processing unit determines the corresponding display mode according to different operation types. This unit clearly presents every small movement of the operation operation in front of the operator in real time . 3. A kind of operation teaching display system based on virtual reality technology according to claim 2, characterized in that: said virtual reality imaging unit comprises an operator's head control module, an operator's camera, an operator's VR imaging unit, a virtual reality Imaging output unit, operator non-VR imaging unit, and flat-panel display; the operator camera is connected to the surgical procedure and scene display unit, operator head control module, operator VR imaging unit, operator non-VR imaging unit, and operator VR imaging The unit is connected with the virtual reality imaging output unit, and the non-VR imaging unit of the operator is connected with the flat-panel display; The graphic data information of the scene and action of the surgical operation is sent to the operator's camera by the operation process and scene display unit, and the direction and angle of the operator's camera are controlled by the operator's head control module, which displays the operator's first perspective The viewing angle is displayed by two imaging units, namely the operator VR imaging unit and the operator non-VR imaging unit, which are output by the virtual reality imaging output unit and the flat-panel display respectively. 4. A surgical teaching display system based on virtual reality technology according to claim 3, characterized in that: the surgical live broadcast unit includes a camera for observers, an imaging display unit for observers, and a flat-panel display; an operation process and scene display unit , observer camera, observer imaging unit, and flat-panel display are connected in sequence; The graphic data information of the scene and action of the surgical operation is sent to the camera of the observer by the operation process and the scene display unit. The purpose of the camera position is to show the whole operation to the observers.