CN106847036A - A kind of Replacement of Hip Joint teaching display systems based on virtual reality technology - Google Patents

Abstract

The present invention provides a teaching and display system for artificial hip replacement based on virtual reality technology, which includes a basic data storage unit, a surgical procedure and scene display unit, a virtual reality imaging unit, and a surgical live broadcast unit; the surgical procedure and scene display unit are respectively It is connected with basic data storage unit, virtual reality imaging unit, and surgical live broadcast unit. The teaching and display system for artificial hip replacement based on virtual reality technology provided by the present invention enables medical staff to experience virtual reality technology and at the same time have a more intuitive experience of operations that require multiple instrument operations. Among them, medical technology can be better trained and the purpose of learning and communication can be achieved, and the process and norms of artificial hip replacement can be learned and understood more realistically.

Description

A teaching display system for artificial hip replacement based on virtual reality technology

technical field

The invention relates to the field of virtual reality technology, in particular to a virtual reality technology-based teaching and display system for artificial hip replacement.

Background technique

Virtual reality technology is a multiple signal transmission between the virtual scene system, the perception management system and the user, so that the user can integrate into the virtual scene. The computer completes the design and production of the virtual scene, and the VR device realizes the user's sensory feedback, which is the content input of virtual reality; the user receives the sensory signal and inputs the user's sensory perception into the computer through the capture device to complete the scene response, which is the user's signal output; The perception management system continuously transmits signals between the virtual scene system and users, forming a complete signal closed loop. However, the biggest problem with VR technology at present is the resolution of dizziness and the establishment of industry standards, which are trapped in the complex integration of multiple industries and multiple scenarios.

The ultimate goal of medical education is clinical operation, but traditional flat textbooks lack interactive and three-dimensional features, making it difficult to provide learners with substantive and efficient guidance, especially resources with high value but few opportunities, such as solid anatomy and surgery, are scarce. It is the advantage of cutting into the VR. VR can provide students with enhanced medical training that cannot be provided in a classroom setting. With the help of technologies such as three-dimensional modeling, positioning and ranging, and five-dimensional coordinates (three-dimensional space + parallel universe), VR has great advantages that traditional teaching cannot match in terms of simulated organ anatomy and virtual surgery.

In ordinary VR technology, only the operator himself can have a complete experience of the entire system, while the surrounding observers can only follow the perspective of the operator, which will easily lead to severe dizziness for the observers and the inability to monitor the operator. accurate guidance. And if you want to broadcast the influence of the virtual world to the outside world, you also need to use expensive auxiliary equipment.

Contents of the invention

Aiming at the problems existing in the background technology, the present invention provides a virtual reality technology-based artificial hip replacement teaching and display system, which is a multi-view live broadcast that broadcasts the whole operation process from a third-person perspective and shows it to observers system.

The present invention adopts following technical scheme to realize:

A teaching and display system for artificial hip replacement based on virtual reality technology, including a basic data storage unit, an operation process and scene display unit, a virtual reality imaging unit, and a live operation unit; Storage unit, virtual reality imaging unit, surgical live broadcast unit connection;

The basic data storage unit: storing high-precision models and operation animations of all medical devices used in the artificial hip replacement operation, as well as corresponding device function information;

The operation process and scene display unit: call the data in the basic data storage unit to construct a virtual operating room, surgical tools and materials, and collect and process the model data in the basic data storage unit for the specific process of hip joint replacement surgery , complete the entire operation process, and display it through the virtual reality imaging unit and the operation live broadcast unit; this unit can be specifically divided into a scene display unit and a surgical process operation unit, and the scene display unit: calls the data in the basic data storage unit in the virtual environment Construct a virtual operating room that highly corresponds to the real surgical scene and extremely simulated surgical tools and materials. Surgical process operation unit: according to the specific surgical process, the model data in the basic data storage unit is collected and processed to complete the entire surgical process, and it is imaged and displayed through the virtual reality imaging unit and the surgical live broadcast unit.

The virtual reality imaging unit: imaging and displaying from the perspective of the operator; there are two types of displayed output, one is the operator's VR imaging display, that is: displayed by a virtual imaging device worn on the operator's head; the other One is to display through the flat-panel display, the virtual imaging display device of the operator can clearly observe the scene display unit, and the flat-panel display can provide third-party personnel to see the scene display unit observed by the operator in real time.

The surgical live broadcast unit: imaging and displaying from the perspective of the observers; it is a display unit provided to the observers that can observe the entire operation process in an all-round way, allowing the operators to view the entire process of the operation to the observers without worrying about their own perspective. The explanation of the operation process can also allow the observers to guide the operator in real time during the whole operation.

The operation process and scene display unit includes a virtual operation control unit, a hip joint replacement operation process processing unit, a surgical instrument and operation target simulation unit, and an operation operation input unit; the virtual operation control unit is connected with the hip joint replacement operation process processing unit, the operation The instrument is connected with the surgical target simulation unit and the surgical operation input unit, and the surgical operation input unit, surgical instruments are connected with the surgical target simulation unit and the hip joint replacement operation process processing unit in sequence;

The virtual operation control unit controls the overall process. The surgical operation input unit obtains the real-time position of the operator's hand and the ongoing operation. When the operator's operation information enters the surgical instrument and surgical target simulation unit, the surgical operation process is checked. As well as the precision inspection, after passing the inspection, the hip joint replacement operation process processing unit is used to push the operation process to continue.

The virtual reality imaging unit includes an operator's head control module, an operator's camera, an operator's VR imaging unit, a virtual reality imaging output unit, an operator's non-VR imaging unit, and a flat panel display; , the operator's head control module, the operator's VR imaging unit, and the operator's non-VR imaging unit are connected, the operator's VR imaging unit is connected to the virtual reality imaging output unit, and the operator's non-VR imaging unit is connected to the flat-panel display;

The graphic data information of the scene and action of the surgical operation is sent to the operator's camera by the operation process and scene display unit, and the direction and angle of the operator's camera are controlled by the operator's head control module, which displays the operator's first perspective The viewing angle is displayed by two imaging units, namely the operator VR imaging unit and the operator non-VR imaging unit, which are output by the virtual reality imaging output unit and the flat-panel display respectively.

The operation live broadcast unit includes an observer camera, an observer imaging display unit, and a flat-panel display; the surgical procedure and scene display unit, the observer camera, the observer imaging unit, and the flat-panel display are sequentially connected;

The graphic data information of the scene and action of the surgical operation is sent to the camera of the observer by the operation process and the scene display unit. The purpose of the camera position is to show the whole operation to the observers.

The artificial hip replacement teaching and display system based on virtual reality (VR) technology provided by the present invention enables medical staff to have a more intuitive experience of operations that require multiple instrument operations while experiencing virtual reality technology. During the operation simulation process, medical technology can be better trained and the purpose of learning and communication can be achieved, and the process and specifications of artificial hip replacement can be learned and understood more realistically. Unit, after starting the surgical live broadcast unit, the surgical operator can easily explain the operation to the observers, and the observers can also observe the entire operation process in an all-round way and give guidance.

Description of drawings

Figure 1 is a schematic diagram of the overall structure of the system;

Fig. 2 is a structural schematic diagram of the operation process and the scene display unit in the system;

Fig. 3 is a structural schematic diagram of the virtual reality imaging unit and the surgical live broadcast unit in the system.

detailed description

The present invention will be further described below in conjunction with the accompanying drawings and embodiments.

As shown in Figure 1, the present invention includes a basic data storage unit, a surgical procedure and a scene display unit, a virtual reality imaging unit, and a surgical live broadcast unit; Surgical live broadcast unit connection.

Basic data storage unit: store model data composed of various surgical instruments, corresponding functional information and usage scenarios of the surgical instruments, such as electric knife, head extractor, electric bone saw, acetabular rasp, femoral prosthesis, Information such as 1:1 scale high-precision models of surgical instruments such as femoral head prosthesis and operation animations.

Surgical process and scene display unit: It is used to simulate the real operating room scene to bring the operator an environment experience close to the real operation, and at the same time control the entire operation process and give voice prompts. The entire operation process and the composition of the scene display unit are specifically described in FIG. 2 . The unit is controlled by the virtual operation control unit. The operator holds the simulated handle representing the surgical instrument. All the information of the handle is provided by the basic data storage unit. The output information of the handle is processed by the fine operation unit, and the operation input unit To obtain the real-time position of the operator's hand and the ongoing operation. When the operation information of the operator enters the surgical instrument and surgical target simulation unit, a large number of surgical operation process checks and precision checks will be carried out. Only after the check is passed can it be promoted The surgical procedure continues. The hip replacement procedure processing unit is specially designed to handle the surgical procedure steps to ensure that the operation is carried out in the correct way.

Both the virtual reality imaging unit and the surgical live broadcast unit display the process pictures of the surgical operation, but their rendering processes are different. As shown in Figure 3, the left branch is the process of the virtual reality imaging unit, and the right branch is the process of the surgical live broadcast unit. The surgical process and the scene display unit in the surgical operation scene and graphic data information of the action will be sent to the operator’s camera respectively. And the observer camera, the operator camera has the operator's own head control module to control the direction and angle, etc., showing the operator's first perspective, while the observer camera is a preset fixed position, the purpose is to show the operator's first perspective. Observers show the whole picture of the operation. For the perspective of the operator, two imaging units are separated in the usual virtual display system, namely the binocular display unit for the operator and the single plane display unit for the bystanders, but the display content of these two display units is usually it's the same. In the present invention, a surgical live broadcast unit dedicated to watchers is created separately. After starting the surgical live broadcast unit, the surgical operator can easily explain the operation to the observers, and the observers can also observe the entire operation process in an all-round way and give guidance.

The above descriptions are only preferred embodiments of the present invention, and are not intended to limit the scope of the present invention. Therefore, on the premise of not departing from the design spirit of the present invention, ordinary engineers and technicians in the field understand the structure, features and principles of the present invention. All equivalent changes or decorations should fall within the protection scope of the present invention, and the content not elaborated in the present invention belongs to the prior art.

Claims (4)

1. A teaching display system for artificial hip replacement based on virtual reality technology, characterized in that: it includes a basic data storage unit, an operation process and a scene display unit, a virtual reality imaging unit, and an operation live broadcast unit; the operation process and the scene The display unit is respectively connected with the basic data storage unit, the virtual reality imaging unit, and the surgical live broadcast unit; The basic data storage unit: storing high-precision models and operation animations of all medical devices used in the artificial hip replacement operation, as well as corresponding device function information; The operation process and scene display unit: call the data in the basic data storage unit to construct a virtual operating room, surgical tools and materials, and collect and process the model data in the basic data storage unit for the specific process of hip joint replacement surgery , to complete the entire operation process, and display it through the virtual reality imaging unit and live operation unit; The virtual reality imaging unit: imaging and displaying from the perspective of the operator; The surgical live broadcast unit: imaging and displaying images from the perspective of observers. 2. A teaching display system for artificial hip replacement based on virtual reality technology according to claim 1, characterized in that: the operation process and scene display unit includes a virtual operation control unit, a hip joint replacement operation process processing unit , surgical instrument and surgical target simulation unit, and surgical operation input unit; the virtual operation control unit is respectively connected with the hip joint replacement operation process processing unit, surgical instrument and surgical target simulation unit, and surgical operation input unit, and the surgical operation input unit, surgical instrument and The operation target simulation unit and the hip joint replacement operation process processing unit are sequentially connected; The virtual operation control unit controls the overall process. The surgical operation input unit obtains the real-time position of the operator's hand and the ongoing operation. When the operator's operation information enters the surgical instrument and surgical target simulation unit, the surgical operation process is checked. As well as the precision inspection, after passing the inspection, the hip joint replacement operation process processing unit is used to push the operation process to continue. 3. A teaching display system for artificial hip replacement based on virtual reality technology according to claim 2, characterized in that: the virtual reality imaging unit includes an operator head control module, an operator camera, and an operator VR imaging unit. unit, virtual reality imaging output unit, operator non-VR imaging unit, and flat-panel display; the operator camera is connected to the surgical procedure and scene display unit, operator head control module, operator VR imaging unit, and operator non-VR imaging unit, The operator's VR imaging unit is connected to the virtual reality imaging output unit, and the operator's non-VR imaging unit is connected to the flat-panel display; The graphic data information of the scene and action of the surgical operation is sent to the operator's camera by the operation process and scene display unit, and the direction and angle of the operator's camera are controlled by the operator's head control module, which displays the operator's first perspective The viewing angle is displayed by two imaging units, namely the operator VR imaging unit and the operator non-VR imaging unit, which are output by the virtual reality imaging output unit and the flat-panel display respectively. 4. A teaching and display system for artificial hip replacement based on virtual reality technology according to claim 3, characterized in that: the surgical live broadcast unit includes a camera for observers, an imaging display unit for observers, and a flat-screen display; And the scene display unit, the observer camera, the observer imaging unit, and the flat-panel display are connected in sequence; The graphic data information of the scene and action of the surgical operation is sent to the camera of the observer by the operation process and the scene display unit. The purpose of the camera position is to show the whole operation to the observers.