WO2023225768A1 - Simulador basado en realidad virtual inmersiva para entrenamiento de procedimientos quirúrgicos - Google Patents
Simulador basado en realidad virtual inmersiva para entrenamiento de procedimientos quirúrgicos Download PDFInfo
- Publication number
- WO2023225768A1 WO2023225768A1 PCT/CL2023/050043 CL2023050043W WO2023225768A1 WO 2023225768 A1 WO2023225768 A1 WO 2023225768A1 CL 2023050043 W CL2023050043 W CL 2023050043W WO 2023225768 A1 WO2023225768 A1 WO 2023225768A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- virtual reality
- mechanical interface
- surgical
- simulation
- simulations
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B23/00—Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes
- G09B23/28—Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes for medicine
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B17/00—Surgical instruments, devices or methods
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/06—Electrically-operated educational appliances with both visual and audible presentation of the material to be studied
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B5/00—Electrically-operated educational appliances
- G09B5/08—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations
- G09B5/12—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations different stations being capable of presenting different information simultaneously
- G09B5/125—Electrically-operated educational appliances providing for individual presentation of information to a plurality of student stations different stations being capable of presenting different information simultaneously the stations being mobile
Definitions
- the present invention relates to the field of medicine or veterinary sciences and hygiene, specifically with the field of computer-assisted surgeries, or manipulators or robots specially adapted for use in surgery or simulators for the training of medical professionals.
- it provides a simulator with immersive and portable virtual reality to train minimal access surgeries and for the preparation of students or professionals in open surgery surgical techniques.
- CN106448403A refers to a surgical training system to simulate thoracoscopic surgeries, which allows the surgeon to simulate various types of surgeries.
- the technical solution adopted and described in this document is a training system for simulating thoracoscopic surgery that includes a body, a monitor, a simulation endoscope, a simulation surgical instrument and a control system;
- the monitor is fixed on the fuselage by an arm, and the simulation endoscope and simulation surgical instruments are connected with the fuselage;
- the simulation endoscope and simulation surgical instruments are provided with a rotation sensor and a displacement sensor, and the control system is electrically connected.
- the control system includes a data receiving processing device, a 3D model processing server and a 3D platform system server.
- document ES2346025A1 refers to a surgical practice simulation system, which has technical particularities intended to allow the surgeon in training to be trained in the most real situation possible, without entailing any type of simulation of deterioration of the material, and therefore allows unlimited repeatability in the same practice.
- the surgeon in Training can also see, not only the simulated situation as a real operation, but the system also allows you to study any other aspect of this situation through different visualization modes.
- it allows personalization of practice by using patient data from diagnostic tests such as scanning, mapping and 3D CT, so a professional can check the status of an operation, decide where to place entry portals and practice in performing the surgery before performing the actual operation on said patient.
- This invention allows a solution to learning the technique, critical and essential procedures in minimally invasive surgery.
- the present invention provides an immersive virtual reality simulator type system for minimal access surgery and other surgical procedures, which is characterized in that it comprises: a mechanical interface included in a briefcase, to facilitate its portability, which connects to a screen for simulation of the behavior of a surgery; where said mechanical interface contains two handles that simulate surgical forceps for the immersion of the user's senses; wherein said mechanical interface contains an electronic system that is operatively connected to a screen to generate a visual interface; where said visual interface contains the graphics developed with motor skills exercises; cameras and sensors that provide information about the position and orientation of the user's movements in real time, where said cameras are located in a virtual reality glasses system, such as Oculus Quest or HTC Vive, and the sensors on the handles; where said cameras and sensors are operatively connected to software that allows generating a stereoscopic representation from the images taken by the camera; and where said visual interface has three-dimensional objects with geometries similar to biological and surgical objects that can intervene in surgery.
- the virtual reality system is characterized in that said mechanical interface is included in a portable case.
- the virtual reality system is characterized in that the glasses contain add-ons to achieve a stereoscopic representation of the cameras.
- the virtual reality system is characterized in that it contains a data storage WEB architecture system.
- the virtual reality system is characterized in that said software delivers physical parameters such as: position, orientation, distances and speeds of the simulated grippers based on the user's maneuvers on the handles.
- the surgical forceps system used in the present invention is characterized in that the rotation exerted by said forceps is based on a ball joint.
- the virtual reality system is characterized in that it uses a three-dimensional environment of games and simulations to recreate the training scenarios developed in simulation engines such as Unity 3D or Unreal.
- the virtual reality system is characterized in that three-dimensional models are created that are made in editors. three-dimensional graphics such as 3dMax, Blender, Maya, among others, for said three-dimensional environment of games and simulations.
- the virtual reality system is characterized in that it has a box containing three-dimensional models simulated in the three-dimensional environment of games and simulations.
- the virtual reality system is characterized in that said container box has dimensions that will be in relation to the surgical procedure that is simulated, such as, for example, it has dimensions of 20cm x20cm x25cm for simulations that contemplate gripping and transportation. of objects with surgical forceps.
- the virtual reality system is characterized in that it includes a system for presenting results of the user's activity in the simulations, where said results are presented visually on the screen or sent via WEB.
- the present invention also provides a device for obtaining virtual reality simulations of multiple surgeries, which is characterized in that it comprises: a mechanical interface that connects to a screen for viewing the simulation of a surgery process; where said mechanical interface contains two handles that simulate surgical forceps for the immersion of the user's senses; and where said mechanical interface stores the information of the simulations carried out in an electronic device.
- FIG. 1 is a photograph of the simulator object of the invention, when it is used by a surgical professional in a training center.
- FIG. 2 illustrates the configuration of the parts that make up the rotation of the clamp-type handle in an exploded view with a cross section.
- FIG. 3 illustrates the mechanical and geometric configuration of the simulation mechanism of the surgical forceps in a profile view with a longitudinal section.
- FIG. 4 illustrates a diagram of the degrees of freedom that the grippers have in rotational movements, in a rectangular coordinate configuration.
- FIG. 5 illustrates the internal components contained in the carrying case, where you can see a protective foam and the coupling of the simulator controllers.
- FIG. 6 illustrates two photographs from different angles of the portable simulator, where its components can be seen, including: the carrying case, the virtual reality glasses and the mechanical interface created to imitate the operation of the clamps attached to the controllers of the glasses .
- FIG. 7 illustrates a visualization of a simulation with some elements used during said simulation, such as: forceps and biological or surgical objects.
- the present invention details a system and a device that offers a technological tool that consists of a system that performs virtual reality simulations for training in various surgeries, focused for use by medical students or other health-related careers, for practice. and evaluation of their management in this type of situations, as well as by health professionals to train before each new surgery, thus reducing preparation times, and improving motor skills and movements characteristic of different surgical interventions.
- This system and device offer the possibility of reducing the surgeon's adaptability times before each surgery, as well as, given its portability, it gives the possibility of training in different places, facilitating training from home and not necessarily from a hospital center.
- This technology is a briefcase type model (3d) as in FIG. 5, which contains an electronic system (1d) capable of connecting to a screen for use, which is installed on a protective foam (2d).
- the advantages of the system proposed in the present invention are its portability, since it allows it to be moved from one place to another, in a briefcase that includes the virtual reality device, and the interface is attached to it. electromechanical that is attached to a work table.
- the system does not include cables, it is enough to have a Wi-Fi network so that the training can be carried out, allowing mobility to the practitioner, and if there is no connectivity, it can be worked in autonomous mode, allowing the training data to be sent in a deferred manner.
- the immersive virtual reality simulator system for minimal access surgery of the invention is characterized in that it comprises: a mechanical interface that connects to a screen for the simulation of the behavior of a surgery; where said mechanical interface contains two handles that simulate surgical forceps for the immersion of the user's senses; wherein said mechanical interface contains an electronic system that is operatively connected to a screen to generate a visual interface; where said visual interface contains the graphics developed with motor skills exercises; cameras and sensors that provide information about the position and orientation of the user's movements in real time, where said cameras are located in a virtual reality glasses system, for example Oculus Quest, and the sensors in the handles; where said cameras and sensors are operatively connected to software that allows generating a stereoscopic representation from the images taken by the camera; and where said visual interface has three-dimensional objects with geometries similar to biological and surgical objects that can intervene in surgery.
- a handle will be understood as a system composed of several mechanical parts where the user of this invention interacts to simulate surgical forceps.
- the virtual reality system is characterized in that said mechanical interface is included in a portable case.
- a carrying case will be understood as a case that contains all the elements of the system of the present invention, to be able to be transported and used in the place where the user finds relevant.
- a simulator assembly will be understood as the structure that contains a base where the entire mechanical structure of the clamps and the electronics that connect to a device are supported. screen.
- protective foam will be understood as a foam of variable geometry that is located inside the carrying case and that protects the entire structure of the simulator assembly. .
- the virtual reality system is characterized in that it contains a system for importing models of different possible surgeries.
- the virtual reality system is characterized in that it contains a data storage WEB architecture system.
- the virtual reality system is characterized in that said software delivers physical parameters such as: position, orientation, distances and speeds of the user.
- the system of surgical forceps used in the present invention is characterized in that the rotation exerted by said forceps is based on a ball joint (5a) that can be seen in FIG. 2, where an axis (2a) is connected, coupled by means of rings (3a) (6a) on a base support plate (4a), which contains a fixing system with bolts (1 a) and nuts (7a).
- said coupling is observed in the lower part of the complete structure in a profile view, while in the upper part it is seen how the axis (2a) is connected to the linear bearings (8a) where the user (controller) interacts.
- said shaft in the upper part consists of a cover (10a) and a fastening system (9a).
- the virtual reality system uses the Unity 3D gaming and simulation environment (Ronghai Wang, April 6, 2017; A surgical training system for four medical punctures based on virtual reality and haptic feedback; 2017 IEEE Symposiumon 3D User Interfaces (3DUI) ) to take advantage of the ease of incorporating graphic features and physical behaviors.
- the virtual reality system has three-dimensional models of the objects that are going to be used in the scene, all of these made in 3dMax (L ⁇ Yaqin, June 22-24, 2010; Theapplyingresearchfor 3D meshmodelswatermarkingbasedon 3D MAX; 2010 2nd International ConferenceonEducationTechnology and Computer). These are located at the origin of the coordinate system and their vertices are updated according to the scale of the object using the Xform modifier (MikkoHonkala, July 2006; Multimodal interactionwithxforms; Proceedingsofthe 6th internationalconferenceon Web engineering).
- the virtual reality system is characterized in that it has a box containing three-dimensional models simulated in the three-dimensional environment of games and simulations.
- the container box of the virtual reality system of the invention can have variable dimensions depending on the surgical procedure that is desired to be simulated, and in an additional preferred embodiment said container box, for example, has dimensions of 20cm x20cm x25 cm. in the three-dimensional environment of games and simulations as shown in FIG. 7.
- the virtual reality system is characterized in that it contains a system for presenting results visually or sent via WEB.
- the present invention also provides a device for obtaining virtual reality simulations of multiple surgeries, which is characterized in that it comprises: a mechanical interface that connects to a screen for viewing the simulation of the behavior of a surgery; where said mechanical interface contains two handles that simulate surgical forceps for the immersion of the user's senses; where said mechanical interface is included in a portable case; and where said mechanical interface stores the information from the simulations in an electronic device.
- the simulator has a persistent scene, responsible for maintaining objects throughout the simulation, two exercise scenes and a scene for the presentation of results of the training sessions.
- OVRCameraRig It is the tracking space for virtual reality glasses, which has a virtual reality camera that replaces the camera conventional Unity environment. Provides access to the interface with the hardware. It can be seen how in this same element “child” is put, from the right controller to the prefab that contains the right gripper model.
- the coordination scene is created to carry out a first practice exercise that allows the user to begin to become familiar with the synchronized work between the hands and the direction of vision. It uses the environment of the containing box and incorporates five spheres of a first color and five spheres of a second color. The spheres of the first color must be “touched” by the left clamp and the spheres of the second color must be touched by the right clamp. There is also a sphere of a third color, which if touched by any clamp, the exercise ends indicating that a serious error has occurred. The spheres behave inside the box according to a random movement in the horizontal plane. This scene also has an error detection system that stores how many spheres have been touched with the wrong gripper or if a serious error has occurred. Additionally, the exercise time is stored.
- the objective of the results presentation scene is to allow the simulation participant to observe a summary of their activity in the practices. This information is collected from the network and displayed on the device through a curved interface that allows observation of the data.
- a ball joint (5a) is created, which allows the Pitch and Yaw rotations, described in FIG. 4. You can see the joint, included in the support base and attached to that base by two rings, one upper and one lower. These rings are joined by a screw (1a) and a nut (7a) to the base support plate (4a).
- FIG. 3 shows how linear bearings (8a) are the connection between the axis and the user's hands. This union guarantees the movement in depth and rotation of the instrument around its axis (Roll).
- the fastening system for the virtual reality glasses controls was designed and built using three anchor points, thus ensuring correct position. These points were made with a non-slip material, to provide better grip in the turning and translation efforts that occur in the daily use of the simulator.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Theoretical Computer Science (AREA)
- Business, Economics & Management (AREA)
- Educational Administration (AREA)
- Educational Technology (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Surgery (AREA)
- Mathematical Physics (AREA)
- Molecular Biology (AREA)
- Mathematical Analysis (AREA)
- Mathematical Optimization (AREA)
- Algebra (AREA)
- Pure & Applied Mathematics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Medicinal Chemistry (AREA)
- Chemical & Material Sciences (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Computational Mathematics (AREA)
- Animal Behavior & Ethology (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Processing Or Creating Images (AREA)
- Manipulator (AREA)
- General Engineering & Computer Science (AREA)
- Optics & Photonics (AREA)
- Human Computer Interaction (AREA)
- Entrepreneurship & Innovation (AREA)
Abstract
Description
Claims
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US18/868,156 US20250273088A1 (en) | 2022-05-24 | 2023-05-24 | Simulator based on immersive virtual reality for surgical procedure training |
| CN202380049624.XA CN119422188A (zh) | 2022-05-24 | 2023-05-24 | 基于沉浸式虚拟现实的外科手术训练的模拟器 |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CL2022001356A CL2022001356A1 (es) | 2022-05-24 | 2022-05-24 | Simulador basado en realidad virtual inmersiva para entrenamiento de procedimientos quirúrgicos |
| CL1356-2022 | 2022-05-24 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2023225768A1 true WO2023225768A1 (es) | 2023-11-30 |
Family
ID=83897884
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/CL2023/050043 Ceased WO2023225768A1 (es) | 2022-05-24 | 2023-05-24 | Simulador basado en realidad virtual inmersiva para entrenamiento de procedimientos quirúrgicos |
Country Status (5)
| Country | Link |
|---|---|
| US (1) | US20250273088A1 (es) |
| CN (1) | CN119422188A (es) |
| AR (1) | AR129417A1 (es) |
| CL (1) | CL2022001356A1 (es) |
| WO (1) | WO2023225768A1 (es) |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130230837A1 (en) * | 2012-03-01 | 2013-09-05 | Simquest Llc | Microsurgery simulator |
| US20170213480A1 (en) * | 2013-03-15 | 2017-07-27 | Mark B. Ratcliffe | System and method for performing virtual surgery |
| EP3482710A1 (en) * | 2017-11-14 | 2019-05-15 | Stryker Corporation | Patient-specific preoperative planning simulation techniques |
| WO2021207661A1 (en) * | 2020-04-10 | 2021-10-14 | Howmedica Osteonics Corp. | Simulation of minimally invasive surgery procedures |
| JP7055988B2 (ja) * | 2016-09-29 | 2022-04-19 | シンバイオニクス リミテッド | 仮想現実環境または拡張現実環境の中の手術室内での医療シミュレーションのための方法およびシステム |
-
2022
- 2022-05-24 CL CL2022001356A patent/CL2022001356A1/es unknown
-
2023
- 2023-05-24 WO PCT/CL2023/050043 patent/WO2023225768A1/es not_active Ceased
- 2023-05-24 US US18/868,156 patent/US20250273088A1/en active Pending
- 2023-05-24 AR ARP230101300A patent/AR129417A1/es unknown
- 2023-05-24 CN CN202380049624.XA patent/CN119422188A/zh active Pending
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20130230837A1 (en) * | 2012-03-01 | 2013-09-05 | Simquest Llc | Microsurgery simulator |
| US20170213480A1 (en) * | 2013-03-15 | 2017-07-27 | Mark B. Ratcliffe | System and method for performing virtual surgery |
| JP7055988B2 (ja) * | 2016-09-29 | 2022-04-19 | シンバイオニクス リミテッド | 仮想現実環境または拡張現実環境の中の手術室内での医療シミュレーションのための方法およびシステム |
| EP3482710A1 (en) * | 2017-11-14 | 2019-05-15 | Stryker Corporation | Patient-specific preoperative planning simulation techniques |
| WO2021207661A1 (en) * | 2020-04-10 | 2021-10-14 | Howmedica Osteonics Corp. | Simulation of minimally invasive surgery procedures |
Also Published As
| Publication number | Publication date |
|---|---|
| AR129417A1 (es) | 2024-08-21 |
| CL2022001356A1 (es) | 2022-10-28 |
| CN119422188A (zh) | 2025-02-11 |
| US20250273088A1 (en) | 2025-08-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| ES2597809T3 (es) | Sistema de simulación para adiestramiento en cirugía artroscópica | |
| Escobar-Castillejos et al. | A review of simulators with haptic devices for medical training | |
| Tendick et al. | A virtual environment testbed for training laparoscopic surgical skills | |
| EP1609431B1 (en) | Haptic device for use in surgical simulation systems | |
| Reznek et al. | Virtual reality and simulation: training the future emergency physician | |
| Coleman et al. | Virtual reality and laparoscopic surgery | |
| ES2301660T3 (es) | Simulador de parto. | |
| US5882206A (en) | Virtual surgery system | |
| Sun et al. | Design and development of a da vinci surgical system simulator | |
| US9786202B2 (en) | Robot assisted surgical training | |
| CN102207997A (zh) | 基于力反馈的机器人微创手术仿真系统 | |
| CN115662234B (zh) | 一种基于虚拟现实的胸腔镜手术示教系统 | |
| CN111276032A (zh) | 一种虚拟手术训练系统 | |
| WO2023225768A1 (es) | Simulador basado en realidad virtual inmersiva para entrenamiento de procedimientos quirúrgicos | |
| Seo et al. | Anatomy builder VR: Embodied VR anatomy learning program to promote constructionist learning | |
| Reis et al. | A framework for simulation systems and technologies for medical training | |
| Riener et al. | VR for medical training | |
| Shibuya et al. | Proposal of simulation-based surgical navigation and development of laparoscopic surgical simulator that reflects motion of surgical instruments in real-world | |
| Malota et al. | Benchmarking for surgery simulators | |
| Nawrat et al. | Robin Heart system modelling and training in virtual reality | |
| Rasool et al. | Image-driven haptic simulation of arthroscopic surgery | |
| Obeid | Development and Validation of a Hybrid Virtual/Physical Nuss Procedure Surgical Trainer | |
| Li et al. | Key technology of Laparoscopic Surgery Training System Based on Virtual Reality Technology | |
| Kannangara et al. | Hardware interface for haptic feedback in laparoscopic surgery simulators | |
| Büyüköztekin | Surgery Simulator Design for Minimally Invasive Pituitary Gland Surgery |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23810517 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 18868156 Country of ref document: US |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 202380049624.X Country of ref document: CN |
|
| WWP | Wipo information: published in national office |
Ref document number: 202380049624.X Country of ref document: CN |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 23810517 Country of ref document: EP Kind code of ref document: A1 |
|
| WWP | Wipo information: published in national office |
Ref document number: 18868156 Country of ref document: US |