WO2023218156A1 - Connexion plug'n play - Google Patents
Connexion plug'n play Download PDFInfo
- Publication number
- WO2023218156A1 WO2023218156A1 PCT/FR2023/050697 FR2023050697W WO2023218156A1 WO 2023218156 A1 WO2023218156 A1 WO 2023218156A1 FR 2023050697 W FR2023050697 W FR 2023050697W WO 2023218156 A1 WO2023218156 A1 WO 2023218156A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- surgical
- simulation tool
- haptic controller
- tool
- connector
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B23/00—Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes
- G09B23/28—Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes for medicine
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B19/00—Teaching not covered by other main groups of this subclass
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/30—Surgical robots
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/70—Manipulators specially adapted for use in surgery
- A61B34/76—Manipulators having means for providing feel, e.g. force or tactile feedback
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09B—EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS
- G09B23/00—Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes
- G09B23/28—Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes for medicine
- G09B23/285—Models for scientific, medical, or mathematical purposes, e.g. full-sized devices for demonstration purposes for medicine for injections, endoscopy, bronchoscopy, sigmoidscopy, insertion of contraceptive devices or enemas
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
- A61B34/10—Computer-aided planning, simulation or modelling of surgical operations
- A61B2034/101—Computer-aided simulation of surgical operations
- A61B2034/102—Modelling of surgical devices, implants or prosthesis
- A61B2034/104—Modelling the effect of the tool, e.g. the effect of an implanted prosthesis or for predicting the effect of ablation or burring
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
- A61B90/36—Image-producing devices or illumination devices not otherwise provided for
- A61B2090/364—Correlation of different images or relation of image positions in respect to the body
- A61B2090/365—Correlation of different images or relation of image positions in respect to the body augmented reality, i.e. correlating a live optical image with another image
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B2560/00—Constructional details of operational features of apparatus; Accessories for medical measuring apparatus
- A61B2560/02—Operational features
- A61B2560/0223—Operational features of calibration, e.g. protocols for calibrating sensors
Definitions
- the present invention relates to a system for connecting a surgical simulation tool to a haptic controller in a surgical training platform.
- the present invention therefore lies in the field of educational and teaching tools, methods and materials. More particularly, the invention relates to a connection system for a surgical procedure training kit, intended for the training of surgeons.
- the aim of the present invention is therefore to provide a safe, practical, precise, realistic, easy to use and readily available training device, making it possible to give any surgical student a chance to train in an environment safe without any risk of injury to yourself, a patient or an animal.
- the user must, in in addition, being able to easily connect a surgical simulation tool to the platform and be able to manipulate it without fear of tearing it off during the simulation. Also, the user must be able to change the tools compatible with the simulation as they wish, without difficulty, and in a fluid manner.
- This invention therefore relates to a surgical training platform configured to interface a haptic controller with a surgical simulation tool comprising:
- At least one surgical simulation tool having at least one free end extending along a first axis Ai
- at least one haptic controller comprising a connection system configured to connect mechanically and electrically, in a reversible manner, the at least one tool of surgical simulation, the control system further including a system for recognizing each surgical simulation tool configured to obtain identification information specific to the surgical simulation tool connected to the haptic controller, and communicating the identification information to the control system so that the control system recognizes each surgical simulation tool connected to the haptic controller.
- connection system comprises at least one connector extending along a second axis A2, the at least one connector comprising a first coupling element complementary to a corresponding coupling element of the free end of each surgical simulation tool, the coupling elements of the connector and the free end of each surgical simulation tool are configured to cooperate in a co-axial manner by alignment of the axes Ai and A2, so that the connection between the haptic controller and each surgical simulation tool is made axially, once connected to each other, each movement of the surgical simulation tool induces a corresponding movement of the mobile haptic controller.
- the platform according to the present invention allows a robust mechanical and electrical connection between the tool and the haptic controller, while allowing the user to change tools without leaving their simulation.
- the platform according to the invention may comprise one or more of the following characteristics, taken separately from each other or combined with each other:
- connection system of the haptic controller makes it possible to connect at least two different surgical simulation tools, the at least one connector is configured to cooperate with the free end of the surgical simulation tool,
- the at least one connector is a key-lock type locking connector configured to cooperate with the free end of the surgical simulation tool
- connection system comprises a first fixed connector to the haptic controller and a second connector fixed to the free end of the surgical simulation tool, the two connectors being configured to cooperate with each other
- the haptic controller comprises a movable arm, the movable arm having a free end intended to cooperate with the connection system
- connection system allows the passage of electric current between the haptic controller and the connected surgical simulation tool, so as to supply the surgical simulation tool with current
- connection system allows the passage of electric current between the system control and the connected surgical simulation tool, so as to supply current to the surgical simulation tool
- each connector includes a magnet so that the connection is magnetized.
- Figure 1 is an overall perspective view of a dismantled platform according to the present invention
- FIG. 2 is an overall perspective view of a disassembled platform according to the present invention, shown with two different surgical training tools each of which can be connected to the platform,
- Figure 3 is a view similar to Figure 2 from a different angle
- Figure 4 A is a perspective view of a training platform mounted according to the invention, connected to a surgical training tool, comprising a single training module,
- Figure 4B is a perspective view of a training platform mounted according to the invention, comprising two training modules, connected to two surgical training modules,
- FIG. 5 is a perspective view of a kit according to the present invention, manipulated by a user according to a first embodiment
- FIG. 6 is a perspective view of a kit according to the present invention, manipulated by a user according to a second embodiment
- Figure 7 is an exploded view of a control module
- FIG. 8A is a perspective view of a calibration element associated with the display device according to the invention.
- Figure 8B is a perspective view of the calibration module
- Figure 9A is a perspective view of a haptic controller connector according to the invention.
- FIG. 9B is a perspective view of a surgical training tool connector according to the invention.
- Figure 10 is a perspective view of a surgical training tool
- Figure 11 is a perspective view of an example of virtual environment according to the invention
- FIG. 12 and 13 are detailed views of a connection between a surgical simulation tool and the platform according to two different embodiments
- Figure 14 is a perspective view of a haptic controller according to the invention, with all the joints.
- the present invention relates to a surgical training platform (for example modular) 10 configured to interface a virtual environment 100 comprising at least one mobile virtual surgical element 102 (see Figure 11) .
- This virtual environment also includes a virtual patient 104 and different decorative elements 106.
- a user manipulating the modular platform 10 interacts with the virtual environment 100 in which all kinds of surgical operations are possible.
- the modular platform 10 comprises:
- a virtual reality display device 12 configured to show/display to the user the virtual environment 100
- each training module comprising a haptic controller 18, possibly another optional module (not shown) capable of providing an additional function when simulation,
- the display device 12 forms the link between the different training modules 16 and the virtual environment 100.
- the drive modules 16 and calibration modules 14 are the only element(s) manipulated by the user and the rendering of these manipulations is not visible. than in the virtual environment 100.
- Each drive module is an autonomous entity comprising several plastic parts assembled together. These parts can be 3D printed. All of these parts will be described as this description progresses.
- each mobile virtual surgical element 102 and each virtual movement of each of these mobile virtual surgical elements 102 present in the virtual environment 100 is made visible to the user by the display device 12.
- the display device 12 (visible in Figures 5 and 6) can be a fixed element in space (such as a screen) or a mobile element in space, for example, configured to be carried by the user during the surgical operation.
- the display device 12 may include several displays, allowing several users to view the virtual environment 100. The different displays may be mobile or fixed. More precisely, as visible in Figures 5 and 6, the display system 12 can be a screen placed on a surface near or at a distance from the different modules 14, 16.
- the display device 12 may be a virtual reality headset, adjustable to the user and capable of providing audio feedback. More specifically, it may be an HP reverb® headset with two screens with a resolution of 2160x2160 pixels. Each screen has a display frequency of 90 Hz.
- the display device 12 is connected to the control system 20 preferably by a cable (for example a displayport or HDMI cable).
- the display device 12 is associated with a mobile calibration tool 22 (see Figure 8B).
- the mobile calibration tool 22 can take the form of a classic joystick as for example illustrated in Figure 8B but it can also take a different shape.
- the calibration module 14 is an independent part shown in Figure 8 A. As visible in Figure 8B, the calibration module 14 includes a footprint 24 complementary to the mobile calibration tool 22. Thus, the calibration module 14 makes it possible to position the mobile calibration tool 22 associated with the display device 12 at a known and fixed distance from the drive module 16, in particular from the haptic controller 18 thereof (see Figure 4A).
- the calibration module 14 is preferably made of plastic. It is preferably printed in 3D.
- the calibration module 14 may include magnets, as will be explained in detail below.
- the calibration module 14 can also be provided with an electrical connector allowing the connection of an electronic circuit for identifying the calibration module 14 by the control system 20. For this, the same device comprising a voltage divider bridge is used. than that used for the key-lock connector of the haptic controller 18, which will be described a little below.
- the haptic controller 18 makes it possible to know the position and relative orientation of an object attached to it (see below), we then obtain the position and orientation of this object relative to the tool. mobile calibration 22.
- the calibration module 14 also makes it possible to locate the user in relation to the drive module 16. Indeed, the position of the mobile calibration tool 22 relative to the display device 12 being known, we can then know the position and orientation of the object connected to the haptic controller 18 relative to the user who is wearing the display device 12 (see Figures 5 and 6).
- the different drive modules 16 connected to each other or to the calibration module 14 can be positioned and located by the display device 12, given that once the different modules 14, 16 are connected to each other , they are all at a fixed and known distance from the calibration module 14 and therefore from the mobile calibration tool 22 (see Figures 4A and 4B).
- the possible identification of the different modules 16 through an electronic system can make it possible to know this distance in a “plug and play” manner.
- the mobile calibration tool 22 associated with the display device 12 serves as a calibration reference for each module training, therefore of each haptic controller 18 and therefore of each of the physical elements manipulated by the user of the platform 10.
- a shock can lead to untimely movement of the drive module(s) 16 and therefore of the calibration module 14 which is connected to it, for example in relation to the display system 12. This can lead to a break in calibration between the virtual environment 100 and the position of the user. This can be avoided by the use of an electronic system comprising an accelerometer making it possible, on the one hand, to detect this type of unwanted movement and, on the other hand, to adapt the digital positioning of the virtual environment 100 to the new position of the calibration module 14 with the mobile calibration tool 22.
- the different drive modules 16 can be connected together, so as to form a control console 26 (see Figure 4B).
- the control console 26 thus comprises at least one drive module 16 (see Figure 2). More particularly, all of the modules 14, 16 are configured to be fixed to each other in a reversible manner in a known configuration (see Figures 4 A and 4B). This allows the modularity of the platform 10 according to the invention.
- the drive module(s) 16 forming the control console 26 can either be connected directly to each other, or connected to each other by means of spacer modules 28 (see Figures 4A and 4B) .
- the spacer modules 28 are made of plastic and are preferably produced by 3D printing, layer deposition or sintering. According to other embodiments, they can be manufactured by molding or other process subsequently.
- the spacing modules 28 are connection parts making it possible to create a known spacing (hence a positioning) between the different modules 14, 16 of the platform 10.
- Each calibration module 14 or drive module 16 comprises for this purpose, a base 30 having a specific shape (see Figure 7).
- the shapes of the different bases 30 of the different modules 14, 16 are complementary to each other, so as to obtain a stable and suitable nesting of the different modules 14, 16, 28 between them.
- the known appearance of the bases 30 of the different modules 14, 16, 28 makes it easy to determine the relative position of the modules 14, 16, 28 in space.
- the calibration modules 14 and drive modules 16 are connected to each other by means of the spacing modules 28 in order to increase the stability of the control console and the platform 10 as a whole when the latter is assembled. .
- each base 30 of each module 14, 16, 28 comprises at least one magnet 32 intended to cooperate with a corresponding magnet 32 of a base 30 of a complementary module 14, 16, 28, thus forming a connection point magnetic.
- the magnets 32 are grouped in threes at each magnetic connection point.
- the polarity of the magnets 32 is chosen so that the spacing modules 28 and the others modules (calibration modules 14 and drive modules 16) attract each other.
- the physical connection may, in addition, include an electronic connector 34 allowing electronic communication between the different modules 14, 16, 28 and the control system 20 (see Figures 1, 2, 7 and 8A).
- each spacing module 28 can accommodate at each magnetic connection point , in addition, an electronic connector 34 intended to cooperate with a connector electronics of the base 30 of the calibration and/or training modules 16. Electronic communication between the different modules 14, 16, 28 is therefore ensured, whether the calibration modules 14 and training modules 16 are connected together directly to the means of a spacing module 28.
- Each electronic connector 34 can be connected to a cable to connect the electronic connector of the corresponding connected module.
- These electronic connectors 34 can, for example, take the form of spring-mounted/retractable pin connectors.
- each electronic connector 34 associated with a drive module 16 comprises, for example, a voltage divider bridge generating a voltage specific to each drive module 16. This makes it possible to identify the drive module 16 by reading the voltage generated by the voltage divider bridge.
- the electronic connector 34 is part of a more complex electronic circuit capable of engaging in digital communication (for example meeting the “UART” standard).
- the control system 20 comprises a microcontroller itself electrically connected, through the connectors 34 and potentially the spacing modules 28, to the calibration modules 14 and drive modules 16. This connection will be detailed below.
- the different calibration modules 14 and/or drive 16 integrate a voltage divider system. THE microcontroller then reads the voltage and is capable of identifying the module(s) 14, 16 which respond(s) with this voltage.
- the calibration modules 14 and/or drive modules 16 each include an electronic card 42 allowing digital communication with the microcontroller of the drive module 16. They identify each other and are capable of exchange information concerning a user action but also feedback to the user of the control system 20 (we can imagine for example a module which lights up in red if an error is made in the manipulation).
- each drive module 16 comprises a haptic controller 18.
- Each haptic controller 18 includes a connection system 35 configured to mechanically connect, in a reversible manner, a surgical training tool or a surgical simulation tool 36.
- the surgical training platform is specifically configured to interface the haptic controller 18 with at least one surgical simulation tool 36.
- the surgical training kit thus formed (see Figures 5 and 6), therefore comprises a modular surgical training platform 16, an example of which is described in the present description and at least one surgical simulation tool 36 configured to be connected to the controller haptic 18 of said platform 10.
- the kit according to the present invention may include three types of surgical simulation tools 36: the tools represented to the user in virtual reality 100 called "simple”, the tools represented to the user in virtual reality lOO called "complex”, and
- the complex surgical simulation tools 36 are complex electronic tools which integrate a microcontroller capable of communicating directly with the control system 20.
- the surgical training tools 36 represented to the user, simple or complex, are modified surgical tools or copies thereof.
- the simulation enabled by the platform 10 according to the present invention thus matches all or part of the physical actions to which these objects are subjected with the behaviors of the virtual twins in the virtual environment 100 displayed by the display device 12 (see Figures 5 and 6).
- the tools not shown make it possible to simulate sensations, for example for palpation of organ(s) inside a patient.
- Each surgical simulation tool 36 having at least one free end extending along a first axis Ai.
- the haptic controller 18 of each drive module 16 comprises a robot with a pivoting arm, the robot with a pivoting arm having a free end intended to cooperate with the system connection 35.
- the haptic controller 18 is movable in at least six degrees of freedom obtained by means of various elbows and rotating parts cooperating with each other so as to form joints Ji, J2, J3, J4 , J5, Jé. More precisely, and as visible in Figure 6, the first three joints (distal joints) are operable by the user while the last three joints (proximal joints) are passive.
- the surgical simulation tool 36 In order to maximize the realism of the simulation, the surgical simulation tool 36, once connected to the haptic controller 18, must have its tip (or its end free) positioned where the haptic feedback would occur in reality, i.e. at the haptic point of the haptic arm.
- This haptic point is designated as “HIP” in Figure 14.
- the haptic controller 18 simulates force feedback related to collision or interactions in the virtual world of the tip (or end) of the simulation tool surgical 36 manipulated with an element of the virtual environment 100. This is the point at which the interactions and collisions are calculated to be able to simulate them without creating a shift or a haptic inconsistency, uncomfortable and disturbing, for the user.
- this haptic point HIP makes it possible to simulate the penetration of a patient's body, for example by the needle of a syringe, by simulating the constraint exerted by the patient's body on the needle. It is therefore very important that the surgical simulation tool 36 and the haptic controller 18 are connected with precision and robustness.
- connection system 35 of the haptic controller 18 is universal, in the sense that it makes it possible to connect at least two different surgical training tools 36 (see Figure 2).
- connection system 35 comprises at least one connector 35a extending along a second axis A2.
- This connector 35a comprises a first coupling element 44a complementary to a corresponding coupling element 44b of the free end of each surgical simulation tool 36
- connection system 35 comprises at least one locking connector 35a of the key-lock type configured to be fixed to the haptic controller 18 and to any surgical training tool 36 so as to ensure their removable connection (see figures 3, 9A and 9B).
- the coupling elements 44a, 44b of the connector 35a and the free end of each surgical simulation tool 36 are configured to cooperate coaxially by aligning the axes Ai and A2, so that the connection 35 between the haptic controller 18 and each surgical simulation tool 36 is done axially.
- each movement of the surgical simulation tool 36 induces a corresponding movement of the mobile haptic controller 18.
- the connectors 35a, 35b also allow transmission of rotation along the axis of the end of the haptic controller 18 to the drive module 16.
- the at least one connector 35a is configured to cooperate with the free end of the surgical simulation tool 36.
- the connection system 35 comprises two connectors 35a, 35b, in particular two connectors 35a, 35b with locking 35a, 35b of the key-lock type: a first connector 35a attached to the haptic controller 18 and configured to cooperate removably with a corresponding second connector 35b attached to the surgical training tool 36.
- the two connectors 35a, 35b can both be attached reversibly, either to the haptic controller 18, or to the surgical training tool 36.
- the two connectors 35a, 35b are obtained by 3D printing, either by layer deposition, or by sintering.
- Figure 9A represents the first connector 35a (here the lock) of the haptic controller 18 and Figure 9B represents the second connector 35b (here the key) intended to cooperate with the surgical training tool 36.
- Fixing the first connector 35a on the haptic controller 18 can be done in several ways. In the case of illustration 9 A, a jack interface already present originally on the haptic controller 18 was used to fix it. In other embodiments, one could consider sticking the first connector 35a or adapting to another haptic controller 18 by creating a form of interface specific to the latter.
- the second connector 35b is preferably fixed by gluing to the surgical training tool 36. This mainly involves bonding at the distal stem of the surgical driving tool 36.
- the 3D model of the second connector 35b is adapted by providing, on the face not visible in FIG. 9B, a drilling corresponding to the end of the distal rod 360 of the surgical driving tool 36. Then the distal rod is glued into the second connector 35b by means, for example, of epoxy.
- This manufacturing process is not the only one that is implemented. According to alternative embodiments, one could also imagine 3D printing a reproduction of a surgical training tool 36 whose model would contain the second connector 35b.
- connection 35, of the lock key type by alignment of the axes Ai and A2 ensures a collinearity constraint along the axis the surgical training tool 36 and the haptic controller 18) are therefore completely constrained in all directions.
- the connection system 35 may comprise, on each side of the “key-lock” system, at least one magnet 38 (see figure 9A, 9B).
- the magnets 38 used are cubic magnets having a magnetization force of 1.1 kg.
- the magnets 38 used are neodymium magnets (cubic).
- ring magnets 38 are used. These allow a stainless steel rod to pass inside themselves and avoid any impact of shear forces, increasing the stability of the connection 35. This value allows both solidity of the attachment but also easy disconnection of the surgical training tool 36, with the desired aim of creating a “plug and play” interface.
- the magnets 38 provide a contact constraint between the two connectors 35a, 35b.
- connection 35 may further comprise a screw configured to cooperate along an axis normal to the axes Ai and A2 once aligned, so as to be normal to the pivot of the haptic controller 18 (see Figure 13).
- connection 35 may be keyed to prevent rotation of the coupling elements 44a, 44b relative to each other. This ensures a firm link between connection 35 and haptic controller 18.
- the coupling elements 44a, 44b of the connector 35a and the free end of each surgical simulation tool 36 include a combination of a hole intended to cooperate with a protruding rod in the tool to avoid any force effect shear which would lead to untimely disconnection of the coupling elements 44a, 44b
- the two connectors 35a, 35b are thus completely constrained in all directions, except the direction collinear with the axis A2 of the end of the haptic controller 18.
- the magnetization makes it possible to constrain/maintain the connection 35 also in this axial direction according to Ai and A2.
- the breaking force of this constraint (and therefore breaking the “key-lock” connection 35) is weaker along the axis A1-A2 because the force of the magnets 38 is not very great.
- the result obtained is therefore that the two connectors 35a, 35b separate by pulling on the surgical driving tool 36 with greater force than is necessary to cause the movement of the haptic controller 18.
- magnets 38 facilitates the connection and disconnection between the surgical training tool and the haptic controller 18.
- the magnets 38 allow a simple connection/disconnection gesture (“plug and play” type) without screws or slides: the user approaches the surgical training tool 36 of the haptic controller 18 and the latter connects alone by the action of the magnets 38.
- the key-lock type connection system 35 has three distinct and complementary functionalities:
- connection system 35 thus has an electronic component.
- Each of the connectors 35a, 35b thus comprises a slot, a groove or a hollow 37 intended for the insertion of an electrical connector (not shown in Figures 9A, 9B).
- this electrical connector is a JST electrical connector having pins, retractable or not, but other types of connectors electric can be used.
- the male part of the electrical connector is inserted into the slot 37 of the first connector 35a fixed to the end of the haptic controller arm 18.
- the female part of the electrical connector is inserted into the slot 37 of the second connector 35b of the surgical driving tool 36.
- FIG. 12-13 it is a spring-loaded “pogo pin” placed in a circular manner around the alignment axes Ai and A2.
- the coupling elements 44a, 44b of the connector 35a and the free end of each surgical simulation tool 36 are aligned using a key (for example a protuberance on the lock and light/holes on the key of the 'tool).
- a keyed connection 35 allows alignment of the electrical pins and prevents unintentional contact between non-compatible pins.
- Certain embodiments integrate a spring because the use of spring-loaded pins makes perfect contact between all the pins and allows almost zero friction.
- the use of 38 magnets ensures powerful contact between all pins.
- a cable 39 connects the pins of the electrical connector to the control system 20.
- this cable 39 is connected to the control module 16.
- the cable 39 can be disconnected from the control module 16, as visible in Figure 12. This connection between the cable 39 and the control module 16 is preferably made by means of “plug and play” or “snap fit” magnetic connectors.
- connection system 35 Another advantage of the connection system 35 according to the present invention is the simplicity with which it is possible to change the surgical simulation tool 36 to the haptic controller 18. It is necessary that this change be simple and rapid so as not to clutter learning complex manipulations. It is therefore necessary to provide a “plug and play” device, as the present invention does.
- Each haptic controller 18 is, moreover, configured to measure each movement in the space of the surgical training tool 36 once it is connected to the haptic controller 18.
- Each haptic controller 18 is thus provided with at least one translation or external rotation sensor 19 fixed on the different movable elements of the haptic controller 18 (see Figure 1), so as to sense the position and the three-dimensional orientation of any object connected to the haptic controller 18 of the drive module 16.
- complex surgical training tools 36 presenting a resting state and at least one activation state, such as pressing a trigger or rotating the an element and comprising an on-board electronic card.
- the haptic controller 18 makes it possible to measure the external movements (movements in space) of each connected surgical simulation tool 36.
- connection system 35 can also play one or more roles other than the identification of the surgical training tool 36 connected to a haptic controller 18:
- the complex surgical simulation tools 36 have a microcontroller capable of communicating directly with the control system 20, and this means of communication is therefore preferred.
- the connection to the haptic controller 18 through the connection system 35 is especially useful physically and mechanically.
- the advantage that this connection system 35 presents for complex tools is that, by connecting the tool, it is possible to detect whether the tool is plugged in or not.
- connection system 35 allows the passage of electric current between the haptic controller 18 or the control system 20 directly and the surgical simulation tool 36 connected, so as to supply it with current.
- the haptic controller 18 is bypassed (with respect to the power supply) and the power supply does not pass through it.
- the platform 10 makes it possible to connect several drive modules 16 to each other, to the calibration module 14 and to the control system 20, the platform 10 thus makes it possible to determine the positioning in space of several surgical training tools 36 connected to the different haptic controllers 18. If the control console 26 comprises several training modules 16, the platform 10 allows the determination of the positioning of several surgical training tools 36 simultaneously, as soon as these are connected to a haptic controller 18.
- the control system 20 of the platform 10 further comprises a recognition system 40 of each surgical simulation tool 36. More precisely, the recognition system 40 of the control system 20 is configured to obtain a specific identification information of each surgical simulation tool 36 connected to the haptic controller 18. The recognition system 40 is configured to communicate the identification information to the control system 20 so that the control system 20 recognizes each surgical simulation tool 36 connected to the haptic controller 18.
- the recognition system 40 of the surgical training tool 36 is thus configured to:
- the recognition system 40 of the surgical training tool 36 is thus configured to read an electronic identification chip located inside the surgical simulation tool 36, in especially so-called simple tools.
- each surgical simulation tool 36 which is connected to the haptic controller 18 to enable the control system 20 to generate, where appropriate, a mobile virtual surgical element 102 corresponding in the virtual space 100. In all cases, it is necessary to have an identification so that the control system 20 can adapt the haptic response to the tool used.
- the platform 10 uses a wireless connection and/or an electrical connection to identify the connected surgical tool (see Figure 3).
- the recognition system 40 comprises a microcontroller 42 preferably located in the base 30 of the drive module 16, as visible in FIG. 7.
- the microcontroller 42 is connected to the surgical simulation tool 36 by means of the connection system 35, by the cable 39.
- the recognition system 40 in the case of a simple surgical training tool further comprises, at the level of the connection system 35 between the tool 36 and the haptic controller 18, an electronic device such as a voltage divider bridge in order to allow recognition of the tool 36.
- the recognition system 40 of the control system 20 recovers and analyzes the information from the microcontroller of the complex surgical training tool 36. In this case, wireless communication is sufficient for identification.
- the control system 20 of the platform 10 is configured to: o identify the different modules 14, 16, 28 connected to each other, o receive and analyze the data linked to the movement(s) of each surgical tool of drive 36 connected to a haptic controller 18, o generate the virtual environment 100, o interface, where appropriate, each mobile virtual surgical element 102 of the virtual environment 100 with a corresponding real element, o generate specific haptic feedback in relationship with the connected tool, the movements of the user (therefore of the haptic controller 18) and virtual reality 100.
- the control system 20 thus generates, for the tools requiring it, a virtual image of each surgical simulation tool 36 connected to the haptic controller 18.
- the virtual environment 100 also includes decorative elements 106 that cannot be moved and/or cannot be manipulated. It can for example be an endoscopy screen 108 or a lamp which can be manipulated virtually by the users with, for example, a click on a button to turn them on. These decorative elements 106 do not have corresponding real elements.
- control system 20 Based on the information received from the recognition system 40 and the information collected at the haptic controller 18, the control system 20 is configured to transform/reproduce each movement in the space of each surgical simulation tool 36 connected to a haptic controller 18 of the control console 26 in a virtual movement corresponding to its virtual image 102 in the virtual environment 100.
- control system 20 comprises: - line measurement unit (or microcontroller 42) configured to: o identify the tools 36 and/or the connected modules 14, 16, o collect the specific movement data (or internal movements) of the connected surgical training tool 36 ,
- a central unit configured to: o generate the virtual environment 100, o receive and analyze the data linked to the movement(s) of each connected surgical simulation tool 36, o interface each virtual surgical tool 102 of the environment virtual 100 with a corresponding real element.
- the measurement unit (or microcontroller 42) is part of the drive module 16.
- the control system 20 is further configured, as mentioned above, to generate a feedback signal (or haptic signal) allowing the haptic controller 18 to in turn generate a corresponding haptic signal, depending on what is happening. passes into the virtual environment 100.
- the control system 20 causes the haptic controller 18 to generate specific haptic feedback when virtual tool 102 corresponding to the surgical training tool 36 manipulated by the user comes into contact with a another virtual tool 102 or another virtual element such as a decor element 106, of the virtual environment 100. This makes it possible to accentuate the immersive aspect of the simulation and to give an increased sense of reality; the interactions visible in the virtual environment 100 are also felt by the user.
- haptic signal is understood as a signal actively generated by the platform 10 according to the present invention. It is to be differentiated from the notion of “tactile feedback” which is a simple passive feedback, automatically generated by the human body in reaction to the manipulation of animate or inanimate objects.
- Some of the complex surgical simulation tools 36 include a rotating distal rod 360. These tools 36 thus have a wheel allowing the rotation of the distal rod 360 and therefore of their axis.
- this distal rod 360 is connected to the connection system 35, it is then impossible for the control system 20 to measure/determine both the position in space of the surgical simulation tool 36 and the specific rotation of the distal rod 360: it is in fact necessary to transmit the general rotation of the surgical simulation tool 36 relative to the axis of the haptic controller 18 so that its virtual twin (virtual tool 102) can be oriented similarly in the virtual environment 100 without losing the specific rotation of the distal rod 360 induced by the operation of the surgical simulation tool 36.
- virtual twin virtual tool 102
- connection system 35 presents a particular embodiment with an arch part 45.
- the arch part 45 as shown in Figure 10, allows the free rotation of an orientation wheel of rod on the surgical driving tool 36 without losing the information on the orientation of the tool 36 itself.
- the arch piece 45 is fixed on the grippable body of the tool 36 on the one hand and on the distal rod 360 secured to the second connector 35b on the other hand.
- the distal rod 360 is cut so that the part under the arch piece 45 can be freely rotated without affecting the rotation at the key lock mechanism of the connection system 35, at the end of the haptic controller 18.
- the arch part 45 is preferably printed using a 3D printer by layer deposition, but any other plastic manufacturing process can be used such as, for example, laser sintering.
- the arch part 45 is preferably designed in two parts so that it can easily be dismantled, the two parts are assembled by means of screws.
- each drive module 16 is thus a central element located at the convergence of the different elements of the platform 10 according to the present invention.
- Each drive module 16 is organized, as already mentioned, around a base 30 which allows the different elements to be fixed: the microcontroller 42 and its connection cable 39 to a connection system 35 intended to connect the surgical training tool 36 to the control system 20,
- haptic controller 18 comprising a robot for acquiring three-dimensional movement by polar reference, magnets 34, 38, and, optionally
- one or more electrical connectors for example retractable pin connectors as seen above.
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Surgery (AREA)
- Life Sciences & Earth Sciences (AREA)
- Medical Informatics (AREA)
- General Health & Medical Sciences (AREA)
- Business, Economics & Management (AREA)
- General Engineering & Computer Science (AREA)
- Educational Technology (AREA)
- Educational Administration (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Molecular Biology (AREA)
- Animal Behavior & Ethology (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- Chemical & Material Sciences (AREA)
- Algebra (AREA)
- Pure & Applied Mathematics (AREA)
- Mathematical Physics (AREA)
- Mathematical Optimization (AREA)
- Mathematical Analysis (AREA)
- Computational Mathematics (AREA)
- Medicinal Chemistry (AREA)
- Robotics (AREA)
- Human Computer Interaction (AREA)
- Radiology & Medical Imaging (AREA)
- Pulmonology (AREA)
- Oral & Maxillofacial Surgery (AREA)
- Pathology (AREA)
- Entrepreneurship & Innovation (AREA)
- Instructional Devices (AREA)
Abstract
Description
Claims
Priority Applications (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CA3257361A CA3257361A1 (fr) | 2022-05-13 | 2023-05-15 | Connexion plug'n play |
| EP23729817.9A EP4523203A1 (fr) | 2022-05-13 | 2023-05-15 | Connexion plug'n play |
| AU2023268000A AU2023268000A1 (en) | 2022-05-13 | 2023-05-15 | Plug and play connection |
| IL316952A IL316952A (en) | 2022-05-13 | 2023-05-15 | Connecting various gadgets to the computer and automatically turning them on |
| JP2024566861A JP2025517215A (ja) | 2022-05-13 | 2023-05-15 | プラグアンドプレイ接続 |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| FR2204583A FR3135560B1 (fr) | 2022-05-13 | 2022-05-13 | Plateforme d’entraînement |
| FRFR2204583 | 2022-05-13 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2023218156A1 true WO2023218156A1 (fr) | 2023-11-16 |
Family
ID=82196756
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/FR2023/050697 Ceased WO2023218156A1 (fr) | 2022-05-13 | 2023-05-15 | Connexion plug'n play |
| PCT/FR2023/050695 Ceased WO2023218155A1 (fr) | 2022-05-13 | 2023-05-15 | Plateforme d'entraînement |
Family Applications After (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/FR2023/050695 Ceased WO2023218155A1 (fr) | 2022-05-13 | 2023-05-15 | Plateforme d'entraînement |
Country Status (8)
| Country | Link |
|---|---|
| US (1) | US20250316184A1 (fr) |
| EP (2) | EP4523202A1 (fr) |
| JP (2) | JP2025517195A (fr) |
| AU (2) | AU2023269320A1 (fr) |
| CA (2) | CA3257363A1 (fr) |
| FR (1) | FR3135560B1 (fr) |
| IL (2) | IL316952A (fr) |
| WO (2) | WO2023218156A1 (fr) |
Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2009094621A2 (fr) * | 2008-01-25 | 2009-07-30 | University Of Florida Research Foundation, Inc. | Dispositifs et procédés permettant la mise en œuvre de procédures chirurgicales endoscopiques et d'instruments associés dans un environnement virtuel |
| EP3482710A1 (fr) * | 2017-11-14 | 2019-05-15 | Stryker Corporation | Techniques de simulation de planification préopératoire spécifiques à un patient |
| US20190380792A1 (en) * | 2018-06-19 | 2019-12-19 | Tornier, Inc. | Virtual guidance for orthopedic surgical procedures |
| WO2020186194A1 (fr) * | 2019-03-13 | 2020-09-17 | Smith & Nephew Inc. | Alignement d'outil chirurgical assisté par réalité augmentée |
-
2022
- 2022-05-13 FR FR2204583A patent/FR3135560B1/fr active Active
-
2023
- 2023-05-15 CA CA3257363A patent/CA3257363A1/fr active Pending
- 2023-05-15 JP JP2024566760A patent/JP2025517195A/ja active Pending
- 2023-05-15 EP EP23729815.3A patent/EP4523202A1/fr active Pending
- 2023-05-15 EP EP23729817.9A patent/EP4523203A1/fr active Pending
- 2023-05-15 IL IL316952A patent/IL316952A/en unknown
- 2023-05-15 WO PCT/FR2023/050697 patent/WO2023218156A1/fr not_active Ceased
- 2023-05-15 CA CA3257361A patent/CA3257361A1/fr active Pending
- 2023-05-15 WO PCT/FR2023/050695 patent/WO2023218155A1/fr not_active Ceased
- 2023-05-15 US US18/865,453 patent/US20250316184A1/en active Pending
- 2023-05-15 JP JP2024566861A patent/JP2025517215A/ja active Pending
- 2023-05-15 IL IL316951A patent/IL316951A/en unknown
- 2023-05-15 AU AU2023269320A patent/AU2023269320A1/en active Pending
- 2023-05-15 AU AU2023268000A patent/AU2023268000A1/en active Pending
Patent Citations (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2009094621A2 (fr) * | 2008-01-25 | 2009-07-30 | University Of Florida Research Foundation, Inc. | Dispositifs et procédés permettant la mise en œuvre de procédures chirurgicales endoscopiques et d'instruments associés dans un environnement virtuel |
| EP3482710A1 (fr) * | 2017-11-14 | 2019-05-15 | Stryker Corporation | Techniques de simulation de planification préopératoire spécifiques à un patient |
| US20190380792A1 (en) * | 2018-06-19 | 2019-12-19 | Tornier, Inc. | Virtual guidance for orthopedic surgical procedures |
| WO2020186194A1 (fr) * | 2019-03-13 | 2020-09-17 | Smith & Nephew Inc. | Alignement d'outil chirurgical assisté par réalité augmentée |
Also Published As
| Publication number | Publication date |
|---|---|
| EP4523203A1 (fr) | 2025-03-19 |
| FR3135560B1 (fr) | 2024-06-21 |
| IL316952A (en) | 2025-01-01 |
| AU2023269320A1 (en) | 2024-11-28 |
| US20250316184A1 (en) | 2025-10-09 |
| WO2023218155A1 (fr) | 2023-11-16 |
| JP2025517195A (ja) | 2025-06-03 |
| FR3135560A1 (fr) | 2023-11-17 |
| JP2025517215A (ja) | 2025-06-03 |
| EP4523202A1 (fr) | 2025-03-19 |
| CA3257363A1 (fr) | 2023-11-16 |
| IL316951A (en) | 2025-01-01 |
| CA3257361A1 (fr) | 2023-11-16 |
| AU2023268000A1 (en) | 2024-11-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Sherman et al. | Understanding virtual reality: Interface, application, and design | |
| US9229540B2 (en) | Deriving input from six degrees of freedom interfaces | |
| US20160098095A1 (en) | Deriving Input from Six Degrees of Freedom Interfaces | |
| CA2942652C (fr) | Systeme de simulation tridimensionnelle virtuelle propre a engendrer un environnement virtuel reunissant une pluralite d'utilisateurs et procede associe | |
| Karvinen et al. | Make: sensors: a hands-on primer for monitoring the real world with Arduino and Raspberry Pi | |
| US20190027063A1 (en) | Instrument skill instruction and training system | |
| Bell | MicroPython for the Internet of Things | |
| US20190221136A1 (en) | Instrument skill instruction and training system | |
| FR3039419A1 (fr) | Ensemble d'elements modulables a jongler comportant un dispositif facilitant l'accrochage amovible ou inamovible au cours du jonglage | |
| EP3707694B1 (fr) | Système de simulation d'acte chirurgical | |
| US12125407B2 (en) | Systems and methods to specify interactive page locations by pointing a light beam using a handheld device | |
| WO2021205131A1 (fr) | Dispositif de simulation chirurgicale | |
| EP4523203A1 (fr) | Connexion plug'n play | |
| WO2019092063A1 (fr) | Dispositif de retour haptique | |
| Valencia et al. | A computer-vision based sensory substitution device for the visually impaired (See ColOr). | |
| US12282613B2 (en) | Systems and methods to specify interactive page locations by pointing a light beam using a handheld device | |
| US20180286084A1 (en) | Device and method for digital painting | |
| US20240038084A1 (en) | Systems and methods to interact with discoverable objects by pointing a light beam using a handheld device | |
| CN116092362B (zh) | 一种镊子夹持训练系统及方法 | |
| US12393287B2 (en) | Systems and methods to identify page-turning using a portable device | |
| WO2024236248A1 (fr) | Console d'entraînement chirurgical à contrainte | |
| WO2025014831A1 (fr) | Systèmes et procédés d'identification de changement de page à l'aide d'un dispositif portable | |
| JP2025513864A (ja) | 手術シミュレーション視鏡システム | |
| Tynes | Making VR Development More Accessible: A Platform Agnostic VR Framework | |
| Chapa et al. | BOGGLES: Boundary Optical GeoGraphic Lidar Environment System |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 23729817 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 316952 Country of ref document: IL |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2024566861 Country of ref document: JP |
|
| WWE | Wipo information: entry into national phase |
Ref document number: AU2023268000 Country of ref document: AU |
|
| REG | Reference to national code |
Ref country code: BR Ref legal event code: B01A Ref document number: 112024023584 Country of ref document: BR |
|
| ENP | Entry into the national phase |
Ref document number: 2023268000 Country of ref document: AU Date of ref document: 20230515 Kind code of ref document: A |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2023729817 Country of ref document: EP |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| ENP | Entry into the national phase |
Ref document number: 2023729817 Country of ref document: EP Effective date: 20241213 |
|
| REG | Reference to national code |
Ref country code: BR Ref legal event code: B01E Ref document number: 112024023584 Country of ref document: BR |
|
| ENP | Entry into the national phase |
Ref document number: 112024023584 Country of ref document: BR Kind code of ref document: A2 Effective date: 20241112 |