HK1214111B - System for underactuated control of insertion path for asymmetric tip needles - Google Patents
System for underactuated control of insertion path for asymmetric tip needles Download PDFInfo
- Publication number
- HK1214111B HK1214111B HK16102023.9A HK16102023A HK1214111B HK 1214111 B HK1214111 B HK 1214111B HK 16102023 A HK16102023 A HK 16102023A HK 1214111 B HK1214111 B HK 1214111B
- Authority
- HK
- Hong Kong
- Prior art keywords
- needle
- control
- axis
- rotation
- path
- Prior art date
Links
Description
The disclosed configuration relates to a system and approach for controlling insertion paths of needles with asymmetric tips for therapeutic and diagnostic medical interventions, and especially underactuated control of needle curvature and direction decoupled from needle insertion.
Needle-based interventions are commonplace. These may be used for a variety of percutaneous diagnostic and therapeutic interventions. However, ensuring that the needle, cannula, or other instrument makes it to the desired target while following a desired path is often nontrivial. Inaccuracy may come from various causes including needle deflection, tissue deformation, target motion, patient motion, or other sources. Many needles have asymmetric tip shapes, such as a beveled tip and/or cannula. In some cases, these tips cause asymmetric forces on the needle that cause it to deflect as it is inserted. This deflection in many cases is undesirable and results in errors in needle placement. However, some clinicians use the asymmetric tip forces to their advantage and actively control or steer the needle path during insertion by rotating the bevel direction. Further, others have attempted continuous rotation or drilling of a needle to ensure that it follows a straight insertion path.
The present disclosure teaches active, semi-autonomous control of needle insertion paths while still enabling a clinician ultimate control over needle insertion. The present teaching describes a method and system for controlling needle path as the needle is inserted by precisely controlling the rotation of the needle as it continuously rotates during insertion. This enables underactuated 2 degree-of-freedom (DOF) control of the direction and the curvature of the needle from a single rotary actuator. An advantage of the disclosed configuration is that control of the rotary motion may be decoupled from the needle insertion. The rotary motion controls steering effort and direction, while the insertion controls needle depth or insertion speed. In one implementation, the proposed method does not require constant velocity insertion, interleaved insertion and rotation, or known insertion position or speed. The insertion may be provided by a robot or other automated method, may be a manual insertion, or may be a teleoperated insertion.
Control of the needle path may be used in multiple cases. In one case, as the needle is inserted an error is determined between the projection of the needle and the target, so a compensation in the needle path is required. In other cases, a specific path or trajectory is desired, and the needle is controlled along that path to reach the target. In a combined case, a predetermined path is defined, and compensation is required as the needle is inserted to ensure the path is followed and the endpoint reached. These control approaches may be open loop or closed loop. The closed loop approach may be based upon medical imaging or image-guidance such as ultrasound, x-ray, fluoroscopy, computed tomography (CT), magnetic resonance imaging (MRI), video feeds, laser scans, external tracking systems, or other approaches.
The present teaching relates generally to controlling the trajectory of a needle or other instrument with an asymmetric tip. The disclosed arrangement describes a method for underactuated control of needle direction and curvature as it is inserted into tissue that is decoupled from the needle insertion motion. The approach also describes a system and components for implementing the proposed method.
In a particular configuration, the disclosed approach employs a method for inserting a needle with an asymmetric shaped tip into tissue along a curved path, wherein the needle is continuously rotated at a time-varying angular velocity; wherein the time-varying angular velocity rotation is a function of the needle angular position.
The present invention provides a needle steering apparatus comprising: a needle having an asymmetric tip, the asymmetric tip defined by a beveled cut across a cylindrical cross section of the needle, the needle having a needle axis which is the axis along the needle; and an inserter for disposing the needle axially in a direction of an axis of rotation, which is the needle axis, at an insertion speed; characterised by a rotary drive for continuously rotating the needle about the needle axis, the rotary drive responsive to control logic adapted to rotate the needle at a time-varying angular velocity based on a needle angular position (θ) about the needle axis, wherein the time-varying angular velocity is independent of the insertion speed and wherein the control logic enables underactuated control of both curvature and direction of a needle path from the rotary drive.
In operation, in a surgical environment having an asymmetric tipped needle and a needle driving apparatus responsive to rotational and insertion control, the method of directing the needle includes identifying a steering trajectory path for the needle, and controlling a time-varying rotation speed of the needle based on the identified steering path, such that the rotation speed determines a relative duration that a bevel angle of the needle applies force in a direction corresponding to the steering trajectory. The rotation is decoupled from advancement of the needle resulting from control of the controlled rotation speed about the needle axis, such that the controlled rotation speed is based on an angle of rotation, and independent of the linear advancement of the needle from the insertion control, so that the needle follows the prescribed path regardless of the insertion speed.
The invention is defined in appended independent claim 1. Preferred embodiments are described in the dependent claims.
The foregoing and other objects, features and advantages of the invention will be apparent from the following description of particular embodiments of the invention, as illustrated in the accompanying drawings in which like reference characters refer to the same parts throughout the different views. The drawings are not necessarily to scale, emphasis instead being placed upon illustrating the principles of the invention.
- Fig. 1 shows a context diagram of major components of the steerable needle assembly and mechanism suitable for use with configurations herein;
- Fig. 2 shows one implementation of the control algorithm for determining needle angular velocity as a function of a current angle;
- Fig. 3 shows a representation of how needle curvature is affected by changing the steering effort parameter;
- Figs. 4a and 4b show plots of needle rotation during a controlled insertion
- Figs. 5a-5c show exemplary plot of needle insertion path during a controlled insertion where needle is inserted straight and then at constant curvature;
- Figs. 6a-c demonstrate an example where the same overall needle path is achieved with two different configurations;
- Fig. 7 shows a view of the needle path in 3D for the case of straight, then curved insertion;
- Figs. 8a-8c show a controlled insertion path where the steering direction changes during the course of insertion;
- Fig. 9 depicts complex trajectories by combining segments of constant curvature;
- Fig. 10 depicts one embodiment wherein needle curvature during insertion is controlled by a stand-alone device for implementing the needle steering control;
- Fig. 11 depicts a particular configuration employing a robot having a needle rotation module;
- .Fig. 12 depicts a configuration of the robotic needle driver module 221 that can be used with the robot device of Fig. 11;
- Fig. 13 shows a driver module that can hold standard needles;
- Fig. 14 depicts one embodiment of the system where an asymmetric tip needle is concentric with one or more additional cannulas;
- Fig. 15 depicts one exemplary embodiment of a robotic needle driver capable of manipulating both a precurved cannula;
- Fig. 16 shows a representative teleoperation framework;
- Fig. 17 depicts an example of a teleoperation master; and
- Fig. 18 depicts a needle driver module incorporating a force sensor.
Configurations disclosed below teach a mechanism referred to as the Continuous Uncoupled Rotation Velocity-independent (CURV) steering approach. The described approach is one example, however the disclosed configuration also includes other related variants of decoupled, underactuated control of needle insertion based on asymmetric tips. The disclosed configuration also describes a plethora of systems and components for implementing the proposed approach. In one embodiment, a robotic needle driver provides 2 DOF control of needle rotation and insertion, thus providing 3 DOF control of the tip (i.e. can place the tip to a 3D position using 2 actuators). The needle driver may further be configured as part of a robotic system. The system may further be configured to incorporate a teleoperation master that a user manipulates to control needle insertion and/or steering angle. The configuration may further include force sensing and haptic feedback. The haptic feedback may be related to the forces on the needle, errors determined by a control system, external factors, or some combination of factors. In one configuration, a user manipulates the teleoperation master along only the insertion axis to control the insertion depth, while the robot automatically steers the needle path according to the disclosed configuration. This may be used based on preoperative path planning, or actively and semi-autonomously compensating for errors as the needle is inserted. In a further embodiment, the rotation is manipulated according to the disclosed configuration by an actuator in a standalone device, and in particular configurations the device may be handheld. The device can control steering effort (related to needle curvature in tissue during insertion) and in alternate configurations may also control angle and/or depth relative to the handle. In an additional embodiment of the disclosed approach, the asymmetric tip control methods taught in the disclosed configuration may be coupled with concentric precurved or prebent tubes or cannulas to provide additional dexterity and control during needle insertion.
Additional advantages of the disclosed configuration will become readily apparent to those skilled in this art from the following detailed description, wherein only selected embodiments of the disclosed configuration are shown and described. As will be realized, the disclosed configuration is capable of other and different embodiments, and its several details are capable of modifications in various obvious respects, all without departing from the invention disclosed herein. Accordingly, the drawings and description are to be regarded as illustrative in nature, and not as restrictive.
The present teachings are described more fully hereinafter with reference to the accompanying drawings, in which the present embodiments are shown. The following description is presented for illustrative purposes only and the presented teachings should not be limited to these embodiments.
In this disclosure, the term "needle" is defined as cylindrical instrument that interacts with tissues, including but not limited to medical needles, electrodes, tubes, rods, and cannulae. The term needle axis refers to the axis along the needle, or subsection thereof. The needles can typically be inserted and rotated along and about thus axis, respectively. In some cases torsional affects make the rotation at various points along the needle unequal, and this can be compensated for if necessary to control the desired subsection of the needle, such as the tip form the base. The term asymmetric tip generally refers to a bevel-shaped tip on a needle, however more broadly it is defined as any feature on a needle that provide asymmetric forces that alter the insertion path as it is inserted.
The examples and discussion that follows employ a surgical context as an example implementation, such that the a surgical needle or cannulated instrument adapted for surgical use is a steerable member, and a medium employed for drilling is surgical tissue. Alternate configurations may employ alternate arrangements of a steerable member and a medium. For example, geological applications may employ steering for exploration of geological structures, such as rock and soil. Alternate configurations may also be employed for building materials such as concrete or wood, or other medium responsive to the steering methodology disclosed herein.
In one embodiment of the disclosed configuration, the needle path direction and curvature is controlled using the approach detailed below and shown in Fig. 2 . In this approach, the needle is continuously rotated, and the angular velocity of the needle about its primary axis is computed as a function of the current angle and the desired direction.
In one approach, the normalized angular velocity of the needle about its primary axis is defined using the Gaussian distribution as: Where:
- ω̂(θ,θd) : normalized needle rotation angular velocity about its primary axis
- θ: current needle angle about its primary axis
- θd : needle rotation angle corresponding to desired steering direction
- α : steering effort where 1 is maximum steering curvature and 0 is a straight path
- c : tuning parameter related to width of the distribution about θd
The equation above describes the use of a normal, Gaussian distribution to determine the angular velocity, ω̂, of the needle about its primary axis as a function of the difference between current needle angle, θ, and desired direction, θ d, and is shown representatively in Fig. 2 . It should be noted that other distributions or functions may be utilized to replace the Gaussian distribution. A primary contribution of the disclosed approach is underactuated control of the needle such that curvature and direction of the needle insertion path can be controlled based on determining the angular velocity or differential motion as a function of the rotation angle as the needle rotates continuously. Needle rotation velocity is determined as a function of the needle angle as it rotates continuously. The underactuated approach allows control of curvature and direction from a single rotary actuator.
The calculation is performed continuously as the needle rotates to determine the corresponding angular velocity or angle set point.
In one embodiment, needle steering is implemented in software on a control system where the normalized needle rotation angular velocity is calculated in a control loop running at a fixed timer period such as a servo loop running at 1kHz. The angular velocity of the needle about its primary axis as a function of current angle as it rotates is calculated as: Where:
- θ̇(θ): needle rotation angular velocity about its primary axis
- ω̂: normalized needle rotation angular velocity about its primary axis
- ωmax: maximum angular velocity of needle about its primary axis
In one implementation, a discrete time controller is used to determine an angle set point for the next period based on the desired angular velocity as: Where:
- θ(t+1): needle rotation angle set point for next period
- θ(t): needle rotation angle in current period
- ω̂: normalized needle rotation angular velocity about its primary axis
- ω̂max: maximum angular velocity of needle about its primary axis
- T: time period between cycles of control loop
This disclosure refers to the term steering effort which is directly related to curvature, wherein full steering effort corresponds to the maximum curvature and zero steering effort corresponds to a straight insertion with no curvature. In closed loop control, steering effort is used within the control loop to correct a needle insertion path based on a detected error. Figure 3 shows an exemplary representation of how needle curvature is affected by changing the steering effort parameter, .i.e. a representation of how the steering effort, a, relates to the curvature of the needle as it is inserted. Referring to Fig. 3 , the overall needle curvature is adjusted by changing this parameter 160. A horizontal axis 162 shows an insertion axis corresponding to the drive (needle) axis 112 (prior to any steering). A vertical axis 164 shows the lateral displacement due to steering, or y-axis. The plot is shown in the plane of the needle's curvature, which may be rotated to any angle about the needle axis, thus enabling control of the needle tip position and the path in 3D. Note that this shows the overall curvature of the needle path, as the tip 144 location during insertion follows a helical profile as the needle rotates during insertion (shown below in Figs. 6a, 6b , 7 and 8a ). The size of the helix may be minimized to provide trajectories that appear as shown. For a fixed steering effort, typically the needle will follow a constant curvature path when all other parameters are constant. The relationship between steering effort and curvature depends on properties of the needle 110, tissue 150, external forces and control parameters.
The specific curvature for a given steering effort is also related to needle properties, tissue properties, and external forces. The steering effort may be run open loop to drive the needle along a specific path, it may be controlled in a closed loop to follow a specific path, or it may be used as a control input to steer the needle towards the target, much like a steering wheel on a car.
In Figs. 6a and 6b , plot lines 186-1, 186-2 show the shape of the body of the needle after insertion and the corresponding needle angular position and velocity. Plot lines 184-1, 184-2 show the 3D view including the helix that the tip 144 follows as the needle is inserted. The shown helix is exaggerated and can be made negligible with appropriate configuration. Even in the case of straight insertion with constant angular velocity rotation (i.e. drilling), an asymmetric tip needle may follow a helical pitch during insertion.
The insertion is decoupled from the insertion speed, this the overall needle shape at the end of insertion is essentially the same independent of insertion speed. The size of the helical path around that needle shape varies as a function of the relative insertion and rotation speed. For a high rotation speed or low insertion speed, the needle tip path essentially matches the final needle shape after insertion (i.e. negligible helical tip motion).
In one configuration, the handheld device contains a motor, angular position sensor, steering effort control switch, processor, and battery. The device may be fully self contained and steers the needle with a curvature related to the steering effort input. The user may use this with independently obtained interactively updated or real-time imaging. The device may also incorporate a biopsy sample retrieval mechanism. An embodiment of the device may be single use or limited lifetime. This configuration may be used for percutaneous procedures or other access to internal tissues. It may also be used for accessing structures close to the surface such as cannulation of blood vessels, acupuncture, or other medical procedures. In one embodiment, the device is fully compatible with the MRI environment and may be used during MR imaging without significantly degrading image quality.
In this embodiment, a collect 116 holds the asymmetric needle 110 and enables control of rotation about the needle axis 112 and insertion translation. The drive 120 includes a rotary motor 232 for providing the drive 120. A piezoelectric motor 233 or other suitable drive provides a separate rotation source for a cannula 113, augmented by one or more pulleys 230 and belts 234 for controlling rotation of the cannula 113 and/or needle 110 inserted therethrough, as is known with surgical cannulas. The drive 120 may be further facilitated by an eccentric belt tensioner 236, bearings 238, and a linear optical encoder 240 for measuring translation 130 feedback of needle insertion, and a rotary optical encoder 242 for needle rotation angle feedback.
A further embodiment of a needle driver is depicted in Fig. 13 , employing a driver module 221' that can hold standard needles. The drive module 250 further includes a fiducial frame for localization. The needle driver 221' may be tracked with respect the patient, surgical plan, and/or medical imaging system. In one configuration, imaging fiducials are incorporated into the robotic needle driver. As shown in Fig. 11 ,, z-shaped fiducial frame 225 is incorporated into the robot base or needle driver to localize the system with respect to the medical imaging system. In one configuration, the system is fully compatible with an MRI (Magnetic Resonance Imaging) environment to enable image-guided control of the insertion path based on intraoperative MR images.
In alternate configurations,, a slave robot is actuated using piezoelectric motors and incorporates FPI fiberoptic force sensing. The slave robot has a needle rotation module capable of using the proposed steering approach. The master device measures needle translation that controls slave needle insertion depth and optionally rotation that may be used to control steering angle either directly or through the proposed steering approach. In a further configuration, force feedback may be provided on the haptic mater device using pneumatics or other actuation technologies. A configuration of the system uses hybrid actuation with pneumatic control of the master robot and piezoelectric actuation of the slave robot. One embodiment of the system is MRI-compatible to enable the controller, master, and slave to reside inside an MRI scanner room and be used during imaging without significantly degrading image quality.
In another arrangement, the apparatus and methods disclosed above may be integrated into a system configuration for teleoperated control of the needle inside the MRI scanner. In one configuration, the target is tracked in interactively updated MRI images. The user control insertion depth of the needle held by the slave robot using the master robot device. The user can visualize the insertion progress in interactively updated MR images. In one configuration, the needle may be autonomously steered to reach the target, while the user only directly controls insertion depth or insertion speed. In this configuration, the target and needle are tracked in interactively updated medical images, and the control system uses the teachings of the resent invention to steer the needle to the target (i.e. active compensation of the path) while the user (e.g. a clinician) controls the insertion depth or insertion speed using a master device while visualizing the needle insertion. This enables the clinician control over depth, thus potentially improving safety over a fully autonomous system, while enable the control system to ensure the needle reaches the target even in the presence of deformation. In an alternate configuration, the needle driver robot is not actuated along needle insertion (only position sensing along the insertion direction), and the user directly inserts the needle by pushing on the needle driver (without a separate teleoperation master) while the rotation module autonomously steers the needle according to the teachings of the disclosed configuration.
The above description provides detail about exemplary configurations and algorithms of the disclosed configuration's teachings; however, the disclosed configuration is not restricted to only the specific configuration or approaches shown.
The present configurations may be practiced by employing conventional materials, methodology and equipment. Accordingly, the details of such materials, equipment and methodology are not set forth herein in detail. In the previous descriptions, numerous specific details are set forth, such as specific materials, structures, processes, etc., in order to provide a thorough understanding of the disclosed configuration. However, it should be recognized that the disclosed configuration can be practiced without resorting to the details specifically set forth. Only an exemplary embodiment of the disclosed configuration and but a few examples of its versatility are shown and described in the present disclosure. It is to be understood that the disclosed configuration is capable of use in various other combinations and environments and is capable of changes or modifications within the scope of the inventive concept as expressed herein.
Those skilled in the art should readily appreciate that the programs and methods defined herein are deliverable to a user processing and rendering device in many forms, including but not limited to a) information permanently stored on non-writeable storage media such as ROM devices, b) information alterably stored on writeable non-transitory storage media such as floppy disks, magnetic tapes, CDs, RAM devices, and other magnetic and optical media, or c) information conveyed to a computer through communication media, as in an electronic network such as the Internet or telephone modem lines. The operations and methods may be implemented in a software executable object or as a set of encoded instructions for execution by a processor responsive to the instructions. Alternatively, the operations and methods disclosed herein may be embodied in whole or in part using hardware components, such as Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs), microcontrollers, state machines, controllers or other hardware components or devices, or a combination of hardware, software, and firmware components.
While the system and methods defined herein have been particularly shown and described with references to embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the scope of the invention encompassed by the appended claims
Claims (6)
- A needle steering apparatus comprising:a needle (110) having an asymmetric tip (144), the asymmetric tip defined by a beveled cut across a cylindrical cross section of the needle, the needle having a needle axis (112) which is the axis along the needle; andan inserter (130) for disposing the needle axially in a direction of an axis of rotation, which is the needle axis, at an insertion speed;characterised by a rotary drive (120) for continuously rotating the needle about the needle axis, the rotary drive responsive to control logic (122) adapted to rotate the needle at a time-varying angular velocity based on a needle angular position (θ) about the needle axis, wherein the time-varying angular velocity is independent of the insertion speed and wherein the control logic enables underactuated control of both curvature and direction of a needle path from the rotary drive.
- The apparatus of claim 1, wherein the control logic enables independent control of the rotary driver from that of the inserter.
- The apparatus of claim 1 or 2 further comprising a teleoperation master device (320) configured for providing control of the inserter motion.
- The apparatus of claim 3, wherein the teleoperation master device is responsive to physical counterforce on the needle for providing corresponding feedback to a user.
- The apparatus of any of claims 1 to 4, further comprising one or more additional drives and a cannulated delivery mechanism, the cannulated delivery mechanism configured to define a cannula (113, 260) for at least a portion of a path to a surgical target, the cannula responsive to insertion of the needle for disposing the needle beyond an end of the cannula.
- The apparatus of any of claims 1 to 5, further comprising a needle driver, the needle driver for controlling rotation and insertion, the needle driver mechanically coupled to a fiducial frame (228) for locating the needle driver relative to a patient, medical images of a patient, and/or a surgical plan.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201261715063P | 2012-10-17 | 2012-10-17 | |
| US61/715,063 | 2012-10-17 | ||
| PCT/US2013/065384 WO2014062890A1 (en) | 2012-10-17 | 2013-10-17 | System and method for underactuated control of insertion path for asymmetric tip needles |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| HK1214111A1 HK1214111A1 (en) | 2016-07-22 |
| HK1214111B true HK1214111B (en) | 2021-04-30 |
Family
ID=
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20250195841A1 (en) | System and method for underactuated control of insertion path for asymmetric tip needles | |
| US20240090881A1 (en) | Apparatus and methods for mri-compatible haptic interface | |
| US11918763B2 (en) | Robotically augmented catheter manipulation handle | |
| JP5303558B2 (en) | Robot control catheter and calibration method thereof | |
| US20210137620A1 (en) | Robotic catheter system | |
| US9204935B2 (en) | Robotic surgical system and method for diagnostic data mapping | |
| US7974674B2 (en) | Robotic surgical system and method for surface modeling | |
| US10172678B2 (en) | Method and system for performing invasive medical procedures using a surgical robot | |
| CN107072717B (en) | System and method for adaptive input mapping | |
| US7822458B2 (en) | Distal bevel-tip needle control device and algorithm | |
| US10863945B2 (en) | Robotic surgical system with contact sensing feature | |
| CN115105210B (en) | A collaborative medical robot that enables safe instrument guidance | |
| Webster III | Design and mechanics of continuum robots for surgery | |
| US20240206999A1 (en) | Robotic catheter system | |
| Lafreniere et al. | Design of an MRI-compatible robot for image-guided needle insertion procedures using active tendon-driven needles | |
| Sperry et al. | Screw-tip soft magnetically steerable needles | |
| Li et al. | Development of an MRI-compatible needle driver for in-bore prostate biopsy | |
| HK1214111B (en) | System for underactuated control of insertion path for asymmetric tip needles | |
| US20250082421A1 (en) | Systems and methods for adjusting an instrument holder while maintaining a position of a remote center of motion |