[go: up one dir, main page]

WO2024222402A1 - Catheter robot and registration method thereof - Google Patents

Catheter robot and registration method thereof Download PDF

Info

Publication number
WO2024222402A1
WO2024222402A1 PCT/CN2024/085557 CN2024085557W WO2024222402A1 WO 2024222402 A1 WO2024222402 A1 WO 2024222402A1 CN 2024085557 W CN2024085557 W CN 2024085557W WO 2024222402 A1 WO2024222402 A1 WO 2024222402A1
Authority
WO
WIPO (PCT)
Prior art keywords
point
points
sampling
patient
catheter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
PCT/CN2024/085557
Other languages
French (fr)
Chinese (zh)
Inventor
沈涛
陈家兴
高元倩
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Shenzhen Edge Medical Co Ltd
Original Assignee
Shenzhen Edge Medical Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Shenzhen Edge Medical Co Ltd filed Critical Shenzhen Edge Medical Co Ltd
Publication of WO2024222402A1 publication Critical patent/WO2024222402A1/en
Anticipated expiration legal-status Critical
Pending legal-status Critical Current

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30Surgical robots
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2046Tracking techniques
    • A61B2034/2059Mechanical position encoders
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A61B2034/2068Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis using pointers, e.g. pointers having reference marks for determining coordinates of body points
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/30Surgical robots
    • A61B2034/301Surgical robots for introducing or steering flexible instruments inserted into the body, e.g. catheters or endoscopes

Definitions

  • the present application relates to the field of surgical robots, and in particular to a catheter robot and a registration method thereof.
  • Minimally invasive medical techniques are intended to reduce the amount of tissue damaged during a medical procedure, thereby reducing patient recovery time, discomfort, and harmful side effects.
  • Such minimally invasive techniques can be performed through natural orifices in the anatomical structure or through one or more surgical incisions. Doctors can insert minimally invasive medical instruments through these natural orifices or incisions to reach the target tissue location.
  • the position of the medical instrument can be correlated with a preoperative image or an intraoperative image of the anatomical structure.
  • image registration of the medical instrument and the image is required.
  • the image registration of the prior art is carried out by selecting several obvious feature points on the image, and the coordinate values of these feature points in the image coordinate system constitute a first point set; and controlling the medical instrument to move in the anatomical structure to reach the corresponding feature points, and obtaining the coordinate values of these feature points in the surgical environment coordinate system to constitute a second point set; and then determining the transformation matrix of the surgical environment coordinate system relative to the image coordinate system based on the first point set and the second point set to complete the registration.
  • the existing technology does not consider the intrinsic motion effect of the anatomical structure when performing image registration.
  • the anatomical structure is a bronchus
  • the effect of respiratory motion is not considered. This effect causes unexpected deviations in the coordinate values of the acquired feature points in the surgical environment coordinate system, which in turn causes a large error in the determined transformation matrix.
  • the present application provides a catheter robot, comprising:
  • a catheter wherein the catheter and/or an instrument carried by the catheter is provided with a first sensor for sensing the position of the catheter end and/or the instrument end;
  • a control device coupled to the first sensor and configured to:
  • model point set comprising a plurality of simulated feature points, the simulated feature points being acquired from an anatomical model of an anatomical structure of a first patient, the plurality of simulated feature points being respectively associated with a plurality of feature points of the anatomical structure;
  • the spatial point set includes a plurality of sampling point subsets, wherein the sampling point subsets include a plurality of sampling points, wherein the sampling points are acquired from the anatomical structure by the first sensor, and the plurality of sampling point subsets are respectively associated with a plurality of the feature points;
  • a rough registration relationship between the model point set and the space point set is determined.
  • the present application provides a catheter robot registration method, comprising:
  • a model point set including a plurality of simulated feature points, wherein the simulated feature points are acquired from an anatomical model of an anatomical structure of a first patient, and the plurality of simulated feature points are respectively associated with a plurality of feature points of the anatomical structure;
  • a spatial point set including a plurality of sampling point subsets, wherein the sampling point subsets include a plurality of sampling points, the sampling points are acquired from the anatomical structure, and the plurality of sampling point subsets are respectively associated with a plurality of the feature points;
  • a rough registration relationship between the model point set and the space point set is determined.
  • the present application provides a computer-readable storage medium storing a computer program, wherein the computer program is configured to be loaded and executed by a processor to implement the steps of the method described in any one of the above embodiments.
  • the present application also provides a computer program product, comprising computer instructions, which, when executed on a computer, enable the computer to execute the method described in any one of the above embodiments.
  • FIG1 is a schematic diagram of the structure of a catheter robot provided in one embodiment of the present application.
  • FIG2 is a schematic diagram of the structure of a catheter device and a power unit provided in one embodiment of the present application;
  • FIG3 is a schematic flow chart of a registration method for a catheter robot according to an embodiment of the present invention.
  • FIG4 is a schematic diagram of simulated feature points in an anatomical structure provided by an embodiment of the present application.
  • FIG5 is a schematic flow chart of a registration method for a catheter robot according to an embodiment of the present invention.
  • FIG6 is a schematic flow chart of a catheter robot registration method provided in yet another embodiment of the application.
  • FIG7 is a schematic flow chart of a registration method for a catheter robot provided in yet another embodiment of the application.
  • FIG8 is a schematic diagram of the effect of converting the coordinate system of the movement path of the catheter provided by an embodiment of the present application.
  • FIG9 is a schematic flow chart of a registration method for a catheter robot according to an embodiment of the present invention.
  • FIG10 is a schematic diagram of the effect of the catheter motion path before and after denoising according to an embodiment of the present application.
  • FIG11 is a schematic diagram showing the effect of the registration accuracy before the catheter motion path denoising provided by an embodiment of the present application.
  • FIG12 is a schematic diagram showing the effect of the registration accuracy after the catheter motion path denoising provided by an embodiment of the present application.
  • FIG. 13 is a schematic diagram showing the principle of the control device of the telemedicine system of the present application.
  • distal end and proximal end used in this application are used as directional words, which are commonly used terms in the field of interventional medical devices, where “distal end” refers to the end close to the patient during surgery, and “proximal end” refers to the end away from the patient during surgery.
  • first/second and the like used in this application represent a component and a class of more than two components with common characteristics.
  • FIG1 shows a catheter system 1000 provided in an embodiment of the present application.
  • the catheter system 1000 includes an imaging vehicle 100, a trolley 200 and a main controller 300 respectively connected to the imaging vehicle 100, a catheter instrument 400 that can be coupled to the trolley 200, a sensor system 500 connected to the trolley 200, and a control system 600 for realizing control between the catheter instrument 400, the main controller 300, the sensor system 500 and the imaging vehicle 100.
  • the main controller 300 can be connected to the trolley 200 by wire or wirelessly.
  • the control instruction can be triggered by operating the main controller 300, and the catheter instrument 400 can be controlled to advance, retract, bend and turn, etc. through the drive of the trolley 200.
  • the trolley 200 can usually be moved to the side of the operating bed to engage the catheter instrument 400, and control the catheter instrument 400 to move up and down in the vertical direction, or translate in the horizontal direction, or move in non-vertical and non-horizontal directions under the control command, so as to provide a better preoperative preparation angle for the operation of the catheter instrument 400.
  • the control command can be a command triggered by the operator by operating the main controller 300, or a command triggered by the operator directly clicking or pressing a button set on the trolley 200.
  • the control command can also be a command triggered by voice control or a force feedback mechanism.
  • the trolley 200 may include a base 210, a sliding seat body 220 that can be lifted and moved along the base 210, and two mechanical arms 230 fixedly connected to the sliding seat body 220.
  • the mechanical arm 230 may include a plurality of arm segments connected at a joint, and the plurality of arm segments provide the mechanical arm 230 with a plurality of degrees of freedom, for example, seven degrees of freedom corresponding to seven arm segments.
  • a power unit (not shown in the figure) is installed at the end of the mechanical arm 230, and the power unit of the mechanical arm 230 is used to engage the catheter instrument 400 and to move the catheter instrument 400 under the driving force of the power unit. Under the action, the end of the catheter instrument 400 is controlled to bend and turn accordingly.
  • the two mechanical arms 230 can be structures that are completely the same or partially the same, one mechanical arm 230 is used to engage the inner catheter instrument 410, and the other mechanical arm 230 is used to engage the outer catheter instrument 420.
  • the outer catheter instrument 420 can be installed first, and when the outer catheter instrument 420 is installed, the catheter of the inner catheter instrument 410 is inserted into the catheter of the outer catheter instrument 420.
  • the sensor system 500 has one or more subsystems for receiving information about the catheter device 400.
  • the subsystems may include: a position sensor system; a shape sensor system for determining the position, orientation, speed, velocity, pose, and/or shape of the tip of the catheter device 400 and/or along one or more segments of the catheter that may constitute the catheter device 400; and/or a visualization system for capturing images from the tip of the catheter device 400.
  • the imaging vehicle 100 may be provided with a display system 110 and a flushing system (not shown in the figure), etc.
  • the display system 110 is used to display images or representations of the surgical site and the catheter instrument 400 generated by the subsystem of the sensor system 500. Real-time images of the surgical site and the catheter instrument 400 captured by the visualization system may also be displayed. Images of the surgical site recorded before or during surgery may also be presented using image data from imaging techniques such as computed tomography (CT), magnetic resonance imaging (MRI), optical coherence tomography (OCT), and ultrasound, etc.
  • CT computed tomography
  • MRI magnetic resonance imaging
  • OCT optical coherence tomography
  • ultrasound etc.
  • the preoperative or intraoperative image data may be presented as a two-dimensional, three-dimensional, or four-dimensional (such as time-based or rate-based information) image and/or presented as an image from a model created based on a preoperative or intraoperative image data set, and a virtual navigation image may also be displayed.
  • a virtual navigation image the actual position of the catheter instrument 400 is registered with the preoperative image to present a virtual image of the catheter instrument 400 in the surgical site to the operator from the outside.
  • the control system 600 includes at least one memory and at least one processor. It is understood that the control system 600 can be integrated into the trolley 200 or the imaging trolley 100, or can be independently provided.
  • the control system 600 can support wireless communication protocols such as IEEE 802.11, IrDA, Bluetooth, HomeRF, DECT, and wireless telemetry.
  • the control system 600 can transmit one or more signals indicating the movement of the catheter instrument 400 by the power unit to move the catheter instrument 400.
  • the catheter instrument 400 can extend to a surgical location in the body via an opening of a natural cavity or a surgical incision of the patient.
  • control system 600 may include a mechanical control system (not shown in the figure) and an image processing system (not shown in the figure), wherein the mechanical control system is used to control the movement of the catheter instrument 400, and therefore, can be integrated into the trolley 200.
  • the image processing system is used for virtual navigation path planning, and therefore, can be integrated into the imaging vehicle 100.
  • the various subsystems of the control system 600 are not limited to the specific situations listed above, and can also be reasonably set according to actual conditions. Among them, the image processing system can image the surgical site based on the image of the surgical site recorded before or during the operation, using the above imaging technology.
  • the software used in combination with manual input can also convert the recorded image into a two-dimensional or three-dimensional synthetic image of a part or the entire anatomical organ or segment.
  • the sensor system 500 can be used to calculate the position of the catheter instrument 400 relative to the patient's anatomical structure, which can be used to generate an external tracking image and an internal virtual image of the patient's anatomical structure, so as to realize the actual position of the catheter instrument 400 and the preoperative image registration, so that the virtual image of the catheter instrument 400 in the surgical site can be presented to the operator from the outside.
  • the structures of the inner catheter device 410 and the outer catheter device 420 are substantially the same, and they respectively have a slender and flexible inner catheter 41 and an outer catheter 42, wherein the diameter of the outer catheter 42 is slightly larger than the inner catheter 41, so that the inner catheter 41 can pass through the outer catheter 42 and provide a certain support for the inner catheter 41, so that the inner catheter 41 can reach the target position in the patient's body, so as to facilitate operations such as tissue or cell sampling from the target position.
  • Certain movements of the main controller 300 may cause corresponding movements of the catheter device 400.
  • the movement of the direction lever of the main controller 300 may be mapped to the corresponding pitch movement of the end of the catheter device 400; when the operator operates the direction lever of the main controller 300 to move left or right, the movement of the direction lever of the main controller 300 may be mapped to the corresponding yaw movement of the end of the catheter device 400.
  • the main controller 300 may control the end of the catheter device 400 to move within a 360° spatial range.
  • the catheter instrument 400 is configured to engage with the power unit 240 of the mechanical arm 230 , and includes an instrument box 45 configured to engage with the power unit 240 and a catheter 48 connected to the instrument box 45 .
  • the “engagement” refers to a state in which the driving force of the power unit 240 can be transmitted to the inside of the instrument box 45 and the catheter 48 can move normally when the instrument box 45 is installed in the power unit 240. For example, under the driving force of the power unit 240, the end of the catheter 48 can be bent and turned.
  • the end in this application may also be referred to as the distal end or the head, which refers to the end away from the instrument box 45 ; the front end may also be referred to as the proximal end or the tail, which refers to the end close to the instrument box 45 .
  • the processor of the control system 600 is configured to perform the following steps to implement the catheter robot registration method provided in an embodiment of the present application. As shown in FIG3 , the method includes:
  • Step S11 obtaining a model point set including a plurality of simulated feature points from the anatomical model of the anatomical structure.
  • Each simulated feature point may correspond (match) to a feature point of the anatomical structure, and different simulated feature points generally correspond to different feature points of the anatomical structure.
  • Each simulated feature point has coordinates in the image coordinate system of the anatomical model.
  • the anatomical structure may be one of the natural or surgically created connecting channels such as bronchus, urinary tract, (cardio) blood vessels and intestines. This application is described by taking the anatomical structure as a bronchus as an example.
  • Feature points can be selected from points in the anatomical structure that have obvious features and are easy to identify.
  • Simulated feature points are points in the anatomical model, which are the same as the points referred to by the feature points in the anatomical structure.
  • the feature points can be selected from various levels of carina, for example, the main carina, the first level and second level carina of the left lobe and the right lobe can be selected respectively.
  • the anatomical structure is a pulmonary bronchus
  • multiple feature points can be selected to cover as many pulmonary bronchus as possible.
  • one or more feature points can be selected from one or more areas of the main carina, right upper lobe, right middle lobe, right lower lobe, left upper lobe, left middle lobe and left lower lobe.
  • one feature point can be selected from each of the above-mentioned areas to cover the entire bronchus.
  • feature point 1 representing the main carina
  • feature point 2 representing the carina of the left upper lobe
  • feature point 3 representing the carina of the left upper lobe
  • feature point 4 representing the carina of the left lower lobe
  • feature point 5 representing the carina of the right upper lobe
  • feature point 6 representing the carina of the right middle lobe
  • feature point 7 representing the carina of the right lower lobe.
  • these simulated feature points can be manually selected, or these simulated feature points can be automatically identified and selected.
  • Step S12 acquiring a spatial point set including a plurality of sampling point subsets from the anatomical structure, and acquiring a denoising weight matrix corresponding to the sampling point subsets in the spatial point set.
  • Each sampling point subset may correspond to (match) a feature point of the anatomical structure, different sampling point subsets may correspond to different feature points of the anatomical structure, and the sampling point subsets and the simulated feature points are associated through the feature points.
  • Each sampling point subset includes multiple sampling points, and the sampling points are generally described by the coordinates of the catheter end or the instrument end in the world coordinate system (surgical environment coordinate system or physical space coordinate system).
  • the sampling points can be acquired by a tracking sensor, and the tracking sensor can include a position sensor and/or a shape sensor.
  • the visualization system can be used to guide the end of the catheter inserted into the anatomical structure and/or the end of the instrument to move to the feature point, and the position sensor set at the end of the catheter and/or the end of the instrument can be used to obtain the position of the end of the catheter and/or the end of the instrument.
  • a position sensor can be a component in the electromagnetic positioning system.
  • the electromagnetic positioning system can further include a magnetic field generating component and a magnetic field detecting component.
  • the magnetic field generating component is used to generate a magnetic field
  • the position sensor is an EM sensor (i.e., an electromagnetic sensor)
  • the position sensor will cause a change in the magnetic field in the magnetic field
  • the magnetic field detection component can detect the change in the magnetic field to detect the position of the position sensor relative to the magnetic field/magnetic field generating component.
  • the position of the catheter end and/or the instrument end relative to the magnetic field/magnetic field generating component can be calculated, and then combined with the coordinate conversion relationship between the magnetic field/magnetic field generating component and the world coordinate system, the position of the catheter end and/or the instrument end in the world coordinate system, i.e., the sampling point, can be calculated.
  • the position sensor can sense at least three translational degrees of freedom in the magnetic field.
  • a shape sensor system can be used to obtain the position of a catheter tip and/or an instrument tip inserted into an anatomical structure.
  • the shape sensor can include an optical fiber aligned with the catheter, and the optical fiber shape sensor can be used to obtain the position of a catheter tip and/or an instrument tip inserted into an anatomical structure.
  • the fiber optic bending sensor can feedback the shape of the catheter, based on which the position of the catheter end and/or the instrument end relative to the base of the shape sensor can be calculated. Combined with the position of the base of the shape sensor in the world coordinate system, the position of the catheter end and/or the instrument end in the world coordinate system, i.e., the sampling point, can be calculated.
  • anatomical structures such as bronchi, (cardio) blood vessels, etc.
  • have intrinsic movements such as respiratory movement and cardiac movement with high frequency and large amplitude, which can easily cause large fluctuations in the position of the catheter end and/or the instrument end at the feature point, and thus easily lead to the problem of inaccurate subsequent registration.
  • the catheter end and/or the instrument end can be manipulated to stay at the feature point in the anatomical structure for a certain period of time to continuously obtain its position.
  • the duration may include at least one movement cycle of the intrinsic movement of the anatomical structure.
  • the duration may include at least one respiratory cycle, such as one, two or more, and a normal respiratory cycle is usually 3 to 5 seconds.
  • the duration may include at least one cardiac cycle, such as one, two or more, and a normal cardiac cycle is usually 0.5 to 1 second. The longer the sampling duration or the more movement cycles included, the more sampling points will be obtained during such a duration, and individual differences caused by different movement cycles can be avoided.
  • the end of the catheter and/or the end of the instrument are affected by respiratory motion at different amplitudes in different lung regions.
  • the fluctuation amplitude caused by the respiratory effect in the upper lobe region may be 10 mm
  • the fluctuation amplitude caused by the respiratory effect in the lower lobe region may reach 20 mm. It can be seen that corresponding to the different positions of the end of the catheter and/or the end of the instrument in the anatomical structure, the influence of the intrinsic motion of the anatomical structure on the end of the catheter and/or the end of the instrument is usually different.
  • different denoising weight matrices can be constructed for different feature points or for different sampling point subsets, so that the sampling point subset can be denoised later by the denoising weight matrix corresponding to the sampling point subset to eliminate the influence of the intrinsic motion of the anatomical structure on the sampling points as much as possible.
  • each selected feature point can be considered to represent an area of the anatomical structure. At different positions within the area, it can be simply considered that the intrinsic movement of the area has basically the same effect on the position of the catheter tip and/or the instrument tip.
  • the number of simulated feature points in the model point set may be the same as or different from the number of the sampling point subset in the spatial point set.
  • the simulated feature points in the model point set and the sampling point subset in the spatial point set may be associated with more than three feature points, such as four, five, six, seven or more, and the more associated feature points, the more accurate the registration.
  • Step S13 denoising the sampling points in the sampling point subset based on the denoising weight matrix, and determining the mean point of the sampling point subset based on the denoised sampling points.
  • sampling points in the sampling point subset can be denoised separately through the denoising weight matrix corresponding to the sampling point subset.
  • the mean point of the sampling point subset is a point representing the average position of all sampling points in the sampling point subset, which is actually a coordinate value described in the surgical environment coordinate system.
  • Each sampling point subset corresponds to a mean point.
  • Step S14 determining a first transformation matrix between the model point set and the space point set based on the multiple simulated feature points of the model point set and the multiple mean points of the space point set.
  • the simulated feature points have a corresponding relationship with the feature points
  • the mean point also has a corresponding relationship with the feature points.
  • the first transformation matrix between the model point set and the space point set can be determined through the one-to-one correspondence between multiple simulated feature points and multiple mean points, that is, the first registration relationship between the image coordinate system of the anatomical structure and the surgical environment coordinate system can be determined.
  • the first registration relationship is a rough registration relationship.
  • the first transformation matrix can be determined by a landmark transform algorithm.
  • the first transformation matrix determined in step S14 can be considered as a coarse registration matrix, or the first registration relationship determined can be considered as a coarse registration relationship.
  • the coarse registration is a rigid registration, that is, the position (i.e., coordinate value) of the feature point only undergoes translation and rotation changes, and there is no scale change. The distance between any feature points remains unchanged in theory after the coordinate system is converted.
  • each sampling point in the sampling point subset associated with the feature point is denoised by using the denoising weight matrix associated with the feature point in the anatomical structure, and the mean point of the denoised sampling points in the sampling point subset is obtained, and then the simulated feature points based on the model point set and the mean of the spatial point set are obtained.
  • the one-to-one correspondence between the points is used to determine the first transformation matrix, which can reduce or eliminate the influence of the intrinsic movement of the anatomical structure on the registration accuracy.
  • the anatomical model of the anatomical structure can generally be a three-dimensional or four-dimensional model.
  • a step of obtaining the anatomical model of the anatomical structure may also be included, and the implementation method of this step is as follows.
  • Images of anatomical structures are obtained by scanning (or photographing) such as CT, MRI, OCT or ultrasound. During the scan, the patient usually needs to take a deep breath and hold it until the scan is completed. The bronchi are largest and the fine branches are easier to image when the human body is in the inhalation state.
  • Segment and reconstruct the image of the anatomical structure For example, the patient's image can be segmented by segmentation algorithms such as region growing and convolutional neural networks to segment the bronchi of the lungs; and then the segmented image can be reconstructed into a three-dimensional model by, for example, a marching cube algorithm.
  • segmentation algorithms such as region growing and convolutional neural networks to segment the bronchi of the lungs.
  • the denoising weight matrix corresponding to the sampling point subset obtained may include two sources.
  • the first one can come from the patient himself.
  • the second type can be derived from other patients with the same or similar physical characteristics as the patient.
  • a certain deviation is allowed.
  • the allowable deviation is defined as within 5%.
  • the amplitude of the intrinsic movement of the anatomical structure is basically the same for the same feature point in the anatomical structure, and the influence on the position of the catheter end and/or the instrument end is basically the same.
  • the physical characteristics include, for example, body shape characteristics and/or physiological characteristics.
  • the body shape characteristics include at least the chest circumference; when the anatomical structure is a bronchus, the physiological characteristics include at least the amplitude of the respiratory movement; when the anatomical structure is a (cardio)vascular vessel, the physiological characteristics include at least the amplitude of the heartbeat movement.
  • the above step S12 may include:
  • Step S1201 obtaining the patient's physical characteristics.
  • Physical characteristics include, for example, body shape characteristics and/or physiological characteristics.
  • Step S1202 determining the type of the patient's anatomical structure.
  • anatomical structures include, for example, bronchi or (cardio)vascular tubes, and of course, may also include Other organs.
  • the type can be determined by manual input or automatic identification.
  • Step S1203 based on the patient's physical features and anatomical structure type, target patients with the same anatomical structure type and the same or similar physical features are matched.
  • one or more databases can be constructed, which store information of multiple patients who have been treated in this hospital or other hospitals.
  • This information includes but is not limited to the patient's name, gender, age, physical characteristics, physiological characteristics of anatomical structures, and the same or different denoising weight matrices of different feature points of one or more anatomical structures. Therefore, it is advantageous to achieve accurate matching through the same or different denoising weight matrices of different feature points of physical characteristics, physiological characteristics, and one or more anatomical structures.
  • Step S1204 determining feature points associated with the patient's sampling point subset.
  • Step S1205 Based on the feature points, a denoising weight matrix of the target patient associated with the feature points is matched.
  • the feature points of the same anatomical structure of different patients are usually selected to have the same or great similarity.
  • these feature points are usually selected from the most easily recognizable bifurcation points of the bronchus at all levels, that is, the carina at all levels.
  • the denoising weight matrix matched in step S1204 should also be the denoising weight matrix of the main carina of the target patient; when the feature points of the sampling point subset correspond to the first-level carina of the left lung lobe, the denoising weight matrix matched in step S1204 should also be the denoising weight matrix of the first-level carina of the left lung lobe of the target patient.
  • step S12 also includes:
  • Step S1201' obtaining the patient's physical characteristics.
  • Step S1203' based on the patient's physical characteristics, match target patients with the same or similar physical characteristics.
  • Step S1205 ′ based on the feature points, a denoising weight matrix of the target patient associated with the feature points is matched.
  • the sampling points in the sampling point subset may be denoised using the matched denoising weight matrix.
  • a method for initially constructing a denoising weight matrix for each feature point may include:
  • Step S1211 acquiring a sampling point subset corresponding to a feature point from the anatomical structure.
  • the sampling point subset includes multiple sampling points, and the multiple sampling points are obtained by sampling the same tracking sensor at different times.
  • the multiple sampling points generally include sampling points in the order of ten, one hundred or even more.
  • Step S1212 acquiring a test point set from the body surface corresponding to the anatomical structure.
  • Each test point set includes multiple test point subsets, and each test point subset includes at least one test point.
  • the test point is sampled by a surface sensor arranged on the patient's body surface corresponding to the anatomical structure.
  • the test point is generally described by the coordinates of the surface sensor in the surgical environment coordinate system.
  • a corresponding test point of different test point subsets is usually sampled by a corresponding surface sensor at different times.
  • the number of body surface sensors is configured in the same manner. For example, when the expected number of test points in each test point subset is one, the number of body surface sensors is one; for another example, when the expected number of test points in each test point subset is two or three, the number of body surface sensors is correspondingly two or three.
  • the plurality of test point subsets generally include test point sets in the order of ten, one hundred or even more.
  • the number of sampling points in the sampling point subset is usually required to be the same as that in the test point set.
  • the number of point subsets is the same for subsequent calculations. However, this does not necessarily require that the same number must be obtained by sampling, and the same number can also be maintained by data processing such as interpolation, filtering, etc.
  • sampling can be performed separately and successively to obtain a sampling point subset and a test point set respectively; however, from the perspective of saving preoperative time, sampling can also be performed simultaneously and at the same frequency to obtain a sampling point subset and a test point set.
  • the body surface sensor used to sense the intrinsic movement of the anatomical structure can generally be a position sensor or a posture sensor.
  • the body surface sensor is usually non-invasively and stably set on the patient's body surface corresponding to the anatomical structure, that is, the body surface sensor is generally exposed on the patient's body surface. Therefore, compared with the tracking sensor used to sense the position of the catheter end and/or the instrument end mentioned above, there are relatively more types of body surface sensors to choose from.
  • the body surface sensor can not only use the EM sensor as mentioned above, but also can use optical positioning sensors.
  • the anatomical structure is a bronchus or a (cardio)vascular vessel
  • at least one body surface sensor is arranged on the patient's chest.
  • the body surface sensors may include three, the first body surface sensor may be arranged in the middle of the patient's chest, the second body surface sensor may be arranged in the area of the patient's chest corresponding to the seventh rib on the left, and the third body surface sensor may be arranged in the area of the patient's chest corresponding to the seventh rib on the right. The more body surface sensors there are, the more areas of the patient's body surface are covered, and the more accurately the intrinsic movement of the anatomical structure is sensed.
  • Step S1213 based on the test point set and the sampling point subset in the same surgical environment coordinate system, determine a denoising weight matrix corresponding to the sampling point subset.
  • the body surface sensor and the tracking sensor are EM sensors, and the two may belong to the same electromagnetic positioning system or different electromagnetic positioning systems.
  • the positions sensed by the two are in the same surgical environment coordinate system; when the two belong to different electromagnetic positioning systems, the positions sensed by the two may also be transformed to the same surgical environment coordinate system by coordinate conversion.
  • the surgical environment coordinate system may also be referred to as an electromagnetic coordinate system.
  • step S1213 can be more specifically implemented by the following steps:
  • the position data of the test point set obtained by the body surface sensor is defined as The body surface sensor data Ref is defined, and the position data of a subset of sampling points acquired by the tracking sensor (ie, sampling points) is defined as the in-vivo catheter data Tube.
  • the inverse solution of can be obtained by SVD (Singular Value Decomposition) method.
  • the obtained inverse solution can usually be expressed as:
  • V is the right singular matrix
  • S is the singular value matrix
  • U is the left singular matrix
  • Weight is the denoising weight matrix.
  • three body surface sensors can be used to obtain a test point set in more than two respiratory cycles (usually 6 to 10 seconds), and a subset of sampling points associated with the feature points can be simultaneously obtained through the tracking sensor.
  • the body surface sensor data Ref is a matrix of N rows and 9 columns, and the format of each row can be expressed as ⁇ X1, Y1, Z1, X2, Y2, Z2, X3, Y3, Z3 ⁇ , for example, and each 3 columns correspond to a position data sensed by a body surface sensor.
  • the in vivo catheter data Tube is a matrix of N rows and 3 columns, and the format of each row can be expressed as ⁇ X0, Y0, Z0 ⁇ , for example, and the 3 columns correspond to the position data of the catheter end and/or the instrument end sensed by the tracking sensor.
  • each feature point corresponds to a certain denoising weight matrix.
  • PosTube is the mean value of the sampling points in the sampling point set corresponding to each feature point.
  • the mean value is the mean value of the electromagnetic coordinate points at the end of the catheter and/or the end of the instrument, as shown in ;
  • PosRef is the mean value of the test points in the test point set corresponding to each feature point.
  • the mean The value is the average of the electromagnetic coordinate points of the three body surface sensors, as shown in Weight is a matrix with 9 rows and 3 columns.
  • the control device when acquiring the data of the sampling points corresponding to a certain feature point, can mark these sampling points or the sampling point subsets corresponding to these sampling points, for example, assign serial numbers to establish the association between the sampling points or the sampling point subsets and the corresponding feature points. Furthermore, when determining the corresponding denoising weight matrix based on the association between the feature points and the sampling points (or sampling point subsets) and the denoising weight matrix, the sampling points (or sampling point subsets) and the denoising weight matrix can be matched extremely conveniently and quickly.
  • the sampling point when denoising the sampling points in the sampling point subset based on the denoising weight matrix, for the same feature point, the sampling point can be denoised by combining a corresponding pair of sampling points and a test point, the denoising weight matrix weight, and the mean value PosRef of the test points in the test point set.
  • Exemplary examples include:
  • the offset can be determined by the following formula:
  • the offset is the offset
  • Ro is the current test point.
  • the offset is a row vector containing 9 elements.
  • denoising can be performed using the following formula:
  • Tf is the current sampling point after denoising
  • To is the current sampling point.
  • a corresponding pair of sampling points and test points may refer to sampling points and test points that are sampled at the same moment in the same motion cycle of the anatomical structure, for example, the pair of points are collected at the same moment in the same motion cycle; or may refer to sampling points and test points that are sampled at the same moment in different motion cycles of the anatomical structure.
  • the method further includes:
  • Step S15 obtaining a path point cloud from the anatomical structure.
  • the path point cloud includes a plurality of actual path points sensed in the anatomical structure by the first sensor.
  • a path point cloud may also be referred to as a path point set, and includes multiple actual path points that the catheter end and/or the instrument end passes through in the anatomical structure.
  • An actual path point reflects the position of the catheter end and/or the instrument end when the sensor feedbacks.
  • the actual path points obtained by multiple feedbacks from the same sensor are arranged according to the feedback time to obtain the movement path of the catheter end and/or the instrument end.
  • the first path point cloud may include not only the sampling point, but also other points different from the sampling point.
  • the first path point cloud may only include other points different from the sampling point.
  • the simulated feature points and the actual path points may be obtained in one process, or may be obtained in different processes.
  • Step S16 obtaining a model point cloud from the anatomical model.
  • the model point cloud includes multiple skeleton points of the pipeline centerline of the anatomical model and/or multiple vertices of the pipeline wall.
  • the skeleton points can be obtained, for example, by first extracting the pipeline centerline from the anatomical model and then discretizing the pipeline centerline to obtain these skeleton points.
  • the vertices of the pipeline wall can be obtained, for example, by first extracting the pipeline wall from the anatomical model and then discretizing the pipeline wall to obtain these pipeline wall vertices.
  • Step S17 determining a second transformation matrix of the path point cloud and the model point cloud based on the first transformation matrix, a plurality of actual path points of the path point cloud, and a plurality of skeleton points of the model point cloud.
  • step S17 by performing point cloud registration on the path point cloud and the model point cloud, the second transformation matrix between the surgical environment coordinate system and the anatomical model, i.e., the second registration relationship, can be determined.
  • the second registration relationship is a precise registration relationship. Since the first transformation matrix obtained in the coarse registration stage has a high precision, the precision of the second transformation matrix obtained in the precise registration stage is also relatively high.
  • the second transformation matrix determined in step S17 can be considered as a precise registration matrix, or the determined second registration relationship can be considered as a precise registration relationship.
  • the representative algorithm for point cloud registration is the Iterative Closest Point (ICP) algorithm.
  • ICP Iterative Closest Point
  • the core idea is to minimize the distance between two point sets and make the two point sets close to each other through iteration.
  • the following is a brief introduction to the principle of ICP.
  • the basic method of ICP includes two steps: 1. Match point clouds Q and P to find the corresponding point pairs between them; 2. Calculate the transformation matrix between point clouds Q and P based on the corresponding point pairs.
  • a corresponding point pair consists of two points, one from point cloud P and the other from point cloud Q. These two points are each other's matching points, and these two points are considered to be corresponding, that is, the two points are essentially equivalent.
  • ICP will match according to the principle of the closest distance (generally Euclidean distance), that is, for each point in the point cloud P, find the point closest to it in the point cloud Q as its matching point. Then calculate a transformation matrix based on these point pairs. After completing a round of calculations, ICP will determine whether the iteration stop condition is met. If not, the transformation matrix obtained by this round of calculations is used to transform and update the point cloud P, and then the point cloud Q and the transformed point cloud P are used to repeat the above process until the iteration stops.
  • the closest distance generally Euclidean distance
  • the default condition for stopping the iteration is that the difference in error between the previous and next two iterations is less than 0.01, but sometimes the difference between the point clouds is so large that the convergence condition cannot be met, so it is necessary to set an upper limit on the number of iterations, for example, it can be set to 500.
  • PosTubeCT MatrixFine*MatrixCoarse*PosTubeEM formula (5)
  • PosTubeEM is the position of the catheter end and/or the instrument end in the surgical environment coordinate system
  • PosTubeCT is the position of the catheter end and/or the instrument end in the image coordinate system of the anatomical model
  • MatrixCoarse is the first transformation matrix
  • MatrixFine is the second transformation matrix.
  • the motion path of the catheter tip and/or the instrument tip in the surgical environment coordinate system is located in the upper part of Figure 8. After each actual path point in the motion path is first multiplied by the rough registration matrix and then by the fine registration matrix, the motion path is basically located inside the planned bronchial anatomical model. The more iterations, the higher the registration accuracy will be.
  • point cloud registration can be divided into two parts: coarse registration from step S11 to step S14 and fine registration from step S15 to step S18.
  • coarse registration is used to obtain an initial transformation matrix (i.e., the first transformation matrix) to roughly align the two sets of point clouds.
  • ICP is used for fine registration, using more points for refined alignment.
  • the first round of ICP is to match the point cloud Q with the point cloud P transformed by the initial transformation matrix.
  • step S15 may include:
  • Step S151 obtaining the current actual path point.
  • the first sensor acquires the actual path point in real time, and the actual path point acquired at the current moment can be defined as the current actual path point. As time changes, the current actual path point will be continuously updated.
  • Step S152 determining the feature point closest to the current actual path point.
  • each actual path point it is necessary to determine the feature point closest to each actual path point. For example, the Euclidean distance between each actual path point and the mean PosTube of the sampling points in the sampling point set corresponding to each feature point can be compared to obtain the feature point closest to it.
  • Step S153 determining a denoising weight matrix associated with the feature point.
  • a KD search tree (KD-tree) can be constructed with the mean point PosTube of the sampling points in the sampling point subset corresponding to all feature points as a node for subsequent retrieval.
  • the KD tree constructed here is a key-value search tree in a three-dimensional Euclidean space, which is used for range search and nearest neighbor search.
  • Step S154 denoising the current actual path point based on the denoising weight matrix, obtaining the denoised current actual path point and adding it to the path point cloud.
  • each actual path point can be denoised by using the formula (4) and the formula (5).
  • the second transformation matrix determined by calculating the path point cloud including the denoised actual path points and the model point cloud is The array has a higher registration accuracy.
  • the point cloud composed of hollow circle-shaped points represents the catheter movement path before denoising (i.e., before compensation)
  • the point cloud composed of five-pointed star-shaped points represents the catheter movement path after denoising
  • the continuous path in the middle is the path spliced together from multiple bronchial centerlines.
  • the denoised point cloud has a smaller deviation (ie, better convergence) relative to the bronchial centerline, which means that the influence of respiratory motion is greatly weakened.
  • the actual path points of the catheter tip in the anatomical structure sensed by the first sensor can be obtained; based on the first transformation matrix and/or the second transformation matrix, the simulated path points of the actual path points in the anatomical model can be determined; a marker graphic representing the catheter tip and/or the instrument tip is generated; and the marker graphic is displayed at the simulated path points.
  • the second transformation matrix can be used to determine the simulated path points of the actual path points in the anatomical model; after the fine registration starts and before it ends, the first transformation matrix and the second transformation matrix can be used to determine the simulated path points of the actual path points in the anatomical model; before the fine registration starts, the first transformation matrix can be used to determine the simulated path points of the actual path points in the anatomical model.
  • the marking graphic may be, for example, a sphere or any other shape.
  • the position of the catheter end and/or the instrument end displayed on the anatomical model is closer to the actual position. Higher accuracy is helpful to determine whether the catheter end and/or the instrument end (such as a biopsy needle) has reached the lesion, reduce the number of X-rays taken during surgery, and reduce the radiation intake of doctors and patients.
  • the stability of the data obtained by the tracking sensor can be improved.
  • the data obtained by the tracking sensor after denoising filters out the jitter caused by the intrinsic movement of the anatomical structure. After being converted into the image coordinate system of the anatomical model, it can be displayed in a certain position of the anatomical model in a stable form without fluctuating and drifting everywhere, making it more convenient for users to observe the current position of the catheter tip and/or the instrument tip.
  • control device may include: a processor 501, a communications interface 502, a memory 503, and a communication bus 504.
  • the processor 501 , the communication interface 502 , and the memory 503 communicate with each other via the communication bus 504 .
  • the communication interface 502 is used to communicate with other devices such as various sensors, rotating motors, solenoid valves, or network elements of other clients or servers.
  • the processor 501 is used to execute the program 505, and specifically can execute the relevant steps in the above method embodiment.
  • the program 505 may include program codes, which include computer operation instructions.
  • the processor 505 may be a central processing unit CPU, or an application specific integrated circuit ASIC (Application Specific Integrated Circuit), or one or more integrated circuits configured to implement the embodiments of the present application, or an FPGA, or a graphics processing unit GPU (Graphics Processing Unit).
  • the one or more processors included in the control device may be processors of the same type, such as one or more CPUs, or one or more GPUs; or they may be processors of different types, such as one or more CPUs and one or more GPUs.
  • the memory 503 is used to store the program 505.
  • the memory 503 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk storage.
  • the program 505 may be specifically used to enable the processor 501 to perform the following operations:
  • a model point set including a plurality of simulated feature points, wherein the simulated feature points are acquired from an anatomical model of an anatomical structure of a first patient, and the plurality of simulated feature points are respectively associated with a plurality of feature points of the anatomical structure;
  • a spatial point set including a plurality of sampling point subsets, wherein the sampling point subsets include a plurality of sampling points, the sampling points are acquired from the anatomical structure, and the plurality of sampling point subsets are respectively associated with a plurality of the feature points;
  • a first transformation matrix between the model point set and the space point set is determined.
  • the present application also provides a computer-readable storage medium storing a computer program, wherein the computer program is configured to be loaded by a processor and executed to implement the steps of the method described in any of the above embodiments.
  • the present application also provides a computer program product, including computer instructions, which, when executed on a computer, enable the computer to execute the method described in any one of the above embodiments.

Landscapes

  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Surgery (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Medical Informatics (AREA)
  • General Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • Robotics (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Manipulator (AREA)

Abstract

A catheter robot and a registration method thereof. The method comprises: acquiring a model point set comprising a plurality of simulated feature points; by means of a first sensor, acquiring a spatial point set comprising a plurality of sampling point subsets; obtaining a plurality of denoising weight matrices corresponding to the plurality of sampling point subsets; based on the plurality of denoising weight matrices, respectively denoising the sampling points in the corresponding plurality of sampling point subsets; based on the denoised sampling points of the plurality of sampling point subsets, respectively determining mean points corresponding to the plurality of sampling point subsets; and based on the plurality of simulated feature points and the plurality of mean points, determining a coarse registration relationship between the model point set and the spatial point set. The invention improves registration precision between a model point set and a spatial point set.

Description

导管机器人及其配准方法Catheter robot and registration method thereof

本申请要求于2023年04月27日提交中国专利局、申请号为202310481670.9、申请名称为“导管机器人及其配准方法”的中国专利申请的优先权,其全部内容通过引用结合在本申请中。This application claims the priority of the Chinese patent application filed with the China Patent Office on April 27, 2023, with application number 202310481670.9 and application name “Catheter Robot and Its Alignment Method”, the entire contents of which are incorporated by reference into this application.

技术领域Technical Field

本申请涉及手术机器人领域,特别是涉及一种导管机器人及其配准方法。The present application relates to the field of surgical robots, and in particular to a catheter robot and a registration method thereof.

背景技术Background Art

微创医疗技术旨在减小在医疗过程期间受损的组织的量,由此减小患者恢复时间、不适和有害的副作用。可以通过解剖结构中的自然孔口或通过一个或多个手术切口来执行此类微创技术。医生可以通过这些自然孔口或切口插入微创医疗仪器以达到目标组织位置。为了辅助达到目标组织位置,可以使医疗仪器的位置与解剖结构的术前图像或术中图像相关。为了实现医疗仪器的位置与解剖结构的术前图像或术中图像相关,需要对医疗仪器和图像进行图像配准。Minimally invasive medical techniques are intended to reduce the amount of tissue damaged during a medical procedure, thereby reducing patient recovery time, discomfort, and harmful side effects. Such minimally invasive techniques can be performed through natural orifices in the anatomical structure or through one or more surgical incisions. Doctors can insert minimally invasive medical instruments through these natural orifices or incisions to reach the target tissue location. In order to assist in reaching the target tissue location, the position of the medical instrument can be correlated with a preoperative image or an intraoperative image of the anatomical structure. In order to achieve the correlation of the position of the medical instrument with the preoperative image or an intraoperative image of the anatomical structure, image registration of the medical instrument and the image is required.

现有技术的图像配准,通过在图像上选取几个明显的特征点,这些特征点在图像坐标系中的坐标值组成第一点集;并操控医疗仪器在解剖结构中运动以达到相应的特征点处,获取这些特征点在手术环境坐标系中的坐标值组成第二点集;进而基于第一点集和第二点集确定手术环境坐标系相对于图像坐标系的变换矩阵以完成配准。The image registration of the prior art is carried out by selecting several obvious feature points on the image, and the coordinate values of these feature points in the image coordinate system constitute a first point set; and controlling the medical instrument to move in the anatomical structure to reach the corresponding feature points, and obtaining the coordinate values of these feature points in the surgical environment coordinate system to constitute a second point set; and then determining the transformation matrix of the surgical environment coordinate system relative to the image coordinate system based on the first point set and the second point set to complete the registration.

然而,现有技术在进行图像配准时,没有考虑解剖结构的内在运动影响,例如解剖结构是支气管时,没有考虑呼吸运动的影响。这种影响导致获取的特征点在手术环境坐标系中的坐标值出现意料之外的偏差,进而导致确定的变换矩阵具有较大的误差。 However, the existing technology does not consider the intrinsic motion effect of the anatomical structure when performing image registration. For example, when the anatomical structure is a bronchus, the effect of respiratory motion is not considered. This effect causes unexpected deviations in the coordinate values of the acquired feature points in the surgical environment coordinate system, which in turn causes a large error in the determined transformation matrix.

发明内容Summary of the invention

基于此,有必要提供一种利于提高配准精度的导管机器人及其配准方法。Based on this, it is necessary to provide a catheter robot and a registration method thereof that are conducive to improving the registration accuracy.

一方面,本申请提供一种导管机器人,包括:In one aspect, the present application provides a catheter robot, comprising:

导管,所述导管和/或所述导管搭载的器械上设置有用于感应所述导管末端和/或所述器械末端的位置的第一传感器;及A catheter, wherein the catheter and/or an instrument carried by the catheter is provided with a first sensor for sensing the position of the catheter end and/or the instrument end; and

控制装置,与所述第一传感器耦接,并被配置成用于:A control device, coupled to the first sensor and configured to:

获取模型点集,所述模型点集包括多个模拟特征点,所述模拟特征点从第一患者的解剖结构的解剖模型获取,多个所述模拟特征点分别与所述解剖结构的多个特征点关联;Acquire a model point set, the model point set comprising a plurality of simulated feature points, the simulated feature points being acquired from an anatomical model of an anatomical structure of a first patient, the plurality of simulated feature points being respectively associated with a plurality of feature points of the anatomical structure;

获取空间点集,所述空间点集包括多个采样点子集,所述采样点子集包括多个采样点,所述采样点通过所述第一传感器从所述解剖结构获取,多个所述采样点子集分别与多个所述特征点关联;Acquire a spatial point set, wherein the spatial point set includes a plurality of sampling point subsets, wherein the sampling point subsets include a plurality of sampling points, wherein the sampling points are acquired from the anatomical structure by the first sensor, and the plurality of sampling point subsets are respectively associated with a plurality of the feature points;

获取相应于多个所述采样点子集的多个去噪权重矩阵,多个所述去噪权重矩阵分别与多个所述特征点关联;Acquire a plurality of denoising weight matrices corresponding to a plurality of the sampling point subsets, wherein the plurality of denoising weight matrices are respectively associated with a plurality of the feature points;

基于多个所述去噪权重矩阵,分别对相应的多个所述采样点子集中所述采样点进行去噪;Based on the plurality of denoising weight matrices, denoising the sampling points in the corresponding plurality of sampling point subsets respectively;

基于多个所述采样点子集的去噪后的所述采样点,分别确定多个所述采样点子集相应的均值点;Based on the denoised sampling points of the plurality of sampling point subsets, respectively determining mean points corresponding to the plurality of sampling point subsets;

基于多个所述模拟特征点和多个所述均值点,确定所述模型点集和所述空间点集之间的粗配准关系。Based on the plurality of simulated feature points and the plurality of mean points, a rough registration relationship between the model point set and the space point set is determined.

另一方面,本申请提供一种导管机器人的配准方法,包括:On the other hand, the present application provides a catheter robot registration method, comprising:

获取包括多个模拟特征点的模型点集,所述模拟特征点从第一患者的解剖结构的解剖模型获取,多个所述模拟特征点分别与所述解剖结构的多个特征点关联;Acquire a model point set including a plurality of simulated feature points, wherein the simulated feature points are acquired from an anatomical model of an anatomical structure of a first patient, and the plurality of simulated feature points are respectively associated with a plurality of feature points of the anatomical structure;

通过第一传感器获取包括多个采样点子集的空间点集,所述采样点子集包括多个采样点,所述采样点从所述解剖结构获取,多个所述采样点子集分别与多个所述特征点关联; Acquire, by a first sensor, a spatial point set including a plurality of sampling point subsets, wherein the sampling point subsets include a plurality of sampling points, the sampling points are acquired from the anatomical structure, and the plurality of sampling point subsets are respectively associated with a plurality of the feature points;

获取相应于多个所述采样点子集的多个去噪权重矩阵,多个所述去噪权重矩阵分别与多个所述特征点关联;Acquire a plurality of denoising weight matrices corresponding to a plurality of the sampling point subsets, wherein the plurality of denoising weight matrices are respectively associated with a plurality of the feature points;

基于多个所述去噪权重矩阵,分别对相应的多个所述采样点子集中所述采样点进行去噪;Based on the plurality of denoising weight matrices, denoising the sampling points in the corresponding plurality of sampling point subsets respectively;

基于多个所述采样点子集的去噪后的所述采样点,分别确定多个所述采样点子集相应的均值点;Based on the denoised sampling points of the plurality of sampling point subsets, respectively determining mean points corresponding to the plurality of sampling point subsets;

基于多个所述模拟特征点和多个所述均值点,确定所述模型点集和所述空间点集之间的粗配准关系。Based on the plurality of simulated feature points and the plurality of mean points, a rough registration relationship between the model point set and the space point set is determined.

又一方面,本申请提供一种计算机可读存储介质,该计算机可读存储介质存储有计算机程序,该计算机程序被配置为由处理器加载并执行实现如上述任一项实施例所述的方法的步骤。On the other hand, the present application provides a computer-readable storage medium storing a computer program, wherein the computer program is configured to be loaded and executed by a processor to implement the steps of the method described in any one of the above embodiments.

本申请还提供一种计算机程序产品,包括计算机指令,当所述计算机指令在计算机上运行时,使得所述计算机执行如上述任一项实施例所述的方法。The present application also provides a computer program product, comprising computer instructions, which, when executed on a computer, enable the computer to execute the method described in any one of the above embodiments.

本申请的导管机器人及其配准方法,具有如下有益效果:The catheter robot and the registration method thereof of the present application have the following beneficial effects:

通过获取分别与各采样点子集相对应的去噪权重矩阵,通过多个去噪权重矩阵分别对相应采样点子集中的采样点进行去噪,并获取各采样点子集去噪后的采样点的均值点,进而基于多个模拟特征点与多个均值点,确定图像坐标系和手术环境坐标系之间的粗配准关系,能够减小或消除患者的解剖结构的内在运动对粗配准精度的不利影响。By obtaining denoising weight matrices corresponding to each sampling point subset, denoising the sampling points in the corresponding sampling point subsets respectively through multiple denoising weight matrices, and obtaining the mean point of the denoised sampling points in each sampling point subset, and then determining the coarse registration relationship between the image coordinate system and the surgical environment coordinate system based on multiple simulated feature points and multiple mean points, the adverse effect of the intrinsic movement of the patient's anatomical structure on the coarse registration accuracy can be reduced or eliminated.

附图说明BRIEF DESCRIPTION OF THE DRAWINGS

图1为本申请一实施例提供的导管机器人的结构示意图;FIG1 is a schematic diagram of the structure of a catheter robot provided in one embodiment of the present application;

图2为本申请一实施例提供的导管器械与动力部的结构示意图;FIG2 is a schematic diagram of the structure of a catheter device and a power unit provided in one embodiment of the present application;

图3为申请一实施例提供的导管机器人的配准方法的流程示意图;FIG3 is a schematic flow chart of a registration method for a catheter robot according to an embodiment of the present invention;

图4为本申请一实施例提供的模拟特征点在解剖结构中的示意示意图;FIG4 is a schematic diagram of simulated feature points in an anatomical structure provided by an embodiment of the present application;

图5为申请一实施例提供的导管机器人的配准方法的流程示意图;FIG5 is a schematic flow chart of a registration method for a catheter robot according to an embodiment of the present invention;

图6为申请又一实施例提供的导管机器人的配准方法的流程示意图; FIG6 is a schematic flow chart of a catheter robot registration method provided in yet another embodiment of the application;

图7为申请再一实施例提供的导管机器人的配准方法的流程示意图;FIG7 is a schematic flow chart of a registration method for a catheter robot provided in yet another embodiment of the application;

图8为本申请一实施例提供的转换导管运动路径的坐标系的效果示意图;FIG8 is a schematic diagram of the effect of converting the coordinate system of the movement path of the catheter provided by an embodiment of the present application;

图9为申请一实施例提供的导管机器人的配准方法的流程示意图;FIG9 is a schematic flow chart of a registration method for a catheter robot according to an embodiment of the present invention;

图10为本申请一实施例提供的导管运动路径去噪前后的效果示意图;FIG10 is a schematic diagram of the effect of the catheter motion path before and after denoising according to an embodiment of the present application;

图11为本申请一实施例提供的导管运动路径去噪前的配准精度的效果示意图;FIG11 is a schematic diagram showing the effect of the registration accuracy before the catheter motion path denoising provided by an embodiment of the present application;

图12为本申请一实施例提供的导管运动路径去噪后的配准精度的效果示意图;FIG12 is a schematic diagram showing the effect of the registration accuracy after the catheter motion path denoising provided by an embodiment of the present application;

图13为本申请远程医疗系统的控制装置的原理示意图。FIG. 13 is a schematic diagram showing the principle of the control device of the telemedicine system of the present application.

具体实施方式DETAILED DESCRIPTION

为了便于理解本申请,下面将参照相关附图对本申请进行更全面的描述。附图中给出了本申请的较佳实施方式。但是,本申请可以以许多不同的形式来实现,并不限于本申请所描述的实施方式。相反地,提供这些实施方式的目的是使对本申请的公开内容理解的更加透彻全面。In order to facilitate the understanding of the present application, the present application will be described more comprehensively with reference to the relevant drawings below. The preferred embodiments of the present application are given in the drawings. However, the present application can be implemented in many different forms and is not limited to the embodiments described in the present application. On the contrary, the purpose of providing these embodiments is to make the disclosure of the present application more thoroughly and comprehensively understood.

需要说明的是,当元件被称为“设置于”另一个元件,它可以直接在另一个元件上或者也可以存在居中的元件。当一个元件被认为是“连接”另一个元件,它可以是直接连接到另一个元件或者可能同时存在居中元件。当一个元件被认为是“耦接”另一个元件,它可以是直接耦接到另一个元件或者可能同时存在居中元件。本申请所使用的术语“垂直的”、“水平的”、“左”、“右”以及类似的表述只是为了说明的目的,并不表示是唯一的实施方式。本申请所使用的术语“远端”、“近端”作为方位词,该方位词为介入医疗器械领域惯用术语,其中“远端”表示手术过程中靠近患者的一端,“近端”表示手术过程中远离患者的一端。本申请所使用的术语“第一/第二”等表示一个部件以及一类具有共同特性的两个以上的部件。It should be noted that when an element is referred to as being "disposed on" another element, it may be directly on the other element or there may be a central element. When an element is considered to be "connected" to another element, it may be directly connected to the other element or there may be a central element at the same time. When an element is considered to be "coupled" to another element, it may be directly coupled to the other element or there may be a central element at the same time. The terms "vertical", "horizontal", "left", "right" and similar expressions used in this application are for illustrative purposes only and do not represent the only implementation method. The terms "distal end" and "proximal end" used in this application are used as directional words, which are commonly used terms in the field of interventional medical devices, where "distal end" refers to the end close to the patient during surgery, and "proximal end" refers to the end away from the patient during surgery. The terms "first/second" and the like used in this application represent a component and a class of more than two components with common characteristics.

除非另有定义,本申请所使用的所有的技术和科学术语与属于本申请的技术领域的技术人员通常理解的含义相同。本申请中所使用的术语只是为了 描述具体的实施方式的目的,不是旨在于限制本申请。本申请所使用的术语“及/或”包括一个或多个相关的所列项目的任意的和所有的组合。本申请中所使用的术语“各”包括一个或两个以上。本申请所使用的术语“多个”指两个及以上。Unless otherwise defined, all technical and scientific terms used in this application have the same meaning as commonly understood by those skilled in the art to which this application belongs. The purpose of describing specific implementation methods is not intended to limit this application. The term "and/or" used in this application includes any and all combinations of one or more related listed items. The term "each" used in this application includes one or more than two. The term "plurality" used in this application refers to two or more.

下面结合附图来描述根据本申请实施例提出的导管机器人的配准方法、导管机器人,以及计算机可读存储介质。The following describes the catheter robot registration method, the catheter robot, and the computer-readable storage medium proposed according to the embodiments of the present application in conjunction with the accompanying drawings.

图1示出了本申请一实施例提供的导管系统1000。导管系统1000包括影像车100、分别与所述影像车100连接的台车200和主控器300,可以被接合至所述台车200上的导管器械400,与所述台车200连接的传感器系统500,以及用于在所述导管器械400、所述主控器300、所述传感器系统500以及所述影像车100之间实现控制的控制系统600等。其中,所述主控器300可以与所述台车200有线连接或无线连接。操作者对台车200旁的患者执行各种程序时,可以通过操作所述主控器300触发控制指令,经所述台车200的驱动而控制所述导管器械400前进、缩回以及弯曲转向等。FIG1 shows a catheter system 1000 provided in an embodiment of the present application. The catheter system 1000 includes an imaging vehicle 100, a trolley 200 and a main controller 300 respectively connected to the imaging vehicle 100, a catheter instrument 400 that can be coupled to the trolley 200, a sensor system 500 connected to the trolley 200, and a control system 600 for realizing control between the catheter instrument 400, the main controller 300, the sensor system 500 and the imaging vehicle 100. Among them, the main controller 300 can be connected to the trolley 200 by wire or wirelessly. When the operator performs various procedures on the patient next to the trolley 200, the control instruction can be triggered by operating the main controller 300, and the catheter instrument 400 can be controlled to advance, retract, bend and turn, etc. through the drive of the trolley 200.

所述台车200通常可以被移动至手术床旁,用于接合所述导管器械400,并在控制指令下控制所述导管器械400沿竖直方向进行升降,或沿水平方向平移,或非竖直以及非水平方向移动,从而为所述导管器械400的操作提供一个较好的术前准备角度。其中,该控制指令可以是来自操作者通过操作所述主控器300而触发的指令,也可以是来自操作者直接通过点击或按压所述台车200上设置的按键而触发的指令。当然,在其他实施例中,所述控制指令还可以是语音控制或通过力反馈机制而触发的指令。The trolley 200 can usually be moved to the side of the operating bed to engage the catheter instrument 400, and control the catheter instrument 400 to move up and down in the vertical direction, or translate in the horizontal direction, or move in non-vertical and non-horizontal directions under the control command, so as to provide a better preoperative preparation angle for the operation of the catheter instrument 400. The control command can be a command triggered by the operator by operating the main controller 300, or a command triggered by the operator directly clicking or pressing a button set on the trolley 200. Of course, in other embodiments, the control command can also be a command triggered by voice control or a force feedback mechanism.

如图1所示,进一步地,所述台车200可以包括底座210、可以沿着所述底座210进行升降移动的滑动座体220,以及与所述滑动座体220固定连接的两个机械臂230。所述机械臂230可以包括在关节处联接的多个臂分段,所述多个臂分段为所述机械臂230提供多个自由度,例如,与七个臂分段相对应的七个自由度。所述机械臂230的末端装设有动力部(图中未示出),所述机械臂230的动力部用于接合所述导管器械400,并在所述动力部的驱动 作用下控制所述导管器械400的末端相应发生弯曲转向。其中,所述两个机械臂230可以是结构完全相同或部分相同的结构,一个机械臂230用于接合内导管器械410,另一个机械臂230用于接合外导管器械420。装设时,可以先安装所述外导管器械420,待所述外导管器械420安装完毕时,将所述内导管器械410的导管插入所述外导管器械420的导管内。As shown in FIG1 , further, the trolley 200 may include a base 210, a sliding seat body 220 that can be lifted and moved along the base 210, and two mechanical arms 230 fixedly connected to the sliding seat body 220. The mechanical arm 230 may include a plurality of arm segments connected at a joint, and the plurality of arm segments provide the mechanical arm 230 with a plurality of degrees of freedom, for example, seven degrees of freedom corresponding to seven arm segments. A power unit (not shown in the figure) is installed at the end of the mechanical arm 230, and the power unit of the mechanical arm 230 is used to engage the catheter instrument 400 and to move the catheter instrument 400 under the driving force of the power unit. Under the action, the end of the catheter instrument 400 is controlled to bend and turn accordingly. The two mechanical arms 230 can be structures that are completely the same or partially the same, one mechanical arm 230 is used to engage the inner catheter instrument 410, and the other mechanical arm 230 is used to engage the outer catheter instrument 420. During installation, the outer catheter instrument 420 can be installed first, and when the outer catheter instrument 420 is installed, the catheter of the inner catheter instrument 410 is inserted into the catheter of the outer catheter instrument 420.

所述传感器系统500具有用于接收关于所述导管器械400的信息的一个或多个子系统。所述子系统可以包括:位置传感器系统;用于确定所述导管器械400的末端和/或沿着可构成所述导管器械400的导管的一个或多个部段的位置、取向、速度、速率、位姿和/或形状的形状传感器系统;和/或用于从所述导管器械400的末端捕获图像的可视化系统。The sensor system 500 has one or more subsystems for receiving information about the catheter device 400. The subsystems may include: a position sensor system; a shape sensor system for determining the position, orientation, speed, velocity, pose, and/or shape of the tip of the catheter device 400 and/or along one or more segments of the catheter that may constitute the catheter device 400; and/or a visualization system for capturing images from the tip of the catheter device 400.

所述影像车100可以设置显示系统110以及冲洗系统(图中未示出)等。所述显示系统110用于显示由传感器系统500的子系统生成的手术部位和导管器械400的图像或表示。还可以显示由可视化系统捕获的手术部位和导管器械400的实时图像。还可以使用来自成像技术的图像数据来呈现术前或术中记录的手术部位的图像,所述成像技术诸如计算机断层扫描(CT)、磁共振成像(MRI)、光学相干断层扫描(OCT)、以及超声等。术前或术中图像数据可以被呈现为二维、三维或四维(如基于时间或基于速率的信息)图像和/或被呈现为来自根据术前或术中图像数据集创建的模型的图像,还可以显示虚拟导航图像。在所述虚拟导航图像中,所述导管器械400的实际位置与术前图像配准,以从外部向操作者呈现手术部位内的导管器械400的虚拟图像。The imaging vehicle 100 may be provided with a display system 110 and a flushing system (not shown in the figure), etc. The display system 110 is used to display images or representations of the surgical site and the catheter instrument 400 generated by the subsystem of the sensor system 500. Real-time images of the surgical site and the catheter instrument 400 captured by the visualization system may also be displayed. Images of the surgical site recorded before or during surgery may also be presented using image data from imaging techniques such as computed tomography (CT), magnetic resonance imaging (MRI), optical coherence tomography (OCT), and ultrasound, etc. The preoperative or intraoperative image data may be presented as a two-dimensional, three-dimensional, or four-dimensional (such as time-based or rate-based information) image and/or presented as an image from a model created based on a preoperative or intraoperative image data set, and a virtual navigation image may also be displayed. In the virtual navigation image, the actual position of the catheter instrument 400 is registered with the preoperative image to present a virtual image of the catheter instrument 400 in the surgical site to the operator from the outside.

所述控制系统600包括至少一个存储器和至少一个处理器。可以理解的是,所述控制系统600可以集成于所述台车200或所述影像车100中,也可以独立设置。所述控制系统600可以支持无线通信协议,诸如IEEE 802.11、IrDA、蓝牙、HomeRF、DECT和无线遥测等。所述控制系统600可以传输指示所述导管器械400移动的一个或多个由所述动力部移动所述导管器械400的信号。所述导管器械400可以经由所述患者的自然腔道的开口或手术切口延伸至体内的手术位置。 The control system 600 includes at least one memory and at least one processor. It is understood that the control system 600 can be integrated into the trolley 200 or the imaging trolley 100, or can be independently provided. The control system 600 can support wireless communication protocols such as IEEE 802.11, IrDA, Bluetooth, HomeRF, DECT, and wireless telemetry. The control system 600 can transmit one or more signals indicating the movement of the catheter instrument 400 by the power unit to move the catheter instrument 400. The catheter instrument 400 can extend to a surgical location in the body via an opening of a natural cavity or a surgical incision of the patient.

进一步地,所述控制系统600可以包括机械控制系统(图中未示出)和图像处理系统(图中未示出),所述机械控制系统用于控制所述导管器械400的移动,因此,可以集成于所述台车200中。所述图像处理系统用于虚拟导航路径规划,因此,可以集成于所述影像车100中。当然,所述控制系统600的各个子系统并不限于上述列举的具体情况,还可以根据实际情况合理设置。其中,所述图像处理系统可以基于术前或术中记录的手术部位的图像,使用上述成像技术对手术部位进行成像。还可以与手动输入结合使用的软件将记录的图像转换成部分或整个解剖器官或区段的二维或三维合成图像。在虚拟导航程序期间,所述传感器系统500可用于计算导管器械400相对于患者的解剖结构的位置,该位置可用于产生患者的解剖结构的外部跟踪图像和内部虚拟图像,实现导管器械400的实际位置与术前图像配准,从而可以从外部向操作者呈现手术部位内的导管器械400的虚拟图像。Further, the control system 600 may include a mechanical control system (not shown in the figure) and an image processing system (not shown in the figure), wherein the mechanical control system is used to control the movement of the catheter instrument 400, and therefore, can be integrated into the trolley 200. The image processing system is used for virtual navigation path planning, and therefore, can be integrated into the imaging vehicle 100. Of course, the various subsystems of the control system 600 are not limited to the specific situations listed above, and can also be reasonably set according to actual conditions. Among them, the image processing system can image the surgical site based on the image of the surgical site recorded before or during the operation, using the above imaging technology. The software used in combination with manual input can also convert the recorded image into a two-dimensional or three-dimensional synthetic image of a part or the entire anatomical organ or segment. During the virtual navigation procedure, the sensor system 500 can be used to calculate the position of the catheter instrument 400 relative to the patient's anatomical structure, which can be used to generate an external tracking image and an internal virtual image of the patient's anatomical structure, so as to realize the actual position of the catheter instrument 400 and the preoperative image registration, so that the virtual image of the catheter instrument 400 in the surgical site can be presented to the operator from the outside.

所述内导管器械410和所述外导管器械420的结构组成大体相同,分别具有细长柔性的内导管41和外导管42,其中,所述外导管42的直径略大于所述内导管41,以使所述内导管41可以穿过所述外导管42,并为所述内导管41提供一定的支撑性,从而可以使得所述内导管41可以到达患者体内的目标位置,以便于从目标位置处进行组织或细胞取样等操作。The structures of the inner catheter device 410 and the outer catheter device 420 are substantially the same, and they respectively have a slender and flexible inner catheter 41 and an outer catheter 42, wherein the diameter of the outer catheter 42 is slightly larger than the inner catheter 41, so that the inner catheter 41 can pass through the outer catheter 42 and provide a certain support for the inner catheter 41, so that the inner catheter 41 can reach the target position in the patient's body, so as to facilitate operations such as tissue or cell sampling from the target position.

所述主控器300的某些运动可以引起导管器械400的对应移动。例如,操作者操作主控器300的方向拨杆向上或向下移动时,所述主控器300的方向拨杆的运动可以被映射到所述导管器械400的末端相应的俯仰运动;当操作者操作主控器300的方向拨杆向左或向右移动时,所述主控器300的方向拨杆的运动可以被映射到所述导管器械400的末端相应的横摆运动。在本实施例中,所述主控器300可以控制所述导管器械400的末端在360°空间范围内进行移动。Certain movements of the main controller 300 may cause corresponding movements of the catheter device 400. For example, when the operator operates the direction lever of the main controller 300 to move upward or downward, the movement of the direction lever of the main controller 300 may be mapped to the corresponding pitch movement of the end of the catheter device 400; when the operator operates the direction lever of the main controller 300 to move left or right, the movement of the direction lever of the main controller 300 may be mapped to the corresponding yaw movement of the end of the catheter device 400. In this embodiment, the main controller 300 may control the end of the catheter device 400 to move within a 360° spatial range.

图2示出了本申请一实施例提供的导管器械400。所述导管器械400被配置成与机械臂230的动力部240进行接合,所述导管器械400包括被配置成与所述动力部240接合的器械盒45以及与所述器械盒45连接的导管48。 其中,所述“接合”是指所述器械盒45安装至所述动力部240时,所述动力部240的驱动力可以传递至所述器械盒45内、并能使所述导管48发生正常移动的状态。例如,在所述动力部240的驱动力作用下,所述导管48的末端可以发生弯曲转向等。2 shows a catheter instrument 400 provided in an embodiment of the present application. The catheter instrument 400 is configured to engage with the power unit 240 of the mechanical arm 230 , and includes an instrument box 45 configured to engage with the power unit 240 and a catheter 48 connected to the instrument box 45 . The “engagement” refers to a state in which the driving force of the power unit 240 can be transmitted to the inside of the instrument box 45 and the catheter 48 can move normally when the instrument box 45 is installed in the power unit 240. For example, under the driving force of the power unit 240, the end of the catheter 48 can be bent and turned.

本申请中的末端,也可以被称为远端或头部,是指远离器械盒45的一端;前端,也可以被称为近端或尾部,是指靠近器械盒45的一端。The end in this application may also be referred to as the distal end or the head, which refers to the end away from the instrument box 45 ; the front end may also be referred to as the proximal end or the tail, which refers to the end close to the instrument box 45 .

控制系统600的处理器被配置为执行以下步骤以实现本申请一实施例提供的导管机器人的配准方法。如图3所示,该方法包括:The processor of the control system 600 is configured to perform the following steps to implement the catheter robot registration method provided in an embodiment of the present application. As shown in FIG3 , the method includes:

步骤S11,从解剖结构的解剖模型中获取包括多个模拟特征点的模型点集。Step S11, obtaining a model point set including a plurality of simulated feature points from the anatomical model of the anatomical structure.

每一模拟特征点可以与解剖结构的一个特征点相对应(匹配),不同模拟特征点通常相应与解剖结构的不同特征点相对应。每一模拟特征点具有在该解剖模型的图像坐标系的坐标。解剖结构可以是支气管、泌尿管、(心)血管及肠道等经由自然的或手术创建的连接通道中的一种。本申请以解剖结构是支气管为例进行说明。Each simulated feature point may correspond (match) to a feature point of the anatomical structure, and different simulated feature points generally correspond to different feature points of the anatomical structure. Each simulated feature point has coordinates in the image coordinate system of the anatomical model. The anatomical structure may be one of the natural or surgically created connecting channels such as bronchus, urinary tract, (cardio) blood vessels and intestines. This application is described by taking the anatomical structure as a bronchus as an example.

特征点可以选取解剖结构中具有明显特征而易于辨别的点。模拟特征点是解剖模型中的点,与解剖结构中的特征点指代的点相同。示例性的,解剖结构是支气管(通常指肺部支气管)时,特征点可以选取各级隆突,例如,可以分别选取主隆突,左肺叶和右肺叶的第一级、第二级隆突等。Feature points can be selected from points in the anatomical structure that have obvious features and are easy to identify. Simulated feature points are points in the anatomical model, which are the same as the points referred to by the feature points in the anatomical structure. For example, when the anatomical structure is a bronchus (usually referring to the bronchus of the lung), the feature points can be selected from various levels of carina, for example, the main carina, the first level and second level carina of the left lobe and the right lobe can be selected respectively.

在选取特征点时,可以尽可能覆盖解剖结构更多的区域。特征点在解剖结构中分布的范围越广、分布的数量越多,后续的配准将越准确,进而可以避免陷入局部配准错误中,即一部分区域对齐、其余区域没有对齐。例如,在解剖结构是肺部支气管时,可以选取多个特征点以尽可能多的覆盖肺部支气管。例如,可以在主隆突、右上叶、右中叶、右下叶、左上叶、左中叶及左下叶中的一个或多个区域分别选取一个或多个特征点。示例性的,可以在上述各区域中的每一区域分别选取一个特征点,以覆盖整个支气管,如图4所示,在解剖模型中选取了表示主隆突的特征点1、表示左上叶的隆突的特 征点2、表示左中叶的隆突的特征点3、表示左下叶的隆突的特征点4、表示右上叶的隆突的特征点5、表示右中叶的隆突的特征点6、及表示右下叶的隆突的特征点7,共七个特征点。When selecting feature points, it is possible to cover as many areas of the anatomical structure as possible. The wider the distribution range of the feature points in the anatomical structure and the greater the number of distribution, the more accurate the subsequent registration will be, and it is possible to avoid falling into local registration errors, that is, one part of the area is aligned and the rest of the area is not aligned. For example, when the anatomical structure is a pulmonary bronchus, multiple feature points can be selected to cover as many pulmonary bronchus as possible. For example, one or more feature points can be selected from one or more areas of the main carina, right upper lobe, right middle lobe, right lower lobe, left upper lobe, left middle lobe and left lower lobe. Exemplarily, one feature point can be selected from each of the above-mentioned areas to cover the entire bronchus. As shown in FIG4 , feature point 1 representing the main carina, feature point 2 representing the carina of the left upper lobe, and feature point 3 representing the carina of the left upper lobe are selected in the anatomical model. There are seven feature points in total, namely, feature point 2, feature point 3 representing the carina of the left middle lobe, feature point 4 representing the carina of the left lower lobe, feature point 5 representing the carina of the right upper lobe, feature point 6 representing the carina of the right middle lobe, and feature point 7 representing the carina of the right lower lobe.

在获取模型点集中的模拟特征点时,可以手动选取这些模拟特征点,也可以自动识别并选取这些模拟特征点。When obtaining the simulated feature points in the model point set, these simulated feature points can be manually selected, or these simulated feature points can be automatically identified and selected.

步骤S12,从解剖结构中获取包括多个采样点子集的空间点集,并获取与空间点集中采样点子集相对应的去噪权重矩阵。Step S12: acquiring a spatial point set including a plurality of sampling point subsets from the anatomical structure, and acquiring a denoising weight matrix corresponding to the sampling point subsets in the spatial point set.

每一采样点子集可以与解剖结构的一个特征点相对应(匹配),不同采样点子集可以与解剖结构的不同特征点相对应,采样点子集与模拟特征点之间通过特征点进行关联。每一采样点子集包括多个采样点,采样点一般用导管末端或器械末端在世界坐标系(手术环境坐标系或物理空间坐标系)的坐标来描述。采样点可以通过跟踪传感器获取,跟踪传感器可以包括位置传感器和/或形状传感器。Each sampling point subset may correspond to (match) a feature point of the anatomical structure, different sampling point subsets may correspond to different feature points of the anatomical structure, and the sampling point subsets and the simulated feature points are associated through the feature points. Each sampling point subset includes multiple sampling points, and the sampling points are generally described by the coordinates of the catheter end or the instrument end in the world coordinate system (surgical environment coordinate system or physical space coordinate system). The sampling points can be acquired by a tracking sensor, and the tracking sensor can include a position sensor and/or a shape sensor.

例如,可以通过可视化系统引导导管插入到解剖结构内的末端和/或器械末端移动到达特征点,并通过设置在导管末端和/或器械末端的位置传感器,以获取导管末端和/或器械末端的位置。其中,一个位置传感器可以是电磁定位系统中的一个部件。电磁定位系统可以进一步包括磁场发生部件和磁场检测部件。磁场发生部件用于产生磁场,位置传感器是EM传感器(即电磁传感器),位置传感器在磁场中会引发磁场改变,磁场检测部件可以检测到磁场的改变从而检测到位置传感器相对于磁场/磁场发生部件的位姿,结合预先设定或标定得到的位置传感器与导管末端和/或器械末端之间的坐标转换关系,可以计算得到导管末端和/或器械末端相对于磁场/磁场发生部件的位置,再结合磁场/磁场发生部件与世界坐标系之间的坐标转换关系,可以计算出导管末端和/或器械末端在世界坐标系中的位置,即采样点。该位置传感器在磁场内至少可以感测三个平移自由度。For example, the visualization system can be used to guide the end of the catheter inserted into the anatomical structure and/or the end of the instrument to move to the feature point, and the position sensor set at the end of the catheter and/or the end of the instrument can be used to obtain the position of the end of the catheter and/or the end of the instrument. Among them, a position sensor can be a component in the electromagnetic positioning system. The electromagnetic positioning system can further include a magnetic field generating component and a magnetic field detecting component. The magnetic field generating component is used to generate a magnetic field, the position sensor is an EM sensor (i.e., an electromagnetic sensor), the position sensor will cause a change in the magnetic field in the magnetic field, and the magnetic field detection component can detect the change in the magnetic field to detect the position of the position sensor relative to the magnetic field/magnetic field generating component. Combined with the coordinate conversion relationship between the position sensor and the catheter end and/or the instrument end obtained by presetting or calibration, the position of the catheter end and/or the instrument end relative to the magnetic field/magnetic field generating component can be calculated, and then combined with the coordinate conversion relationship between the magnetic field/magnetic field generating component and the world coordinate system, the position of the catheter end and/or the instrument end in the world coordinate system, i.e., the sampling point, can be calculated. The position sensor can sense at least three translational degrees of freedom in the magnetic field.

又例如,可以用形状传感器系统来获取插入到解剖结构内的导管末端和/或器械末端的位置。例如,形状传感器可以包括与导管对齐的光纤,光纤形 成的光纤弯曲传感器可以反馈导管的形状,据此可以计算得到导管末端和/或器械末端相对于形状传感器的基座的位置,结合形状传感器的基座在世界坐标系中的位置,可以计算出导管末端和/或器械末端在世界坐标系中的位置,即采样点。For another example, a shape sensor system can be used to obtain the position of a catheter tip and/or an instrument tip inserted into an anatomical structure. For example, the shape sensor can include an optical fiber aligned with the catheter, and the optical fiber shape sensor can be used to obtain the position of a catheter tip and/or an instrument tip inserted into an anatomical structure. The fiber optic bending sensor can feedback the shape of the catheter, based on which the position of the catheter end and/or the instrument end relative to the base of the shape sensor can be calculated. Combined with the position of the base of the shape sensor in the world coordinate system, the position of the catheter end and/or the instrument end in the world coordinate system, i.e., the sampling point, can be calculated.

一些类型的解剖结构如支气管、(心)血管等,其内在运动如呼吸运动、心动运动频率高、幅度大,容易引起导管末端和/或器械末端在特征点处的位置波动大,进而容易导致后续配准不准确的问题。在一些实施例中,至少对于这种类型的解剖结构,可以操纵导管末端和/或器械末端在解剖结构中特征点处停留一定的时长以不间断获取其位置。一些实施例中,该时长可以包括该解剖结构的内在运动的至少一个运动周期。例如,对于支气管而言,该时长可以包括至少一个呼吸周期,例如一个、两个或者更多,正常人通常的一个呼吸周期为3~5秒。又例如,对于(心)血管而言,该时长可以包括至少一个心动周期,例如一个、两个或者更多,正常人通常的一个心动周期为0.5~1秒。采样的时长越长或者包括的运动周期越多,在这样的时长内不间断采样,采样点的数量相应会更多,能够避免因为运动周期的不同导致的个体差异。Some types of anatomical structures, such as bronchi, (cardio) blood vessels, etc., have intrinsic movements such as respiratory movement and cardiac movement with high frequency and large amplitude, which can easily cause large fluctuations in the position of the catheter end and/or the instrument end at the feature point, and thus easily lead to the problem of inaccurate subsequent registration. In some embodiments, at least for this type of anatomical structure, the catheter end and/or the instrument end can be manipulated to stay at the feature point in the anatomical structure for a certain period of time to continuously obtain its position. In some embodiments, the duration may include at least one movement cycle of the intrinsic movement of the anatomical structure. For example, for bronchi, the duration may include at least one respiratory cycle, such as one, two or more, and a normal respiratory cycle is usually 3 to 5 seconds. For another example, for (cardio) blood vessels, the duration may include at least one cardiac cycle, such as one, two or more, and a normal cardiac cycle is usually 0.5 to 1 second. The longer the sampling duration or the more movement cycles included, the more sampling points will be obtained during such a duration, and individual differences caused by different movement cycles can be avoided.

示例性的,在解剖结构是支气管时,导管末端和/或器械末端在不同的肺部区域,受到的呼吸运动的影响幅度不同,例如其在上肺叶区域受到的呼吸影响产生的波动幅度可能为10mm,而其在下肺叶区域受到的呼吸影响产生的波动幅度可能到达20mm。可见,对应于导管末端和/或器械末端在解剖结构中位置的不同,其受到解剖结构内在运动的影响通常也不同。由于特征点与采样点子集具有关联性,因此,可以对不同特征点或者可以对不同采样点子集构建不同的去噪权重矩阵,以在后续可以通过与采样点子集对应的去噪权重矩阵对该采样点子集进行去噪,以尽可能消除解剖结构内在运动对采样点的影响。Exemplarily, when the anatomical structure is a bronchus, the end of the catheter and/or the end of the instrument are affected by respiratory motion at different amplitudes in different lung regions. For example, the fluctuation amplitude caused by the respiratory effect in the upper lobe region may be 10 mm, while the fluctuation amplitude caused by the respiratory effect in the lower lobe region may reach 20 mm. It can be seen that corresponding to the different positions of the end of the catheter and/or the end of the instrument in the anatomical structure, the influence of the intrinsic motion of the anatomical structure on the end of the catheter and/or the end of the instrument is usually different. Since the feature points are associated with the sampling point subsets, different denoising weight matrices can be constructed for different feature points or for different sampling point subsets, so that the sampling point subset can be denoised later by the denoising weight matrix corresponding to the sampling point subset to eliminate the influence of the intrinsic motion of the anatomical structure on the sampling points as much as possible.

本申请中,选取的每一个特征点可以认为代表解剖结构的一个区域,在该区域内不同位置,可以简单认为该区域的内在运动对导管末端和/或器械末端的位置的影响基本相同。 In the present application, each selected feature point can be considered to represent an area of the anatomical structure. At different positions within the area, it can be simply considered that the intrinsic movement of the area has basically the same effect on the position of the catheter tip and/or the instrument tip.

一些实施例中,模型点集中模拟特征点的数量可以相同或不同于空间点集中采样点子集的数量。通常,模型点集中模拟特征点和空间点集中采样点子集可以共同关联至三个以上的特征点,如四个、五个、六个、七个或者更多个,关联的特征点越多,配准越精确。In some embodiments, the number of simulated feature points in the model point set may be the same as or different from the number of the sampling point subset in the spatial point set. Typically, the simulated feature points in the model point set and the sampling point subset in the spatial point set may be associated with more than three feature points, such as four, five, six, seven or more, and the more associated feature points, the more accurate the registration.

步骤S13,基于去噪权重矩阵对采样点子集中的采样点进行去噪,并基于去噪后的采样点确定该采样点子集的均值点。Step S13, denoising the sampling points in the sampling point subset based on the denoising weight matrix, and determining the mean point of the sampling point subset based on the denoised sampling points.

其中,可以通过采样点子集对应的去噪权重矩阵,对该采样点子集中全部采样点分别进行去噪。采样点子集的均值点是表示该采样点子集中全部采样点的平均位置的一个点,实质是一个描述于手术环境坐标系的坐标值。每个采样点子集均对应具有一个均值点。Among them, all sampling points in the sampling point subset can be denoised separately through the denoising weight matrix corresponding to the sampling point subset. The mean point of the sampling point subset is a point representing the average position of all sampling points in the sampling point subset, which is actually a coordinate value described in the surgical environment coordinate system. Each sampling point subset corresponds to a mean point.

步骤S14,基于模型点集的多个模拟特征点和空间点集的多个均值点,确定模型点集和空间点集之间的第一变换矩阵。Step S14: determining a first transformation matrix between the model point set and the space point set based on the multiple simulated feature points of the model point set and the multiple mean points of the space point set.

其中,模拟特征点与特征点具有对应关系,均值点也与特征点具有对应关系,进而,可以通过多个模拟特征点与多个均值点之间一一对应的关系,确定模型点集和空间点集之间的第一变换矩阵,也即确定解剖结构的图像坐标系与手术环境坐标系之间的第一配准关系,该第一配准关系是一个粗配准关系。示例性的,可以通过如标记点算法(Landmark Transform)确定第一变换矩阵。Among them, the simulated feature points have a corresponding relationship with the feature points, and the mean point also has a corresponding relationship with the feature points. Then, the first transformation matrix between the model point set and the space point set can be determined through the one-to-one correspondence between multiple simulated feature points and multiple mean points, that is, the first registration relationship between the image coordinate system of the anatomical structure and the surgical environment coordinate system can be determined. The first registration relationship is a rough registration relationship. Exemplarily, the first transformation matrix can be determined by a landmark transform algorithm.

由于选取的特征点(即地标点)相对较少、且仅对与特征点关联的模拟特征点和均值点进行配准,其精度相对较低,步骤S14所确定的第一变换矩阵可以认为是粗配准矩阵,或者,所确定的第一配准关系可以认为是粗配准关系。其中,粗配准为一个刚性配准,即特征点的位置(即坐标值)只发生平移和旋转的变化,没有尺度的变化,任意特征点之间的距离在转换坐标系之后理论上保持不变。Since the selected feature points (i.e., landmark points) are relatively few and only the simulated feature points and mean points associated with the feature points are registered, the accuracy is relatively low, and the first transformation matrix determined in step S14 can be considered as a coarse registration matrix, or the first registration relationship determined can be considered as a coarse registration relationship. Among them, the coarse registration is a rigid registration, that is, the position (i.e., coordinate value) of the feature point only undergoes translation and rotation changes, and there is no scale change. The distance between any feature points remains unchanged in theory after the coordinate system is converted.

上述步骤S11~S14,通过与解剖结构中特征点关联的去噪权重矩阵,对与特征点关联的采样点子集中每个采样点进行去噪,并获取采样点子集中去噪后的采样点的均值点,进而基于模型点集的模拟特征点与空间点集的均值 点的一一对应关系进行配准以确定第一变换矩阵,能够减少或消除解剖结构内在运动对于配准精度的影响。In the above steps S11 to S14, each sampling point in the sampling point subset associated with the feature point is denoised by using the denoising weight matrix associated with the feature point in the anatomical structure, and the mean point of the denoised sampling points in the sampling point subset is obtained, and then the simulated feature points based on the model point set and the mean of the spatial point set are obtained. The one-to-one correspondence between the points is used to determine the first transformation matrix, which can reduce or eliminate the influence of the intrinsic movement of the anatomical structure on the registration accuracy.

所述解剖结构的解剖模型通常可以是三维或四维模型。一些实施例中,以解剖结构是支气管、解剖模型是三维模型为例,在步骤S11之前,还可以包括获取解剖结构的解剖模型的步骤,该步骤实现方法如下。The anatomical model of the anatomical structure can generally be a three-dimensional or four-dimensional model. In some embodiments, taking the anatomical structure as a bronchus and the anatomical model as a three-dimensional model as an example, before step S11, a step of obtaining the anatomical model of the anatomical structure may also be included, and the implementation method of this step is as follows.

通过如CT、MRI、OCT或超声扫描(或拍摄)获取解剖结构的图像。其中,在扫描时,通常患者需要深吸一口气,然后屏气直到扫描完成。人体处于吸气状态下的支气管最大、细末枝节也更易成像。Images of anatomical structures are obtained by scanning (or photographing) such as CT, MRI, OCT or ultrasound. During the scan, the patient usually needs to take a deep breath and hold it until the scan is completed. The bronchi are largest and the fine branches are easier to image when the human body is in the inhalation state.

对解剖结构的图像进行分割及重建。其中,例如可以通过如区域生长以及卷积神经网络等分割算法对患者的图像进行分割,以分割出肺部的支气管;然后将分割之后的图像通过如移动立方体算法重建为三维模型。Segment and reconstruct the image of the anatomical structure. For example, the patient's image can be segmented by segmentation algorithms such as region growing and convolutional neural networks to segment the bronchi of the lungs; and then the segmented image can be reconstructed into a three-dimensional model by, for example, a marching cube algorithm.

一些实施例中,所获取的与采样点子集相对应的去噪权重矩阵,可以包括两种来源。In some embodiments, the denoising weight matrix corresponding to the sampling point subset obtained may include two sources.

第一种,可以来源于该患者自身。The first one can come from the patient himself.

第二种,可以来源于与该患者具有相同或相近身体特征的其他患者,相近允许一定的偏差,例如定义可允许的偏差为5%以内,对应于解剖结构中相同特征点,具有相同或相近身体特征的患者,解剖结构内在运动的幅度基本相同,对于导管末端和/或器械末端的位置的影响基本相同。其中,身体特征例如包括体型特征和/或生理特征。对于解剖结构是支气管或(心)血管,体型特征至少包括胸围;对于解剖结构是支气管时,生理特征至少包括呼吸运动的幅度;对于解剖结构是(心)血管,生理特征至少包括心跳运动的幅度。The second type can be derived from other patients with the same or similar physical characteristics as the patient. A certain deviation is allowed. For example, the allowable deviation is defined as within 5%. For patients with the same or similar physical characteristics, the amplitude of the intrinsic movement of the anatomical structure is basically the same for the same feature point in the anatomical structure, and the influence on the position of the catheter end and/or the instrument end is basically the same. Among them, the physical characteristics include, for example, body shape characteristics and/or physiological characteristics. When the anatomical structure is a bronchus or a (cardio)vascular vessel, the body shape characteristics include at least the chest circumference; when the anatomical structure is a bronchus, the physiological characteristics include at least the amplitude of the respiratory movement; when the anatomical structure is a (cardio)vascular vessel, the physiological characteristics include at least the amplitude of the heartbeat movement.

一些实施例中,对于去噪权重矩阵来源于第二种的情况,如图5所示,上述步骤S12可以包括:In some embodiments, for the case where the denoising weight matrix is derived from the second type, as shown in FIG5 , the above step S12 may include:

步骤S1201,获取患者的身体特征。Step S1201, obtaining the patient's physical characteristics.

身体特征例如包括体型特征和/或生理特征。Physical characteristics include, for example, body shape characteristics and/or physiological characteristics.

步骤S1202,确定患者的解剖结构的类型。Step S1202, determining the type of the patient's anatomical structure.

其中,解剖结构的类型例如包括支气管或(心)血管,当然还可以包括 其他器官。可以人工输入确定该类型,也可以自动识别确定该类型。The types of anatomical structures include, for example, bronchi or (cardio)vascular tubes, and of course, may also include Other organs. The type can be determined by manual input or automatic identification.

步骤S1203,基于患者的身体特征、解剖结构的类型,匹配出具有相同解剖结构的类型以及相同或相近身体特征的目标患者。Step S1203, based on the patient's physical features and anatomical structure type, target patients with the same anatomical structure type and the same or similar physical features are matched.

其中,可以构建一个或多个数据库,这些数据库存储有多个患者的信息,该多个患者是曾经在本院或者他院就医的患者。这些信息包括但不限于患者的姓名、性别、年龄、身体特征、解剖结构的生理特征、及一种或多种解剖结构的不同特征点的相同或不同去噪权重矩阵。因而,有利的可以通过身体特征、生理特征、及一种或多种解剖结构的不同特征点的相同或不同去噪权重矩阵来实现精准匹配。Among them, one or more databases can be constructed, which store information of multiple patients who have been treated in this hospital or other hospitals. This information includes but is not limited to the patient's name, gender, age, physical characteristics, physiological characteristics of anatomical structures, and the same or different denoising weight matrices of different feature points of one or more anatomical structures. Therefore, it is advantageous to achieve accurate matching through the same or different denoising weight matrices of different feature points of physical characteristics, physiological characteristics, and one or more anatomical structures.

步骤S1204,确定患者的采样点子集关联的特征点。Step S1204: determining feature points associated with the patient's sampling point subset.

步骤S1205,基于特征点,匹配出目标患者的关联于该特征点的去噪权重矩阵。Step S1205: Based on the feature points, a denoising weight matrix of the target patient associated with the feature points is matched.

其中,不同患者的相同解剖结构的特征点通常在选取时,具有相同性或具有极大的相似性,以支气管为例,通常这些特征点都会选取最易被识别的支气管的各级分叉点,也即各级隆突。示例性的,采样点子集的特征点对应是主隆突时,步骤S1204匹配出的去噪权重矩阵也应当是目标患者的主隆突的去噪权重矩阵;采样点子集的特征点对应是左肺叶的第一级隆突时,步骤S1204匹配出的去噪权重矩阵也应当是目标患者的左肺叶的第一级隆突的去噪权重矩阵。Among them, the feature points of the same anatomical structure of different patients are usually selected to have the same or great similarity. Taking the bronchus as an example, these feature points are usually selected from the most easily recognizable bifurcation points of the bronchus at all levels, that is, the carina at all levels. Exemplarily, when the feature points of the sampling point subset correspond to the main carina, the denoising weight matrix matched in step S1204 should also be the denoising weight matrix of the main carina of the target patient; when the feature points of the sampling point subset correspond to the first-level carina of the left lung lobe, the denoising weight matrix matched in step S1204 should also be the denoising weight matrix of the first-level carina of the left lung lobe of the target patient.

一些实施例中,对于去噪权重矩阵来源于第二种的情况,如图6所示,上述步骤S12也以包括:In some embodiments, for the case where the denoising weight matrix is derived from the second type, as shown in FIG6 , the above step S12 also includes:

步骤S1201’,获取患者的身体特征。Step S1201', obtaining the patient's physical characteristics.

步骤S1203’,基于患者的身体特征,匹配出具有相同或相近身体特征的目标患者。Step S1203', based on the patient's physical characteristics, match target patients with the same or similar physical characteristics.

步骤S1204’,确定患者的采样点子集关联的特征点。Step S1204', determining the characteristic points associated with the patient's sampling point subset.

步骤S1205’,基于特征点,匹配出目标患者的关联于该特征点的去噪权重矩阵。 Step S1205 ′: based on the feature points, a denoising weight matrix of the target patient associated with the feature points is matched.

进而在上述步骤S13中,可以通过匹配出的去噪权重矩阵对采样点子集中的采样点进行去噪。Furthermore, in the above step S13, the sampling points in the sampling point subset may be denoised using the matched denoising weight matrix.

通过上述步骤S1201~S1205,无需对患者本人重新构建解剖结构的不同特征点的去噪权重矩阵,而通过与患者身体特征相同或相近的其他患者的已有的解剖结构的相应特征点的去噪权重矩阵,能够极大减少术前准备时间,这些时间至少包括布置检测解剖结构内在运动的传感器的时间。当然,在时间较为充裕的场景下,也可以兼顾患者之间的个体差异,单独对患者本人构建解剖结构的不同特征点的去噪权重矩阵。Through the above steps S1201 to S1205, there is no need to reconstruct the denoising weight matrix of different feature points of the anatomical structure for the patient himself, and the denoising weight matrix of the corresponding feature points of the existing anatomical structure of other patients with the same or similar body features as the patient can be used to greatly reduce the preoperative preparation time, which at least includes the time for arranging sensors for detecting the intrinsic movement of the anatomical structure. Of course, in a scenario with more time, it is also possible to take into account the individual differences between patients and construct the denoising weight matrix of different feature points of the anatomical structure for the patient alone.

一些实施例中,如图7所示,无论基于患者本身,还是基于其他患者,对于多个特征点的每一个,初始构建每个特征点的去噪权重矩阵的方法可以包括:In some embodiments, as shown in FIG. 7 , whether based on the patient itself or on other patients, for each of the plurality of feature points, a method for initially constructing a denoising weight matrix for each feature point may include:

步骤S1211,从解剖结构中获取对应于一个特征点的一个采样点子集。Step S1211: acquiring a sampling point subset corresponding to a feature point from the anatomical structure.

采样点子集包括多个采样点,多个采样点由同一个跟踪传感器在不同时刻采样获得。在该实施例中,多个采样点通常包括十个、百个甚至更多的数量级别的采样点。The sampling point subset includes multiple sampling points, and the multiple sampling points are obtained by sampling the same tracking sensor at different times. In this embodiment, the multiple sampling points generally include sampling points in the order of ten, one hundred or even more.

步骤S1212,从解剖结构对应的体表获取一个测试点集。Step S1212: acquiring a test point set from the body surface corresponding to the anatomical structure.

每个测试点集包括多个测试点子集,每个测试点子集包括至少一个测试点。测试点由布设于解剖结构对应的患者体表的体表传感器采样获得。测试点一般用体表传感器在手术环境坐标系的坐标来描述。不同测试点子集的对应一个测试点通常由对应一个体表传感器在不同时刻采样获得。Each test point set includes multiple test point subsets, and each test point subset includes at least one test point. The test point is sampled by a surface sensor arranged on the patient's body surface corresponding to the anatomical structure. The test point is generally described by the coordinates of the surface sensor in the surgical environment coordinate system. A corresponding test point of different test point subsets is usually sampled by a corresponding surface sensor at different times.

相应于每一测试点子集中测试点的期望数量,对体表传感器的数量进行相同配置。例如,每一测试点子集中测试点的期望数量为一个时,体表传感器的数量为一个;又例如,每一测试点子集中测试点的期望数量为两个或三个时,体表传感器的数量对应为两个或三个。Corresponding to the expected number of test points in each test point subset, the number of body surface sensors is configured in the same manner. For example, when the expected number of test points in each test point subset is one, the number of body surface sensors is one; for another example, when the expected number of test points in each test point subset is two or three, the number of body surface sensors is correspondingly two or three.

在该实施例中,多个测试点子集通常包括十个、百个甚至更多的数量级别的测试点集。In this embodiment, the plurality of test point subsets generally include test point sets in the order of ten, one hundred or even more.

一些实施例中,采样点子集中采样点的数量通常需要跟测试点集中测试 点子集的数量相同,以便于后续计算。但这并不要求必须通过采样的方式获得该相同数量,也可以通过数据处理如采用插值的方式、滤波等方式,保持两者数量相同。In some embodiments, the number of sampling points in the sampling point subset is usually required to be the same as that in the test point set. The number of point subsets is the same for subsequent calculations. However, this does not necessarily require that the same number must be obtained by sampling, and the same number can also be maintained by data processing such as interpolation, filtering, etc.

一些实施例中,对于同一个特征点,可以先后单独采样,分别获得采样点子集和测试点集;但从节约术前时间的角度考虑,也可以同时、同频率进行采样,以获得采样点子集和测试点集。In some embodiments, for the same feature point, sampling can be performed separately and successively to obtain a sampling point subset and a test point set respectively; however, from the perspective of saving preoperative time, sampling can also be performed simultaneously and at the same frequency to obtain a sampling point subset and a test point set.

用于感应解剖结构的内在运动的体表传感器,一般可以采用位置传感器或位姿传感器。该体表传感器通常无创且稳定的设置于解剖结构对应的患者体表,也即体表传感器一般外露于患者体表,因此,相较于前文用于感应导管末端和/或器械末端的位置的跟踪传感器而言,体表传感器可选的类型相对更多。例如,体表传感器不仅可以选用如前述的EM传感器,还可以选用如光学定位传感器。The body surface sensor used to sense the intrinsic movement of the anatomical structure can generally be a position sensor or a posture sensor. The body surface sensor is usually non-invasively and stably set on the patient's body surface corresponding to the anatomical structure, that is, the body surface sensor is generally exposed on the patient's body surface. Therefore, compared with the tracking sensor used to sense the position of the catheter end and/or the instrument end mentioned above, there are relatively more types of body surface sensors to choose from. For example, the body surface sensor can not only use the EM sensor as mentioned above, but also can use optical positioning sensors.

一些实施例中,在解剖结构是支气管或(心)血管时,至少一个体表传感器布设在患者胸部。示例性的,体表传感器可以包括三个,第一个体表传感器可以布置于患者胸部中间,第二个体表传感器可以布置于患者胸部对应于左边第7根肋骨的区域,第三个体表传感器可以布置于患者胸部对应于右边第7根肋骨的区域。体表传感器越多,覆盖的患者体表的区域越多,感应解剖结构的内在运动越准确。In some embodiments, when the anatomical structure is a bronchus or a (cardio)vascular vessel, at least one body surface sensor is arranged on the patient's chest. Exemplarily, the body surface sensors may include three, the first body surface sensor may be arranged in the middle of the patient's chest, the second body surface sensor may be arranged in the area of the patient's chest corresponding to the seventh rib on the left, and the third body surface sensor may be arranged in the area of the patient's chest corresponding to the seventh rib on the right. The more body surface sensors there are, the more areas of the patient's body surface are covered, and the more accurately the intrinsic movement of the anatomical structure is sensed.

步骤S1213,基于在同一手术环境坐标系的测试点集和采样点子集,确定与采样点子集相对应的去噪权重矩阵。Step S1213, based on the test point set and the sampling point subset in the same surgical environment coordinate system, determine a denoising weight matrix corresponding to the sampling point subset.

一些实施例中,体表传感器和跟踪传感器分别采用EM传感器,两者可以属于同一电磁定位系统或不同电磁定位系统。在两者属于同一电磁定位系统时,两者感应的位置处于同一手术环境坐标系;在两者属于不同电磁定位系统时,也可以通过坐标转换的方式,将两者感应的位置变换到同一手术环境坐标系。此时,手术环境坐标系也可称为电磁坐标系。In some embodiments, the body surface sensor and the tracking sensor are EM sensors, and the two may belong to the same electromagnetic positioning system or different electromagnetic positioning systems. When the two belong to the same electromagnetic positioning system, the positions sensed by the two are in the same surgical environment coordinate system; when the two belong to different electromagnetic positioning systems, the positions sensed by the two may also be transformed to the same surgical environment coordinate system by coordinate conversion. In this case, the surgical environment coordinate system may also be referred to as an electromagnetic coordinate system.

一些实施例中,上述步骤S1213更具体地,可以通过如下步骤实现:In some embodiments, the above step S1213 can be more specifically implemented by the following steps:

为方便描述,定义体表传感器获取的测试点集的位置数据(即测试点) 为体表传感器数据Ref,并定义跟踪传感器获取的采样点子集的位置数据(即采样点)为体内导管数据Tube。For the convenience of description, the position data of the test point set obtained by the body surface sensor (i.e., the test point) is defined as The body surface sensor data Ref is defined, and the position data of a subset of sampling points acquired by the tracking sensor (ie, sampling points) is defined as the in-vivo catheter data Tube.

(1)对体表传感器数据Ref做去均值化处理,获得体表传感器数据并对体内导管数据Tube做去均值化处理,获得体内导管数据 (1) De-average the body surface sensor data Ref to obtain the body surface sensor data And de-average the in vivo catheter data Tube to obtain the in vivo catheter data

(2)获取体表传感器数据的逆解。例如可以通过SVD(Singular Value Decomposition,奇异值分解)法获得该逆解。其中,获得的逆解通常可以表达为:
(2) Obtaining body surface sensor data The inverse solution of . For example, the inverse solution can be obtained by SVD (Singular Value Decomposition) method. The obtained inverse solution can usually be expressed as:

其中,为体表传感器数据的逆解,V为右奇异矩阵,S为奇异值矩阵,U为左奇异矩阵。in, is the inverse solution of the body surface sensor data, V is the right singular matrix, S is the singular value matrix, and U is the left singular matrix.

(3)基于体表传感器数据的逆解和体内导管数据确定相应特征点的去噪权重矩阵。其中,获得的关联于相应特征点的去噪权重矩阵可以表达为:
(3) Inverse solution based on body surface sensor data and in vivo catheter data Determine the denoising weight matrix of the corresponding feature point. The denoising weight matrix associated with the corresponding feature point can be expressed as:

其中,Weight为去噪权重矩阵。Among them, Weight is the denoising weight matrix.

一些实施例中,仍以解剖结构是支气管为例,示例性的可以使用3个体表传感器,在2个以上的呼吸周期(通常为6~10秒)获取测试点集,并通过跟踪传感器同时获取关联于特征点的采样点子集。其中,体表传感器数据Ref是一个N行9列的矩阵,每行的格式例如可以表达成{X1,Y1,Z1,X2,Y2,Z2,X3,Y3,Z3},每3列对应一个体表传感器感应的位置数据。体内导管数据Tube是一个N行3列的矩阵,每行的格式例如可以表达成{X0,Y0,Z0},该3列对应跟踪传感器感应的导管末端和/或器械末端的位置数据。In some embodiments, still taking the anatomical structure of the bronchus as an example, three body surface sensors can be used to obtain a test point set in more than two respiratory cycles (usually 6 to 10 seconds), and a subset of sampling points associated with the feature points can be simultaneously obtained through the tracking sensor. Among them, the body surface sensor data Ref is a matrix of N rows and 9 columns, and the format of each row can be expressed as {X1, Y1, Z1, X2, Y2, Z2, X3, Y3, Z3}, for example, and each 3 columns correspond to a position data sensed by a body surface sensor. The in vivo catheter data Tube is a matrix of N rows and 3 columns, and the format of each row can be expressed as {X0, Y0, Z0}, for example, and the 3 columns correspond to the position data of the catheter end and/or the instrument end sensed by the tracking sensor.

进一步地,每个特征点对应一个确定的去噪权重矩阵。示例性的,可以采用数据结构ST={PosTube,PosRef,Weight}进行存储。其中,PosTube为每个特征点对应的采样点集中采样点的均值,如采用电磁定位系统时,该均值即为导管末端和/或器械末端的电磁坐标点的均值,形如;PosRef为每个特征点对应的测试点集中测试点的均值,如采用电磁定位系统时,该均 值即为三个体表传感器的电磁坐标点的均值,形如 weight是一个9行3列的矩阵。Furthermore, each feature point corresponds to a certain denoising weight matrix. Exemplarily, the data structure ST = {PosTube, PosRef, Weight} can be used for storage. Among them, PosTube is the mean value of the sampling points in the sampling point set corresponding to each feature point. For example, when an electromagnetic positioning system is used, the mean value is the mean value of the electromagnetic coordinate points at the end of the catheter and/or the end of the instrument, as shown in ; PosRef is the mean value of the test points in the test point set corresponding to each feature point. If an electromagnetic positioning system is used, the mean The value is the average of the electromagnetic coordinate points of the three body surface sensors, as shown in Weight is a matrix with 9 rows and 3 columns.

为了便于实施上述步骤S13,在对应于某一特征点获取采样点的数据时,控制装置可以为这些采样点或者为这些采样点所对应的采样点子集进行标记,例如赋予序号,以构建采样点或采样点子集与对应的特征点之间的关联。进而,在基于特征点与采样点(或采样点子集)、去噪权重矩阵之间的关联,确定对应的去噪权重矩阵时,能够极其方便快速地匹配出采样点(或采样点子集)、及去噪权重矩阵。In order to facilitate the implementation of the above step S13, when acquiring the data of the sampling points corresponding to a certain feature point, the control device can mark these sampling points or the sampling point subsets corresponding to these sampling points, for example, assign serial numbers to establish the association between the sampling points or the sampling point subsets and the corresponding feature points. Furthermore, when determining the corresponding denoising weight matrix based on the association between the feature points and the sampling points (or sampling point subsets) and the denoising weight matrix, the sampling points (or sampling point subsets) and the denoising weight matrix can be matched extremely conveniently and quickly.

一些实施例中,具体在所述基于去噪权重矩阵对采样点子集中的采样点进行去噪时,对于相同一个特征点,可以结合相对应的一对采样点和测试点、去噪权重矩阵weight、及测试点集中测试点的均值PosRef以对采样点进行去噪。示例性的,包括:In some embodiments, when denoising the sampling points in the sampling point subset based on the denoising weight matrix, for the same feature point, the sampling point can be denoised by combining a corresponding pair of sampling points and a test point, the denoising weight matrix weight, and the mean value PosRef of the test points in the test point set. Exemplary examples include:

(1)确定关联于同一特征点的当前测试点与测试点集中测试点的均值之间的偏移量。例如,可以通过如下公式确定该偏移量:
(1) Determine the offset between the current test point associated with the same feature point and the mean of the test points in the test point set. For example, the offset can be determined by the following formula:

其中,为偏移量,Ro为当前测试点。示例性的,在体表传感器数量为3个时,该偏移量是含有9个元素的行向量。in, is the offset, and Ro is the current test point. Exemplarily, when the number of body surface sensors is 3, the offset is a row vector containing 9 elements.

(2)基于关联于同一特征点的特征向量、当前采样点、及去噪权重矩阵对当前采样点进行去噪。例如,可以通过如下公式去噪:
(2) De-noising the current sampling point based on the feature vector associated with the same feature point, the current sampling point, and the denoising weight matrix. For example, denoising can be performed using the following formula:

其中,Tf为经过去噪的当前采样点;To为当前采样点。Wherein, Tf is the current sampling point after denoising; To is the current sampling point.

在该实施例中,相对应的一对采样点和测试点,可以指在解剖结构的同一个运动周期的相同时刻分别采样获得的采样点和测试点,例如,该一对点均采集于该同一运动周期的相同时刻;也可以指在解剖结构的不同运动周期的经历相同时间的时刻分别采样获得的采样点和测试点。In this embodiment, a corresponding pair of sampling points and test points may refer to sampling points and test points that are sampled at the same moment in the same motion cycle of the anatomical structure, for example, the pair of points are collected at the same moment in the same motion cycle; or may refer to sampling points and test points that are sampled at the same moment in different motion cycles of the anatomical structure.

一些实施例中,继续参阅图3,在步骤S14之后,所述方法还包括: In some embodiments, referring to FIG. 3 , after step S14, the method further includes:

步骤S15,从解剖结构中获取路径点云。Step S15, obtaining a path point cloud from the anatomical structure.

其中,该路径点云包括通过第一传感器在解剖结构中感应的多个实际路径点。The path point cloud includes a plurality of actual path points sensed in the anatomical structure by the first sensor.

路径点云也可以称为路径点集,包括导管末端和/或器械末端在解剖结构内经过的多个实际路径点。一个实际路径点反映了传感器反馈时导管末端和/或器械末端的位置,将同一传感器多次反馈得到的实际路径点按照反馈时间排列,可得到导管末端和/或器械末端的运动路径。例如,第一路径点云不仅可以包括与所述采样点,也可以包括不同于所述采样点的其他点。又例如,第一路径点云可以仅包括不同于所述采样点的其他点。A path point cloud may also be referred to as a path point set, and includes multiple actual path points that the catheter end and/or the instrument end passes through in the anatomical structure. An actual path point reflects the position of the catheter end and/or the instrument end when the sensor feedbacks. The actual path points obtained by multiple feedbacks from the same sensor are arranged according to the feedback time to obtain the movement path of the catheter end and/or the instrument end. For example, the first path point cloud may include not only the sampling point, but also other points different from the sampling point. For another example, the first path point cloud may only include other points different from the sampling point.

其中,可以在一个过程中获取模拟特征点与获取实际路径点。也可以在不同过程中获取模拟特征点与获取实际路径点。The simulated feature points and the actual path points may be obtained in one process, or may be obtained in different processes.

步骤S16,从解剖模型中获取模型点云。Step S16, obtaining a model point cloud from the anatomical model.

该模型点云包括解剖模型的管道中心线的多个骨架点和/或管道管壁的多个顶点。骨架点的获得例如可以先从解剖模型中提取管道中心线,然后离散管道中心线获得这些骨架点。管壁顶点的获得例如可以先从解剖模型中提取管壁,然后离散管壁获得这些管壁顶点。The model point cloud includes multiple skeleton points of the pipeline centerline of the anatomical model and/or multiple vertices of the pipeline wall. The skeleton points can be obtained, for example, by first extracting the pipeline centerline from the anatomical model and then discretizing the pipeline centerline to obtain these skeleton points. The vertices of the pipeline wall can be obtained, for example, by first extracting the pipeline wall from the anatomical model and then discretizing the pipeline wall to obtain these pipeline wall vertices.

步骤S17,基于第一变换矩阵、路径点云的多个实际路径点及模型点云的多个骨架点,确定路径点云和模型点云的第二变换矩阵。Step S17, determining a second transformation matrix of the path point cloud and the model point cloud based on the first transformation matrix, a plurality of actual path points of the path point cloud, and a plurality of skeleton points of the model point cloud.

在该步骤S17中,通过对路径点云和模型点云进行点云配准,可以确定手术环境坐标系与解剖模型之间的第二变换矩阵,也即第二配准关系,该第二配准关系是一个精配准关系。其中,由于粗配准阶段获得的第一变换矩阵具有较高的精度,故此处获得的精配准阶段的第二变换矩阵的精度也相对较高。In step S17, by performing point cloud registration on the path point cloud and the model point cloud, the second transformation matrix between the surgical environment coordinate system and the anatomical model, i.e., the second registration relationship, can be determined. The second registration relationship is a precise registration relationship. Since the first transformation matrix obtained in the coarse registration stage has a high precision, the precision of the second transformation matrix obtained in the precise registration stage is also relatively high.

由于配准使用的点相对较多,其精度相对较高,步骤S17所确定的第二变换矩阵可以认为是精配准矩阵,或者,所确定的第二配准关系可以认为是精配准关系。Since the registration uses relatively more points and has relatively higher precision, the second transformation matrix determined in step S17 can be considered as a precise registration matrix, or the determined second registration relationship can be considered as a precise registration relationship.

点云配准的代表算法为最近点迭代(Iterative closest point,ICP)算法, 其核心思想为最小化两个点集间的距离,通过迭代使得两个点集相互接近。下面简单介绍ICP的原理。The representative algorithm for point cloud registration is the Iterative Closest Point (ICP) algorithm. The core idea is to minimize the distance between two point sets and make the two point sets close to each other through iteration. The following is a brief introduction to the principle of ICP.

ICP的基础方法包括两步:一、对点云Q和P进行匹配,找出二者之间的对应点对;二、根据对应点对计算出点云Q和P之间的变换矩阵。一个对应点对由两个点组成,其中一个来自于点云P,另一个来自于点云Q,这两个点互为对方的匹配点,且这两个点被认为是对应的,即这两个点实质上等同。The basic method of ICP includes two steps: 1. Match point clouds Q and P to find the corresponding point pairs between them; 2. Calculate the transformation matrix between point clouds Q and P based on the corresponding point pairs. A corresponding point pair consists of two points, one from point cloud P and the other from point cloud Q. These two points are each other's matching points, and these two points are considered to be corresponding, that is, the two points are essentially equivalent.

如果可以直接找出真实准确的对应点对,那么上面的过程只需要进行一次,就可以直接算出足够准确的变换矩阵。然而实际应用中很难直接找到准确的对应点对,因此ICP会按照距离(一般是欧式距离)最近的原则进行匹配,即对于点云P中的每一个点,在点云Q中寻找与其距离最近的一个点作为其匹配点。然后根据这些点对计算出一个变换矩阵。在完成一轮计算之后,ICP会判断是否满足迭代停止条件,如果不满足,则使用本轮计算得到的变换矩阵对点云P进行变换更新,然后使用点云Q和变换后的点云P重复上述过程,直至停止迭代。示例性的,默认停止迭代的条件是前后两次迭代的误差的差值小于0.01,但是有时点云之间的差异较大无法达到收敛的条件,因此需要设置一个迭代的上限次数,例如可以设置为500。例如,可以采用如下公式进行迭代或者应用至虚拟导航中:
PosTubeCT=MatrixFine*MatrixCoarse*PosTubeEM公式(5)
If the real and accurate corresponding point pairs can be found directly, then the above process only needs to be performed once to directly calculate a sufficiently accurate transformation matrix. However, it is difficult to directly find accurate corresponding point pairs in practical applications, so ICP will match according to the principle of the closest distance (generally Euclidean distance), that is, for each point in the point cloud P, find the point closest to it in the point cloud Q as its matching point. Then calculate a transformation matrix based on these point pairs. After completing a round of calculations, ICP will determine whether the iteration stop condition is met. If not, the transformation matrix obtained by this round of calculations is used to transform and update the point cloud P, and then the point cloud Q and the transformed point cloud P are used to repeat the above process until the iteration stops. Exemplarily, the default condition for stopping the iteration is that the difference in error between the previous and next two iterations is less than 0.01, but sometimes the difference between the point clouds is so large that the convergence condition cannot be met, so it is necessary to set an upper limit on the number of iterations, for example, it can be set to 500. For example, the following formula can be used for iteration or applied to virtual navigation:
PosTubeCT=MatrixFine*MatrixCoarse*PosTubeEM formula (5)

其中,PosTubeEM为导管末端和/或器械末端在手术环境坐标系的位置,PosTubeCT为导管末端和/或器械末端在解剖模型的图像坐标系的位置,MatrixCoarse为第一变换矩阵,MatrixFine为第二变换矩阵。Among them, PosTubeEM is the position of the catheter end and/or the instrument end in the surgical environment coordinate system, PosTubeCT is the position of the catheter end and/or the instrument end in the image coordinate system of the anatomical model, MatrixCoarse is the first transformation matrix, and MatrixFine is the second transformation matrix.

参阅图8,导管末端和/或器械末端在手术环境坐标系中的运动路径位于图8中上部,通过将该运动路径中每个实际路径点,先左乘粗配准矩阵、再左乘精配准矩阵之后,该运动路径基本位于规划的支气管解剖模型内部。迭代次数越多,配准精度将会越高。Referring to Figure 8, the motion path of the catheter tip and/or the instrument tip in the surgical environment coordinate system is located in the upper part of Figure 8. After each actual path point in the motion path is first multiplied by the rough registration matrix and then by the fine registration matrix, the motion path is basically located inside the planned bronchial anatomical model. The more iterations, the higher the registration accuracy will be.

由于ICP对初始值比较敏感,如果点云P和Q初始差别比较大,直接使 用ICP可能无法保证收敛。因此可以将点云配准分为步骤S11~步骤S14的粗配准和步骤S15~步骤S18的精配准两个部分,先采用粗配准得到一个初始变换矩阵(即第一变换矩阵),让两组点云大体上对齐,然后使用ICP进行精配准,使用更多的点进行精细化的对齐,此时第一轮的ICP是对点云Q和使用初始变换矩阵变换后的点云P进行匹配。Since ICP is sensitive to initial values, if the initial difference between point clouds P and Q is large, directly using Convergence may not be guaranteed using ICP. Therefore, point cloud registration can be divided into two parts: coarse registration from step S11 to step S14 and fine registration from step S15 to step S18. First, coarse registration is used to obtain an initial transformation matrix (i.e., the first transformation matrix) to roughly align the two sets of point clouds. Then, ICP is used for fine registration, using more points for refined alignment. At this time, the first round of ICP is to match the point cloud Q with the point cloud P transformed by the initial transformation matrix.

一些实施例中,如图9所示,所述步骤S15可以包括:In some embodiments, as shown in FIG. 9 , step S15 may include:

步骤S151,获取当前实际路径点。Step S151, obtaining the current actual path point.

其中,第一传感器实时获取实际路径点,当前时刻获取的实际路径点可以定义为当前实际路径点。随着时间的变化,当前实际路径点将会持续更新。The first sensor acquires the actual path point in real time, and the actual path point acquired at the current moment can be defined as the current actual path point. As time changes, the current actual path point will be continuously updated.

步骤S152,确定与当前实际路径点距离最近的特征点。Step S152, determining the feature point closest to the current actual path point.

也即,需要确定每一个实际路径点距离最近的特征点。例如,可以比较每一实际路径点与各个特征点对应的采样点集中采样点的均值PosTube之间的欧氏距离,得到与其距离最近的特征点。That is, it is necessary to determine the feature point closest to each actual path point. For example, the Euclidean distance between each actual path point and the mean PosTube of the sampling points in the sampling point set corresponding to each feature point can be compared to obtain the feature point closest to it.

步骤S153,确定关联于特征点的去噪权重矩阵。Step S153, determining a denoising weight matrix associated with the feature point.

一些实施例中,可以以所有特征点对应的采样点子集中采样点的均值点PosTube作为节点,构建一个KD搜索树(KD-tree),用于后续的检索。此处构建的KD树是一个三维欧式空间的一个键值搜索树,用于范围搜索以及最邻近搜索。输入导管末端和/或器械末端的实时位置(即实时的实际路径点),即可通过KD搜索树快速查询到距离最近的节点所对应的特征点,进而可以获取与该距离最近的特征点相应的去噪权重矩阵。通过构建KD搜索树,大大地加速了获得去噪权重矩阵的过程。In some embodiments, a KD search tree (KD-tree) can be constructed with the mean point PosTube of the sampling points in the sampling point subset corresponding to all feature points as a node for subsequent retrieval. The KD tree constructed here is a key-value search tree in a three-dimensional Euclidean space, which is used for range search and nearest neighbor search. By inputting the real-time position of the catheter end and/or the instrument end (i.e., the real-time actual path point), the feature point corresponding to the nearest node can be quickly queried through the KD search tree, and then the denoising weight matrix corresponding to the nearest feature point can be obtained. By constructing a KD search tree, the process of obtaining the denoising weight matrix is greatly accelerated.

步骤S154,基于去噪权重矩阵对当前实际路径点进行去噪,获得去噪后的当前实际路径点并添加到路径点云。Step S154, denoising the current actual path point based on the denoising weight matrix, obtaining the denoised current actual path point and adding it to the path point cloud.

其中,可以通过所述公式(4)和公式(5)对每一个实际路径点进行去噪。Wherein, each actual path point can be denoised by using the formula (4) and the formula (5).

进而,由于路径点云中的实际路径点均进行了去噪处理,因此,基于包括去噪后的实际路径点的路径点云与模型点云进行计算而确定的第二变换矩 阵具有较高的配准精度。Furthermore, since the actual path points in the path point cloud are all subjected to denoising, the second transformation matrix determined by calculating the path point cloud including the denoised actual path points and the model point cloud is The array has a higher registration accuracy.

在图10至图12中,空心圆形状的点构成的点云代表去噪前(即补偿前)的导管运动路径,五角星形状的点构成的点云代表去噪后的导管运动路径,中间的连续路径为多段支气管中心线拼接出来的路径。In Figures 10 to 12, the point cloud composed of hollow circle-shaped points represents the catheter movement path before denoising (i.e., before compensation), the point cloud composed of five-pointed star-shaped points represents the catheter movement path after denoising, and the continuous path in the middle is the path spliced together from multiple bronchial centerlines.

如图10所示,可见经过去噪的点云相对于支气管中心线而言,偏移更小(即收敛性更好),也即受到呼吸运动的影响被大幅削弱。As shown in FIG. 10 , it can be seen that the denoised point cloud has a smaller deviation (ie, better convergence) relative to the bronchial centerline, which means that the influence of respiratory motion is greatly weakened.

如图11、图12,两者示意了去噪前与去噪后的配准精度的对比图。在图11中,补偿前的配准精度大致为6.5mm。在图12中,补偿后的配准精度大致为3.2mm。可见,通过去噪处理,大大提高了配准精度,导管位置的飘动幅度大幅减少,便于在解剖模型中观察导管此时所在的位置。As shown in Figures 11 and 12, the comparison of the registration accuracy before and after denoising is shown. In Figure 11, the registration accuracy before compensation is approximately 6.5 mm. In Figure 12, the registration accuracy after compensation is approximately 3.2 mm. It can be seen that the denoising process greatly improves the registration accuracy, and the fluctuation of the catheter position is greatly reduced, making it easier to observe the position of the catheter in the anatomical model.

一些实施例中,在进行虚拟导航时,可以获取由第一传感器感应的导管末端在解剖结构中的实际路径点;基于第一变换矩阵和/或第二变换矩阵,确定实际路径点在解剖模型中的模拟路径点;生成表征导管末端和/或器械末端的标记图形;在模拟路径点处显示标记图形。示例性的,精配准迭代结束后,可以使用第二变换矩阵来确定实际路径点在解剖模型中的模拟路径点;精配准开始后、结束前,可以使用第一变换矩阵和第二变换矩阵来确定实际路径点在解剖模型中的模拟路径点;精配准开始前,可以使用第一变换矩阵来确定实际路径点在解剖模型中的模拟路径点。In some embodiments, when performing virtual navigation, the actual path points of the catheter tip in the anatomical structure sensed by the first sensor can be obtained; based on the first transformation matrix and/or the second transformation matrix, the simulated path points of the actual path points in the anatomical model can be determined; a marker graphic representing the catheter tip and/or the instrument tip is generated; and the marker graphic is displayed at the simulated path points. Exemplarily, after the fine registration iteration ends, the second transformation matrix can be used to determine the simulated path points of the actual path points in the anatomical model; after the fine registration starts and before it ends, the first transformation matrix and the second transformation matrix can be used to determine the simulated path points of the actual path points in the anatomical model; before the fine registration starts, the first transformation matrix can be used to determine the simulated path points of the actual path points in the anatomical model.

其中,该标记图形例如可以是一个圆球或其他任意形状。The marking graphic may be, for example, a sphere or any other shape.

本申请的方法,具有如下有益效果:The method of the present application has the following beneficial effects:

能够提高配准算法的精度,导管末端和/或器械末端在解剖模型上显示的位置与实际位置更为接近,更高的精度有益判断导管末端和/或器械末端(如活检针)是否到达病灶处,减少手术中拍摄X射线的次数,减少医生和病人摄入的辐射;It can improve the accuracy of the registration algorithm. The position of the catheter end and/or the instrument end displayed on the anatomical model is closer to the actual position. Higher accuracy is helpful to determine whether the catheter end and/or the instrument end (such as a biopsy needle) has reached the lesion, reduce the number of X-rays taken during surgery, and reduce the radiation intake of doctors and patients.

能够提高配准算法的稳定性,粗配准与精配准的结合使用,极大地提高了算法地鲁棒性,减少了因为配准失败导致的手术时间延长或是手术失败的可能性; It can improve the stability of the registration algorithm. The combination of coarse registration and fine registration greatly improves the robustness of the algorithm and reduces the possibility of prolonged surgery or surgical failure due to registration failure.

能够提高跟踪传感器获得的数据的稳定性,去噪之后的跟踪传感器获得的数据滤除了由于解剖结构内在运动带来的抖动,转换到解剖模型的图像坐标系之后,能够以稳定的形式显示在解剖模型的某个位置,而不会到处波动漂移,更加方便用户观察导管末端和/或器械末端此时所在的位置。The stability of the data obtained by the tracking sensor can be improved. The data obtained by the tracking sensor after denoising filters out the jitter caused by the intrinsic movement of the anatomical structure. After being converted into the image coordinate system of the anatomical model, it can be displayed in a certain position of the anatomical model in a stable form without fluctuating and drifting everywhere, making it more convenient for users to observe the current position of the catheter tip and/or the instrument tip.

本申请还提供一种控制装置。如图13所示,该控制装置可以包括:处理器(processor)501、通信接口(Communications Interface)502、存储器(memory)503、以及通信总线504。The present application also provides a control device. As shown in FIG13 , the control device may include: a processor 501, a communications interface 502, a memory 503, and a communication bus 504.

处理器501、通信接口502、以及存储器503通过通信总线504完成相互间的通信。The processor 501 , the communication interface 502 , and the memory 503 communicate with each other via the communication bus 504 .

通信接口502,用于与其它设备比如各类传感器或旋转电机或电磁阀或其它客户端或服务器等的网元通信。The communication interface 502 is used to communicate with other devices such as various sensors, rotating motors, solenoid valves, or network elements of other clients or servers.

处理器501,用于执行程序505,具体可以执行上述方法实施例中的相关步骤。The processor 501 is used to execute the program 505, and specifically can execute the relevant steps in the above method embodiment.

具体地,程序505可以包括程序代码,该程序代码包括计算机操作指令。Specifically, the program 505 may include program codes, which include computer operation instructions.

处理器505可能是中央处理器CPU,或者是特定集成电路ASIC(Application Specific Integrated Circuit),或者是被配置成实施本申请实施例的一个或多个集成电路,或者是FPGA,或者是图形处理器GPU(Graphics Processing Unit)。控制装置包括的一个或多个处理器,可以是同一类型的处理器,如一个或多个CPU,或者,一个或多个GPU;也可以是不同类型的处理器,如一个或多个CPU以及一个或多个GPU。The processor 505 may be a central processing unit CPU, or an application specific integrated circuit ASIC (Application Specific Integrated Circuit), or one or more integrated circuits configured to implement the embodiments of the present application, or an FPGA, or a graphics processing unit GPU (Graphics Processing Unit). The one or more processors included in the control device may be processors of the same type, such as one or more CPUs, or one or more GPUs; or they may be processors of different types, such as one or more CPUs and one or more GPUs.

存储器503,用于存放程序505。存储器503可能包含高速RAM存储器,也可能还包括非易失性存储器(non-volatile memory),例如至少一个磁盘存储器。The memory 503 is used to store the program 505. The memory 503 may include a high-speed RAM memory, and may also include a non-volatile memory (non-volatile memory), such as at least one disk storage.

程序505具体可以用于使得处理器501执行以下操作:The program 505 may be specifically used to enable the processor 501 to perform the following operations:

获取包括多个模拟特征点的模型点集,所述模拟特征点从第一患者的解剖结构的解剖模型获取,多个所述模拟特征点分别与所述解剖结构的多个特征点关联; Acquire a model point set including a plurality of simulated feature points, wherein the simulated feature points are acquired from an anatomical model of an anatomical structure of a first patient, and the plurality of simulated feature points are respectively associated with a plurality of feature points of the anatomical structure;

通过第一传感器获取包括多个采样点子集的空间点集,所述采样点子集包括多个采样点,所述采样点从所述解剖结构获取,多个所述采样点子集分别与多个所述特征点关联;Acquire, by a first sensor, a spatial point set including a plurality of sampling point subsets, wherein the sampling point subsets include a plurality of sampling points, the sampling points are acquired from the anatomical structure, and the plurality of sampling point subsets are respectively associated with a plurality of the feature points;

获取相应于多个所述采样点子集的多个去噪权重矩阵,多个所述去噪权重矩阵分别与多个所述特征点关联;Acquire a plurality of denoising weight matrices corresponding to a plurality of the sampling point subsets, wherein the plurality of denoising weight matrices are respectively associated with a plurality of the feature points;

基于多个所述去噪权重矩阵,分别对相应的多个所述采样点子集中所述采样点进行去噪;Based on the plurality of denoising weight matrices, denoising the sampling points in the corresponding plurality of sampling point subsets respectively;

基于多个所述采样点子集的去噪后的所述采样点,分别确定多个所述采样点子集相应的均值点;Based on the denoised sampling points of the plurality of sampling point subsets, respectively determining mean points corresponding to the plurality of sampling point subsets;

基于多个所述模拟特征点和多个所述均值点,确定所述模型点集和所述空间点集之间的第一变换矩阵。。Based on the plurality of simulated feature points and the plurality of mean value points, a first transformation matrix between the model point set and the space point set is determined.

本申请还提供一种计算机可读存储介质,该计算机可读存储介质存储有计算机程序,该计算机程序被配置为由处理器加载并执行实现如上述任一项实施例所述的方法的步骤。The present application also provides a computer-readable storage medium storing a computer program, wherein the computer program is configured to be loaded by a processor and executed to implement the steps of the method described in any of the above embodiments.

本申请还提供一种计算机程序产品,包括计算机指令,当计算机指令在计算机上运行时,使得计算机执行如上述任一项实施例所述的方法。The present application also provides a computer program product, including computer instructions, which, when executed on a computer, enable the computer to execute the method described in any one of the above embodiments.

以上所述实施例的各技术特征可以进行任意的组合,为使描述简洁,未对上述实施例中的各个技术特征所有可能的组合都进行描述,然而,只要这些技术特征的组合不存在矛盾,都应当认为是本说明书记载的范围。The technical features of the above-described embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

以上所述实施例仅表达了本申请的几种实施方式,其描述较为具体和详细,但并不能因此而理解为对本申请专利范围的限制。应当指出的是,对于本领域的普通技术人员来说,在不脱离本申请构思的前提下,还可以做出若干变形和改进,这些都属于本申请的保护范围。因此,本申请专利的保护范围应以所附权利要求为准。 The above-mentioned embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims (18)

一种导管机器人,其特征在于,包括:A catheter robot, characterized by comprising: 导管,所述导管和所述导管搭载的器械中的至少一个设置有用于感应所述导管末端和所述器械末端中的至少一个的位置的第一传感器;及a catheter, wherein at least one of the catheter and an instrument carried by the catheter is provided with a first sensor for sensing a position of at least one of a distal end of the catheter and a distal end of the instrument; and 控制装置,与所述第一传感器耦接,并被配置成用于:A control device, coupled to the first sensor and configured to: 获取模型点集,所述模型点集包括多个模拟特征点,所述模拟特征点从第一患者的解剖结构的解剖模型获取,多个所述模拟特征点分别与所述解剖结构的多个特征点关联;Acquire a model point set, the model point set comprising a plurality of simulated feature points, the simulated feature points being acquired from an anatomical model of an anatomical structure of a first patient, the plurality of simulated feature points being respectively associated with a plurality of feature points of the anatomical structure; 获取空间点集,所述空间点集包括多个采样点子集,所述采样点子集包括多个采样点,所述采样点通过所述第一传感器从所述解剖结构获取,多个所述采样点子集分别与多个所述特征点关联;Acquire a spatial point set, wherein the spatial point set includes a plurality of sampling point subsets, wherein the sampling point subsets include a plurality of sampling points, wherein the sampling points are acquired from the anatomical structure by the first sensor, and the plurality of sampling point subsets are respectively associated with a plurality of the feature points; 获取相应于多个所述采样点子集的多个去噪权重矩阵,多个所述去噪权重矩阵分别与多个所述特征点关联;Acquire a plurality of denoising weight matrices corresponding to a plurality of the sampling point subsets, wherein the plurality of denoising weight matrices are respectively associated with a plurality of the feature points; 基于多个所述去噪权重矩阵,分别对相应的多个所述采样点子集中所述采样点进行去噪;Based on the plurality of denoising weight matrices, denoising the sampling points in the corresponding plurality of sampling point subsets respectively; 基于多个所述采样点子集的去噪后的所述采样点,分别确定多个所述采样点子集相应的均值点;Based on the denoised sampling points of the plurality of sampling point subsets, respectively determining mean points corresponding to the plurality of sampling point subsets; 基于多个所述模拟特征点和多个所述均值点,确定所述模型点集和所述空间点集之间的粗配准关系。Based on the plurality of simulated feature points and the plurality of mean points, a rough registration relationship between the model point set and the space point set is determined. 根据权利要求1所述的导管机器人,其特征在于,所述控制装置被配置成用于:The catheter robot according to claim 1, characterized in that the control device is configured to: 获取路径点云,所述路径点云包括通过所述第一传感器在所述解剖结构中感应的多个实际路径点;Acquire a path point cloud, the path point cloud comprising a plurality of actual path points sensed in the anatomical structure by the first sensor; 获取模型点云,所述模型点云包括所述解剖模型的管道中心线的多个骨架点和多个管道管壁的顶点中的至少一种;Acquire a model point cloud, wherein the model point cloud includes at least one of a plurality of skeleton points of a pipeline centerline of the anatomical model and a plurality of vertices of a pipeline wall; 基于所述粗配准关系、所述路径点云中多个所述实际路径点、及所述模型点云中多个所述骨架点和多个管道管壁的顶点中的至少一种,确定所述路 径点云和所述模型点云的精配准关系。The path point cloud is determined based on the rough registration relationship, the actual path points in the path point cloud, and at least one of the skeleton points and the vertices of the pipeline wall in the model point cloud. The precise registration relationship between the radius point cloud and the model point cloud. 根据权利要求2所述的导管机器人,其特征在于,所述获取路径点云,包括:The catheter robot according to claim 2, characterized in that the step of obtaining a path point cloud comprises: 获取当前实际路径点;Get the current actual path point; 确定与所述当前实际路径点距离最近的所述特征点;Determine the feature point that is closest to the current actual path point; 确定关联于所述特征点的所述去噪权重矩阵;Determining the denoising weight matrix associated with the feature point; 基于所述去噪权重矩阵对所述当前实际路径点进行去噪,获得去噪后的当前实际路径点并添加到所述路径点云。The current actual path point is denoised based on the denoising weight matrix to obtain the denoised current actual path point and add it to the path point cloud. 根据权利要求3所述的导管机器人,其特征在于,所述确定与所述当前实际路径点距离最近的所述特征点,包括:The catheter robot according to claim 3, characterized in that the step of determining the feature point closest to the current actual path point comprises: 分别确定与多个所述特征点关联的多个所述采样点子集中所述采样点的均值点;Respectively determine mean points of the sampling points in the plurality of sampling point subsets associated with the plurality of feature points; 以多个所述均值点作为节点,构建KD搜索树;Using the plurality of mean points as nodes, constructing a KD search tree; 基于所述KD搜索树,确定与所述当前实际路径点距离最近的所述特征点。Based on the KD search tree, the feature point closest to the current actual path point is determined. 根据权利要求2~4中任一项所述的导管机器人,其特征在于,所述确定所述第二路径点云和所述模型点云的精配准关系之后,还包括:The catheter robot according to any one of claims 2 to 4, characterized in that after determining the precise registration relationship between the second path point cloud and the model point cloud, it further comprises: 获取由所述第一传感器感应的所述导管末端在所述解剖结构中的实际路径点;acquiring an actual path point of the catheter tip in the anatomical structure sensed by the first sensor; 基于所述粗配准关系和所述精配准关系中的至少一个,确定所述实际路径点在所述解剖模型中的模拟路径点;Determining a simulated path point of the actual path point in the anatomical model based on at least one of the coarse registration relationship and the fine registration relationship; 生成表征所述导管末端和所述器械末端中的至少一个的标记图形;generating a marker pattern representative of at least one of the catheter tip and the instrument tip; 在所述模拟路径点处显示所述标记图形。The marker graphic is displayed at the simulated path point. 根据权利要求1所述的导管机器人,其特征在于,所述获取相应于多个所述采样点子集的多个去噪权重矩阵,包括:The catheter robot according to claim 1, characterized in that the step of obtaining a plurality of denoising weight matrices corresponding to a plurality of the sampling point subsets comprises: 获取所述第一患者的身体特征,所述身体特征包括体型特征和所述解剖结构的生理特征中至少一种; Acquiring a physical characteristic of the first patient, wherein the physical characteristic comprises at least one of a body shape characteristic and a physiological characteristic of the anatomical structure; 匹配出具有相同或相近所述身体特征的第二患者;matching a second patient having the same or similar physical characteristics; 确定所述第一患者的所述采样点子集关联的所述特征点;determining the feature points associated with the subset of sampling points of the first patient; 匹配出所述第二患者的关联于所述特征点的所述去噪权重矩阵,其中,所述第二患者的解剖结构的多个特征点分别关联多个所述去噪权重矩阵。The denoising weight matrix associated with the feature point of the second patient is matched, wherein a plurality of feature points of the anatomical structure of the second patient are respectively associated with a plurality of the denoising weight matrices. 根据权利要求1所述的导管机器人,其特征在于,所述获取相应于多个所述采样点子集的多个去噪权重矩阵,包括:The catheter robot according to claim 1, characterized in that the step of obtaining a plurality of denoising weight matrices corresponding to a plurality of the sampling point subsets comprises: 获取所述第一患者的身体特征,所述身体特征包括体型特征和所述解剖结构的生理特征中至少一种;Acquiring a physical characteristic of the first patient, wherein the physical characteristic comprises at least one of a body shape characteristic and a physiological characteristic of the anatomical structure; 确定所述第一患者的解剖结构的类型;determining a type of anatomy of the first patient; 匹配出具有相同所述类型以及相同或相近所述身体特征的第二患者;matching a second patient with the same type and the same or similar physical features; 确定所述第一患者的所述采样点子集关联的所述特征点;determining the feature points associated with the subset of sampling points of the first patient; 匹配出所述第二患者的关联于所述特征点的所述去噪权重矩阵,其中,所述第二患者的不同类型的解剖结构的多个特征点分别关联多个所述去噪权重矩阵。The denoising weight matrix associated with the feature point of the second patient is matched, wherein a plurality of feature points of different types of anatomical structures of the second patient are respectively associated with a plurality of the denoising weight matrices. 根据权利要求6或7所述的导管机器人,其特征在于,所述身体特征包括体型特征和生理特征中的至少一种,所述体型特征包括胸围,所述生理特征包括呼吸运动的幅度和心跳运动的幅度中的至少一种。The catheter robot according to claim 6 or 7 is characterized in that the physical characteristics include at least one of body shape characteristics and physiological characteristics, the body shape characteristics include chest circumference, and the physiological characteristics include at least one of the amplitude of respiratory movement and the amplitude of heartbeat movement. 根据权利要求1所述的导管机器人,其特征在于,所述导管机器人还包括至少一个第二传感器,所述第二传感器与所述控制装置耦接,被配置于患者体表、用于感应所述患者的解剖结构的内在运动,所述控制装置还被配置成用于:The catheter robot according to claim 1, characterized in that the catheter robot further comprises at least one second sensor, the second sensor being coupled to the control device and being configured on the patient's body surface for sensing the intrinsic movement of the patient's anatomical structure, and the control device being further configured to: 获取所述患者的采样点子集,所述患者的采样点子集包括多个采样点,所述采样点通过所述第一传感器从所述患者的解剖结构获取,所述采样点子集与所述患者的特征点关联;Acquire a sampling point subset of the patient, wherein the sampling point subset of the patient includes a plurality of sampling points, the sampling points are acquired from the anatomical structure of the patient by the first sensor, and the sampling point subset is associated with a feature point of the patient; 获取所述患者的测试点集,所述患者的测试点集包括多个测试点,所述测试点通过所述第二传感器获取从所述患者的体表获取,所述采样点和所述测试点处于同一手术环境坐标系或经转换处于同一手术环境坐标系; Acquire a test point set of the patient, wherein the test point set of the patient includes a plurality of test points, wherein the test points are acquired from the body surface of the patient by the second sensor, and the sampling points and the test points are in the same surgical environment coordinate system or are in the same surgical environment coordinate system after conversion; 基于获取自所述患者的所述采样点子集和所述测试点集,确定与所述患者的特征点关联的所述去噪权重矩阵,其中,所述患者是第一患者或者第二患者。The denoising weight matrix associated with the feature points of the patient is determined based on the sampling point subset and the test point set obtained from the patient, wherein the patient is the first patient or the second patient. 根据权利要求9所述的导管机器人,其特征在于,所述基于获取自所述患者的所述采样点子集和所述测试点集,确定与所述患者的特征点关联的所述去噪权重矩阵,包括:The catheter robot according to claim 9, characterized in that the determining the denoising weight matrix associated with the feature points of the patient based on the sampling point subset and the test point set obtained from the patient comprises: 对获取自所述患者的所述测试点集中多个测试点做去均值化处理,并对获取自所述患者的所述采样点子集中多个采样点做去均值化处理;Performing a de-averaging process on a plurality of test points in the test point set obtained from the patient, and performing a de-averaging process on a plurality of sampling points in the sampling point subset obtained from the patient; 确定经过所述去均值化处理的所述测试点集的逆解;Determining an inverse solution of the test point set after the de-averaging process; 基于经过所述去均值化处理的所述采样点子集和所述测试点集的逆解,确定与获取自所述患者的所述采样点子集相对应的所述去噪权重矩阵。Based on the sampling point subset subjected to the de-averaging process and the inverse solution of the test point set, the denoising weight matrix corresponding to the sampling point subset obtained from the patient is determined. 根据权利要求9所述的导管机器人,其特征在于,所述解剖结构是支气管,所述内在运动是呼吸运动,所述获取所述患者的测试点集的采集周期包括至少一个呼吸周期;或者,The catheter robot according to claim 9, characterized in that the anatomical structure is a bronchus, the intrinsic motion is a respiratory motion, and the acquisition cycle for acquiring the test point set of the patient includes at least one respiratory cycle; or 所述解剖结构是血管,所述内在运动是心动运动,所述获取所述患者的测试点集的采集周期包括至少一个心动周期。The anatomical structure is a blood vessel, the intrinsic motion is a cardiac motion, and the acquisition cycle for acquiring the test point set of the patient includes at least one cardiac cycle. 根据权利要求11所述的导管机器人,其特征在于,所述解剖结构是支气管时,所述特征点包括所述支气管的主隆突、左肺叶的第一级隆突、左肺叶的第二级隆突、右肺叶的第一级隆突及右肺叶的第二级隆突中的多个。The catheter robot according to claim 11 is characterized in that when the anatomical structure is a bronchus, the feature points include multiple of the main carina of the bronchus, the first-level carina of the left lobe, the second-level carina of the left lobe, the first-level carina of the right lobe, and the second-level carina of the right lobe. 根据权利要求11所述的导管机器人,其特征在于,所述解剖结构是支气管时,所述特征点包括主隆突、右上叶、右中叶、右下叶、左上叶、左中叶及左下叶中的一个或多个区域中的一个或多个特征点。The catheter robot according to claim 11 is characterized in that when the anatomical structure is a bronchus, the feature points include one or more feature points in one or more areas of the main carina, right upper lobe, right middle lobe, right lower lobe, left upper lobe, left middle lobe and left lower lobe. 根据权利要求9所述的导管机器人,其特征在于,所述解剖结构是支气管时,所述解剖模型是人体处于吸气状态下获取的解剖模型。The catheter robot according to claim 9 is characterized in that, when the anatomical structure is a bronchus, the anatomical model is an anatomical model obtained when the human body is in an inhalation state. 根据权利要求9所述的导管机器人,其特征在于,The catheter robot according to claim 9, characterized in that 所述第一传感器包括电磁传感器或形状传感器,所述第二传感器包括电磁传感器或光学定位传感器。 The first sensor includes an electromagnetic sensor or a shape sensor, and the second sensor includes an electromagnetic sensor or an optical positioning sensor. 根据权利要求1所述的导管机器人,其特征在于,所述解剖结构包括泌尿管或肠道。The catheter robot according to claim 1, characterized in that the anatomical structure includes a urinary tract or an intestine. 一种导管机器人的配准方法,其特征在于,包括:A catheter robot registration method, characterized by comprising: 获取包括多个模拟特征点的模型点集,所述模拟特征点从第一患者的解剖结构的解剖模型获取,多个所述模拟特征点分别与所述解剖结构的多个特征点关联;Acquire a model point set including a plurality of simulated feature points, wherein the simulated feature points are acquired from an anatomical model of an anatomical structure of a first patient, and the plurality of simulated feature points are respectively associated with a plurality of feature points of the anatomical structure; 通过第一传感器获取包括多个采样点子集的空间点集,所述采样点子集包括多个采样点,所述采样点从所述解剖结构获取,多个所述采样点子集分别与多个所述特征点关联;Acquire, by a first sensor, a spatial point set including a plurality of sampling point subsets, wherein the sampling point subsets include a plurality of sampling points, the sampling points are acquired from the anatomical structure, and the plurality of sampling point subsets are respectively associated with a plurality of the feature points; 获取相应于多个所述采样点子集的多个去噪权重矩阵,多个所述去噪权重矩阵分别与多个所述特征点关联;Acquire a plurality of denoising weight matrices corresponding to a plurality of the sampling point subsets, wherein the plurality of denoising weight matrices are respectively associated with a plurality of the feature points; 基于多个所述去噪权重矩阵,分别对相应的多个所述采样点子集中所述采样点进行去噪;Based on the plurality of denoising weight matrices, denoising the sampling points in the corresponding plurality of sampling point subsets respectively; 基于多个所述采样点子集的去噪后的所述采样点,分别确定多个所述采样点子集相应的均值点;Based on the denoised sampling points of the plurality of sampling point subsets, respectively determining mean points corresponding to the plurality of sampling point subsets; 基于多个所述模拟特征点和多个所述均值点,确定所述模型点集和所述空间点集之间的粗配准关系。Based on the plurality of simulated feature points and the plurality of mean points, a rough registration relationship between the model point set and the space point set is determined. 一种计算机可读存储介质,其特征在于,所述计算机可读存储介质存储有计算机程序,所述计算机程序被配置为由处理器加载并执行实现如权利要求17所述的方法的步骤。 A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program, and the computer program is configured to be loaded and executed by a processor to implement the steps of the method according to claim 17.
PCT/CN2024/085557 2023-04-27 2024-04-02 Catheter robot and registration method thereof Pending WO2024222402A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202310481670.9A CN118845228A (en) 2023-04-27 2023-04-27 Catheter robot and registration method thereof
CN202310481670.9 2023-04-27

Publications (1)

Publication Number Publication Date
WO2024222402A1 true WO2024222402A1 (en) 2024-10-31

Family

ID=93160949

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2024/085557 Pending WO2024222402A1 (en) 2023-04-27 2024-04-02 Catheter robot and registration method thereof

Country Status (2)

Country Link
CN (1) CN118845228A (en)
WO (1) WO2024222402A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119745516A (en) * 2025-01-07 2025-04-04 中科南京人工智能创新研究院 Surgical tool positioning and moving method, apparatus, electronic device, storage medium and computer program product applied to surgical robot

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104540439A (en) * 2012-08-14 2015-04-22 直观外科手术操作公司 Systems and methods for registration of multiple vision systems
CN108024698A (en) * 2015-08-14 2018-05-11 直观外科手术操作公司 Registration system and method for image-guided surgery
CN108024699A (en) * 2015-08-14 2018-05-11 直观外科手术操作公司 Registration arrangement and method for image guided surgery operation
US20190201106A1 (en) * 2018-01-04 2019-07-04 Holo Surgical Inc. Identification and tracking of a predefined object in a set of images from a medical image scanner during a surgical procedure
CN112423652A (en) * 2018-06-19 2021-02-26 直观外科手术操作公司 Systems and methods related to registration for image guided surgery
CN113521499A (en) * 2020-04-22 2021-10-22 西门子医疗有限公司 Method for generating control signal
CN113710145A (en) * 2019-03-15 2021-11-26 直观外科手术操作公司 System for enhanced registration of patient anatomy
CN115778554A (en) * 2023-01-09 2023-03-14 深圳市精锋医疗科技股份有限公司 Catheter robot, registration method thereof and readable storage medium

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104540439A (en) * 2012-08-14 2015-04-22 直观外科手术操作公司 Systems and methods for registration of multiple vision systems
CN108024698A (en) * 2015-08-14 2018-05-11 直观外科手术操作公司 Registration system and method for image-guided surgery
CN108024699A (en) * 2015-08-14 2018-05-11 直观外科手术操作公司 Registration arrangement and method for image guided surgery operation
US20190201106A1 (en) * 2018-01-04 2019-07-04 Holo Surgical Inc. Identification and tracking of a predefined object in a set of images from a medical image scanner during a surgical procedure
CN112423652A (en) * 2018-06-19 2021-02-26 直观外科手术操作公司 Systems and methods related to registration for image guided surgery
CN113710145A (en) * 2019-03-15 2021-11-26 直观外科手术操作公司 System for enhanced registration of patient anatomy
CN113521499A (en) * 2020-04-22 2021-10-22 西门子医疗有限公司 Method for generating control signal
CN115778554A (en) * 2023-01-09 2023-03-14 深圳市精锋医疗科技股份有限公司 Catheter robot, registration method thereof and readable storage medium

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN119745516A (en) * 2025-01-07 2025-04-04 中科南京人工智能创新研究院 Surgical tool positioning and moving method, apparatus, electronic device, storage medium and computer program product applied to surgical robot

Also Published As

Publication number Publication date
CN118845228A (en) 2024-10-29

Similar Documents

Publication Publication Date Title
US12285223B2 (en) Systems and methods of registration for image-guided surgery
US10898057B2 (en) Apparatus and method for airway registration and navigation
US11423542B2 (en) Systems and methods of registration for image-guided surgery
KR102337440B1 (en) Systems and methods for device-aware flexible tool registration
CN106170265B (en) System and method for non-rigid deformation of tissue for virtual navigation of interventional tools
JP2023552577A (en) Dynamic deformation tracking for navigational bronchoscopy
CN112741692A (en) Rapid navigation method and system for realizing device navigation to target tissue position
US11514591B2 (en) Systems and methods related to registration for image guided surgery
CN119367052B (en) Navigation system and readable storage medium
WO2024222402A1 (en) Catheter robot and registration method thereof
JP2023513383A (en) Medical imaging systems, devices, and methods for visualizing deployment of internal therapeutic devices
CN109745120B (en) Image registration conversion parameter optimization method and system
CN119214797B (en) Catheter robot and registration method thereof
US20250391021A1 (en) Systems and methods for progressive registration
US12373942B2 (en) Systems and methods for progressive registration
US20250391026A1 (en) Systems and methods of registration for image-guided surgery

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24795783

Country of ref document: EP

Kind code of ref document: A1