[go: up one dir, main page]

WO2023021538A1 - Système de manipulateur, dispositif de commande et procédé d'estimation de forme - Google Patents

Système de manipulateur, dispositif de commande et procédé d'estimation de forme Download PDF

Info

Publication number
WO2023021538A1
WO2023021538A1 PCT/JP2021/029852 JP2021029852W WO2023021538A1 WO 2023021538 A1 WO2023021538 A1 WO 2023021538A1 JP 2021029852 W JP2021029852 W JP 2021029852W WO 2023021538 A1 WO2023021538 A1 WO 2023021538A1
Authority
WO
WIPO (PCT)
Prior art keywords
manipulator
timing
input value
shape
value
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2021/029852
Other languages
English (en)
Japanese (ja)
Inventor
晋平 宮原
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Olympus Medical Systems Corp
Original Assignee
Olympus Medical Systems Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Olympus Medical Systems Corp filed Critical Olympus Medical Systems Corp
Priority to PCT/JP2021/029852 priority Critical patent/WO2023021538A1/fr
Publication of WO2023021538A1 publication Critical patent/WO2023021538A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor

Definitions

  • the present invention relates to a manipulator system, a control device, a shape estimation method, and the like.
  • manipulators and systems containing manipulators have been used in the medical and industrial fields.
  • a manipulator When a manipulator is used by being inserted into, for example, the body, the operator who operates the manipulator cannot directly see the tip of the insertion portion of the manipulator.
  • Japanese Patent Application Laid-Open No. 2002-200001 discloses a technique of sensing the amount of wire pulling of an endoscope, which is an example of a manipulator, and predicting the shape of a bending portion of the endoscope.
  • One aspect of the present disclosure is a manipulator, a first sensor that acquires movement of a tip of the manipulator, an operation unit that performs a bending operation on the manipulator, and a second sensor that acquires an operation input amount of the bending operation of the operation unit. and a control device for estimating a shape of the manipulator, wherein the control device receives an input from the first sensor, from the shape of the manipulator in a first state, a start timing at which the manipulator begins to bend.
  • a bending operation of the operation unit causes the state to shift from the first state It concerns a manipulator system that estimates the shape of said manipulator in a second state, which is a changed state.
  • Another aspect of the present disclosure is a control device for estimating a shape of a manipulator, which acquires a first input value, which is an input value from a first sensor that acquires movement of a tip of the manipulator, and bends the manipulator. Acquiring a second input value that is an input value from a second sensor that acquires an operation input amount based on a bending operation of the operating portion to be operated, and based on the first input value, from the shape of the manipulator in the first state.
  • Yet another aspect of the present disclosure is a shape estimation method for estimating a shape of a manipulator, comprising: acquiring a first input value that is an input value from a first sensor that acquires movement of a tip of the manipulator; acquiring a second input value that is an input value from a second sensor that acquires an operation input amount based on a bending operation of an operation unit that bends the manipulator; and obtaining a first state based on the first input value.
  • FIG. 2 is a block diagram for explaining a configuration example of a manipulator system
  • FIG. FIG. 4 is a diagram schematically explaining an example of a manipulator and an operation unit
  • FIG. 5 is a diagram for explaining start timing; The figure explaining the slack of a wire. Another figure explaining slack of a wire. Another figure explaining slack of a wire. The figure explaining a 1st state and a 2nd state.
  • FIG. 5 is a diagram for explaining a processing example of tip angle estimation processing
  • FIG. 4 is a diagram for explaining a first input value and a first input value excluding a disturbance value
  • FIG. 1 is a block diagram illustrating a configuration example of a manipulator system 10 of this embodiment.
  • Manipulator system 10 includes manipulator 100 , operation unit 200 , and control device 300 .
  • Manipulator 100 includes a first sensor 150 .
  • Operation unit 200 includes a second sensor 250 .
  • the configuration of the manipulator system 10 is not limited to that shown in FIG. 1, and various modifications such as adding other components are possible.
  • the manipulator 100 can be configured to include the operation unit 200 .
  • FIG. 2 is a diagram schematically illustrating the manipulator 100 and the operation unit 200 of this embodiment.
  • Manipulator 100 includes a curved portion 102 and a flexible portion 104 .
  • the bending portion 102 is positioned on the distal end side of the outer sheath 110 and includes a plurality of bending pieces 120 and a distal end portion 130 connected to the distal ends of the bending pieces 120 .
  • the bending portion 102 bends when the wire 160 is pulled based on the operation of the operation portion 200, which will be described later.
  • the flexible portion 104 is positioned on the proximal end side of the outer sheath 110, does not include the bending piece 120, and bends passively by an external force.
  • the flexible portion 104 may further include a flexible annular member as long as it is passively bent by an external force.
  • the bending piece 120 is a short cylindrical member made of metal, and the number thereof is not particularly limited.
  • the plurality of bending pieces 120 and the distal end portion 130 are each connected by a rotatable connecting portion 140 . That is, the manipulator 100 of this embodiment has an articulated structure.
  • the manipulator 100 is not limited to that shown in FIG. 2, and various modifications such as addition of other components are possible.
  • the distal end portion 130 may include a treatment tool, a lighting device, or an imaging device. Also, all or part of these may be included.
  • the lighting device and imaging device included in the distal end portion 130 can be controlled from the outside by passing an optical fiber connected to the lighting device and a cable connecting to the imaging device through a cavity (not shown) in the operation unit 200 and the bending piece 120.
  • the manipulator 100 of the present embodiment can be used as a medical manipulator such as a medical endoscope, a catheter, and a surgical support robot arm, or as an industrial manipulator such as an industrial endoscope and an industrial robot arm.
  • the specific structures of the bending piece 120, the distal end portion 130, the connecting portion 140, etc. are known, and detailed description thereof will be omitted.
  • bending operation of the bending portion 102 may be referred to as bending operation of the manipulator 100 . Further, in the following description, bending of the bending portion 102 may be referred to as bending of the manipulator 100 .
  • the A axis, the UD axis and the LR axis are shown as appropriate from FIG. 2 onward as the three mutually orthogonal axes.
  • the direction along the A-axis is called the A-axis direction, which is the direction along the longitudinal direction of the manipulator 100 .
  • the direction in which the distal end side of the manipulator 100 is inserted into a body cavity, for example, is direction A1
  • the direction in which the manipulator 100 is pulled out is direction A2.
  • the direction along the UD axis is called the UD axis direction
  • the direction along the LR axis is called the LR axis direction.
  • the LR axis, UD axis, and A axis can also be called the X axis, Y axis, and Z axis, respectively.
  • perpendicular includes not only intersecting at 90° but also intersecting at an angle slightly inclined from 90°.
  • the first sensor 150 acquires the movement of the tip of the manipulator 100.
  • the first sensor is, for example, a two-axis or three-axis acceleration sensor, and outputs detected acceleration data to the control device 300, which will be described later, through wireless communication or wired communication.
  • the first sensor 150 may integrate the detected acceleration data with an integrator (not shown) and output it to the control device 300 as velocity data.
  • the two axes here are the aforementioned X axis and Y axis
  • the three axes are the X axis, Y axis, and Z axis. The same applies to the rest.
  • the first sensor may be a two-axis or three-axis gyro sensor, and may output detected angular acceleration data or angular velocity data to the control device 300, which will be described later, via wireless or wired communication.
  • a gyro sensor may also be called an angular velocity sensor.
  • the first sensor may be a motion sensor including a biaxial or triaxial acceleration sensor and a biaxial or triaxial gyro sensor. Note that the motion sensor may refer to either one of an acceleration sensor and a gyro sensor.
  • the operation unit 200 bends the manipulator 100 .
  • the pair of wires 160 can be moved in opposite directions by a wire driving mechanism (not shown) based on an operation input of the operation section 200, and the bending section 102 can be bent in a desired direction.
  • the bending portion 102 is shown bent upward in the UD direction by the two wires 160, but it may be bent in the RL direction.
  • the manipulator 100 may be configured to include four wires 160 consisting of an upper bend wire 160u, a lower bend wire 160d, a left bend wire 160l, and a right bend wire 160r. .
  • the left bending wire 160l and the right bending wire 160r move in mutually opposite directions, and the predetermined bending piece 120 rotates. It is assumed that the bending portion 102 can be bent in a desired direction in the RL direction.
  • the angle knob 200B that is the operation unit 200
  • the upper bending wire 160u and the lower bending wire 160d move in opposite directions, and the specific bending piece 120 rotates, thereby bending the bending portion 102. can be bent in any desired direction in the UD direction.
  • the wire drive mechanism (not shown) can be realized by a known method, so detailed description thereof will be omitted.
  • the second sensor 250 acquires the operation input amount of the bending operation of the operation section 200 .
  • the operation unit 200 is the angle knobs 200A and 200B described above
  • the amount of rotation of the angle knobs 200A and 200B can be grasped as the operation input amount of the bending operation. can do.
  • a method of estimating the amount of pulling of the wire 160 based on the amount of rotation of the angle knobs 200A and 200B and estimating the curved shape of the manipulator 100 is known.
  • the second sensor 250 may be a sensor that directly detects the amount of movement of the wire 160 .
  • the control device 300 acquires a first input value input from the first sensor and a second input value input from the second sensor.
  • the first input value is the aforementioned acceleration data or angular acceleration data, or position change data or angle data obtained by integrating these data.
  • the second input value is data indicating the operation input amount of the operation unit 200 described above and data indicating the movement amount of the wire 160 .
  • the control device 300 is configured with the following hardware.
  • the hardware may include circuitry for processing digital signals and/or circuitry for processing analog signals.
  • the hardware may consist of one or more circuit devices or one or more circuit elements mounted on a circuit board.
  • the one or more circuit devices are, for example, ICs (Integrated Circuits), FPGAs (field-programmable gate arrays), or the like.
  • the one or more circuit elements are, for example, resistors, capacitors, and the like.
  • Controller 300 includes a memory that stores information and a processor that operates on the information stored in the memory.
  • the information is, for example, programs and various data.
  • a processor includes hardware.
  • Various processors such as a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), and a DSP (Digital Signal Processor) can be used as the processor.
  • the memory may be a semiconductor memory such as SRAM (Static Random Access Memory) or DRAM (Dynamic Random Access Memory), a register, or a magnetic storage device such as HDD (Hard Disk Drive).
  • it may be an optical storage device such as an optical disc device.
  • the memory stores computer-readable instructions, and when the instructions are executed by the processor, some or all of the functions of the units of the control device 300 are realized as processes.
  • the instruction here may be an instruction set that constitutes a program, or an instruction that instructs a hardware circuit of a processor to perform an operation.
  • all or part of each unit of the control device 300 can be realized by cloud computing, and each process described later with reference to FIG. 10 and the like can be performed on the cloud computing.
  • control device 300 estimates the shape of the manipulator 100 .
  • a method of estimating the shape of the manipulator 100 using the amount of pulling of the wire 160 and the amount of operation input of the operation unit 200 is disclosed in Patent Document 1 and the like. Therefore, it is considered that the control device 300 can estimate the shape of the manipulator 100 by using these methods based on the second input value from the second sensor 250 described above.
  • the shape of the manipulator 100 cannot be accurately estimated only by applying the method disclosed in Patent Document 1 and the like. This is because the method disclosed in Patent Document 1 or the like assumes that uniform and constant tension always acts on the wire 160 .
  • wire 160 in flexible section 104 is slack.
  • the bending portion 102 starts bending at the start timing ts, which is the timing after the timing at which the operation of the operation portion 200 is started.
  • the start timing cannot be grasped from the second input value from the second sensor 250 .
  • FIG. 4 is a diagram for explaining the relationship between the time for operating the operation unit 200 and the first input value.
  • the bending pieces 120 and the like which are unnecessary for explanation, are omitted as appropriate.
  • the reference numerals of the outer sheath 110, the distal end portion 130, the wire 160, and the operating portion 200 are attached to only one portion as a representative, and the others are omitted.
  • the specific direction in which the manipulator 100 bends is not particularly limited. It is also assumed that the operator starts operating the operation unit 200 at the timing when the vertical axes intersect, and that the manipulator 100 as a whole is not curved at the time of starting the operation of the operation unit 200 .
  • the period indicated by B2 is a period in which the slackness of the wire 160 corresponding to the operation of the operation section 200 is eliminated. Part 130 begins to act. Then, when the operator continues to operate the operation section 200, the bending section 102 starts bending, for example, as indicated by B3 at the start timing ts.
  • the bending angle of the bending portion 102 can be accurately estimated.
  • the bending angle of the bending portion 102 can be accurately estimated by adding a certain offset value to the amount of operation input to the above-described conventional method after considering the start timing. It seems so.
  • the start timing ts is not a constant value, but a value that changes according to the shape of the flexible portion 104 .
  • 5, 6, and 7 are diagrams illustrating slackness of the wire 160.
  • FIG. 5 shows the state in which the flexible portion 104 is not curved
  • FIG. 6 shows the state in which the flexible portion 104 is curved by 90°
  • FIG. 7 is the state in which the flexible portion 104 is curved by 180°.
  • FIG. 1 is in a state of 5 to 7 show only the upward bending wire 160u and the downward bending wire 160d as examples of the wires 160, and show the case where the flexible portion 104 bends upward in the UD axis direction. is the same, and the same is true for the RL axis direction. Further, illustration of the bending portion 102 is omitted in FIG. The same applies to FIGS. 6 and 7.
  • FIG. 1 shows only the upward bending wire 160u and the downward bending wire 160d as examples of the wires 160, and show the case where the flexible portion 104 bends upward in the UD axis direction. is the same, and the same is true for the RL axis direction. Further, illustration of the bending portion 102 is omitted in FIG. The same applies to FIGS. 6 and 7.
  • FIG. 1 is in a state of 5 to 7 show only the upward bending wire 160u and the downward bending wire 160d as examples of the wires 160, and show the case where the flexible portion 104 bends upward in
  • the slackness of the upper bending wire 160u and the lower bending wire 160d is the same.
  • the same here includes substantially the same.
  • the slackness of wire 160 depends on the shape of flexible portion 104 of manipulator 100 .
  • the manipulator 100 is a medical manipulator such as an endoscope
  • the shape of the flexible portion 104 changes intricately over time. , and the start timing ts also changes accordingly. Therefore, it is difficult to easily estimate the shape of the manipulator 100 using the conventional method.
  • the control device 300 estimates the start timing ts based on the first input value from the shape of the manipulator 100 in the first state. For example, assume that the shape of the manipulator 100 before the start timing ts was in the first state. However, although FIG. 8 schematically illustrates a state where the manipulator 100 is not curved, the manipulator 100 may be curved. Then, the start timing ts is estimated by applying a method described later to the first input value input from the first sensor 150 .
  • the control device 300 estimates the shape of the manipulator 100 in the second state, which is the state changed from the first state by the bending operation of the operation unit 200, based on the second input value. .
  • the shape of the manipulator 100 can be determined at a predetermined timing after the start timing ts. can be estimated.
  • the control device 300 can estimate that the tip of the manipulator 100 is bent by 90° at the timing indicated by C1, and that the tip of the manipulator 100 is bent by 180° at the timing indicated by C2.
  • the predetermined method is the conventional method described above, the method described later with reference to FIG. 13, or the like.
  • the manipulator system 10 of the present embodiment includes the manipulator 100, the first sensor 150 that acquires the movement of the tip of the manipulator 100, the operation unit 200 that performs bending operation of the manipulator 100, and the operation unit 200 that performs bending operation. and a control device 300 for estimating the shape of the manipulator 100 .
  • controller 300 estimates the start timing ts at which manipulator 100 begins to bend, based on the first input value from first sensor 150 . Further, based on the second input value, which is the input value from the second sensor 250 after the estimated start timing ts, the control device 300 controls the second state, which is the state changed from the first state by the bending operation of the operation unit 200 . Estimate the shape of the state manipulator 100 .
  • the manipulator system 10 of this embodiment not only includes the second sensor 250 in the operation section 200, but also includes the first sensor 150 in the manipulator 100.
  • the control device 300 can use not only the second input value but also the first input value in estimating the shape of the manipulator 100 .
  • the start timing ts can be estimated using the first state before the manipulator 100 starts bending and the first input value. This makes it possible to update the estimation result of the start timing ts every time the shape of the manipulator 100 changes. As a result, the start timing ts can be accurately estimated, so the shape of the manipulator 100 can be accurately estimated by using the second input value from the second sensor. This allows the operator to operate the manipulator 100 easily and safely.
  • the method of the present embodiment may be implemented as the control device 300. That is, the control device 300 of the present embodiment is a control device 300 that estimates the shape of the manipulator 100, and acquires the first input value that is the input value from the first sensor 150 that acquires the movement of the tip of the manipulator 100. do.
  • the control device 300 also acquires a second input value, which is an input value from the second sensor 250 that acquires the amount of operation input based on the bending operation of the operation unit 200 that bends the manipulator 100 .
  • the control device 300 estimates the start timing ts at which the manipulator 100 begins to bend, and the second input after the estimated start timing ts. Based on the values, the shape of the manipulator 100 in the second state, which is the state changed from the first state by the bending operation of the operation unit 200, is estimated. By doing so, an effect similar to that described above can be obtained.
  • the method of the present embodiment may be implemented as a shape estimation method. That is, the shape estimation method of the present embodiment is a shape estimation method for estimating the shape of the manipulator 100, and acquires the first input value, which is the input value from the first sensor 150 that acquires the movement of the tip of the manipulator 100. and obtaining a second input value that is an input value from the second sensor 250 that obtains an operation input amount based on the bending operation of the operation unit 200 that bends the manipulator 100 .
  • the shape estimating method includes, based on the first input value, estimating the start timing ts at which the manipulator 100 is considered to start bending from the shape of the manipulator 100 in the first state, and It includes estimating the shape of the manipulator 100 in the second state, which is a state changed from the first state by the bending operation of the operation unit 200, based on the second input value.
  • FIG. 9 is a diagram for explaining the relationship between the angle change of the tip portion 130 of the manipulator 100, the behavior of the first input value, and the behavior of the second input value.
  • each graph in FIG. 9 shows either the component in the LR axis direction or the component in the UD axis direction, but the same applies to the other. The same applies to FIG. 13 to be described later.
  • the first sensor 150 is assumed to be an acceleration sensor in the following description, it may be the gyro sensor or motion sensor described above. That is, the first sensor 150 is an acceleration sensor provided at the tip of the manipulator 100, an angular velocity sensor, or both.
  • the operation unit 200 is rotated like the angle knobs 200A and 200B in FIG. 2, and the second sensor 250 is an angle sensor. That is, the operation unit 200 is rotated within a predetermined angle range, and the second sensor 250 is an angle sensor that measures the angle. That is, the change in the second input value shown in FIG. 9 is the change in the angle of the operation unit 200 .
  • the second sensor 250 may be a sensor that can directly acquire the amount of traction of the wire 160, and in this case there is no need to use the aforementioned angle sensor.
  • the manipulator 100 includes the wire 160 and the second sensor 250 is a sensor capable of acquiring the amount of pulling of the wire 160 .
  • the bending portion 102 is bent by an angle ⁇ 1.
  • the curved portion 102 at this time may not be curved, that is, the angle ⁇ 1 may be 0°.
  • the bending portion 102 starts bending at a first timing t1, and bends by an angle ⁇ 2 at a second timing t2. That is, the first timing t1 in FIG. 9 is timing corresponding to the start timing ts in FIG.
  • the first timing t1 at which the bending portion 102 begins to bend is the timing at which the operation input of the operation unit 200 is started. It does not match. That is, the operation input of the operation unit 200 is started at the third timing t3 which is the timing before the first timing t1, and the second sensor 250 acquires the second input value at the third timing t3. It will be.
  • the shape of the manipulator 100 does not change at the third timing t3 or at timings before the third timing t3, it corresponds to the first state in FIG. That is, the first state is the state of the shape of the manipulator 100 at the timing before the third timing t3, which is the timing at which the operation input to the operation unit 200 is performed, and the state of the shape of the manipulator 100 at the third timing t3. at least one of them.
  • the first input value starts rising after the third timing t3.
  • the timing at which the first input value exceeds the threshold value L is the first timing t1, and the bending portion 102 starts bending.
  • the timing when the first input value is divided by the threshold value L is the second timing t2, and the bending portion 102 stops bending at the aforementioned angle ⁇ 2.
  • the threshold value L here is a value that depends on the shape of the manipulator 100 at the third timing t3, and the details will be described later. Also, since the first input value acquired by the first sensor 150 includes a disturbance value, which will be described later, it is necessary to estimate the first timing t1 in consideration of the disturbance value, the method of which will be described later.
  • the shape of the manipulator 100 can be estimated at a timing after the first timing t1. That is, at a predetermined timing after the first timing t1, the shape of the manipulator 100 can be estimated based on the second input value.
  • the predetermined timing is the timing from the first timing t1 to the second timing t2.
  • the control device 300 estimates the threshold value L of the operation input amount at which the manipulator 100 is assumed to start bending from the shape of the manipulator 100 in the first state.
  • the first timing t1 which is the timing at which the operation input amount exceeds the threshold L
  • the second state The shape of the manipulator 100 is estimated.
  • the method of the present embodiment may be implemented as the control device 300. That is, the control device 300 of the present embodiment estimates the threshold value L of the amount of operation input at which the manipulator 100 is considered to start bending from the shape of the manipulator 100 in the first state, and calculates the amount of operation input based on the first input value. exceeds the threshold value L as the start timing ts, and the shape of the manipulator 100 in the second state is estimated based on the second input value at a predetermined timing after the first timing t1. . Thereby, an effect similar to that described above can be obtained.
  • the method of the present embodiment may be implemented as a shape estimation method.
  • the shape estimation method of the present embodiment includes estimating the threshold value L of the amount of operation input at which the manipulator 100 is assumed to start bending from the shape of the manipulator 100 in the first state. Further, the shape estimating method includes, based on the first input value, determining the first timing t1, which is the timing at which the operation input amount exceeds the threshold value L, as the start timing ts, estimating the shape of the manipulator 100 in the second state based on the second input value at the timing; Thereby, an effect similar to that described above can be obtained.
  • the control device 300 first acquires a first input value (step S100).
  • the process of step S100 is a loop process until YES in step S120, which will be described later, and is always performed at a constant cycle. In other words, the control device 300 continues to acquire the first input value as time-series data.
  • the control device 300 acquires a disturbance value (step S110).
  • the disturbance value is, among the first input values, a value that does not depend on the bending operation from the operation unit 200, and specifically is noise or the like. That is, in a situation where noise or the like occurs, the control device 300 obtains the first input value as a value to which the disturbance value is added. Therefore, when the control device 300 continues to acquire the first input value until the second timing t2, the actual waveform of the first input value becomes, for example, D1 in FIG.
  • the situation where noise or the like occurs is, for example, when the manipulator 100 is a medical endoscope, it is inserted into the patient's lumen.
  • the control device 300 acquires a disturbance value estimated by applying a predetermined time-series model to the time-series data of the first input value.
  • the predetermined time series model is, for example, an autoregressive model, but may be other time series models such as an autoregressive moving average model or an autoregressive integrated moving average model.
  • the autoregressive model can also be called an AR (autoregressive) model
  • the autoregressive moving average model can also be called an ARMA (autoregressive moving average) model
  • the autoregressive integrated moving average model can be called an ARIMA (autoregressive integrated moving average) model.
  • ARIMA autoregressive integrated moving average
  • control device 300 performs a process of determining whether or not a bending operation has been detected, and if a bending operation has not been detected (NO in step S120), the process returns to step S100.
  • a tip angle calculation process step S200, which will be described later, is performed, and then the process returns to step S100.
  • step S110 described above is repeatedly performed until the bending operation is detected.
  • the disturbance value is also determined. That is, the disturbance value is estimated based on the waveform portion indicated by E in the waveform indicated by D1 in FIG. 12 and the above-described predetermined time-series model. Then, as will be described later with reference to FIG. 11, the estimated disturbance value is used to estimate the first timing t1.
  • the control device 300 acquires the second input value at the third timing (step S210), and acquires the threshold value L of the amount of operation input (step S220). Specifically, control device 300 acquires threshold value L estimated according to a predetermined algorithm based on the second input value at the third timing.
  • the predetermined algorithm for example, assumes that the manipulator 100 is a multi-joint manipulator connected to i joints as shown in FIG. This is an algorithm that estimates the velocity and angular velocity of the point F connected to the terminal joint by distributing. Although each joint in the multi-joint manipulator in FIG.
  • a homogeneous transformation matrix from the origin O to the link coordinate system at the joint i-1 can be expressed by the following equation (1).
  • the model of the articulated manipulator in FIG. 13 can correspond to the illustrated manipulator 100 in FIG.
  • the operating portion 200 in FIG. 2 corresponds to the origin O in FIG. 13
  • the connecting portion 140 in FIG. 2 corresponds to the joint in FIG. 13
  • the tip portion 130 in FIG. 2 corresponds to the point F in FIG.
  • the displacement of the bending piece 120 and the change in the angle between the bending pieces 120 due to the pulling of the wire 160 by the operation input of the operation unit 200 in FIG. corresponds to changes in Therefore, if the second input value, which is the value obtained by operating the operation unit 200 in FIG. 2, corresponds to the velocity and angular velocity at the origin O in FIG.
  • the velocity and angular velocity of F are estimated.
  • the velocity and angular velocity of tip portion 130 of manipulator 100 can be estimated. Therefore, by setting the acceleration obtained by partially differentiating the estimated speed of the tip end portion 130 as the threshold value L, it can be compared with the first input value, which is the acceleration data. Accordingly, after the third timing t3, the first timing t1 at which the first input value input to the control device 300 exceeds the threshold value L is considered to match the start timing ts with high accuracy. It can be regarded as the start timing ts.
  • the estimated threshold value L is a value that depends on the shape of the manipulator 100 at the third timing t3. For example, when the manipulator 100 is not bent at all, and the manipulator 200 is quickly operated, that is, when the wire 160 is quickly pulled, the distal end portion 130 undergoes a large acceleration. Further, for example, even if the wire 160 is pulled at the same speed while the manipulator 100 is curved, the acceleration generated in the tip portion 130 is smaller than when the manipulator 100 is not curved at all. These events mean that the Jacobian matrix in the multi-joint manipulator model of FIG. 13 depends on the angle of each joint. Therefore, when the control device 300 calculates the threshold L based on the above model, estimation of the threshold L can be realized by storing Jacobian matrix data according to the angle in a storage unit (not shown). can be done.
  • a large estimated threshold value L means that the tip portion 130 of the manipulator 100 is difficult to move. I have something to say.
  • the operability of the manipulator 100 can be predicted from the shape of the manipulator 100 at the third timing t3, and the second input value at the third timing t3 is used to obtain the first timing t1.
  • a threshold L can be estimated.
  • the operability is the responsiveness of the first input value to the bending operation of the operating section 200, and the responsiveness is shown in the above equation (3). That is, in Equation (3), the velocity and angular velocity of each joint change according to the bending operation, and as a result, the angle and/or angular velocity of the tip portion 130 corresponding to the first input value responds.
  • the velocity or angular velocity input to the operation unit 200 is the same, if the Jacobian matrix is different, the angle or angular velocity of the tip portion 130 corresponding to the first input value will be different.
  • the bending operation amount differs according to the operability, so different threshold values L are estimated according to the operability. That is, the operability and the threshold L are estimated based on the Jacobian matrix of Equation (3).
  • the control device 300 converts the second input value at the third timing t3, which is the timing at which the operation input to the operation unit 200 is performed, to the Jacobian matrix in a predetermined algorithm.
  • a threshold value L is obtained based on the threshold value L, and the first timing t1 is obtained by comparing the threshold value L and the first input value. By doing so, the threshold value L can be determined such that the first timing t1 and the start timing ts match with high precision.
  • the method of the present embodiment may be implemented as the control device 300. That is, the control device 300 of the present embodiment obtains the threshold value L based on the second input value at the third timing t3, which is the timing at which the operation input to the operation unit 200 is performed, and the Jacobian matrix in a predetermined algorithm, A first timing t1 is obtained by comparing the threshold value L and the first input value. Thereby, an effect similar to that described above can be obtained.
  • the method of the present embodiment may be implemented as a shape estimation method. That is, the shape estimation method of the present embodiment obtains the threshold value L based on the second input value at the third timing t3, which is the timing at which the operation input to the operation unit 200 is performed, and the Jacobian matrix in a predetermined algorithm, and determining the first timing t1 by comparing the threshold value L and the first input value. Thereby, an effect similar to that described above can be obtained.
  • step S230 acquires the first input value (step S230).
  • the process of step S230 is the same as step S100 of FIG. 10, but step S100 is a process of acquiring the first input value before the third timing t3, whereas step S230 is a process of acquiring the first input value after the third timing t3. It differs in that it is a process of acquiring the first input value.
  • control device 300 determines whether or not the value obtained by subtracting the disturbance value obtained in step S110 from the first input value obtained in step S230 is greater than the threshold value L obtained in step S220. For example, when the disturbance value is subtracted from the first input value based on the waveform shown in D1 of FIG. 12, the waveform shown in D2, for example, is obtained.
  • step S230 When the value obtained by subtracting the disturbance value from the first input value is smaller than the threshold value L (NO in step S240), the control device 300 performs the process of step S230 again. That is, as long as the value obtained by subtracting the disturbance value from the first input value is smaller than the threshold value L, step S230 is looped. As described above, the first input value obtained in step S230 increases over time, and the timing at which the value obtained by subtracting the disturbance value from the first input value exceeds the threshold value L is the first timing t1, that is, the estimated start It is the timing ts.
  • the control device 300 uses the first input value in a predetermined period before the third timing t3, which is the timing at which the operation input to the operation unit 200 is performed, Among the first input values, a disturbance value that does not depend on the bending operation from the operation unit 200 is estimated. Then, the control device 300 estimates the start timing ts based on the disturbance value and the first input value.
  • the method of the present embodiment may be implemented as the control device 300. That is, the control device 300 of the present embodiment uses the first input value in a predetermined period before the third timing t3, which is the timing at which the operation input to the operation unit 200 is performed, to A disturbance value that does not depend on the bending operation from the operation unit 200 is estimated. Then, the control device 300 estimates the start timing ts based on the disturbance value and the first input value. Thereby, an effect similar to that described above can be obtained.
  • the method of this embodiment may be implemented as a shape estimation method. That is, the shape estimation method of the present embodiment uses the first input value in a predetermined period before the third timing t3, which is the timing at which the operation input to the operation unit 200 is performed, It includes estimating a disturbance value that does not depend on the bending operation from the operation unit 200 . The shape estimation method also includes estimating the start timing ts based on the disturbance value and the first input value. Thereby, an effect similar to that described above can be obtained.
  • the control device 300 integrates the second input value within a predetermined range (step S250).
  • the timing at which the first input value becomes greater than the threshold value L is the first timing t1 as described above, which is the timing at which the bending portion 102 is estimated to start bending. Therefore, as shown in FIG. 14, the control device 300 integrates the second input value in the section from the first timing t1 to the second timing, which is the timing at which the bending portion 102 finishes bending, so that the second timing t2 is estimated.
  • the higher the estimation accuracy the closer the estimated angle is to the angle ⁇ 2.
  • the angle information of the operation input of the operation unit 200 is obtained by integration. Based on this, the pulling amount of the wire 160 can be grasped. Thereby, the shape of the manipulator 100 can be estimated using the conventional technique described above.
  • the manipulator 100 is configured by a plurality of bending pieces 120 connected by the connecting portion 140, but the control device 300 estimates the bending angle assuming that the angles formed by the adjacent bending pieces 120 are equal. are doing.
  • the control device 300 integrates the second input value in the range from the first timing t1 to the second timing t2, which is the timing after the first timing t1.
  • the shape of the manipulator 100 at the second timing t2 is estimated.
  • the first timing t1 which is estimated to be the timing at which bending of the bending portion 102 is started, can be set as one end of the integration interval. can be estimated to
  • the method of the present embodiment may be implemented as the control device 300. That is, the control device 300 of the present embodiment integrates the second input value in the range from the first timing t1 to the second timing t2, which is the timing after the first timing t1, based on the second timing Estimate the shape of the manipulator 100 at t2. Thereby, an effect similar to that described above can be obtained.
  • the method of the present embodiment may be implemented as a shape estimation method. That is, the shape estimation method of the present embodiment calculates the second input value at the second timing based on the value obtained by integrating the second input value in the range from the first timing t1 to the second timing t2, which is the timing after the first timing t1. including estimating the shape of the manipulator 100 at t2. Thereby, an effect similar to that described above can be obtained.
  • the method of this embodiment is not limited to the above, and various modifications are possible.
  • the first input value is acceleration data input from the first sensor 150
  • the control device 300 may acquire velocity data from the first sensor 150 as the first input value.
  • the speed of the point F estimated in the above-described multi-joint manipulator model equation (3) can be used as the threshold value L and compared with the first input value. Even in this way, the first timing t1 can be obtained in the same manner, so that the same effect as when the first input value is acceleration data can be obtained.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Surgery (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Biomedical Technology (AREA)
  • Optics & Photonics (AREA)
  • Pathology (AREA)
  • Radiology & Medical Imaging (AREA)
  • Biophysics (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Manipulator (AREA)

Abstract

Un système de manipulateur (10) comprend : un manipulateur (100) ; un premier capteur (150) qui acquiert le mouvement d'une extrémité avant du manipulateur ; une unité d'opération (200) destinée à effectuer une opération de pliage sur le manipulateur ; un second capteur (250) qui acquiert une quantité d'entrée d'opération de l'opération de pliage effectuée par l'intermédiaire de l'unité d'opération ; et un dispositif de commande (300) qui estime la forme du manipulateur. Le dispositif de commande estime, à partir de la forme du manipulateur dans un premier état, un instant de départ (ts) auquel il estime que le manipulateur à commencé le pliage, sur la base d'une première valeur d'entrée qui est une valeur entrée à partir du premier capteur. De plus, sur la base d'une seconde valeur d'entrée qui est une valeur entrée à partir du second capteur à un instant ultérieur à l'instant de départ estimé, le dispositif de commande estime la forme du manipulateur dans un second état qui est un état qui a changé par rapport au premier état suite à l'opération de pliage par l'unité d'opération.
PCT/JP2021/029852 2021-08-16 2021-08-16 Système de manipulateur, dispositif de commande et procédé d'estimation de forme Ceased WO2023021538A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2021/029852 WO2023021538A1 (fr) 2021-08-16 2021-08-16 Système de manipulateur, dispositif de commande et procédé d'estimation de forme

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2021/029852 WO2023021538A1 (fr) 2021-08-16 2021-08-16 Système de manipulateur, dispositif de commande et procédé d'estimation de forme

Publications (1)

Publication Number Publication Date
WO2023021538A1 true WO2023021538A1 (fr) 2023-02-23

Family

ID=85240163

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/029852 Ceased WO2023021538A1 (fr) 2021-08-16 2021-08-16 Système de manipulateur, dispositif de commande et procédé d'estimation de forme

Country Status (1)

Country Link
WO (1) WO2023021538A1 (fr)

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS63294825A (ja) * 1987-05-28 1988-12-01 Olympus Optical Co Ltd 内視鏡装置
JP2002264048A (ja) * 2001-03-08 2002-09-18 Hitachi Ltd 被牽引機構の位置決め制御装置
JP2007029290A (ja) * 2005-07-25 2007-02-08 Olympus Medical Systems Corp 医療用制御装置
JP2008220672A (ja) * 2007-03-13 2008-09-25 Olympus Corp 内視鏡装置および内視鏡画像記録方法
WO2012153646A1 (fr) * 2011-05-12 2012-11-15 オリンパスメディカルシステムズ株式会社 Dispositif médical de commande
JP2013085616A (ja) * 2011-10-14 2013-05-13 Olympus Corp 湾曲動作システム
JP2015160278A (ja) * 2014-02-27 2015-09-07 オリンパス株式会社 医療用システム及び処置具のキャリブレーション方法
JP2018057799A (ja) * 2016-09-29 2018-04-12 富士フイルム株式会社 内視鏡システム及び内視鏡システムの駆動方法

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS63294825A (ja) * 1987-05-28 1988-12-01 Olympus Optical Co Ltd 内視鏡装置
JP2002264048A (ja) * 2001-03-08 2002-09-18 Hitachi Ltd 被牽引機構の位置決め制御装置
JP2007029290A (ja) * 2005-07-25 2007-02-08 Olympus Medical Systems Corp 医療用制御装置
JP2008220672A (ja) * 2007-03-13 2008-09-25 Olympus Corp 内視鏡装置および内視鏡画像記録方法
WO2012153646A1 (fr) * 2011-05-12 2012-11-15 オリンパスメディカルシステムズ株式会社 Dispositif médical de commande
JP2013085616A (ja) * 2011-10-14 2013-05-13 Olympus Corp 湾曲動作システム
JP2015160278A (ja) * 2014-02-27 2015-09-07 オリンパス株式会社 医療用システム及び処置具のキャリブレーション方法
JP2018057799A (ja) * 2016-09-29 2018-04-12 富士フイルム株式会社 内視鏡システム及び内視鏡システムの駆動方法

Similar Documents

Publication Publication Date Title
US9827047B2 (en) Control apparatus and control method of insertion apparatus, insertion apparatus having control apparatus, control program for insertion apparatus, and controlling integrated electronic circuit of insertion apparatus
US9233467B2 (en) Control apparatus and method for master-slave robot, master-slave robot, and control program
JP5743495B2 (ja) ロボット制御装置
US11877814B2 (en) Tension control in actuation of multi-joint medical instruments
US8523765B2 (en) Medical control apparatus
CN103648428B (zh) 用于微创手术的医学主/从式装置
JP6164970B2 (ja) ロボット制御方法、ロボットシステム、プログラム、記録媒体及び部品の製造方法
JP6456555B1 (ja) キャリブレーション装置、キャリブレーション方法および制御装置
JP4897122B2 (ja) 内視鏡形状検出装置及び内視鏡の挿入部の形状検出方法
WO2013018404A1 (fr) Dispositif d'affichage de configuration de tube d'insertion
KR20140011984A (ko) 제어 시스템, 프로그램 및 기계 장치의 제어 방법
US11540699B2 (en) Medical manipulator system
JP6003312B2 (ja) ロボットシステム
CN117224241B (zh) 一种软式内镜操控系统的控制方法及相关装置
WO2023021538A1 (fr) Système de manipulateur, dispositif de commande et procédé d'estimation de forme
CN113263496B (zh) 一种六自由度机械臂优化路径的方法和计算机设备
US20170004237A1 (en) Simulation method and simulation apparatus
JP2017154193A (ja) ロボット
WO2023032074A1 (fr) Système manipulateur et procédé d'inférence de la forme d'un manipulateur
WO2020045538A1 (fr) Dispositif d'estimation, procédé d'estimation et programme
CN119290233B (zh) 细长型医疗器械的头部力感知方法、装置、设备和介质
JP2020028645A (ja) 推定システム、推定方法およびプログラム
CN118574557A (zh) 腔内设备系统、控制装置以及控制方法
KR20240156459A (ko) 굴곡기구 외력 추정 시스템 및 방법과 이를 위한 컴퓨터 프로그램
JP5829164B2 (ja) 医療機器システム

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21954113

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21954113

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP