Summary of the invention
The objective of the invention is to propose the vision register method in a kind of auxiliary stereotactic neurosurgery robot, be to adopt the coordinate of technique of binocular stereoscopic vision measurement markers point in the robot coordinate system, thereby finish the registration of scanning image coordinate system to the robot coordinate system.This method only needs two camera heads can determine the coordinate of gauge point in the robot coordinate system.Compare with contact measurement method, its setting accuracy height, and can be automatically the position of measurement markers point in real time; Compare with other non-contact method, it cheap, simple to operation, tool has an enormous advantage.
Vision register method in a kind of auxiliary stereotactic neurosurgery of the present invention robot, this method is by containing robot, camera head, computer, the coordinate of scanned imagery device execution vision technique measurement markers point in the robot coordinate system, thereby finish the registration of scanning image coordinate system to the robot coordinate system, this method comprises the following steps:
(a) at patient head labelling point;
(b) determine the coordinate of gauge point in scanning image coordinate system:
Scan patient head with scanned imagery device, become image to be input to computer institute, the surgery planning software processes in the machine is determined the coordinate of gauge point in image coordinate system as calculated;
(c) determine the coordinate of gauge point in the robot coordinate system:
The patient head image that camera head is obtained is input to computer, and the positioning software in the machine is handled as calculated, determines the coordinate of gauge point in the robot coordinate system, and sends this coordinate to surgery planning software;
The coordinate of described gauge point in the robot coordinate system comprises that robot coordinate system OXYZ, camera head coordinate system O ' X ' Y ' Z ', undistorted image coordinates are that o ' u ' v ', distorted image coordinates are o " u " v " with computer screen coordinate system o
cFive coordinate systems of uv, the conversion simultaneous between described five coordinate systems obtains the coordinate of gauge point on computer screen;
(d) surgery planning software is finished the registration of scanning image coordinate system to the robot coordinate system.
Described vision register method, the number of its gauge point can have 4.
Described vision register method, its camera head are finished the coordinate of measurement markers point in the robot coordinate system.
Described vision register method, its scanned imagery device can be CT or MRI.
Advantage of the present invention: this vision register method is compared with the contact register method, its setting accuracy height, and can be automatically the position of measurement markers point in real time; Compare with other noncontact register method, it cheap, simple to operation, tool has an enormous advantage.
The specific embodiment
The present invention is described in further detail below in conjunction with drawings and Examples.
In the auxiliary stereotactic neurosurgery of robot, patient head is behind the scanning imagery device scan, and its image is input to " the surgery planning software " of computer, and the doctor sketches the contours the focus point by software in scanogram, and definite target spot and puncture path." surgery planning software " is converted into the object pose of robot among the robot coordinate system with doctor's the planning in scanogram, and the control robot undergos surgery with the guiding doctor according to the path alignment target spot of planning.Finish the conversion from the scanning image coordinate system to robot coordinate system, need set up the mapping relations of scanning image coordinate system, promptly finish two registrations between the coordinate system to the robot coordinate system.
The present invention is the vision register method in a kind of auxiliary stereotactic neurosurgery robot, use the gauge point of robot, camera head, computer, scanned imagery device and patient head, finish the registration of scanning image coordinate system, so that the focus point can be aimed at according to the planning of doctor in scanogram by robot in the operation process to the robot coordinate system.Registration process as shown in Figure 1,
Specific practice is:
(a) paste four gauge points in patient head, then patient head is carried out CT or MRI scanning, obtain the image of patient head surface and internal structure thereof, and be entered in " the surgery planning software " of computer;
(b) doctor goes up at " the surgery planning software " of computer and determines the position of gauge point on scanogram, calculates the coordinate of gauge point in scanning image coordinate system by " surgery planning software ";
(c) camera head is demarcated in the robot coordinate system, use camera head collection patient head image then and it is imported " the vision localization software " of computer, calculate the coordinate of gauge point in the robot coordinate system, and these coordinates are passed to " surgery planning software ";
(d) " surgery planning software " calculates the relation between scanning image coordinate system and the robot coordinate system according to the coordinate of gauge point in scanning image coordinate system and robot coordinate system, promptly finishes two registrations between the coordinate system.The target coordinate in scanning image coordinate system, determined of doctor and the puncture path pose that promptly can be exchanged into robot afterwards, thus the control robot arrives the desired position.
The coordinate of image calculation gauge point in the robot coordinate system that " vision localization software " is gathered by camera head in the present invention." surgery planning software " is used for determining the coordinate of gauge point in scanning image coordinate system in the present invention, and receive the coordinate of gauge point in the robot coordinate system that " vision localization software " is imported, finish the registration from the scanning image coordinate system to robot coordinate system.
(1) coordinate of gauge point in scanning image coordinate system
The process of determining the coordinate of gauge point in scanning image coordinate system as shown in Figure 3.Scanogram is input to " surgery planning software " in the computer, searches the image of underlined point and make marks with the distal point of mouse at gauge point, planning software is noted the figure layer at gauge point place and residing position on this figure layer.All scanograms are carried out the interlayer interpolation arithmetic, the residing figure layer of gauge point sequence number can be converted into the w coordinate in the scanning image coordinate system shown in the accompanying drawing 2, the position of gauge point in the figure layer promptly is u, the v coordinate in the scanning image coordinate system, can obtain the three-dimensional coordinate of gauge point in scanning image coordinate system thus.
(2) determine the coordinate of gauge point in the robot coordinate system
The present invention uses the coordinate of method measurement markers point in the robot coordinate system of vision localization.Be the formulation of this method below.
In the method, have five coordinate systems, as shown in Figure 4, wherein coordinate system OXYZ is the robot coordinate system, and O ' X ' Y ' Z ' is the camera head coordinate system, and o ' u ' v ' is undistorted image coordinates system, o " u " v " is distorted image coordinates system, o
cUv is the computer screen coordinate system.Can set up computer screen coordinate system o by coordinate transform
cRelation between uv and the robot coordinate system OXYZ.Vision localization in this method is exactly to put at computer screen coordinate system o by certain
cCoordinate among the uv calculates this coordinate in machine x people coordinate system OXYZ.
(1) coordinate system transformational relation
(a) robot coordinate system → camera head coordinate system
(t
x, t
y, t
z) be translational component, (α, beta, gamma, t
x, t
y, t
z) be 6 external parameters of camera head.
Be spin matrix, comprise three parameters (α, beta, gamma), α, β, γ be respectively around X,
The corner of Y, Z axle then has:
(b) camera head coordinate system → undistorted picture coordinate system
Perspective projection relation according to imaging
F is the camera head focal length, s
x, s
yBe the camera head scale factor, unit (pixel/mm).
(c) undistorted picture coordinate system → distortion is as coordinate system
There are two class distortions in camera head lens: radial distortion and tangential distortion.Wherein radial distortion is the main cause that causes the imaging point skew, generally only considers radial distortion.
u″=u′-R
u (4)
v″=v′-R
v (5)
R
u=u×(k
1r
2+k
2r
4+…)≈u×(k
1r
2+k
2r
4) (6)
R
v=v×(k
1r
2+k
2r
4+…)≈v×(k
1r
2+k
2r
4) (7)
The radial distortion of camera head is the even multinomial of r, and high order can be ignored.k
1, k
2Be the coefficient relevant with radial distortion.
(d) distortion is as coordinate system → computer screen coordinate system
u=u″+u
0 (9)
v=v″+v
0 (10)
u
0, v
0Side-play amount for the relative computer picture coordinate system of image coordinates initial point.(f, s
x, s
y, k
1, k
2, u
0, v
0) be the inner parameter of camera.
(2) camera head is demarcated
Because camera head and target range are closer in using, and the distortion of camera head itself is also little, thereby in native system, do not consider distortion.Above-mentioned each coordinate system transformational relation simultaneous can be got, be tied to the transformation relation of computer screen coordinate system from robot coordinate
K wherein
1=fs
x, k
2=fs
yThen
Promptly
Order
Then
Therefore have
A
1X+A
2Y+A
3Z+A
4-A
5Xu-A
6Yu-A
7Zu=u (12)
A
8X+A
9Y+A
10Z+A
11-A
5Xv-A
6Yv-A
7Zv=v (13)
More than two equations comprise 11 parameters to be asked, given n (n 〉=6) group reference point (u
n, v
n, X
n, Y
n, Z
n), order
A=[A
1?A
2?A
3?A
4?A
5?A
6?A
7?A
8?A
9?A
10?A
11]
T
C=[u
1?u
2?…?u
n?v
1?v
2?…?v
n]
T
Then have
E·A=C
A=E
+·C (14)
If the undetermined parameter of two camera heads is respectively:
A
l=[A
1l?A
2l?A
3l?A
4l?A
5l?A
6l?A
7l?A
8l?A
9l?A
10l?A
11l]
T
A
r=[A
1r?A
2r?A
3r?A
4r?A
5r?A
6r?A
7r?A
8r?A
9r?A
10r?A
11r]
T
Given n within two common field ranges of camera head (n 〉=6) individual known in the robot coordinate system reference point of coordinate, can calibrate all undetermined parameters of two camera heads respectively by (14).Timing signal can be got on the mechanical arm terminal needle point point as with reference to point, allows mechanical arm move to the individual different position of n (n 〉=6) respectively, with obtain n individual known in the robot coordinate system reference point of coordinate.
(3) coordinate Calculation of gauge point
Get by equation (12), (13):
(A
1-A
5u)X+(A
2-A
6u)Y+(A
3-A
7u)Z=u-A
4 (15)
(A
8-A
5v)X+(A
9-A
6v)Y+(A
10-A
7v)Z=v-A
11 (16)
If the coordinate to be asked of certain point is that (Z), it is respectively (u through the coordinate in the computer screen coordinate system after two camera head imagings for X, Y in the robot coordinate system
l, v
l) and (u
r, v
r), then have:
Can obtain the coordinate of gauge point in the robot coordinate system by (17):
(3) registration from the scanning image coordinate system to robot coordinate system
As shown in Figure 2, establishing the coordinate of four gauge points in the robot coordinate system is respectively
(X
1, Y
1, Z
1), (X
2, Y
2, Z
2), (X
3, Y
3, Z
3), (X
4, Y
4, Z
4), the coordinate in scanning image coordinate system is respectively
(u
1, v
1, w
1), (u
2, v
2, w
2), (u
3, v
3, w
3), (u
4, v
4, w
4), scanning image coordinate system is T to robot coordinate system's transformation matrix, then
Try to achieve
Can finish the registration of scanning image coordinate system accurately by the sign of above-mentioned mathematical way to the robot coordinate system.This method only needs two camera heads can determine the coordinate of gauge point in the robot coordinate system.Compare with contact measurement method, its setting accuracy height, and can be automatically the position of measurement markers point in real time; Compare with other non-contact method, it cheap, simple to operation, tool has an enormous advantage.
Medical robot vision register method of the present invention also can be used for Wicresoft thoracic cavity, abdominal operation, and its register method is identical with the auxiliary stereotactic neurosurgery of robot with gauge point.