[go: up one dir, main page]

WO2017018748A1 - Marqueur de poursuite optique, système de poursuite optique, et procédé de poursuite optique - Google Patents

Marqueur de poursuite optique, système de poursuite optique, et procédé de poursuite optique Download PDF

Info

Publication number
WO2017018748A1
WO2017018748A1 PCT/KR2016/008058 KR2016008058W WO2017018748A1 WO 2017018748 A1 WO2017018748 A1 WO 2017018748A1 KR 2016008058 W KR2016008058 W KR 2016008058W WO 2017018748 A1 WO2017018748 A1 WO 2017018748A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
marker
lens
feature points
reflectance
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2016/008058
Other languages
English (en)
Korean (ko)
Inventor
홍종규
이현기
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koh Young Technology Inc
Original Assignee
Koh Young Technology Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from KR1020150105187A external-priority patent/KR101627835B1/ko
Priority claimed from KR1020150105225A external-priority patent/KR101627828B1/ko
Priority claimed from KR1020150105258A external-priority patent/KR101627813B1/ko
Application filed by Koh Young Technology Inc filed Critical Koh Young Technology Inc
Publication of WO2017018748A1 publication Critical patent/WO2017018748A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B34/00—Computer-aided surgery; Manipulators or robots specially adapted for use in surgery
    • A61B34/20—Surgical navigation systems; Devices for tracking or guiding surgical instruments, e.g. for frameless stereotaxis
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B90/00—Instruments, implements or accessories specially adapted for surgery or diagnosis and not covered by any of the groups A61B1/00 - A61B50/00, e.g. for luxation treatment or for protecting wound edges
    • A61B90/90—Identification means for patients or instruments, e.g. tags

Definitions

  • the present invention relates to a marker for optical tracking, an optical tracking system and an optical tracking method.
  • the present invention also relates to a method of forming an image on an optical tracking marker.
  • An optical tracking system can be used as one method for tracking the object.
  • an optical tracking system may be used to track the location or coordinates and posture or orientation of the affected area or surgical robot or surgical tool.
  • the position of the object may be defined as spatial coordinates such as, for example, coordinates on the X, Y, and Z axes in the rectangular coordinate system.
  • the posture of the target may be defined as a roll, pitch, yaw. For accurate tracking of the object, it is important to know exactly the position and posture corresponding to the six degrees of freedom of the object, as described above.
  • a reference object called a marker is attached to an object, and then the position and attitude of the object can be measured by tracking the marker.
  • a structure having three or more markers attached thereto may be attached to the object to measure the position and posture of the object.
  • the method of using three or more markers has a problem that miniaturization of the tracking reference body is difficult.
  • the size and weight thereof may interfere with the use of the user's tool or the user may feel uncomfortable.
  • the problem to be solved by the present invention is to provide an optical tracking marker that can be reduced in weight or downsized.
  • the problem to be solved by the present invention is to provide an optical tracking system and method that can measure both the position and the posture of the object using a lightweight or compact marker.
  • the present invention provides an optical tracking system and tracking method for tracking the position and posture of an object to which at least one marker is attached.
  • Another object of the present invention is to provide a method for forming an image having at least two feature points on a marker for an optical tracking system having a three-dimensional shape.
  • the marker for measuring position and posture may include an image having a random shape formed so that a plurality of feature points can be arbitrarily selected, and a lens for enlarging and transmitting the image.
  • the image may be located on a surface on which the focal point of the lens is formed.
  • the lens may be coated such that only light of a specific wavelength range may be transmitted.
  • the plurality of feature points in the image may be formed of a light emitting material.
  • the image may be formed of two or more materials having different reflectances for light incident to the marker, and the plurality of feature points in the image may reflect a difference in reflectances of the two or more materials. It can be formed using.
  • the image may be formed of two or more materials having different transmittances to light incident on the marker, and the plurality of feature points in the image may indicate differences in transmittances of the two or more materials. It can be formed using.
  • the random shape may be unique for each marker.
  • the surface where the focal point of the lens is formed may be an outer surface of the surface reflected from the lens after light is incident on the lens.
  • the surface where the focal point of the lens is formed may be spaced apart from the lens, and the image may be spaced apart from a material having a refractive index different from that of the lens.
  • the image may be formed on an outer portion of a surface where light is reflected after the light is incident on the lens and passes through the material having the different refractive index.
  • the surface on which the focal point of the lens is formed may be formed inside the lens.
  • light may be irradiated onto the image by including a light source that is brighter than the inside of the marker.
  • the image may be a predetermined shape instead of a random shape.
  • the image may be formed by printing an image material.
  • the image may be formed by lithography using an image material.
  • An optical tracking system includes a first image having a random shape and a first lens for enlarging and transmitting the first image having a random shape formed so that a plurality of feature points can be arbitrarily selected.
  • an imaging unit including one or more imaging elements for forming the first image into a second image at a focal length of the second lens and the second lens, and optionally selecting a plurality of feature points from the first image. The object to which the marker is attached can be tracked.
  • the first image may be positioned on a surface on which the focal point of the first lens is formed.
  • the optical tracking system may determine a posture based on first information related to the first image and second information related to the second image, and the first information is included in the first image.
  • the coordinates may be coordinates of two or more feature points among the plurality of feature points, and the second information may be detected in the second image as coordinates corresponding to the two or more feature points.
  • the first image may be formed of two or more materials having different reflectances to light, and the plurality of feature points included in the first image may indicate a difference in reflectances of the two or more materials. It can be formed using.
  • the first image may be formed of two or more materials having different transmittances to light, and the plurality of feature points included in the first image may indicate a difference between transmittances of the two or more materials. It can be formed using.
  • the random shape of the first image may be unique for each marker.
  • the first image may be a predetermined shape instead of the random shape.
  • the optical tracking method comprises the steps of: imaging the first image of a random shape included in a marker that is extended and transmitted through the first lens into a second image at a focal length of the second lens; And determining a posture of the marker based on the first information related to the first image and the second information related to the second image, wherein the randomly shaped first image has a plurality of feature points selected arbitrarily. It may be formed to be able to be, and to track a target to which the marker is attached by selecting a plurality of arbitrary feature points from the first image.
  • the determining of the pose of the marker based on the first information related to the first image and the second information related to the second image may include determining coordinates of two or more feature points from the second image. Detecting as second information and detecting coordinates of a feature point corresponding to two or more feature points detected from the second image as the first information among the plurality of feature points included in the first image stored in advance; And determining the posture from a relational expression between the coordinates as the first information and the coordinates as the second information.
  • the method of forming an image on a marker for an optical tracking system may include preparing a marker including a lens and forming an image on the marker. Forming may include forming a portion of the image with a material having a first reflectance and forming a remainder of the image with a material having a second reflectance different from the first reflectance in the marker,
  • the image may be formed in a random shape such that a plurality of feature points may be arbitrarily selected from the difference between the first reflectance and the second reflectance, and the plurality of feature points may be arbitrarily detectable by the optical tracking system.
  • the forming of the image on the marker may be forming the image on a surface on which the focal point of the lens is formed.
  • a portion formed of a material having the first reflectance or the second reflectance may form the feature point.
  • the marker according to an embodiment of the present invention may be implemented in a small size.
  • the position and posture corresponding to six degrees of freedom of the object to which the marker is attached may be measured using at least one marker.
  • the trackable distance can be increased.
  • an image having at least two feature points may be simply formed on a small marker having a three-dimensional shape.
  • FIG. 1 is a view showing a surgical scene as an application of the optical tracking system according to an embodiment of the present invention.
  • FIG. 2 is a diagram showing an example in which a marker according to an embodiment of the present invention is attached to a surgical tool and used.
  • FIG. 3 is a block diagram of an optical tracking system including a marker according to an embodiment of the present invention.
  • FIG. 4 is a diagram illustrating a process of transmitting image information included in a marker to the outside according to an embodiment of the present invention.
  • FIG. 5 is a diagram for describing a case where a focus is formed according to characteristics of a ball lens when a marker according to an embodiment of the present invention is implemented using a ball lens.
  • FIG. 6 is a view for explaining the position of the surface on which the image is formed on the marker according to the focal position of the ball lens when implementing the marker according to an embodiment of the present invention.
  • FIG. 7 is a lens for a marker according to an embodiment of the present invention, which shows a lens combining two hemispherical lenses.
  • FIG. 8 is a lens for a marker according to an embodiment of the present invention, which shows a lens combining two identical hemispherical lenses.
  • FIG. 9 illustrates a drum lens as a lens for a marker according to an exemplary embodiment of the present invention.
  • FIG. 10 is a view illustrating a lens combining two spherical dome lenses as lenses for a marker according to an embodiment of the present invention.
  • FIG. 11 illustrates a lens for a marker according to an embodiment of the present invention, in which two spherical dome lenses having the same inner radius are combined.
  • FIG. 12 is a lens for a marker according to an embodiment of the present invention, which shows a lens combining two spherical dome lenses having the same outer radius.
  • FIG. 13 is a view illustrating a lens combining two spherical dome lenses having the same shape as a lens for a marker according to an embodiment of the present invention.
  • FIG. 14 is a view illustrating a lens combining two spherical dome lenses and one ball lens as a lens for a marker according to an embodiment of the present invention.
  • FIG. 15 is a lens for a marker according to an embodiment of the present invention, which shows two spherical dome lenses and one ball lens which are not spherical.
  • FIG. 16 is a lens for a marker according to an embodiment of the present invention, which illustrates a lens combining one ball lens and one optical medium having a concentric surface.
  • FIG. 17 is a lens for a marker according to an embodiment of the present invention, which illustrates a lens combining one ball lens and one spherical dome lens.
  • FIG. 18 is a lens for a marker according to an embodiment of the present invention, which illustrates a lens combining one ball lens and one spherical dome lens instead of the hemisphere.
  • FIG. 19 is a view showing a GRIN ball lens as a lens for a marker according to an embodiment of the present invention.
  • 20 is a diagram illustrating an image formed on one surface of a ball lens and feature points included in the image according to an embodiment of the present invention.
  • 21 is a diagram illustrating a case in which an image included in a marker has a predetermined shape according to an embodiment of the present invention.
  • FIG. 22 is a diagram illustrating a marker including a light source therein according to one embodiment of the present invention.
  • FIG. 23 is a diagram illustrating a marker including a light source therein according to one embodiment of the present invention.
  • 24 is a view illustrating a positional relationship between a lens and an imaging device in an imaging unit in an optical tracking system according to an exemplary embodiment of the present invention.
  • 25 is a diagram for describing a process of detecting a posture of a marker, according to an embodiment of the present invention.
  • FIG. 26 is a diagram exemplarily illustrating a change in a feature point in an image of a marker formed in an image forming unit as a marker moves in an optical tracking system according to an exemplary embodiment of the present invention.
  • FIG. 27 is a block diagram of an optical tracking system in which an imaging unit includes two imaging devices in order to measure the position of a marker in the optical tracking system according to an exemplary embodiment of the present invention.
  • FIG. 28 is a flowchart illustrating a method of determining a pose of a marker in an optical tracking system according to an embodiment of the present invention.
  • 29 is a flowchart illustrating a method of determining a posture of a marker from image information included in the marker in the optical tracking system according to an embodiment of the present invention.
  • FIG. 30 is a flowchart illustrating a method of determining the position of a marker in an optical tracking system according to an embodiment of the present invention.
  • FIG. 31 is a view illustrating a method of forming an image on a marker for an optical tracking system according to an embodiment of the present invention.
  • the image is formed on the marker by a spraying technique.
  • 32 is a flowchart illustrating a method of forming an image on a marker for an optical tracking system according to an embodiment of the present invention.
  • FIG. 33 is a diagram illustrating a method of forming an image on a marker for an optical tracking system according to an embodiment of the present invention, and illustrating an image on a marker by a printing technique.
  • FIG. 34 is a view illustrating a method of forming an image on a marker for an optical tracking system according to an embodiment of the present invention and forming an image on the marker by a technique of injecting a substance.
  • FIG. 35 is a view illustrating a method of forming an image on a marker for an optical tracking system according to an embodiment of the present invention.
  • the image is formed on the marker by a stencil technique.
  • FIG. 36 is a view illustrating a method of forming an image on a marker for an optical tracking system according to an embodiment of the present invention, wherein the image is formed on the marker by a stamping technique.
  • FIG. 37 is a view illustrating a method of forming an image on a marker for an optical tracking system according to an embodiment of the present invention, and implementing the marker using a 3D printer.
  • FIG. 38 illustrates a method of forming an image on a marker for an optical tracking system according to an embodiment of the present invention, and illustrates a method of forming an image on a marker by a lithography technique.
  • FIG. 39 is a view illustrating a method of forming an image on a marker for an optical tracking system according to an embodiment of the present invention, and a method of forming an image on the marker by a lithography technique.
  • FIG. 40 is a view illustrating a method of forming an image on a marker for an optical tracking system according to an embodiment of the present invention, and a method of forming an image on the marker by a lithography technique.
  • the markers 110 and 130 are attached to an object such as an affected part or a surgical tool, and then the markers 110 and 130 of the markers 110 and 130 are based on the information about the markers 110 and 130 obtained through the imaging unit 150.
  • the object to which the markers 110 and 130 are attached can be tracked.
  • a structure having three or more markers attached thereto may be attached to the object.
  • all six degrees of freedom of the object to which the marker is attached may be determined by only attaching one marker.
  • the marker 210 according to an embodiment of the present invention is attached to the surgical tool 230 and used.
  • the marker may be attached or detached to the object to be tracked.
  • a removable method may be convenient.
  • the detaching process may be simple.
  • the time and effort required to disinfect the markers can be reduced.
  • an optical tracking system that can use a small number of markers as in the present invention can be conveniently used.
  • the optical tracking system of the present invention briefly described with reference to FIGS. 1 and 2 will be described in more detail.
  • the optical tracking system 300 may include a marker 310, an image forming unit 330, a light source 350, and a processor 370.
  • the marker 310 may include an image 312 and a lens 314 for enlarging and transmitting the image 312.
  • the imaging unit 330 may include an imaging device 334 and a lens 332 capable of imaging an image transmitted from the marker 310.
  • the imaging unit 330 may include two or more imaging devices 334. Alternatively, two or more imaging units 330 may be included in the optical tracking system 300.
  • the image 312 transmitted from the marker 310 may pass through the lens 332 and may be formed into another image in the imaging device 334.
  • the light source 350 may be arranged to irradiate light toward the marker 310 to help the image 312 included in the marker 310 form an image in the image forming unit 330.
  • the light source 350 may be disposed outside the marker 310, and in this case, the marker 310 may operate as a passive marker. According to another embodiment, the light source 350 may be disposed inside the marker 310, in which case the marker 310 may operate as an active marker.
  • the processor 370 is hardware or software capable of calculating the position and posture of the marker 310 by receiving image information of the marker 310 formed by the imaging unit 330.
  • the processor 370 may be a CPU (central processing unit).
  • the processor 370 may be used independently of the optical tracking system 300 or installed in the imaging unit 330.
  • the processor 370 may distribute functions for calculating the position and attitude of the marker 310 to various components such as the image forming unit 330 in order to reduce the load on the calculation amount.
  • the processor 370 may be located at a different place far from where the optical tracking system 300 is installed, and may exchange data with the optical tracking system 300 through a wired or wireless network. . As such, when the functions of the processor 370 are distributed, the burden on the amount of computation or the speed of the optical tracking system 300 itself may be reduced. In this case, the high speed processor 370 may not be required.
  • the marker 310 is an object to be measured position and posture through the optical tracking system 300. By measuring the position and posture of the marker 310, the position and posture of the object to which the marker 310 is attached may be measured.
  • the marker 310 to be used in the present invention will be described in more detail.
  • the marker 310 may operate in a passive manner or an active manner. Either way, by causing the light emitted from the light source 350 to be reflected on the image 312 included in the marker 310, the image 312 information may be transmitted to the outside of the marker 310 via the lens 314. . By allowing the light emitted from the light source 350 to be reflected on the image 312 included in the marker 310, the discriminating power of the image 312 of the marker 310 formed in the image forming unit 330 may be increased. According to another embodiment, the light irradiated to the image 312 is transmitted through the image 312, so that the image 312 information may be transmitted to the outside via the lens 314.
  • image 312 may be formed of a material having a high or low reflectivity or a material having a high or low transmittance for light emitted to image 312.
  • the reflectance may mean the ratio of the energy of the reflected light and the energy of the incident light
  • the transmittance may mean the ratio of the energy of the transmitted light and the energy of the reflected light. The reason for distinguishing the reflectance from the transmittance is to consider the case where the energy of light is absorbed in the image.
  • the marker 310 may include a lens 314 that enlarges the image 312 and transmits the image to the outside.
  • the type of the lens 314 is not particularly limited, and any type of lens capable of magnifying and transferring the image 312 included in the marker 310 may be used.
  • the image 312 may be positioned on the marker 310 where the image 312 may be identified outside the marker 310 through the lens 314.
  • the lens 314 and the image 312 may be disposed such that the image 312 may be transmitted to the outside of the marker 310 in the form of parallel emission light. This is a condition that can be combined with the optical system of the image forming unit 330 side of the optical tracking system 300 to implement an infinite optical system.
  • the imaging unit 330 may obtain an imaging image of the enlarged marker 310. Therefore, even if the position of the marker 310 is far from the image forming unit 330, it may be easy to obtain information on the image 312 included in the marker 310 from the image forming image.
  • the arrangement relationship between the image 312 and the lens 314 in the marker 310 will be described in more detail.
  • the ball lens 500 focuses the light incident on the ball lens 500 on the surface P 0 , inside P 2 , or outside P 1 of the ball lens 500. Can bear.
  • the position where the focal point of the lens 314 is formed may vary depending on the material or appearance of the lens 314.
  • the image 312 may be transmitted in the form of parallel output light through the lens 314. .
  • FIG. 6 illustrates a position of a surface on which an image 312 is to be formed according to a position at which the ball lens 500 is focused when the lens 314 is used as the ball lens 500 according to an exemplary embodiment.
  • the image 312 may be formed on the surface 510 of the ball lens 500.
  • the image 312 may be formed on the outer surface of the surface reflected from the lens 314 after light is incident on the lens 314.
  • the image 312 is a focal plane 530 spaced apart from the ball lens 500.
  • the focal plane 530 may form a concentric circle with the ball lens 500.
  • the surface on which the image 312 is formed and the spaced space on the lens 312 may be filled with a material having a refractive index different from that of the lens 312. Spaces may be filled with gas.
  • the image 312 may be formed on the inner surface 550 of the ball lens 500.
  • the inner surface 550 may be concentric with the ball lens 500.
  • embodiments of the marker 310 using various kinds of lenses may be considered based on the arrangement relationship between the lens 314 and the image 312.
  • the lens 314 may be implemented by combining two optical media.
  • the lens 314 may be implemented by combining two hemispherical lenses 510c and 530c.
  • the lens 314 may be implemented by combining a hemispherical lens 510c having a radius of R1 and a hemispherical lens 530c having a radius of R2.
  • the two hemispherical lenses 510c and 530c may be concentric with each other.
  • the lens 314 may be implemented by combining two identical hemispherical lenses 510c and 530c.
  • at least one of the two hemispherical lenses 510c and 530c may have a shape that forms a part of the ball lens instead of the lens of the hemispherical shape.
  • the two lenses to be combined may be located on concentric circles with each other.
  • the focus of light irradiated to the hemispherical lens 510c from the outside may be formed on the inside, the surface, or the outside of the hemispherical lens 530c, and the image 312 may be formed in any one of them.
  • image 312 may be formed at any location within hemispherical ball lens 530c.
  • the refractive indices of the two optical media to be combined may be the same or different from each other, and the focal position of the incident light may be determined according to the refractive indices.
  • the refractive index by changing the refractive index, the position where the image 312 is to be formed in the marker 310 can be adjusted, and also the recognition rate for the image 312 can be adjusted when the image 312 is imaged.
  • an optical adhesive may be used to couple between the first optical medium and the second optical medium, such as between hemispherical lenses 510c and 530c or lenses that form part of a ball lens.
  • an optical adhesive may be used to couple between the first optical medium and the second optical medium, such as between hemispherical lenses 510c and 530c or lenses that form part of a ball lens.
  • by placing another optical medium between the first optical medium and the second optical medium it is possible to combine between the optical media.
  • 9 illustrates an embodiment in which portions 510d and 530d of a ball lens and another optical medium 550d are combined to form a lens 314.
  • the portions 510d and 530d of the ball lenses have the same radius, that is, the same radius of curvature, and may be located on concentric circles with each other.
  • portions 510d and 530d of the ball lens and another optical medium 550d may be formed integrally.
  • the lens 314 may be a drum lens.
  • the drum lens can be made by machining the ball lens into a cylindrical shape, or by processing the optical medium to have two curved surfaces of the same radius of curvature and to have a thickness twice the radius of curvature.
  • the image 312 may be formed on a portion 530d of the other ball lens. Specifically, if light is incident on the portion 510d of the ball lens, the image 312 is inside, on the surface of, the portion 530d of the ball lens focused by the portion 510d of the ball lens and the optical medium 550d. Or it may be formed on at least one of the outside. At least one of the refractive indexes of the portions 510d and 530d of the ball lens and the optical medium 550d may be different or the same. By adjusting the refractive indices of the optical media, the position at which the image 312 will be formed in the marker 310 can be adjusted. Also, the recognition rate for the image 312 when the image 312 is imaged may be adjusted.
  • the optical medium 550d may further include a convex portion or groove for easily attaching the marker 310 to the object to be tracked.
  • the lens 314 of the marker 310 may be implemented by combining two spherical dome lenses.
  • FIG. 10 illustrates a lens 314 implemented by combining hemispherical dome lenses 510e and 530e among spherical dome lenses according to an embodiment of the present invention.
  • the hemispherical dome lens 510e may have a shape having an inner radius of R1 and an outer radius of R2
  • the hemispherical dome lens 530e may have a shape having an inner radius of R3 and an outer radius of R4.
  • the inner radii R1 and R3 of the two hemispherical dome lenses may be the same, or as in the embodiment shown in FIG.
  • the outer radii R2 and R4 may be the same.
  • the two hemispherical dome lenses 510e and 530e may have the same shape. These spherical dome lenses 510e and 530e may be located on concentric circles.
  • the two spherical dome lenses are not limited to hemispherical dome lenses but may be any dome lens that forms part of a sphere.
  • the image 312 may be formed on another hemispherical dome lens 530e. Specifically, if light is incident on the hemispherical dome lens 510e, the image 312 may be formed on at least one of the surface, inside or outside of the hemispherical dome lens 530e to which the hemispherical dome lens 510e is focused. . In this case, the refractive indices of the hemispherical dome lens 510e and the hemispherical dome lens 530e may be different or the same. By adjusting the refractive indices of these optical media, the position where the image 312 is to be formed in the marker 310 can be adjusted, and also the recognition rate for the image 312 when the image 312 is imaged can be adjusted.
  • the space between the two spherical dome lenses may be filled with a material having a refractive index different from at least one of the refractive indices of the two spherical dome lenses.
  • the material to be filled may be a gas or an optical resin.
  • it may have another optical medium between two spherical dome lenses.
  • FIG. 14 shows a lens 314 with a ball lens 550f between two hemispherical dome lenses 510f and 530f as two spherical dome lenses, as a lens for a marker according to an embodiment of the present invention.
  • the two hemispherical dome lenses 510f and 530f may have the same inner radius.
  • the hemispherical dome lenses 510f and 530f and the ball lens 550f may be located on concentric circles.
  • the dome lens to be coupled to the ball lens 550f may be any spherical dome lens that is not hemispherical.
  • FIG. 15 shows a lens for a marker according to an embodiment of the present invention, in which two spherical dome lenses 510f and 530f and one ball lens 550f are combined.
  • image 312 may be formed on another hemispherical dome lens 530f.
  • the image 312 is either of the surface, interior or exterior of the hemispherical dome lens 530f focused by the hemispherical dome lens 510f and the ball lens 550f. It may be formed in at least one. In this case, at least one of the refractive indices of the hemispherical dome lenses 510f and 530f and the ball lens 550f may be different or the same.
  • FIG. 16 illustrates a combination of one ball lens 510g and one optical medium 530g having a sphere surface 550g concentrically spaced apart from the ball lens 510g.
  • the lens 312 is shown.
  • the spaced space between the ball lens 510g and the optical medium 530g may be filled with a material having a refractive index different from that of at least one of the ball lens 510g or the optical medium 530g.
  • the material to be filled may be a gas or an optical resin.
  • the surface of the ball lens 510g may be in contact with the spherical surface 550g of the optical medium 530g without a space between the ball lens 510g and the optical medium 530g. have.
  • the image 312 may be formed on the optical medium 530g. Specifically, if light is incident on the ball lens 510g, the image 312 may be formed on at least one of the spherical surface 550g, the inside or the outside of the optical medium 530g to which the ball lens 510g is focused. . In this case, the refractive indexes of the ball lens 510g and the optical medium 530g may be different or the same.
  • the optical medium 530g may be filled with a material having a refractive index different from that of the ball lens 510g or the optical medium 530g in a space spaced between the ball lens 510g and the optical medium 530g.
  • the location at which the image 312 is formed can be adjusted.
  • the refractive index of the ball lens 510g by adjusting the refractive index of the ball lens 510g, the position where the image 312 is to be formed in the optical medium 530g may be adjusted. By adjusting the refractive index in this manner, not only the position where the image 312 is to be formed can be adjusted, but also the recognition rate for the image 312 when the image 312 is imaged can be adjusted.
  • the optical medium 530g may include convex portions 570g and 572g for coupling with the ball lens 510g.
  • the optical medium 530g may include convex portions or grooves that can easily attach to the object to be tracked to the marker 310.
  • the hemispherical dome lens 530h may have an inner radius R1 and an outer radius R2.
  • the radius of the ball lens 550h may be the inner radius R1 of the hemispherical dome lens 530h, and the ball lens 550h may contact the surface of the hemispherical dome lens 530h.
  • the ball lens 550h and the hemispherical dome lens 530h may be spaced apart. In this case, an optical medium having a refractive index different from at least one of the ball lens 550h or the hemispherical dome lens 530h may be included between the spaces.
  • the spherical dome lens to be combined with the ball lens 550h may be any spherical dome lens 530h that is not hemispherical.
  • Ball lens 550h and any spherical dome lens 530h may be located concentrically.
  • FIG. 18 is a lens for a marker according to an embodiment of the present invention, and shows a lens 314 implemented by combining one ball lens 550h and one spherical dome lens 530h that is not hemispherical.
  • the image 312 may be formed in the hemispherical dome lens 530h. Specifically, if light is incident on the ball lens 550h, the image 312 may be formed on at least one of the surface, inside or outside of the hemispherical dome lens 530h to which the ball lens 550h is focused. According to one embodiment, the surface of the hemispherical dome lens 530h may be a surface formed by the inner radius R1 or the outer radius R2.
  • the refractive indexes of the ball lens 550h and the hemispherical dome lens 530h may be the same or different. By adjusting the refractive indices of these optical media, the position at which the image 312 is to be formed in the marker 310 can be adjusted, and the recognition rate for the image 312 when the image 312 is imaged can be adjusted.
  • the GRIN ball lens may refer to a ball lens in which layers of different refractive indices are stacked 510i, 530i, 550i, and 570i.
  • FIG. 19 it is assumed that the GRIN ball lens is implemented with materials having four refractive indices, but the number of materials may vary depending on the lens.
  • each material forming the GRIN ball lens may have a different color.
  • the image 312 can be located on either the surface, inside or outside of the GRIN ball lens to which the GRIN ball lens is focused, as when using a ball lens.
  • the surface of the GRIN ball lens may be an outer surface of the surface reflected from the GRIN ball lens after light enters the GRIN ball lens.
  • the inside or outside of the GRIN ball lens to which the GRIN ball lens is focused may be concentric with the GRIN ball lens. Since the GRIN ball lens can make a spot size smaller than a general spherical lens, when the image 312 is formed, the resolution of the formed image can be increased.
  • the image 312 included in the marker 310 may provide information for measuring the position and pose of the marker 310.
  • the image 312 is a shape including a plurality of feature points, and the shape may be a random shape or a predetermined shape.
  • the image 312 in the present invention may be formed so that two or more feature points can be detected from the detected image when the image 312 is detected by the imaging unit 330. This is because information about at least two of the plurality of feature points included in the image 312 is required as the minimum information for measuring the position and the attitude corresponding to the six degrees of freedom of the marker 310.
  • the image 312 may have a random shape.
  • the feature points in the present invention may be represented by points on the image 312.
  • the feature points in the present invention may represent points 610, 612, 614, 616 that represent the characteristic regions, as shown in FIG. 20.
  • the feature points 610, 612, 614, 616 may be the field of view of the characteristic region.
  • the feature points 610, 612, 614, and 616 exemplarily shown in FIG. 20 may be formed of a material having a high reflectance with respect to light irradiated to the image 312 in order to increase discrimination on the image 312.
  • the feature points 610, 612, 614, and 616 may be formed of a material having a high transmittance for light emitted to the image 312.
  • the feature points 610, 612, 614, 616 may be formed of a light emitting material. In this case, the feature points 610, 612, 614, and 616 may be detected at the image forming unit 330 even in a dark environment or a condition in which there is no light source irradiated to the image 312.
  • the image 312 may be formed of two or more materials having different reflectances for light irradiated with the marker 310.
  • the feature points 610, 612, 614, and 616 in the image 312 may be formed using differences in reflectances of two or more materials.
  • the feature points 610, 612, 614, 616 are formed of one material having a high reflectance for light irradiated with the marker 310, and the rest of the image 312 has a high transmittance so that light is transmitted. The amount to be formed can be formed with one more material.
  • the feature points 610, 612, 614, and 616 are formed of one material having a higher transmittance with respect to the light irradiated with the marker 310 and having a larger amount of light transmitted therethrough, and the image 312.
  • the rest of can be formed of a material with high reflectance.
  • FIG. 21 illustrates a case where an image 312 included in the marker 310 has a predetermined shape according to an embodiment of the present invention.
  • the marker 310 of the present invention may have an image having a random shape, and a predetermined shape having a regular pattern or the like may be formed as in the image shown in FIG. 21.
  • the imaging unit 330 when the image 312 formed on the marker 310 is detected by the imaging unit 330, at least two feature points of the plurality of feature points included in the image 312 may be detected.
  • a plurality of markers may be used since the marker 310 should be attached to each object.
  • two or more markers may be attached to one object for the purpose of broadening the tracking range or angle. In this case, it is necessary to distinguish between a plurality of markers attached to the object.
  • different markers may be formed by differently forming images for each marker. If the markers are manufactured so that the image has a random shape, it may be possible to distinguish between the markers by using random characteristics of the image formed on each marker.
  • the information about the plurality of feature points may be coordinates of the feature points. Therefore, the surface on which the image 312 is formed may be shaped to minimize distortion of coordinates of feature points detected from the image formed when the image 312 is formed in the image forming unit 330.
  • the shape of the surface on which the image 312 is formed may be a spherical surface or a curved surface close to the spherical surface.
  • the light source 350 when the marker 310 is used as the active marker, the light source 350 may be included in the marker 310. Although the light source 350 is included in the marker 310, its role is not significantly different from the case where the light source 350 is located outside the marker 310. Accordingly, the above descriptions regarding the marker 310 may be equally applied even when the light source 350 is inside the marker 310.
  • FIG. 22 illustrates that the light emitted from the light source 350 passes through the image 312 included in the marker 310, so that the information of the plurality of feature points included in the image 312 may be changed into a lens. 314) is transmitted to the outside.
  • the plurality of feature points included in the image 312 may be formed of a material that transmits or reflects light emitted from the light source 350. This depends on whether the image of the feature point is bright or dark when the image 312 is imaged on the image forming unit 330 side. On the contrary, FIG.
  • the light irradiated from the light source 350 is reflected from the image 312 according to an embodiment of the present invention, so that information of a plurality of feature points included in the image 312 may be applied to the lens 314. It is shown to be transmitted to outside.
  • the plurality of feature points included in the image 312 may be formed of a material that transmits or reflects light emitted from the light source 350.
  • the wavelength of the light can be a wavelength in the visible region where the user can recognize a particular color or a wavelength in the infrared band where the user can not recognize the presence of light. It may be.
  • the wavelength of the infrared band may be used so as not to obstruct the view of the doctor or nurse in the surgical environment.
  • the surface of the lens may be coated such that only light of a specific wavelength range is transmitted to the lens 314 used for the marker 310 to reduce the influence on other external light.
  • the lens 314 may be coated on the surface of the lens 314 such that only light of the wavelength in the infrared band is transmitted.
  • the marker 310 may further include an additional optical filter such that only light of a specific wavelength can convey image 312 information included in the marker 310.
  • the image 312 included in the marker 310 is included in the image forming unit 330 after passing through the lens 314. It may be formed in the imaging device 334.
  • the imaging unit 330 may be implemented with a lens 332 and an imaging device 334.
  • the image 312 of the marker 310 may be imaged in the imaging device 334 via the lens 332.
  • the imaging unit 330 may be implemented using a camera, a camcorder, or the like as an image forming apparatus.
  • the imaging device 334 is a device for converting image information transmitted through light into an electrical signal, and may be implemented using a CMOS image sensor or a CCD.
  • the imaging unit 330 may obtain a clear image by detecting an image formed at a distance apart from the lens 332 by a focal length. Therefore, the imaging unit 330 may adjust or focus the distance between the imaging device 334 and the lens 332 such that the imaging device 334 is positioned at the focal length of the lens 332 when the image is detected. . However, if the imaging unit 330 repeats the focus adjustment every time the marker 310 moves to detect the image 312 included in the marker 310, the detection speed of the image 312 may be slowed down. In addition, in order to accurately detect the feature points of the image 312 included in the marker of very small size and to increase the recognition rate, it is necessary to form an image 312 in an enlarged form in the image forming unit 330.
  • the imaging device 334 may be fixed to the focal length of the lens 332. If the imaging device 334 is positioned at the infinite focus which is a focal point formed by the lens 314 of the marker 310 and the lens 332 of the imaging unit 330, the change in distance according to the movement of the marker 310 may occur. Regardless, the image 312 may be enlarged and imaged in the imaging device 334. As shown in FIG. 24, the -f c point, which is the focal length of the lens 332 in which the imaging device 334 is located, may be a position at which infinite focus is provided.
  • the image 312 in the marker 310 may be located on the surface where the focus of the lens 314 is formed.
  • the imaging unit 330 may image the image 312 included in the marker 310 without adjusting the focus even if the marker 310 moves, and also may include an image included in the small marker 310. 312) can be formed in an enlarged form. Therefore, the imaging unit 330 may accurately detect the image 312 included in the small size marker 310 and the plurality of feature points included therein at high speed.
  • the burden on the size of the image 312 included in the marker 310 can be reduced, it is possible to miniaturize the marker 310 attached to the object.
  • the processor 370 of the optical tracking system 300 may obtain information related to the image 312 included in the marker 310 and the image 312 by forming an image on the image forming unit 330.
  • the posture of the marker 310 may be determined based on the information related to the.
  • the information related to the image 312 may be coordinates (first coordinates) on the marker 310 of the plurality of feature points included in the image 312.
  • the information related to the imaged image may be coordinates (fourth coordinates) on the imaged image corresponding to the plurality of feature points included in the image 312.
  • the processor 370 may determine the posture of the marker 310 based on a relation between the first coordinate and the fourth coordinate.
  • the first coordinate may be obtained in advance through a calibration process of the marker 310, and then stored in a memory accessible by the processor 370.
  • the processor 370 determines the posture of the marker 310 based on the relational expression of the first coordinate and the fourth coordinate will be described.
  • a detailed description of the algorithm for determining the pose of the marker 310 is disclosed in Korean Patent Application No. 10-2014-0065168, which is incorporated by reference.
  • FIG. 25 is a diagram for describing a process of detecting a posture of the marker 310 based on a relational expression between first coordinates and fourth coordinates, according to an exemplary embodiment.
  • Point A represents the first coordinate
  • point B is the coordinate (second coordinate) for lens 314 of the first coordinate
  • point C is the coordinate (third coordinate) for lens 332 of the second coordinate.
  • Point D represents the fourth coordinate.
  • the point O is a reference point of the first to fourth coordinates and is a point indicating the center of the lens 332.
  • the transformation matrix for converting the first coordinate to the second coordinate is defined as C
  • the transformation matrix for converting the third coordinate to the fourth coordinate is defined as A
  • the matrix representing the attitude of the marker is R If defined as, the matrix R can be calculated through the following equations (1) to (3).
  • (( , ) Is the coordinate on the image detected by the imaging unit 330 corresponding to the center of the image 312, Is the distance that the imaging element 334 is separated from the lens 332, Is the width of the pixels in the image, Is the height of the pixels in the image
  • At least two of the plurality of feature points of the image 312 may be formed in the image forming unit 330. have. As the number of feature points detected on the formed image increases, an error between the calculated posture of the marker 310 and the actual posture of the marker 310 may be reduced.
  • the matrix R can also be calculated through the following equation (4).
  • the processor 370 may use a relationship between a feature point on the image 312 and the feature point formed in the image forming unit 330 corresponding to the feature point to determine the posture of the marker 310.
  • the pose of the marker 310 may be determined by detecting a change in the geometric relationship between the markers in a structure to which three or more markers are attached.
  • the pose of the marker may be determined using only one marker by determining the pose through an equation based on the information of the feature points of the image 312. Therefore, in the optical tracking system 300, even if only one marker is attached to the object, all posture calculations of the object can be performed, and thus the number of markers to be used can be reduced even if there are many tracking objects.
  • the marker 310 of the present invention may be conveniently used.
  • FIG. 26 exemplarily illustrates changes in feature points when the optical tracking system 300 according to an exemplary embodiment detects an image 312 included in the marker 310 according to the movement of the marker 310. Indicates. As shown in FIG.
  • the change in the information of the feature point obtained for each detection time may mean that the marker 310 is moving, and that only the information of the same feature point is detected may mean that the marker 310 is not moving.
  • some of the feature points detected at each view point may be the same, and only two or more of the feature points changed in this way may be determined to determine the posture of the marker 310 at each view point.
  • the optical tracking system 300 may not calculate the posture of the marker 310 based only on the same feature points detected while the marker 310 is moving. Accordingly, since the optical tracking system 300 does not need to keep track of the same object change as in the conventional optical tracking system, the marker 310 can be stably tracked even when a problem such as a part of the object is blocked. have.
  • the optical tracking system 300 may determine the position of the marker 310 using triangulation.
  • the imaging unit 330 may include two or more imaging devices or two or more imaging units 330. This is because in order to use the trigonometry, information related to the image of the marker 310 formed at different positions or the image 312 included in the marker 310 is required.
  • FIG. 27 is a block diagram of an optical tracking system 300 in which the imaging unit 330 includes two imaging devices 334 and 1234 according to an embodiment of the present invention.
  • the imaging elements 334 and 1234 may image the marker 310 or the image 312 included in the marker 310 at different positions. This information is passed to the processor 370, which can determine the location of the marker 310 through trigonometry based on information obtained from the transferred image.
  • the processor 370 may coordinate with the two imaging elements and the coordinates on the marker 310 of the plurality of feature points included in the image 312, similar to the method of determining the pose of the marker 310 described above.
  • the position of the marker 310 may be determined based on a relationship between coordinates of the plurality of feature points detected from the images formed at 334 and 1234. A detailed description thereof is disclosed in Korean Patent Application No. 10-2014-0065178, which is incorporated by reference.
  • the pose of the marker 310 may also be determined based on the images detected by the two imaging devices 334 and 1234.
  • the processor 370 detects coordinates of two or more arbitrary feature points corresponding to each other from the images formed by the two imaging devices 334 and 1234, and is included in the detected coordinates and the previously stored image 312.
  • the attitude of the marker 310 may be determined through a relationship with the coordinates of the plurality of feature points.
  • step S1310 The first image having a random shape included in the marker may be enlarged and transmitted through the first lens.
  • an image 312 having a random shape included in the marker 310 may be enlarged and transmitted through the lens 314.
  • the image 312 may be formed on the surface where the lens 314 is focused in the marker 310.
  • the image 312 may be formed inside or on the surface of the lens 314, or may be formed at a location remote from the lens 314, depending on where the lens 314 is to be in focus.
  • the optical tracking system 300 may further include a light source 350 for irradiating light to the image 312.
  • the light source 350 may be located inside or outside the marker 310.
  • the image 312 may include a plurality of feature points.
  • the plurality of feature points may be formed of a material that reflects or transmits light emitted to the image 312.
  • the image 312 may be formed of two or more materials having different reflectances for light irradiated onto the image 312.
  • the plurality of feature points included in the image 312 may be formed using differences in reflectances of two or more different materials.
  • the plurality of feature points may be formed of a material having a high reflectance to reflect light irradiated onto the image 312, or may be formed of a material having a low reflectance to transmit light emitted to the image 312.
  • the image 312 may have a predetermined shape instead of a random shape.
  • the first image may pass through the second lens and may be imaged as a second image at a position spaced apart from the focus of the second lens.
  • the image 312 may be imaged by the imaging device 334 at a position spaced apart from the focal point of the lens 332 after passing through the lens 332.
  • the imaging element 334 may be positioned at an infinite focal point formed by the lens 314 and the lens 332 to form an image 312 included in the marker 310.
  • the imaging unit 330 Since the imaging element 334 is positioned at the infinite focus formed by the lens 314 and the lens 332, the imaging unit 330 focuses whenever imaging the image 312 included in the moving marker 310. no need. Thus, regardless of the movement of the marker 310, the information contained in the image 312 can be obtained accurately and quickly. In addition, when the optical system is used, the imaging unit 330 may enlarge the image 312 to form an image. Therefore, even when the small marker 310 is used, it is easy to obtain information on the feature point. The image information formed by the imaging unit 330 may then be transferred to the processor 370.
  • the processor 370 may be configured based on the first information related to the first image and the second information related to the second image. Determine your posture. For example, referring to FIG. 3, the processor 370 may determine a posture based on first information related to the image 312 and second information related to the image formed by the image forming unit 330.
  • step S1351 the processor 370 may detect coordinates of two or more feature points from the second image as second information.
  • step S1352 the processor 370 may detect, as the first information, coordinates of the feature points corresponding to two or more feature points detected from the second image among the plurality of feature points included in the first image stored in advance.
  • the processor 370 may detect, as information related to the image 312, coordinates of the feature points corresponding to the coordinates of the feature points detected from the image formed among the coordinates of the plurality of feature points included in the image 312. have.
  • the processor 370 determines the first information associated with the first image and The posture may be determined based on the second information related to the second image. For example, the processor 370 may determine the marker 310 based on a relationship between the coordinates of two or more arbitrary feature points corresponding to each other extracted from the image 312 and the image formed by the image forming unit 330. Determine your posture.
  • a first image of a random shape included in a marker may be imaged at two different positions.
  • the imager elements 334 and 1234 may image the images 312 at different positions.
  • the image information imaged at each different position is transferred to the processor 370.
  • the processor 370 may determine the position of the object to which the marker is attached through trigonometry based on the two imaged images. According to an embodiment, trigonometry based on information about an image in which an image of the marker 310 itself is formed may be used instead of the image 312.
  • At least one marker 310 may be attached to the object in an exchangeable form.
  • two or three or more markers may be attached to the object.
  • a plurality of markers may be used.
  • the markers may be distinguished from each other by having a unique random shape image for each marker.
  • the image 312 may include a plurality of feature points, and the processor 370 may be configured to form an image 312 in the image forming unit 330. Any two or more feature points can be detected.
  • a method of forming such an image 312 on the marker 310 is described.
  • a randomly shaped image 312 may be formed on the marker 310 using a spraying technique.
  • the marker 310 may be the ball lens 1610 itself, in which case an image 312 may be formed on the surface of the ball lens 1610.
  • the image of the random shape on the surface of the ball lens 1610 312 may be formed. This is based on the granularity of the material, and the image 312 having a random shape may be formed by simply spraying the spray 1630 with a material having a high reflectance on the surface of the ball lens 1610. In this case, regions 1612, 1614, 1616, and 1618 on which particles with high reflectance are deposited may be characteristic points.
  • the ball lens 1610 is sprayed with a spray 1630 spraying on the surface of the ball lens 1610 material having a low reflectance for light incident to the ball lens 1610 and having a high property of transmitting the light.
  • a random shape image 312 may be formed on the surface.
  • regions 1612, 1614, 1616, and 1618 on which a material having a low reflectance (ie, a material having a high transmittance) are deposited may be characteristic points.
  • a material having a high reflectance for light incident on the ball lens 1610 is sprayed on the surface of the ball lens 1610 through a spray 1630, and after being dried and deposited, the material having a low reflectance By spraying through spray 1630, an image 312 of random shape may be formed.
  • the features 1616, 1614, 1616, and 1618 may be regions in which a material having high reflectance is deposited or regions in which a material having low reflectance is deposited.
  • the low reflectance material may be sprayed first with a spray 1630 and then the high reflectance material may be sprayed with a spray 1630.
  • the recognition rate of the feature points included in the image formed by the imaging unit 330 may be increased by using the difference in reflectance between these materials.
  • the size of the particles of material to be sprayed with the spray 1630 is small enough that feature points can be formed when sprayed on the marker 310, and proportionally according to the size of the marker 310. Can change.
  • larger markers 310 may be used for larger particles, and smaller markers 310 may be used for smaller particles.
  • the lens 314 may be any lens surface capable of magnifying and transferring the image 312 formed on the marker 310 to the outside.
  • a ball lens may be used as shown in the example of FIG. 31, and in particular, a marker 310 having an image 312 formed on a surface of the lens 314 may be implemented using a ball lens having a refractive index of 2. have.
  • a marker including a lens may be prepared.
  • a marker 310 including a lens 314 may be prepared.
  • the lens 314 itself may be the marker 310.
  • the marker 310 may further include a surface on which the image 312 is to be formed in addition to the lens 314.
  • an image may be formed on the prepared marker.
  • a portion of the image 312 may be formed of a material having a first reflectance in step S1750.
  • a region in which a part of the image 312 is formed may be a feature point, and conversely, a region in which a material having a first reflectance is not coated may be a feature point.
  • the first reflectance may be a material that mainly reflects the irradiated light due to its high reflectance with respect to the light irradiated onto the marker 310, or may be a material that mainly transmits the irradiated light with a low reflectance. .
  • an image 312 having a random shape having a plurality of feature points may be formed in the marker 310.
  • the image may be formed as a material having a second reflectance different from the first reflectance in the marker 310.
  • the remainder of 312 may be further formed.
  • the first reflectance is a reflectance for the purpose of reflecting light
  • the second reflectance may be a low reflectance for the purpose of transmitting light.
  • the first reflectance is a reflectance for the purpose of transmitting light
  • the second reflectance may be a high reflectance for the purpose of reflecting light.
  • the surface on which the image 312 is formed on the marker 310 may be a surface on which the lens 314 is focused.
  • the drying and / or deposition step may be further subjected to the material and formation method used.
  • the material and formation method used may be further subjected to the material and formation method used.
  • the image 312 is formed on the marker 310 by a printing technique.
  • a material having a first reflectance or a material having a second reflectance may be printed on the surface of the marker 310 such as a ball lens using an inkjet printer or the like. If the printing method is used as described above, an image having a random shape or a predetermined shape may be freely formed on the surface of the marker 310.
  • the image 312 is formed on the marker 310 by a technique of injecting a substance. After filling the syringe or the like with a material having a first reflectance or a material having a second reflectance, the materials 312 are displayed on the surface of the marker 310 by scanning the materials through the needle 1910 onto the surface of the marker 310. ) May be formed. If such a scanning method is used, a precise image representing a random shape or a predetermined shape may be formed on the surface of the marker 310. In addition, the scanning method may be a method suitable for forming an image on the surface of the marker 310 when the size of the marker 310 is small.
  • FIG. 35 illustrates a method of forming the image 312 on the marker 310.
  • the image 312 is formed on the marker 310 by a stencil technique.
  • Stencil frame 2010 having a random shape or a predetermined shape is prepared in advance so that it can be attached to the outline of the marker 310, and then sprayed on the surface of the marker 310 to spray 2030 or the like thereon.
  • a material having a first reflectance or a material having a second reflectance a desired image 312 can be formed on the surface of the marker 310.
  • the stencil technique may be in a manner suitable for forming the same image 312 continuously on the surface of the marker 310.
  • FIG. 36 illustrates a method of forming the image 312 on the marker 310.
  • the image 312 is formed on the marker 310 by a stamping technique.
  • a stamping technique By embedding a material having a first reflectance or a material having a second reflectance on the flexible stamp 2110 and stamping the material on the surface of the marker 310, a random shape or a predetermined shape is formed on the surface of the three-dimensional marker 310.
  • Image 312 may be formed. If the image 312 is formed on the surface of the marker 310 in such a stamping manner, the image 312 may be formed on the surface of the marker 310 in a large area at one time.
  • FIG. 37 illustrates a method of forming an image 312 on the marker 310, wherein the marker 310 itself including the image 312 and the lens 314 is integrally formed using the 3D printer 2210. Indicates. If the 3D printer 2210 is used, the shape of the marker 310, the shape of the image 312, and the like may be freely expressed. In addition, a material having a first reflectance or a material having a second reflectance may be easily formed on the marker 310. In addition, the image 312 may be formed inside the marker 310 or the lens 314 without any special assembly process.
  • 38 to 40 illustrate a method of forming an image 312 on the marker 310, and show an image of forming an image 312 on the marker 310 by lithography.
  • a material 2314 having a high reflectance or high transmittance may be first deposited on a surface 2312 on which an image 312 is to be formed. Then, as shown in FIG. 39, material 2314 may be removed at a location 2316 where the image 312 will not be formed. Only the process up to FIG. 39 may form an image 312 for tracking on the marker 310.
  • a material having a reflectance or transmittance different from that of the material 2314 at a location 2316 where the image 312 is not formed to increase the recognition rate of the image 312 2318 may be filled.
  • an image 312 having two or more feature points using the difference in reflectance or transmittance of the material 2314 and the material 2318 may be formed.
  • a very sophisticated image 312 can be formed on the surface of the marker 310.

Landscapes

  • Health & Medical Sciences (AREA)
  • Surgery (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Medical Informatics (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Molecular Biology (AREA)
  • Animal Behavior & Ethology (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Oral & Maxillofacial Surgery (AREA)
  • Pathology (AREA)
  • Robotics (AREA)
  • Length Measuring Devices By Optical Means (AREA)

Abstract

La présente invention concerne un marqueur comprenant une image formée de manière à avoir une forme aléatoire, de sorte qu'une pluralité de points caractéristiques puissent être sélectionnés arbitrairement, et une lentille pour agrandir et transmettre l'image, et concerne un système de poursuite optique et un procédé de poursuite pour suivre la position ou la posture du marqueur. L'emplacement et la posture, dans la présente invention, peuvent être déterminés sur la base de la pluralité de points caractéristiques qui ont été arbitrairement sélectionnés à partir de l'image ayant la forme aléatoire. La présente invention concerne en outre un procédé de formation, sur un marqueur, d'une image ayant une forme aléatoire dans laquelle une pluralité de points caractéristiques peuvent être arbitrairement sélectionnés.
PCT/KR2016/008058 2015-07-24 2016-07-22 Marqueur de poursuite optique, système de poursuite optique, et procédé de poursuite optique Ceased WO2017018748A1 (fr)

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
KR10-2015-0105258 2015-07-24
KR1020150105187A KR101627835B1 (ko) 2015-07-24 2015-07-24 옵티컬 트래킹 시스템 및 방법
KR1020150105225A KR101627828B1 (ko) 2015-07-24 2015-07-24 옵티컬 트래킹 시스템용 마커에 이미지를 형성하는 방법
KR10-2015-0105225 2015-07-24
KR1020150105258A KR101627813B1 (ko) 2015-07-24 2015-07-24 위치 및 자세 측정용 마커
KR10-2015-0105187 2015-07-24

Publications (1)

Publication Number Publication Date
WO2017018748A1 true WO2017018748A1 (fr) 2017-02-02

Family

ID=57884698

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2016/008058 Ceased WO2017018748A1 (fr) 2015-07-24 2016-07-22 Marqueur de poursuite optique, système de poursuite optique, et procédé de poursuite optique

Country Status (1)

Country Link
WO (1) WO2017018748A1 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113813046A (zh) * 2017-12-20 2021-12-21 株式会社高迎科技 光学跟踪系统及光学跟踪方法

Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070183041A1 (en) * 2006-02-09 2007-08-09 Northern Digital Inc. Retroreflective marker-tracking systems
KR20110118640A (ko) * 2008-12-31 2011-10-31 인튜어티브 서지컬 오퍼레이션즈 인코포레이티드 기기 트래킹을 위한 컨피규레이션 마커 디자인 및 탐지
KR20130080078A (ko) * 2012-01-04 2013-07-12 조창호 의료용 광학적 영상 취득 장치의 렌즈 장치
KR101406220B1 (ko) * 2013-04-30 2014-06-12 경북대학교 산학협력단 옵티컬 트랙킹 시스템 및 이를 이용한 트랙킹 방법
KR101532717B1 (ko) * 2013-09-24 2015-07-01 주식회사 고영테크놀러지 환자 트래킹 마커 및 이를 이용한 환자 트래킹 시스템
KR101627813B1 (ko) * 2015-07-24 2016-06-08 주식회사 고영테크놀러지 위치 및 자세 측정용 마커
KR101627835B1 (ko) * 2015-07-24 2016-06-08 주식회사 고영테크놀러지 옵티컬 트래킹 시스템 및 방법
KR101627828B1 (ko) * 2015-07-24 2016-06-08 주식회사 고영테크놀러지 옵티컬 트래킹 시스템용 마커에 이미지를 형성하는 방법

Patent Citations (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20070183041A1 (en) * 2006-02-09 2007-08-09 Northern Digital Inc. Retroreflective marker-tracking systems
KR20110118640A (ko) * 2008-12-31 2011-10-31 인튜어티브 서지컬 오퍼레이션즈 인코포레이티드 기기 트래킹을 위한 컨피규레이션 마커 디자인 및 탐지
KR20130080078A (ko) * 2012-01-04 2013-07-12 조창호 의료용 광학적 영상 취득 장치의 렌즈 장치
KR101406220B1 (ko) * 2013-04-30 2014-06-12 경북대학교 산학협력단 옵티컬 트랙킹 시스템 및 이를 이용한 트랙킹 방법
KR101532717B1 (ko) * 2013-09-24 2015-07-01 주식회사 고영테크놀러지 환자 트래킹 마커 및 이를 이용한 환자 트래킹 시스템
KR101627813B1 (ko) * 2015-07-24 2016-06-08 주식회사 고영테크놀러지 위치 및 자세 측정용 마커
KR101627835B1 (ko) * 2015-07-24 2016-06-08 주식회사 고영테크놀러지 옵티컬 트래킹 시스템 및 방법
KR101627828B1 (ko) * 2015-07-24 2016-06-08 주식회사 고영테크놀러지 옵티컬 트래킹 시스템용 마커에 이미지를 형성하는 방법

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113813046A (zh) * 2017-12-20 2021-12-21 株式会社高迎科技 光学跟踪系统及光学跟踪方法

Similar Documents

Publication Publication Date Title
WO2020116922A1 (fr) Ensemble de lentilles et dispositif électronique le comprenant
EP3335067A1 (fr) Système optique à objectif de courte longueur focale, et dispositif imageur incluant ce système optique
WO2017023107A1 (fr) Dispositif de détection de lumière et de télémétrie
WO2022215895A1 (fr) Dispositif électronique à porter sur soi comprenant une pluralité d'appareils photo
WO2020153703A1 (fr) Appareil de caméra et son procédé de mise au point automatique
WO2020141827A1 (fr) Système optique et module de caméra le comprenant
WO2022270734A1 (fr) Ensemble de lentilles et dispositif électronique le comprenant
WO2017018748A1 (fr) Marqueur de poursuite optique, système de poursuite optique, et procédé de poursuite optique
WO2021246758A1 (fr) Dispositif électronique et son procédé de fonctionnement
WO2023048466A1 (fr) Dispositif électronique et procédé d'affichage de contenu
WO2022265348A1 (fr) Ensemble lentille et dispositif électronique le comprenant
WO2022139424A1 (fr) Dispositif électronique et son procédé de suivi de l'œil d'un utilisateur et de fourniture d'un service de réalité augmentée
WO2025084705A1 (fr) Dispositif électronique pour acquérir des informations de vitesse de tangage à l'aide d'un module de capteur doppler détachable et d'une caméra, et procédé de commande associé
WO2023075067A1 (fr) Ensemble lentille et dispositif électronique le comprenant
WO2023068475A1 (fr) Ensemble lentille et dispositif électronique le comprenant
WO2023277298A1 (fr) Procédé de stabilisation d'image et dispositif électronique associé
WO2018221950A1 (fr) Dispositif de système de coordonnées en forme de sphère et procédé de calcul d'informations de position utilisant ce dernier
WO2023080420A1 (fr) Dispositif électronique habitronique comprenant une terre variable
WO2022080853A1 (fr) Dispositif portatif de mesure d'image tridimensionnelle, procédé de mesure d'image tridimensionnelle l'utilisant et système d'appariement d'images médicales
WO2023003368A1 (fr) Procédé permettant de fournir une fonction de mise au point automatique et dispositif électronique associé
WO2021132736A1 (fr) Dispositif électronique de vérification d'informations d'authentification et procédé de commande associé
WO2023282549A1 (fr) Dispositif électronique pour détecter une fissure de ligne de signal, et procédé de fonctionnement de dispositif électronique
US12028505B2 (en) Image sensing device and head-mounted display
WO2019098447A1 (fr) Système d'imagerie à échelles multiples avec miroir rotatif
WO2025105718A1 (fr) Capteur d'images, dispositif électronique comprenant un capteur d'images et son procédé de fonctionnement

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16830781

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16830781

Country of ref document: EP

Kind code of ref document: A1