EP1468246A2 - Procede de reconstruction de la geometrie de la surface interne d'une cavite - Google Patents
Procede de reconstruction de la geometrie de la surface interne d'une caviteInfo
- Publication number
- EP1468246A2 EP1468246A2 EP20020700001 EP02700001A EP1468246A2 EP 1468246 A2 EP1468246 A2 EP 1468246A2 EP 20020700001 EP20020700001 EP 20020700001 EP 02700001 A EP02700001 A EP 02700001A EP 1468246 A2 EP1468246 A2 EP 1468246A2
- Authority
- EP
- European Patent Office
- Prior art keywords
- cavity
- probe
- points
- contrasting
- contrasting points
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000000034 method Methods 0.000 title claims abstract description 60
- 239000000523 sample Substances 0.000 claims abstract description 49
- 230000003287 optical effect Effects 0.000 claims abstract description 29
- 210000000883 ear external Anatomy 0.000 claims abstract description 13
- 230000009466 transformation Effects 0.000 claims abstract 3
- 239000002245 particle Substances 0.000 claims description 8
- 238000003384 imaging method Methods 0.000 claims description 4
- 238000003780 insertion Methods 0.000 claims description 3
- 230000037431 insertion Effects 0.000 claims description 3
- 239000006260 foam Substances 0.000 claims description 2
- 239000007788 liquid Substances 0.000 claims description 2
- 239000000463 material Substances 0.000 claims description 2
- LFQSCWFLJHTTHZ-UHFFFAOYSA-N Ethanol Chemical compound CCO LFQSCWFLJHTTHZ-UHFFFAOYSA-N 0.000 claims 1
- 239000010408 film Substances 0.000 claims 1
- 239000000976 ink Substances 0.000 claims 1
- 230000001788 irregular Effects 0.000 claims 1
- 238000002372 labelling Methods 0.000 claims 1
- 238000005507 spraying Methods 0.000 claims 1
- 239000010409 thin film Substances 0.000 claims 1
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 claims 1
- 238000004519 manufacturing process Methods 0.000 abstract description 4
- 210000000613 ear canal Anatomy 0.000 description 39
- 210000003454 tympanic membrane Anatomy 0.000 description 7
- 230000033001 locomotion Effects 0.000 description 4
- 230000005540 biological transmission Effects 0.000 description 3
- 238000002360 preparation method Methods 0.000 description 3
- 208000002193 Pain Diseases 0.000 description 2
- XUIMIQQOPSSXEZ-UHFFFAOYSA-N Silicon Chemical compound [Si] XUIMIQQOPSSXEZ-UHFFFAOYSA-N 0.000 description 2
- 210000004204 blood vessel Anatomy 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 2
- 238000004140 cleaning Methods 0.000 description 2
- 210000003027 ear inner Anatomy 0.000 description 2
- 239000003365 glass fiber Substances 0.000 description 2
- 210000004209 hair Anatomy 0.000 description 2
- 230000036407 pain Effects 0.000 description 2
- 229920001296 polysiloxane Polymers 0.000 description 2
- 238000011084 recovery Methods 0.000 description 2
- 229910052710 silicon Inorganic materials 0.000 description 2
- 239000010703 silicon Substances 0.000 description 2
- 102100023170 Nuclear receptor subfamily 1 group D member 1 Human genes 0.000 description 1
- 230000006978 adaptation Effects 0.000 description 1
- 238000007664 blowing Methods 0.000 description 1
- 235000019994 cava Nutrition 0.000 description 1
- 210000003477 cochlea Anatomy 0.000 description 1
- 239000003086 colorant Substances 0.000 description 1
- 230000006735 deficit Effects 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000001035 drying Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 239000013013 elastic material Substances 0.000 description 1
- 238000002347 injection Methods 0.000 description 1
- 239000007924 injection Substances 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000012876 topography Methods 0.000 description 1
- 238000002604 ultrasonography Methods 0.000 description 1
- 230000037303 wrinkles Effects 0.000 description 1
Definitions
- these elements need to be adapted to the geometry of the ear canal.
- This geometry is predefined by the physiognomy and is always different for each user.
- a known possibility for the customization of these elements consists in offering different cases of the elements for certain basic forms of the ear canal or in equipping the outer wall of the cases with an elastic material which permits a certain adaptation to different designs.
- This method is, however, only suitable for very small elements and offers neither an optimal seat nor optimal acoustic conditions.
- the pressure exerted by the elastic surface of the elements onto the ear canal moreover is found unpleasant and can cause even pains.
- three-dimensional imprints have commonly been taken, from which moulds could be formed for the production of elements of hearing devices with the
- the recording of the form of the human ear canal implies relatively high frequencies and it would be necessary that the surroundings of the ear must be freed from growth of hair. Furthermore, the deep inner portions of the ear canal may be covered by other portions of the ear canal and thus preventing the recording of those inner portions. Further problems exists with the exact transmission of the ultrasound either by the body or over the air, to bring about the necessity for separate transmission means (for example a gel) , which means on the one hand a great effort and on the other hand can show unpleasant side effects.
- a gel for example a gel
- the second method . the use of X rays, needs a very expensive equipment and is only conditionally suitable for the desired purpose.
- the use of a mechanical scanning device will fail if the cavity shows passages full of corners and isn't feasible if the cavity to be determined falls below a certain size as this is the case, for example for the ear canal .
- An object of the present invention is to provide a method for the fast and reliable reconstruction and saving of the geometry of a cavity.
- a further object of the present invention is to provide such a method for the fast and reliable reconstruction of at least the outer portion of the ear canal.
- a probe with an optical sensor will be introduced from the outside through the opening of a cavity to be determined, such as the human ear canal.
- the optical sensor is thereby producing video signals or video images, which will be transmitted to a computer device.
- the computer will then compute by means of known algorithms from the set of video images received by the optical sensor the positioning data of the inner wall of the cavity.
- the iterative factorization methods by Poelman and Kanade (Conrad Poelman and Takeo Kanade, " Paraperspective Factorization Method for Shape and Motion Recovery", Technical report CMU-93- 219, Carnegie Mellon University, Pittsburgh) and Han and Kanade (Mei Han and Takeo Kanade, "Perspective Factorization Methods for Euclidean Reconstruction", Technical report CMU-RI-TR-99-22, Carnegie Mellon University, Pittsburgh) will be used to calculate the three-dimensional coordinates of the surface of the cavity. These coordinates now may be directly used to produce a mould by means of numeric controlled tools with the exact shape of the inner wall of the cavity. As an advantage, the unpleasant injection of Silicon into the ear canal may be prevented as well as the use of an additional stopper to protect the eardrum.
- a further advantage of the present invention is the possibility of performing the measuring of the shape without having an direct and defined reference to the vicinity of the cavity itself, that is the catheter needs not to be calibrated in respect to the cavity and may be moved without guiding aids.
- contrasting points with a diameter of about 50 ⁇ m will be applied onto the surface of the cavity. These contrasting points enable an optimal recognition rate by the optical sensor and the algorithm used to determine the positioning data.
- the contrasting points may preferably be applied in form of ink droplets which may be sprayed onto the surface of the cavity.
- ink or fluorescent ink provides on one hand a good contrast in relation to the cavity wall itself for reliable optical detection and on the other hand is easy to handle, that is easy to be sprayed and afterwards removed.
- the contrasting points may be applied directly onto the surface of the cavity, which therefore only needs to be clean.
- the cleaning of the ear canal of example may be performed by a simple wash up of the ear canal.
- the contrasting points are represented by particles, preferably small particles which can be fluorescent.
- the contrasting points may be applied in advance onto the surface of a separate thin, elastically body, such as a balloon, which may then be introduced or positioned in to the cavity and pressed close to the surface of the cavity before the insertion of the catheter. This may be performed by applying an overpressure to the inside of this thin body or balloon or by sucking out the air between this thin body and the surface of the cavity.
- the contrasting points may thereby have already been applied onto the surface of the thin body, either onto the inside or outside of the surface, or may be sprayed or applied after the insertion and inflation of the thin body.
- the contrasting points are transferred by a film onto the surface of the cavity. This method allows the preparation of such films with specific arrangement of the contrasting points with respect of size, shape and distance.
- the contrasting points in form of particles may be applied to the surface of the cavity by means of a liquid coat or may be transferred by a foam containing such particles .
- the optical sensor is arranged as flexible or rigid probe.
- the use of a flexible probe allows the recognition of the surface of cavities with strongly crooked passages.
- the imaging device may either be arranged at the proximal end of the probe, with glass fibers or lenses for the transmission of the image, or directly at the distal end of the probe.
- the imaging device is preferably a CCD, CMOS or analog camera device.
- the probe diameter is about 2 mm or less, with a focal length of about 2 mm and a resolution of about 50 ⁇ m. These parameters allows the recognition of the exact shape of the cavity in a sufficient resolution.
- the probe will be inserted into the cavity by the outlet of the cavity, thereby performing a linear forward movement and preferably at the same time a rotational movement around its longitudinal axis thus allowing to cover the entire surface of the cavity, at least in the area to be determined.
- the video signals will be preferably transmitted to a computer device, which will perform algorithms to transform those video signals into three-dimensional coordinates of the surface of the cavity.
- the video signals from a optical device with telecentric projection are directly treated by using a factorization method, preferably the factorization methods by Poelman and Kanade (Conrad Poelman and Takeo Kanade, "A Paraperspective Factorization Method for Shape and Motion Recovery", Technical report CMU-93-219, Carnegie Mellon University, Pittsburgh) and Han and Kanade (Mei Han and Takeo Kanade, "Perspective Factorization Methods for Euclidean Reconstruction", Technical report CMU-RI-TR-99- 22, Carnegie Mellon University, Pittsburgh) to calculate the three-dimensional coordinates of the surface of the cavity, especially the coordinates of the contrasting points of the surface of the cavity.
- a nonlinear optimization method may be used to calculate the three-dimensional coordinates of the surface of the cavity, especially the coordinates of the contrasting points of the surface of the cavity
- any of the above mentioned reconstruction methods may be applied to subsets of the data and the reconstructed three-dimensional coordinates of these subsets can be combined using methods of 3D geometry to give a 3D reconstruction of all of the cavity surface. Further a progressive reconstructions may take place, by using the preceding subset of data as an aid for the reconstruction of a succeeding subset of data.
- the basis of the above reconstruction algorithm lies in the feature recognition, i.e. the identification and location of point features in each video image generated by the probe.
- feature recognition i.e. the identification and location of point features in each video image generated by the probe.
- natural features such as surface colors, blood vessels, surface profile features, e.g. wrinkles, or features attached to the surface, e.g. hairs, may be sufficient for the algorithms as described above.
- the present method is not only suited to be used in the medical field, such as the reconstruction of the ear canal for the fabrication of hearing devices or hearing aids or the three-dimensional reconstruction of shapes from images acquired by an optical sensor such as en endoscope, but also for the reconstruction of underground caves, internal spaces within machinery or voids within collapsed structures .
- Fig. 1 is a cross sectional view of the human ear
- Fig. 2 is a schematic view of the ear canal with contrasting points applied onto the surface
- Fig. 3 is a detailed view of the position of several contrasting adjacent points
- Fig. 4 is a schematic view of the ear canal with inserted probe
- Fig. 5 is a flexible probe
- Fig. 6 is the schematic representation of the calculated coordinates of the ear canal according Figures 2 and 4;
- Fig. 7 is a cross sectional view of the human ear with a balloon inserted in the cavity;
- Fig. 8 a schematic sectional view of a probe with a rotating mirror;
- Fig. 9 schematic a probe with an optical device with telecentric projection
- FIG. 10 schematic view of a probe with the optical sensor at its distal
- FIG. 11 schematic view of a probe with the optical sensor at its proximal end.
- Fig. 1 shows the cross sectional view of a human ear.
- the outer ear 1 is separated by the eardrum 2 from the inner ear, in which the ossicles 3 are located.
- the ossicles 3 are transmitting vibrations of the eardrum, caused by the sound leaded through the outer ear to the eardrum, to the inner ear and finally to the cochlea 4.
- a hearing aid or a hearing element By inserting a hearing aid or a hearing element into the opening part from the auricle to the outer ear canal, a reduced hearing ability may be artificially supported and improved.
- the hearing aid element which has to be inserted and must at least remain temporarily in the outer ear canal, has to fit properly in the ear canal as to provide an optimum support by the hearing aid, i.e. the outer shape of this element should be a exact copy of the shape of this part of the ear canal. Deviations of this exact shape will cause on one hand impairments of the functionality of the hearing aids, which leads to a permanent need of adjustment of the hearing aid, and on the other hand a pressure will be forced onto the skin, which is unpleasant and can cause pain.
- Figure 2 shows again the sectional view according Figure 1, but with contrasting points 6 directly applied onto the inner skin of the outer ear canal 1.
- the arrangement of such contrasting points 6 is shown enlarged in Figure 3.
- the diameter d of the contrasting points 6 is preferably about 50 ⁇ m and the distance between the contrasting points is between 100 ⁇ m and 200 ⁇ m.
- Those contrasting points 6 will later represent the nodes of the coordinates of the topography of the outer ear canal.
- the contrasting points 6 will preferably be sprayed onto the wall of the ear canal 1, and will consist preferably of a fluorescent colored ink.
- Such ink points will on one hand build a good contrast with respect to the relatively pale and smooth skin of the outer ear. This provides very clear video signals which will result in very stable and exact results from the algorithms.
- FIG 4 now shows schematically the outer ear canal 1 with contrasting points 6 applied and with the already introduced probe 7.
- the probe 7, for instance a rigid probe 7, will be inserted longitudinally and moved linear in direction of the ear drum, whereby rotating around its axis, as indicated by the arrows.
- An optical device 8 such as a lens or a camera, is arranged at the end of the probe 7.
- the probe 7 is preferably a fiberscope, whereby a plurality of parallel glass fibers are arranged to form a bundle to transmit the collected picture onto an electronic recording device, such as an CCD-Array.
- the picture signals for instance received over the probe 7 by a CCD-Array, will be converted into video signals, which will further be processed by a computer using known algorithms to calculate positioning data or 3D-cooridnates of contrasting picture elements.
- Those contrasting picture elements may be represented by the artificial contrasting points 6 as described above, and thus the coordinates of those contrasting points 6 may be evaluated and stored by the computer.
- One major advantage by using such algorithms for the reconstruction of 3D coordinates lies in the fact, that the position of the optical device, i.e. the probe 7, relative to the object to be determined is not of importance and has not to be fixed or determined for the calculation.
- Figure 5 shows schematically the use of a flexible probe 7 ' instead of a rigid probe 7 to receive data even in the case of strongly crooked passages towards the ear drum.
- Figure ⁇ shows schematically the calculated contrasting points in a 3D-coordinate system, as they are stored by the computer system after finishing the algorithms.
- a computer controlled machinery may now be used to reproduce an exact 1:1 copy of the ear canal on the base of those data.
- This copy my be a mould for the production of the casing of an hearing device, such as an hearing aid, or the casing of the hearing device or hearing aid itself may be directly produced by such a machinery.
- Such a copy of the 3D-structure will advantageously not need any finishing work to fit exactly into the ear canal, as it is the case with the common used technique with silicon moulds.
- the use of the probe does not implement any additional preparation of the vicinity of the ear canal or the ear canal itself, besides the cleaning of the ear canal before inserting the probe. The whole process is a very quick and easy process and the data will be retrieved without any delay time.
- Figure 7 shows the use of a thin cover, such as a balloon 10, to be inserted into the ear canal, instead of applying the artificial contrasting points 6 directly onto the skin of the ear canal.
- the skin of the balloon 10 may then be pressed onto the skin of the outer ear canal 1 by blowing air into the inside of the balloon 10.
- the inside of the balloon may now be provided with the artificial points 6 as already described above, if they have not yet been applied in advance.
- the probe 7 now may be inserted into the ear canal 1 on the inside ' of the balloon 10 and the contrasting points 6 will be detected by the optical sensor of the probe 7.
- the application of the artificial contrasting points 6 may be avoided by the use of such a balloon, on the other hand, it may be more easy to apply the contrasting points onto the surface of such thin cover material instead of the application directly onto the skin of the ear canal. Furthermore, the use of such a balloon may cover natural features in the ear canal, which could cause problems or faults with the calculation of the coordinates of contrasting points.
- Figure 8 shows schematically the sectional view of the end of a probe 7 with a rotating mirror 11 at its end portion as optical device. Only this end portion is rotating whereby the probe itself may be moved only transversally.
- the mirror could be rotatable arranged inside a transparent end portion of the probe.
- Figure 9 shows schematically an optical sensor 8 at the end of the probe 7 with telecentric projection.
- Figures 10 and 11 are showing in a schematically manner probes 7 with the optical sensor 8 at the proximal end of the probe 7 (Fig. 10) and at the distal end of the probe 7 (Fig. 11) .
Landscapes
- Endoscopes (AREA)
Abstract
L'invention concerne un procédé de reconstruction de la structure tridimensionnelle de la surface d'une cavité (1) sous forme de données de localisation. Ce procédé consiste à introduire une sonde (7) dans la cavité en question à l'aide d'un capteur optique (8). Cette sonde (7) est introduite depuis l'extérieur de l'entrée de la cavité (1). Les signaux vidéo ainsi produits sont transformés, au moyen d'un calculateur, en données de localisation de la surface de la cavité (1). Ce procédé est particulièrement approprié pour reconstruire le conduit auditif externe. On peut en outre utiliser ces données pour agir sur un dispositif de production et fabriquer les coquilles de dispositifs auditifs, tels que les appareils auditifs. De préférence, les points de contraste sont appliqués sur la surface de la cavité avant d'introduire la sonde. La transformation des signaux vidéo en données de localisation est préférablement réalisée par des méthodes itératives d'algorithmes de factorisation.
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/CH2002/000030 WO2002021894A2 (fr) | 2002-01-21 | 2002-01-21 | Procede de reconstruction de la geometrie de la surface interne d'une cavite |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| EP1468246A2 true EP1468246A2 (fr) | 2004-10-20 |
Family
ID=32913645
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP20020700001 Withdrawn EP1468246A2 (fr) | 2002-01-21 | 2002-01-21 | Procede de reconstruction de la geometrie de la surface interne d'une cavite |
Country Status (1)
| Country | Link |
|---|---|
| EP (1) | EP1468246A2 (fr) |
-
2002
- 2002-01-21 EP EP20020700001 patent/EP1468246A2/fr not_active Withdrawn
Non-Patent Citations (1)
| Title |
|---|
| See references of WO0221894A3 * |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6751494B2 (en) | Method for the reconstruction of the geometry of the inner surface of a cavity | |
| EP2568870B1 (fr) | Balayage de cavités à accessibilité réduite | |
| TW468355B (en) | One-size-fits-all uni-ear hearing instrument | |
| ES2327212T3 (es) | Procedimiento y aparato para un escaneado optico tridimensional de superficies interiores. | |
| ES2378060T3 (es) | Procedimiento para modelar piezas auriculares personalizadas | |
| EP1368986B1 (fr) | Procede de moulage de pieces auriculaires personnalisees | |
| US7625335B2 (en) | Method and apparatus for three-dimensional optical scanning of interior surfaces | |
| US8135453B2 (en) | Method and apparatus for ear canal surface modeling using optical coherence tomography imaging | |
| US7164775B2 (en) | In the ear hearing aid utilizing annular ring acoustic seals | |
| US20040158157A1 (en) | Method and apparatus for locating foreign objects in the ear canal | |
| JP2004534435A (ja) | 補聴器ハウジングのコンピュータ支援設計システム | |
| CN108476352A (zh) | 定制耳塞扫描和制造 | |
| JP2006523124A (ja) | 装置及び装置内でルーメンの3次元幾何形状及び寸法を決定する方法、オブジェクトの少なくとも一部分の3次元デジタル表示を得るための方法、及び、空間内の2つ以上の点の相対位置を得るための方法 | |
| US7480387B2 (en) | In the ear hearing aid utilizing annular acoustic seals | |
| WO2018152066A1 (fr) | Modélisation de canal auditif à l'aide d'une projection de motif | |
| US8840558B2 (en) | Method and apparatus for mathematically characterizing ear canal geometry | |
| EP1468246A2 (fr) | Procede de reconstruction de la geometrie de la surface interne d'une cavite | |
| JP2019523063A (ja) | 撮像装置 | |
| US20250098982A1 (en) | Method and apparatus for three-dimensional measurements of the outer ear shape |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| 17P | Request for examination filed |
Effective date: 20040708 |
|
| AK | Designated contracting states |
Kind code of ref document: A2 Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE TR |
|
| AX | Request for extension of the european patent |
Extension state: AL LT LV MK RO SI |
|
| 17Q | First examination report despatched |
Effective date: 20080912 |
|
| RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: SONOVA AG |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
| 18D | Application deemed to be withdrawn |
Effective date: 20150924 |