WO2002031579A1 - Procede et dispositif pour faire passer des informations optiques sur la retine humaine - Google Patents
Procede et dispositif pour faire passer des informations optiques sur la retine humaine Download PDFInfo
- Publication number
- WO2002031579A1 WO2002031579A1 PCT/EP2000/009842 EP0009842W WO0231579A1 WO 2002031579 A1 WO2002031579 A1 WO 2002031579A1 EP 0009842 W EP0009842 W EP 0009842W WO 0231579 A1 WO0231579 A1 WO 0231579A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- scanning
- projection
- retina
- image
- movement pattern
- Prior art date
Links
- 210000001525 retina Anatomy 0.000 title claims abstract description 56
- 238000000034 method Methods 0.000 title claims abstract description 47
- 230000003287 optical effect Effects 0.000 title claims abstract description 39
- 230000033001 locomotion Effects 0.000 claims abstract description 46
- 230000008569 process Effects 0.000 claims abstract description 22
- 238000012545 processing Methods 0.000 claims description 20
- 230000011514 reflex Effects 0.000 claims description 9
- 230000002207 retinal effect Effects 0.000 claims description 9
- 230000036961 partial effect Effects 0.000 claims description 5
- 238000001454 recorded image Methods 0.000 claims description 3
- 238000011144 upstream manufacturing Methods 0.000 claims 1
- 239000011521 glass Substances 0.000 description 52
- 238000001514 detection method Methods 0.000 description 24
- 230000002452 interceptive effect Effects 0.000 description 17
- 230000000875 corresponding effect Effects 0.000 description 14
- 238000000576 coating method Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 8
- 210000000873 fovea centralis Anatomy 0.000 description 8
- 230000004048 modification Effects 0.000 description 8
- 238000012986 modification Methods 0.000 description 8
- 239000011248 coating agent Substances 0.000 description 7
- 230000000007 visual effect Effects 0.000 description 7
- 238000013461 design Methods 0.000 description 6
- 230000008901 benefit Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 230000006872 improvement Effects 0.000 description 4
- 210000000056 organ Anatomy 0.000 description 4
- 230000008447 perception Effects 0.000 description 3
- 238000001228 spectrum Methods 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 239000003086 colorant Substances 0.000 description 2
- 210000004087 cornea Anatomy 0.000 description 2
- 238000012937 correction Methods 0.000 description 2
- 230000023077 detection of light stimulus Effects 0.000 description 2
- 238000011161 development Methods 0.000 description 2
- 230000018109 developmental process Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000006870 function Effects 0.000 description 2
- 210000003128 head Anatomy 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 230000035479 physiological effects, processes and functions Effects 0.000 description 2
- 230000004800 psychological effect Effects 0.000 description 2
- 230000005855 radiation Effects 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 230000002829 reductive effect Effects 0.000 description 2
- 238000000926 separation method Methods 0.000 description 2
- 230000003595 spectral effect Effects 0.000 description 2
- 239000000725 suspension Substances 0.000 description 2
- 230000002123 temporal effect Effects 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 239000013598 vector Substances 0.000 description 2
- 206010034960 Photophobia Diseases 0.000 description 1
- 238000010521 absorption reaction Methods 0.000 description 1
- 239000006117 anti-reflective coating Substances 0.000 description 1
- 238000005282 brightening Methods 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000001427 coherent effect Effects 0.000 description 1
- 230000004456 color vision Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000001276 controlling effect Effects 0.000 description 1
- 230000002596 correlated effect Effects 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 230000002542 deteriorative effect Effects 0.000 description 1
- 238000006073 displacement reaction Methods 0.000 description 1
- 239000000428 dust Substances 0.000 description 1
- 230000004438 eyesight Effects 0.000 description 1
- 230000008921 facial expression Effects 0.000 description 1
- 239000003337 fertilizer Substances 0.000 description 1
- 230000008676 import Effects 0.000 description 1
- 208000013469 light sensitivity Diseases 0.000 description 1
- 230000000670 limiting effect Effects 0.000 description 1
- 230000007257 malfunction Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 230000007246 mechanism Effects 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 230000004962 physiological condition Effects 0.000 description 1
- 230000008092 positive effect Effects 0.000 description 1
- 238000002360 preparation method Methods 0.000 description 1
- 230000001681 protective effect Effects 0.000 description 1
- 210000001747 pupil Anatomy 0.000 description 1
- 230000004256 retinal image Effects 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 210000004243 sweat Anatomy 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 230000009897 systematic effect Effects 0.000 description 1
- 239000013585 weight reducing agent Substances 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/113—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for determining or recording eye movement
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/01—Head-up displays
- G02B27/017—Head mounted
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B3/00—Apparatus for testing the eyes; Instruments for examining the eyes
- A61B3/10—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
- A61B3/12—Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for looking at the eye fundus, e.g. ophthalmoscopes
Definitions
- the invention relates to a method for transferring optical information to the human retina using a preferably serial scanning system that records an image incident on the retina and an information projection system according to the preamble of patent claim 1.
- the invention also relates to a device for performing a method.
- the known procedure is that the projection process only starts when the scanning process for the entire retinal reflex to be scanned has been completed.
- an "improved" pixel can only be projected into the eye when the project on the next pass, it has exactly reached the point on the retina that was previously recorded.
- the known method does not always succeed in providing the information, eg. B. an image enhancement, so that it is optimally adapted to the current image incident on the retina.
- the image in the eye may already have changed during the period of time that elapses due to the completion of the scanning process, the switching process and the tracking of the projection beam to the selected recording point.
- high frame rates are required to suppress flickering of the image impression.
- the invention is therefore based on the object of developing a method according to the preamble of patent claim 1 or a device according to the preamble of patent claim 3 such that the spectrum of the optical information and thus the field of application of the method and the device with improved accuracy and improved signal Processing can be expanded.
- the invention information is projected onto the retina of the human eye while the scanning process is ongoing.
- the invention is based on the idea that in many cases it is not important for the information to be imported that a complete scanning operation of the image incident on the eye is carried out beforehand.
- the period of time of the scanning process which was previously unused for projection can, according to the invention, be fully used for the preparation and import of information, for example for image processing.
- improvement can be used, as a result of which it is possible to project the required information, such as a signal that improves the image point, more quickly onto the retina, or to optimally use a full scan cycle of, for example, 20 ms in order to carry out a corresponding signal processing.
- the method according to the invention opens up the possibility of being able to carry out much more complex processing in the specified period of time.
- a partial projection process advantageously takes place after a partial scanning of the image.
- the area scanned can be a line, a surface, a pixel sequence or even a single pixel.
- the beam of the projected light lags behind the beam of the received light.
- This embodiment has the advantage that it can still work with an arrangement in which the beam path of the scanning and projection systems is congruent. However, in order to avoid high-frequency switching processes between recording and projection operation, this system can advantageously also be equipped with separate scanning and projection systems.
- the minimum time offset between the recording and projection of a pixel essentially corresponds to the processing time of the previously recorded image signal or the previously recorded image signals. If separate systems are provided for the light incident on the retinal image and 'for the projection of information onto the retina scanning, it is advantageous to design the device according to claim. 7 Since the movement patterns of the scanning and projection beams are offset from one another, the scanning and projection systems can work in parallel almost without hindrance, which saves additional time for signal processing. In order to be able to synchronize the movement patterns of the scanning and projection beam in a particularly simple manner, it is advantageous to offset the movement patterns in relation to one another in a predetermined manner. This can be done, for example, by shifting the movement patterns by a predetermined small angle, or by shifting the movement patterns radially from one another by a predetermined small distance.
- the movement pattern of the scanning and / or projection beam corresponds to a spiral.
- this has the advantage that there is no need to move through lines.
- the distance between the orbits should be smaller in the center of the spiral or concentric circles or ellipses and increase with the distance to the center of the spiral or concentric circle arrangement.
- a correspondingly higher resolution is achieved in the area of the center of the movement pattern, in which the fovea centralis of the retina is also located and in which the density of the light-sensitive cells is greater.
- FIG. 1 shows a schematic view of a device for transferring information to the human retina in the form of an interactive glasses system
- Figure 2A shows a conventional movement pattern and associated timing diagram for the scanning beam of the device
- FIG. 2B shows a conventional movement pattern and the associated time diagram for the projection beam of the device
- FIGS. 3A to 7A show further embodiments of interactive glasses that can be equipped with a device according to the invention
- FIGS. 3B to 7B show detailed drawings of the signal detection and projection devices shown in FIGS. 3A to 7A;
- FIG. 8 shows a schematic perspective illustration of a modification of the signal detection and projection device, in which the two devices have separate beam paths;
- FIGS. 9A and 9B are schematic representations to illustrate a first embodiment of the recording and reproduction cycle, taking into account corresponding movement patterns of the scanning and projection beam in accordance with a field recording / reproduction technique with the associated time diagram;
- FIGS. 10A and 10B are schematic representations to illustrate a second embodiment of the recording and reproduction cycle based on a circular sequential scanning and projection mode of the scanning and projection beam in accordance with a full-picture recording / reproduction technique with associated time diagram;
- FIGS. HA and 11B are schematic representations to illustrate a third embodiment of the recording and reproduction cycle based on a circle-sequential scanning and projection mode of the scanning and projection beam according to a full-picture recording-V reproduction technique with associated time diagram;
- FIGS. 12A and 12B are schematic representations to illustrate a fourth embodiment of the recording and reproduction cycle based on a pixel sequential scanning and projection mode of the scanning and projection beam in accordance with a full-picture recording / reproduction technique with associated time diagram;
- FIGS. 13A and 13B are schematic representations to illustrate a fifth embodiment of the recording and reproduction cycle based on a pixel-sequential scanning and projection mode of the scanning and projection beam in accordance with a still image recording / reproduction technique with associated time diagram;
- FIG. 14 is a schematic (enlarged) view of a modified movement pattern for the scanning and projection beam
- FIG. 15 shows a schematic illustration of a modified position assignment between the scanning beam and the production beam
- FIG. 16 shows a schematic view of a scan and projection beam movement pattern, the movement patterns being traversed in the same way
- FIG. 17 shows a schematic view to illustrate the beam path in a further embodiment of the device for transferring optical information onto the human retina.
- FIG. 1 shows the basic structure of a device for transferring optical information onto the human retina in the form of an information system 100.
- the information system 100 is designed in the form of an interactive glasses system 120 or interactive glasses 120, which comprises two optical devices 150 ,
- the optical devices 150 are preferably located on the inside of a left 121L or right 121R temple part of the glasses 120.
- there are also other arrangements of the optical devices which do not obstruct the view for example in the area of a device running over the nose of a user Nose bridge 122 of glasses 120 makes sense.
- the optical device 150 of the glasses 120 is connected to a processor unit 140 via connecting lines 101.
- the connecting lines serve for the transmission of electrical detector or control signals.
- the photodetectors or light sources can be arranged in the processor unit 140 and connected to the optical devices 150 of the glasses 120 via light-conducting connecting lines 101. This contributes to the weight reduction of the glasses 120.
- FIGS. 2A and 2B show how conventionally the image incident on the retina - in the known case the retinal reflex - is scanned and how information signals, which should lead to an image improvement, for example, are subsequently projected onto the retina.
- the scanning movement pattern is indicated in FIG. 2 as a circular scan movement on the basis of a few selected concentric circular rings. However, it should be emphasized that a line scan or spiral scan can equally be used. It can be seen from the time diagram that a full image is acquired over a period of 20 ms (corresponding to a recording / playback frequency of 50 Hz).
- FIG. 1 shows how conventionally the image incident on the retina - in the known case the retinal reflex - is scanned and how information signals, which should lead to an image improvement, for example, are subsequently projected onto the retina.
- the scanning movement pattern is indicated in FIG. 2 as a circular scan movement on the basis of a few selected concentric circular rings. However, it should be emphasized that a line scan or spiral scan can equally be used. It
- the projection beam which, like the image, can simultaneously project the radiation of all primary colors red, green and blue, transfer information onto the retina with pixel accuracy can.
- the information is therefore only transferred when a full image has been scanned and evaluated in the processor 140.
- the device according to the invention for transferring optical information onto the human retina can be used with recording and projection devices according to the older patent application DE 196 31 414 as well as with a modified structure of an internal Realize interactive glasses according to Figures 3 to 5, which will be described in more detail below.
- FIG. 3 shows an embodiment of the interactive glasses system or glasses 320 as described above, in which a signal detection device in the form of a scanning eye scanner 350D is provided.
- the left half of the image represents a top view of the head of a user 302 together with glasses 320 with a right temple part 321R, while the right half of the image shows a cross section of the glasses 320 running through the left temple part 321L.
- the devices belonging to the interactive glasses 320 no further components of the information system 100 according to the invention are shown in FIG.
- light rays 333a and 333b falling on the eye 380 which originate, for example, from the visual field, are sharply imaged by the lens 382 on the retina 381 as a coherent image and reflected back by it as a retinal reflex image.
- the eye scanning device 350D comprises a signal detection device 351 in the form of a photodetector 351, which detects the light beam 331 reflected back by the retina 381, and two movable flat mirrors 352H and 353V, which horizontally and vertically deflect the light beam 331 onto the photodetector 351 effect.
- the glasses 320 additionally comprise a light trap 324 which prevents light from coming in from undesired directions of incidence.
- the mirror 323 can be realized by a mirrored inner surface of the glasses. However, the surface must have a certain shape in order to record the entire retinal reflex image even in the event of a possible to allow rotated position of the eye 380. This in turn limits the design options for the glasses 320.
- a point-shaped detector 351 with corresponding control of the flat mirrors 352H and 352V results in a serial point-by-point scanning of the retinal reflex image as a sequence of pixels.
- the retina 381 as described in DE 196 31 414 AI and DE 197 28 890, is scanned with a circular, spiral or elliptical scan pattern.
- This has the advantage that the flat mirrors 352 can be driven without backward movements and that a higher pixel density (number of pixels per unit area of the retina) in the area of the fovea centralis 1886 (cf. FIG. 18) can be detected.
- FIG. 4 shows a known embodiment of the interactive glasses 420 as described above, in which an output device in the form of a scanning projection device 450P is provided.
- the left half of the image represents a top view of the head of a user 402 together with glasses 420 with the right temple part 421R, while the right half of the image shows a cross section of the glasses 420 running through the left temple part 421L.
- the devices belonging to the interactive glasses 420 no further components of the information system 100 according to the invention are shown in FIG.
- the scanning projection device 450P comprises a light source 453 emitting a projection light beam 432, for example a laser diode or an LED focused via a lens system, and two movable flat mirrors 454H and 454V.
- the projection light beam 432 is directed via the movable flat mirrors 454H and 454V onto a mirror system of the glasses 420 which comprises two concave mirrors 422 and 423, which throw the projection light beam 432 onto the lens 482 of an eye 480 and finally onto the retina 481.
- the mirror 423 can be realized by a mirrored inner surface of the spectacle lens.
- the surface must have a certain shape in order to enable a projection onto all areas of the retina 481 even if the eye 480 is possibly rotated. This in turn limits the design options for the glasses 420.
- the glasses 420 can be equipped with a light trap 424, which prevents incidence of light from undesired directions of incidence.
- the projection as described in DE 196 31 414 AI and DE 197 28 890, is preferably carried out using a circular, spiral or elliptical scan pattern. This has the advantage that the flat mirrors 452 can be driven without backward movements and that a higher pixel density in the area of the fovea centralis 286 can be projected onto the retina 481.
- the degree of perception of an image projected into the eye 480 can be controlled in relation to the naturally perceived image by the brightness of the projected pixels.
- retinal perception is a deeply complex process in which psychological effects also play a very strong role.
- the retina 481 adjusts itself to the brightness of the light falling on it as a whole.
- the faint glow of a clock radio clock that is not perceived in daylight can appear to illuminate an entire room in the dark.
- the strong headlights of oncoming vehicles are hardly noticeable in daylight. It is therefore, the bright- ness of an individual image points' s in relation to the otherwise perceived pixels.
- the Retina 481 works similarly. If the brightness of an image point projected on an area of the retina 481 exceeds the brightness of the light otherwise falling on this area by approximately 10%, only the projected image point is effectively perceived by this area of the retina 481 instead of the other light. Due to psychological effects, the exact value can be between 5% -10%, 10% -15% or even 15% -20% instead of 10%.
- FIG. 5A shows interactive glasses 520 according to a preferred exemplary embodiment, in which a combined signal detection and projection device 550 is attached to the glasses 520 in the region of the nose bridge 522.
- the combined signal detection and projection device 550 comprises both a projection device 553 and a signal detection device, which are accommodated together in a protective housing 558.
- Light rays 530 enter the interior of the housing 558 and vice versa through a translucent window 559 in an outer wall of the housing 558.
- closing the housing 558 through the window 559 prevents dust, sweat and other foreign matter from interfering with the operation of the combined signal detection and projection device 550.
- the structure of glasses 520 can be simplified in that the mirrors 352 and 452, which are separate in the prior art, for vertical and horizontal deflection of the respective light beam
- a partially transparent mirror can be used
- the inside of the spectacle lens is preferably provided with a surface 523 which is highly reflective for rays incident from this direction and which serves as a mirror for the Beam path between the eye 580 and the combined signal acquisition and projection device 550 used.
- This contributes to a reduction in the necessary components and, in the embodiment shown, leads to a simplified, bright beam path 530, in which the light beam 530 between the eye 580 and the projection or signal detection device 553 or 551 is reflected only three times. As described above, however, this results in a restriction of the design options for the glasses 520.
- the freedom of movement necessary for a tumbling movement of the mirror 552, 554 can be achieved, for example, by a gimbal or spring suspension of the mirror 552, 554. Possible embodiments of such a wobble mirror are known to the person skilled in the art, for example from the field of microtechnology. Further solutions to the present deflection problem, in which the respective light beam 530 is guided on the basis of electrochro, holographic, electroholographic or other light refraction or light reflection mechanisms, are readily conceivable and can also be used.
- the interactive glasses 520 is shown in a minimalist embodiment, in which a combined signal acquisition and projection device 550 is provided only for the left eye 580, it goes without saying that a mirror-built, second combined signal acquisition and projection device 550 in the area the right half of the nose bridge 522 can be provided for the right eye, not shown, if necessary.
- FIG. 6A shows, in the form of a modification of the glasses 520 shown in FIGS. 5A and 5B, interactive glasses 620 according to a second preferred exemplary embodiment, in which the left combined signal detection and projection devices 650L part between the left lens 624L and the left temple 621L lying area and the right combined signal detection and projection devices 650R are arranged in the area lying between the right spectacle lens 624R and the left temple part 621R.
- Such an arrangement of the combined signal detection and projection devices 650L, 650R in relation to the respective spectacle lenses 624L, 624R and the respective eyes 680 is normally associated with the need to provide either several mirrors along the beam path 630 (cf. mirrors 322 and 323 in FIG. 3) or to give the respective spectacle lens 624L, 624R a special shape in order to ensure detection of all areas of the retina 681.
- the interactive glasses 620 according to FIG. 6 provide glasses 624L, 624R, the inside of which are provided with a respective holographic coating 623L, 623R.
- Such holographic coatings 623 are able to emulate any reflection topology.
- a holographically coated, flat surface can look like a spherically curved surface.
- a holographically coated, spherically curved surface can also act like a flat surface.
- the change in the effective reflection topology depends only on the holographic content of the coating.
- the holographic coatings 623L and 623R are formed and arranged in a mirror-symmetrical manner to one another.
- FIG. 6B contains a detailed drawing of the combined signal acquisition and projection devices 650L. Analogous to the combined signal detection and projection device 550 shown in FIG. 5B, it comprises a housing 658, a projection device 653 and a signal detection device 651, respective wobble mirrors 652 and 654, a partially transparent mirror 656 and a housing window 659. Similar to FIGS. 6A and 6B, FIG. 7A shows, in the form of a modification of the glasses 520 shown in FIGS.
- interactive glasses 720 according to a third preferred exemplary embodiment, in which the left combined signal detection and projection devices 750L in the between the left glasses lens 724L and the left temple part 721L and the right combined signal detection and projection devices 750R are arranged in the region lying between the right lens 724 and the left temple part 721R.
- Figure 7B contains a detailed drawing of the combined signal acquisition and projection devices 750L. Analogously to the combined signal detection and projection device 550 shown in FIG. 5B, it comprises a housing 758, a projection device 753 and a signal detection device 751, respective wobble mirrors 752 and 754, a partially transparent mirror 756 and a housing window 759.
- the problem of the beam path 730 mentioned above is solved in a space-saving manner by specially designed pads 725L and 725R.
- glasses 720 are supported either on the nose bridge by the nose bridge 722 or by so-called pads 725.
- pads are relatively flat, slightly curved and oval.
- they are either pivotally or tumbling on a projection extending from the nose bridge 722 in order to ensure that the pads lie comfortably against the side surfaces of the nose root.
- the pads 725 are designed as dimensionally stable, elongated units which protrude from the glasses 720 in the direction of the eye 780 in the region of the nose bridge 722.
- the pads 725 form the support surface which rests on the root of the nose.
- the pads 725 In their end region opposite the glasses 720, the pads 725 have a wing on the side facing the eye, which is covered with a mirror or a reflective coating, for example a metal coating or a holographic coating.
- the frame of the glasses 720 has a basically solid shape, both quasi-static, e.g. due to material fatigue and / or temperature changes, as well as dynamic deformations of the frame.
- the relative arrangement of the glasses 720 with respect to the eye 780 is also not a constant.
- both the optical system of the glasses 720 i.e. those system components that contribute to optical signal detection or optical projection, as well as a processing system possibly connected to it, are designed and configured in such a way that such changes in arrangement can be taken into account and / or compensated for and / or do not cause any extraordinary malfunctions. This applies to all types of interactive glasses systems.
- Optical markings can also be permanently attached to the spectacle frame in the vicinity of the usual beam path 730 by the signal detection device 751 for the purpose of calibrating their optical system regularly or as required.
- FIG. 8 shows the basic principle which consists in the fact that the projection process takes place while an image is being scanned. This can either be done using the previously described scanning and projection devices by switching between scanning and projection according to a selected mode when going through a scanning or projection movement pattern, or - as shown in Figure 8 - by the beam path a recorded light and the projected light does not run in the same way.
- FIG. 8 shows a perspective representation of the radiation guide system relative to the eye 880.
- the scan track on the retina - shown in the form of a spiral - is designated 842.
- the scanning beam designated 843 strikes the spectacle lens designated 844, on which a point-symmetrical and possibly appropriately stretched image of the scan track 842 in the form of the beam track 842 'is created.
- the scanning beam 843 is reflected by the spectacle lens 844 to the scanner game gel 845, which reflects the scanning beam in the direction of the sensor system, which is not shown in more detail.
- the curved double arrows in FIG. 8 indicate the wobble movement of the scanner mirror system 845, with which it is possible to implement the scanning movement pattern.
- a projection beam 846 strikes an associated scanner mirror 847 from the projection optics, also not shown. which reflects the beam at a predetermined distance onto the inside of the spectacle lens 844 and from there directs it through the lens 882 of the eye onto the scan track 842 on the retina.
- the scanner mirror 847 executes corresponding wobble movements.
- the optical systems are matched to one another in such a way that the projection beam 846 hits those pixels on the retina that were previously swept by the scanning beam 843, but with a time delay. Of course, care is taken that the scanner mirrors 845 and 847 carry out their wobble movement under electronic synchronization, so that the corresponding pixels are recorded in the desired chronological order.
- FIG. 9 shows a recording and playback cycle according to a field technique.
- FIG. 9A schematically shows the recording cycle of the first field, which is obtained within 10 ms, for example, by scanning circles 1, 3, 5, ... n.
- a second field is reproduced (FIG. 9B), the reproduction or the projection representing the adjacent circle, i.e. the 2nd, 4th, 6th, ... n + lth circle.
- the time of 20 ms available for a full scan is thus divided according to the invention and already for the projection of information signals, such as used by image-enhancing signals.
- FIGS. 10 and 11 show a modification of the recording and playback cycle, wherein a circular sequential scanning and playback mode is used in each case.
- full images are acquired alternately, with the first full image being recorded on the lth, 3rd, 5th, ... nth circle, while on the 2nd, 4th, 6th, ... n + lter circle the projection is carried out.
- the scanning and reproducing beams are therefore at a predetermined distance from one another.
- the relationships are reversed, i.e. on the 2nd, 4th, 6th, ... n + lth circle the image is taken, while on the lth, 3rd, 5th, ... nth circle the projection takes place. There is thus a simultaneous projection at any moment of the full-screen viewing while the recording process is ongoing.
- FIGS. 12 and 13 show recording and playback cycles to which a pixel sequential mode for recording and playback is used.
- the right side of FIG. 12A shows how recording and playback pixels are distributed for the first scan circle.
- FIG. 12B shows a detail view for two adjacent circles swept by the scanning and projection beam. It can be seen from the illustrations that the recording and playback pixels alternate, i.e. there is a sequential recording and playback.
- the distance 12 VA between the recording and playback pixels should again preferably not be less than 7 ⁇ m.
- the illustration shows that the lth, 3rd, 5th, ..., nth pixel functions as recording pixels, while pixels 2, 4, 6, ..., n + 1 of a respective scan circle represent the playback pixels , Recording and playback is done by pixel synchronous switching.
- the alternate processing of the image points can be carried out in the simplest manner by switching the projection laser (s) on and off with the appropriate synchronization.
- the embodiments according to FIGS. 5 to 7 can thus be used advantageously.
- FIG. 13 shows a modified pixel sequential mode, with the difference from FIG. 12 that recording and playback pixels have a slight optical offset 13VA here.
- This optical offset is given, for example, in FIG. 13B as 7 ⁇ m.
- this measure is due to the physiological boundary conditions of the eye can be determined.
- the separation between recording and playback can be achieved by slightly offset optical paths of the recording and playback channel, but in the sense of the invention the projection beam lags the scanning beam.
- FIGS. 9 to 13 The recording and reproducing movement patterns of the optical beams are indicated as concentric circles in FIGS. 9 to 13.
- Figure f ⁇ T shows a modification in that a spiral scan is used instead of a circular scan.
- the peculiarity of this movement pattern for the scanning and projection beam is that a double jump can be omitted.
- the second peculiarity can be seen in the fact that the "line spacing" is variable, which is particularly important for the field of application according to the invention, i.e. adapted to transfer optical information to the human retina.
- the keen vision of the human eye takes place in the area of the fovea centralis and the immediate vicinity. This allows the line spacing outside this range to be chosen to be very large without deteriorating the image impression. This enables considerable data reduction, which in turn has a positive effect on the possibilities of signal processing and image enhancement.
- FIG. 15 shows a modification of the embodiment according to the invention in such a way that a linear offset by the dimension 1504 takes place when using a spiral scanning pattern.
- a scan scan 1502a is linearly offset from a projection scan 1502b, but is always kept parallel to it.
- the distance 1504 is smaller than the distance 1506 from two adjacent scan lines of a scan.
- FIG. 16 illustrates, on a greatly enlarged scale, the conditions when signal processing according to FIGS. 12 and 13 is used.
- the movement pattern for the scanning point 1602a ′ is identical to the movement pattern for the projection point 1602b 1 .
- the distance between the two points is characterized by the angle 1604 '.
- the absolute distance A between the two points is smaller in the inner area of the movement pattern than in the outer scan area, which in turn is particularly useful in connection with the physiology of the human eye, since in the area of the fovea centralis and in the area surrounding it the crucial image information is created.
- the method according to the invention can of course be used for modified systems, e.g. for a system as shown in Figure 17.
- This figure shows a modification of the glasses 520 shown in FIGS. 5A and 5B, in which a spherical or spherically acting, partially transparent, reflective additional element 929 is arranged between the spectacle lens 924 and the eye 980.
- the additional element 929 is preferably arranged confocal to the optical system of the eye 980.
- the degree of reflection of such an additional element 929 can be adapted to the needs of the information system. You can choose between a high degree of reflection, which enables very good detection of light rays 933a-933c directed towards the eye 980, and a low degree of reflection, which avoids impairing the perception by the eye 980.
- the additional element 929 preferably has a low (for example less than 10%), homogeneous degree of reflection over its entire reflection surface.
- the additional element 929 should have as little effect as possible on the light falling on it.
- the additional element 929 is preferably made of a homogeneous translucent and uncolored material and with a constant thickness in the direction of the light rays directed towards the center of the eye.
- the reflective contour of such an additional element 929 is well defined and can accordingly be made available to the information system as known information, while the contour of the relevant reflective organs of the eye 980 must first be determined. The latter can involve considerable effort in some cases.
- the detection of light rays 933a-933c directed at the eye 980 via such an additional element 929 can thus provide high-quality images of the field of view.
- the side of the spectacle lens 924 facing the eye 9 is strong for rays incident from this direction reflecting surface 923, and has a specially designed shape or a specially designed coating, which bundles the light rays reflected perpendicularly from the additional element such that they fall as almost parallel light rays 934 onto the signal detection device 951, while not reflecting perpendicularly from the additional element Beams of light are directed in a different direction. Furthermore, an aperture 957 is provided shortly in front of the signal detection device 951, which prevents detection of those light rays whose angle of incidence lies outside a narrow angle of incidence of the light rays 934 which run almost parallel, as described above.
- the correlation between the detected light and the perceived visual field must be determined.
- this correlation is achieved by a preferred confocal arrangement of the additional element 929 to the optical system of the eye 980. It is therefore preferred that the additional element 929 is attached to the glasses via an adjustable suspension such that the position of the additional element 929 can be readjusted both in vertical and in two horizontal directions.
- Confocal i tat is basically given when the additional element 929, optically seen, is arranged rotationally symmetrically to the visual axis and at a distance from the lens 982 that the optically see center of the optical system of the eye coincides with the center of the sphere defined by the spherical or spherically acting additional element.
- the visual axis can be adequately determined via the orientation of the pupil 984, which can be easily recognized by its sharp contours, and the orientation of which can be determined easily due to its round shape.
- no pivoting of the additional element 929 about the possible pivot axes of the eye 980 is necessary in order to ensure confocal.
- the additional element 929 optically speaking, remains rotationally symmetrical to the visual axis due to a corresponding vertical and / or horizontal displacement of the additional element 929.
- the distance to the lens 982 there are various ways of determining the necessary distance. For example, an optical or acoustic measurement of the cornea 983 can be carried out, the curvature of which gives a very good guide value for the correct arrangement of the additional element 929.
- Retinal or corneal reflex images can also be acquired at least partially, and the correct distance can be determined on the basis of a comparison of the reflex images with the light acquired via the additional element 929.
- the time available for the image construction is better used to carry out the required signal processing and project corresponding signals onto the retina.
- the projection into the eye is always lagging, ie the light beam of the projection follows the scanning beam via a suitable geometry.
- the temporal / spatial offset between scanning and projecting can be reduced to a pixel distance, the corresponding time period being sufficient for certain pixel improvements, such as brightening or correction of poor color vision.
- the path of the projection beam can either be on the same line or on an adjacent line at a constant angle from the scanning beam.
- the adjacent path does not have to have the same center as the path of the scanning beam. Because the projection beam does not disturb the original signal. There is also no need to switch back and forth between scanning and projection. Accordingly, there is more time available for processing the image information. Since there are also lower requirements for the congruence of the movement patterns, the scanner system can be designed more cost-effectively.
- a constant-speed scan can be used in which the retina is scanned with constant light sensitivity.
- This scan is suitable if essentially the image seen is to be evaluated, for example to be able to control an assistance system or to superimpose additional overlays on the original image.
- it is advantageous to keep the angle between the vectors of the scanning beam and the projection beam constant. The angle should be very small so that the accuracy is maintained in the area of the center of the scan spiral.
- a physiologically correct spiral scan with constant angular velocity is even more suitable for image enhancement.
- the length of stay in the area of the fovea centralis is to the scanning length significantly longer. Since the number of light-sensitive receptors in this area of the fovea centralis is much higher than in the outer area, more points can be scanned and projected accordingly at a given scanning frequency. In such a scan, the angle between the vectors of the scanning beam and the projection beam must be adjustable.
- the scanning speed it is advantageous to set the scanning speed so that it largely corresponds to the density of the receptors.
- the same number of receptors are therefore always scanned per unit of time, or a correspondingly equal number of projection signals are sent.
- a scanning spiral is preferably used in which the individual webs run at different distances from one another, as is best shown in FIG. 14.
- the distance between the orbits is very small and increases the further the path is from the center of the spiral.
- a high resolution is no longer necessary, with a radius of approx. 1 mm in the area of the fovea centralis, about 20 times more scan paths will run than in the area above up to approx. 6 mm radius.
- the invention thus provides a method and a device for transferring optical information onto the human retina using a preferably serial scanning system that records an image incident on the retina and an information system. So that the spectrum of the optical information that is to be able to be played back and the field of application of the method and the device can be expanded, which simultaneously results in improved accuracy and improved signal processing, the projection process takes place while the scanning process is running.
Landscapes
- Life Sciences & Earth Sciences (AREA)
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Engineering & Computer Science (AREA)
- Heart & Thoracic Surgery (AREA)
- Surgery (AREA)
- Ophthalmology & Optometry (AREA)
- Biomedical Technology (AREA)
- Human Computer Interaction (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Biophysics (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Public Health (AREA)
- Veterinary Medicine (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
Abstract
Priority Applications (23)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| AU2001210227A AU2001210227A1 (en) | 2000-10-07 | 2000-10-07 | Method and device for transferring optical information onto the human retina |
| PCT/EP2000/009842 WO2002031579A1 (fr) | 2000-10-07 | 2000-10-07 | Procede et dispositif pour faire passer des informations optiques sur la retine humaine |
| DE50112749T DE50112749D1 (de) | 2000-10-07 | 2001-10-08 | Vorrichtung zur bestimmung der orientierung eines auges |
| US10/551,445 US7641342B2 (en) | 2000-10-07 | 2001-10-08 | Information system and method for providing information using a holographic element |
| DE50112248T DE50112248D1 (de) | 2000-10-07 | 2001-10-08 | Informationssystem und Verfahren zur Zurverfügungstellen von Informationen unter Verwendung eines Holographischen Elements |
| AU2002221662A AU2002221662A1 (en) | 2000-10-07 | 2001-10-08 | Information system and method for providing information using a holographic element |
| AT01986772T ATE367596T1 (de) | 2000-10-07 | 2001-10-08 | Vorrichtung zur bestimmung der orientierung eines auges |
| PCT/EP2001/011633 WO2002033472A2 (fr) | 2000-10-07 | 2001-10-08 | Systeme d'informations et procede de diffusion d'informations faisant intervenir l'utilisation d'un element holographique |
| US10/551,443 US8113657B2 (en) | 2000-10-07 | 2001-10-08 | Device and method for determining the orientation of an eye |
| PCT/EP2001/011634 WO2002031581A1 (fr) | 2000-10-07 | 2001-10-08 | Systeme et procede permettant de determiner l'orientation d'un oeil |
| AT01987895T ATE357680T1 (de) | 2000-10-07 | 2001-10-08 | Informationssystem und verfahren zur zurverfügungstellen von informationen unter verwendung eines holographischen elements |
| EP01986772A EP1405122B1 (fr) | 2000-10-07 | 2001-10-08 | Systeme permettant de determiner l'orientation d'un oeil |
| EP07013946A EP1840627B1 (fr) | 2000-10-07 | 2001-10-08 | Dispositif et procédé destinés à la détermination de l'orientation d'un oeil |
| AU2002215929A AU2002215929A1 (en) | 2000-10-07 | 2001-10-08 | Device and method for determining the orientation of an eye |
| ES07013946T ES2401132T3 (es) | 2000-10-07 | 2001-10-08 | Dispositivo y procedimiento para la determinación de la orientación de un ojo |
| EP01987895A EP1405123B1 (fr) | 2000-10-07 | 2001-10-08 | Systàme d'informations et procédé de diffusion d'informations faisant intervenir l'utilisation d'un element holographique |
| US12/646,670 US8016421B2 (en) | 2000-10-07 | 2009-12-23 | Information system and method for providing information using a holographic element |
| US13/223,825 US8944602B2 (en) | 2000-10-07 | 2011-09-01 | Information system and method for providing information using a holographic element |
| US13/300,691 US8382285B2 (en) | 2000-10-07 | 2011-11-21 | Device and method for determining the orientation of an eye |
| US13/749,945 US20130135181A1 (en) | 2000-10-07 | 2013-01-25 | System and Method for Determining the Orientation of an Eye |
| US14/572,264 US9427154B2 (en) | 2000-10-07 | 2014-12-16 | Information system and method for providing information using a holographic element |
| US15/235,845 US10188288B2 (en) | 2000-10-07 | 2016-08-12 | Information system and method for providing information using a holographic element |
| US16/259,496 US20190150731A1 (en) | 2000-10-07 | 2019-01-28 | Information System and Method for Providing Information Using a Holographic Element |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| PCT/EP2000/009842 WO2002031579A1 (fr) | 2000-10-07 | 2000-10-07 | Procede et dispositif pour faire passer des informations optiques sur la retine humaine |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2002031579A1 true WO2002031579A1 (fr) | 2002-04-18 |
Family
ID=8164121
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/EP2000/009842 WO2002031579A1 (fr) | 2000-10-07 | 2000-10-07 | Procede et dispositif pour faire passer des informations optiques sur la retine humaine |
Country Status (2)
| Country | Link |
|---|---|
| AU (1) | AU2001210227A1 (fr) |
| WO (1) | WO2002031579A1 (fr) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7641342B2 (en) | 2000-10-07 | 2010-01-05 | Metaio Gmbh | Information system and method for providing information using a holographic element |
| US8113657B2 (en) | 2000-10-07 | 2012-02-14 | Metaio Gmbh | Device and method for determining the orientation of an eye |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE19631414A1 (de) * | 1996-08-05 | 1998-02-19 | Daimler Benz Ag | Vorrichtung zur Aufnahme des Netzhautreflexbildes und Überlagerung von Zusatzbildern im Auge |
| US5727098A (en) * | 1994-09-07 | 1998-03-10 | Jacobson; Joseph M. | Oscillating fiber optic display and imager |
| DE19728890A1 (de) * | 1997-07-07 | 1999-02-04 | Daimler Benz Ag | Verfahren zur Verbesserung des optischen Wahrnehmungsvermögens durch Modifikation des Netzhautbildes |
-
2000
- 2000-10-07 WO PCT/EP2000/009842 patent/WO2002031579A1/fr active Application Filing
- 2000-10-07 AU AU2001210227A patent/AU2001210227A1/en not_active Abandoned
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5727098A (en) * | 1994-09-07 | 1998-03-10 | Jacobson; Joseph M. | Oscillating fiber optic display and imager |
| DE19631414A1 (de) * | 1996-08-05 | 1998-02-19 | Daimler Benz Ag | Vorrichtung zur Aufnahme des Netzhautreflexbildes und Überlagerung von Zusatzbildern im Auge |
| DE19728890A1 (de) * | 1997-07-07 | 1999-02-04 | Daimler Benz Ag | Verfahren zur Verbesserung des optischen Wahrnehmungsvermögens durch Modifikation des Netzhautbildes |
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7641342B2 (en) | 2000-10-07 | 2010-01-05 | Metaio Gmbh | Information system and method for providing information using a holographic element |
| US8016421B2 (en) | 2000-10-07 | 2011-09-13 | Metaio Gmbh | Information system and method for providing information using a holographic element |
| US8113657B2 (en) | 2000-10-07 | 2012-02-14 | Metaio Gmbh | Device and method for determining the orientation of an eye |
| US8382285B2 (en) | 2000-10-07 | 2013-02-26 | Metaio Gmbh | Device and method for determining the orientation of an eye |
| US8944602B2 (en) | 2000-10-07 | 2015-02-03 | Metaio Gmbh | Information system and method for providing information using a holographic element |
| US9427154B2 (en) | 2000-10-07 | 2016-08-30 | Metaio Gmbh | Information system and method for providing information using a holographic element |
| US10188288B2 (en) | 2000-10-07 | 2019-01-29 | Apple Inc. | Information system and method for providing information using a holographic element |
Also Published As
| Publication number | Publication date |
|---|---|
| AU2001210227A1 (en) | 2002-04-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| DE69420427T2 (de) | Abtast-opthalmoskop | |
| EP1405122B1 (fr) | Systeme permettant de determiner l'orientation d'un oeil | |
| DE69722674T2 (de) | Beobachtungsvorrichtung für die augenheilkunde | |
| DE69906139T2 (de) | Vorrichtung zum verfolgen von augenbewegungen | |
| EP1405123B1 (fr) | Systàme d'informations et procédé de diffusion d'informations faisant intervenir l'utilisation d'un element holographique | |
| DE2545662C2 (de) | Am Kopf oder Helm tragbare Anzeigevorrichtung | |
| EP1190667A2 (fr) | Dispositif pour l'acquisition de l'image réflexe rétinienne | |
| DE19704602B4 (de) | Interferometrische Anordnung zur Abtastung eines Objektes | |
| EP0917661A2 (fr) | Dispositif pour l'acquisition de l'image reflexe retinienne et la superposition d'images complementaires dans l'oeil | |
| DE68912444T2 (de) | Vorrichtung zum Ausrichten eines ophthalmologischen Instruments. | |
| DE2359360A1 (de) | Verfahren und vorrichtung zum verfolgen von augenbewegungen | |
| EP1389943B1 (fr) | Ophtalmoscope | |
| WO1988003396A1 (fr) | Dispositif pour la production d'images d'un objet et notamment pour l'observation des parties arriere de l'oeil | |
| DE3040009A1 (de) | Augenuntersuchungsgeraet | |
| WO2016091743A1 (fr) | Dispositifs d'affichage | |
| DE102018209886B4 (de) | Einrichtung zur Projektion eines Laserstrahls zur Erzeugung eines Bildes auf der Netzhaut eines Auges und Brilleneinrichtung mit zwei derartigen Einrichtungen | |
| DE10153397A1 (de) | Vorrichtung und Verfahren zur Messung der Refraktion | |
| EP1840627B1 (fr) | Dispositif et procédé destinés à la détermination de l'orientation d'un oeil | |
| DE102020206452A1 (de) | Projektions- und Okulografievorrichtung für eine Datenbrille und Verfahren zum Betreiben einer Projektions- und Okulografievorrichtung für eine Datenbrille | |
| WO2008125665A1 (fr) | Procédé et système de mesure oculaire | |
| EP3443883B1 (fr) | Procédés et dispositif permettant d'effectuer des mesures relatives à l' oeil | |
| EP1416843B1 (fr) | Dispositif permettant d'obtenir sans contact des images de la cornee | |
| DE10326527A1 (de) | Verfahren und Vorrichtung zur Bestimmung einer Bewegung eines menschlichen Auges | |
| DE102008026576A1 (de) | Optisches System für ophtalmologische Geräte, insbesondere Funduskameras | |
| WO1999003013A1 (fr) | Procede pour l'amelioration du pouvoir de perception optique par modification de l'image retinale |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AK | Designated states |
Kind code of ref document: A1 Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ DE DK DM EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW |
|
| AL | Designated countries for regional patents |
Kind code of ref document: A1 Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG |
|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
| DFPE | Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101) | ||
| REG | Reference to national code |
Ref country code: DE Ref legal event code: 8642 |
|
| NENP | Non-entry into the national phase |
Ref country code: JP |
|
| 122 | Ep: pct application non-entry in european phase | ||
| 122 | Ep: pct application non-entry in european phase | ||
| REG | Reference to national code |
Ref country code: DE Ref legal event code: 8642 |