[go: up one dir, main page]

WO2024129446A1 - Illuminateur adaptatif pour affichages montés sur la tête (hmds) - Google Patents

Illuminateur adaptatif pour affichages montés sur la tête (hmds) Download PDF

Info

Publication number
WO2024129446A1
WO2024129446A1 PCT/US2023/082570 US2023082570W WO2024129446A1 WO 2024129446 A1 WO2024129446 A1 WO 2024129446A1 US 2023082570 W US2023082570 W US 2023082570W WO 2024129446 A1 WO2024129446 A1 WO 2024129446A1
Authority
WO
WIPO (PCT)
Prior art keywords
eye
leds
box
led array
pupil
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2023/082570
Other languages
English (en)
Inventor
Mehdi Aas
Rob Jacques Paul ENGELEN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Lumileds LLC
Original Assignee
Lumileds LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Lumileds LLC filed Critical Lumileds LLC
Priority to EP23841403.1A priority Critical patent/EP4634718A1/fr
Publication of WO2024129446A1 publication Critical patent/WO2024129446A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0179—Display position adjusting means not related to the information to be displayed
    • G02B2027/0187—Display position adjusting means not related to the information to be displayed slaved to motion of at least a part of the body of the user, e.g. head, eye
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013—Eye tracking input arrangements

Definitions

  • the subject matter disclosed herein relates to an adaptive illuminator for head-mounted displays (HMDs). More specifically, the disclosed subject-matter relates to systems, devices, and apparatuses to provide an adaptive illuminator to an HMD based on a location of an eye-pupil as determined by an eye-tracking unit.
  • HMDs head-mounted displays
  • HMDs Head-Mounted Displays
  • a category of HMDs includes small reflective devices including Liquid Crystal on Silicon (LCoS) devices, which are substantially opaque to visible light, and liquid crystal display (LCD) devices, which are substantially transmissive to visible light.
  • LCD liquid crystal display
  • Mini-displays in HMDs modify the intensity of a reflected or transmitted light intensity and include an optical system to magnify and project images from the minidisplay onto the eye location. Since the pupil size of a human eye is variable and can change between 2 mm up to 8 mm depending on the intensity of the ambient light, it is desirable to design an eye-box in an HMD to be large enough to cover rotational movements and alignment ranges of the eye of an HMD user relative to the projection system of an HMD.
  • the disclosed subject-matter describes an apparatus to provide adaptive illumination to portions of an eye-box in which an eye-pupil is located.
  • the apparatus includes a light-emitting diode (LED) array having a plurality of LEDs. Each of the plurality of LEDs is individually addressable in subsets of the LED array with at least one of the plurality of LEDs within a subset of the LED array being configured to be lighted based on a location of the eye-pupil with the eye-box.
  • the apparatus further includes a collimating element located between the LED array and the eye-box.
  • a display device is located between the collimating lens and the eyebox; the display device is configured to generate images.
  • An eyepiece element is located between the display device and the eye-box to receive light from the at least one of the plurality of LEDs within the subset of the LED array and to project the images generated by the display device toward a location of the eye-pupil within an area of the eye-box.
  • the disclosed subject-matter describes a head-mounted display (HMD) with an adaptive illumination apparatus.
  • the HMD includes a light-emitting diode (LED) array having a plurality of LEDs.
  • Each of the plurality of LEDs is individually addressable in subsets of the LED array, with at least one of the plurality of LEDs within a subset of the LED array being configured to be lighted based on a location of an eye-pupil with a volume of an eye-box within the HMD.
  • a collimating element is located between the LED array and the eye-box.
  • a display device is located between the collimating lens and the eye-box, with the display device being configured to generate images.
  • the disclosed subject-matter describes a method for providing adaptive illumination to portions of an eye-box in which an eye-pupil is located.
  • the method includes determining a position of the eye-pupil; sending a signal to a lightemitting diode (LED) array having a plurality of LEDs, where each of the plurality of LEDs is individually addressable in subsets of the LED array; and lighting at least one of the plurality of LEDs within the subset of the LED array based on the determined location of the eye-pupil with the eye-box.
  • LED lightemitting diode
  • FIG. 1A shows an example of a portion of a head-mounted display (HMD) with a backlighted, transmissive mini-liquid crystal display (mini-LCD) in an occluded architecture, in accordance with various embodiments of the disclosed subject matter;
  • FIG. IB shows a portion of an HMD with a backlighted, transmissive mini-LCD in a folded, see-through architecture, in accordance with various embodiments of the disclosed subject matter;
  • FIG. 2A shows an example of an occluded optical- architecture for a near-to-eye HMD projection system with on-axis light-emitting diodes (LEDs) switched on for an eye-pupil alignment, in accordance with various embodiments of the disclosed subject matter;
  • LEDs light-emitting diodes
  • FIG. 2B shows an example of an occluded optical- architecture for a near-to-eye HMD projection system with off-axis LEDs switched on for an eye-pupil alignment, in accordance with various embodiments of the disclosed subject matter;
  • FIG. 3A shows an example of an occluded optical- architecture for a near-to-eye HMD projection system with on-axis LEDs switched on for an eye-pupil alignment, in accordance with various embodiments of the disclosed subject matter;
  • FIG. 3B shows an example of an occluded optical- architecture for a near-to-eye HMD projection system with off-axis LEDs switched on for an eye-pupil alignment, in accordance with various embodiments of the disclosed subject matter;
  • FIG. 4 is an exemplary embodiment of a layout of an adaptive illuminator system for an HMD with an eye-tracking module, in accordance with various embodiments of the disclosed subject matter;
  • FIG. 5 shows an exemplary embodiment of an optical layout for a near-to-eye HMD projection system with an arbitrary LED-to- collimator distance and an eyepiece-to-eye-pupil distance, in accordance with various embodiments of the disclosed subject matter;
  • FIG. 6 shows an exemplary embodiment of an eye-box size and location for an occluded on-axis near-to-eye HMD, in accordance with various embodiments of the disclosed subject matter;
  • FIG. 7 shows an exemplary embodiment of a see-through configuration of an HMD with an adaptive eye-box illuminator, in accordance with various embodiments of the disclosed subject matter
  • FIG. 8 shows an exemplary embodiment of a compact-design alternative of a see-through HMD with an adaptive eye-box illuminator, in accordance with various embodiments of the disclosed subject matter.
  • FIG. 9 shows an exemplary embodiment of a near-to-eye HMD folded-design with thin polarizing beam-splitters (PBSs) in a see-through HMD-system design.
  • PBSs polarizing beam-splitters
  • HMDs head-mounted displays
  • first, second, third, etc. may be used herein to describe various elements, these elements should not be limited by these terms. These terms may be used merely to distinguish one element from another. For example, a first element may be termed a second element and a second element may be termed a first element without departing from the scope of the disclosed subject matter. As used herein, the term “and/or” may include any and all combinations of one or more of the associated listed items. [0022] It will also be understood that when an element is referred to as being “connected” or “coupled” to another element, it may be directly connected or coupled to the other element and/or connected or coupled to the other element via one or more intervening elements.
  • Relative terms such as “below,” “above,” “upper,” “lower,” “horizontal,” or “vertical” may be used herein to describe a relationship of one element, zone, or region relative to another element, zone, or region as illustrated in the figures. A person of ordinary skill in the art will understand that these terms are intended to encompass different orientations of the device in addition to an orientation depicted in the figures. Further, whether the LEDs, LED arrays, optical elements, electrical components and/or electronic components are housed on one, two, or more electronics boards or optical boards, or in one or multiple physical locations may also depend on design constraints and/or a specific application.
  • Various embodiments of the disclosed subject-matter include an adaptive illumination system for HMDs.
  • An eye-pupil tracking system is used to locate the position of the eye-pupil and the illumination system is adapted to generate only and locate the beams on the location of eye-pupil.
  • the eye-box size can be replaced with a dynamically illuminated eye-box size of only about 2 mm by about 2 mm. This smaller, dynamically illuminated eye-box size moves inside of the 10 mm by 8 mm eye-box based on signals from an eye-tracking sensor.
  • a power efficiency of the HMD system increase by 20 times due to the reduced area of illumination that is used.
  • many of the concepts and designs disclosed herein may also be adapted for uses with other types of display systems, such as displays projected onto one or more portions of an automobile windshield or onto one or more portions of a windshield of the cockpit of a domestic or military plane or other vehicle.
  • FIG. 1A shows an example of a portion of a head-mounted display (HMD) 100 (an occluded projection system) with a backlighted, transmissive mini -liquid crystal display (mini-LCD) 103 in an occluded architecture, in accordance with various embodiments of the disclosed subject matter.
  • the occluded architecture blocking only a portion of a scene viewable to a person wearing the HMD.
  • FIG. 1 is also shown to include a backlight unit 101, an eyepiece lens 105, an eye-box 107, a human eye 109A, and an eye-pupil 109B.
  • the mini-LCD 103 is located at a first distance 111, f e , from the eyepiece lens 105.
  • the first distance 111 can be considered as the focal length of the eyepiece lens 105.
  • the eyepiece lens 105 is also located at a second distance 113, de, from the eye-box 107.
  • the backlight unit 101 can be any type of backlight, known in the relevant art, to illuminate a backside (that is, a side farthest from the eye-box 107) of the mini-LCD 103. As shown in FIGS. 1A and IB, the backlight unit 101 provides illumination to the backside of the mini-LCD 103 so as to substantially fill the eye-box 107 with light.
  • the eyepiece lens 105 can be any type of lens, or a combination of lenses, as would be recognized by a person of ordinary skill in the art upon reading and understanding the disclosed subject matter.
  • the eye-box 107 refers to an area, rather than an actual physical object, where the eye-pupil 109B receives an acceptable view of the image with respect to a set of criteria and thresholds, as defined in more detail below.
  • FIG. IB shows an example of a portion of an HMD 120 (a see-through projection system) with a backlighted, transmissive version of a mini-LCD 103 in a folded, see-through architecture, in accordance with various embodiments of the disclosed subject matter.
  • a beam splitter 121 is added, thus allowing a user of the see-through projection system to see both the mini-LCD 103 as well as a scene through the beam splitter 121 (e.g., a sense to the left of the beam splitter 121).
  • a size of the eye-pupil 109B is variable and can change from, for example, between about 2 mm up to about 8 mm depending on an intensity level of ambient light.
  • a size of the eye-box 107 in an HMD is generally designed large enough to cover rotational movements and an alignment range of the human eye 109A of a user relative to the projection system of the portion of the HMD 100.
  • the user will still be able to see the mini-LCD 103.
  • the size of the eye-box 107 is a function of an optical design of the portion of the HDM 100 (the projection system) and an angular luminance of the mini-LCD 103.
  • a specific value or values of the angular width of luminance of the mini-LCD 103 is considered.
  • the angular width of the rays coming from each pixel of the display is approximately:
  • Aa 2 tan’ 1 ( (1)
  • H d is a height of the mini-LCD 103
  • f e is the focal length of the eyepiece, shown in FIG. 1A as the first distance 111.
  • an angular width of luminance from each pixel on the display is An is greater than or equal to 17°.
  • the luminance on the display is desired to substantially be uniform.
  • FIG. 2A shows an example of an occluded optical- architecture for a portion of a near-to-eye HMD projection system 200 with light-emitting diodes (LEDs) 201A, 20 IB, 201C (although the only on-axis LED 20 IB is illuminated), switched on (illuminated) for alignment with an eye-pupil 209B, in accordance with various embodiments of the disclosed subject matter.
  • the occluded optical- architecture blocking only a portion of a scene otherwise viewable to a person wearing the HMD.
  • the LEDs 201A, 20 IB, 201C may be considered as being part of an LED array.
  • each of the LEDs is addressable individually to be turned on or off.
  • LEDs in the LED arrays disclosed herein may be grouped into subgroups, with each subgroup containing at least one LED but fewer than all of the LEDs within the LED array. Therefore, each of the subgroups comprise a subset of all LEDs in the LED array.
  • the subgroups may comprise LEDs that are overlapping or not over-lapping.
  • a first subgroup of an overlapping subgroup of LEDs may comprise a first LED and a second LED.
  • a second subgroup of an overlapping subgroup of LEDs may comprise the second LED and a third LED.
  • a first subgroup of a non-overlapping subgroup of LEDs may comprise a first LED and a second LED.
  • a second subgroup of a non-overlapping subgroup of LEDs may comprise a third LED and a fourth LED (but not the second LED).
  • the LED array can be only partially lighted in order to track a current location of the eye-pupil 209B (e.g., only a single LED is lighted or a subgroup of LEDs is lighted). Since the LED array provides light to the eye-pupil 209B and not to the entirety of the eye-box 107, a smaller amount of energy is needed to produce light directed to only a portion of the eye-box 107.
  • Optical rays are shown as emanating from a single point of an uppermost one of the LEDs 201A in a direction toward a human eye 209A, in order to provide a better understanding of the portion of the HMD 100.
  • the human eye 209A is substantially centered, from top to bottom, within the eye -box 107.
  • a third dimension into the plane of the sheet
  • a number of LEDs may also be populated with a number of LEDs (as part of the LED array) to provide adaptive lighting to the eye-pupil 209B of the human eye 209A, and a resulting movement of the eye-pupil 209B, as it moves or rotates within the third dimension.
  • FIG. 2A is also shown to include a collimator lens 207, an LCD display 203, and an eyepiece lens 205.
  • the LCD display 203 may be the same as or similar to the mini-LCD 103 of FIG. 1A and FIG. IB.
  • the eyepiece lens 205 may be the same as or similar to the eyepiece lens 105 of FIG. 1A.
  • the LED array comprising the LEDs 201A, 20 IB, 201C, is located at a first distance 211, f c , from the collimator lens 207.
  • the first distance 211 can be considered as the focal length of the collimator lens 207.
  • the collimator lens 207 is located at a second distance 213, d, from the LCD display 203.
  • the LCD display 203 is located at a third distance 215, f e , from the eyepiece lens 205.
  • the eyepiece lens 205 is located at a fourth distance 217, also f e , from the eye-box 107.
  • the third distance 215 and the fourth distance 217 can be considered as the focal length of the eyepiece lens 205.
  • the eyepiece lens 205 can be any type of lens, or a combination of lenses, as would be recognized by a person of ordinary skill in the art upon reading and understanding the disclosed subject matter. Therefore, the eyepiece lens 205 can be considered to be an eyepiece element and is arranged to project images generated by the LCD display 203 toward a location of the eye-pupil 209B within a volume of the eye-box 107.
  • the collimator lens 207 can be any type of lens, or a combination of lenses, as would be recognized by a person of ordinary skill in the art upon reading and understanding the disclosed subject matter. Therefore, the collimator lens 207 can be considered to be a collimating element.
  • the optical rays of FIG. 2A indicate how switching on only the on-axis LED, the LED 20 IB, directs light from the LCD display 203 to the on- axis location of the human eye 209A and, specifically, to the eye-pupil 209B. Consequently, since power is only being supplied to an appropriate one of LEDs in the LED array, in this case the LED 20 IB, to illuminate the on-axis location of the eye-pupil 209B, significant power is saved by not switching power to each of the LEDs 201A, 20 IB, 201C within the LED array.
  • FIG. 2B shows an example of an occluded optical- architecture for a near-to-eye HMD projection system 220 with LEDs 201A, 20 IB, 201C (although only the lower of the two off-axis LEDs, the LED 201C, is lighted), switched on for an eye-pupil 209D alignment, in accordance with various embodiments of the disclosed subject matter.
  • the eye-pupil 209D of a human eye 209C is shifted to an uppermost portion of the eye-box 107.
  • the LED 201C directs light from the LCD display 203 to the off-axis location of the human eye 209C and, specifically, to the eye-pupil 209D.
  • FIGS. 2A and 2B there is an LED array located on the focal plane of the collimator lens 207. Collimated rays from each LED within the LED array impinges on a mini-LCD, the LCD display 203, which functions in transmission mode.
  • the eyepiece lens 205 is located at its focal distance, f e , from the mini-LCD and generates a virtual image of the LCD at infinity relative to the viewer (the location of the human eye 209A, 209C).
  • Power switching as shown in FIGS. 2 A and 2B is on the input end, at the LED array, prior to the transmissive optics (e.g., the collimator lens 207 and the eyepiece lens 205.
  • FIG. 3A shows an example of an occluded optical- architecture for a near-to-eye HMD projection system 300 with LEDs 301A, 30 IB, 3010 (although the only on-axis LED 30 IB is hghted), switched on for an eye-pupil 309B alignment, in accordance with various embodiments of the disclosed subject matter.
  • the LEDs 301A, 30 IB, 301C may be considered as being part of an LED array.
  • the backlight unit 101 of FIGS. 1A and IB which are constantly lighted, only one LED in the LED array can be lighted in order to track a current location of the eyepupil 309B.
  • the LED array provides light to the eye-pupil 309B and not to the entirety of the eye-box 107, a smaller amount of energy is needed to produce light directed to only a portion of the eye-box 107.
  • Optical rays are shown as emanating from a single point of an uppermost one of the LEDs 201A in a direction toward a human eye 209A, in order to provide a better understanding of the portion of the HMD 100.
  • the human eye 209A is substantially centered, from top to bottom, within the eye-box 107.
  • FIG. 3A is also shown to include a collimator lens 307, an LCD display 303, and an eyepiece lens 305.
  • the LCD display 303 may be the same as or similar to the mini-LCD 103 of FIGS. 1 and IB, or the LCD display 203 of FIGS. 2 A and 2B.
  • the eyepiece lens 305 may be the same as or similar to the similar components of FIGS. 1A, IB, 2 A, and 2B.
  • the LED array comprising the LEDs 301 A, 30 IB, 301C, is located at a first distance 311, f c , from the collimator lens 307.
  • the first distance 311 can be considered as the focal length of the collimator lens 307.
  • the collimator lens 307 is located at a second distance 313, d, from the LCD display 303.
  • the LCD display 303 is located at a third distance 315, fe, from the eyepiece lens 305.
  • the eyepiece lens 305 is located at a fourth distance 317, also f e , from the eye-box 107.
  • the third distance 315 and the fourth distance 317 can be considered as the focal length of the eyepiece lens 305.
  • the optical rays of FIG. 3A shown only for a single pixel on the LCD display 303, indicate how switching on only the on-axis LED, the LED 30 IB, directs light from the LCD display 303 to the on-axis location of the human eye 309A and, specifically, to the eye-pupil 309B.
  • FIG. 3B shows an example of an occluded optical- architecture for a near-to-eye HMD projection system 320 with LEDs 201A, 20 IB, 201C (although only the lower of the two off-axis LEDs, the LED 301C, is lighted), switched on for an eye-pupil 309D alignment, in accordance with various embodiments of the disclosed subject matter.
  • the eye-pupil 309D of a human eye 309C is shifted to an uppermost portion of the eye-box 107.
  • the LED 301C shown only for a single pixel on the LCD display 303, indicate how switching on only the lower of the two off-axis LEDs, the LED 301C, directs light from the LCD display 303 to the off-axis location of the human eye 309C and, specifically, to the eye-pupil 309D.
  • FIG. 4 is an exemplary embodiment of a layout of an adaptive illuminator system 400 for an HMD with an eye-tracking module 423, in accordance with various embodiments of the disclosed subject matter.
  • the eye-tracking module 423 keeps track of a position of an eye-pupil of a human eye 417 within an eye-box (not shown explicitly within FIG. 4, but understandable based on descriptions of other eye-boxes disclosed herein).
  • the eye-tracking module 423 can comprise, for example, a camera, as is known in the art, or another type of eye-tracking device known in the relevant art. Further, although the eye-tracking module 423 is shown coupled to the adaptive illuminator system 400 with a particular type of display device, the same or similar type of eye-tracking module can be used with any of the embodiments disclosed herein. For example,, an eyetracking module can be used with the near-to-eye HMD projection system 200 of FIG. 2.
  • a signal is sent to a processor and commanding unit 421.
  • the processor and commanding unit 421 sends an additional signal directing an illumination driver 401, coupled to an LED array 403 (e.g., the same as or similar to the LED arrays of FIG. 2A, 2B, 3A, and 3B), to switch on (or off) one or more corresponding LEDs within the LED array 403, for a given determined location of the eye-pupil as determined by the eyetracking module 423.
  • the beam splitters 409, 415 may comprise a polarizing-type beam splitter to account for the change in polarization state once illumination provided from the LED array 403 reflects from the LCoS displaydevice 411.
  • the beam splitters may comprise, for example, plate beam splitters or cube beam splitters.
  • one or more of the beam splitters may be substituted by any optical device that is capable of splitting a beam of light into a partially transmitted beam and a partially reflected beam (e.g., a partially silvered mirror).
  • the LED array 403 can be an array of only white LEDs, or it can be an array of RGB LEDs, or various other types, colors, and combinations of colors of LEDs.
  • the LCoS display- device 411 can include RGB filters to generate colored images.
  • the LCoS display-device 411 can be used without color filters and can be synchronized with the red, green, and blue LEDs with corresponding patterns for red, green, and blue frames to generate colored images.
  • FIG. 5 shows an exemplary embodiment of an optical layout for a near-to-eye HMD projection system 500 having an LED 501, a collimator lens 503, an LCD display 505, an eyepiece lens 507, and a human eye 509A with an eye-pupil 509B, in accordance with various embodiments of the disclosed subject matter.
  • FIG. 5 is also shown to include a first distance 511, si (e.g., an arbitrary LED-to-collimator distance), a second distance 513, d, a third distance 515, f e , and a fourth distance 517, S2 (e.g., an arbitrary eyepiece-to-eye-pupil distance).
  • FIG. 5 is provided so that a person of ordinary skill in the art may better appreciate how locations of various components within any of the adaptive illumination systems (e.g., projection systems) disclosed herein may be determined.
  • a person of ordinary skill in the art can calculate the size of an adaptive eye-box using the magnification of the LED image on the eye-pupil location to a first- order Gaussian approximation. For example, with continuing reference to a general optical layout of FIG. 5, with the first distance, an arbitrary LED-to-collimator distance of s 1( and a fourth distance 517, an eyepiece to eye-pupil distance of s 2 , adaptive eye-box location is at:
  • An area defined by these dimensions for the LED could include a single emitter or multiple mini- or micro -emitters with, for example, RGB colors.
  • FIG. 6 shows an exemplary embodiment of an eye-box size and location diagram 600 for an occluded on-axis near-to-eye HMD, in accordance with various embodiments of the disclosed subject matter.
  • FIG. 6 is shown to include an LCD display 601, having a first dimension Di (height Ha), an eyepiece lens 603, having a second dimension D2 (height H e ), and an eye-box 107 having an open aperture with a third dimension D3 (height Hb).
  • the third dimension D3 (height Hb) defines a region of the eye-box 107 without vignetting.
  • FIG. 6 shows an exemplary embodiment of an eye-box size and location diagram 600 for an occluded on-axis near-to-eye HMD, in accordance with various embodiments of the disclosed subject matter.
  • FIG. 6 is shown to include an LCD display 601, having a first dimension Di (height Ha), an eyepiece lens 603, having a second dimension D2 (height H e ), and an eye-box 107 having
  • a region 611 of a volume of the eye-box 107 is shown that is substantially free of vignetting.
  • a relative size of the eye-box 107 is calculated for an HMD with the LCD display 601, having a size of H d , and eye piece aperture size of H e , at a distance of d e from the eye piece lens as indicated by equation (4).
  • the adaptive eye-box is a subset of the system eyebox which can be scanned (or positioned) to the location of an eyepupil.
  • FIG. 7 shows an exemplary embodiment of a see-through configuration of an HMD with an adaptive eye-box illuminator, in accordance with various embodiments of the disclosed subject matter.
  • the adaptive eye-box illuminator system of FIG. 7 is shown to include LEDs 701A, 70 IB, 701C (with only the on-axis LED 70 IB being lighted for this example), a collimator lens 703, a first cube-type beam-splitter 705, having a first beam-splitter surface 707, a reflective, liquid crystal on silicon (LCoS) display-device 709, an eyepiece lens 711, and a second cube-type beam-splitter 713, having a second beam-splitter surface 715.
  • LEDs 701A, 70 IB, 701C with only the on-axis LED 70 IB being lighted for this example
  • a collimator lens 703 a first cube-type beam-splitter 705, having a first beam
  • the second beam-splitter surface 715 reflects light from the LCoS display-device 709, illuminated by the LED 70 IB, to an eye-pupil 717B of a human eye 717A.
  • the collimator lens 703 and the eyepiece lens 711 may the same as or similar to, for example, the collimator lens 207 and the eyepiece lens 205, respectively, of FIG. 2B.
  • the cube-type beam splitters 705, 713 may each comprise a polarizing-type beam splitter to account for the change in polarization state once illumination provided from a selected one or ones of the LEDs 701A, 70 IB, 701C reflects from the LCoS display-device 709.
  • the cubetype beam splitters 705, 713 may instead comprise, for example, plate beam-splitters.
  • one or more of the beam splitters may be substituted by any optical device that is capable of splitting a beam of light into a partially transmitted beam and a partially reflected beam (e.g., a partially silvered mirror).
  • the LEDs 701A, 70 IB, 701C may be considered as being part of an LED array.
  • FIG. 8 shows an exemplary embodiment of a compact-design alternative of a see-through HMD with an adaptive eye box illuminator, in accordance with various embodiments of the disclosed subject matter.
  • FIG. 8 is shown to include LEDs 801A, 80 IB, 8010 (with only the on-axis LED 80 IB being lighted for this example), a collimator lens 803, a reflective, liquid crystal on silicon (LCoS) display- device 809, and a single, prismatic component 805A.
  • LEDs 801A, 80 IB, 8010 with only the on-axis LED 80 IB being lighted for this example
  • a collimator lens 803 a reflective, liquid crystal on silicon (LCoS) display- device 809
  • a single, prismatic component 805A a single, prismatic component
  • the a single, prismatic component 805A includes a first beam-splitter surface 807, a second beam-splitter surface 811, and an eyepiece lens 805B (e.g., a concave, reflecting lens or reflecting lens element).
  • the second beam-splitter surface 811 reflects light from the LCoS display- device 809 illuminated by the LED 80 IB, and reflected by the eyepiece lens 805B, to an eye-pupil 807B of a human eye 807A.
  • the collimator lens 803 may the same as or similar to, for example, the collimator lens 207 of FIG. 2B.
  • the LEDs 801A, 80 IB, 801C may be considered as being part of an LED array.
  • FIG. 9 shows an exemplary embodiment of a near-to-eye HMD folded-design with thin polarizing beam-splitters (PBSs) 905, 911 in a see-through HMD-system design.
  • FIG. 9 is shown to include LEDs 901A, 90 IB, 901C (with only the on-axis LED 90 IB being lighted for this example), a collimator lens 903, a reflective, liquid crystal on silicon (LCoS) display- device 907, a first polarizing-type beam-splitter 905, a second polarizing-type beam-splitter 911, and an eyepiece lens 909.
  • LEDs 901A, 90 IB, 901C with only the on-axis LED 90 IB being lighted for this example
  • a collimator lens 903 a reflective, liquid crystal on silicon (LCoS) display- device 907
  • a first polarizing-type beam-splitter 905 a second polarizing-type beam-splitter 911
  • the second polarizing-type beam-splitter 911 reflects light from the LCoS display- device 907 illuminated by the LED 90 IB, and directed through by the eyepiece lens 909, to an eyepupil 913B of a human eye 913A.
  • the collimator lens 903 and the eyepiece lens 909 may the same as or similar to, for example, the collimator lens 207 and the eyepiece lens 909, respectively, of FIG. 2B.
  • the LEDs 901A, 90 IB, 901C may be considered as being part of an LED array.
  • Example 1 An embodiment of the disclosed subject-matter describes an apparatus to provide adaptive illumination to portions of an eye-box in which an eye-pupil is located.
  • the apparatus includes a light-emitting diode (LED) array having a plurality of LEDs. Each of the plurality of LEDs is individually addressable in subsets of the LED array with at least one of the plurality of LEDs within a subset of the LED array being configured to be lighted based on a location of the eye-pupil with the eye-box.
  • the apparatus further includes a collimating element located between the LED array and the eye-box.
  • a display device is located between the collimating lens and the eyebox; the display device is configured to generate images.
  • An eyepiece element is located between the display device and the eye-box to receive light from the at least one of the plurality of LEDs within the subset of the LED array and to project the images generated by the display device toward a location of the eye-pupil within an area of the eye-box.
  • Example 2 The apparatus of Example 1, wherein the subsets of the LED array comprise at least one LED and fewer than all of the LEDs within the LED array.
  • Example 3 The apparatus of either Example 1 or Example 2, wherein the display device is a liquid crystal display (LCD) device.
  • LCD liquid crystal display
  • Example 4 The apparatus of any one of the preceding Examples, further comprising an eye-tracking module to determine the location of the eye-pupil within the eye-box.
  • Example 5 The apparatus of Example 4, further comprising an illumination driver coupled to the LED array to switch one or more of the plurality of LEDs within the subset of the LED array that correspond to the determined location of the eye-pupil with the eyebox.
  • Example 6 The apparatus of Example 5, further comprising a processor and commanding unit configured to send a signal directing the illumination driver to switch the one or more of the plurality of LEDs within the subset of the LED array based on the determined location of the eye-pupil with the eye-box.
  • Example 7 The apparatus of any one of the preceding Examples, wherein the apparatus is a portion of a head-mounted display (HMD).
  • HMD head-mounted display
  • Example 8 The apparatus of Example 7, wherein the apparatus is a portion of an occluded optical-architecture of the HMD, whereby at least a portion of a scene viewable to a wearer of the HMD is blocked by the apparatus.
  • Example 9 The apparatus of Example 7, further comprising at least one beam splitter located between the LED array and the eyebox, wherein the at least one beam splitter allows a wearer of the HMD to view a substantial entirety of a scene that is not blocked by the apparatus.
  • Example 10 An embodiment of the disclosed subject-matter describes a head-mounted display (HMD) with an adaptive illumination apparatus.
  • the HMD includes a light-emitting diode (LED) array having a plurality of LEDs. Each of the plurality of LEDs is individually addressable in subsets of the LED array, with at least one of the plurality of LEDs within a subset of the LED array being configured to be lighted based on a location of an eye-pupil with a volume of an eye-box within the HMD.
  • a collimating element is located between the LED array and the eye-box.
  • a display device is located between the collimating lens and the eye-box, with the display device being configured to generate images.
  • An eyepiece element is located between the display device and the eye-box to receive light from the at least one of the plurality of LEDs within the subset of the LED array and to project the images generated by the display device toward a location of the eye-pupil within a volume of the eye-box.
  • At least one beam splitter is located between the LED array and the eyebox. The at least one beam splitter is configured to allow a wearer of the HMD to view a substantial entirety of a scene that is not blocked by the adaptive illumination apparatus.
  • Example 11 The HMD of Example 10, wherein the subsets of the LED array comprise at least one LED and fewer than all of the LEDs within the LED array.
  • Example 12 The HMD of either Example 10 or Example 11, wherein the display device is a liquid crystal display (LCD) device.
  • Example 13 The HMD of any one of Example 10 through Example 12, further comprising an eye-tracking module to determine the location of the eye-pupil within the eye-box.
  • Example 14 The HMD of Example 13, further comprising an illumination driver coupled to the LED array to switch one or more of the plurality of LEDs within the subset of the LED array that correspond to the determined location of the eye-pupil with the eyebox.
  • Example 15 The HMD of Example 13, further comprising a processor and commanding unit configured to send a signal directing the illumination driver to switch the one or more of the plurality of LEDs within the subset of the LED array based on the determined location of the eye-pupil with the eye-box.
  • Example 16 An embodiment of the disclosed subject-matter describes a method for providing adaptive illumination to portions of an eye-box in which an eye-pupil is located. The method includes determining a position of the eye-pupil; sending a signal to a lightemitting diode (LED) array having a plurality of LEDs, where each of the plurality of LEDs is individually addressable in subsets of the LED array; and lighting at least one of the plurality of LEDs within the subset of the LED array based on the determined location of the eye-pupil with the eye-box.
  • LED lightemitting diode
  • Example 17 The method of Example 16, further comprising: receiving light from the illuminated portions of LED array by the at least one of the plurality of LEDs within the subset of the LED array and projecting images generated by a display device toward a location of the eye-pupil within a volume of the eye-box.
  • Example 18 The method of either one of Example 16 or Example 17, further comprising switching the one or more of the plurality of LEDs within the subset of the LED array that correspond to the determined location of the eye-pupil with the eye-box.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)

Abstract

Divers modes de réalisation comprennent des appareils et des procédés pour fournir un éclairage adaptatif à des parties d'une région oculaire dans laquelle une pupille d'œil est située. Dans un exemple, un appareil est divulgué qui comprend un réseau de diodes électroluminescentes (DEL) ayant une pluralité de DEL, chacune de la pluralité de DEL étant adressable individuellement dans des sous-ensembles du réseau de DEL, un élément de collimation situé entre le réseau de DEL et la région oculaire, un dispositif d'affichage pour générer des images, et un oculaire pour recevoir la lumière provenant d'au moins l'une de la pluralité de DEL à l'intérieur du sous-ensemble du réseau de DEL et pour projeter les images générées par le dispositif d'affichage vers un emplacement de la pupille oculaire à l'intérieur d'un volume de la région oculaire. L'invention concerne d'autres appareils et procédés.
PCT/US2023/082570 2022-12-15 2023-12-05 Illuminateur adaptatif pour affichages montés sur la tête (hmds) Ceased WO2024129446A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
EP23841403.1A EP4634718A1 (fr) 2022-12-15 2023-12-05 Illuminateur adaptatif pour affichages montés sur la tête (hmds)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US202263432966P 2022-12-15 2022-12-15
US63/432,966 2022-12-15

Publications (1)

Publication Number Publication Date
WO2024129446A1 true WO2024129446A1 (fr) 2024-06-20

Family

ID=89619927

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2023/082570 Ceased WO2024129446A1 (fr) 2022-12-15 2023-12-05 Illuminateur adaptatif pour affichages montés sur la tête (hmds)

Country Status (2)

Country Link
EP (1) EP4634718A1 (fr)
WO (1) WO2024129446A1 (fr)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6094309A (en) * 1998-01-28 2000-07-25 U.S. Philips Corporation Head-mounted display
US6219186B1 (en) * 1998-04-06 2001-04-17 Optimize Incorporated Compact biocular viewing system for an electronic display
WO2018200417A1 (fr) * 2017-04-24 2018-11-01 Pcms Holdings, Inc. Systèmes et procédés destinés à des affichages 3d à couches optiques flexibles
CN113608353A (zh) * 2021-07-14 2021-11-05 上海大学 一种基于阵列光源的全息近眼显示系统及眼瞳箱扩展方法
CN115145036A (zh) * 2022-06-07 2022-10-04 上海大学 基于光源阵列的大视场角高分辨全息近眼显示装置和显示方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6094309A (en) * 1998-01-28 2000-07-25 U.S. Philips Corporation Head-mounted display
US6219186B1 (en) * 1998-04-06 2001-04-17 Optimize Incorporated Compact biocular viewing system for an electronic display
WO2018200417A1 (fr) * 2017-04-24 2018-11-01 Pcms Holdings, Inc. Systèmes et procédés destinés à des affichages 3d à couches optiques flexibles
CN113608353A (zh) * 2021-07-14 2021-11-05 上海大学 一种基于阵列光源的全息近眼显示系统及眼瞳箱扩展方法
CN115145036A (zh) * 2022-06-07 2022-10-04 上海大学 基于光源阵列的大视场角高分辨全息近眼显示装置和显示方法

Also Published As

Publication number Publication date
EP4634718A1 (fr) 2025-10-22

Similar Documents

Publication Publication Date Title
US10663735B2 (en) Head-mounted display
US8705177B1 (en) Integrated near-to-eye display module
US9298002B2 (en) Optical configurations for head worn computing
US8503087B1 (en) Structured optical surface
JP6571110B2 (ja) 自己発光型マイクロディスプレイエンジンを有する接眼ディスプレイ
KR101556839B1 (ko) 다중 반사기를 구비하는 눈 인접 디스플레이를 위한 접안렌즈
US6005720A (en) Reflective micro-display system
US5657165A (en) Apparatus and method for generating full-color images using two light sources
EP3243098B1 (fr) Visiocasque ayant un réseau de microlentilles incurvées
US11675206B1 (en) Display with a resolution enhanced region
US20190317323A1 (en) Head-up display device
US11340462B2 (en) Electronic device
US20230023995A1 (en) Display illumination using a grating
US12276796B2 (en) Light field directional backlighting based three-dimensional (3D) pupil steering
US12105290B2 (en) Optical design of a dual combiner in head-wearable display
JP4835327B2 (ja) 映像表示装置、及び頭部装着式映像表示装置
US11988827B2 (en) Method and system for displaying images
US20250053008A1 (en) Optical waveguide with integrated optical elements
JPWO2018043254A1 (ja) 映像表示装置と光学シースルーディスプレイ
WO2020255562A1 (fr) Dispositif d'affichage d'image et dispositif d'affichage
WO2024129446A1 (fr) Illuminateur adaptatif pour affichages montés sur la tête (hmds)
JP2016110146A (ja) 画像表示装置
JP2021152565A (ja) 表示装置及び光学素子
US20250370265A1 (en) Autostereoscopic display device with high brightness and a wide field of view
US20250067981A1 (en) Binocular display system for an eyewear display

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 23841403

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2023841403

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 2023841403

Country of ref document: EP

Effective date: 20250715

WWP Wipo information: published in national office

Ref document number: 2023841403

Country of ref document: EP