[go: up one dir, main page]

WO2025171242A1 - Projection d'image bidimensionnelle (2d) holographique pour un affichage à guide d'ondes à réalité augmentée (ar) - Google Patents

Projection d'image bidimensionnelle (2d) holographique pour un affichage à guide d'ondes à réalité augmentée (ar)

Info

Publication number
WO2025171242A1
WO2025171242A1 PCT/US2025/014979 US2025014979W WO2025171242A1 WO 2025171242 A1 WO2025171242 A1 WO 2025171242A1 US 2025014979 W US2025014979 W US 2025014979W WO 2025171242 A1 WO2025171242 A1 WO 2025171242A1
Authority
WO
WIPO (PCT)
Prior art keywords
slm
display
waveguide
eye
examples
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
PCT/US2025/014979
Other languages
English (en)
Inventor
Changwon Jang
Manu Gopakumar
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Meta Platforms Technologies LLC
Original Assignee
Meta Platforms Technologies LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Meta Platforms Technologies LLC filed Critical Meta Platforms Technologies LLC
Publication of WO2025171242A1 publication Critical patent/WO2025171242A1/fr
Pending legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0081—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for altering, e.g. enlarging, the entrance or exit pupil
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0123—Head-up displays characterised by optical features comprising devices increasing the field of view
    • G02B2027/0125—Field-of-view increase by wavefront division
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G02B2027/0174—Head mounted characterised by optical features holographic
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B26/00—Optical devices or arrangements for the control of light using movable or deformable optical elements
    • G02B26/06—Optical devices or arrangements for the control of light using movable or deformable optical elements for controlling the phase of light
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking

Definitions

  • HMD head-mounted display
  • the HMD device may project or direct light to display virtual objects or combine images of real objects with virtual objects, as in virtual reality (VR), augmented reality (AR), or mixed reality (MR) applications.
  • VR virtual reality
  • AR augmented reality
  • MR mixed reality
  • a user may view both images of virtual objects (e.g., computer-generated images (CGIs)) and the surrounding environment.
  • CGIs computer-generated images
  • HMD devices may also present interactive content, where a user’s (wearer’s) gaze may be used as input for the interactive content.
  • an augmented reality / virtual reality (AR/VR) near-eye display device comprising: a display system to render AR/VR content comprising: a waveguide display; and a holographic two-dimensional (2D) projection module employing at least one spatial light modulator (SLM), wherein the at least one SLM is illuminated by a planar wavefront; an eye tracking system; and a controller to manage the display system and the eye tracking system.
  • a display system to render AR/VR content comprising: a waveguide display; and a holographic two-dimensional (2D) projection module employing at least one spatial light modulator (SLM), wherein the at least one SLM is illuminated by a planar wavefront; an eye tracking system; and a controller to manage the display system and the eye tracking system.
  • 2D holographic two-dimensional
  • the holographic 2D projection module further comprises: a half-band filter.
  • the at least one SLM is a complex wavefront modulation SLM.
  • a near-eye display device comprising: a waveguide display to display augmented reality I virtual reality (AR/VR) content to a user; and a holographic projection module to generate and project a two-dimensional (2D) image into the waveguide display for the waveguide display to form three-dimensional (3D) content for the user, wherein the holographic projection module comprises: a spatial light modulator (SLM) to be illuminated by a planar wavefront and then to modulate and to project the patterned light planar wavefront; a holographic optical element (HOE) to receive and project the patterned light planar wavefront; and a switchable lens to receive the patterned light planar wavefront from the HOE and project the 2D image into the waveguide display.
  • SLM spatial light modulator
  • HOE holographic optical element
  • FIGS. 6A through 6E are block diagrams of waveguide holography systems illustrating various configurations of holographic projection modules where a two-dimensional (2D) hologram is projected substantially directly into a waveguide display, according to various examples.
  • the display electronics 122 may display or facilitate the display of images to the user according to data received from, for example, the optional console 110.
  • the display electronics 122 may include one or more display panels.
  • the display electronics 122 may include any number of pixels to emit light of a predominant color such as red, green, blue, white, or yellow.
  • the display electronics 122 may display a three- dimensional (3D) image by, e.g., using stereoscopic effects produced by two- dimensional (2D) panels to create a subjective perception of image depth.
  • the optional console 110 may include a processor and a non-transitory computer-readable storage medium storing instructions executable by the processor.
  • the processor may include multiple processing units executing instructions in parallel.
  • the non-transitory computer-readable storage medium may be any memory, such as a hard disk drive, a removable memory, or a solid-state drive (e.g., flash memory or dynamic random access memory (DRAM)).
  • the modules of the optional console 110 described in conjunction with FIG. 1 may be encoded as instructions in the non-transitory computer-readable storage medium that, when executed by the processor, cause the processor to perform the functions further described below. It should be appreciated that the optional console 110 may or may not be needed or the optional console 110 may be integrated with or separate from the near-eye display 120.
  • the headset tracking module 1 14 may track movements of the near-eye display 120 using slow calibration information from the external imaging device 150. For example, the headset tracking module 114 may determine positions of a reference point of the near-eye display 120 using observed locators from the slow calibration information and a model of the near-eye display 120. Additionally, in some examples, the headset tracking module 114 may use portions of the fast calibration information, the slow calibration information, or any combination thereof, to predict a future location of the near-eye display 120. In some examples, the headset tracking module 1 14 may provide the estimated or predicted future position of the near-eye display 120 to the virtual reality engine 116.
  • a projector mounted in a display system may be placed near and/or closer to a user’s eye (i.e. , “eye-side”).
  • a projector for a display system shaped like eyeglasses may be mounted or positioned in a temple arm (i.e., a top far corner of a lens side) of the eyeglasses. It should be appreciated that, in some instances, utilizing a back-mounted projector placement may help to reduce size or bulkiness of any required housing required for a display system, which may also result in a significant improvement in user experience for a user.
  • FIG. 3 is a perspective view of a near-eye display 300 in the form of a pair of glasses (or other similar eyewear), according to an example.
  • the near-eye display 300 may be a specific example of near-eye display 120 of FIG. 1 and may be configured to operate as a virtual reality (VR) display, an augmented reality (AR) display, and/or a mixed reality (MR) display.
  • the near-eye display 300 may include a frame 305 and a display 310.
  • the display 310 may be configured to present media or other content to a user.
  • the display 310 may include display electronics and/or display optics, similar to components described with respect to FIGS. 1 and 2A-2C.
  • the display 310 may include a liquid crystal display (LCD) display panel, a light-emitting diode (LED) display panel, or an optical display panel (e.g., a waveguide display assembly).
  • the display 310 may also include any number of optical components, such as waveguides, gratings, lenses, mirrors, etc.
  • the display 310 may include a projector, or in place of the display 310 the near-eye display 300 may include a projector.
  • the near-eye display 300 may further include various sensors on orwithin a frame 305.
  • the various sensors may include any number of depth sensors, motion sensors, position sensors, inertial sensors, and/or ambient light sensors, as shown.
  • the various sensors may include any number of image sensors configured to generate image data representing different fields of views in one or more different directions.
  • the various sensors may be used as input devices to control or influence the displayed content of the near-eye display, and/or to provide an interactive virtual reality (VR), augmented reality (AR), and/or mixed reality (MR) experience to a user of the near- eye display 300.
  • the various sensors may also be used for stereoscopic imaging or other similar applications.
  • the in-coupling grating 521 A/B may be disposed on the other side of the waveguide 520A/B or integrated inside the waveguide 520A/B, and/or may be functionally distributed among a number of gratings, and may include diffractive, reflective, geometric, etc., gratings.
  • the out-coupling grating 523A/B may be disposed in any suitable location, and/or may be functionally distributed among a number of gratings, and may include diffractive, reflective, geometric, etc., gratings.
  • the projected wavefront may be modulated to achieve various improvements in AR/VR waveguide displays using the principle of holographic display.
  • a 2D hologram may be projected into the waveguide allowing control of exit-pupil size, image resolution, dynamic range, and uniformity of image.
  • FIG. 6B shows a second configuration of a holographic projection module for projecting a 2D hologram substantially directly into a waveguide display according to some examples.
  • the holographic projection module includes an SLM 61 OB illuminated by a planar wavefront (not shown), a projection lens 613B, a half-band filter 618B, and a waveguide 620B.
  • the half-band filter 618B may form an aperture (in Fourier domain), which is controllable by a phase pattern displayed on the SLM 61 OB.
  • the half-band filter 618B may also block DC order noise (if it exists). As indicated by the two-headed vertical arrow in FIG.
  • FIG. 6E shows a fifth configuration of a holographic projection module for projecting a 2D hologram substantially directly into a waveguide display according to some examples.
  • the holographic projection module includes two SLMs, i.e., SLM1 611 E and SLM2 612E, with the first SLM, SLM1 611 E, illuminated with a plane wavefront, no projection lens, and the light is projected through the second SLM, SLM2612E, to project patterned light 615E directly into a waveguide 620E.
  • SLM1 611 E the first SLM
  • SLM1 611 E illuminated with a plane wavefront, no projection lens
  • the SLM1 611 E and/or SLM2 612E may be communicatively connected to, and/or under the control of, a controller 680E, and the controller 680E may be communicatively connected to, and/or controlling, other components in the near-eye display system (e.g., the one or more laser sources for the SLM1 611 E, the tilt of the 2 SLMs in some examples, any other active components, etc.).
  • the controller 680E may include a processor 683E and a memory 685E which may store instructions executable by the processor 683E to perform any of the methods described herein.
  • the light may be projected out through a translating pupil iris 762 to a lens 764 for a camera 766.
  • the light may be projected out to a user’s eye.
  • the controllers 480A, 580A/B, 680A-E, 780, and/or 880, respectively may include the processors 483A, 583A/B, 683A-E, 783, and/or 883, respectively, and the memories 485A, 585A/B, 685A-E, 785, and/or 885, respectively.
  • the controller 480A, 580A/B, 680A-E, 780, and/or 880 may be implemented as hardware, software, and/or a combination of hardware and software in the near-eye display device.
  • the processor 483A, 583A/B, 683A- E, 783, and/or 883 may be implemented with a general purpose single- and/or multichip processor, a single- and/or multi-core processor, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA), or other programmable logic device, discrete gate or transistor logic, discrete hardware components, and/or any combination thereof suitable to perform the functions described herein.
  • a general purpose processor may be any conventional processor, microprocessor, controller, microcontroller, and/or state machine.
  • a method of providing holographic 2D image projection in an augmented reality/virtual reality (ARA/R) system is described herein.
  • a system of providing holographic 2D image projection in an AR/VR system is also described herein.
  • a non-transitory computer-readable storage medium may have an executable stored thereon, which when executed instructs a processor to perform the methods described herein.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)

Abstract

L'invention concerne des systèmes, des procédés et/ou des appareils pour un module de projection holographique dans un dispositif d'affichage proche de l'œil, qui peuvent afficher un contenu de réalité augmentée/réalité virtuelle (AR/VR) à l'utilisateur. Selon un aspect, un modulateur spatial de lumière (SLM) est éclairé par un front d'onde plan, que le SLM module avec un motif et projette la lumière à motifs à travers une lentille de projection pour former un hologramme 2D qui est entré dans un affichage à guide d'ondes. Certains exemples peuvent comprendre un filtre d'ordre élevé pour former une ouverture dans le domaine de Fourier pouvant être commandée par le motif de phase affiché sur le SLM ; d'autres exemples peuvent ne pas avoir de lentilles de projection, l'image SLM affichée correspondant à la représentation d'image de domaine de Fourier perçue par l'utilisateur. Certains exemples peuvent utiliser deux SLM empilés, un SLM de modulation de front d'onde complexe, et/ou un SLM de phase avec un masque (tel que, par exemple, un masque d'amplitude binaire).
PCT/US2025/014979 2024-02-09 2025-02-07 Projection d'image bidimensionnelle (2d) holographique pour un affichage à guide d'ondes à réalité augmentée (ar) Pending WO2025171242A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US202463551604P 2024-02-09 2024-02-09
US63/551,604 2024-02-09

Publications (1)

Publication Number Publication Date
WO2025171242A1 true WO2025171242A1 (fr) 2025-08-14

Family

ID=94869707

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2025/014979 Pending WO2025171242A1 (fr) 2024-02-09 2025-02-07 Projection d'image bidimensionnelle (2d) holographique pour un affichage à guide d'ondes à réalité augmentée (ar)

Country Status (1)

Country Link
WO (1) WO2025171242A1 (fr)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180120563A1 (en) * 2016-11-01 2018-05-03 Microsoft Technology Licensing, Llc Holographic projector for waveguide display
US9964925B2 (en) 2015-12-29 2018-05-08 Oculus Vr, Llc Holographic display architecture
US20190369403A1 (en) * 2017-02-13 2019-12-05 Seereal Technologies S.A. Light guide device and display device for representing scenes
US20220350219A1 (en) * 2019-06-23 2022-11-03 Lumus Ltd. Display with foveated optical correction

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9964925B2 (en) 2015-12-29 2018-05-08 Oculus Vr, Llc Holographic display architecture
US20180120563A1 (en) * 2016-11-01 2018-05-03 Microsoft Technology Licensing, Llc Holographic projector for waveguide display
US20190369403A1 (en) * 2017-02-13 2019-12-05 Seereal Technologies S.A. Light guide device and display device for representing scenes
US20220350219A1 (en) * 2019-06-23 2022-11-03 Lumus Ltd. Display with foveated optical correction

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
"Waveguide Holography: Towards True 3D Holographic Glasses", ARXIV:2221.02784V1, 4 November 2022 (2022-11-04)

Similar Documents

Publication Publication Date Title
US10775633B1 (en) Exit pupil steering for near-eye displays
CN107850780B (zh) 全息近眼显示
JP7420893B2 (ja) 別個の位相および振幅変調器を伴う接眼３ｄディスプレイ
US11885967B2 (en) Phase structure on volume Bragg grating-based waveguide display
JP2023509295A (ja) 中心窩適応ディスプレイシステム
US11022939B2 (en) Reduced bandwidth holographic near-eye display
US11695913B1 (en) Mixed reality system
JP2023509294A (ja) スイッチ可能なパンチャラトナム－ベリー位相格子積層体
US20220091560A1 (en) Lightguide based holographic display
US10935794B1 (en) Low-obliquity beam scanner with polarization-selective grating
US12276796B2 (en) Light field directional backlighting based three-dimensional (3D) pupil steering
US12339454B2 (en) Display systems with waveguide configuration to mitigate rainbow effect
US12085717B2 (en) Hybrid waveguide to maximize coverage in field of view (FOV)
US11927758B1 (en) Multi-laser illuminated mixed waveguide display with volume Bragg grating (VBG) and mirror
WO2025171242A1 (fr) Projection d'image bidimensionnelle (2d) holographique pour un affichage à guide d'ondes à réalité augmentée (ar)
US20250208412A1 (en) Wide field of view (fov) waveguide eye tracking system
EP4414769A1 (fr) Scanner à faisceau bidimensionnel à faisceau plié
EP4575595A1 (fr) Couche d'hologramme volumique à polarisation réfléchissante dans un ensemble optique de réalité augmentée/réalité virtuelle
US20250291411A1 (en) Eye tracking via dense point cloud scanning using a light beam source and a reflective and/or diffractive surface
US20230314846A1 (en) Configurable multifunctional display panel
US20230314716A1 (en) Emission of particular wavelength bands utilizing directed wavelength emission components in a display system
US20230236415A1 (en) Image generation and delivery in a display system utilizing a two-dimensional (2d) field of view expander
KIM et al. SUPER MULTI-VIEW NEAR-EYE DISPLAY WITH LED ARRAY AND WAVEGUIDE ILLUMINATION MODULE

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 25709550

Country of ref document: EP

Kind code of ref document: A1