[go: up one dir, main page]

WO2025049975A4 - System and methods for display of 3d multi-media - Google Patents

System and methods for display of 3d multi-media Download PDF

Info

Publication number
WO2025049975A4
WO2025049975A4 PCT/US2024/044765 US2024044765W WO2025049975A4 WO 2025049975 A4 WO2025049975 A4 WO 2025049975A4 US 2024044765 W US2024044765 W US 2024044765W WO 2025049975 A4 WO2025049975 A4 WO 2025049975A4
Authority
WO
WIPO (PCT)
Prior art keywords
hologram
optical
quantization
hologram pattern
quadrant
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
PCT/US2024/044765
Other languages
French (fr)
Other versions
WO2025049975A1 (en
Inventor
Edward Buckley
Andrzej KACZOROWSKI
Theodore Michel MARESCAUX
Richard Stahl
Gebirie Yizengaw BELAY
Joel Steven Kollin
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Swave BV
Original Assignee
Swave BV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Swave BV filed Critical Swave BV
Priority to PCT/US2025/010721 priority Critical patent/WO2025151505A1/en
Publication of WO2025049975A1 publication Critical patent/WO2025049975A1/en
Publication of WO2025049975A4 publication Critical patent/WO2025049975A4/en
Pending legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50—Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/54—Browsing; Visualisation therefor
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B27/0103—Head-up displays characterised by optical features comprising holographic elements
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/20—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images by providing first and second parallax images to an observer's left and right eyes
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04—Processes or apparatus for producing holograms
    • G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
    • G03H1/0808—Methods of numerical synthesis, e.g. coherent ray tracing [CRT], diffraction specific
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04—Processes or apparatus for producing holograms
    • G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
    • G03H1/0841—Encoding method mapping the synthesized field into a restricted set of values representative of the modulator parameters, e.g. detour phase coding
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G02B2027/0174—Head mounted characterised by optical features holographic
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/22—Processes or apparatus for obtaining an optical image from holograms
    • G03H1/2294—Addressing the hologram to an active spatial light modulator
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04—Processes or apparatus for producing holograms
    • G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
    • G03H1/0808—Methods of numerical synthesis, e.g. coherent ray tracing [CRT], diffraction specific
    • G03H2001/0816—Iterative algorithms
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H1/00—Holographic processes or apparatus using light, infrared or ultraviolet waves for obtaining holograms or for obtaining an image from them; Details peculiar thereto
    • G03H1/04—Processes or apparatus for producing holograms
    • G03H1/08—Synthesising holograms, i.e. holograms synthesized from objects or objects from holograms
    • G03H1/0808—Methods of numerical synthesis, e.g. coherent ray tracing [CRT], diffraction specific
    • G03H2001/0825—Numerical processing in hologram space, e.g. combination of the CGH [computer generated hologram] with a numerical optical element
    • G—PHYSICS
    • G03—PHOTOGRAPHY; CINEMATOGRAPHY; ANALOGOUS TECHNIQUES USING WAVES OTHER THAN OPTICAL WAVES; ELECTROGRAPHY; HOLOGRAPHY
    • G03H—HOLOGRAPHIC PROCESSES OR APPARATUS
    • G03H2210/00—Object characteristics
    • G03H2210/40—Synthetic representation, i.e. digital or optical object decomposition
    • G03H2210/45—Representation of the decomposed object
    • G03H2210/454—Representation of the decomposed object into planes

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Holo Graphy (AREA)

Abstract

A method for a display device begins by receiving data representative of a set of two-dimensional (2D) scene layers, with each 2D scene layer having a corresponding predetermined display depth in a focus space, and generating a first hologram pattern for each 2D scene layer of the set of 2D scene layers to create a set of first hologram patterns, where each first hologram pattern of the a set of first hologram patterns is adapted to place an associated 2D scene layer at infinite depth. The method continues by using a mathematical lens function to convert each first hologram pattern of the set of first hologram patterns to a second hologram pattern to create a set of second hologram patterns, where each second hologram pattern is adapted to place an associated 2D scene layer at a corresponding predetermined display depth in the focus space. Finally, the method continues by aggregating the set of second hologram patterns to provide an aggregated hologram pattern.

Claims

AMENDED CLAIMS received by the International Bureau on 22 March 2025 (22.03.2025) What is claimed is:
1. A method for a display device, the method comprises: receiving data representative of a set of two-dimensional (2D) scene layers, each 2D scene layer having a corresponding predetermined display depth in a focus space; generating a first hologram pattern for each 2D scene layer of the set of 2D scene layers to create a set of first hologram patterns, wherein each first hologram pattern of the set of first hologram patterns is adapted to place an associated 2D scene layer at infinite depth; converting, using a mathematical lens function, each first hologram pattern of the set of first hologram patterns to a second hologram pattern to create a set of second hologram patterns, wherein each second hologram pattern is adapted to place an associated 2D scene layer at a corresponding predetermined display depth in the focus space; aggregating the set of second hologram patterns to provide an aggregated hologram pattern.
2. The method of claim 1, wherein the data is generated from at least one of a three-dimensional (3D) object or a three-dimensional (3D) scene.
3. The method of claim 1, further comprising: applying random phase to each 2D scene layer of the set of 2D scene layers.
4. The method of claim 1, further comprising: correcting, using an aberration correction function, the aggregated hologram pattern.
5. The method of claim 1, further comprising: converting, using a vision correction function, the aggregated hologram pattern, wherein the vision correction function is adapted to modify the aggregated hologram pattern to correct for a vision impairment.
6. The method of claim 1, wherein the mathematical lens function includes at least one of an aberration correction function or a vision correction function.
7. The method of claim 1, further comprising: finalizing, using a quantization function, the aggregated hologram pattern.
8. The method of claim 7, wherein the quantization function is based on one of error diffusion quantization or mask-based quantization.
9. The method of claim 7, wherein the quantized hologram pattern is rendered on the one or more spatial light modulator devices of the display device.
10. The method of claim 1, wherein each first hologram pattern of the set of first hologram patterns is generated using a Fourier transform.
11. A method for a display device, with the display device comprising at least one spatial light modulator device configured for rendering one or more hologram patterns, the method comprising: dividing the at least one spatial light modulator device into a set of subareas; generating a hologram pattern for a first subarea of the set of subareas; rendering the hologram pattern of the first subarea on each subarea of the set of subareas.
12. The method of claim 11, wherein each subarea of the set of subareas has a width equal to the width of every other subarea of the set of subareas and wherein each subarea further has a length equal to the length of every other subarea of the set of subareas.
13. A method for a display device, the method comprises: receiving data representative of media for display at a predetermined display depth in a focus space; generating, from the data, a first hologram pattern, wherein the first hologram pattern has a size corresponding to a portion of a spatial light modulator, wherein the first hologram pattern is adapted to place the media at an infinite depth; placing two or more replications of the first hologram pattern in an array creating a second hologram pattern, wherein the second hologram pattern is configured to have a width that is a multiple of a width of the first hologram pattern and wherein the second hologram pattern is further configured to have a length that is a multiple of a length of the first hologram pattern; converting, using a mathematical lens function, the second hologram pattern to a third hologram pattern, wherein the third hologram is adapted to place the media for display at a predetermined display depth in the focus space.
14. The method of claim 13, further comprising: applying random phase to the data representative of media before generating the first hologram pattern.
15. The method of claim 13, further comprising: correcting, using an aberration correction function, the third hologram pattern.
16. The method of claim 13, further comprising: converting, using a vision correction function, the third hologram pattern, wherein the vision correction function is adapted to modify the third hologram pattern to correct for a vision impairment.
17. The method of claim 13, wherein the mathematical lens function further includes one of an aberration correction function or a vision correction function.
18. The method of claim 13, further comprising: finalizing, using a quantization function, the third hologram pattern to provide a quantized hologram pattern.
19. The method of claim 18, wherein the quantization function is based on one of error diffusion quantization or mask-based quantization.
20. The method for a display device of claim 18, wherein the display device comprises one or more spatial light modulator devices, wherein the quantized hologram pattern is rendered on the one or more spatial light modulator devices.
21. The method of claim 12, wherein the first hologram pattern is generated using a Fourier transform.
22. A method for a display device, wherein the display device comprises at least one spatial light modulator device, the method comprises: receiving data representative of a set of two-dimensional (2D) scene layers, wherein a 2D scene layer has a corresponding predetermined display depth in a focus space; generating a first hologram pattern for each 2D scene layer of the set of 2D scene layers to create a set of first hologram patterns, wherein each first hologram pattern places an associated 2D scene layer at an infinite depth; wherein each first hologram pattern has a size corresponding to a portion of the at least one spatial light modulator device; for each first hologram pattern of the set of first hologram patterns, placing two or more replications of the first hologram pattern in an array creating a second hologram pattern to create a set of second hologram patterns, wherein a width of each second hologram pattern is a multiple of a width of an associated first hologram pattern and wherein a length of each second hologram pattern is a multiple of a length of an associated first hologram pattern converting, using a mathematical lens function, each second hologram pattern of the set of second hologram patterns to create a set of third hologram patterns, wherein each third hologram pattern is adapted to place an associated 2D scene layer at a corresponding predetermined display depth in the focus space; aggregating the set of third hologram patterns to provide an aggregated hologram pattern.
23. The method of claim 22, wherein each first hologram pattern of the set of first hologram patterns has a width equal to the width of every other first hologram pattern of the set of first hologram patterns and wherein each first hologram pattern further has a length equal to the length of every other first hologram pattern of the set of first hologram patterns.
24. The method of claim 22, wherein the data is generated from at least one of a three-dimensional (3D) object or a three-dimensional (3D) scene.
25. The method of claim 22, further comprising: applying random phase to each 2D scene layer of the set of 2D scene layers.
26. The method of claim 22, further comprising: correcting, using an aberration correction function, the aggregated hologram pattern.
27. The method of claim 22, further comprising: converting, using a vision correction function, the aggregated hologram pattern, wherein the vision correction function is adapted to modify the aggregated hologram pattern to correct for a vision impairment.
28. The method of claim 22, wherein the mathematical lens function further includes at least one of an aberration correction function or a vision correction function.
29. The method of claim 22, further comprising: finalizing, using a quantization function, the aggregated hologram pattern to provide a quantized hologram pattern.
30. The method of claim 29, wherein the quantization function is based on at least one of error diffusion quantization or mask-based quantization.
31. The method for a display device of claim 29, wherein the display device comprises one or more spatial light modulator devices, wherein the quantized hologram pattern is adapted for rendering on the one or more spatial light modulator devices.
32. The method of claim 22, wherein a first hologram pattern of the set of first hologram patterns is generated using a Fourier transform.
33. A method for execution by one or more processing modules of one or more computing devices of a mobile device, the method comprises: receiving a visual search request; capturing, in response to the visual search request, a scene; segmenting the scene into a plurality of elements; determining a relative depth of one or more elements of the plurality of elements; facilitating display of an indicator associated with one or more of the one or more elements; determining whether the indicator is associated with an element of interest; in response to a determination that the indicator is associated with an element of interest, transmitting sensor data associated with the element of interest to a processing device; receiving, from the processing device a reverse image search result; and facilitating display of an indicator representative of the reverse image search result.
34. The method of claim 33, wherein the segmenting the scene into a plurality of elements is executed by one or more processing devices, wherein the one or more processing devices are external to the mobile device and wherein segmented scene data is adapted for transmission to the mobile device by the one or more processing devices.
35. The method of claim 33, wherein the indicator associated with the element of interest is an outline of the element of interest.
36. The method of claim 35, wherein t)lg\/|>gt^©@£re®fqggqrti^ Rfp Q(iigiT|9)tcd reality overlay.
31. The method of claim 33, wherein the indicator associated with the element of interest is adapted for display at a predetermined depth relative to a depth of the element of interest.
38. The method of claim 37, wherein the relevant depth is a same depth as a depth of the element of interest.
39. The method of claim 33, wherein the indicator representative of the reverse image search result includes contextual information pertaining to the element of interest.
40. The method of claim 33, wherein the indicator representative of the reverse image search result is adapted for display at a predetermined depth relative to a depth of the element of interest.
41. The method of claim 40, wherein the relevant depth is a same depth as a depth of the element of interest.
42. The method of claim 33, wherein the processing device is a remote server.
43. The method of claim 33, wherein the mobile device is an augmented reality device.
44. The method of claim 43, wherein the mobile device is further configured to collect metadata.
45. The method of claim 44, further comprising: transmitting the metadata to the processing device.
46. The method of claim 44, wherein the metadata is captured by one or more sensors associated with the mobile device.
47. The method of claim 44, wherein the metadata comprises at least one of descriptive metadata, geospatial metadata or contextual metadata.
48. A method for execution by one or more processing modules of one or more computing devices of a mobile device, the method comprises: receiving a visual search request; capturing, in response to the visual search request, a scene; segmenting the scene into a plurality of elements; determining, based on a tracking element, a potential element of interest from the plurality of elements; determining a relative depth of the potential element of interest; facilitating display of an indicator associated with the potential element of interest; determining whether the indicator is associated with the actual element of interest; in response to a determination that the indicator is associated with the actual element of interest, transmitting sensor data associated with the actual element of interest to a processing device; receiving, from the processing device a reverse image search result; and facilitating display of an indicator representative of the reverse image search result.
49. The method of claim 48, wherein the tracking element is at least one of an eye tracking sensor or a gaze tracking sensor.
50. The method of claim 48, wherein the segmenting the scene into a plurality of elements is executed by one or more processing devices, wherein the one or more processing devices are external to the mobile device and wherein segmented scene data is adapted for transmission to the mobile device by the one or more processing devices.
51. The method of claim 48, wherein the indicator associated with any of the potential element of interest is an outline of the potential element of interest .
52. The method of claim 48, wherein the outline is representative of an augmented reality overlay.
53. The method of claim 48, wherein the indicator associated with the potential element of interest is displayed at a predetermined depth relative to a depth of the potential element of interest.
54. The method of claim 53, wherein the predetermined depth is a same depth as the depth of the potential element of interest.
55. The method of claim 48, wherein the indicator representative of the reverse image search result includes contextual information pertaining to the element of interest.
56. The method of claim 48, wherein the indicator representative of the reverse image search result is adapted for display at a predetermined depth relative to a depth of the element of interest.
57. The method of claim 56, wherein the predetermined depth is a same depth as the depth of the element of interest.
58. The method of claim 45, wherein the processing device is a remote server.
59. The method of claim 45, wherein the mobile device is an augmented reality device.
60. The method of claim 45, wherein the mobile device is further configured to collect metadata.
61. The method of claim 60, further comprising: transmitting metadata to the processing device.
62. The method of claim 60, wherein the metadata comprises at least one of descriptive metadata, geospatial metadata or contextual metadata.
63. The method of claim 60, wherein the metadata is captured by one or more sensors associated with the mobile device.
64. An augmented reality device comprises: an interface for interfacing with a network; a light source; one or more optical elements; memory; a spatial light modulator, wherein the spatial light modulator is configured to render a light interference pattern to provide a rendered light interference pattern, wherein a rendered light interference pattern is adapted for displaying media content at a predetermined distance relative to a user; and a processing module operably coupled to the interface and to the memory.
65. The augmented reality device of claim 64, wherein the processing module is further operable to: receive, via the interface, data representative of the light interference pattern; provide the data to the spatial light modulator for rendering; and facilitate illuminating, by the light source, the rendered light interference pattern.
66. The augmented reality device of claim 64, wherein the processing module is further operable to: receive, via the interface, data representative of media for display; transmit the data to another processing module; receive, from the another processing module, a light interference pattern; provide the light interference pattern to the spatial light modulator for rendering; and facilitate illuminating, by the light source, the rendered light interference pattern.
67. The augmented reality device of claim 64, wherein the processing module is configured to execute a Computer-Generated Holography (CGH) algorithm.
68. The augmented reality device of claim 67, wherein the CGH algorithm comprises at least one of a Fourier transform algorithm, a Fresnel transform algorithm, an iterative Fourier transform algorithm (IFTA), a point cloud method-based algorithm, an angular spectrum method-based algorithm, or a look-up table (LUT) method-based algorithm.
69. The augmented reality device of claim 64, wherein a rendered light interference pattern is associated with at least one of a two-dimensional (2D) image, a two-dimensional (2D) representation, two-dimensional (2D) information, a three-dimensional (3D) object or a three-dimensional (3D) scene.
70. An optical display system comprising: one or more spatial light modulators configured to display holographic images viewable by a user; one or more illumination sources; and one or more optical elements.
71. The optical display system of claim 70, wherein the holographic images comprise at least one of a two- dimensional (2D) image, a two-dimensional (2D) representation, two-dimensional (2D) information, a three- dimensional (3D) object or a three-dimensipa^glflJggjngHEET (ARTICLE 19)
72. The optical display system of claim 70 further comprising: one or more holographic processing modules configured to execute one or more Computer-Generated Holography (CGH) algorithms.
73. The optical display system of claim 72, wherein the one or more CGH algorithms comprise at least one of a Fourier transform algorithm, a Fresnel transform algorithm, an iterative Fourier transform algorithm (IFTA), a point cloud method-based algorithm, an angular spectrum method-based algorithm, or a look-up table (LUT) method-based algorithm.
74. The optical display system of claim 70, wherein a spatial light modulator comprises an array of light modulating elements.
75. The optical display system of claim 74, wherein a pitch of two adjacent light modulating elements of the array of light modulating elements is equal to or less than the wavelength of a predetermined visible light wavelength.
76. The optical display system of claim 74, wherein each light modulating element of the array of light modulating elements modulates at least one of amplitude, phase or polarization of light incident to the light modulating element.
77. The optical display system of claim 70, further comprising: one or more displays, wherein a display of the one or more displays is at least one of a head-mounted display, a head-up display, a stereoscopic display, or a holographic display.
78. A method for execution by one or more processing modules of one or more computing devices, the method comprises: generating a quantization mask, wherein the quantization mask is adapted to move noise associated with a quantization process outside a predetermined signal window in a frequency domain. quantizing, based on the quantization mask, a continuous hologram to generate a quantized hologram.
79. The method of claim 76, wherein quantizing the continuous hologram includes comparing a value of the continuous hologram pattern to a corresponding value of the quantization mask.
80. The method of claim 76, wherein the quantization mask is configured to have a same size as the continuous hologram.
81. The method of claim 76, wherein the quantization mask is configured to have a size smaller than the continuous hologram.
82. The method of claim 79, wherein the quantization mask is replicated over the continuous hologram for quantization of the continuous hologram to create a quantized hologram.
83. A method for execution by one or more processing modules of one or more computing devices, the method comprises: generating a first quantization mask, with the first quantization mask having a size smaller than a size of a continuous hologram, wherein the first quantization mask is adapted to move noise associated with a quantization process outside a predetermined signal window in a frequency domain; generating a second quantization mask, with the second quantization mask having a size smaller than the size of the continuous hologram, wherein the second quantization mask is adapted to move noise associated with the quantization process outside a predetermined signal window in the frequency domain; using the first and the second quantization masks to quantize a continuous hologram to generate a quantized hologram.
84. The method of claim 83, wherein the second quantization mask is different from the first quantization mask.
85. The method of claim 83, wherein using the first and the second quantization mask to quantize a continuous hologram into a quantized hologram includes comparing a value of the continuous hologram to a corresponding value of the first quantization mask or of the second quantization mask.
86. The method of claim 83, wherein the second quantization mask is configured to have a same width as the first quantization mask and is configured to have a same length as the first quantization mask.
87. The method of claim 83, wherein the first and the second quantization mask are alternately replicated along a horizontal direction or a vertical direction, or along both a horizontal and a vertical direction of the continuous hologram.
88. A method for execution by one or more processing modules of one or more computing devices, the method comprises: receiving a continuous hologram, wherein the continuous hologram is divided into an array of pixels, wherein each pixel is associated with a value corresponding to a value of the continuous hologram; using a quantization mask to quantize the pixel value of each pixel of the array of pixels to one of a plurality of states, wherein the quantization mask is configured to facilitate moving noise associated with the quantization process outside a predetermined signal window in a frequency domain.
89. The method of claim 88, the method comprising: adapting the continuous hologram so that values of the continuous hologram lie between -1 and 1, with -1 and 1 included; dividing the continuous hologram to provide four quadrants sharing a quadripoint, a first quadrant including a portion of the array of pixels, wherein each of a second quadrant (top left quadrant), a third quadrant (bottom left quadrant) and a fourth quadrant (bottom right quadrant) respectively includes another equal size portion of the array of pixels; generating a first quantization mask, wherein each value of the first quantization mask lies between -1 and 1, with -1 and 1 included; reversing the sign of each value of the first quantization mask to provide a second quantization mask; using the first quantization mask over the second and the fourth quadrant for quantization of the second and the fourth quadrant of the continuous hologram; reversing the sign of each value of the first quadrant and of the third quadrant of the continuous hologram providing a sign-reversed first quadrant and a sign-reversed third quadrant; using the second quantization mask over the sign-reversed first and the sign-reversed third quadrant of the continuous hologram providing a quantized sign-reversed first quadrant and a quantized sign- reversed third quadrant; reversing the sign of each value of the quantized sign-reversed first quadrant and of the quantized sign-reversed third quadrant providing a quantized hologram for the first and fourth quadrant of the continuous hologram.
90. The method of claim 89, wherein the first and the second quantization mask have a size smaller than the size of any of the four quadrants, the method comprising: replicating the first quantization mask over the second quadrant and over the fourth quadrant for quantization of the second and the fourth quadrant of the continuous hologram providing a quantized hologram for the second and the fourth quadrant, reversing the sign of each value of the first quadrant and of the third quadrant of the continuous hologram providing a sign-reversed first quadrant and a sign-reversed third quadrant; repheating the second quantization mask over the sign-reversed first quadrant and over the sign- reversed third quadrant for quantization of the sign-reversed first and the sign-reversed third quadrant providing a quantized sign-reversed first quadrant and a quantized sign-reversed third quadrant; reversing the sign of each value of the quantized sign-reversed first quadrant and of the quantized sign-reversed third quadrant providing a quantized hologram for the first and the fourth quadrant of the continuous hologram.
91. A method for a display device, the method comprises: receiving data representative of media for display at a predetermined display depth in a focus space; generating, from the data, a first hologram pattern, which places the media at an infinite depth; converting, using a mathematical lens function, the first hologram pattern to a second hologram pattern, which places the media for display from the infinite depth to the predetermined display depth in the focus space.
92. The method of claim 91, whereby the media for display at a predetermined display depth in a focus space comprises one of a two-dimensional (2D) image, a two-dimensional (2D) representation or two-dimensional (2D) information.
93. The method of claim 91 , further comprising: applying random phase to the data representative of media for display at a predetermined display depth in a focus space before generating the first hologram pattern.
AMENDED SHEET (ARTICLE 19)
57
94. The method of claim 91, wherein the mathematical lens function further includes one of an aberration correction function or a vision correction function.
95. The method of claim 91 , further comprising: finalizing, using a quantization function, the second hologram pattern in a quantized hologram pattern.
96. The method of claim 95, wherein the quantization function is based on one of error diffusion quantization or mask-based quantization.
97. The method for a display device of claim 95, wherein the display device comprises one or more spatial light modulator devices, wherein the quantized hologram pattern is rendered on the one or more spatial light modulator devices.
98. The method of claim 95, wherein the first hologram pattern is generated using a Fourier transform.
99. An optical display system comprising: one or more spatial light modulators; one or more optical light modules; and one or more optical combiners.
100. The optical display system of claim 99, wherein the one or more spatial light modulators comprise an array of light modulating elements, wherein each light modulating element of the array of light modulating elements is individually addressable to control a state of the light modulating element, wherein each light modulating element can exhibit at least two different states, each state having different optical properties.
101. The optical display system of claim 100, wherein the pitch between two adjacent light modulating elements of the array of light modulating elements is equal to or smaller than a wavelength of the light incident to the one or more spatial light modulators.
102. The optical display system of claim 100, wherein the pitch between two adjacent light modulating elements of the array of light modulating elements is equal to or smaller than half a wavelength of light incident to the one or more spatial light modulators.
103. The optical display system of claim 100, wherein a light modulating element of the array of light modulating elements is configured to modulate any of amplitude, phase of polarization of light incident to the light modulating element.
104. The optical display system of claim 100, wherein a light modulating element of the array of light modulating elements of the one or more spatial light modulators comprises: a phase change material; a heater element; two or more electrodes connected to the heater element, wherein the light modulating element is configured to be individually addressable via the two or more electrodes; wherein a state of the light modulating element is configured to be alterable by changing a state of the phase change material in response to a thermal contribution from the heater element.
105. The optical display system of claim 99, wherein an optical light module of the one or more optical light modules comprises: an illumination scheme; a first group of optical elements; and a second group of optical elements.
106. The optical display system of claim 105, wherein the illumination scheme comprises: one or more illumination sources and an optical assembly, wherein the optical assembly is configured to transmit light from the one or more illumination sources to the one or more spatial light modulators.
107. The optical display system of claim 106, wherein the one or more illumination sources is an RGB laser source.
108. The optical display system of claim 106, wherein the optical assembly comprises at least one of: a beam splitter; a Total Internal Reflection (TIR) prism; a free form prism.
109. The optical display system of claim 106, wherein the optical assembly includes a collimator element configured to provide collimated illumination to the one or more spatial light modulators.
110. The optical display system of claim 106, wherein at least one of the first group of optical elements or of the second group of optical elements of the optical light module comprises one or more achromatic lenses.
111. The optical display system of claim 105, wherein at least one of the first group of optical elements or of the second group of optical elements of the optical light module comprise at least one of: a lens; a mirror; a prism; a beam splitter; an optical filter; a polarizer.
112. The optical display system of claim 105, wherein an optical light module of the one or more optical light modules comprises: one or more optical corrector elements, wherein the one or more optical corrector elements are configured to correct for aberrations introduced by optical elements associated with the optical light module.
113. The optical display system of claim 112, wherein the one or more optical corrector elements includes at least one of: a toroid optical element; or a free form optical element.
114. The optical display system of claim 99, wherein an optical combiner of the one or more optical combiners includes at least one of: a holographic optical element; a meta surface; a semi-reflective element.
115. The optical display system of claim 105, wherein a first group of optical elements of the one or more optical light modules forms a first lens group of a 4f optical system and wherein a second group of optical elements together with the one or more optical combiners are configured to form a second lens group of the 4f optical system.
116. The optical display system of claim 115, wherein the first lens group of the 4f optical system is adapted to perform a Fourier transform to information representative of a hologram at a plane of the one or more spatial light modulators by converting the information at a plane of the one or more spatial light modulators from a spatial domain to a spatial frequency domain, wherein the spatial frequency information is at a Fourier plane of the 4f optical system and wherein the second lens group of the 4f system is adapted to perform an inverse Fourier transform to the spatial frequency information at the Fourier plane by converting the spatial frequency information at the Fourier plane from the frequency domain to the spatial domain.
117. The optical display system of claim 99, wherein the one or more optical light modules comprise: an illumination scheme; a first group of optical elements, wherein the first group of optical elements forms a first lens group of a 4f optical system and wherein the one or more optical combiners form a second lens group of the 4f optical system.
118. The optical display system of claim 99, wherein the one or more optical light modules further comprise one or more optical filter elements.
119. The optical display system of claim 99, wherein the one or more optical filter elements are configured to filter out unwanted frequency -based information at a Fourier plane.
120. The optical display system of claim 99 further comprising one or more processing units.
121. The optical display system of claim 120, wherein the one or more processing units are implemented on a system-on-chip.
122. The optical display system of claim 120, wherein the one or more processing units are configured to execute one or more Computer-Generated Holography (CGH) algorithms to generate one or more hologram patterns for rendering using the one or more spatial light modulators.
123. The optical display system of claim 122, wherein the CGH algorithms comprise at least one of a Fourier transform algorithm, a Fresnel transform algorithm, an iterative Fourier transform algorithm (IFTA), a point cloud method-based algorithm, an angular spectrum method-based algorithm, or a look-up table (LUT) method-based algorithm.
124. The optical display system of claim 120, wherein the one or more processing units are adapted to modify one or more hologram patterns for rendering using the one or more spatial light modulators to provide modified hologram patterns, wherein the modified hologram patterns are adapted to correct for aberrations introduced by the one or more optical light modules or by the one or more optical combiners.
125. The optical display system of claim 120, wherein the one or more processing units are adapted to modify one or more hologram patterns for rendering using the one or more spatial light modulators to provide modified hologram patterns, wherein the modified hologram patterns are adapted to correct for a refractive error or a vision impairment associated with a user of the optical display system.

The claims as amended in the present application are believed to have novelty, an inventive step and industrial applicability, and such an indication is respectfully requested in the issuance of the International Preliminary Report on Patentability. It is respectfully requested that the Examiner call or email the undersigned if clarification is needed on any matter within this Amendment.

PCT/US2024/044765 2023-09-01 2024-08-30 System and methods for display of 3d multi-media Pending WO2025049975A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/US2025/010721 WO2025151505A1 (en) 2024-01-08 2025-01-08 Method and apparatus for holographic display

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
US202363580198P 2023-09-01 2023-09-01
US63/580,198 2023-09-01
US202463618818P 2024-01-08 2024-01-08
US63/618,818 2024-01-08

Publications (2)

Publication Number Publication Date
WO2025049975A1 WO2025049975A1 (en) 2025-03-06
WO2025049975A4 true WO2025049975A4 (en) 2025-05-08

Family

ID=94820458

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2024/044765 Pending WO2025049975A1 (en) 2023-09-01 2024-08-30 System and methods for display of 3d multi-media

Country Status (1)

Country Link
WO (1) WO2025049975A1 (en)

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102007023737B4 (en) * 2007-05-16 2009-01-02 Seereal Technologies S.A. Method for generating video holograms in real time for extending a 3D rendering graphics pipeline
KR101758163B1 (en) * 2010-12-31 2017-07-14 엘지전자 주식회사 Mobile terminal and hologram controlling method thereof
JP6289194B2 (en) * 2014-03-20 2018-03-07 オリンパス株式会社 Hologram data generation method, hologram image reproduction method, and hologram image reproduction apparatus
KR101820563B1 (en) * 2014-12-31 2018-01-19 한국전자통신연구원 Data format for hologram, and apparatus and method for holographic video system
DE102015205873A1 (en) * 2015-04-01 2016-10-06 Seereal Technologies S.A. Method for calculating holograms for holographic reconstruction of two-dimensional and / or three-dimensional scenes
KR101754976B1 (en) * 2015-06-01 2017-07-06 주식회사 쓰리디팩토리 Contents convert method for layered hologram and apparatu
KR101883233B1 (en) * 2017-02-21 2018-07-30 주식회사 미래기술연구소 Method for generating and reconstructing 3-dimensional computer generated hologram
US10599097B2 (en) * 2018-05-25 2020-03-24 International Business Machines Corporation Image and/or video capture from different viewing angles of projected mirror like reflective holographic image surface
KR20220054619A (en) * 2019-09-03 2022-05-03 라이트 필드 랩 인코포레이티드 Lightfield display for mobile devices
KR20230112962A (en) * 2022-01-21 2023-07-28 삼성전자주식회사 Method and apparatus for modulating depth of hologram and holographic display using same

Also Published As

Publication number Publication date
WO2025049975A1 (en) 2025-03-06

Similar Documents

Publication Publication Date Title
US12013533B2 (en) Holographic image projection with holographic correction
Lee et al. Tomographic near-eye displays
US11803156B2 (en) Near-eye device
US20210341879A1 (en) 2D/3D Holographic Display System
US10585396B2 (en) Head-up display with diffuser
Huebschman et al. Dynamic holographic 3-D image projection
US11281003B2 (en) Near eye dynamic holography
GB2554575A (en) Diffuser for head-up display
CN107390379B (en) Near-to-eye holographic three-dimensional display system and display method
CN111830811A (en) High-definition three-dimensional holographic display method and realization device based on diffraction field superposition
WO2025049975A4 (en) System and methods for display of 3d multi-media
Bove Jr Holographic television
US12443141B2 (en) Holographic display apparatus including freeform curved surface and operating method thereof
Kim et al. Full-color time-sequential super multi-view near-eye display with front-lit waveguide illumination
CN118433365A (en) Method for calibrating holographic projector
CN118974632A (en) Processing device and display system
JPH08240869A (en) Stereoscopic image display device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24861180

Country of ref document: EP

Kind code of ref document: A1