[go: up one dir, main page]

WO2018014049A1 - Procédé d'étalonnage pour systèmes de direction d'énergie holographique - Google Patents

Procédé d'étalonnage pour systèmes de direction d'énergie holographique Download PDF

Info

Publication number
WO2018014049A1
WO2018014049A1 PCT/US2017/042679 US2017042679W WO2018014049A1 WO 2018014049 A1 WO2018014049 A1 WO 2018014049A1 US 2017042679 W US2017042679 W US 2017042679W WO 2018014049 A1 WO2018014049 A1 WO 2018014049A1
Authority
WO
WIPO (PCT)
Prior art keywords
energy
attributes
locations
waveguide array
sensor
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/US2017/042679
Other languages
English (en)
Inventor
Brendan Elwood BEVENSEE
Jonathan Sean KARAFIN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Light Field Lab Inc
Original Assignee
Light Field Lab Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from PCT/US2017/042276 external-priority patent/WO2018014010A1/fr
Priority to CN202110159133.3A priority Critical patent/CN112859563B/zh
Priority to US16/064,300 priority patent/US11156771B2/en
Priority to NZ743820A priority patent/NZ743820B/en
Priority to CN201780056889.7A priority patent/CN109791391B/zh
Priority to CA3006553A priority patent/CA3006553C/fr
Priority to KR1020197004343A priority patent/KR102609331B1/ko
Priority to AU2017297630A priority patent/AU2017297630B2/en
Priority to EP17828633.2A priority patent/EP3485331A4/fr
Application filed by Light Field Lab Inc filed Critical Light Field Lab Inc
Priority to KR1020237041092A priority patent/KR20230165389A/ko
Publication of WO2018014049A1 publication Critical patent/WO2018014049A1/fr
Priority to AU2019200180A priority patent/AU2019200180B2/en
Anticipated expiration legal-status Critical
Priority to US17/486,242 priority patent/US11921317B2/en
Priority to US18/368,520 priority patent/US20240077668A1/en
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00—Optical elements other than lenses
    • G02B5/32—Holograms used as optical elements
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G02B27/0172—Head mounted characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/10—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images using integral imaging methods
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/016—Input arrangements with force or tactile feedback as computer generated output to the user
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0132—Head-up displays characterised by optical features comprising binocular systems
    • G02B2027/0134—Head-up displays characterised by optical features comprising binocular systems of stereoscopic type
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02E—REDUCTION OF GREENHOUSE GAS [GHG] EMISSIONS, RELATED TO ENERGY GENERATION, TRANSMISSION OR DISTRIBUTION
    • Y02E10/00—Energy generation through renewable energy sources
    • Y02E10/50—Photovoltaic [PV] energy
    • Y02E10/52—PV systems with concentrators

Definitions

  • the present disclosure generally relates to methods for calibration of holographic energy system, and more specifically, to methods for calibrating relay elements and waveguide elements of holographic energy systems.
  • An embodiment of the present disclosure is directed to a method of calibration for an energy relay element, wherein the energy relay element is configured such that energy propagating through the energy relay element has higher transport efficiency in a longitudinal orientation.
  • the method may include receiving data of energy attributes of energy at a first plurality of energy locations at a first surface of an energy relay element, wherein energy at the first plurality of energy locations was relayed from a second plurality of energy locations through the energy relay element along the longitudinal orientation.
  • the method may further include correlating predetermined data of energy attributes of energy at the second plurality of energy locations and the data of energy attributes of energy at the first plurality of energy locations to create a calibrated relay function.
  • the calibrated relay function comprises a mapping of the energy attributes at the first plurality of energy locations to the energy attributes at the second plurality of energy.
  • An embodiment of a method of calibration for an energy waveguide array in which the energy waveguide array operable to direct energy along uninhibited energy propagation paths extending from a first side to a second side of the energy waveguide array, wherein the uninhibited energy propagation paths extend, on the first side, to a plurality of energy locations, and extend, on the second side, along different angular directions relative to the energy waveguide array depending on the respective energy locations on the first side.
  • the method may include receiving data of energy attributes of energy along the uninhibited energy propagation paths on the second side of the waveguide array.
  • the method may furthe include correlating data of energy attributes of energy at the plurality of energy locations and the data of energy attributes of energy along the uninhibited energy propagation paths on the second side of the waveguide array to create a calibrated four- dimensional (4D) plenoptic function for the energy waveguide array.
  • the calibration 4D plenoptic function comprises a mapping between the plurality of energy locations and the respective angular directions of the uninhibited energy propagation paths.
  • a method of calibration for an energy directing system is dislcosed, in which an energy relay element of the energy directing system is configured such that energy propagating through the energy relay element has higher transport efficiency in a longitudinal orientation, and an energy waveguide array of the energy directing system is operable to direct energy along uninhibited energy propagation paths extending from a first side to a second side of the energy waveguide array, wherein the uninhibited energy propagation paths extend, on the first side, to a plurality of relayed energy locations, and extend, on the second side, along different angular directions relative to the energy waveguide array depending on the respective energy locations on the first side.
  • the method may include receiving data of energy attributes of energy at a plurality of relayed energy locations at a first surface of an energy relay element, wherein energy at the first plurality of energy locations was relayed from a plurality of source energy locations through the energy relay element along the longitudinal orientation.
  • the method may further include correlating predetermined data of energy attributes of energy at the plurality of source energy locations and the data of energy attributes of energy at the plurality of relayed energy locations to create a calibrated relay function, wherein the calibrated relay function comprises a mapping of the energy attributes at the first plurality of energy locations to the energy attributes at the second plurality of energy.
  • the method may further include receiving data of energy attributes of energy along the uninhibited energy propagation paths on the second side of the waveguide array and correlating data of energy attributes of energy at the plurality of relayed energy locations and the data of energy attributes of energy along the uninhibited energy propagation paths on the second side of the waveguide array to create a calibrated four-dimensional (4D) plenoptic function for the energy waveguide array, wherein the calibration 4D plenoptic function comprises a mapping between the plurality of energy locations and the respective angular directions of the uninhibited energy propagation paths.
  • 4D plenoptic function comprises a mapping between the plurality of energy locations and the respective angular directions of the uninhibited energy propagation paths.
  • FIGURE 1 is a schematic diagram illustrating design parameters for an energy directing system
  • FIGURE 2 is a schematic diagram illustrating an energy system having an active device area with a mechanical envelope
  • FIGURE 3 is a schematic diagram illustrating an energy relay system
  • FIGURE 4 is a schematic diagram illustrating an embodiment of energy relay elements adhered together and fastened to a base structure
  • FIGURE 5A is a schematic diagram illustrating an example of a relayed image through multi-core optical fibers
  • FIGURE 5B is a schematic diagram illustrating an example of a relayed image through an energy relay that exhibits the properties of the Transverse Anderson Localization principle
  • FIGURE 6 is a schematic diagram showing rays propagated from an energy surface to a viewer
  • FIGURE 7 is a schematic diagram illustrating a system architecture operable to direct energy according to a four-dimensional plenoptic function
  • FIGURE 8 is a flow diagram illustrating process for mapping the energy locations and energy propagation paths for a four-dimensional plenoptic energy directing system
  • FIGURE 9 is a schematic diagram illustrating a calibration system for calibrating an energy relay element in a four-dimensional plenoptic energy directing system
  • FIGURES lOA-C are embodiments of mappings in the process of Fig. 8;
  • FIGURE 11 is a flow diagram illustrating an embodiment of a process for mapping the energy locations
  • FIGURE 12 is a flow diagram illustrating another embodiment of a process for mapping the energy locations
  • FIGURE 13 is a flow diagram illustrating an embodiment of a process for mapping the energy locations and energy propagation paths for a four-dimensional plenoptic energy directing system.
  • FIGURE 14 is a schematic diagram illustrating a calibration system for calibrating an energy waveguide element in a four-dimensional plenoptic energy directing system.
  • Holodeck Design Parameters provide sufficient energy stimulus to fool the human sensory receptors into believing that received energy impulses within a virtual, social and interactive environment are real, providing: 1) binocular disparity without external accessories, head-mounted eyewear, or other peripherals; 2) accurate motion parallax, occlusion and opacity throughout a viewing volume simultaneously for any number of viewers; 3) visual focus through synchronous convergence, accommodation and miosis of the eye for all perceived rays of light; and 4) converging energy wave propagation of sufficient density and resolution to exceed the human sensory "resolution" for vision, hearing, touch, taste, smell, and/or balance.
  • the terms light field and holographic may be used interchangeably to define the energy propagation for stimulation of any sensory receptor response. While initial disclosures may refer to examples of electromagnetic and mechanical energy propagation through energy surfaces for holographic imagery and volumetric haptics, all forms of sensory receptors are envisioned in this disclosure. Furthermore, the principles disclosed herein for energy propagation along propagation paths may be applicable to both energy emission and energy capture.
  • the human acuity of each of the respective systems is studied and understood to propagate energy waves to sufficiently fool the human sensory receptors.
  • the visual system is capable of resolving to approximately 1 arc min
  • the auditory system may distinguish the difference in placement as little as three degrees
  • the somatosensory system at the hands are capable of discerning points separated by 2 - 12mm. While there are various and conflicting ways to measure these acuities, these values are sufficient to understand the systems and methods to stimulate perception of energy propagation.
  • a desired energy surface may be designed to include many gigapixels of effective energy location density.
  • the design parameters of a desired energy surface may include hundreds of gigapixels or more of effective energy location density.
  • a desired energy source may be designed to have 1 to 250 effective megapixels of energy location density for ultrasonic propagation of volumetric haptics or an array of 36 to 3,600 effective energy locations for acoustic propagation of holographic sound depending on input environmental variables.
  • all components may be configured to form the appropriate structures for any energy domain to enable holographic propagation.
  • the embodiments disclosed herein may provide a real-world path to building the Holodeck.
  • Example embodiments will now be described hereinafter with reference to the accompanying drawings, which form a part hereof, and which illustrate example embodiments which may be practiced.
  • the terms “embodiment”, “example embodiment”, and “exemplary embodiment” do not necessarily refer to a single embodiment, although they may, and various example embodiments may be readily combined and interchanged, without departing from the scope or spirit of example embodiments.
  • the terminology as used herein is for the purpose of describing example embodiments only and is not intended to be limitations.
  • the term “in” may include “in” and “on”, and the terms “a,” “an” and “the” may include singular and plural references.
  • the term “by” may also mean “from”, depending on the context.
  • the term “if” may also mean “when” or “upon,” depending on the context.
  • the words “and/or” may refer to and encompass any and all possible combinations of one or more of the associated listed items.
  • Light field and holographic display is the result of a plurality of projections where energy surface locations provide angular, color and intensity information propagated within a viewing volume.
  • the disclosed energy surface provides opportunities for additional information to coexist and propagate through the same surface to induce other sensory system responses.
  • the viewed position of the converged energy propagation paths in space do not vary as the viewer moves around the viewing volume and any number of viewers may simultaneously see propagated objects in real- world space as if it was truly there.
  • the propagation of energy may be located in the same energy propagation path but in opposite directions. For example, energy emission and energy capture along an energy propagation path are both possible in some embodiments of the present disclosed.
  • variables relevant for stimulation of sensory receptor response may include surface diagonal 101, surface width 102, surface height 103, a determined target seating distance 118, the target seating field of view field of view from the center of the display 104, the number of intermediate samples demonstrated here as samples between the eyes 105, the average adult inter-ocular separation 106, the average resolution of the human eye in arcmin 107, the horizontal field of view formed between the target viewer location and the surface width 108, the vertical field of view formed between the target viewer location and the surface height 109, the resultant horizontal waveguide element resolution, or total number of elements, across the surface 110, the resultant vertical waveguide element resolution, or total number of elements, across the surface 111, the sample distance based upon the inter-ocular spacing between the eyes and the number of intermediate samples for angular projection between the eyes 112, the angular sampling may be based upon the sample distance and the target seating distance 113, the total resolution Horizontal per waveguide element derived from the angular sampling desired 114, the total resolution
  • a method to understand the desired minimum resolution may be based upon the following criteria to ensure sufficient stimulation of visual (or other) sensory receptor response: surface size (e.g., 84" diagonal), surface aspect ratio (e.g., 16:9), seating distance (e.g., 128" from the display), seating field of view (e.g., 120 degrees or +/- 60 degrees about the center of the display), desired intermediate samples at a distance (e.g., one additional propagation path between the eyes), the average inter-ocular separation of an adult (approximately 65mm), and the average resolution of the human eye (approximately 1 arcmin).
  • surface size e.g., 84" diagonal
  • surface aspect ratio e.g., 16:9
  • seating distance e.g., 128" from the display
  • seating field of view e.g., 120 degrees or +/- 60 degrees about the center of the display
  • desired intermediate samples at a distance e.g., one additional propagation path between the eyes
  • each of the values attributed to the visual sensory receptors may be replaced with other systems to determine desired propagation path parameters.
  • the auditory system's angular sensitivity as low as three degrees
  • the somatosensory system's spatial resolution of the hands as small as 2 - 12mm.
  • the total energy waveguide element density may be calculated such that the receiving sensory system cannot discern a single energy waveguide element from an adjacent element, given:
  • the inter-ocular distance is leveraged to calculate the sample distance although any metric may be leveraged to account for appropriate number of samples as a given distance.
  • any metric may be leveraged to account for appropriate number of samples as a given distance.
  • the resultant energy surface may desirably include approximately 400k x 225k pixels of energy resolution locations, or 90 gigapixels holographic propagation density. These variables provided are for exemplary purposes only and many other sensory and energy metrology considerations should be considered for the optimization of holographic propagation of energy. In an additional embodiment, 1 gigapixel of energy resolution locations may be desired based upon the input variables. In an additional embodiment, 1,000 gigapixels of energy resolution locations may be desired based upon the input variables.
  • FIG. 2 illustrates a device 200 having an active area 220 with a certain mechanical form factor.
  • the device 200 may include drivers 230 and electronics 240 for powering and interface to the active area 220, the active area having a dimension as shown by the x and y arrows.
  • This device 200 does not take into account the cabling and mechanical structures to drive, power and cool components, and the mechanical footprint may be further minimized by introducing a flex cable into the device 200.
  • the minimum footprint for such a device 200 may also be referred to as a mechanical envelope 210 having a dimension as shown by the M:x and M:y arrows.
  • This device 200 is for illustration purposes only and custom electronics designs may further decrease the mechanical envelope overhead, but in almost all cases may not be the exact size of the active area of the device.
  • this device 200 illustrates the dependency of electronics as it relates to active image area 220 for a micro OLED, DLP chip or LCD panel, or any other technology with the purpose of image illumination.
  • approximately 105 x 105 devices similar to those shown in FIG. 2 may be desired. It should be noted that many devices comprise of various pixel structures that may or may not map to a regular grid. In the event that there are additional sub-pixels or locations within each full pixel, these may be exploited to generate additional resolution or angular density. Additional signal processing may be used to determine how to convert the light field into the correct (u,v) coordinates depending on the specified location of the pixel structure(s) and can be an explicit characteristic of each device that is known and calibrated. Further, other energy domains may involve a different handling of these ratios and device structures, and those skilled in the art will understand the direct intrinsic relationship between each of the desired frequency domains. This will be shown and discussed in more detail in subsequent disclosure.
  • the resulting calculation may be used to understand how many of these individual devices may be desired to produce a full resolution energy surface. In this case, approximately 105 x 105 or approximately 11,080 devices may be desired to achieve the visual acuity threshold.
  • the challenge and novelty exists within the fabrication of a seamless energy surface from these available energy locations for sufficient sensory holographic propagation.
  • an energy propagating relay system may allow for an increase the effective size of the active device area to meet or exceed the mechanical dimensions to configure an array of relays and form a singular seamless energy surface.
  • FIG. 3 illustrates an embodiment of such an energy relay system 300.
  • the relay system 300 may include a device 310 mounted to a mechanical envelope 320, with an energy relay element 330 propagating energy from the device 310.
  • the relay element 330 may be configured to provide the ability to mitigate any gaps 340 that may be produced when multiple mechanical envelopes 320 of the device are placed into an array of multiple devices 310.
  • an energy relay element 330 may be designed with a magnification of 2: 1 to produce a tapered form that is approximately 20mm x 10mm on a minified end (arrow A) and 40mm x 20mm on a magnified end (arrow B), providing the ability to align an array of these elements 330 together seamlessly without altering or colliding with the mechanical envelope 320 of each device 310.
  • the relay elements 330 may be bonded or fused together to align and polish ensuring minimal seam gap 340 between devices 310. In one such embodiment, it is possible to achieve a seam gap 340 smaller than the visual acuity limit of the eye.
  • FIG. 4 illustrates an example of a base structure 400 having energy relay elements 410 formed together and securely fastened to an additional mechanical structure 430.
  • the mechanical structure of the seamless energy surface 420 provides the ability to couple multiple energy relay elements 410, 450 in series to the same base structure through bonding or other mechanical processes to mount relay elements 410, 450.
  • each relay element 410 may be fused, bonded, adhered, pressure fit, aligned or otherwise attached together to form the resultant seamless energy surface 420.
  • a device 480 may be mounted to the rear of the relay element 410 and aligned passively or actively to ensure appropriate energy location alignment within the determined tolerance is maintained.
  • the seamless energy surface comprises one or more energy locations and one or more energy relay element stacks comprise a first and second side and each energy relay element stack is arranged to form a singular seamless display surface directing energy along propagation paths extending between one or more energy locations and the seamless display surface, and where the separation between the edges of any two adjacent second sides of the terminal energy relay elements is less than the minimum perceptible contour as defined by the visual acuity of a human eye having better than 20/100 vision at a distance greater than the width of the singular seamless display surface.
  • each of the seamless energy surfaces comprise one or more energy relay elements each with one or more structures forming a first and second surface with a transverse and longitudinal orientation.
  • the first relay surface has an area different than the second resulting in positive or negative magnification and configured with explicit surface contours for both the first and second surfaces passing energy through the second relay surface to substantially fill a +/- 10 degree angle with respect to the normal of the surface contour across the entire second relay surface.
  • multiple energy domains may be configured within a single, or between multiple energy relays to direct one or more sensory holographic energy propagation paths including visual, acoustic, tactile or other energy domains.
  • the seamless energy surface is configured with energy relays that comprise two or more first sides for each second side to both receive and emit one or more energy domains simultaneously to provide bidirectional energy propagation throughout the system.
  • the energy relays are provided as loose coherent elements.
  • Transverse Anderson Localization is the propagation of a ray transported through a transversely disordered but longitudinally consistent material.
  • the cladding is to functionally eliminate the scatter of energy between fibers, but simultaneously act as a barrier to rays of energy thereby reducing transmission by at least the core to clad ratio (e.g., a core to clad ratio of 70:30 will transmit at best 70% of received energy transmission) and additionally forms a strong pixelated patterning in the propagated energy.
  • FIG. 5A illustrates an end view of an example of one such non-Anderson Localization energy relay 500, wherein an image is relayed through multi-core optical fibers where pixilation and fiber noise may be exhibited due to the intrinsic properties of the optical fibers.
  • relayed images may be intrinsically pixelated due to the properties of total internal reflection of the discrete array of cores where any cross-talk between cores will reduce the modulation transfer function and increase blurring.
  • the resulting imagery produced with traditional multi-core optical fiber tends to have a residual fixed noise fiber pattern similar to those shown in figure 3.
  • FIG. 5B illustrates an example of the same relayed image 550 through an energy relay comprising materials that exhibit the properties of Transverse Anderson Localization, where the relayed pattern has a greater density grain structures as compared to the fixed fiber pattern from figure 5A.
  • relays comprising randomized microscopic component engineered structures induce Transverse Anderson Localization and transport light more efficiently with higher propagation of resolvable resolution than commercially available multi-mode glass optical fibers.
  • a relay element exhibiting Transverse Anderson Localization may comprise a plurality of at least two different component engineered structures in each of three orthogonal planes arranged in a dimensional lattice and the plurality of structures form randomized distributions of material wave propagation properties in a transverse plane within the dimensional lattice and channels of similar values of material wave propagation properties in a longitudinal plane within the dimensional lattice, wherein localized energy waves propagating through the energy relay have higher transport efficiency in the longitudinal orientation versus the transverse orientation.
  • multiple energy domains may be configured within a single, or between multiple Transverse Anderson Localization energy relays to direct one or more sensory holographic energy propagation paths including visual, acoustic, tactile or other energy domains.
  • the seamless energy surface is configured with Transverse Anderson Localization energy relays that comprise two or more first sides for each second side to both receive and emit one or more energy domains simultaneously to provide bidirectional energy propagation throughout the system.
  • the Transverse Anderson Localization energy relays are configured as loose coherent or flexible energy relay elements.
  • a light field display system generally includes an energy source (e.g., illumination source) and a seamless energy surface configured with sufficient energy location density as articulated in the above discussion.
  • a plurality of relay elements may be used to relay energy from the energy devices to the seamless energy surface. Once energy has been delivered to the seamless energy surface with the requisite energy location density, the energy can be propagated in accordance with a 4D plenoptic function through a disclosed energy waveguide system. As will be appreciated by one of ordinary skill in the art, a 4D plenoptic function is well known in the art and will not be elaborated further herein.
  • the energy waveguide system selectively propagates energy through a plurality of energy locations along the seamless energy surface representing the spatial coordinate of the 4D plentopic function with a structure configured to alter an angular direction of the energy waves passing through representing the angular component of the 4D plenoptic function, wherein the energy waves propagated may converge in space in accordance with a plurality of propagation paths directed by the 4D plentopic function.
  • FIG. 6 illustrating an example of light field energy surface in 4D image space in accordance with a 4D plenoptic function.
  • the figure shows ray traces of an energy surface 600 to a viewer 620 in describing how the rays of energy converge in space 630 from various positions within the viewing volume.
  • each waveguide element 610 defines four dimensions of information describing energy propagation 640 through the energy surface 600.
  • Two spatial dimensions (herein referred to as x and y) are the physical plurality of energy locations that can be viewed in image space, and the angular components theta and phi (herein referred to as u and v), which is viewed in virtual space when projected through the energy waveguide array.
  • the plurality of waveguides are able to direct an energy location from the x, y dimension to a unique location in virtual space, along a direction defined by the u, v angular component, in forming the holographic or light field system described herein.
  • an approach to selective energy propagation for addressing challenges associated with holographic display may include energy inhibiting elements and substantially filling waveguide apertures with near-collimated energy into an environment defined by a 4D plenoptic function.
  • an array of energy waveguides may define a plurality of energy propagation paths for each waveguide element configured to extend through and substantially fill the waveguide element's effective aperture in unique directions defined by a prescribed 4D function to a plurality of energy locations along a seamless energy surface inhibited by one or more elements positioned to limit propagation of each energy location to only pass through a single waveguide element.
  • multiple energy domains may be configured within a single, or between multiple energy waveguides to direct one or more sensory holographic energy propagations including visual, acoustic, tactile or other energy domains.
  • the energy waveguides and seamless energy surface are configured to both receive and emit one or more energy domains to provide bidirectional energy propagation throughout the system.
  • the energy waveguides are configured to propagate non-linear or non- regular distributions of energy, including non-transmitting void regions, leveraging digitally encoded, diffractive, refractive, reflective, grin, holographic, Fresnel, or the like waveguide configurations for any seamless energy surface orientation including wall, table, floor, ceiling, room, or other geometry based environments.
  • an energy waveguide element may be configured to produce various geometries that provide any surface profile and/or tabletop viewing allowing users to view holographic imagery from all around the energy surface in a 360-degree configuration.
  • the energy waveguide array elements may be reflective surfaces and the arrangement of the elements may be hexagonal, square, irregular, semi-regular, curved, non-planar, spherical, cylindrical, tilted regular, tilted irregular, spatially varying and/or multi-layered.
  • waveguide, or relay components may include, but not limited to, optical fiber, silicon, glass, polymer, optical relays, diffractive, holographic, refractive, or reflective elements, optical face plates, energy combiners, beam splitters, prisms, polarization elements, spatial light modulators, active pixels, liquid crystal cells, transparent displays, or any similar materials exhibiting Anderson localization or total internal reflection.
  • Each energy surface system may comprise an assembly having a base structure, energy surface, relays, waveguide, devices, and electronics, collectively configured for bidirectional holographic energy propagation, emission, reflection, or sensing.
  • an environment of tiled seamless energy systems are aggregated to form large seamless planar or curved walls including installations comprising up to all surfaces in a given environment, and configured as any combination of seamless, discontinuous planar, faceted, curved, cylindrical, spherical, geometric, or non-regular geometries.
  • aggregated tiles of planar surfaces form wall-sized systems for theatrical or venue-based holographic entertainment.
  • aggregated tiles of planar surfaces cover a room with four to six walls including both ceiling and floor for cave-based holographic installations.
  • aggregated tiles of curved surfaces produce a cylindrical seamless environment for immersive holographic installations.
  • aggregated tiles of seamless spherical surfaces form a holographic dome for immersive Holodeck-based experiences.
  • aggregates tiles of seamless curved energy waveguides provide mechanical edges following the precise pattern along the boundary of energy inhibiting elements within the energy waveguide structure to bond, align, or fuse the adjacent tiled mechanical edges of the adjacent waveguide surfaces, resulting in a modular and seamless energy waveguide system.
  • energy is propagated bidirectionally for multiple simultaneous energy domains.
  • the energy surface provides the ability to both display and capture simultaneously from the same energy surface with waveguides designed such that light field data may be projected by an illumination source through the waveguide and simultaneously received through the same energy surface.
  • additional depth sensing and active scanning technologies may be leveraged to allow for the interaction between the energy propagation and the viewer in correct world coordinates.
  • the energy surface and waveguide are operable to emit, reflect or converge frequencies to induce tactile sensation or volumetric haptic feedback. In some embodiments, any combination of bidirectional energy propagation and aggregated surfaces are possible.
  • the system comprises an energy waveguide capable of bidirectional emission and sensing of energy through the energy surface with one or more energy devices independently paired with two-or-more-path energy combiners to pair at least two energy devices to the same portion of the seamless energy surface, or one or more energy devices are secured behind the energy surface, proximate to an additional component secured to the base structure, or to a location in front and outside of the FOV of the waveguide for off-axis direct or reflective projection or sensing, and the resulting energy surface provides for bidirectional transmission of energy allowing the waveguide to converge energy, a first device to emit energy and a second device to sense energy, and where the information is processed to perform computer vision related tasks including, but not limited to, 4D plenoptic eye and retinal tracking or sensing of interference within propagated energy patterns, depth estimation, proximity, motion tracking, image, color, or sound formation, or other energy frequency analysis.
  • the tracked positions actively calculate and modify positions of energy based upon the interference between the bidirectional captured data and projection information.
  • a plurality of combinations of three energy devices comprising an ultrasonic sensor, a visible electromagnetic display, and an ultrasonic emitting device are configured together for each of three first relay surfaces propagating energy combined into a single second energy relay surface with each of the three first surfaces comprising engineered properties specific to each device's energy domain, and two engineered waveguide elements configured for ultrasonic and electromagnetic energy respectively to provide the ability to direct and converge each device's energy independently and substantially unaffected by the other waveguide elements that are configured for a separate energy domain.
  • a calibration procedure to enable efficient manufacturing to remove system artifacts and produce a geometric mapping of the resultant energy surface for use with encoding/decoding technologies as well as dedicated integrated systems for the conversion of data into calibrated information appropriate for energy propagation based upon the calibrated configuration files.
  • additional energy waveguides in series and one or more energy devices may be integrated into a system to produce opaque holographic pixels.
  • additional waveguide elements may be integrated comprising energy inhibiting elements, beam-splitters, prisms, active parallax barriers or polarization technologies in order to provide spatial and/or angular resolutions greater than the diameter of the waveguide or for other super-resolution purposes.
  • the disclosed energy system may also be configured as a wearable bidirectional device, such as virtual reality (VR) or augmented reality (AR).
  • the energy system may include adjustment optical element(s) that cause the displayed or received energy to be focused proximate to a determined plane in space for a viewer.
  • the waveguide array may be incorporated to holographic head-mounted-display.
  • the system may include multiple optical paths to allow for the viewer to see both the energy system and a real- world environment (e.g., transparent holographic display). In these instances, the system may be presented as near field in addition to other methods.
  • the transmission of data comprises encoding processes with selectable or variable compression ratios that receive an arbitrary dataset of information and metadata; analyze said dataset and receive or assign material properties, vectors, surface IDs, new pixel data forming a more sparse dataset, and wherein the received data may comprise: 2D, stereoscopic, multi-view, metadata, light field, holographic, geometry, vectors or vectorized metadata, and an encoder/decoder may provide the ability to convert the data in real-time or off-line comprising image processing for: 2D; 2D plus depth, metadata or other vectorized information; stereoscopic, stereoscopic plus depth, metadata or other vectorized information; multi-view; multi-view plus depth, metadata or other vectorized information; holographic; or light field content; through depth estimation algorithms, with or without depth metadata; and an inverse ray tracing methodology appropriately maps the resulting converted data produced by inverse ray tracing from the various 2D, stereoscopic, multi-view, volumetric, light field or
  • FIG. 7 shows an overview of the architecture of one embodiment of a four-dimensional (4D) plenoptic energy directing system 700.
  • the energy directing system 700 may include one or more energy devices 702 such as an LCD, a LED, or an OLED which may include energy locations 704 that are on a regular grid. Energy from energy location 704 may be directed to energy locations 712 on an energy surface 706 through an energy relay element 708, which can include, but is not limited to, a tapered energy relay, a flexible energy relay, or a faceplate, each of which may operate on the principle of Anderson Transverse Localization in some embodiments.
  • the energy system 700 may include a mosaic of these energy devices 702 and relay elements 708.
  • Each relay element 708 may introduce a unique distortion 710, such as warping, so that a regular grid pattern on the energy device plane is no longer regular on the energy surface 706.
  • the energy system 700 may further include an array of energy waveguides 720.
  • the array of the energy waveguides 720 may be an array of lenses.
  • the energy locations 704 in the energy device 702 may have relayed energy locations 712 on the energy surface 706 as defined by its (x, y) coordinates on the energy surface.
  • the energy system 700 may further include an inhibiting element 714 for inhibiting propagation of energy.
  • the inhibiting element 714 and the energy waveguide array 720 may cooperate such that the energy locations 712 each may have an uninhibited propagation path through a waveguide array location (x, y).
  • the uninhibited propagation path of the energy locations 712 may be characterized by path angle defined by angular coordinates (u, v), and a collimated energy wave may propagate along the uninhibited propagation path at angular coordinate (u, v).
  • the four parameters (x, y, u, v) - the waveguide locations and the angular coordinate of propagation paths through the waveguide elements - define a 4D plenoptic coordinate system.
  • One of the goals of calibration is to determine the 4D parameters for each energy location 712 as precisely as possible.
  • Fig. 8 is a flow chart diagram illustrating an embodiment of a calibration process 800, which may include an energy location mapping process 802 and a waveguide mapping process 804.
  • the energy location mapping process 802 may include a calibration for the relay element 708 without the waveguides 720.
  • the energy location mapping process 802 may define the real- world coordinate (x, y) in physical space for each energy location 704 on the energy surface 706.
  • the energy location mapping process 802 may also define a mapping between each energy location 712 on the energy surface 706 and each energy location 704 on the energy source device 702.
  • the energy location mapping process 802 may remove any distortion or artifacts 710 that the relay element 708 may introduce.
  • the energy location mapping process 802 may include two steps: a coarse one and a fine one.
  • a coarse step each individual energy relay of the light field mosaic (referred to as a tile) is analyzed, and an overall mapping between the energy surface 706 for that tile and the corresponding energy device 702 is determined.
  • the fine step smaller but more detailed portions of each tile are analyzed at a time, and the mapping between the energy surface 706 and the energy device 702 is made much more precise.
  • energy location mapping process 802 may also include applying a gain map for each relay element tile, and adjusting the overall energy intensity of each relay element tile to match all the others in the energy system 700.
  • the waveguide array mapping process 804 of the calibration process 800 may be carried out after the energy location mapping process 802, and after the energy waveguides 720 are aligned and secured.
  • the waveguide array mapping process 804 may define the energy propagation path angle for the energy that propagate through each energy location generally under the energy waveguides 720.
  • the waveguide mapping process 804 may yield correct (u, v) angular coordinates for each energy location 712.
  • this calibration procedure may involve locating the energy location 712 under a center of each waveguide 720 and assigning energy location 712 under each waveguide 720 the appropriate (u, v) angular coordinate, and finally validating and refining these (u, v) assignments through direct measurements and interpolation.
  • FIG. 9 is a schematic of a calibration system 900 for the energy location mapping process 802.
  • the calibration system 900 may include an energy senor 902.
  • the energy senor 902 may be any device that is configured to receive energy from the energy device 702 and relay element 708.
  • the energy senor 902 may include a camera, a line scanning device, a plurality of pressure sensors disposed in a spatial array, or a plurality of acoustic sensors disposed in a spatial array.
  • the energy sensor 902 may include a commercial camera having greater than 20 MPix that can be remotely operated via a computer for automated data gathering.
  • the sensor size of the energy sensor 902 may be chosen to be about the size of the energy surface 706 side of an individual relay element 708, and the number of pixels in each dimension in a horizontal plane may be chosen to be larger than the number of energy locations 712 or 704.
  • the energy sensor may include a macro lens focused onto the energy surface 706, and providing an imaging field of view that is 10% larger than the energy surface 706 side of an individual relay element 708, so that it images the entire relay element tile.
  • the energy system 700 may be mounted onto a motorized movable platform 904 of the calibration system 900, which moves the energy system 700 underneath the energy sensor 902 in x and y coordinates parallel to the energy surface 706.
  • the calibration system 900 may further include a controller module 906 in electrical communication with the energy sensor 902 and the movable platform 904 so that the movable platform 904 can be controlled by the controller module 906 to move remotely for the purpose of automation.
  • the energy system 700 may be mounted on a tilt stage 904 that has two degrees of freedom, and allows the adjustment of the energy surface 706 so that it is coplanar with the plane of motion of the movable platform 904.
  • the tilt may be adjusted by trial and error until the entire energy surface 706 remains in focus despite the shallow depth of field of an objective lens in an embodiment of the optics for the energy sensor 902.
  • the energy location mapping process 802 may allow for mapping between the real- world coordinates of the energy locations 712 and the digital coordinates of the energy locations 704 in the energy device 702.
  • FIG. 10A shows the outline of the energy surface 706 for the energy relay as recorded in the digital space of the sensor 902.
  • the sensor data may contain the boundaries of a particular relay mosaic tile. Although the tile illustrated in FIG. 10A is rectangular, the image of the tile may have subtle distortions such as a pin-cushion distortion.
  • FIG. 10B shows the actual real-world coordinates of the energy surface 706 defined in a physical reference space.
  • Map 1 translates digital sensor coordinates into real-world coordinates in units of length (for example, mm).
  • a second reference pattern may be present at energy locations 702 on the energy source device 702. This will result in this second reference pattern being relayed to the first surface 706.
  • the relay element 708 may warp the second reference pattern as it is relayed to surface 706.
  • sensor data for this second reference pattern may be recorded in a digital reference space.
  • Map 1 may be applied to the digital sensorcoordinates to translate this second reference pattern into real-world coordinates in the physical reference space.
  • Map 2 translates the (x, y) coordinates of energy surface 706 into the digital coordinates of energy source plane 702. This forward mapping has a paired reverse mapping.
  • Fig. IOC shows the energy surface 706 in digital coordinates of the energy source plane 702, with an outline of the energy source plane coordinates that map to the physical edges of the surface of the relay 706.
  • Fig. 11 is a flow chart diagram illustrating an embodiment of an energy location mapping process 1100.
  • the mapping process 1100 may include a step 1102 in which data is received for energy attributes of energy at the first plurality of energy locations 712 at the first surface 706 of the energy relay element 708. Energy at the first plurality of energy locations 712 was relayed from a second plurality of energy locations 704 through the energy relay element 708 along the longitudinal orientation of the relay element 708.
  • the mapping process 1100 may further include a step 1104 in which predetermined data of energy attributes of energy at the second plurality of energy locations 704 and the data of energy attributes of energy at the first plurality of energy locations 712 are correlated to create a calibrated relay function that includes a mapping of the energy attributes at the first plurality of energy locations 712 to the energy attributes at the second plurality of energy 704.
  • the energy attributes being correlated and mapped in step 1104 may include at least one energy attribute selected from a group consisting of position, color, intensity, frequency, amplitude, contrast, and resolution.
  • the calibration mapping may be applied to compensate for at least one relay attribute selected from a group consisting of: an intensity variation, a color variation, an attenuating region, and a spatial distortion.
  • the energy attributes at the first plurality of energy locations 712 may include at least position coordinates defined in a physical reference space
  • the energy attributes at the second plurality of energy locations 704 may include at least position coordinates defined in a first digital reference space.
  • the first digital reference space may be defined by the energy locations 704 in the energy device 702.
  • the pixels of the display may define a digital "pixel" reference space.
  • the position coordinates defined in the physical reference space may be converted from a second digital reference space using a conversion function.
  • the second digital space may be defined by sensing units in the sensor 902.
  • the data captured by a senor 902 may include captured pixel locations in the data, and a conversion function of captured pixel locations to physical measurements in the real world may be used to convert energy attributes at the first plurality of energy locations 712 in physical measurements.
  • the data of attributes of energy at the first plurality of energy locations 712 may be generated by the energy sensor 902 capturing energy from first plurality of energy locations 712.
  • the energy sensor 902 may be configured to receive an operating parameter of the energy sensor 902 from the controller 906, which may be programmed to operate the energy sensor 902 according to a predetermined instruction.
  • the operating parameter may be provided in a digital signal from the controller 906.
  • the operating parameter may include position instruction where the controller 906 is programmed to position the sensor 902 according to the predetermined instruction.
  • data of attributes of energy at the first plurality of energy locations 712 may be generated by positioning the movable platform 904 on which the energy relay element 708 is located, and by operating the energy sensor 902 to capture energy from first plurality of energy locations 712 when the energy relay element 708 is located at a predetermined position.
  • the movable platform 904 and the sensor 902 are configured to receive digital signals from the controller 906, which may be programmed to operate the energy sensor 902 and the movable platform 904 according to a predetermined instruction.
  • the digital signals may comprise position instructions for the energy sensor 902 and the movable platform 904, and the controller 906 is programmed to position the energy sensor 902 and movable platform 904 according to the predetermined instruction.
  • Fig. 12 is a flow chart diagram illustration of an embodiment of an energy location mapping process 1200 that uses a conversion function to convert energy attributes in a digital space to energy attributes in a physical space.
  • the mapping process 1200 may include a step 1206 in which data is received for captured reference energy attributes of reference energy that was captured at the first plurality of energy locations 712 at the first surface 706 of the energy relay element 708.
  • the reference energy may have predetermined reference energy attributes defined in a physical reference space, e.g., a real word measurement.
  • the predetermined reference energy attributes may include at least one energy attribute selected from a group consisting of position, color, intensity, frequency, amplitude, contrast, and resolution.
  • the reference energy forms a reference spatial pattern and further wherein the reference energy captured at the first plurality of energy locations 712 at the first surface 706 forms a captured pattern.
  • position attributes of the reference spatial pattern are known in the physical reference space.
  • the mapping process 1200 may include a step 1208 in which a conversion function is generated by correlating the predetermined reference energy attributes defined in the physical reference space to the captured reference energy attributes in a digital reference space.
  • this mapping is similar to Map 1 above, which translated image pixel coordinates into real- world coordinates in units of length (for example, mm), and is the mapping shown between FIG. lOA and FIG 10B.
  • the mapping process 1200 may include a step 1202 in which digital data is received for energy attributes of energy at the first plurality of energy locations 712 at the first surface 706 of the energy relay element 708. Energy at the first plurality of energy locations 712 was relayed from a second plurality of energy locations 704 through the energy relay element 708 along the longitudinal orientation of the relay element 708.
  • the mapping process 1200 may further include a step 1204 in which the conversion function generated in step 1208 is applied to the digital data received in step 1202, in order to map the energy attributes of energy defined in the digital reference space to energy attributes in a physical reference space.
  • the mapping process 1200 may further include a step 1210 which generates a mapping between the energy attributes at the first plurality of energy locations 712 as defined in a physical reference space to the energy attributes at the second plurality of energy locations 704 as defined in a digital reference space.
  • this mapping is similar to Map 2 above, which translated real-world coordinates in units of length (for example, mm), into energy source digital pixel coordinates, and is the mapping shown between FIG. 10B and FIG IOC.
  • mapping processes 1100 and 1200 are provided below with respect to a display system with a display surface and pixels of illumination sources that may provide an image to the display surface. It is to be appreciated that other implementations in accordance with the principles of the present disclosure may be carried out for other types of energy systems, such as acoustic, infrared, ultraviolet, microwave, x-ray, electro-magnetic, optical-mechanical, or tactile energy system.
  • energy systems such as acoustic, infrared, ultraviolet, microwave, x-ray, electro-magnetic, optical-mechanical, or tactile energy system.
  • a high-resolution reference checkerboard chart directly on the display surface.
  • This is a reference grid with a known pitch used to calibrate real-world coordinates, and is printed on a transparent medium such as Mylar or glass.
  • the dark portions of the chart should be opaque to light, while the light portions of the chart should be optically transparent. If the checkerboard chart adds any path length, for example, from a thickness of glass, then a compensating path length must be also included during imaging of the display surface without this chart.
  • the pitch of the reference checkerboard is 125um.
  • the checkerboard squares are each 4 to 12 pixels wide.
  • the checkerboard pattern on the display surfaced may have optical distortions after travelling through the optical relay, if one exists.
  • mapping Map 2 from the display surface real- world coordinates to the illumination engine pixel coordinates.
  • This mapping may use at least one offset pixel reference location for the illumination source display for a known location on the display surface, such as the top-left corner.
  • each tile should be photographed with a uniform white image. Then the average illumination can be determined, and the overall illumination for each tile can be adjusted to achieve a uniform display surface.
  • the above discussed energy location calibration may define the mapping between real-world coordinates for the energy surface 706 and the coordinates for the energy locations 704 in the energy device 702. This energy location calibration may be performed without the energy waveguide array 720. 4D calibration may define the angular coordinates for the energy propagation path for each energy locations 712 once the waveguides 720 has been installed. An objective of a 4D calibration process may be to define the 4D plenoptic coordinates (x,y,u,v) for every energy location 712.
  • an energy waveguide element 720a may be operable to direct energy along uninhibited energy propagation paths 1402 and 1404 extending from a first side to a second side of the energy waveguide element 720a.
  • the uninhibited energy propagation paths 1402 and 1404 may extend, on the first side, to a plurality of energy locations 1406, 1408, respectively, and extend, on the second side, along different angular directions (ui, vi), (u 2 , v 2 ) relative to the energy waveguide element 720a depending on the respective energy locations 1406, 1408 on the first side of the energy relay element 706.
  • a process 1300 for 4D calibration may include a step 1302 in which data is received for data of energy attributes of energy along the uninhibited energy propagation paths 1402, 1404 on the second side of the waveguide array is received, and a step 1304 in which data of energy attributes of energy at the plurality of energy locations 1406, 1408 on the first side of the energy waveguide element and the data of energy attributes of energy along the uninhibited energy propagation paths 1402 and 1404 on the second side of the energy waveguide element to create are correlated to create a calibrated four-dimensional (4D) plenoptic function for the waveguide element 720a.
  • the calibrated 4D plenoptic function may include a mapping between the plurality of energy locations 1406, 1408 and the respective angular directions of the energy propagation paths 1402, 1404.
  • the data of energy attributes of energy along the uninhibited energy propagation paths 1402, 1404 on the second side of the waveguide array may be generated by the energy sensor 902 capturing energy along the uninhibited energy propagation paths 1402, 1404 on the second side of the waveguide array.
  • the energy sensor 902 may be configured to receive an operating parameter of the energy sensor 902 from the controller 906, which may be programmed to operate the energy sensor 902 according to a predetermined instruction.
  • the operating parameter may be provided in a digital signal from the controller 906.
  • the operating parameter may include position instruction where the controller 906 is programmed to position the sensor 902 according to the predetermined instruction.
  • data of energy attributes of energy along the uninhibited energy propagation paths 1402, 1404 on the second side of the waveguide array may generated by positioning the movable platform 904 on which the energy relay element 708 is located, and by operating the energy sensor 902 to capture energy along the uninhibited energy propagation paths 1402, 1404 on the second side of the waveguide array when the energy relay element 708 is located at a predetermined position.
  • the movable platform 904 and the sensor 902 are configured to receive digital signals from the controller 906, which may be programmed to operate the energy sensor 902 and the movable platform 904 according to a predetermined instruction.
  • the digital signals may comprise position instructions for the energy sensor 902 and the movable platform 904, and the controller 906 is programmed to position the energy sensor 902 and movable platform 904 according to the predetermined instruction.
  • the energy attributes being correlated and mapped in step 1304 may include at least one energy attribute selected from a group consisting of position, color, intensity, frequency, amplitude, contrast, and resolution.
  • the calibrated 4D plenoptic function may be applied to compensate for at least one waveguide array attribute selected from a group consisting of: an intensity variation, a color variation, an attenuating region, and a spatial distortion.
  • process 1100 or 1200 may be performed to compensate for at least one relay attribute, followed by process 1300 to compensate for at least one waveguide array attribute, thereby compensating for the energy directing system 700 as a whole.
  • the energy attributes of energy along the uninhibited energy propagation paths 1402, 1404 on the second side of the energy waveguide element 720a comprise at least angular coordinates (ui, vi), (u 2 , v 2 ) of the uninhibited energy propagation paths 1402,1404, and the energy attributes of energy at the plurality of energy locations 1406, 1408 on the first side of the energy waveguide element 720a comprise at least position coordinates of the plurality of energy locations.
  • the position coordinates for the plurality of energy locations 1406, 1408 may be defined in a physical reference space or converted from a digital reference space to a physical reference space using a conversion function as discussed above with respect to processes 1100 and 1200.
  • the energy location mapping process of 1100 may be performed before process 1300 so that the position coordinates for the plurality of energy locations 1406, 1408 may be used to determine the angular coordinates (ui, vi), (u 2 , v 2 ) of the uninhibited energy propagation paths 1402,1404, respectively in a physical reference space.
  • the angular coordinates (ui, vi), (u 2 , v 2 ) of the uninhibited energy propagation paths 1402, 1404, in a physical reference space may be determined using a known reference position of the energy waveguide element 720a, a known distance 1410 between the sensor 902 and the waveguide element 720a, and known position of a reference energy location 712a, all of which is defined in the same physical reference space.
  • an energy propagation axis 1412 may be defined in the waveguide element 720a and used as a reference position.
  • the distance 1410 between the sensor 902 and the waveguide element 720a may be determined according to a number of measurement methods known in the art.
  • the angular coordinates (ui, vi), (u 2 , v 2 ) of the uninhibited energy propagation paths 1402, 1404 may be determined using a triangulation of data points obtained by the sensor 902 with the known reference parameters in the physical reference space.
  • mapping 1300 For the purpose of illustrating the principles of the present disclosure, an example of implementing embodiments of the mapping 1300 is provided below with respect to a display system with a display surface and pixels of illumination sources that may provide an image to the display surface and a waveguide array such as a micro lens array for directing light from the display surface to views according to a 4D plenoptic function. It is to be appreciated that other implementations in accordance with the principles of the present disclosure may be carried out for other types of energy systems, such as acoustic, infrared, ultraviolet, microwave, x-ray, electro-magnetic, optical- mechanical, or tactile energy system.
  • energy systems such as acoustic, infrared, ultraviolet, microwave, x-ray, electro-magnetic, optical- mechanical, or tactile energy system.
  • Words of comparison, measurement, and timing such as “at the time,” “equivalent,” “during,” “complete,” and the like should be understood to mean “substantially at the time,” “substantially equivalent,” “substantially during,” “substantially complete,” etc., where “substantially” means that such comparisons, measurements, and timings are practicable to accomplish the implicitly or expressly stated desired result.
  • Words relating to relative position of elements such as “near,” “proximate to,” and “adjacent to” shall mean sufficiently close to have a material effect upon the respective system element interactions.
  • A, B, C, or combinations thereof refers to all permutations and combinations of the listed items preceding the term.
  • A, B, C, or combinations thereof is intended to include at least one of: A, B, C, AB, AC, BC, or ABC, and if order is important in a particular context, also BA, CA, CB, CBA, BCA, ACB, BAC, or CAB.
  • expressly included are combinations that contain repeats of one or more item or term, such as BB, AAA, AB, BBC, AAABCCCC, CBBAAA, CABABB, and so forth.
  • the skilled artisan will understand that typically there is no limit on the number of items or terms in any combination, unless otherwise apparent from the context.
  • compositions and/or methods disclosed and claimed herein can be made and executed without undue experimentation in light of the present disclosure. While the compositions and methods of this disclosure have been described in terms of preferred embodiments, it will be apparent to those of skill in the art that variations may be applied to the compositions and/or methods and in the steps or in the sequence of steps of the method described herein without departing from the concept, spirit and scope of the disclosure. All such similar substitutes and modifications apparent to those skilled in the art are deemed to be within the spirit, scope and concept of the disclosure as defined by the appended claims.

Landscapes

  • Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Variable-Direction Aerials And Aerial Arrays (AREA)

Abstract

Les systèmes holographiques d'orientation d'énergie peuvent comprendre un réseau de guides d'ondes et un élément de relais. Des approches d'étalonnage de l'invention permettent de cartographier des emplacements d'énergie et de cartographier des emplacements d'énergie par rapport à la direction angulaire de l'énergie telle que définie dans un système plénoptique à quatre dimensions. Les distorsions dues au réseau de guides d'ondes et à l'élément relais peuvent également être compensées.
PCT/US2017/042679 2016-07-15 2017-07-18 Procédé d'étalonnage pour systèmes de direction d'énergie holographique Ceased WO2018014049A1 (fr)

Priority Applications (12)

Application Number Priority Date Filing Date Title
KR1020237041092A KR20230165389A (ko) 2016-07-24 2017-07-18 홀로그램 에너지 지향 시스템에 대한 캘리브레이션 방법
KR1020197004343A KR102609331B1 (ko) 2016-07-15 2017-07-18 홀로그램 에너지 지향 시스템에 대한 캘리브레이션 방법
US16/064,300 US11156771B2 (en) 2016-07-15 2017-07-18 Method of calibration for holographic energy directing systems
NZ743820A NZ743820B (en) 2016-07-15 2017-07-18 Method of calibration for holographic energy directing systems
CN201780056889.7A CN109791391B (zh) 2016-07-24 2017-07-18 用于全息能量引导系统的校准方法
CA3006553A CA3006553C (fr) 2016-07-15 2017-07-18 Procede d'etalonnage pour systemes de direction d'energie holographique
AU2017297630A AU2017297630B2 (en) 2016-07-15 2017-07-18 Method of calibration for holographic energy directing systems
CN202110159133.3A CN112859563B (zh) 2016-07-24 2017-07-18 用于全息能量引导系统的校准方法
EP17828633.2A EP3485331A4 (fr) 2016-07-15 2017-07-18 Procédé d'étalonnage pour systèmes de direction d'énergie holographique
AU2019200180A AU2019200180B2 (en) 2016-07-15 2019-01-11 Method of calibration for holographic energy directing systems
US17/486,242 US11921317B2 (en) 2016-07-15 2021-09-27 Method of calibration for holographic energy directing systems
US18/368,520 US20240077668A1 (en) 2016-07-15 2023-09-14 Method of calibration for holographic energy directing systems

Applications Claiming Priority (10)

Application Number Priority Date Filing Date Title
US201662362602P 2016-07-15 2016-07-15
US62/362,602 2016-07-15
US201662366076P 2016-07-24 2016-07-24
US62/366,076 2016-07-24
US201762507500P 2017-05-17 2017-05-17
US62/507,500 2017-05-17
PCT/US2017/042276 WO2018014010A1 (fr) 2016-07-15 2017-07-14 Propagation sélective d'énergie dans un champ lumineux et des réseaux de guides d'ondes holographiques
PCT/US2017/042275 WO2018014009A1 (fr) 2016-07-15 2017-07-14 Propagation d'énergie et localisation d'anderson transverse à l'aide de relais bidimensionnels, à champ lumineux et holographiques
USPCT/US2017/042276 2017-07-14
USPCT/US2017/042275 2017-07-14

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2017/042275 Continuation-In-Part WO2018014009A1 (fr) 2016-05-13 2017-07-14 Propagation d'énergie et localisation d'anderson transverse à l'aide de relais bidimensionnels, à champ lumineux et holographiques

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US16/064,300 A-371-Of-International US11156771B2 (en) 2016-07-15 2017-07-18 Method of calibration for holographic energy directing systems
US17/486,242 Continuation US11921317B2 (en) 2016-07-15 2021-09-27 Method of calibration for holographic energy directing systems

Publications (1)

Publication Number Publication Date
WO2018014049A1 true WO2018014049A1 (fr) 2018-01-18

Family

ID=60952214

Family Applications (4)

Application Number Title Priority Date Filing Date
PCT/US2017/042467 Ceased WO2018014045A2 (fr) 2016-07-15 2017-07-14 Procédé d'étalonnage pour des systèmes d'orientation d'énergie holographique
PCT/US2017/042466 Ceased WO2018014044A1 (fr) 2016-07-15 2017-07-17 Dispositifs d'orientation d'énergie à haute densité pour visiocasques bidimensionnels, stéréoscopiques, à champ lumineux et holographiques
PCT/US2017/042469 Ceased WO2018014047A1 (fr) 2016-05-13 2017-07-17 Système et procédés de génération, de manipulation et de transport de données sensorielles holographiques
PCT/US2017/042679 Ceased WO2018014049A1 (fr) 2016-07-15 2017-07-18 Procédé d'étalonnage pour systèmes de direction d'énergie holographique

Family Applications Before (3)

Application Number Title Priority Date Filing Date
PCT/US2017/042467 Ceased WO2018014045A2 (fr) 2016-07-15 2017-07-14 Procédé d'étalonnage pour des systèmes d'orientation d'énergie holographique
PCT/US2017/042466 Ceased WO2018014044A1 (fr) 2016-07-15 2017-07-17 Dispositifs d'orientation d'énergie à haute densité pour visiocasques bidimensionnels, stéréoscopiques, à champ lumineux et holographiques
PCT/US2017/042469 Ceased WO2018014047A1 (fr) 2016-05-13 2017-07-17 Système et procédés de génération, de manipulation et de transport de données sensorielles holographiques

Country Status (1)

Country Link
WO (4) WO2018014045A2 (fr)

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10904479B2 (en) 2019-03-12 2021-01-26 Light Field Lab, Inc. Video communication including holographic content
US10898818B2 (en) 2018-07-25 2021-01-26 Light Field Lab, Inc. Light field display system based amusement park attraction
US10981046B2 (en) 2019-08-26 2021-04-20 Light Field Lab, Inc. Light field display system for sporting events
US11212514B2 (en) 2019-03-25 2021-12-28 Light Field Lab, Inc. Light field display system for cinemas
US20220035311A1 (en) * 2018-01-14 2022-02-03 Light Field Lab, Inc. Holographic and diffractive optical encoding systems
US11428933B2 (en) 2019-05-13 2022-08-30 Light Field Lab, Inc. Light field display system for performance events
US11902500B2 (en) 2019-08-09 2024-02-13 Light Field Lab, Inc. Light field display system based digital signage system

Families Citing this family (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102754032B1 (ko) 2018-01-14 2025-01-14 라이트 필드 랩 인코포레이티드 3d 환경에서 데이터를 렌더링하는 시스템 및 방법
CN115430062A (zh) 2018-01-14 2022-12-06 光场实验室公司 光场视力矫正装置
KR20200116941A (ko) 2018-01-14 2020-10-13 라이트 필드 랩 인코포레이티드 정렬된 구조를 사용해 에너지 릴레이의 횡방향 에너지 편재를 위한 시스템 및 방법
US10951875B2 (en) 2018-07-03 2021-03-16 Raxium, Inc. Display processing circuitry
EP3857290A4 (fr) 2018-09-28 2022-07-06 Light Field Lab, Inc. Relais d'objet holographique pour affichage de champ lumineux
KR20210141946A (ko) 2019-03-14 2021-11-23 라이트 필드 랩 인코포레이티드 편향각이 영이 아닌 에너지 지향 표면을 갖는 에너지 지향 시스템
US10768442B1 (en) * 2019-03-18 2020-09-08 Brelyon Inc. Display system providing concentric light field and monocular-to-binocular hybridization
CA3139102A1 (fr) * 2019-05-20 2020-11-26 Light Field Lab, Inc. Rafraichissement de ligne de balayage pour systemes d'affichage modulaires
TWI704377B (zh) * 2019-09-09 2020-09-11 宏碁股份有限公司 頭戴式顯示裝置與其視力檢查方法
JP2023500234A (ja) 2019-11-01 2023-01-05 ラキシウム インコーポレイテッド 眼追跡器を組み込む明視野ディスプレイと、眼追跡情報を使用して明視野ディスプレイのためのビューを生成するための方法
EP4058852A4 (fr) 2019-11-12 2024-04-24 Light Field Lab, Inc. Systèmes de relais

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6556280B1 (en) * 2000-09-19 2003-04-29 Optical Switch Corporation Period reconfiguration and closed loop calibration of an interference lithography patterning system and method of operation
US20050260677A1 (en) * 2001-02-02 2005-11-24 Saaski Elric W Enhanced waveguide and method
US20080170293A1 (en) 2006-03-15 2008-07-17 Lucente Mark E Dynamic autostereoscopic displays
WO2014188149A1 (fr) * 2013-05-20 2014-11-27 Milan Momcilo Popovich Dispositif holographique de suivi d'un œil à guide d'onde
US20150016777A1 (en) * 2012-06-11 2015-01-15 Magic Leap, Inc. Planar waveguide apparatus with diffraction element(s) and system employing same
US20150178939A1 (en) * 2013-11-27 2015-06-25 Magic Leap, Inc. Virtual and augmented reality systems and methods
US20150331241A1 (en) * 2014-05-19 2015-11-19 Osterhout Group, Inc. Content position calibration in head worn computing

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
NL192610C (nl) * 1990-12-13 1997-11-04 Enschede & Zonen Grafisch Beelddrager en werkwijze voor het op een beelddrager drukken van een beeld.
US6680761B1 (en) * 2000-01-24 2004-01-20 Rainbow Displays, Inc. Tiled flat-panel display having visually imperceptible seams, optimized for HDTV applications
US6563648B2 (en) * 2000-10-20 2003-05-13 Three-Five Systems, Inc. Compact wide field of view imaging system
AU2003279122A1 (en) * 2002-10-03 2004-04-23 Massachusetts Insitute Of Technology System and method for holographic fabrication and replication of diffractive optical elements for maskless lithography
US8736675B1 (en) 2006-12-01 2014-05-27 Zebra Imaging, Inc. Multi-core processor architecture for active autostereoscopic emissive displays
US7710845B2 (en) * 2007-02-09 2010-05-04 Sanyo Electric Co., Ltd. Holographic memory and holographic recording apparatus
US9083958B2 (en) * 2009-08-06 2015-07-14 Qualcomm Incorporated Transforming video data in accordance with three dimensional input formats
KR101756910B1 (ko) * 2010-05-11 2017-07-26 삼성전자주식회사 감쇠 패턴을 포함하는 마스크를 이용한 광 필드 영상 처리 장치 및 방법
JP2014522591A (ja) * 2011-05-25 2014-09-04 サード ディメンション アイピー リミテッド ライアビリティー カンパニー 角スライス実像３ｄディスプレイのためのアライメント、キャリブレーション、およびレンダリングのシステムおよび方法
US9340055B2 (en) * 2011-06-15 2016-05-17 Hewlett-Packard Development Company, L.P. Security image printing
EP2551827A3 (fr) * 2011-07-28 2017-08-02 Sony Mobile Communications AB Présentation de profondeur tridimensionnelle
US10062210B2 (en) * 2013-04-24 2018-08-28 Qualcomm Incorporated Apparatus and method for radiance transfer sampling for augmented reality
US20160014395A1 (en) * 2014-07-10 2016-01-14 Arete Associates Data fusion processing to identify obscured objects
US10321105B2 (en) * 2014-07-31 2019-06-11 Vuzix Corporation Image and wave field projection through diffusive media
US9816287B2 (en) * 2014-12-22 2017-11-14 Cyberoptics Corporation Updating calibration of a three-dimensional measurement system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6556280B1 (en) * 2000-09-19 2003-04-29 Optical Switch Corporation Period reconfiguration and closed loop calibration of an interference lithography patterning system and method of operation
US20050260677A1 (en) * 2001-02-02 2005-11-24 Saaski Elric W Enhanced waveguide and method
US20080170293A1 (en) 2006-03-15 2008-07-17 Lucente Mark E Dynamic autostereoscopic displays
US20150016777A1 (en) * 2012-06-11 2015-01-15 Magic Leap, Inc. Planar waveguide apparatus with diffraction element(s) and system employing same
WO2014188149A1 (fr) * 2013-05-20 2014-11-27 Milan Momcilo Popovich Dispositif holographique de suivi d'un œil à guide d'onde
US20150178939A1 (en) * 2013-11-27 2015-06-25 Magic Leap, Inc. Virtual and augmented reality systems and methods
US20150331241A1 (en) * 2014-05-19 2015-11-19 Osterhout Group, Inc. Content position calibration in head worn computing

Cited By (14)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US12111615B2 (en) * 2018-01-14 2024-10-08 Light Field Lab, Inc. Holographic and diffractive optical encoding systems
US20220035311A1 (en) * 2018-01-14 2022-02-03 Light Field Lab, Inc. Holographic and diffractive optical encoding systems
US11938410B2 (en) 2018-07-25 2024-03-26 Light Field Lab, Inc. Light field display system based amusement park attraction
US10898818B2 (en) 2018-07-25 2021-01-26 Light Field Lab, Inc. Light field display system based amusement park attraction
US11452945B2 (en) 2018-07-25 2022-09-27 Light Field Lab, Inc. Light field display system based amusement park attraction
US11381775B2 (en) 2019-03-12 2022-07-05 Light Field Lab, Inc. Light field display system for video communication including holographic content
US10904479B2 (en) 2019-03-12 2021-01-26 Light Field Lab, Inc. Video communication including holographic content
US11212514B2 (en) 2019-03-25 2021-12-28 Light Field Lab, Inc. Light field display system for cinemas
US12022053B2 (en) 2019-03-25 2024-06-25 Light Field Lab, Inc. Light field display system for cinemas
US11428933B2 (en) 2019-05-13 2022-08-30 Light Field Lab, Inc. Light field display system for performance events
US12169275B2 (en) 2019-05-13 2024-12-17 Light Field Lab, Inc. Light field display system for performance events
US11902500B2 (en) 2019-08-09 2024-02-13 Light Field Lab, Inc. Light field display system based digital signage system
US11691066B2 (en) 2019-08-26 2023-07-04 Light Field Lab, Inc. Light field display system for sporting events
US10981046B2 (en) 2019-08-26 2021-04-20 Light Field Lab, Inc. Light field display system for sporting events

Also Published As

Publication number Publication date
WO2018014044A1 (fr) 2018-01-18
WO2018014045A2 (fr) 2018-01-18
WO2018014045A9 (fr) 2019-01-17
WO2018014045A3 (fr) 2018-03-01
WO2018014047A1 (fr) 2018-01-18
WO2018014045A8 (fr) 2018-12-06

Similar Documents

Publication Publication Date Title
US11921317B2 (en) Method of calibration for holographic energy directing systems
WO2018014049A1 (fr) Procédé d'étalonnage pour systèmes de direction d'énergie holographique
WO2018014040A1 (fr) Superposition holographique de modulation d'opacité plénoptique du monde réel à travers des réseaux de guides d'ondes transparents
CN112859563B (zh) 用于全息能量引导系统的校准方法
NZ743820B (en) Method of calibration for holographic energy directing systems
NZ743819B (en) Encoded energy waveguides for holographic super resolution

Legal Events

Date Code Title Description
ENP Entry into the national phase

Ref document number: 3006553

Country of ref document: CA

ENP Entry into the national phase

Ref document number: 2017297630

Country of ref document: AU

Date of ref document: 20170718

Kind code of ref document: A

121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17828633

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

ENP Entry into the national phase

Ref document number: 20197004343

Country of ref document: KR

Kind code of ref document: A

ENP Entry into the national phase

Ref document number: 2017828633

Country of ref document: EP

Effective date: 20190215

WWR Wipo information: refused in national office

Ref document number: 1020237041092

Country of ref document: KR