[go: up one dir, main page]

WO2018065850A1 - Système opto-électronique pour des applications de réalité augmentée - Google Patents

Système opto-électronique pour des applications de réalité augmentée Download PDF

Info

Publication number
WO2018065850A1
WO2018065850A1 PCT/IB2017/055838 IB2017055838W WO2018065850A1 WO 2018065850 A1 WO2018065850 A1 WO 2018065850A1 IB 2017055838 W IB2017055838 W IB 2017055838W WO 2018065850 A1 WO2018065850 A1 WO 2018065850A1
Authority
WO
WIPO (PCT)
Prior art keywords
electromagnetic beam
user
opto
fimm
protective layer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/IB2017/055838
Other languages
English (en)
Inventor
Giovanni TREGNAGHI
Alessio ZANUTTA
Andrea Bianco
Sara MAUTINO
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
GLASSUP Srl
Istituto Nazionale di Astrofisica INAF
Original Assignee
GLASSUP Srl
Istituto Nazionale di Astrofisica INAF
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by GLASSUP Srl, Istituto Nazionale di Astrofisica INAF filed Critical GLASSUP Srl
Publication of WO2018065850A1 publication Critical patent/WO2018065850A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/0101Head-up displays characterised by optical features
    • G02B27/0103Head-up displays characterised by optical features comprising holographic elements
    • G02B2027/0109Head-up displays characterised by optical features comprising holographic elements comprising details concerning the making of holograms
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01Head-up displays
    • G02B27/017Head mounted
    • G02B2027/0178Eyeglass type

Definitions

  • the present invention relates to an opto-electronic system for augmented reality applications based on holographic optical devices.
  • the present invention relates to an opto-electronic system for augmented reality applications comprising a holographic "combiner" lens and the description that follows makes reference to this field of application in order to simplify the description thereof.
  • Combiner lens means an optical element that is partially transmissive relative to electromagnetic radiation coming from the outside and which is capable, at the same time, of superimposing digital images coming from a display.
  • the combiner is an optical element that redirects the digital image projected from a display towards the field of vision of a user, in such a way that the user can simultaneously view the background scene and the image projected from the display, combined in what is called an 'augmented reality' scene.
  • HMDs head-mounted displays
  • see-through i.e. glasses that can enable an augmented reality scene to be viewed by superimposing images coming from a display over a panorama of a real scene.
  • the user is able to see images coming from a display, which are superimposed on an image of the real scene observable through the lenses of the glasses and thus view a combined image, more properly referred to as "augmented", the term from which the specific expression of "augmented reality glasses” derives.
  • the combined or “augmented” image is made up of the real scene, normally observed by the user, "augmented” by one of a CGI (computer-generated imagery) type, which comes instead from the display, also referred to as "augmentation".
  • CGI computer-generated imagery
  • the user is therefore able to see a real scene and a virtual scene simultaneously.
  • the undersigned has found that, in these glasses, the digital images coming from a display are brought into the user's field of vision in a manner that is known per se, through an optical path which depends on the specific design created.
  • This optical path can also include, among its various elements, the glass lenses, when the latter are provided for.
  • the image coming from the display is viewed in the space in front of the user.
  • the undersigned has found that the distance of this image from the user's eyes and its dimensions are closely correlated parameters defined on the basis of the overall optical layout.
  • an appropriate focus distance of the virtual scene enables the user to put the real scene and virtual one into focus simultaneously.
  • the two scenes of a different nature are integrated by superimposition, obtaining an augmented image that is in focus overall.
  • the element responsible for this integration is called a "combiner" lens, a term deriving from its specific function of combining the above-described scenes: this element has a key role within the layout of the glasses.
  • holographic combiner lenses with non-monochromatic light incident on them have the functionality of reflecting elements, but with working angles that can be defined at the design stage and whose functioning is independent of the known process of reflection along an interface in the presence of a change in the refractive index, where the angle of reflection is equal to the incidence angle according to Snell's law, as for the known mirrors.
  • the intrinsic dispersive characteristics of the diffracted field can have a blurring effect on the reflected image.
  • Holographic combiner lenses made as volume HOEs are also known.
  • holographic combiner lenses can be inserted in the general layout of the HMD in the form of one or more separate units, with a discrete distribution, or as parts of a waveguide-integrated system.
  • the combiners are used at the inlet and outlet of a transparent waveguide, normally made of glass or polymeric material, which is part of the optical path, and carries the images generated by the display to the user's field of vision.
  • HMDs that implement waveguides use laser sources.
  • HMDs are subject to well-known specific limits, such as ghost images, due to interferences of coherent light among multiple reflections of the image, speckle, limitation of lateral vision (which is important for the balance of the user during movement; this also prevents objects positioned laterally from being seen properly), fragility of the element when the material used for the waveguide is glass, and in general a rather heavy aesthetic appearance.
  • Another problem for augmented reality glasses in general and for HMDs in particular, is energy autonomy.
  • a general object of the present invention is to provide an opto-electronic augmented reality system that overcomes the problems of the prior art.
  • a specific object of the present invention is to propose a novel opto-electronic system for augmented reality applications that has a large field of vision compatible with its form factor, which is transparent, which has a high spectral selectivity characterised by a considerable image sharpness, with an angular selectivity representing a compromise between an exit pupil of fairly large dimensions and the possibility of inhibiting any spurious reflections coming from outside the glasses, which can be easily miniaturised, has a modest cost and whose low consumption enables a considerable battery lifetime.
  • the opto-electronic system for augmented reality applications comprises a glass frame adapted to be worn by a user.
  • the glass frame comprises a front portion, placed in front of the head of the user, adapted to support at least one lens, and at least one side supporting portion, placed along the side of the head of the user, and connected with the front portion so as to allow a support of the frame on the head of the user;
  • the glass frame is adapted to be coupled with an opto-electronic device comprising: a LED lighting device configured to output a first electromagnetic beam of LED light; a display configured to receive encoding information of digital images and to modulate the first electromagnetic beam, coming from the LED lighting device, as a function of the encoding information received, determining a second electromagnetic beam configured to carry the information of the image;
  • a projection optical device configured to project the second electromagnetic beam
  • a narrow-band bandpass interference filter configured to filter spectrally the electromagnetic beam according to a narrow spectral band.
  • the glass frame comprises at least one combiner lens, mounted on the front portion, comprising a holographic element interposed between a first protective layer proximal to the eyes of the user and a second protective layer distal to the eyes of the user,
  • the combiner lens is adapted to:
  • the overlapping of the second electromagnetic beam and the real image determines an augmented reality vision for the user.
  • the frame comprises a front portion, placed in front of the head of the user, adapted to support at least one lens, and at least one side supporting portion, placed along the side of the head of the user, and connected with the front portion so as to allow a support of the frame on the head of the user;
  • an opto-electronic device comprising a LED lighting device configured to output a first electromagnetic beam of LED light
  • At least one combiner lens mounted on the front portion comprising a holographic element interposed between a first protective layer proximal to the eyes of the user and a second protective layer distal to the eyes of the user;
  • the overlapping of the second electromagnetic beam and the real image determines an augmented reality vision for the user.
  • the combiner lens comprises a first protective layer proximal to the user;
  • a holographic element interposed between the first and second protective layers.
  • the holographic element is configured to:
  • the invention describes augmented reality glasses comprising a non-waveguide opto-electronic projection device, preferably integrated in the temples of the glasses, and a holographic combiner lens with excellent transparency to the real image coming from the outside and with a very high efficiency in reflecting the image coming from the projection optical device, wherein the combination of the two images determines the effect of augmented reality.
  • the combiner lens and the opto-electronic projection device are configured to project the augmented image within the field of view of the user, thus simultaneously permitting a view at infinity of the real scene by the user.
  • the technology introduced by the present invention enables the perception of augmented reality scenes with sharp images, while simultaneously assuring a lightweight design with a high quality overall experience, in terms of both aesthetics and perception during use (user experience).
  • the user is not required to turn his or her eyes in directions other than the natural one identified by the ocular axis ("look at” or “look around” configuration) in order to be able to observe the augmented image, thus enabling the user to be able to entirely appreciate the scene before him or her ("see through” configuration).
  • the invention as a whole achieves the technical effect of a high efficiency in terms of the quality of the image projected in the user's field of view.
  • the interference filter spectrally filters either the first electromagnetic beam coming from the LED or the second electromagnetic beam of the image, wherein the first or second beam is incident on the combiner lens.
  • the combination of a LED source, interference filter and lens assures a high diffraction efficiency and high transparency of the holographic element, produced in the combiner lens, in the spectral regions complementary to the operating ones.
  • Figure 1 A is a top view of the opto-electronic system of the present invention in a first embodiment of the present invention.
  • Figure 1 B is a schematic view of the components and of the electromagnetic beams operating in the system of figure 1 A.
  • Figure 2A is a top view of the opto-electronic system of the present invention in a second embodiment.
  • Figure 2B is a schematic view of the components and of the electromagnetic beams operating in the system of figure 2A.
  • Figure 3A is a top view of the opto-electronic system of the present invention in a third embodiment of the present invention.
  • Figure 3B is a schematic view of the components and of the electromagnetic beams operating in the system of figure 3A.
  • Figure 4A is a top view of the opto-electronic system of the present invention in a fourth embodiment of the present invention.
  • Figure 4B is a schematic view of the components and of the electromagnetic beams operating in the system of figure 4B.
  • Figure 5 is a schematic representation of a combiner lens according to the invention.
  • Figures 6-1 1 represent diagrams simulating the structural and functional configurations of the opto-electronic system of the present invention.
  • the opto-electronic system of the present invention is a pair of glasses comprising an opto-electronic device which projects images from a display towards lenses including a holographic element (HOE, holographic optical element), defined “combiner” lens, which enables the projection of the images coming from the display towards the user's field of view superimposed on the image of the real world which emerges from the combiner lens.
  • a holographic element HOE, holographic optical element
  • combiner defined "combiner” lens
  • the system comprises a glass frame 2 adapted to be worn by a user.
  • the glass frame 2 comprises a front portion 3, placed in front of the head of the user, adapted to support at least one lens 10.
  • the front portion 3 supports two lenses 10.
  • the glass frame 2 further comprises at least one side supporting portion 2a,2b, placed along the side of the head of the user, and connected with the front portion 3 so as to allow a support of the frame 2 on the head of the user.
  • the at least one side supporting portion 2a, 2b comprises two temples.
  • the glass frame 2 is adapted to accommodate at least one combiner lens 10 mounted on the front portion 3.
  • the glass frame 2 is adapted to be coupled with an optoelectronic device 4.
  • the opto-electronic device 4 can be mounted on the glass frame 2 or on an element solidly constrained thereto.
  • the opto-electronic device 4 can be accommodated in the glass frame 2 or in the element solidly constrained thereto.
  • the opto-electronic device 4 comprises a LED lighting device 6a configured to output a first electromagnetic beam F L ED of LED light.
  • a LED light source In general, the technical effects assured by the use of a LED light source are many: reduced energy consumption (fundamental in instruments such as glasses, which cannot be constantly supplied with power), reduced size, given the intrinsic dimensions of LEDs and, therefore, easy integration into electronic platforms, easy control, a temperature that is not high (and thus no cooling system is required, as is the case when a laser source is used as the lighting system), in complete compatibility with glasses wearable at the temples.
  • the opto-electronic device 4 is configured to receive as input the first electromagnetic beam FLED of LED light.
  • the opto-electronic device 4 comprises a display 6 configured to receive encoding information lnf_COD of a digital image ImDGT and to modulate the first electromagnetic beam F L ED , coming from the LED lighting device 6a, as a function of the encoding information lnf_COD received.
  • the display 6 thus determines a second electromagnetic beam FIMM configured to carry the information of the image ImDGT.
  • the opto-electronic device 4 further comprises a projection optical device 6b configured to project the second electromagnetic beam F !M M-
  • the opto-electronic device 4 further comprises a bandpass interference filter 6C configured to filter spectrally the first electromagnetic beam FLED, or the second electromagnetic beam F !M M according to a spectral band BP.
  • a bandpass interference filter 6C configured to filter spectrally the first electromagnetic beam FLED, or the second electromagnetic beam F !M M according to a spectral band BP.
  • the bandpass interference filter 6C is configured to filter a narrow spectral band BP.
  • the narrow spectral band BP characteristic of the bandpass interference filter 6c is comprised between 1 and 10 nm FWHM (full width half maximum); further below in the description it will be seen how this value is also linked to other specific technical features of the invention.
  • the narrow spectral band BP is comprised between 1 nm and 3nm FWHM.
  • the image obtained as output from the opto-electronic device 4 i.e. the second electromagnetic beam FIMM, appears as a sharp image, without speckle or any appreciable chromatic aberrations.
  • the combination of the LED light source and the narrow-band bandpass interference filter enables the emission of a quasi-monochromatic light beam, very close to the monochromatic beam generated by a laser source.
  • the first electromagnetic beam F L ED is intrinsically collimated.
  • the LED lighting device 6a is configured to output a first electromagnetic beam F L ED of LED light that is already intrinsically collimated.
  • the opto-electronic system 1 comprises at least one collimation lens upstream of the bandpass interference filter 6C and downstream of the LED lighting device 6a.
  • the at least one collimation lens is at the inlet of the bandpass interference filter 6C.
  • the second electromagnetic beam FIMM is collimated before being transmitted to the combiner lens 10 via a suitable collimation device, in particular the projection optical device 6b. It follows that the second electromagnetic beam F !M M strikes the combiner lens 10 as a collimated beam.
  • the opto-electronic system of filtration and collimation of the incident light beam further assures the technical effect of a narrow pass band.
  • the bandpass interference filter 6C is placed after the LED lighting device 6a.
  • the bandpass interference filter 6C is placed after the projection optical device 6b.
  • the bandpass interference filter 6C is placed after the LED lighting device 6a.
  • the opto-electronic processing device 4 comprises a beam diverting means 6d interposed between the LED lighting device 6a and the display 6, in particular between the LED lighting device 6a and the bandpass interference filter 6c.
  • the opto-electronic device 4 comprises a reflective relay means 6f configured to receive the second electromagnetic beam FIMM and redirect it in reflection towards the projection optical device 6b.
  • the bandpass interference filter 6c is placed after the projection optical device 6b.
  • the opto-electronic device 4 comprises a beam diverting device 6d interposed between the LED lighting device 6a and the display 6.
  • the opto-electronic device 4 comprises a reflective relay means 6f configured to receive the second electromagnetic beam F !M M and redirect it in reflection towards the projection optical device 6b.
  • the opto-electronic system 1 of the invention can comprise accessory devices placed in at least one of the side supporting portions 2a,2b, or in compartments solidly constrained thereto.
  • the opto-electronic system 1 comprises power supply devices 22 and/or connection ports 24, in particular a micro USB port, preferably mounted in at least one of the side supporting portions 2a,2b or in compartments solidly constrained thereto.
  • the opto-electronic system 1 comprises management devices 26 mounted in at least one of the side supporting portions 2a,2b, or in compartments solidly constrained thereto, wherein said devices are adapted to manage the information present on the display 6.
  • the opto-electronic system 1 comprises an integrated microprocessor 28, mounted in at least one of the side supporting portions 2a,2b, or in compartments solidly constrained thereto, and configured to manage the electronic and opto-electronic components of the system 1 , wherein the microprocessor 28 is configured to control one or more among:
  • the opto-electronic system 1 is coupled with the processing unit 8.
  • the processing unit 8 is configured to communicate with the display 6.
  • the processing unit 8 is configured to send encoding information lnf_COD of digital images ImDGT to the display 6, which projects the information, in the form of images, towards the eyes of the user.
  • the processing unit 8 is further configured to:
  • the - receive and process information coming from devices present on the glasses such as, preferably, the streaming of video data coming from the camera 12 or, optionally, status parameters of the system-glasses, such as, for example, but not limited to, the charge status of the power supply system 22, the status of the connection of the connection systems 7, the GPS position, or any other devices/sensors that may be installed.
  • devices present on the glasses such as, preferably, the streaming of video data coming from the camera 12 or, optionally, status parameters of the system-glasses, such as, for example, but not limited to, the charge status of the power supply system 22, the status of the connection of the connection systems 7, the GPS position, or any other devices/sensors that may be installed.
  • the images can be generated, for example, by a mobile phone 8c, a tablet 8b, a personal computer 8a or other sources that are preferably external to the glasses, generically indicated as a processing unit 8, and they are sent to the display so that, as described below, they can be redirected towards the field of vision of the user.
  • the information carried by the images and coming from the micro-display relate, for example, to SMS text messages, e-mails, information of a navigator, or mobile phone functions such as the Internet connection, contacts, calendar, agenda etc.
  • the images coming from the display are generated by a camera 12 placed on the glasses themselves and adapted to acquire images of the real scene situated in front of the glasses. Such images of the real scene are acquired and processed by the camera, which outputs corresponding images of the CGI type.
  • the opto-electronic device 4 is configured to project images FIMM generated by the display 6, as a function of the encoded information lnf_COD, towards at least one combiner lens 10 including a holographic element 100.
  • the "combiner" lens a term deriving from its specific function of combining an image received from a source with a real image set in the background, has a key role within the layout of the glasses.
  • the optoelectronic system 1 for augmented reality applications comprises the at least one combiner lens 10 mounted on the front portion 3 of the glass frame 2.
  • the combiner lens 10 comprises the holographic element 100 interposed between a first protective layer ST1 proximal to the eyes of the user and a second protective layer ST2 distal to the eyes of the user.
  • the combiner lens 10 is adapted to receive the second electromagnetic beam FIMM incident on the first protective layer ST1 ,.
  • the combiner lens 10 is adapted to reflect, within the field of view of the user U, the second electromagnetic beam FIMM-
  • the combiner lens 10 is further adapted to let an image pass through ImR from the real scene incident on the second protective layer ST2 so that it enters the field of view of the user (U), combining with the second electromagnetic beam F !M M- The described overlapping of the second electromagnetic beam F !M M and the real image
  • ImR determines an augmented reality vision for the user U.
  • the combiner lens and the opto-electronic projection device are configured to project the digital image within the field of view of the user, thus simultaneously permitting a view at infinity of the real scene by the user.
  • the combiner lens and the opto-electronic projection device are configured to carry the augmented image into the field of view of the user as if the augmentation came from infinity.
  • the combiner lens and opto-electronic projection device are configured to carry the augmented image into the field of view of the user as if the augmentation were coming from a point at a fixed distance; this embodiment is particularly useful in the case of glasses for visually impaired persons.
  • a holographic lens in combination with a LED light source with a specific narrow pass band i.e. the above-described narrow pass band BP, in general assures the technical effect of a high efficiency of the opto-electronic system of the present invention, as will be discussed below with a mathematical explanation.
  • the holographic element 100 is off axis.
  • the holographic combiner lens 10 of the invention has the functionality of a reflecting element, but with working angles that can be defined at the design stage and whose functioning is independent of the known process of reflection along an interface in the presence of a change in the refractive index, where the angle of reflection is equal to the incidence angle according to Snell's law, as for the known mirrors.
  • such combiner lenses are optical elements characterised by modes that are selective both from a spectral and angular viewpoint, while maintaining at the same time a generally very high transparency in the spectral band complementary to that of reflection.
  • the holographic element 100 is configured to:
  • the angle of reflection ⁇ may have a specific value differing from the incidence angle a.
  • the two angles may have the same value, so that the holographic lens can reproduce the characteristics of a simple mirror.
  • the second electromagnetic beam F !M M must strike the holographic element 100 according to a specific diffraction efficiency.
  • the incidence angle a has a value comprised between 50° and 70°, the efficiency of the combiner must be centred in this angular range.
  • Figure 6 first order diffraction efficiency curve.
  • the angle a is close to 60°, the value on which the peak of the efficiency curve is centred.
  • the range of values allowed for the hologram acceptance angles a is dependent on the efficiency curve of figure 6, and is defined specifically across the interval for which the efficiency is not negligible: for values of acceptance angles falling outside that range, the efficiency takes on zero diffraction values; consequently, the field is not diffracted there.
  • Figure 6 shows a peak for a value of a close to 60°. The field incident on the lens at angles a less than 50° or greater than 70° will not be diffracted with sufficient intensity to generate spurious diffractions in the eyes of the user.
  • the holographic element Given the minimum width of the spectral and angular responses, the holographic element will be effective only in defined angular and spectral intervals. Therefore, there is a minimal likelihood that light coming from the outside will strike at the correct angle and with the "correct" wavelength for reconstructing a ghost image or a spurious reflection falling within the field of vision of the user in such a way that the latter would be able to perceive it.
  • the angular response of the hologram is designed to substantially match the user's field of view, thereby preserving a high quality in the overall perception.
  • This angular band is chosen so narrow in order to filter out the spurious reflections coming from peripheral areas of the field of view, thus preventing the contamination of the images perceived with unwanted visual artifacts and contributing to the overall sharpness of the image.
  • the projection device can be off axis according to design needs; according to the principles of diffraction, the constraint of symmetry between the incident and reflected angles, typical of refraction, is overcome.
  • the opto-electronic device 4 is mounted on at least one side supporting portion 2a,2b so that the projection optical device 6b projects the second electromagnetic beam F !M M towards the combiner lens 1 0 according to the incidence angle a.
  • the incidence angle a is configurable on the basis of the position of the opto-electronic device 4 on at least one side supporting portion 2a,2b.
  • the opto-electronic device 4 is mounted on the front portion 3, above or below the combiner lens 10.
  • the front portion 3 is configured to support a protection lens 10b placed distally from the eye of the user and having a function of protecting the combiner lens 10.
  • the protection lens 10b is coupled to the combiner lens 10.
  • the invention envisages a particular conformation of the combiner lens 10, as shown in figure 5, which makes it possible to obtain the technical effects already described and others that will be detailed here below.
  • the combiner lens (10) comprises a first protective layer ST1 proximal to the user, a second protective layer ST2 distal to the user and a holographic element 100 interposed between the first protective layer ST1 and the second protective layer ST2.
  • the holographic element 100 is off axis.
  • the holographic element is configured to receive a second electromagnetic beam F !M M, configured to carry the information of an image ImDGT, at an incidence angle a and to reflect towards the user the second electromagnetic beam FIMM at an angle of reflection ( ⁇ ) programmable with respect to the incidence angle a.
  • the angle of reflection ⁇ can have a specific value differing from the incidence angle a.
  • the two angles may have the same value, so that the holographic lens can reproduce the characteristics of a simple mirror.
  • the second protective layer ST2 comprises a photochromic material PF proximal to the holographic element 100.
  • the holographic element 100 is laminated onto the photochromic material
  • the photochromic material PF is a polymeric material.
  • the technical effect of the photochromic part of the lens of the glasses is to decrease the light intensity necessary to have an optimal contrast, above all under bright light conditions, when the projected image must be very clear and this entails considerable consumption of the battery. Therefore, with the use of photochromic lenses, the contrast between the projected image and real scene is favoured.
  • a holographic component associated with an outer photochromic substrate makes it possible to decrease the overall energy consumption of the battery of the system, in particular in relation to the ambient light.
  • the second protective layer ST2 it is also possible to provide for the presence of a non-reflective coating AR1 distal with respect to the holographic element 100.
  • the first protective layer ST1 comprises a transparent material PT proximal to the holographic element 100 and a non-reflective coating AR2 distal with respect to holographic element 100.
  • the transparent material PT is configured to allow a passage in the direction of the user U of the second electromagnetic beam F !M M reflected by the holographic element 100 and of the light coming from the real scene frontally to the second protective layer ST2, so that it enters the field of view of the user, combining with the second electromagnetic beam (FIMM).
  • the layer ST2 lets an image ImR pass through from the real scene incident on it so that it enters the field of view of the user U, combining with the second electromagnetic beam FIMM-
  • the transparent material PT is a polymeric material.
  • the combiner lens 10 of the invention further comprises a coupling means MA interposed between the first protective layer ST1 and the holographic element 100, in particular a specifically prepared glue.
  • the technical effect is obtained, besides through other components, by means of the synchronised joint action of the narrow-band interference filter, which spectrally filters the image entering the combiner lens, and the combiner lens with a defined angular band and a narrow spectral band synchronised with that of the interference filter; the combination of filter and lens assures a high diffraction efficiency in line with figure 6, and a high transparency of the holographic element in the spectral regions complementary to the operating ones.
  • the holographic element of the present invention is a reflection diffraction grating that reconstructs the image coming from a projector according to the known grating equation:
  • n refractive index of the medium.
  • optical projection components were chosen with the aim of directing and forming a beam image which, once focused, would have dimensions and a field of view adapted to be contained in the eyes of a user.
  • the geometric optical design thus uniquely defines the incidence angle a which can be used for the projection of the image on the lens of the glasses.
  • the nominal value of this working angle is, for example, equal to 60° relative to the normal at the lens; consequently, the exit angle is equal to 6° in order to enable the output beam (diffracted) to coincide with the centre of the field of view.
  • Said lens 10 in other words, reflects, within the field of view of the user, the image in a preferably central position relative to the field of view.
  • the combiner lens 10 consists of a series of layers, as previously described.
  • the transparent polymeric layer PT placed on the side of the lens 10 close to the eyes, being transparent in the visible, permits the passage of both the light coming from the projection system, reflected by the HOE element, external, and the light coming from the real scene.
  • Said layer PT is coupled with the holographic element HOE, about 62 urn thick, by means of glue MA.
  • the holographic element HOE 100 comprises a 12 micron layer of holographic film coupled with its 50 micron polymeric protective substrate.
  • the holographic element HOE must be deposited by lamination on a glass substrate to prevent phenomena of shrinkage from compromising the process of transformation. Glass is in fact rigid enough to counter the shifting of the holographic film during recording.
  • the holographic layer HOE can be removed from the glass substrate and thus be laminated, preferably directly, on the final photochromic polymeric layer PF.
  • the assembly of the lens 10, which has a 'sandwich-like' structure, is concluded by adding the glue MA on the free side of the film HOE in order to glue the layer of transparent polymeric material PT, preferably 1 mm thick.
  • the holographic layer HOE can be laminated directly onto the transparent polymeric layer PT and subsequently assembled to the photochromic polymeric layer PF by adding the glue MA on the free side of the film HOE.
  • the system After the time necessary for the layer of glue to become uniformly spread, the system is 'cross-linked' by exposure to UV light (curing) and made solid and mouldable into the shape of a glass lens or another shape.
  • the diffraction grating produced by means of the holographic recording process is an optical element that reflects light in a non-conventional direction compared to a normal mirror, which reflects according to the laws of refraction.
  • a volume holographic element which contains within it sinusoidal modulations of the refractive index. These index modulations occur laterally along the whole 'recorded' sample; if viewed in cross section, they can be schematised with 'lines' of modulation of the index, with an inclination relative to the normal at the surface of the sample which determines the previously mentioned entrance and exit angles a and ⁇ . Depending on their angulation, in fact, the hologram will respond with different entrance and exit angles.
  • the response of a volume hologram is typically described by its efficiency curve, which normally has a peak whose value will be greater the higher the change in the refractive index and a bandwidth that will decrease with decreases in the thickness of the active material (figure 7).
  • RCWA rigid coupled wave analysis
  • the response angles of the grating are defined by positioning the beams that create interference according to the diagram in Figure 10.
  • Figure 10 diagram of the recording setup for producing the holographic lens.
  • angles A and B of the system should be the same as the ones used in the reconstruction step (60° - 6°), it was necessary to proceed with an optimisation of A and B in order to ensure that the response curve was centred in efficiency.
  • the recording process not only directly induces an absolute variation in the refractive index ⁇ , but it also modifies the mean value of the index present within the photosensitive material, which in turn influences the spectral response of the holographic element; this value is the refractive index n which appears in the equation of the grating and is fundamental in the geometric definition of the working angles of the holographic element.
  • the mean value of the index depends both on the type of material used and the value ⁇ selected during the simulation step.
  • Figure 11 shift in the efficiency response due to the change in the entrance angle (the pair of recording angles is shown for each curve).
  • the pairs of angles were selected so as to constantly maintain the number G of lines per millimetre of the grating defined at the design stage, so that.
  • the transparency of the holographic element in the spectral regions complementary to the operating one exceeds 90% in the visible, as a result of the ad-hoc type of material used, or the coupling of active material with a suitable substrate.
  • the invention also describes a method of displaying augmented reality images comprising the operating steps implemented by the above-described components.
  • the method of displaying augmented reality images comprises the steps of
  • a glass frame 2 adapted to be worn by a user wherein the frame comprises:
  • the method further comprises coupling to the glass frame 2
  • an opto-electronic device 4 comprising a LED lighting device 6a configured to output a first electromagnetic beam FLED of LED light;
  • the method further comprises carrying out, in the opto-electronic device 4, the steps of:
  • the method further comprises providing at least one combiner lens mounted on the front portion 3 comprising a holographic element 100 interposed between a first protective layer ST1 proximal to the eyes of the user and a second protective layer ST2 distal to the eyes of the user.
  • the method further comprises carrying out, in the combiner lens 10, the steps of:
  • the technology introduced by the present invention enables the perception of augmented reality scenes with sharp images, while simultaneously assuring a lightweight design with a high quality overall experience, in terms of both aesthetics and perception during use (user experience).
  • the user is not required to turn his or her eyes in directions other than the natural one identified by the ocular axis ("look at” or “look around” configuration) in order to be able to observe the augmented image, thus enabling the user to be able to entirely appreciate the scene before him or her ("see through” configuration);

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Optical Communication System (AREA)
  • Processing Or Creating Images (AREA)
  • Image Generation (AREA)

Abstract

L'invention concerne un système opto-électronique pour des applications de réalité augmentée comprenant un cadre en verre (2) comprenant une partie avant (3), au moins une partie de support latérale (2a,2b), la monture de verre (2) étant conçue pour être couplée à un dispositif optoélectronique (4) comprenant : un dispositif d'éclairage à DEL (6a) configuré pour émettre un premier faisceau électromagnétique (F DEL ) de lumière de DEL; un dispositif d'affichage (6) configuré pour recevoir des informations de codage (lnf_COD) d'images numériques (ImDGT) et pour moduler ledit premier faisceau électromagnétique (F DEL ) en fonction des informations de codage (lnf_COD) reçues, à déterminer un second faisceau électromagnétique (F IMM ) configurée pour porter les informations de ladite image (ImDGT); un dispositif optique de projection (6b) configuré pour projeter le second faisceau électromagnétique (F IMM ); un filtre d'interférence passe-bande à bande étroite (6C) configuré pour filtrer spectralement le faisceau électromagnétique (F DEL F IMM ), selon une bande spectrale étroite (BP); le cadre en verre (2) comprenant en outre au moins une lentille de combinaison (10) comprenant un élément holographique (100) interposé entre une première couche de protection (ST1) et une second couche de protection (ST2)), la lentille de combineur (10) étant conçue pour : recevoir le second faisceau électromagnétique (F IMM ); réfléchir, dans le champ de vision dudit utilisateur (U), le second faisceau électromagnétique (F IMM ), laisser passer une image à travers (ImR) la scène réelle de sorte qu'elle entre dans le champ de vision de l'utilisateur, combinaison avec le second faisceau électromagnétique (F IMM ); le chevauchement du second faisceau électromagnétique (F IMM ) et de l'image réelle (ImR) détermine une vision de réalité augmentée pour l'utilisateur. L'invention concerne en outre un procédé d'affichage d'images de réalité augmentée et une lentille de combinaison montée dans le système opto-électronique.
PCT/IB2017/055838 2016-09-27 2017-09-26 Système opto-électronique pour des applications de réalité augmentée Ceased WO2018065850A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
IT102016000096547 2016-09-27
IT102016000096547A IT201600096547A1 (it) 2016-09-27 2016-09-27 Dispositivo opto-elettronico per applicazioni a realta’ aumentata

Publications (1)

Publication Number Publication Date
WO2018065850A1 true WO2018065850A1 (fr) 2018-04-12

Family

ID=58606526

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2017/055838 Ceased WO2018065850A1 (fr) 2016-09-27 2017-09-26 Système opto-électronique pour des applications de réalité augmentée

Country Status (2)

Country Link
IT (1) IT201600096547A1 (fr)
WO (1) WO2018065850A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108333775B (zh) * 2018-04-20 2023-10-03 深圳创维新世界科技有限公司 近眼显示系统

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014115095A2 (fr) * 2013-01-28 2014-07-31 Ecole Polytechnique Federale De Lausanne (Epfl) Film holographique transflectif pour dispositif d'affichage porté sur tête
WO2016051325A1 (fr) * 2014-09-29 2016-04-07 Glassup S.R.L. Dispositif optique pour applications de réalité augmentée, et son procédé de fabrication

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2014115095A2 (fr) * 2013-01-28 2014-07-31 Ecole Polytechnique Federale De Lausanne (Epfl) Film holographique transflectif pour dispositif d'affichage porté sur tête
WO2016051325A1 (fr) * 2014-09-29 2016-04-07 Glassup S.R.L. Dispositif optique pour applications de réalité augmentée, et son procédé de fabrication

Also Published As

Publication number Publication date
IT201600096547A1 (it) 2018-03-27

Similar Documents

Publication Publication Date Title
JP2022141630A (ja) ウェアラブルヘッドアップディスプレイにおけるアイボックス拡張のためのシステム、機器、及び方法
JP6867999B2 (ja) 反射型転換アレイを有する結像光ガイド
CN108604012B (zh) 用于增强的近眼可穿戴显示器的系统和方法
US8934175B2 (en) Display apparatus
CN102667912B (zh) 头戴式显示装置
US20210382307A1 (en) Light-field mixed reality system with correct monocular depth cues to a viewer
US20150362734A1 (en) Transflective holographic film for head worn display
KR102833128B1 (ko) 원통형 도파관을 갖는 광학 시스템
CA2981652A1 (fr) Surface nanostructuree de forme libre pour affichage proche de l'oeil en realite virtuelle et augmentee
CN114008518B (zh) 在低双折射率基础镜片上具有全息反射镜的眼科镜片
HU227185B1 (en) Substrage-guided optical beam expander
GB2388673A (en) Wearable display having objective and ocular lenses and light guide
WO1998015868A1 (fr) Systeme de combinaison d'images pour lunettes et masques
CN219162490U (zh) 一种近眼光学显示系统以及ar显示设备
KR20220162173A (ko) 시선 추적 촬영에서의 광학 결합기 수차 보정
US20190310482A1 (en) Light guide with beam separator for dual images
WO2017223167A1 (fr) Optique de dispositifs d'affichage portables
KR20210134661A (ko) 복합형 회절 소자, 기구, 및 영상 투사 시스템
WO2018065850A1 (fr) Système opto-électronique pour des applications de réalité augmentée
US20250102803A1 (en) Image light guide with interference filter
RU2740065C1 (ru) Устройство дополненной реальности на основе голографического оптического волновода
Bruder et al. A new application example for NIR sensitized Bayfol HX film
CN115616788A (zh) 一种全息光学模组、近眼显示系统及增强现实穿戴设备
EP1336126A1 (fr) Systeme de visualisation individuel
HK1261546B (en) Systems and methods for augmented near-eye wearable displays

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17787961

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17787961

Country of ref document: EP

Kind code of ref document: A1