[go: up one dir, main page]

WO2019142953A1 - Système d'affichage fovéal proche de l'œil destiné à résoudre le problème du conflit accommodation-vergence - Google Patents

Système d'affichage fovéal proche de l'œil destiné à résoudre le problème du conflit accommodation-vergence Download PDF

Info

Publication number
WO2019142953A1
WO2019142953A1 PCT/KR2018/000901 KR2018000901W WO2019142953A1 WO 2019142953 A1 WO2019142953 A1 WO 2019142953A1 KR 2018000901 W KR2018000901 W KR 2018000901W WO 2019142953 A1 WO2019142953 A1 WO 2019142953A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
image
area
covering
optical system
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/KR2018/000901
Other languages
English (en)
Korean (ko)
Inventor
홍지수
김영민
강훈종
홍성희
신춘성
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Korea Electronics Technology Institute
Original Assignee
Korea Electronics Technology Institute
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Korea Electronics Technology Institute filed Critical Korea Electronics Technology Institute
Publication of WO2019142953A1 publication Critical patent/WO2019142953A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/02—Viewing or reading apparatus
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/10—Processing, recording or transmission of stereoscopic or multi-view image signals
    • H04N13/106—Processing image signals
    • H04N13/156—Mixing image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/302—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays
    • H04N13/322—Image reproducers for viewing without the aid of special glasses, i.e. using autostereoscopic displays using varifocal lenses or mirrors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/361—Reproducing mixed stereoscopic images; Reproducing mixed monoscopic and stereoscopic images, e.g. a stereoscopic image overlay window on a monoscopic image background
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/366—Image reproducers using viewer tracking
    • H04N13/383—Image reproducers using viewer tracking for tracking with gaze detection, i.e. detecting the lines of sight of the viewer's eyes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N2213/00—Details of stereoscopic systems
    • H04N2213/002—Eyestrain reduction by processing stereoscopic signals or controlling stereoscopic devices

Definitions

  • the present invention relates to a three-dimensional display technology, and more particularly, to a foveated near-eye display system for solving a convergent focus mismatch problem.
  • a light field (LF) display or a digital holographic (DH) display which satisfies the hyperchip condition that can solve the convergence focus mismatch and provide accurate focus information, is proposed as an alternative, but an accurate accommodation cue is provided
  • the number of pixels required is far exceeding the specification of the existing display and still remains to the point of being able to explore the possibility.
  • a near-eye display can be assumed.
  • the pupil of the user's eye covers a moving area of a wide field of view (FOV) and requires a significantly larger number of pixels than the current 2D display in order to provide accommodation information .
  • FOV wide field of view
  • a 3D display system including a 3D display for generating a 3D image to be provided as a divergent angle for covering a first area; And a 2D display for generating a 2D image to be provided as a divergent angle for covering a second area other than the first area.
  • the first region may be a foveated region.
  • the second region may be a peripheral region of the paved region.
  • the 3D display system according to the present invention may further include a semi-mirror for synthesizing the 3D image generated in the 3D display and the 2D image generated in the 2D display.
  • a 3D display system includes: a first optical system for transmitting a 3D image generated in a 3D display to a virtual screen; And a second optical system for delivering the 2D image generated in the 2D display to the virtual screen.
  • the focal lengths of the lenses included in the first optical system may be different from the focal lengths of the lenses included in the second optical system.
  • the 3D display system according to the present invention may further include a first spatial filter disposed in the first optical system for limiting a divergent angle of the 3D image for covering the first area.
  • the 3D display system according to the present invention may further include a second spatial filter disposed in the second optical system for limiting a divergent angle of the 2D image for covering the second area.
  • the 3D display system according to the present invention may further include an alternative lens positioned at the rear end of the virtual screen.
  • the 3D display system according to the present invention may further include an optical system for transmitting the 3D image generated in the 3D display and the 2D image generated in the 2D display to the virtual screen.
  • a 3D display system includes a spatial filter disposed in an optical system for limiting a divergence angle of a 3D image for covering a first area and limiting a divergence angle of a 2D image for covering a second area .
  • the spatial filter may comprise a first polarizer for passing a 3D image of the first polarization state.
  • the spatial filter may further comprise a second polarizer for passing the 3D image of the second polarization state.
  • the 3D display may be a light field display or a digital holographic display.
  • a 3D display method comprising: generating a 3D image to be provided as a divergent angle for covering a first area; And generating a 2D image to be provided as a divergent angle for covering a second area other than the first area.
  • a 3D display system includes a 3D display for generating a 3D image to provide a divergent angle for covering a first area; And a half mirror for synthesizing the 3D image generated in the 3D display and the 2D image to be provided as the divergence angle for covering the second area other than the first area.
  • a 3D display method comprising: generating a 3D image to be provided as a divergent angle for covering a first area; And synthesizing a 2D image to be provided as a divergent angle for covering the generated 3D image and a second area other than the first area.
  • a 3D display system includes a 2D display for generating a 2D image to be provided as a divergent angle for covering a second area other than the first area; And a half mirror for combining the 3D image to be provided with the divergence angle for covering the first area and the 2D image generated in the 2D display.
  • the number of pixels required for the display device can be minimized while solving the convergence focus mismatch problem.
  • FIG. 1 shows the emission characteristics of each pixel of an LF or DH display
  • Figure 2 illustrates a basic concept for implementing a paved LF or DH display
  • FIG. 3 is a graph illustrating the light-diverging characteristics of the Foveated LF or DH display
  • FIG. 6 illustrates an optical setup for implementing a Foveated LF or DH display according to an embodiment of the present invention
  • FIGS. 7 and 8 illustrate a mutually exclusive spatial filter
  • Figure 12 shows the optical configuration of a foveated LF or DH display system with one optical path
  • FIG. 13 illustrates a Polarization-base mutually exclusive spatial filter
  • 15 is a parameterization for determining the divergence angle of each pixel of the LF or DH display.
  • FIG. 1 shows the optical characteristics of a light field (LF) display or a digital holographic (DH) display based on a hyperchip, which can transmit accurate accommodation information to a user.
  • LF light field
  • DH digital holographic
  • a significant diffraction angle range is determined in inverse proportion to the sampling interval of the display pixel, and in a typical display, this diffraction angle becomes very narrow.
  • the angular range that can provide meaningful information at each pixel of the LF or DH display is limited as shown in FIG. 1, and the angle is usually determined to be a very small value.
  • the number of pixels required to function as an LF or DH display system that provides precise accommodation information on the range of the pupil of the user's eye that has a wide FOV as in a general Near-Eye display system is significantly increased.
  • an eye piece lens is mounted in front of an LF or DH display and all of the chief rays emitted from each pixel are condensed to enter the pupil, it can be implemented as an LF or DH display for the entire FOV.
  • the size of the field of view that can be designed in numbers is similar to the pupil, so there is little room for the observer's eye to move.
  • the minimum area where convergence focus mismatch does not occur is defined as a foveated region when an accurate accommodation cue is provided. If accommodation cue is provided only for the above area, it can be expected that convergence focus mismatch problem will not occur.
  • the divergence angle of the light emitted from each pixel on the image of the screen functioning as an LF or DH display after the system as shown in Fig. 2 is more than enough to cover the foveated region in view of the viewer's pupil Even if the divergence angle does not cover the entire eye pupil trajectory, it may be possible to solve convergent focus mismatch problem.
  • image information as a 2D display is provided for divergent angles other than the foveated region.
  • FIG. 3 in the embodiment of the present invention, when the virtual screen is assumed to be the image of screen in FIG. 2, the divergence angle around the chief ray, which covers the foveated region, , A display system that functions as an LF or DH display capable of providing accommodation information and functions as a 2D display for other divergence angles.
  • the pixel in the direction of interest is recognized as a 3D pixel providing accommodation information
  • a pixel at a viewing angle beyond the region is recognized as a 2D pixel without accommodation information. If the foveated region is properly set, the entire FOV does not provide accommodaton information, but convergence focus mismatch problem does not occur.
  • FIG. 6 shows a specific optical setup for implementing a foveated LF or DH display system according to an embodiment of the present invention.
  • a foveated display system includes an LF or DH display 110 and a 2D display 140.
  • the LF or DH display 110 passes through a 4f system 120 consisting of lenses with focal lengths f 1 and f 2 and the 2D display 140 is made up of lenses with focal lengths f 3 and f 4 4f system 150 and onto a half mirror (Half Mirror) 170 over a plane named as the intermediate virtual screen 175.
  • a 4f system 120 consisting of lenses with focal lengths f 1 and f 2
  • the 2D display 140 is made up of lenses with focal lengths f 3 and f 4 4f system 150 and onto a half mirror (Half Mirror) 170 over a plane named as the intermediate virtual screen 175.
  • the spatial filter 130 located in the 4f system 120 of the LF or DH display 110 limits the 3D image to be provided by the divergence angle for covering the paved area as shown in Fig.
  • the spatial filter 160 located in the 4f system 150 of the 2D display 140 is configured to limit the 2D image to a divergent angle for covering the peripheral area of the paved area, do.
  • the relationship between the coordinates of the spatial filter 130 and the angles is determined by the following equation when the LF of the intermediate virtual screen 175 or the light emission angle of each pixel of the DH display 110 is parameterized as shown in FIGS.
  • the 2D display system 130 is scaled with a coordinate value of f 4 / f 2 .
  • the intermediate virtual screen 175 functions as an LF or DH display at an angle within ⁇ D of light emitted from each pixel as shown in FIG. 11, and functions as a 2D display at other angles .
  • the chief rays from each pixel are all parallel.
  • FIG. 6 by placing an eyepiece lens 180 having a focal distance F at a distance g from the rear end of the intermediate virtual screen 175, And the luminescence characteristics of each pixel of the virtual screen are as shown in Fig. 3 as intended.
  • the 4f system 120 for the LF or DH display 110 and the 4f system 150 for the 2D display 140 use lenses of the same focal length, Can be combined into a sight path.
  • the polarization-based mutually exclusive spatial filter 220 operates as a spatial filter for the LF or DH display 110 and the 2D display 140 based on the polarization state. Accordingly, the LF or DH display 110 and the 2D display 140 must have orthogonal polarization states, which can be achieved by imparting a polarization state to the light source or attaching a polarizer to the front of the display.
  • the LF or DH display 110 and the 2D display 140 are combined into a single optical path through the half mirror 170. Since each display has orthogonal polarization states, the polarization beam splitter (PBS) Giving it may be advantageous in light efficiency. Thereafter, the two displays pass through a 4f system 210 comprising lenses having f 1 and f 2 focal lengths, and a polarization-based mutually exclusive spatial filter 220 as shown in FIG. 13 is located in the frequency domain.
  • PBS polarization beam splitter
  • FIG. 14 is a basic parameterization for determining the divergence angle of optical information in each pixel of an LF or DH display used to implement a foveated LF or DH display according to an embodiment of the present invention.
  • the virtual screen is z D away from the forefront of the user's eye, and the radius of rotation of the user's pupil is r.
  • the center of rotation of the user's pupil is distant from the eyepiece lens by the focal distance F, all of the chief rays emitted from each pixel of the virtual screen are collected at the center of the user's pupil rotation.
  • the foveated region is characterized by ⁇ fv , which is part of it.
  • ⁇ fv the magnitude of the optical information scattering angle per pixel of the LF or DH display on the virtual screen.
  • the angle of view is? B.
  • ⁇ B is determined by the following equation.
  • the center of the pupil having the width of P E is denoted by P o
  • the divergence angle of the LF or DH display per pixel is denoted by ⁇ D
  • the point at which the outermost ray meets the pupil is called P D.
  • LF or because the optical information of each pixel in the dispersion of the DH display is to be covered to some extent than the area of the pupil may differ depending on the situation which causes the accommodation response, placing the value to ⁇ A, the pupil more ⁇ A
  • ⁇ D is determined so as to satisfy the following inequality.
  • accommodation information is provided only for a foveated region, which is a part of the entire FOV, using the concept of foveation, thereby minimizing the number of display request pixels for resolving the convergence focus mismatch.
  • a near eye display in which the convergence focus problem was solved without increasing the number of pixels significantly. Thereby, the number of pixels required for the display device can be minimized while solving the convergence focus mismatch problem.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)

Abstract

L'invention concerne un système d'affichage fovéal proche de l'œil destiné à résoudre le problème du conflit accommodation-vergence. Un système d'affichage tridimensionnel selon un mode de réalisation de la présente invention comprend : un dispositif d'affichage tridimensionnel pour la génération d'une image tridimensionnelle à délivrer selon un angle de divergence permettant de couvrir une première région; et un dispositif d'affichage bidimensionnel pour la génération d'une image bidimensionnelle à délivrer selon un angle de divergence permettant de couvrir une seconde région excluant la première région. Par conséquent, le nombre de pixels requis pour le dispositif d'affichage peut être réduit au minimum tandis que le problème du conflit accommodation-vergence est résolu.
PCT/KR2018/000901 2018-01-19 2018-01-19 Système d'affichage fovéal proche de l'œil destiné à résoudre le problème du conflit accommodation-vergence Ceased WO2019142953A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR1020180006866A KR102065233B1 (ko) 2018-01-19 2018-01-19 수렴초점 불일치 문제 해결을 위한 포비티드 Near-Eye 디스플레이 시스템
KR10-2018-0006866 2018-01-19

Publications (1)

Publication Number Publication Date
WO2019142953A1 true WO2019142953A1 (fr) 2019-07-25

Family

ID=67302159

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2018/000901 Ceased WO2019142953A1 (fr) 2018-01-19 2018-01-19 Système d'affichage fovéal proche de l'œil destiné à résoudre le problème du conflit accommodation-vergence

Country Status (2)

Country Link
KR (1) KR102065233B1 (fr)
WO (1) WO2019142953A1 (fr)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR102830279B1 (ko) 2020-02-24 2025-07-04 삼성전자주식회사 광학 장치 및 이를 포함한 근안 디스플레이 장치
GB2610204B (en) 2021-08-26 2024-10-02 Envisics Ltd Hologram calculation

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101371772B1 (ko) * 2013-01-28 2014-03-10 가톨릭대학교 산학협력단 입체시 검안 장치
KR20160030034A (ko) * 2014-09-05 2016-03-16 전자부품연구원 홀로그램과 다시점 영상을 이용한 3차원 영상 시스템 및 디스플레이 방법
KR20160066942A (ko) * 2014-12-03 2016-06-13 서울대학교산학협력단 홀로그래픽 광학 소자의 제조 방법 및 장치
KR20160147636A (ko) * 2015-06-15 2016-12-23 삼성전자주식회사 헤드 마운티드 디스플레이 장치
US20170337660A1 (en) * 2014-03-10 2017-11-23 Sony Corporation Method and device for simulating a wide field of view

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101371772B1 (ko) * 2013-01-28 2014-03-10 가톨릭대학교 산학협력단 입체시 검안 장치
US20170337660A1 (en) * 2014-03-10 2017-11-23 Sony Corporation Method and device for simulating a wide field of view
KR20160030034A (ko) * 2014-09-05 2016-03-16 전자부품연구원 홀로그램과 다시점 영상을 이용한 3차원 영상 시스템 및 디스플레이 방법
KR20160066942A (ko) * 2014-12-03 2016-06-13 서울대학교산학협력단 홀로그래픽 광학 소자의 제조 방법 및 장치
KR20160147636A (ko) * 2015-06-15 2016-12-23 삼성전자주식회사 헤드 마운티드 디스플레이 장치

Also Published As

Publication number Publication date
KR20190088609A (ko) 2019-07-29
KR102065233B1 (ko) 2020-01-10

Similar Documents

Publication Publication Date Title
US10890771B2 (en) Display system with video see-through
WO2016006758A1 (fr) Structure de conduit de lumière, dispositif optique et système d'imagerie
WO2016144005A1 (fr) Système de projection d'image de réalité augmentée
JPH0954376A (ja) 立体表示装置
EP2374281A2 (fr) Procédé d'obtention de données d'images et son appareil
WO2020085564A1 (fr) Dispositif optique
US10255499B2 (en) Head-mounted display
WO2019142953A1 (fr) Système d'affichage fovéal proche de l'œil destiné à résoudre le problème du conflit accommodation-vergence
WO2019223090A1 (fr) Télescope intelligent à réalité mixte
US11960088B2 (en) Waveguide configurations in a head-mounted display (HMD) for improved field of view (FOV)
WO2023234459A1 (fr) Dispositif et procédé pour fournir une image de réalité augmentée à vue directe à grand écran à l'aide d'un affichage transparent
WO2020060198A1 (fr) Dispositif de projection d'image spatiale cylindrique utilisant un demi-miroir
WO2010087587A2 (fr) Procédé d'obtention de données d'images et son appareil
WO2018124799A1 (fr) Système d'imagerie
WO2018230971A1 (fr) Procédé et appareil de traitement d'image omnidirectionnelle
US7259911B2 (en) Trinocular tube for stereo microscopes
WO2019112096A1 (fr) Procédé de mise en correspondance d'image de point de vue destiné à un système d'imagerie intégré utilisant une lentille hexagonale
WO2017111274A1 (fr) Microscope monoculaire permettant de capturer une image stéréoscopique
WO2019240388A1 (fr) Boîte hr
US20030197929A1 (en) Binoculars for capturing images
US12019240B2 (en) Imaging apparatus integrated with display for head-mounted display
WO2021066335A1 (fr) Visiocasque
WO2025005526A1 (fr) Dispositif d'affichage de champ lumineux
WO2011056012A2 (fr) Système de lentilles pour photographier des images stéréoscopiques
JP4081156B2 (ja) 立体内視鏡

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18900968

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 18900968

Country of ref document: EP

Kind code of ref document: A1