CN111381367A - Eyeball tracker and display device - Google Patents
Eyeball tracker and display device Download PDFInfo
- Publication number
- CN111381367A CN111381367A CN201811608622.7A CN201811608622A CN111381367A CN 111381367 A CN111381367 A CN 111381367A CN 201811608622 A CN201811608622 A CN 201811608622A CN 111381367 A CN111381367 A CN 111381367A
- Authority
- CN
- China
- Prior art keywords
- lens
- beam splitter
- light source
- distance
- structured light
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 210000005252 bulbus oculi Anatomy 0.000 title claims abstract description 35
- 210000001508 eye Anatomy 0.000 claims abstract description 34
- 238000003384 imaging method Methods 0.000 claims abstract description 21
- 238000010586 diagram Methods 0.000 description 6
- 230000003287 optical effect Effects 0.000 description 3
- 239000007787 solid Substances 0.000 description 3
- 238000000034 method Methods 0.000 description 2
- 241000699670 Mus sp. Species 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0093—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for monitoring data relating to the user, e.g. head-tracking, eye-tracking
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Eye Examination Apparatus (AREA)
Abstract
本发明提供一种眼球追踪器,其包括透镜、分光镜、结构光源以及取像元件。分光镜设置于透镜的一侧。结构光源设置于透镜与分光镜之间。取像元件设置于透镜与分光镜之间,其中结构光源用以发出第一光线并射向分光镜,第一光线自分光镜反射向透镜并穿过透镜以射向眼球。第一光线自眼球反射而形成第二光线,其中第二光线穿过透镜并射向分光镜,且自分光镜反射向取像元件。一种显示装置也被提出。
The present invention provides an eye tracker, which includes a lens, a beam splitter, a structured light source and an imaging element. The beam splitter is arranged on one side of the lens. The structured light source is arranged between the lens and the beam splitter. The imaging element is arranged between the lens and the beam splitter, wherein the structured light source is used to emit a first light and emit it to the beam splitter, and the first light is reflected from the beam splitter to the lens and passes through the lens to emit to the eyeball. The first light is reflected from the eyeball to form a second light, wherein the second light passes through the lens and emits to the beam splitter, and is reflected from the beam splitter to the imaging element. A display device is also proposed.
Description
技术领域technical field
本发明涉及一种眼球追踪技术,尤其涉及一种眼球追踪器与应用此眼球追踪器的显示装置。The invention relates to an eye tracking technology, in particular to an eye tracker and a display device using the eye tracker.
背景技术Background technique
眼球追踪技术通常应用于显示装置中,藉以在使用者观看显示装置的同时取得使用者的眼球或眼球周边的变化,并且,判断眼球或眼球周边的变化,以与显示装置进行互动。换句话说,眼球追踪技术可用以取代现有的键盘、鼠标、触控板或触控式面板等操作界面。Eye tracking technology is usually applied to display devices, so as to obtain changes of the user's eyeballs or the periphery of the eyeballs while the user watches the display device, and to determine the changes of the eyeballs or the periphery of the eyeballs to interact with the display device. In other words, eye-tracking technology can be used to replace existing operating interfaces such as keyboards, mice, trackpads or touch panels.
常见的眼球追踪器大多将光源设置于透镜的周围,且设置于透镜面向使用者的眼球的一侧。因此,光源发出的光图案(light pattern)备受限制,除此之外,为使光源发出的光线集中射向眼球,需对应光源设置导光元件,较难符合轻薄化的设计需求,而且光源与导光元件在组装对位上的误差会对眼球追踪的准确度造成影响。In most common eye trackers, the light source is disposed around the lens, and the light source is disposed on the side of the lens facing the user's eyeball. Therefore, the light pattern emitted by the light source is limited. In addition, in order to concentrate the light emitted by the light source toward the eyeball, it is necessary to provide a light guide element corresponding to the light source, which is difficult to meet the design requirements of light and thin, and the light source The error in the assembly alignment with the light guide element will affect the accuracy of eye tracking.
发明内容SUMMARY OF THE INVENTION
本发明提供一种眼球追踪器与应用此眼球追踪器的显示装置,有助于提高眼球追踪的准确度。The present invention provides an eye tracker and a display device using the eye tracker, which helps to improve the accuracy of eye tracking.
本发明一实施例的眼球追踪器,其包括透镜、分光镜、结构光源以及取像元件。分光镜设置于透镜的一侧。结构光源设置于透镜与分光镜之间。取像元件设置于透镜与分光镜之间,其中结构光源用以发出第一光线并射向分光镜,第一光线自分光镜反射向透镜并穿过透镜以射向眼球。第一光线自眼球反射而形成第二光线,其中第二光线穿过透镜并射向分光镜,且自分光镜反射向取像元件。An eye tracker according to an embodiment of the present invention includes a lens, a beam splitter, a structured light source, and an imaging element. The beam splitter is arranged on one side of the lens. The structured light source is arranged between the lens and the beam splitter. The image capturing element is arranged between the lens and the beam splitter, wherein the structured light source is used to emit a first light beam to the beam splitter. The first light ray is reflected from the eyeball to form the second light ray, wherein the second light ray passes through the lens and goes to the beam splitter, and is reflected from the beam splitter to the imaging element.
本发明一实施例的显示装置,其包括上述的眼球追踪器以及显示面板。显示面板设置于分光镜的一侧,且分光镜位于透镜与显示面板之间。A display device according to an embodiment of the present invention includes the above-mentioned eye tracker and a display panel. The display panel is arranged on one side of the beam splitter, and the beam splitter is located between the lens and the display panel.
基于上述,本发明的眼球追踪器与应用此眼球追踪器的显示装置采用结构光源来追踪眼球或眼球周边的变化,故能提高眼球追踪的准确度。除此之外,因结构光源设置于透镜与分光镜之间,结构光源所发出的光线先射向分光镜,再自分光镜反射向眼球,无须额外设置其他导光元件,故能符合轻薄化的设计需求。Based on the above, the eye tracker of the present invention and the display device using the eye tracker adopt the structured light source to track the changes of the eyeball or the periphery of the eyeball, so the accuracy of eyeball tracking can be improved. In addition, because the structured light source is arranged between the lens and the beam splitter, the light emitted by the structured light source is first directed to the beam splitter, and then reflected from the beam splitter to the eyeball. There is no need to install other light guide elements, so it can meet the requirements of light and thin. design requirements.
为让本发明的上述特征和优点能更明显易懂,下文特举实施例,并配合所附附图作详细说明如下。In order to make the above-mentioned features and advantages of the present invention more obvious and easy to understand, the following embodiments are given and described in detail with the accompanying drawings as follows.
附图说明Description of drawings
图1是本发明一实施例的显示装置的示意图。FIG. 1 is a schematic diagram of a display device according to an embodiment of the present invention.
图2与图3分别是本发明一实施例的结构光源所产生的光图案的示意图。2 and 3 are schematic diagrams of light patterns generated by a structured light source according to an embodiment of the present invention, respectively.
图4是本发明另一实施例的显示装置的示意图。FIG. 4 is a schematic diagram of a display device according to another embodiment of the present invention.
【符号说明】【Symbol Description】
10:眼球追踪器10: Eye Tracker
20:显示面板20: Display panel
100、100A:显示装置100, 100A: Display device
101:透镜101: Lens
1011:第一透镜端1011: First lens end
1012:第二透镜端1012: Second lens end
102:分光镜102: Beamsplitter
1021:第一分光镜端1021: First beam splitter end
1022:第二分光镜端1022: Second beam splitter end
103:结构光源103: Structured light sources
1031:第一光线1031: First Ray
1032:第二光线1032: Second Ray
104:取像元件104: Image acquisition element
105:处理器105: Processor
200:眼球200: Eyeballs
D1:第一距离D1: first distance
D2:第二距离D2: second distance
D3:第三距离D3: third distance
D4:第四距离D4: Fourth distance
G1:第一间隙G1: first gap
G2:第二间隙G2: Second Gap
具体实施方式Detailed ways
图1是本发明一实施例的显示装置的示意图。请参考图1,在本实施例中,显示装置100包括眼球追踪器10以及显示面板20,其中眼球追踪器10设置于显示面板20的一侧,且眼球追踪器10包括透镜101、分光镜102、结构光源103以及取像元件104。透镜101、分光镜102以及显示面板20依序排列,也就是说,分光镜102位于透镜101与显示面板20之间。其中,显示面板20所发出的光线可依序通过分光镜102与透镜101,以射向使用者的眼球200。FIG. 1 is a schematic diagram of a display device according to an embodiment of the present invention. Please refer to FIG. 1 , in this embodiment, the
具体而言,结构光源103设置于透镜101与分光镜102之间,且取像元件104设置于透镜101与分光镜102之间。结构光源103可为激光与衍射光学元件(Diffractive opticalelement,DOE)的组合,或其他不可见光与衍射光学元件的组合,本发明对此不作限制。结构光源103用以发出第一光线1031,因衍射光学元件的设置,第一光线1031具有特定的光图案,而光图案的设计端视实际应用需求而定。另一方面,因本实施例的眼球追踪器10与应用此眼球追踪器10的显示装置100采用结构光源103来追踪眼球200或眼球周边的变化,故能提高眼球追踪的准确度。Specifically, the
图2与图3分别是本发明一实施例的结构光源所产生的光图案的示意图。请参考图2与图3,在其一实施例中,第一光线1031的光图案可由多个实线圆所组成,且这些实线圆可为同心圆。在另一实施例中,第一光线1031的光图案可由多个虚线圆所组成,且这些虚线圆可为同心圆。在其他实施例中,光图案可为十字型,或由多个并列的实线条纹或虚线条纹组成,但不限于此。2 and 3 are schematic diagrams of light patterns generated by a structured light source according to an embodiment of the present invention, respectively. Referring to FIG. 2 and FIG. 3 , in an embodiment, the light pattern of the
请继续参考图1,结构光源103所发出的第一光线1031会先射向分光镜102,接着自分光镜102反射向透镜101并穿过透镜101以射向眼球200。之后,第一光线1031自眼球200反射而形成第二光线1032,其中第二光线1032穿过透镜101并射向分光镜102,且自分光镜102反射向取像元件104。因结构光源103设置于透镜101与分光镜102之间,结构光源103所发出的光线先射向分光镜102,再自分光镜102反射向眼球200,无须额外设置其他导光元件,故能符合轻薄化的设计需求。Please continue to refer to FIG. 1 , the
在本实施例中,眼球追踪器10还包括处理器105,且结构光源103与取像元件104电性耦接处理器105。处理器105可为中央处理单元(Central Processing Unit,CPU)、系统单芯片(System on Chip,SOC)或是其他可程序化的一般用途或特殊用途的微处理器(microprocessor)、数字信号处理器(Digital Signal Processor,DSP)、可程序化控制器、特殊应用集成电路(Application Specific Integrated Circuits,ASIC)、可程序化逻辑装置(Programmable Logic Device,PLD)、其他类似处理装置或这些装置的组合,用以控制结构光源103出光,以及接收并运算处理图像信号。In this embodiment, the
进一步来说,取像元件104在接收到第二光线1032后会将第二光线1032转换为图像信号,再将图像信号传送至处理器105,之后,处理器105会对接收所得的图像信号进行运算处理。因眼球200或眼球周边的变化会连带使反射光线产生变化,处理器105会对出射光线(即第一光线1031)的光图案与反射光线(即第二光线1032)的光图案进行比对,以判断出眼球200或眼球周边的变化。Further, after receiving the second light 1032, the
在本实施例中,透镜101具有相对的第一透镜端1011与第二透镜端1012,且分光镜102具有相对的第一分光镜端1021与第二分光镜端1022。第一分光镜端1021对应于第一透镜端1011设置,且第二分光镜端1022对应于第二透镜端1012设置。另一方面,结构光源103与取像元件104设置于第二透镜端1012的一侧,且结构光源103位于第二透镜端1012与取像元件104之间。也就是说,结构光源103较取像元件104靠近第二透镜端1012。In this embodiment, the
具体而言,第一分光镜端1021与第一透镜端1011之间具有第一间隙G1,且第二分光镜端1022与第二透镜端1012之间具有第二间隙G2。第二间隙G2大于第一间隙G1,如图1所示,分光镜102倾斜于并列的透镜101与显示面板20。另一方面,结构光源103与取像元件104设置于第二间隙G2内,其中结构光源103与第二透镜端1012相距第一距离D1,且结构光源103与第二分光镜端1022相距第二距离D2。取像元件104与第二透镜端1012相距第三距离D3,且取像元件104与第二分光镜端1022相距第四距离D4。其中,第二距离D2大于第一距离D1,第四距离D4大于第三距离D3,且第三距离D3大于第一距离D1。Specifically, a first gap G1 is formed between the first
图4是本发明另一实施例的显示装置的示意图。请参考图4,本实施例中的显示装置100A与前一实施例的显示装置100大致相同,以下仅就差异处进行说明。在本实施例中,取像元件104位于第二透镜端1012与结构光源103之间,进一步来说,取像元件104与第二透镜端1012相距的第三距离D3小于结构光源103与第二透镜端1012相距的第一距离D1。FIG. 4 is a schematic diagram of a display device according to another embodiment of the present invention. Referring to FIG. 4 , the
综上所述,本发明的眼球追踪器与应用此眼球追踪器的显示装置采用结构光源来追踪眼球或眼球周边的变化,故能提高眼球追踪的准确度。除此之外,因结构光源设置于透镜与分光镜之间,结构光源所发出的光线先射向分光镜,再自分光镜反射向眼球,无须额外设置其他导光元件,故能符合轻薄化的设计需求。To sum up, the eye tracker of the present invention and the display device using the eye tracker adopt the structured light source to track the changes of the eyeball or the periphery of the eyeball, so the accuracy of eyeball tracking can be improved. In addition, because the structured light source is arranged between the lens and the beam splitter, the light emitted by the structured light source is first directed to the beam splitter, and then reflected from the beam splitter to the eyeball. There is no need to install other light guide elements, so it can meet the requirements of light and thin. design requirements.
虽然本发明已以实施例揭示如上,然其并非用以限定本发明,任何所属技术领域中的技术人员,在不脱离本发明的精神和范围内,当可作些许的更改与润饰,故本发明的保护范围当视权利要求所界定的为准。Although the present invention has been disclosed above with examples, it is not intended to limit the present invention. Any person skilled in the art can make some changes and modifications without departing from the spirit and scope of the present invention. The protection scope of the invention shall be determined by the claims.
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811608622.7A CN111381367A (en) | 2018-12-27 | 2018-12-27 | Eyeball tracker and display device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201811608622.7A CN111381367A (en) | 2018-12-27 | 2018-12-27 | Eyeball tracker and display device |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN111381367A true CN111381367A (en) | 2020-07-07 |
Family
ID=71219361
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811608622.7A Pending CN111381367A (en) | 2018-12-27 | 2018-12-27 | Eyeball tracker and display device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111381367A (en) |
Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5737012A (en) * | 1994-12-01 | 1998-04-07 | Olympus Optical Co., Ltd. | Head mounted image display apparatus and image forming apparatus related thereto |
| CN105531716A (en) * | 2013-07-30 | 2016-04-27 | 微软技术许可有限责任公司 | Near-eye optical positioning in display devices |
| CN106659541A (en) * | 2014-03-19 | 2017-05-10 | 直观外科手术操作公司 | Medical devices, systems and methods integrating eye gaze tracking for stereoscopic viewers |
| CN107209390A (en) * | 2015-02-12 | 2017-09-26 | 谷歌公司 | The display of combination high-resolution narrow and intermediate-resolution wide field are shown |
| CN108205374A (en) * | 2018-01-02 | 2018-06-26 | 京东方科技集团股份有限公司 | Eyeball tracking module and its method, the video glass of a kind of video glass |
| CN108572447A (en) * | 2017-03-13 | 2018-09-25 | 宏达国际电子股份有限公司 | Head-mounted display device, object tracking device and object tracking method thereof |
| CN207924261U (en) * | 2018-03-29 | 2018-09-28 | 北京京东方光电科技有限公司 | Display device and virtual reality device |
-
2018
- 2018-12-27 CN CN201811608622.7A patent/CN111381367A/en active Pending
Patent Citations (7)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5737012A (en) * | 1994-12-01 | 1998-04-07 | Olympus Optical Co., Ltd. | Head mounted image display apparatus and image forming apparatus related thereto |
| CN105531716A (en) * | 2013-07-30 | 2016-04-27 | 微软技术许可有限责任公司 | Near-eye optical positioning in display devices |
| CN106659541A (en) * | 2014-03-19 | 2017-05-10 | 直观外科手术操作公司 | Medical devices, systems and methods integrating eye gaze tracking for stereoscopic viewers |
| CN107209390A (en) * | 2015-02-12 | 2017-09-26 | 谷歌公司 | The display of combination high-resolution narrow and intermediate-resolution wide field are shown |
| CN108572447A (en) * | 2017-03-13 | 2018-09-25 | 宏达国际电子股份有限公司 | Head-mounted display device, object tracking device and object tracking method thereof |
| CN108205374A (en) * | 2018-01-02 | 2018-06-26 | 京东方科技集团股份有限公司 | Eyeball tracking module and its method, the video glass of a kind of video glass |
| CN207924261U (en) * | 2018-03-29 | 2018-09-28 | 北京京东方光电科技有限公司 | Display device and virtual reality device |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10496227B2 (en) | Optical touch system comprising means for projecting and detecting light beams above and inside a transmissive panel | |
| CN106055172B (en) | Optical navigation chip, optical navigation module and optical encoder | |
| US20180242841A1 (en) | Eye-tracker illumination | |
| KR102380693B1 (en) | Projection-type display device | |
| US20120181419A1 (en) | Compact optical finger navigation system based on speckles | |
| CN107896506A (en) | distance sensor | |
| US10976560B2 (en) | Navigation device, illumination system and light beam shaping optics thereof | |
| JP2011508315A (en) | Diffuse optical element in optical mouse | |
| JP2012173029A (en) | Optical position detection apparatus and display system with input function | |
| CN114815468B (en) | Multi-plane projection using laser beam scanning in augmented reality displays | |
| JP6669068B2 (en) | Projection display device | |
| US20190346687A1 (en) | Integrated structure of flood illuminator and dot projector | |
| EP3605198A1 (en) | Head mounted display and using method thereof | |
| CN110426845B (en) | Eyeball tracking architecture | |
| CN111214239B (en) | Optical detection device applied to physiological feature identification | |
| JP2016049261A (en) | Illumination imaging device and visual axis detecting apparatus | |
| US9007346B2 (en) | Handwriting system and sensing method thereof | |
| CN111381367A (en) | Eyeball tracker and display device | |
| US8089466B2 (en) | System and method for performing optical navigation using a compact optical element | |
| JP2013024579A (en) | Optical position detector and display system with input function | |
| TW202022556A (en) | Eye tracker and display | |
| WO2012022018A1 (en) | Laser optical touch control module and analog-digital conversion system and method thereof | |
| TW201710712A (en) | Multi-segment optical component and related optical detecting device capable of increasing SNR | |
| TWI439906B (en) | Sensing system | |
| TWI547850B (en) | Optical detecting device capable of increasing signal-to-noise ratio and economizing power consumption |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| WD01 | Invention patent application deemed withdrawn after publication | ||
| WD01 | Invention patent application deemed withdrawn after publication |
Application publication date: 20200707 |