[go: up one dir, main page]

WO2012133279A1 - Système optique - Google Patents

Système optique Download PDF

Info

Publication number
WO2012133279A1
WO2012133279A1 PCT/JP2012/057710 JP2012057710W WO2012133279A1 WO 2012133279 A1 WO2012133279 A1 WO 2012133279A1 JP 2012057710 W JP2012057710 W JP 2012057710W WO 2012133279 A1 WO2012133279 A1 WO 2012133279A1
Authority
WO
WIPO (PCT)
Prior art keywords
photosensor
optical system
angle
display panel
optical
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/JP2012/057710
Other languages
English (en)
Japanese (ja)
Inventor
倫大 河合
健太郎 今村
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sharp Corp
Original Assignee
Sharp Corp
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sharp Corp filed Critical Sharp Corp
Publication of WO2012133279A1 publication Critical patent/WO2012133279A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B5/00—Optical elements other than lenses
    • G02B5/08—Mirrors
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304—Detection arrangements using opto-electronic means
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
    • G06F3/042—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means
    • G06F3/0425—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by opto-electronic means using a single imaging device like a video camera for tracking the absolute position of a single or a plurality of objects with respect to an imaged reference surface, e.g. video camera imaging a display or a projection screen, a table or a wall surface, on which a computer generated image is displayed or projected
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B30/00—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images
    • G02B30/50—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images the image being built up from image elements distributed over a 3D volume, e.g. voxels
    • G02B30/56—Optical systems or apparatus for producing three-dimensional [3D] effects, e.g. stereoscopic images the image being built up from image elements distributed over a 3D volume, e.g. voxels by projecting aerial or floating images
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F2203/00—Indexing scheme relating to G06F3/00 - G06F3/048
    • G06F2203/041—Indexing scheme relating to G06F3/041 - G06F3/045
    • G06F2203/04101—2.5D-digitiser, i.e. digitiser detecting the X/Y position of the input means, finger or stylus, also when it does not touch, but is proximate to the digitiser's interaction surface and also measures the distance of the input means within a short range in the Z direction, possibly with a separate measurement setup

Definitions

  • the present invention relates to an optical system capable of forming an image of a projection object in a space.
  • Patent Documents 1 to 3 an optical system that forms an image of a projection object in a space using a reflective imaging element has been proposed (for example, Patent Documents 1 to 3).
  • the optical system has a reflective imaging element and a projection, and an image displayed in space (hereinafter referred to as “aerial image”) is in a plane-symmetric position with the reflective imaging element as a symmetry plane.
  • the image of the projection object is formed.
  • This optical system uses specular reflection of a reflective imaging element, and in principle, the ratio of the size of the image of the projection object and the image projected in space is 1: 1.
  • the reflective imaging element includes an optical element that includes a hole penetrating in the thickness direction of a flat substrate and includes two mirror elements perpendicular to the inner wall of each hole (for example, see Patent Document 1). 4), or a plurality of transparent cylindrical bodies projecting in the thickness direction of the substrate and having an optical element composed of two mirror surface elements orthogonal to the inner wall surface of each cylindrical body. (For example, see FIG. 7 of Patent Document 1).
  • Patent Document 1 has tens of thousands to hundreds of thousands of square holes each having a side of about 50 ⁇ m to 200 ⁇ m formed on a substrate having a thickness of 50 ⁇ m to 200 ⁇ m.
  • the inner surface is mirror-coated by electroforming, nanoprinting or sputtering.
  • Patent Document 3 discloses an optical system in which an infrared camera is arranged on the side where the projection object of the reflective imaging element is arranged to detect that a human hand touches the aerial image. .
  • Patent Documents 1 to 3 For the purpose of reference, the entire disclosure of Patent Documents 1 to 3 is incorporated herein by reference.
  • JP 2008-158114 A International Publication No. 2009/136578 International Publication No. 2008/123500
  • Patent Document 3 does not disclose a quantitative relationship between the installation position of the infrared camera and the projection object and the detection accuracy, the optimal arrangement position of the infrared camera is unknown.
  • the present invention has been made in view of the above problems, and an object of the present invention is to provide a reflective imaging element that can accurately detect contact with an aerial image by optimizing the installation positions of an optical sensor and a projection object. It is to provide an optical system having a child.
  • An optical system includes a reflective imaging element having a display panel, two mirror elements that contribute to imaging, and a mirror element facing either of the two mirror elements, and the reflective imaging element At least one photosensor disposed on the display panel side, wherein the at least one photosensor is disposed to face the display panel, and a width of each of the two specular elements is a, When the height of each of the two specular elements is b, the angle ⁇ 1 formed by the optical axis of the at least one photosensor and the normal direction of the reflective imaging element satisfies the equation (1). , The image displayed on the display surface of the display panel is imaged at a plane-symmetrical position with the reflective imaging element as a symmetry plane.
  • the installation angle of the display panel is equal to the angle ⁇ 1.
  • the angle ⁇ 1 satisfies 30 ° ⁇ 1 ⁇ 70 °.
  • the at least one photosensor includes a first photosensor and a second photosensor, and when viewed from the normal direction of the reflective imaging element, the second photosensor is a first photosensor.
  • the axis As the axis of symmetry, it is arranged in a line-symmetrical position with the first photosensor, and when the counterclockwise direction is the positive direction and the clockwise direction is the negative direction, the light of the first axis and the first photosensor.
  • the angle ⁇ satisfies 0 ° ⁇ ⁇ 65 °
  • the first One axis is parallel to a bisected line that bisects the angle formed by the two specular elements.
  • the display panel and the at least one photosensor are connected to an arrangement control module that controls the arrangement of the display panel and the at least one photosensor.
  • the light emitted from the at least one photosensor is infrared or visible light.
  • the at least one photosensor includes a plurality of photosensors.
  • the optical system includes an optical sensor module in which the plurality of optical sensors are arranged in an array.
  • each of the plurality of optical sensors independently detects contact with each of a plurality of aerial images formed to overlap in a normal direction of the reflective imaging element.
  • an optical system having a reflective imaging element that can accurately detect contact with an aerial image is provided.
  • FIG. 6 is a diagram illustrating a modification example of the optical system 100.
  • FIG. 6 is a diagram illustrating another embodiment of the optical system 100. 2 is a schematic plan view of the optical sensor module 120.
  • FIG. 1A is a schematic diagram of the optical system 100
  • FIG. 1B is a schematic plan view of the reflective imaging element 10.
  • the optical system 100 shown in FIG. 1A includes a display panel 30, a reflective imaging element 10, and at least one photosensor 40 disposed on the display panel 30 side of the reflective imaging element 10. At least one photosensor 40 is arranged to face the display surface of the display panel 30.
  • the optical system 100 forms an image displayed on the display surface of the display panel 30 at a plane-symmetric position with the reflective imaging element 10 as a symmetry plane, and an aerial image 50 is obtained. Further, the optical sensor 40 can detect that, for example, a human hand F touches the aerial image 50.
  • the light emitted from the optical sensor 40 is preferably infrared or visible light. In the case of the optical sensor 40 using visible light, the observer can easily recognize the position of the light emitted from the optical sensor 40.
  • the optical sensor 40 is less susceptible to the influence of surrounding visible light (for example, light from a fluorescent lamp), so that the optical sensor 40 is less likely to malfunction.
  • a TOF (Time-Of-Flight) type infrared sensor is used as the optical sensor 40.
  • the reflective imaging element 10 includes a flat substrate 12, a plurality of through holes 22 that penetrate in the thickness direction of the substrate 12, and inner walls of the plurality of through holes 22. It has two mirror surface elements 14a and 15a orthogonal to each other.
  • the plurality of through holes 22 are each rectangular (for example, square).
  • the two specular elements 14a and 15a are specular elements that contribute to imaging. Furthermore, it has the mirror surface elements 14b and 15b facing either of the two mirror surface elements 14a and 15a. When there is one optical sensor 40, only one of the mirror elements 14b and 15b may be formed.
  • the specular elements 14b and 15b are specular elements that receive light (for example, infrared rays) from the optical sensor 40.
  • FIG. 1 (c) and 1 (d) are schematic enlarged views of the region X of the reflective imaging element 10 shown in FIG. 1 (b).
  • the light 60 from the display panel 30 is incident on the two mirror elements 14a and 15a and reflected (metal reflection or total reflection), thereby condensing in the air.
  • the specular elements 14a, 14b, 15a and 15b each have a width a and a height b.
  • the width a is preferably 50 ⁇ m or more and 1500 ⁇ m or less (for example, 209 ⁇ m)
  • the height b is preferably 150 ⁇ m or more and 4500 ⁇ m or less (for example, 160 ⁇ m).
  • Patent Application 1 In the international publication 2011/136214 (hereinafter referred to as Patent Application 1), the present applicant examined the installation position of the display panel from which an aerial image with high visibility is obtained. For reference, the entire disclosure of Patent Application 1 is incorporated herein by reference. In patent application 1, it was found that the installation angle ⁇ 2 of the display panel 30 preferably satisfies the formula (2).
  • the angle ⁇ 1 formed by the optical axis of at least one photosensor 40 and the normal direction L of the reflective imaging element 10 also preferably satisfies the formula (2).
  • the optical sensor 40 when the optical sensor 40 is arranged, it is possible to accurately detect contact with an aerial image.
  • the optical system 100 allows the optical sensor 40 and the display panel 30 to be arranged so that the optical sensor 40 and the display panel 30 do not interfere with each other, and the optical sensor 40 and the display panel 30 are connected in a reflective manner.
  • the image element 10 can be arranged so as to be hidden from the observer. Furthermore, since the positional relationship among the display panel 30, the optical sensor 40, and the reflective imaging element 10 is constant, an optimal positional relationship is easily provided.
  • FIG. 2 is a diagram for explaining the positional relationship of the optical sensors 40 when viewed from the normal direction of the reflective imaging element 10.
  • the second photosensor 40b when viewed from the normal direction of the reflective imaging element 10, the second photosensor 40b is line-symmetric with the first photosensor 40a with the first axis 71 as the axis of symmetry. Placed in position.
  • the first axis 71 is parallel to a bisector that bisects the angle formed by the two specular elements 14a and 15a (see the dotted line 70 in FIG. 1C).
  • the first photosensor 40a and the second photosensor 40b are arranged so that the center P of the display area of the display panel 30 and the first axis 71 overlap. It is preferable to arrange.
  • the center of the aerial image 50 and the center P of the display area of the display panel 30 overlap.
  • the light 80 emitted from the optical sensor 40 enters, for example, the mirror element 14b facing the mirror element 14a that contributes to image formation, and is reflected by the mirror element 14b. Enters the mirror surface element 14a, and the light reflected by the mirror surface element 14a travels toward the aerial image.
  • the inventor made an angle formed by the first axis 71 and the optical axis of the first optical sensor (for example, a TOF type infrared sensor) 40a, where counterclockwise is a positive direction and clockwise is a negative direction.
  • the relationship between the angle ⁇ and the sensor intensity Is was simulated when the angle between the first axis 71 and the optical axis of the second optical sensor (for example, the TOF infrared sensor) 40b was ⁇ .
  • FIG.2 (c) is a graph which shows the result which the inventor simulated.
  • the sensor intensity Is is preferably greater than 0% (0 ° ⁇ ⁇ 65 °) and the sensor intensity Is is considered from the utilization efficiency of light from the photosensor. 50% or more (35 ° ⁇ ⁇ ⁇ 55 °) is more preferable.
  • the simulation results show that the angle ⁇ does not depend on the angle ⁇ 1.
  • Two or more optical sensors 40 can be used, and it may be detected that the aerial image 50 is touched by time division.
  • the reflected light intensity is too strong. Therefore, in the case of the TOF type infrared sensor, it is preferable to use the reflected light intensity within an angle ⁇ range detectable by the sensor.
  • the reflected light intensity decreases in proportion to the square of the distance.
  • the optical system 100 can be modified to an optical system incorporating a module 91 (hereinafter referred to as an “arrangement control module”) that controls the relative arrangement relationship between the display panel 30 and the optical sensor 40.
  • the optical system having the arrangement control module 91 facilitates optimal arrangement of the display panel 30 and the optical sensor 40.
  • the optical sensors 40a to 40d that independently detect that the aerial images 50a and 50b are touched can be installed without interfering with each other.
  • the angle ⁇ 1 and the angle ⁇ 2 corresponding to the angle ⁇ of each of the optical sensors 40a to 40d are preferably independently 0 ° ⁇ 1, ⁇ 2 ⁇ 65 °, and 35 ° ⁇ ⁇ 1, ⁇ 2 ⁇ 55. More preferably.
  • the axis 71 in FIG. 5 corresponds to the axis 71 shown in FIG.
  • each of the optical sensors 40a to 40d is preferably connected to the corresponding arrangement control modules 91a and 91b.
  • an optical sensor module 120 in which a plurality of optical sensors 40 are arranged in an array may be used.
  • the detection accuracy of contact with an aerial image is further increased.
  • the present invention provides an optical system having a reflective imaging element that can accurately detect contact with an aerial image.
  • the present invention can be widely applied to an optical system having a reflective imaging element capable of forming an image of a projection object in space and a display panel.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Multimedia (AREA)
  • Optics & Photonics (AREA)
  • Optical Elements Other Than Lenses (AREA)

Abstract

Un système optique (100) selon la présente invention comprend : un panneau d'affichage (30) ; un élément d'imagerie du type réfléchissant (10) ; ainsi qu'au moins un capteur de lumière (40) disposé sur le côté panneau d'affichage (30) de l'élément d'imagerie du type réfléchissant (10). Ledit capteur de lumière (40) est placé de manière à avoir une relation prédéfinie, et une image affichée sur la surface d'affichage du panneau d'affichage (30) est formée à un emplacement symétrique dans le plan, l'élément d'imagerie du type réfléchissant (10) constituant le plan de symétrie.
PCT/JP2012/057710 2011-03-30 2012-03-26 Système optique Ceased WO2012133279A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2011075639 2011-03-30
JP2011-075639 2011-03-30

Publications (1)

Publication Number Publication Date
WO2012133279A1 true WO2012133279A1 (fr) 2012-10-04

Family

ID=46930997

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2012/057710 Ceased WO2012133279A1 (fr) 2011-03-30 2012-03-26 Système optique

Country Status (1)

Country Link
WO (1) WO2012133279A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014127822A (ja) * 2012-12-26 2014-07-07 Funai Electric Co Ltd 画像表示装置
JP2015060296A (ja) * 2013-09-17 2015-03-30 船井電機株式会社 空間座標特定装置
JP2016103028A (ja) * 2015-12-21 2016-06-02 増田　麻言 走査型投影装置、および携帯型投影装置
WO2023136106A1 (fr) * 2022-01-13 2023-07-20 凸版印刷株式会社 Appareil d'affichage aérien

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007013215A1 (fr) * 2005-07-25 2007-02-01 Pioneer Corporation Dispositif d’affichage d’image
WO2008123500A1 (fr) * 2007-03-30 2008-10-16 National Institute Of Information And Communications Technology Dispositif d'interaction vidéo en vol et son programme

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2007013215A1 (fr) * 2005-07-25 2007-02-01 Pioneer Corporation Dispositif d’affichage d’image
WO2008123500A1 (fr) * 2007-03-30 2008-10-16 National Institute Of Information And Communications Technology Dispositif d'interaction vidéo en vol et son programme

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
HIROSHI FURUKAWA ET AL.: "Kuchu Eizo o Tsukatta Tegaki Interface", HUMAN INTERFACE SYMPOSIUM RONBUNSHU, no. 1502, 2010, pages 255 - 258 *

Cited By (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014127822A (ja) * 2012-12-26 2014-07-07 Funai Electric Co Ltd 画像表示装置
JP2015060296A (ja) * 2013-09-17 2015-03-30 船井電機株式会社 空間座標特定装置
JP2016103028A (ja) * 2015-12-21 2016-06-02 増田　麻言 走査型投影装置、および携帯型投影装置
WO2023136106A1 (fr) * 2022-01-13 2023-07-20 凸版印刷株式会社 Appareil d'affichage aérien
JP2023102972A (ja) * 2022-01-13 2023-07-26 凸版印刷株式会社 空中表示装置
TWI858504B (zh) * 2022-01-13 2024-10-11 日商凸版印刷股份有限公司 空中顯示裝置
EP4465155A4 (fr) * 2022-01-13 2025-04-02 Toppan Holdings Inc. Appareil d'affichage aérien

Similar Documents

Publication Publication Date Title
TWI654445B (zh) 空間影像顯示裝置
TWI502212B (zh) 光學裝置、使用微透鏡之感光元件及其製作方法
JP7727028B2 (ja) 飛行時間ｔｏｆセンサモジュールおよび電子デバイス
CN104597700B (zh) 光出射装置及图像显示系统
JP5754266B2 (ja) 指示部材、光学式位置検出装置、および入力機能付き表示システム
JP2011065620A (ja) 光学式タッチ装置、遮光物の位置検出方法及び線性光源モジュール
US11402285B2 (en) Force sensor and device provided with force sensor
JP2012173029A (ja) 光学式位置検出装置および入力機能付き表示システム
WO2012133279A1 (fr) Système optique
JP2012059228A (ja) 座標入力装置
TW201324259A (zh) 使用者介面顯示裝置
CN102985786A (zh) 投光器和用于距离测定的视觉系统
CN107710309A (zh) 光学片、显示装置和电子设备
CN118999395A (zh) 复眼式单目标方向矢量测量微系统
US20240125985A1 (en) Image-forming element and image display device
CN105096576B (zh) 信号接收模块与显示装置
US20130016068A1 (en) Optical position detection device and display system with input function
CN101903819B (zh) 光电子装置和图像记录设备
JP2012201346A (ja) 照明装置
WO2020090593A1 (fr) Système de détection d'objet et étagère de présentation d'article
US9389123B2 (en) Mask applied to a sensing surface of a dual pyroelectric sensor
US20110018805A1 (en) Location-detecting system and arrangement method thereof
US9599831B2 (en) Spatial image display apparatus
TWI595253B (zh) 可用來判斷參考物件或光源相對位置的光學偵測裝置
JP2001290584A (ja) 光デジタイザ

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12763886

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 12763886

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP