[go: up one dir, main page]

EP3281058A4 - Virtual reality display apparatus and display method thereof - Google Patents

Virtual reality display apparatus and display method thereof Download PDF

Info

Publication number
EP3281058A4
EP3281058A4 EP16842274.9A EP16842274A EP3281058A4 EP 3281058 A4 EP3281058 A4 EP 3281058A4 EP 16842274 A EP16842274 A EP 16842274A EP 3281058 A4 EP3281058 A4 EP 3281058A4
Authority
EP
European Patent Office
Prior art keywords
virtual reality
display apparatus
display
display method
reality display
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
EP16842274.9A
Other languages
German (de)
French (fr)
Other versions
EP3281058A1 (en
Inventor
Weiming Li
Do-Wan Kim
Jae-Yun Jeong
Yong-Gyoo Kim
Gengyu Ma
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Samsung Electronics Co Ltd
Original Assignee
Samsung Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Samsung Electronics Co Ltd filed Critical Samsung Electronics Co Ltd
Priority claimed from PCT/KR2016/009711 external-priority patent/WO2017039308A1/en
Publication of EP3281058A1 publication Critical patent/EP3281058A1/en
Publication of EP3281058A4 publication Critical patent/EP3281058A4/en
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T19/00—Manipulating 3D models or images for computer graphics
    • G06T19/006—Mixed reality
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/017—Head mounted
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/70—Determining position or orientation of objects or cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20—Image signal generators
    • H04N13/204—Image signal generators using stereoscopic image cameras
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/332—Displays for viewing with the aid of special glasses or head-mounted displays [HMD]
    • H04N13/344—Displays for viewing with the aid of special glasses or head-mounted displays [HMD] with head-mounted left-right displays
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/30—Image reproducers
    • H04N13/398—Synchronisation thereof; Control thereof
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0132—Head-up displays characterised by optical features comprising binocular systems
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0132—Head-up displays characterised by optical features comprising binocular systems
    • G02B2027/0134—Head-up displays characterised by optical features comprising binocular systems of stereoscopic type
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
    • G02B27/01—Head-up displays
    • G02B27/0101—Head-up displays characterised by optical features
    • G02B2027/0138—Head-up displays characterised by optical features comprising image capture systems, e.g. camera

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Optics & Photonics (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Software Systems (AREA)
  • Computer Hardware Design (AREA)
  • Computer Graphics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Human Computer Interaction (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
EP16842274.9A 2015-08-31 2016-08-31 Virtual reality display apparatus and display method thereof Ceased EP3281058A4 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
CN201510549225.7A CN106484085B (en) 2015-08-31 2015-08-31 Method for displaying real objects in head mounted display and head mounted display therefor
KR1020160106177A KR20170026164A (en) 2015-08-31 2016-08-22 Virtual reality display apparatus and display method thereof
PCT/KR2016/009711 WO2017039308A1 (en) 2015-08-31 2016-08-31 Virtual reality display apparatus and display method thereof

Publications (2)

Publication Number Publication Date
EP3281058A1 EP3281058A1 (en) 2018-02-14
EP3281058A4 true EP3281058A4 (en) 2018-04-11

Family

ID=58236359

Family Applications (1)

Application Number Title Priority Date Filing Date
EP16842274.9A Ceased EP3281058A4 (en) 2015-08-31 2016-08-31 Virtual reality display apparatus and display method thereof

Country Status (3)

Country Link
EP (1) EP3281058A4 (en)
KR (1) KR20170026164A (en)
CN (2) CN110275619B (en)

Families Citing this family (48)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP7070547B2 (en) 2017-03-22 2022-05-18 ソニーグループ株式会社 Image processing equipment and methods, as well as programs
CN107168515A (en) * 2017-03-31 2017-09-15 北京奇艺世纪科技有限公司 The localization method and device of handle in a kind of VR all-in-ones
CN106896925A (en) * 2017-04-14 2017-06-27 陈柳华 The device that a kind of virtual reality is merged with real scene
CN107222689B (en) * 2017-05-18 2020-07-03 歌尔科技有限公司 Real scene switching method and device based on VR (virtual reality) lens
CN108960008B (en) * 2017-05-22 2021-12-14 华为技术有限公司 Method and device for VR display, VR equipment
CN107229342A (en) * 2017-06-30 2017-10-03 宇龙计算机通信科技(深圳)有限公司 Document handling method and user equipment
CN107577337A (en) * 2017-07-25 2018-01-12 北京小鸟看看科技有限公司 A kind of keyboard display method for wearing display device, device and wear display device
US10627635B2 (en) * 2017-08-02 2020-04-21 Microsoft Technology Licensing, Llc Transitioning into a VR environment and warning HMD users of real-world physical obstacles
CN107422942A (en) * 2017-08-15 2017-12-01 吴金河 A kind of control system and method for immersion experience
CN111448568B (en) * 2017-09-29 2023-11-14 苹果公司 Environment-based application demonstration
DE102017218215B4 (en) 2017-10-12 2024-08-01 Audi Ag Method for operating a head-mounted electronic display device and display system for displaying virtual content
KR102389185B1 (en) * 2017-10-17 2022-04-21 삼성전자주식회사 Electronic device and method for executing function using input interface displayed via at least portion of content
CN108169901A (en) * 2017-12-27 2018-06-15 北京传嘉科技有限公司 VR glasses
CN108040247A (en) * 2017-12-29 2018-05-15 湖南航天捷诚电子装备有限责任公司 A kind of wear-type augmented reality display device and method
CN108572723B (en) * 2018-02-02 2021-01-29 陈尚语 Carsickness prevention method and equipment
KR102076647B1 (en) * 2018-03-30 2020-02-12 데이터얼라이언스 주식회사 IoT Device Control System And Method Using Virtual reality And Augmented Reality
CN108519676B (en) * 2018-04-09 2020-04-28 杭州瑞杰珑科技有限公司 Head-wearing type vision-aiding device
US11087136B2 (en) 2018-04-13 2021-08-10 Apple Inc. Scene classification
CN108764152B (en) * 2018-05-29 2020-12-04 北京物灵智能科技有限公司 Method and device for realizing interactive prompt based on picture matching and storage equipment
CN108922115B (en) * 2018-06-26 2020-12-18 联想(北京)有限公司 Information processing method and electronic equipment
WO2020051509A2 (en) 2018-09-07 2020-03-12 Ocelot Laboratories Llc Transitioning between imagery and sounds of a virtual environment and a real environment
JP6739847B2 (en) 2018-09-12 2020-08-12 株式会社アルファコード Image display control device and image display control program
EP3671410B1 (en) * 2018-12-19 2022-08-24 Siemens Healthcare GmbH Method and device to control a virtual reality display unit
US10992926B2 (en) * 2019-04-15 2021-04-27 XRSpace CO., LTD. Head mounted display system capable of displaying a virtual scene and a real scene in a picture-in-picture mode, related method and related non-transitory computer readable storage medium
US11137908B2 (en) * 2019-04-15 2021-10-05 Apple Inc. Keyboard operation with head-mounted device
US20200327867A1 (en) * 2019-04-15 2020-10-15 XRSpace CO., LTD. Head mounted display system capable of displaying a virtual scene and a map of a real environment in a picture-in-picture mode, related method and related non-transitory computer readable storage medium
US11265487B2 (en) * 2019-06-05 2022-03-01 Mediatek Inc. Camera view synthesis on head-mounted display for virtual reality and augmented reality
US12147607B1 (en) 2019-07-11 2024-11-19 Apple Inc. Transitioning between environments
CN110475103A (en) * 2019-09-05 2019-11-19 上海临奇智能科技有限公司 A kind of wear-type visual device
CN111124112A (en) * 2019-12-10 2020-05-08 北京一数科技有限公司 Interactive display method and device for virtual interface and entity object
JP6754908B1 (en) * 2020-02-07 2020-09-16 株式会社ドワンゴ Viewing terminal, viewing method, viewing system and program
CN111427447B (en) * 2020-03-04 2023-08-29 青岛小鸟看看科技有限公司 Virtual keyboard display method, head-mounted display device and system
CN112462937B (en) 2020-11-23 2022-11-08 青岛小鸟看看科技有限公司 Local perspective method and device of virtual reality equipment and virtual reality equipment
CN112445341B (en) * 2020-11-23 2022-11-08 青岛小鸟看看科技有限公司 Keyboard perspective method and device of virtual reality equipment and virtual reality equipment
CN112581054B (en) * 2020-12-09 2023-08-29 珠海格力电器股份有限公司 Material management method and material management device
CN114827338A (en) * 2021-01-29 2022-07-29 北京外号信息技术有限公司 Method and electronic device for presenting virtual objects on a display medium of a device
CN114035732A (en) * 2021-11-04 2022-02-11 海南诺亦腾海洋科技研究院有限公司 Method and device for controlling virtual experience content of VR head display equipment by one key
KR20230072757A (en) 2021-11-18 2023-05-25 삼성전자주식회사 Wearable electronic device and operating method of wearable electronic device
CN114327044A (en) * 2021-11-30 2022-04-12 歌尔光学科技有限公司 Control method and device for head-mounted display device, head-mounted display device and medium
WO2023130435A1 (en) * 2022-01-10 2023-07-13 深圳市闪至科技有限公司 Interaction method, head-mounted display device, and system and storage medium
CN114372179A (en) * 2022-01-12 2022-04-19 乌鲁木齐涅墨西斯网络科技有限公司 A spatial visualization community management system and method based on AR technology
CN114419292B (en) * 2022-01-21 2025-06-03 北京字跳网络技术有限公司 Image processing method, device, equipment and storage medium
CN114972692B (en) * 2022-05-12 2023-04-18 北京领为军融科技有限公司 Target positioning method based on AI identification and mixed reality
CN115661414B (en) * 2022-11-04 2025-08-22 深圳技术大学 Image processing method and intelligent terminal
CN116229503B (en) * 2022-12-26 2025-08-26 歌尔科技有限公司 Gesture recognition method, device, head-mounted device, head-mounted system and medium
WO2024190187A1 (en) * 2023-03-14 2024-09-19 パナソニックＩｐマネジメント株式会社 Display control device, display control method, and program
CN116744195B (en) * 2023-08-10 2023-10-31 苏州清听声学科技有限公司 Parametric array loudspeaker and directional deflection method thereof
CN119576111A (en) * 2023-09-05 2025-03-07 珠海莫界科技有限公司 Control method, device, equipment and storage medium of head mounted display device

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120249587A1 (en) * 2011-04-04 2012-10-04 Anderson Glen J Keyboard avatar for heads up display (hud)
US20120326961A1 (en) * 2011-06-21 2012-12-27 Empire Technology Development Llc Gesture based user interface for augmented reality
US20130328762A1 (en) * 2012-06-12 2013-12-12 Daniel J. McCulloch Controlling a virtual object with a real controller device
WO2015111283A1 (en) * 2014-01-23 2015-07-30 ソニー株式会社 Image display device and image display method

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6037882A (en) * 1997-09-30 2000-03-14 Levy; David H. Method and apparatus for inputting data to an electronic system
GB2376397A (en) * 2001-06-04 2002-12-11 Hewlett Packard Co Virtual or augmented reality
JP2005044102A (en) * 2003-07-28 2005-02-17 Canon Inc Image reproduction method and image reproduction apparatus
JP2009025918A (en) * 2007-07-17 2009-02-05 Canon Inc Image processing apparatus and image processing method
CN101893935B (en) * 2010-07-14 2012-01-11 北京航空航天大学 Cooperative construction method for enhancing realistic table-tennis system based on real rackets
US8884984B2 (en) * 2010-10-15 2014-11-11 Microsoft Corporation Fusing virtual content into real content
JP2012173772A (en) * 2011-02-17 2012-09-10 Panasonic Corp User interaction device, user interaction method, user interaction program, and integrated circuit
US20120249416A1 (en) * 2011-03-29 2012-10-04 Giuliano Maciocci Modular mobile connected pico projectors for a local multi-user collaboration
JP5765133B2 (en) * 2011-08-16 2015-08-19 富士通株式会社 Input device, input control method, and input control program
US8941560B2 (en) * 2011-09-21 2015-01-27 Google Inc. Wearable computer with superimposed controls and instructions for external device
CN103018905A (en) * 2011-09-23 2013-04-03 奇想创造事业股份有限公司 Head-mounted somatosensory control display system and method thereof
US9081177B2 (en) * 2011-10-07 2015-07-14 Google Inc. Wearable computer with nearby object response
JP6079614B2 (en) * 2013-12-19 2017-02-15 ソニー株式会社 Image display device and image display method

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20120249587A1 (en) * 2011-04-04 2012-10-04 Anderson Glen J Keyboard avatar for heads up display (hud)
US20120326961A1 (en) * 2011-06-21 2012-12-27 Empire Technology Development Llc Gesture based user interface for augmented reality
US20130328762A1 (en) * 2012-06-12 2013-12-12 Daniel J. McCulloch Controlling a virtual object with a real controller device
WO2015111283A1 (en) * 2014-01-23 2015-07-30 ソニー株式会社 Image display device and image display method
EP3098689A1 (en) * 2014-01-23 2016-11-30 Sony Corporation Image display device and image display method

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
See also references of WO2017039308A1 *
SOOYOUNG KIM ET AL: "Using keyboards with head mounted displays", VIRTUAL REALITY CONTINUUM AND ITS APPLICATIONS PROCEEDINGS OF THE 2004 ACM SIGGRAPH INTERNATIONAL CONFERENCE ON VIRTUAL REALITY CONTINUUM AND ITS APPLICATIONS IN INDUSTRY, ACM NEW YORK, NY, US, 1 January 2004 (2004-01-01), pages 336 - 343, XP002674991, ISBN: 978-1-58113-884-9, DOI: 10.1145/1044588.1044662 *

Also Published As

Publication number Publication date
CN106484085A (en) 2017-03-08
CN106484085B (en) 2019-07-23
EP3281058A1 (en) 2018-02-14
KR20170026164A (en) 2017-03-08
CN110275619A (en) 2019-09-24
CN110275619B (en) 2024-08-23

Similar Documents

Publication Publication Date Title
EP3281058A4 (en) Virtual reality display apparatus and display method thereof
EP3284081A4 (en) Display apparatus and method for displaying
EP3445463A4 (en) Virtual reality haptic system and apparatus
EP3281403A4 (en) Methods and apparatus for augmented reality applications
EP3302251A4 (en) Biofeedback virtual reality system and method
EP3286911A4 (en) Display apparatus and control method thereof
EP3149539A4 (en) Methods and systems for generating virtual content display with a virtual or augmented reality apparatus
EP3358524A4 (en) Method and device for tweaking virtual reality image
GB2554914B (en) Virtual reality system and method
EP3297288A4 (en) Display method and display device
EP3167356A4 (en) Display apparatus and control method thereof
EP3338272A4 (en) Display apparatus and control method thereof
EP3338178A4 (en) Display apparatus and control method thereof
EP3309774A4 (en) Display device and display method
EP3350989A4 (en) 3d display apparatus and control method thereof
EP3306944A4 (en) Display method and display device
EP3273287A4 (en) Display device and display method therefor
EP3345384A4 (en) Display apparatus and control method thereof
EP3318058A4 (en) Display apparatus and controlling method thereof
EP3286630A4 (en) Display apparatus and control method thereof
EP3400580A4 (en) Method and apparatus for facilitating interaction with virtual reality equipment
EP3108356A4 (en) Display apparatus and control method thereof
EP3274894A4 (en) Display apparatus and display method
EP3352066A4 (en) Method and apparatus for displaying function interface
EP3311582A4 (en) Display device and operating method thereof

Legal Events

Date Code Title Description
STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE

PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE

17P Request for examination filed

Effective date: 20171106

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

AX Request for extension of the european patent

Extension state: BA ME

A4 Supplementary search report drawn up and despatched

Effective date: 20180308

RIC1 Information provided on ipc code assigned before grant

Ipc: G06T 7/70 20170101ALI20180303BHEP

Ipc: G02B 27/01 20060101ALI20180303BHEP

Ipc: G02B 27/22 20180101AFI20180303BHEP

Ipc: G06T 19/00 20110101ALI20180303BHEP

Ipc: G06F 3/01 20060101ALI20180303BHEP

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: EXAMINATION IS IN PROGRESS

DAV Request for validation of the european patent (deleted)
DAX Request for extension of the european patent (deleted)
17Q First examination report despatched

Effective date: 20181128

REG Reference to a national code

Ref country code: DE

Ref legal event code: R003

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION HAS BEEN REFUSED

18R Application refused

Effective date: 20210320