[go: up one dir, main page]

US9733789B2 - Interfacing with a device via virtual 3D objects - Google Patents

Interfacing with a device via virtual 3D objects Download PDF

Info

Publication number
US9733789B2
US9733789B2 US14/236,492 US201214236492A US9733789B2 US 9733789 B2 US9733789 B2 US 9733789B2 US 201214236492 A US201214236492 A US 201214236492A US 9733789 B2 US9733789 B2 US 9733789B2
Authority
US
United States
Prior art keywords
activatable
activating
processor
activatable object
distinct
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related, expires
Application number
US14/236,492
Other languages
English (en)
Other versions
US20150363070A1 (en
Inventor
Itay Katz
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Eyesight Mobile Technologies Ltd
Original Assignee
Eyesight Mobile Technologies Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Eyesight Mobile Technologies Ltd filed Critical Eyesight Mobile Technologies Ltd
Priority to US14/236,492 priority Critical patent/US9733789B2/en
Assigned to EYESIGHT MOBILE TECHNOLOGIES LTD. reassignment EYESIGHT MOBILE TECHNOLOGIES LTD. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: KATZ, ITAY
Publication of US20150363070A1 publication Critical patent/US20150363070A1/en
Application granted granted Critical
Publication of US9733789B2 publication Critical patent/US9733789B2/en
Expired - Fee Related legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/04815Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/013Eye tracking input arrangements
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017Gesture based interaction, e.g. based on a set of recognized hand gestures
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/0304Detection arrangements using opto-electronic means
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0481Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
    • G06F3/0482Interaction with lists of selectable items, e.g. menus
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/048Interaction techniques based on graphical user interfaces [GUI]
    • G06F3/0484Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
    • G06F3/04842Selection of displayed objects or displayed text elements
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/16Sound input; Sound output
    • G06F3/167Audio in a user interface, e.g. using voice commands for navigating, audio feedback

Definitions

  • the message or command generated when an activatable object is activated may depend on how the object was activated.
  • Different modes of activating an activatable object include, for example, pointing at an activatable object, holding an activating object at an activatable object for a predetermined amount of time, clicking on the activatable object, double clicking, clicking from the right side, clicking from the left side, clicking from the bottom, clicking from the top, grasping the object, gesturing towards the object from the right, or from the left side, passing through the object, pushing the object, clapping over the object, waving over the object, performing a blast gesture, performing a tapping gesture, performing a clockwise or counter clockwise gesture over the object grasping the object with two fingers, performing a click-drag-release motion, sliding an icon such as a volume bar.
  • the generated command for scrolling may depend on the speed or acceleration of a performed scrolling motion.
  • one or more of the activating objects may be one or more hands, a part of a hand, one or more fingers, one or more parts of a finger, a fingertip, or a stylus.
  • the system 2 may be associated with a device 21 , in which case the command executed by the processor 6 upon activation of an activatable object may be an operating system (OS) command of the device 21 .
  • OS commands include depressing a virtual key displayed on a display screen of the device; rotating a selection carousel; switching between desktops; running on the central processor unit a predetermined software application; turning off an application; turning the speakers on or off; turning the volume up/down; skipping to the next or previous track in a media player or between IPTV channels; controlling a navigation application; unlocking the device, stopping/running an application, starting a call, ending a call, presenting a notification, displaying a notification; navigating in a photo or music album gallery, scrolling web-pages, emails, documents or maps, controlling actions in games, controlling interactive video or animated content, editing video or images, pointing at a map, zooming-in/out on a map or images, painting on an image, pushing an activatable object toward the display device, pulling an activa
  • the executed command may also depend on how or where an activating objected “touches” an activatable object.
  • the command associated with activation of an activatable object may depend upon how the user “touches” the activatable object. For example, a “light touch” and a “deep touch” may result in a different command being executed.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Multimedia (AREA)
  • Health & Medical Sciences (AREA)
  • Audiology, Speech & Language Pathology (AREA)
  • General Health & Medical Sciences (AREA)
  • User Interface Of Digital Computer (AREA)
  • Processing Or Creating Images (AREA)
US14/236,492 2011-08-04 2012-08-02 Interfacing with a device via virtual 3D objects Expired - Fee Related US9733789B2 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US14/236,492 US9733789B2 (en) 2011-08-04 2012-08-02 Interfacing with a device via virtual 3D objects

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201161515055P 2011-08-04 2011-08-04
US14/236,492 US9733789B2 (en) 2011-08-04 2012-08-02 Interfacing with a device via virtual 3D objects
PCT/IL2012/050290 WO2013018099A2 (fr) 2011-08-04 2012-08-02 Système et procédé pour assurer l'interface avec un dispositif par le biais d'un affichage en 3d

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/IL2012/050290 A-371-Of-International WO2013018099A2 (fr) 2011-08-04 2012-08-02 Système et procédé pour assurer l'interface avec un dispositif par le biais d'un affichage en 3d

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/675,981 Continuation US10606442B2 (en) 2011-08-04 2017-08-14 Touch-free gesture recognition system and method

Publications (2)

Publication Number Publication Date
US20150363070A1 US20150363070A1 (en) 2015-12-17
US9733789B2 true US9733789B2 (en) 2017-08-15

Family

ID=46963988

Family Applications (3)

Application Number Title Priority Date Filing Date
US14/236,492 Expired - Fee Related US9733789B2 (en) 2011-08-04 2012-08-02 Interfacing with a device via virtual 3D objects
US15/675,981 Expired - Fee Related US10606442B2 (en) 2011-08-04 2017-08-14 Touch-free gesture recognition system and method
US16/834,968 Abandoned US20200409529A1 (en) 2011-08-04 2020-03-30 Touch-free gesture recognition system and method

Family Applications After (2)

Application Number Title Priority Date Filing Date
US15/675,981 Expired - Fee Related US10606442B2 (en) 2011-08-04 2017-08-14 Touch-free gesture recognition system and method
US16/834,968 Abandoned US20200409529A1 (en) 2011-08-04 2020-03-30 Touch-free gesture recognition system and method

Country Status (3)

Country Link
US (3) US9733789B2 (fr)
CN (2) CN103858074B (fr)
WO (1) WO2013018099A2 (fr)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170031538A1 (en) * 2013-12-06 2017-02-02 Telefonaktiebolaget Lm Ericsson (Publ) Optical head mounted display, television portal module and methods for controlling graphical user interface

Families Citing this family (102)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9857868B2 (en) 2011-03-19 2018-01-02 The Board Of Trustees Of The Leland Stanford Junior University Method and system for ergonomic touch-free interface
US8840466B2 (en) 2011-04-25 2014-09-23 Aquifi, Inc. Method and system to create three-dimensional mapping in a two-dimensional game
US12260023B2 (en) 2012-01-17 2025-03-25 Ultrahaptics IP Two Limited Systems and methods for machine control
US20150253428A1 (en) 2013-03-15 2015-09-10 Leap Motion, Inc. Determining positional information for an object in space
US9501152B2 (en) 2013-01-15 2016-11-22 Leap Motion, Inc. Free-space user interface and control using virtual constructs
US11493998B2 (en) 2012-01-17 2022-11-08 Ultrahaptics IP Two Limited Systems and methods for machine control
US8854433B1 (en) 2012-02-03 2014-10-07 Aquifi, Inc. Method and system enabling natural user interface gestures with an electronic system
US9111135B2 (en) 2012-06-25 2015-08-18 Aquifi, Inc. Systems and methods for tracking human hands using parts based template matching using corresponding pixels in bounded regions of a sequence of frames that are a specified distance interval from a reference camera
US9098739B2 (en) 2012-06-25 2015-08-04 Aquifi, Inc. Systems and methods for tracking human hands using parts based template matching
US8836768B1 (en) 2012-09-04 2014-09-16 Aquifi, Inc. Method and system enabling natural user interface gestures with user wearable glasses
US9459697B2 (en) 2013-01-15 2016-10-04 Leap Motion, Inc. Dynamic, free-space user interactions for machine control
US9696867B2 (en) 2013-01-15 2017-07-04 Leap Motion, Inc. Dynamic user interactions for display control and identifying dominant gestures
US9092665B2 (en) 2013-01-30 2015-07-28 Aquifi, Inc Systems and methods for initializing motion tracking of human hands
US9129155B2 (en) 2013-01-30 2015-09-08 Aquifi, Inc. Systems and methods for initializing motion tracking of human hands using template matching within bounded regions determined using a depth map
US20150370443A1 (en) * 2013-02-12 2015-12-24 Inuitive Ltd. System and method for combining touch and gesture in a three dimensional user interface
CN103152626A (zh) * 2013-03-08 2013-06-12 苏州百纳思光学科技有限公司 一种智能电视的远红外三维手势探测装置
US9298266B2 (en) 2013-04-02 2016-03-29 Aquifi, Inc. Systems and methods for implementing three-dimensional (3D) gesture based graphical user interfaces (GUI) that incorporate gesture reactive interface objects
US9916009B2 (en) 2013-04-26 2018-03-13 Leap Motion, Inc. Non-tactile interface systems and methods
US20140325455A1 (en) * 2013-04-26 2014-10-30 Ebay Inc. Visual 3d interactive interface
US9747696B2 (en) 2013-05-17 2017-08-29 Leap Motion, Inc. Systems and methods for providing normalized parameters of motions of objects in three-dimensional space
US20180046265A1 (en) * 2013-06-06 2018-02-15 Idhl Holdings, Inc. Latency Masking Systems and Methods
US9671868B2 (en) * 2013-06-11 2017-06-06 Honeywell International Inc. System and method for volumetric computing
CN104238727A (zh) * 2013-06-20 2014-12-24 苏州技杰软件有限公司 一种基于红外线的手势点餐设备
EP2818985B1 (fr) * 2013-06-28 2021-05-12 Nokia Technologies Oy Champ de saisie par magnsurvol
US9798388B1 (en) 2013-07-31 2017-10-24 Aquifi, Inc. Vibrotactile system to augment 3D input systems
US10281987B1 (en) * 2013-08-09 2019-05-07 Leap Motion, Inc. Systems and methods of free-space gestural interaction
US9293015B2 (en) * 2013-09-09 2016-03-22 Immersion Corporation Electrical stimulation haptic feedback interface
US9507417B2 (en) 2014-01-07 2016-11-29 Aquifi, Inc. Systems and methods for implementing head tracking based graphical user interfaces (GUI) that incorporate gesture reactive interface objects
US9785243B2 (en) 2014-01-30 2017-10-10 Honeywell International Inc. System and method for providing an ergonomic three-dimensional, gesture based, multimodal interface for use in flight deck applications
US9619105B1 (en) 2014-01-30 2017-04-11 Aquifi, Inc. Systems and methods for gesture based interaction with viewpoint dependent user interfaces
US11221680B1 (en) * 2014-03-01 2022-01-11 sigmund lindsay clements Hand gestures used to operate a control panel for a device
DE112015001401T5 (de) 2014-03-26 2017-02-16 Magna Mirrors Of America, Inc. Fahrzeugfunktionssteuerungssystem verwendend projizierte Zeichen
US9607139B1 (en) * 2014-03-27 2017-03-28 EMC IP Holding Company LLC Map-based authentication
US10691324B2 (en) * 2014-06-03 2020-06-23 Flow Labs, Inc. Dynamically populating a display and entering a selection interaction mode based on movement of a pointer along a navigation path
JP6813254B2 (ja) * 2014-07-15 2021-01-13 ソニー株式会社 情報処理装置、情報処理方法、及びプログラム
US9773328B2 (en) * 2014-08-18 2017-09-26 Wells Fargo Bank, N.A. Density gradient analysis tool
CN104199547B (zh) * 2014-08-29 2017-05-17 福州瑞芯微电子股份有限公司 一种虚拟触屏操作装置、系统及方法
DE102014114742A1 (de) * 2014-10-10 2016-04-14 Infineon Technologies Ag Eine Vorrichtung zum Erzeugen eines Anzeigensteuerungssignals und ein Verfahren derselben
CA2971280C (fr) * 2014-12-30 2021-11-30 Omni Consumer Products, Llc Systeme et procede de projection interactive
CN104503699B (zh) * 2015-01-08 2017-12-05 中国计量学院 一种非接触式空间手势智能锁系统及其操作方法
WO2016177325A1 (fr) * 2015-05-04 2016-11-10 上汽通用汽车有限公司 Procédé et système de déverrouillage pour un capot moteur de véhicule
JP6293372B2 (ja) * 2015-05-20 2018-03-14 三菱電機株式会社 情報処理装置及びインタロック制御方法
US20180292907A1 (en) * 2015-05-28 2018-10-11 Itay Katz Gesture control system and method for smart home
CN104932691A (zh) * 2015-06-19 2015-09-23 中国航天员科研训练中心 带有触觉感知反馈的手势实时交互系统
US10372268B2 (en) * 2015-07-21 2019-08-06 Sony Corporation Spatial image display apparatus and spatial image display method
CN106484087A (zh) * 2015-09-02 2017-03-08 黄小明 一种便携遥测体感输入方法及装置
US11194398B2 (en) * 2015-09-26 2021-12-07 Intel Corporation Technologies for adaptive rendering using 3D sensors
US10372289B2 (en) 2015-12-31 2019-08-06 Beijing Pico Technology Co., Ltd. Wraparound interface layout method, content switching method under three-dimensional immersive environment, and list switching method
CN105653034A (zh) * 2015-12-31 2016-06-08 北京小鸟看看科技有限公司 一种三维沉浸式环境下内容切换方法和装置
US10831273B2 (en) * 2016-01-26 2020-11-10 Lenovo (Singapore) Pte. Ltd. User action activated voice recognition
AU2017223313A1 (en) * 2016-02-26 2018-09-20 The Coca-Cola Company Touchless control graphical user interface
CA3012217C (fr) 2016-04-21 2024-04-30 Wayne Fueling Systems Llc Distributeurs de carburant intelligents
US12248995B2 (en) 2016-04-21 2025-03-11 Wayne Fueling Systems Llc Intelligent fuel dispensers
US10346015B2 (en) 2016-05-27 2019-07-09 Wayne Fueling Systems Llc Transparent fuel dispenser
JP2017228080A (ja) * 2016-06-22 2017-12-28 ソニー株式会社 情報処理装置、情報処理方法、及び、プログラム
KR20190034215A (ko) * 2016-06-30 2019-04-01 아브라카다브라 리클램 베 야인씰릭 리미티드 서케티 디지털 멀티미디어 플랫폼
CN106249882B (zh) * 2016-07-26 2022-07-12 华为技术有限公司 一种应用于vr设备的手势操控方法与装置
DE102016216577A1 (de) 2016-09-01 2018-03-01 Volkswagen Aktiengesellschaft Verfahren zur Interaktion mit Bildinhalten, die auf einer Anzeigevorrichtung in einem Fahrzeug dargestellt werden
JP2018085552A (ja) * 2016-11-21 2018-05-31 セイコーエプソン株式会社 プロジェクターシステム
KR20180058097A (ko) * 2016-11-23 2018-05-31 삼성전자주식회사 이미지를 표시하는 전자 장치 및 그 제어 방법
US10083640B2 (en) * 2016-12-29 2018-09-25 Pure Depth Limited Multi-layer display including proximity sensor and depth-changing interface elements, and/or associated methods
JP6822234B2 (ja) * 2017-03-15 2021-01-27 セイコーエプソン株式会社 プロジェクターシステム
CN107300975A (zh) * 2017-07-13 2017-10-27 联想(北京)有限公司 一种信息处理方法及电子设备
WO2019039416A1 (fr) * 2017-08-24 2019-02-28 シャープ株式会社 Dispositif d'affichage et programme
DE102017217591A1 (de) * 2017-10-04 2019-04-04 Audi Ag Bediensystem mit dreidimensionaler Anzeige für ein Fahrzeug
WO2019080902A1 (fr) * 2017-10-27 2019-05-02 Zyetric Inventions Limited Objet virtuel intelligent interactif
CN109996148B (zh) * 2017-12-29 2023-10-13 青岛有屋科技有限公司 一种智能厨房多媒体播放系统
CN107911686B (zh) * 2017-12-29 2019-07-05 盎锐(上海)信息科技有限公司 控制方法以及摄像终端
CN108479062B (zh) * 2018-02-24 2021-02-05 网易(杭州)网络有限公司 游戏事件触发控制方法、装置和计算机可读存储介质
DE102018203349A1 (de) * 2018-03-07 2019-09-12 BSH Hausgeräte GmbH Interaktionsmodul
EP3557380B1 (fr) * 2018-04-20 2024-07-03 Cadwalk Global Pty Ltd Syst?me pour la relocalisation d'images d'objets virtuels dans un espace non-électronique réel
TWI669653B (zh) * 2018-05-28 2019-08-21 宏碁股份有限公司 具備手勢感測功能之三維顯示器
DE102018115640A1 (de) * 2018-06-28 2020-01-02 Frank Buddenhagen Vorrichtung und Verfahren zur berührungsfreien Eingabe von Information
US20200050353A1 (en) * 2018-08-09 2020-02-13 Fuji Xerox Co., Ltd. Robust gesture recognizer for projector-camera interactive displays using deep neural networks with a depth camera
CN108873754A (zh) * 2018-08-22 2018-11-23 宁波柏厨集成厨房有限公司 一种智能厨房的显示门板系统
CN112313605B (zh) * 2018-10-03 2024-08-13 谷歌有限责任公司 增强现实环境中对象的放置和操纵
EP3906458A1 (fr) * 2018-12-31 2021-11-10 Guardian Glass, LLC Systèmes et/ou procédés de correction de parallaxe dans des interfaces tactiles transparentes à grande surface
KR102648818B1 (ko) * 2019-01-29 2024-03-19 현대자동차주식회사 차량용 인포테인먼트 장치 및 그의 제어 방법과 그를 포함하는 차량
DE102019202462A1 (de) * 2019-02-22 2020-08-27 Volkswagen Aktiengesellschaft Tragbares Endgerät
US10890992B2 (en) * 2019-03-14 2021-01-12 Ebay Inc. Synchronizing augmented or virtual reality (AR/VR) applications with companion device interfaces
EP3948492B1 (fr) 2019-03-27 2024-11-20 INTEL Corporation Appareil de panneau d'affichage intelligent et procédés associés
CN110119208B (zh) * 2019-05-15 2021-04-30 京东方科技集团股份有限公司 悬浮显示成像装置及悬浮显示触控方法
US11379016B2 (en) 2019-05-23 2022-07-05 Intel Corporation Methods and apparatus to operate closed-lid portable computers
CN114450624A (zh) 2019-08-19 2022-05-06 光场实验室公司 用于消费者装置的光场显示器
CN110517544A (zh) * 2019-08-27 2019-11-29 曹忠浮 一种分布式桌面投影互动教学系统
US11543873B2 (en) 2019-09-27 2023-01-03 Intel Corporation Wake-on-touch display screen devices and related methods
CN111028494B (zh) * 2019-11-04 2021-01-29 珠海格力电器股份有限公司 一种电器设备的虚拟遥控方法、计算机可读存储介质及智能家电
US11733761B2 (en) 2019-11-11 2023-08-22 Intel Corporation Methods and apparatus to manage power and performance of computing devices based on user presence
US11809535B2 (en) 2019-12-23 2023-11-07 Intel Corporation Systems and methods for multi-modal user device authentication
US11360528B2 (en) 2019-12-27 2022-06-14 Intel Corporation Apparatus and methods for thermal management of electronic user devices based on user activity
CN111246014B (zh) * 2020-01-13 2021-04-06 维沃移动通信有限公司 通话方法、头戴式设备及介质
CN111402430A (zh) * 2020-03-13 2020-07-10 杭州趣维科技有限公司 一种全息3d交互视频编辑方法
EP4172720A4 (fr) 2020-06-26 2024-03-27 INTEL Corporation Procédés, systèmes, articles manufacturés et appareil pour planifier dynamiquement un schéma de réveil dans un système informatique
CN111722769B (zh) * 2020-07-16 2024-03-05 腾讯科技(深圳)有限公司 交互方法、装置、显示设备和存储介质
US12079394B2 (en) * 2020-10-14 2024-09-03 Aksor Interactive contactless ordering terminal
JP7534206B2 (ja) * 2020-12-17 2024-08-14 シャープ株式会社 表示装置、表示方法、及び表示プログラム
US12189452B2 (en) 2020-12-21 2025-01-07 Intel Corporation Methods and apparatus to improve user experience on computing devices
WO2022152221A1 (fr) * 2021-01-15 2022-07-21 安徽省东超科技有限公司 Système de rétroaction de commande tactile, équipement terminal, procédé de commande de rétroaction de commande tactile et support d'enregistrement
US11919392B2 (en) * 2021-09-21 2024-03-05 GM Global Technology Operations LLC Rollable/bendable virtual 3D display
US11800082B2 (en) 2021-09-21 2023-10-24 GM Global Technology Operations LLC Virtual 3D display
CN113791548A (zh) * 2021-09-26 2021-12-14 北京市商汤科技开发有限公司 设备控制方法、装置、电子设备及存储介质
US12468381B1 (en) * 2024-09-06 2025-11-11 Snap Inc. Dynamic interaction zone system for accurate 3D button selection in augmented reality environments

Citations (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0227823A1 (fr) 1985-07-03 1987-07-08 Polaroid Corp Procedes et produits photographiques de transfert en couleurs.
US5729249A (en) * 1991-11-26 1998-03-17 Itu Research, Inc. Touch sensitive input control device
US6283860B1 (en) * 1995-11-07 2001-09-04 Philips Electronics North America Corp. Method, system, and program for gesture based option selection
US20030016247A1 (en) * 2001-07-18 2003-01-23 International Business Machines Corporation Method and system for software applications using a tiled user interface
US20030113018A1 (en) * 2001-07-18 2003-06-19 Nefian Ara Victor Dynamic gesture recognition from stereo sequences
US20040117727A1 (en) * 2002-11-12 2004-06-17 Shinya Wada Method and apparatus for processing files utilizing a concept of weight so as to visually represent the files in terms of whether the weight thereof is heavy or light
US6788809B1 (en) * 2000-06-30 2004-09-07 Intel Corporation System and method for gesture recognition in three dimensions using stereo imaging and color vision
US20060132432A1 (en) * 2002-05-28 2006-06-22 Matthew Bell Interactive video display system
US7216305B1 (en) * 2001-02-15 2007-05-08 Denny Jaeger Storage/display/action object for onscreen use
US7274803B1 (en) * 2002-04-02 2007-09-25 Videomining Corporation Method and system for detecting conscious hand movement patterns and computer-generated visual feedback for facilitating human-computer interaction
US20080013793A1 (en) * 2006-07-13 2008-01-17 Northrop Grumman Corporation Gesture recognition simulation system and method
US7340077B2 (en) * 2002-02-15 2008-03-04 Canesta, Inc. Gesture recognition system using depth perceptive sensors
US20080174551A1 (en) * 2007-01-23 2008-07-24 Funai Electric Co., Ltd. Image display system
WO2008132724A1 (fr) 2007-04-26 2008-11-06 Mantisvision Ltd. Procédé et dispositif pour une interaction tridimensionnelle avec des afficheurs autostéréoscopiques
WO2009035705A1 (fr) 2007-09-14 2009-03-19 Reactrix Systems, Inc. Traitement d'interactions d'utilisateur basées sur des gestes
US20090089714A1 (en) * 2007-09-28 2009-04-02 Yahoo! Inc. Three-dimensional website visualization
US20100315417A1 (en) 2009-06-14 2010-12-16 Lg Electronics Inc. Mobile terminal and display controlling method thereof
US20110012830A1 (en) * 2009-07-20 2011-01-20 J Touch Corporation Stereo image interaction system
US20110187709A1 (en) * 2010-01-29 2011-08-04 Pantech Co., Ltd. Mobile terminal and method for displaying information
US20120260217A1 (en) * 2011-04-11 2012-10-11 Microsoft Corporation Three-dimensional icons for organizing, invoking, and using applications
US8289316B1 (en) * 2009-04-01 2012-10-16 Perceptive Pixel Inc. Controlling distribution of error in 2D and 3D manipulation
US20120317511A1 (en) * 2008-03-07 2012-12-13 Intellectual Ventures Holding 67 Llc Display with built in 3d sensing capability and gesture control of tv
US20130321271A1 (en) * 2011-02-09 2013-12-05 Primesense Ltd Pointing-based display interaction
US8669953B2 (en) * 2010-07-16 2014-03-11 Lg Electronics Inc. Mobile terminal and method of controlling the same

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6191773B1 (en) * 1995-04-28 2001-02-20 Matsushita Electric Industrial Co., Ltd. Interface apparatus
IL161002A0 (en) 2004-03-22 2004-08-31 Itay Katz Virtual video keyboard system
JP4274997B2 (ja) * 2004-05-06 2009-06-10 アルパイン株式会社 操作入力装置および操作入力方法
JP3961545B2 (ja) * 2005-11-29 2007-08-22 株式会社コナミデジタルエンタテインメント オブジェクト選択装置、オブジェクト選択方法、ならびに、プログラム
US20090249258A1 (en) * 2008-03-29 2009-10-01 Thomas Zhiwei Tang Simple Motion Based Input System
KR101632963B1 (ko) 2009-02-02 2016-06-23 아이사이트 모빌 테크놀로지 엘티디 비디오 스트림에 있어서 물체 인식 및 트랙킹을 위한 시스템 및 방법

Patent Citations (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0227823A1 (fr) 1985-07-03 1987-07-08 Polaroid Corp Procedes et produits photographiques de transfert en couleurs.
US5729249A (en) * 1991-11-26 1998-03-17 Itu Research, Inc. Touch sensitive input control device
US6283860B1 (en) * 1995-11-07 2001-09-04 Philips Electronics North America Corp. Method, system, and program for gesture based option selection
US6788809B1 (en) * 2000-06-30 2004-09-07 Intel Corporation System and method for gesture recognition in three dimensions using stereo imaging and color vision
US7216305B1 (en) * 2001-02-15 2007-05-08 Denny Jaeger Storage/display/action object for onscreen use
US20030016247A1 (en) * 2001-07-18 2003-01-23 International Business Machines Corporation Method and system for software applications using a tiled user interface
US20030113018A1 (en) * 2001-07-18 2003-06-19 Nefian Ara Victor Dynamic gesture recognition from stereo sequences
US7340077B2 (en) * 2002-02-15 2008-03-04 Canesta, Inc. Gesture recognition system using depth perceptive sensors
US7274803B1 (en) * 2002-04-02 2007-09-25 Videomining Corporation Method and system for detecting conscious hand movement patterns and computer-generated visual feedback for facilitating human-computer interaction
US20060132432A1 (en) * 2002-05-28 2006-06-22 Matthew Bell Interactive video display system
US20040117727A1 (en) * 2002-11-12 2004-06-17 Shinya Wada Method and apparatus for processing files utilizing a concept of weight so as to visually represent the files in terms of whether the weight thereof is heavy or light
US20080013793A1 (en) * 2006-07-13 2008-01-17 Northrop Grumman Corporation Gesture recognition simulation system and method
US20080174551A1 (en) * 2007-01-23 2008-07-24 Funai Electric Co., Ltd. Image display system
WO2008132724A1 (fr) 2007-04-26 2008-11-06 Mantisvision Ltd. Procédé et dispositif pour une interaction tridimensionnelle avec des afficheurs autostéréoscopiques
US8230367B2 (en) * 2007-09-14 2012-07-24 Intellectual Ventures Holding 67 Llc Gesture-based user interactions with status indicators for acceptable inputs in volumetric zones
WO2009035705A1 (fr) 2007-09-14 2009-03-19 Reactrix Systems, Inc. Traitement d'interactions d'utilisateur basées sur des gestes
US20090089714A1 (en) * 2007-09-28 2009-04-02 Yahoo! Inc. Three-dimensional website visualization
US20120317511A1 (en) * 2008-03-07 2012-12-13 Intellectual Ventures Holding 67 Llc Display with built in 3d sensing capability and gesture control of tv
US8289316B1 (en) * 2009-04-01 2012-10-16 Perceptive Pixel Inc. Controlling distribution of error in 2D and 3D manipulation
US20100315417A1 (en) 2009-06-14 2010-12-16 Lg Electronics Inc. Mobile terminal and display controlling method thereof
CN101957719A (zh) 2009-07-14 2011-01-26 Lg电子株式会社 移动终端及其显示控制方法
US8866810B2 (en) 2009-07-14 2014-10-21 Lg Electronics Inc. Mobile terminal and display controlling method thereof
US20110012830A1 (en) * 2009-07-20 2011-01-20 J Touch Corporation Stereo image interaction system
US20110187709A1 (en) * 2010-01-29 2011-08-04 Pantech Co., Ltd. Mobile terminal and method for displaying information
US8669953B2 (en) * 2010-07-16 2014-03-11 Lg Electronics Inc. Mobile terminal and method of controlling the same
US20130321271A1 (en) * 2011-02-09 2013-12-05 Primesense Ltd Pointing-based display interaction
US20120260217A1 (en) * 2011-04-11 2012-10-11 Microsoft Corporation Three-dimensional icons for organizing, invoking, and using applications

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
International Search Report for PCT International Application No. PCT/IL2012/050290, mailed Mar. 14, 2013 (4 pages).

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170031538A1 (en) * 2013-12-06 2017-02-02 Telefonaktiebolaget Lm Ericsson (Publ) Optical head mounted display, television portal module and methods for controlling graphical user interface
US10338776B2 (en) * 2013-12-06 2019-07-02 Telefonaktiebolaget Lm Ericsson (Publ) Optical head mounted display, television portal module and methods for controlling graphical user interface

Also Published As

Publication number Publication date
CN103858074A (zh) 2014-06-11
WO2013018099A2 (fr) 2013-02-07
CN109271029A (zh) 2019-01-25
US20150363070A1 (en) 2015-12-17
US20200409529A1 (en) 2020-12-31
US20170344222A1 (en) 2017-11-30
US10606442B2 (en) 2020-03-31
CN109271029B (zh) 2022-08-26
CN103858074B (zh) 2018-10-19
WO2013018099A3 (fr) 2013-07-04

Similar Documents

Publication Publication Date Title
US10606442B2 (en) Touch-free gesture recognition system and method
US20220382379A1 (en) Touch Free User Interface
EP2638461B1 (fr) Appareil et procédé pour une entrée utilisateur permettant de commander des informations affichées
US10203764B2 (en) Systems and methods for triggering actions based on touch-free gesture detection
CN110476142B (zh) 显示虚拟内容的计算设备、方法和头戴式显示器设备
US9939914B2 (en) System and method for combining three-dimensional tracking with a three-dimensional display for a user interface
US9619105B1 (en) Systems and methods for gesture based interaction with viewpoint dependent user interfaces
CN104246682B (zh) 增强的虚拟触摸板和触摸屏
US20180292907A1 (en) Gesture control system and method for smart home
US9753547B2 (en) Interactive displaying method, control method and system for achieving displaying of a holographic image
WO2014140827A2 (fr) Systèmes et procédés de détection de gestes à base de capteur de proximité et de capteur d'image
US20130257734A1 (en) Use of a sensor to enable touch and type modes for hands of a user via a keyboard
CN107077199A (zh) 用于在三维显示器上呈现虚拟对象的装置及用于控制装置的方法
US11307762B2 (en) Operating user interfaces
JP2012038025A (ja) 表示装置及び表示装置の制御方法、プログラム
WO2016102948A1 (fr) Interaction cohérente sans contact avec des images 3d stéréoscopiques

Legal Events

Date Code Title Description
AS Assignment

Owner name: EYESIGHT MOBILE TECHNOLOGIES LTD., ISRAEL

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:KATZ, ITAY;REEL/FRAME:032132/0708

Effective date: 20140131

STCF Information on status: patent grant

Free format text: PATENTED CASE

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

FEPP Fee payment procedure

Free format text: SURCHARGE FOR LATE PAYMENT, SMALL ENTITY (ORIGINAL EVENT CODE: M2554); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2551); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

Year of fee payment: 4

FEPP Fee payment procedure

Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

LAPS Lapse for failure to pay maintenance fees

Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

STCH Information on status: patent discontinuation

Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362

FP Lapsed due to failure to pay maintenance fee

Effective date: 20250815