US9733789B2 - Interfacing with a device via virtual 3D objects - Google Patents
Interfacing with a device via virtual 3D objects Download PDFInfo
- Publication number
- US9733789B2 US9733789B2 US14/236,492 US201214236492A US9733789B2 US 9733789 B2 US9733789 B2 US 9733789B2 US 201214236492 A US201214236492 A US 201214236492A US 9733789 B2 US9733789 B2 US 9733789B2
- Authority
- US
- United States
- Prior art keywords
- activatable
- activating
- processor
- activatable object
- distinct
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Expired - Fee Related, expires
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/04815—Interaction with a metaphor-based environment or interaction object displayed as three-dimensional, e.g. changing the user viewpoint with respect to the environment or object
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
- G06F3/013—Eye tracking input arrangements
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/0304—Detection arrangements using opto-electronic means
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0481—Interaction techniques based on graphical user interfaces [GUI] based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance
- G06F3/0482—Interaction with lists of selectable items, e.g. menus
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/048—Interaction techniques based on graphical user interfaces [GUI]
- G06F3/0484—Interaction techniques based on graphical user interfaces [GUI] for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range
- G06F3/04842—Selection of displayed objects or displayed text elements
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/16—Sound input; Sound output
- G06F3/167—Audio in a user interface, e.g. using voice commands for navigating, audio feedback
Definitions
- the message or command generated when an activatable object is activated may depend on how the object was activated.
- Different modes of activating an activatable object include, for example, pointing at an activatable object, holding an activating object at an activatable object for a predetermined amount of time, clicking on the activatable object, double clicking, clicking from the right side, clicking from the left side, clicking from the bottom, clicking from the top, grasping the object, gesturing towards the object from the right, or from the left side, passing through the object, pushing the object, clapping over the object, waving over the object, performing a blast gesture, performing a tapping gesture, performing a clockwise or counter clockwise gesture over the object grasping the object with two fingers, performing a click-drag-release motion, sliding an icon such as a volume bar.
- the generated command for scrolling may depend on the speed or acceleration of a performed scrolling motion.
- one or more of the activating objects may be one or more hands, a part of a hand, one or more fingers, one or more parts of a finger, a fingertip, or a stylus.
- the system 2 may be associated with a device 21 , in which case the command executed by the processor 6 upon activation of an activatable object may be an operating system (OS) command of the device 21 .
- OS commands include depressing a virtual key displayed on a display screen of the device; rotating a selection carousel; switching between desktops; running on the central processor unit a predetermined software application; turning off an application; turning the speakers on or off; turning the volume up/down; skipping to the next or previous track in a media player or between IPTV channels; controlling a navigation application; unlocking the device, stopping/running an application, starting a call, ending a call, presenting a notification, displaying a notification; navigating in a photo or music album gallery, scrolling web-pages, emails, documents or maps, controlling actions in games, controlling interactive video or animated content, editing video or images, pointing at a map, zooming-in/out on a map or images, painting on an image, pushing an activatable object toward the display device, pulling an activa
- the executed command may also depend on how or where an activating objected “touches” an activatable object.
- the command associated with activation of an activatable object may depend upon how the user “touches” the activatable object. For example, a “light touch” and a “deep touch” may result in a different command being executed.
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Human Computer Interaction (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Multimedia (AREA)
- Health & Medical Sciences (AREA)
- Audiology, Speech & Language Pathology (AREA)
- General Health & Medical Sciences (AREA)
- User Interface Of Digital Computer (AREA)
- Processing Or Creating Images (AREA)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US14/236,492 US9733789B2 (en) | 2011-08-04 | 2012-08-02 | Interfacing with a device via virtual 3D objects |
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201161515055P | 2011-08-04 | 2011-08-04 | |
| US14/236,492 US9733789B2 (en) | 2011-08-04 | 2012-08-02 | Interfacing with a device via virtual 3D objects |
| PCT/IL2012/050290 WO2013018099A2 (fr) | 2011-08-04 | 2012-08-02 | Système et procédé pour assurer l'interface avec un dispositif par le biais d'un affichage en 3d |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/IL2012/050290 A-371-Of-International WO2013018099A2 (fr) | 2011-08-04 | 2012-08-02 | Système et procédé pour assurer l'interface avec un dispositif par le biais d'un affichage en 3d |
Related Child Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US15/675,981 Continuation US10606442B2 (en) | 2011-08-04 | 2017-08-14 | Touch-free gesture recognition system and method |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| US20150363070A1 US20150363070A1 (en) | 2015-12-17 |
| US9733789B2 true US9733789B2 (en) | 2017-08-15 |
Family
ID=46963988
Family Applications (3)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US14/236,492 Expired - Fee Related US9733789B2 (en) | 2011-08-04 | 2012-08-02 | Interfacing with a device via virtual 3D objects |
| US15/675,981 Expired - Fee Related US10606442B2 (en) | 2011-08-04 | 2017-08-14 | Touch-free gesture recognition system and method |
| US16/834,968 Abandoned US20200409529A1 (en) | 2011-08-04 | 2020-03-30 | Touch-free gesture recognition system and method |
Family Applications After (2)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| US15/675,981 Expired - Fee Related US10606442B2 (en) | 2011-08-04 | 2017-08-14 | Touch-free gesture recognition system and method |
| US16/834,968 Abandoned US20200409529A1 (en) | 2011-08-04 | 2020-03-30 | Touch-free gesture recognition system and method |
Country Status (3)
| Country | Link |
|---|---|
| US (3) | US9733789B2 (fr) |
| CN (2) | CN103858074B (fr) |
| WO (1) | WO2013018099A2 (fr) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170031538A1 (en) * | 2013-12-06 | 2017-02-02 | Telefonaktiebolaget Lm Ericsson (Publ) | Optical head mounted display, television portal module and methods for controlling graphical user interface |
Families Citing this family (102)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US9857868B2 (en) | 2011-03-19 | 2018-01-02 | The Board Of Trustees Of The Leland Stanford Junior University | Method and system for ergonomic touch-free interface |
| US8840466B2 (en) | 2011-04-25 | 2014-09-23 | Aquifi, Inc. | Method and system to create three-dimensional mapping in a two-dimensional game |
| US12260023B2 (en) | 2012-01-17 | 2025-03-25 | Ultrahaptics IP Two Limited | Systems and methods for machine control |
| US20150253428A1 (en) | 2013-03-15 | 2015-09-10 | Leap Motion, Inc. | Determining positional information for an object in space |
| US9501152B2 (en) | 2013-01-15 | 2016-11-22 | Leap Motion, Inc. | Free-space user interface and control using virtual constructs |
| US11493998B2 (en) | 2012-01-17 | 2022-11-08 | Ultrahaptics IP Two Limited | Systems and methods for machine control |
| US8854433B1 (en) | 2012-02-03 | 2014-10-07 | Aquifi, Inc. | Method and system enabling natural user interface gestures with an electronic system |
| US9111135B2 (en) | 2012-06-25 | 2015-08-18 | Aquifi, Inc. | Systems and methods for tracking human hands using parts based template matching using corresponding pixels in bounded regions of a sequence of frames that are a specified distance interval from a reference camera |
| US9098739B2 (en) | 2012-06-25 | 2015-08-04 | Aquifi, Inc. | Systems and methods for tracking human hands using parts based template matching |
| US8836768B1 (en) | 2012-09-04 | 2014-09-16 | Aquifi, Inc. | Method and system enabling natural user interface gestures with user wearable glasses |
| US9459697B2 (en) | 2013-01-15 | 2016-10-04 | Leap Motion, Inc. | Dynamic, free-space user interactions for machine control |
| US9696867B2 (en) | 2013-01-15 | 2017-07-04 | Leap Motion, Inc. | Dynamic user interactions for display control and identifying dominant gestures |
| US9092665B2 (en) | 2013-01-30 | 2015-07-28 | Aquifi, Inc | Systems and methods for initializing motion tracking of human hands |
| US9129155B2 (en) | 2013-01-30 | 2015-09-08 | Aquifi, Inc. | Systems and methods for initializing motion tracking of human hands using template matching within bounded regions determined using a depth map |
| US20150370443A1 (en) * | 2013-02-12 | 2015-12-24 | Inuitive Ltd. | System and method for combining touch and gesture in a three dimensional user interface |
| CN103152626A (zh) * | 2013-03-08 | 2013-06-12 | 苏州百纳思光学科技有限公司 | 一种智能电视的远红外三维手势探测装置 |
| US9298266B2 (en) | 2013-04-02 | 2016-03-29 | Aquifi, Inc. | Systems and methods for implementing three-dimensional (3D) gesture based graphical user interfaces (GUI) that incorporate gesture reactive interface objects |
| US9916009B2 (en) | 2013-04-26 | 2018-03-13 | Leap Motion, Inc. | Non-tactile interface systems and methods |
| US20140325455A1 (en) * | 2013-04-26 | 2014-10-30 | Ebay Inc. | Visual 3d interactive interface |
| US9747696B2 (en) | 2013-05-17 | 2017-08-29 | Leap Motion, Inc. | Systems and methods for providing normalized parameters of motions of objects in three-dimensional space |
| US20180046265A1 (en) * | 2013-06-06 | 2018-02-15 | Idhl Holdings, Inc. | Latency Masking Systems and Methods |
| US9671868B2 (en) * | 2013-06-11 | 2017-06-06 | Honeywell International Inc. | System and method for volumetric computing |
| CN104238727A (zh) * | 2013-06-20 | 2014-12-24 | 苏州技杰软件有限公司 | 一种基于红外线的手势点餐设备 |
| EP2818985B1 (fr) * | 2013-06-28 | 2021-05-12 | Nokia Technologies Oy | Champ de saisie par magnsurvol |
| US9798388B1 (en) | 2013-07-31 | 2017-10-24 | Aquifi, Inc. | Vibrotactile system to augment 3D input systems |
| US10281987B1 (en) * | 2013-08-09 | 2019-05-07 | Leap Motion, Inc. | Systems and methods of free-space gestural interaction |
| US9293015B2 (en) * | 2013-09-09 | 2016-03-22 | Immersion Corporation | Electrical stimulation haptic feedback interface |
| US9507417B2 (en) | 2014-01-07 | 2016-11-29 | Aquifi, Inc. | Systems and methods for implementing head tracking based graphical user interfaces (GUI) that incorporate gesture reactive interface objects |
| US9785243B2 (en) | 2014-01-30 | 2017-10-10 | Honeywell International Inc. | System and method for providing an ergonomic three-dimensional, gesture based, multimodal interface for use in flight deck applications |
| US9619105B1 (en) | 2014-01-30 | 2017-04-11 | Aquifi, Inc. | Systems and methods for gesture based interaction with viewpoint dependent user interfaces |
| US11221680B1 (en) * | 2014-03-01 | 2022-01-11 | sigmund lindsay clements | Hand gestures used to operate a control panel for a device |
| DE112015001401T5 (de) | 2014-03-26 | 2017-02-16 | Magna Mirrors Of America, Inc. | Fahrzeugfunktionssteuerungssystem verwendend projizierte Zeichen |
| US9607139B1 (en) * | 2014-03-27 | 2017-03-28 | EMC IP Holding Company LLC | Map-based authentication |
| US10691324B2 (en) * | 2014-06-03 | 2020-06-23 | Flow Labs, Inc. | Dynamically populating a display and entering a selection interaction mode based on movement of a pointer along a navigation path |
| JP6813254B2 (ja) * | 2014-07-15 | 2021-01-13 | ソニー株式会社 | 情報処理装置、情報処理方法、及びプログラム |
| US9773328B2 (en) * | 2014-08-18 | 2017-09-26 | Wells Fargo Bank, N.A. | Density gradient analysis tool |
| CN104199547B (zh) * | 2014-08-29 | 2017-05-17 | 福州瑞芯微电子股份有限公司 | 一种虚拟触屏操作装置、系统及方法 |
| DE102014114742A1 (de) * | 2014-10-10 | 2016-04-14 | Infineon Technologies Ag | Eine Vorrichtung zum Erzeugen eines Anzeigensteuerungssignals und ein Verfahren derselben |
| CA2971280C (fr) * | 2014-12-30 | 2021-11-30 | Omni Consumer Products, Llc | Systeme et procede de projection interactive |
| CN104503699B (zh) * | 2015-01-08 | 2017-12-05 | 中国计量学院 | 一种非接触式空间手势智能锁系统及其操作方法 |
| WO2016177325A1 (fr) * | 2015-05-04 | 2016-11-10 | 上汽通用汽车有限公司 | Procédé et système de déverrouillage pour un capot moteur de véhicule |
| JP6293372B2 (ja) * | 2015-05-20 | 2018-03-14 | 三菱電機株式会社 | 情報処理装置及びインタロック制御方法 |
| US20180292907A1 (en) * | 2015-05-28 | 2018-10-11 | Itay Katz | Gesture control system and method for smart home |
| CN104932691A (zh) * | 2015-06-19 | 2015-09-23 | 中国航天员科研训练中心 | 带有触觉感知反馈的手势实时交互系统 |
| US10372268B2 (en) * | 2015-07-21 | 2019-08-06 | Sony Corporation | Spatial image display apparatus and spatial image display method |
| CN106484087A (zh) * | 2015-09-02 | 2017-03-08 | 黄小明 | 一种便携遥测体感输入方法及装置 |
| US11194398B2 (en) * | 2015-09-26 | 2021-12-07 | Intel Corporation | Technologies for adaptive rendering using 3D sensors |
| US10372289B2 (en) | 2015-12-31 | 2019-08-06 | Beijing Pico Technology Co., Ltd. | Wraparound interface layout method, content switching method under three-dimensional immersive environment, and list switching method |
| CN105653034A (zh) * | 2015-12-31 | 2016-06-08 | 北京小鸟看看科技有限公司 | 一种三维沉浸式环境下内容切换方法和装置 |
| US10831273B2 (en) * | 2016-01-26 | 2020-11-10 | Lenovo (Singapore) Pte. Ltd. | User action activated voice recognition |
| AU2017223313A1 (en) * | 2016-02-26 | 2018-09-20 | The Coca-Cola Company | Touchless control graphical user interface |
| CA3012217C (fr) | 2016-04-21 | 2024-04-30 | Wayne Fueling Systems Llc | Distributeurs de carburant intelligents |
| US12248995B2 (en) | 2016-04-21 | 2025-03-11 | Wayne Fueling Systems Llc | Intelligent fuel dispensers |
| US10346015B2 (en) | 2016-05-27 | 2019-07-09 | Wayne Fueling Systems Llc | Transparent fuel dispenser |
| JP2017228080A (ja) * | 2016-06-22 | 2017-12-28 | ソニー株式会社 | 情報処理装置、情報処理方法、及び、プログラム |
| KR20190034215A (ko) * | 2016-06-30 | 2019-04-01 | 아브라카다브라 리클램 베 야인씰릭 리미티드 서케티 | 디지털 멀티미디어 플랫폼 |
| CN106249882B (zh) * | 2016-07-26 | 2022-07-12 | 华为技术有限公司 | 一种应用于vr设备的手势操控方法与装置 |
| DE102016216577A1 (de) | 2016-09-01 | 2018-03-01 | Volkswagen Aktiengesellschaft | Verfahren zur Interaktion mit Bildinhalten, die auf einer Anzeigevorrichtung in einem Fahrzeug dargestellt werden |
| JP2018085552A (ja) * | 2016-11-21 | 2018-05-31 | セイコーエプソン株式会社 | プロジェクターシステム |
| KR20180058097A (ko) * | 2016-11-23 | 2018-05-31 | 삼성전자주식회사 | 이미지를 표시하는 전자 장치 및 그 제어 방법 |
| US10083640B2 (en) * | 2016-12-29 | 2018-09-25 | Pure Depth Limited | Multi-layer display including proximity sensor and depth-changing interface elements, and/or associated methods |
| JP6822234B2 (ja) * | 2017-03-15 | 2021-01-27 | セイコーエプソン株式会社 | プロジェクターシステム |
| CN107300975A (zh) * | 2017-07-13 | 2017-10-27 | 联想(北京)有限公司 | 一种信息处理方法及电子设备 |
| WO2019039416A1 (fr) * | 2017-08-24 | 2019-02-28 | シャープ株式会社 | Dispositif d'affichage et programme |
| DE102017217591A1 (de) * | 2017-10-04 | 2019-04-04 | Audi Ag | Bediensystem mit dreidimensionaler Anzeige für ein Fahrzeug |
| WO2019080902A1 (fr) * | 2017-10-27 | 2019-05-02 | Zyetric Inventions Limited | Objet virtuel intelligent interactif |
| CN109996148B (zh) * | 2017-12-29 | 2023-10-13 | 青岛有屋科技有限公司 | 一种智能厨房多媒体播放系统 |
| CN107911686B (zh) * | 2017-12-29 | 2019-07-05 | 盎锐(上海)信息科技有限公司 | 控制方法以及摄像终端 |
| CN108479062B (zh) * | 2018-02-24 | 2021-02-05 | 网易(杭州)网络有限公司 | 游戏事件触发控制方法、装置和计算机可读存储介质 |
| DE102018203349A1 (de) * | 2018-03-07 | 2019-09-12 | BSH Hausgeräte GmbH | Interaktionsmodul |
| EP3557380B1 (fr) * | 2018-04-20 | 2024-07-03 | Cadwalk Global Pty Ltd | Syst?me pour la relocalisation d'images d'objets virtuels dans un espace non-électronique réel |
| TWI669653B (zh) * | 2018-05-28 | 2019-08-21 | 宏碁股份有限公司 | 具備手勢感測功能之三維顯示器 |
| DE102018115640A1 (de) * | 2018-06-28 | 2020-01-02 | Frank Buddenhagen | Vorrichtung und Verfahren zur berührungsfreien Eingabe von Information |
| US20200050353A1 (en) * | 2018-08-09 | 2020-02-13 | Fuji Xerox Co., Ltd. | Robust gesture recognizer for projector-camera interactive displays using deep neural networks with a depth camera |
| CN108873754A (zh) * | 2018-08-22 | 2018-11-23 | 宁波柏厨集成厨房有限公司 | 一种智能厨房的显示门板系统 |
| CN112313605B (zh) * | 2018-10-03 | 2024-08-13 | 谷歌有限责任公司 | 增强现实环境中对象的放置和操纵 |
| EP3906458A1 (fr) * | 2018-12-31 | 2021-11-10 | Guardian Glass, LLC | Systèmes et/ou procédés de correction de parallaxe dans des interfaces tactiles transparentes à grande surface |
| KR102648818B1 (ko) * | 2019-01-29 | 2024-03-19 | 현대자동차주식회사 | 차량용 인포테인먼트 장치 및 그의 제어 방법과 그를 포함하는 차량 |
| DE102019202462A1 (de) * | 2019-02-22 | 2020-08-27 | Volkswagen Aktiengesellschaft | Tragbares Endgerät |
| US10890992B2 (en) * | 2019-03-14 | 2021-01-12 | Ebay Inc. | Synchronizing augmented or virtual reality (AR/VR) applications with companion device interfaces |
| EP3948492B1 (fr) | 2019-03-27 | 2024-11-20 | INTEL Corporation | Appareil de panneau d'affichage intelligent et procédés associés |
| CN110119208B (zh) * | 2019-05-15 | 2021-04-30 | 京东方科技集团股份有限公司 | 悬浮显示成像装置及悬浮显示触控方法 |
| US11379016B2 (en) | 2019-05-23 | 2022-07-05 | Intel Corporation | Methods and apparatus to operate closed-lid portable computers |
| CN114450624A (zh) | 2019-08-19 | 2022-05-06 | 光场实验室公司 | 用于消费者装置的光场显示器 |
| CN110517544A (zh) * | 2019-08-27 | 2019-11-29 | 曹忠浮 | 一种分布式桌面投影互动教学系统 |
| US11543873B2 (en) | 2019-09-27 | 2023-01-03 | Intel Corporation | Wake-on-touch display screen devices and related methods |
| CN111028494B (zh) * | 2019-11-04 | 2021-01-29 | 珠海格力电器股份有限公司 | 一种电器设备的虚拟遥控方法、计算机可读存储介质及智能家电 |
| US11733761B2 (en) | 2019-11-11 | 2023-08-22 | Intel Corporation | Methods and apparatus to manage power and performance of computing devices based on user presence |
| US11809535B2 (en) | 2019-12-23 | 2023-11-07 | Intel Corporation | Systems and methods for multi-modal user device authentication |
| US11360528B2 (en) | 2019-12-27 | 2022-06-14 | Intel Corporation | Apparatus and methods for thermal management of electronic user devices based on user activity |
| CN111246014B (zh) * | 2020-01-13 | 2021-04-06 | 维沃移动通信有限公司 | 通话方法、头戴式设备及介质 |
| CN111402430A (zh) * | 2020-03-13 | 2020-07-10 | 杭州趣维科技有限公司 | 一种全息3d交互视频编辑方法 |
| EP4172720A4 (fr) | 2020-06-26 | 2024-03-27 | INTEL Corporation | Procédés, systèmes, articles manufacturés et appareil pour planifier dynamiquement un schéma de réveil dans un système informatique |
| CN111722769B (zh) * | 2020-07-16 | 2024-03-05 | 腾讯科技(深圳)有限公司 | 交互方法、装置、显示设备和存储介质 |
| US12079394B2 (en) * | 2020-10-14 | 2024-09-03 | Aksor | Interactive contactless ordering terminal |
| JP7534206B2 (ja) * | 2020-12-17 | 2024-08-14 | シャープ株式会社 | 表示装置、表示方法、及び表示プログラム |
| US12189452B2 (en) | 2020-12-21 | 2025-01-07 | Intel Corporation | Methods and apparatus to improve user experience on computing devices |
| WO2022152221A1 (fr) * | 2021-01-15 | 2022-07-21 | 安徽省东超科技有限公司 | Système de rétroaction de commande tactile, équipement terminal, procédé de commande de rétroaction de commande tactile et support d'enregistrement |
| US11919392B2 (en) * | 2021-09-21 | 2024-03-05 | GM Global Technology Operations LLC | Rollable/bendable virtual 3D display |
| US11800082B2 (en) | 2021-09-21 | 2023-10-24 | GM Global Technology Operations LLC | Virtual 3D display |
| CN113791548A (zh) * | 2021-09-26 | 2021-12-14 | 北京市商汤科技开发有限公司 | 设备控制方法、装置、电子设备及存储介质 |
| US12468381B1 (en) * | 2024-09-06 | 2025-11-11 | Snap Inc. | Dynamic interaction zone system for accurate 3D button selection in augmented reality environments |
Citations (24)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0227823A1 (fr) | 1985-07-03 | 1987-07-08 | Polaroid Corp | Procedes et produits photographiques de transfert en couleurs. |
| US5729249A (en) * | 1991-11-26 | 1998-03-17 | Itu Research, Inc. | Touch sensitive input control device |
| US6283860B1 (en) * | 1995-11-07 | 2001-09-04 | Philips Electronics North America Corp. | Method, system, and program for gesture based option selection |
| US20030016247A1 (en) * | 2001-07-18 | 2003-01-23 | International Business Machines Corporation | Method and system for software applications using a tiled user interface |
| US20030113018A1 (en) * | 2001-07-18 | 2003-06-19 | Nefian Ara Victor | Dynamic gesture recognition from stereo sequences |
| US20040117727A1 (en) * | 2002-11-12 | 2004-06-17 | Shinya Wada | Method and apparatus for processing files utilizing a concept of weight so as to visually represent the files in terms of whether the weight thereof is heavy or light |
| US6788809B1 (en) * | 2000-06-30 | 2004-09-07 | Intel Corporation | System and method for gesture recognition in three dimensions using stereo imaging and color vision |
| US20060132432A1 (en) * | 2002-05-28 | 2006-06-22 | Matthew Bell | Interactive video display system |
| US7216305B1 (en) * | 2001-02-15 | 2007-05-08 | Denny Jaeger | Storage/display/action object for onscreen use |
| US7274803B1 (en) * | 2002-04-02 | 2007-09-25 | Videomining Corporation | Method and system for detecting conscious hand movement patterns and computer-generated visual feedback for facilitating human-computer interaction |
| US20080013793A1 (en) * | 2006-07-13 | 2008-01-17 | Northrop Grumman Corporation | Gesture recognition simulation system and method |
| US7340077B2 (en) * | 2002-02-15 | 2008-03-04 | Canesta, Inc. | Gesture recognition system using depth perceptive sensors |
| US20080174551A1 (en) * | 2007-01-23 | 2008-07-24 | Funai Electric Co., Ltd. | Image display system |
| WO2008132724A1 (fr) | 2007-04-26 | 2008-11-06 | Mantisvision Ltd. | Procédé et dispositif pour une interaction tridimensionnelle avec des afficheurs autostéréoscopiques |
| WO2009035705A1 (fr) | 2007-09-14 | 2009-03-19 | Reactrix Systems, Inc. | Traitement d'interactions d'utilisateur basées sur des gestes |
| US20090089714A1 (en) * | 2007-09-28 | 2009-04-02 | Yahoo! Inc. | Three-dimensional website visualization |
| US20100315417A1 (en) | 2009-06-14 | 2010-12-16 | Lg Electronics Inc. | Mobile terminal and display controlling method thereof |
| US20110012830A1 (en) * | 2009-07-20 | 2011-01-20 | J Touch Corporation | Stereo image interaction system |
| US20110187709A1 (en) * | 2010-01-29 | 2011-08-04 | Pantech Co., Ltd. | Mobile terminal and method for displaying information |
| US20120260217A1 (en) * | 2011-04-11 | 2012-10-11 | Microsoft Corporation | Three-dimensional icons for organizing, invoking, and using applications |
| US8289316B1 (en) * | 2009-04-01 | 2012-10-16 | Perceptive Pixel Inc. | Controlling distribution of error in 2D and 3D manipulation |
| US20120317511A1 (en) * | 2008-03-07 | 2012-12-13 | Intellectual Ventures Holding 67 Llc | Display with built in 3d sensing capability and gesture control of tv |
| US20130321271A1 (en) * | 2011-02-09 | 2013-12-05 | Primesense Ltd | Pointing-based display interaction |
| US8669953B2 (en) * | 2010-07-16 | 2014-03-11 | Lg Electronics Inc. | Mobile terminal and method of controlling the same |
Family Cites Families (6)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US6191773B1 (en) * | 1995-04-28 | 2001-02-20 | Matsushita Electric Industrial Co., Ltd. | Interface apparatus |
| IL161002A0 (en) | 2004-03-22 | 2004-08-31 | Itay Katz | Virtual video keyboard system |
| JP4274997B2 (ja) * | 2004-05-06 | 2009-06-10 | アルパイン株式会社 | 操作入力装置および操作入力方法 |
| JP3961545B2 (ja) * | 2005-11-29 | 2007-08-22 | 株式会社コナミデジタルエンタテインメント | オブジェクト選択装置、オブジェクト選択方法、ならびに、プログラム |
| US20090249258A1 (en) * | 2008-03-29 | 2009-10-01 | Thomas Zhiwei Tang | Simple Motion Based Input System |
| KR101632963B1 (ko) | 2009-02-02 | 2016-06-23 | 아이사이트 모빌 테크놀로지 엘티디 | 비디오 스트림에 있어서 물체 인식 및 트랙킹을 위한 시스템 및 방법 |
-
2012
- 2012-08-02 CN CN201280049041.9A patent/CN103858074B/zh active Active
- 2012-08-02 US US14/236,492 patent/US9733789B2/en not_active Expired - Fee Related
- 2012-08-02 CN CN201811099767.9A patent/CN109271029B/zh not_active Expired - Fee Related
- 2012-08-02 WO PCT/IL2012/050290 patent/WO2013018099A2/fr not_active Ceased
-
2017
- 2017-08-14 US US15/675,981 patent/US10606442B2/en not_active Expired - Fee Related
-
2020
- 2020-03-30 US US16/834,968 patent/US20200409529A1/en not_active Abandoned
Patent Citations (27)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP0227823A1 (fr) | 1985-07-03 | 1987-07-08 | Polaroid Corp | Procedes et produits photographiques de transfert en couleurs. |
| US5729249A (en) * | 1991-11-26 | 1998-03-17 | Itu Research, Inc. | Touch sensitive input control device |
| US6283860B1 (en) * | 1995-11-07 | 2001-09-04 | Philips Electronics North America Corp. | Method, system, and program for gesture based option selection |
| US6788809B1 (en) * | 2000-06-30 | 2004-09-07 | Intel Corporation | System and method for gesture recognition in three dimensions using stereo imaging and color vision |
| US7216305B1 (en) * | 2001-02-15 | 2007-05-08 | Denny Jaeger | Storage/display/action object for onscreen use |
| US20030016247A1 (en) * | 2001-07-18 | 2003-01-23 | International Business Machines Corporation | Method and system for software applications using a tiled user interface |
| US20030113018A1 (en) * | 2001-07-18 | 2003-06-19 | Nefian Ara Victor | Dynamic gesture recognition from stereo sequences |
| US7340077B2 (en) * | 2002-02-15 | 2008-03-04 | Canesta, Inc. | Gesture recognition system using depth perceptive sensors |
| US7274803B1 (en) * | 2002-04-02 | 2007-09-25 | Videomining Corporation | Method and system for detecting conscious hand movement patterns and computer-generated visual feedback for facilitating human-computer interaction |
| US20060132432A1 (en) * | 2002-05-28 | 2006-06-22 | Matthew Bell | Interactive video display system |
| US20040117727A1 (en) * | 2002-11-12 | 2004-06-17 | Shinya Wada | Method and apparatus for processing files utilizing a concept of weight so as to visually represent the files in terms of whether the weight thereof is heavy or light |
| US20080013793A1 (en) * | 2006-07-13 | 2008-01-17 | Northrop Grumman Corporation | Gesture recognition simulation system and method |
| US20080174551A1 (en) * | 2007-01-23 | 2008-07-24 | Funai Electric Co., Ltd. | Image display system |
| WO2008132724A1 (fr) | 2007-04-26 | 2008-11-06 | Mantisvision Ltd. | Procédé et dispositif pour une interaction tridimensionnelle avec des afficheurs autostéréoscopiques |
| US8230367B2 (en) * | 2007-09-14 | 2012-07-24 | Intellectual Ventures Holding 67 Llc | Gesture-based user interactions with status indicators for acceptable inputs in volumetric zones |
| WO2009035705A1 (fr) | 2007-09-14 | 2009-03-19 | Reactrix Systems, Inc. | Traitement d'interactions d'utilisateur basées sur des gestes |
| US20090089714A1 (en) * | 2007-09-28 | 2009-04-02 | Yahoo! Inc. | Three-dimensional website visualization |
| US20120317511A1 (en) * | 2008-03-07 | 2012-12-13 | Intellectual Ventures Holding 67 Llc | Display with built in 3d sensing capability and gesture control of tv |
| US8289316B1 (en) * | 2009-04-01 | 2012-10-16 | Perceptive Pixel Inc. | Controlling distribution of error in 2D and 3D manipulation |
| US20100315417A1 (en) | 2009-06-14 | 2010-12-16 | Lg Electronics Inc. | Mobile terminal and display controlling method thereof |
| CN101957719A (zh) | 2009-07-14 | 2011-01-26 | Lg电子株式会社 | 移动终端及其显示控制方法 |
| US8866810B2 (en) | 2009-07-14 | 2014-10-21 | Lg Electronics Inc. | Mobile terminal and display controlling method thereof |
| US20110012830A1 (en) * | 2009-07-20 | 2011-01-20 | J Touch Corporation | Stereo image interaction system |
| US20110187709A1 (en) * | 2010-01-29 | 2011-08-04 | Pantech Co., Ltd. | Mobile terminal and method for displaying information |
| US8669953B2 (en) * | 2010-07-16 | 2014-03-11 | Lg Electronics Inc. | Mobile terminal and method of controlling the same |
| US20130321271A1 (en) * | 2011-02-09 | 2013-12-05 | Primesense Ltd | Pointing-based display interaction |
| US20120260217A1 (en) * | 2011-04-11 | 2012-10-11 | Microsoft Corporation | Three-dimensional icons for organizing, invoking, and using applications |
Non-Patent Citations (1)
| Title |
|---|
| International Search Report for PCT International Application No. PCT/IL2012/050290, mailed Mar. 14, 2013 (4 pages). |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20170031538A1 (en) * | 2013-12-06 | 2017-02-02 | Telefonaktiebolaget Lm Ericsson (Publ) | Optical head mounted display, television portal module and methods for controlling graphical user interface |
| US10338776B2 (en) * | 2013-12-06 | 2019-07-02 | Telefonaktiebolaget Lm Ericsson (Publ) | Optical head mounted display, television portal module and methods for controlling graphical user interface |
Also Published As
| Publication number | Publication date |
|---|---|
| CN103858074A (zh) | 2014-06-11 |
| WO2013018099A2 (fr) | 2013-02-07 |
| CN109271029A (zh) | 2019-01-25 |
| US20150363070A1 (en) | 2015-12-17 |
| US20200409529A1 (en) | 2020-12-31 |
| US20170344222A1 (en) | 2017-11-30 |
| US10606442B2 (en) | 2020-03-31 |
| CN109271029B (zh) | 2022-08-26 |
| CN103858074B (zh) | 2018-10-19 |
| WO2013018099A3 (fr) | 2013-07-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US10606442B2 (en) | Touch-free gesture recognition system and method | |
| US20220382379A1 (en) | Touch Free User Interface | |
| EP2638461B1 (fr) | Appareil et procédé pour une entrée utilisateur permettant de commander des informations affichées | |
| US10203764B2 (en) | Systems and methods for triggering actions based on touch-free gesture detection | |
| CN110476142B (zh) | 显示虚拟内容的计算设备、方法和头戴式显示器设备 | |
| US9939914B2 (en) | System and method for combining three-dimensional tracking with a three-dimensional display for a user interface | |
| US9619105B1 (en) | Systems and methods for gesture based interaction with viewpoint dependent user interfaces | |
| CN104246682B (zh) | 增强的虚拟触摸板和触摸屏 | |
| US20180292907A1 (en) | Gesture control system and method for smart home | |
| US9753547B2 (en) | Interactive displaying method, control method and system for achieving displaying of a holographic image | |
| WO2014140827A2 (fr) | Systèmes et procédés de détection de gestes à base de capteur de proximité et de capteur d'image | |
| US20130257734A1 (en) | Use of a sensor to enable touch and type modes for hands of a user via a keyboard | |
| CN107077199A (zh) | 用于在三维显示器上呈现虚拟对象的装置及用于控制装置的方法 | |
| US11307762B2 (en) | Operating user interfaces | |
| JP2012038025A (ja) | 表示装置及び表示装置の制御方法、プログラム | |
| WO2016102948A1 (fr) | Interaction cohérente sans contact avec des images 3d stéréoscopiques |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| AS | Assignment |
Owner name: EYESIGHT MOBILE TECHNOLOGIES LTD., ISRAEL Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:KATZ, ITAY;REEL/FRAME:032132/0708 Effective date: 20140131 |
|
| STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
| FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
| FEPP | Fee payment procedure |
Free format text: SURCHARGE FOR LATE PAYMENT, SMALL ENTITY (ORIGINAL EVENT CODE: M2554); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
| MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2551); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY Year of fee payment: 4 |
|
| FEPP | Fee payment procedure |
Free format text: MAINTENANCE FEE REMINDER MAILED (ORIGINAL EVENT CODE: REM.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
| LAPS | Lapse for failure to pay maintenance fees |
Free format text: PATENT EXPIRED FOR FAILURE TO PAY MAINTENANCE FEES (ORIGINAL EVENT CODE: EXP.); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY |
|
| STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
| FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20250815 |