EP2266016A4 - Gesture based control using three-dimensional information extracted over an extended depth of field - Google Patents

Gesture based control using three-dimensional information extracted over an extended depth of field

Info

Publication number: EP2266016A4
Authority: EP; European Patent Office
Prior art keywords: field; information extracted; dimensional information; based control; gesture based
Prior art date: 2008-04-02
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.): Withdrawn

Application number

EP09728557.1A

Other languages

German (de)

French (fr)

Other versions

EP2266016A2 (en

Inventor

Hilaire Pierre St

John S Underkoffler

Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)

Oblong Industries Inc

Original Assignee

Oblong Industries Inc

Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)

2008-04-02

Filing date

2009-04-02

Publication date

2014-10-29

2008-04-24 Priority claimed from US12/109,263 external-priority patent/US8407725B2/en

2009-04-02 Application filed by Oblong Industries Inc filed Critical Oblong Industries Inc

2010-12-29 Publication of EP2266016A2 publication Critical patent/EP2266016A2/en

2014-10-29 Publication of EP2266016A4 publication Critical patent/EP2266016A4/en

Status Withdrawn legal-status Critical Current

Classifications

- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/0075—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00 with means for altering, e.g. increasing, the depth of field or depth of focus
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/50—Optics for phase object visualisation
- G02B27/52—Phase contrast optics
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/0304—Detection arrangements using opto-electronic means
- G06F3/0325—Detection arrangements using opto-electronic means using a plurality of light emitters or reflectors or a plurality of detectors forming a reference frame from which to derive the orientation of the object, e.g. by triangulation or on the basis of reference deformation in the picked up image
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/44—Arrangements for executing specific programs
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T1/00—General purpose image data processing
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V40/00—Recognition of biometric, human-related or animal-related patterns in image or video data
- G06V40/20—Movements or behaviour, e.g. gesture recognition
- G06V40/28—Recognition of hand or arm movements, e.g. recognition of deaf sign language

Landscapes

Engineering & Computer Science (AREA)
Theoretical Computer Science (AREA)
Physics & Mathematics (AREA)
General Engineering & Computer Science (AREA)
General Physics & Mathematics (AREA)
Human Computer Interaction (AREA)
Software Systems (AREA)
General Health & Medical Sciences (AREA)
Psychiatry (AREA)
Multimedia (AREA)
Computer Vision & Pattern Recognition (AREA)
Optics & Photonics (AREA)
Health & Medical Sciences (AREA)
Social Psychology (AREA)
User Interface Of Digital Computer (AREA)
Processing Or Creating Images (AREA)
Position Input By Displaying (AREA)
Studio Devices (AREA)
Length Measuring Devices By Optical Means (AREA)

EP09728557.1A 2008-04-02 2009-04-02 Gesture based control using three-dimensional information extracted over an extended depth of field Withdrawn EP2266016A4 (en)

Applications Claiming Priority (5)

Application Number	Priority Date	Filing Date	Title
US4189208P	2008-04-02	2008-04-02
US12/109,263 US8407725B2 (en)	2007-04-24	2008-04-24	Proteins, pools, and slawx in processing environments
US10524308P	2008-10-14	2008-10-14
US10525308P	2008-10-14	2008-10-14
PCT/US2009/039285 WO2009124181A2 (en)	2008-04-02	2009-04-02	Gesture based control using three-dimensional information extracted over an extended depth of field

Publications (2)

Publication Number	Publication Date
EP2266016A2 EP2266016A2 (en)	2010-12-29
EP2266016A4 true EP2266016A4 (en)	2014-10-29

Family

ID=41136111

Family Applications (1)

Application Number	Title	Priority Date	Filing Date
EP09728557.1A Withdrawn EP2266016A4 (en)	2008-04-02	2009-04-02	Gesture based control using three-dimensional information extracted over an extended depth of field

Country Status (5)

Country	Link
EP (1)	EP2266016A4 (en)
JP (1)	JP5697590B2 (en)
KR (1)	KR101550478B1 (en)
CN (1)	CN102047203B (en)
WO (1)	WO2009124181A2 (en)

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number	Priority date	Publication date	Assignee	Title
WO2011059404A2 (en) *	2009-11-12	2011-05-19	Nanyang Polytechnic	Method and system for interactive gesture-based control
US9171200B2 (en)	2011-03-04	2015-10-27	Hewlett-Packard Development Company, L.P.	Gestural interaction identification
CN103135755B (en) *	2011-12-02	2016-04-06	深圳泰山在线科技有限公司	Interactive system and method
JP5917125B2 (en)	2011-12-16	2016-05-11	キヤノン株式会社	Image processing apparatus, image processing method, imaging apparatus, and display apparatus
TWI451344B (en) *	2012-08-27	2014-09-01	Pixart Imaging Inc	Gesture recognition system and method
CN104007819B (en) *	2014-05-06	2017-05-24	清华大学	Gesture recognition method and device and Leap Motion system
EP3631533A4 (en)	2017-05-24	2021-03-24	The Trustees of Columbia University in the City of New York	WIDE-BAND ACHROMATIC FLAT OPTICAL COMPONENTS BY DIELECTRIC METASURFACES MODIFIED BY DISPERSION
CN107515454B (en) *	2017-08-29	2019-12-20	宁夏巨能机器人股份有限公司	Automatic focal length adjusting device for 3D visual positioning and adjusting method thereof
CN111656707A (en)	2017-08-31	2020-09-11	梅特兰兹股份有限公司	Transmissive metasurface lens integration
CA3089373A1 (en)	2018-01-24	2019-08-01	President And Fellows Of Harvard College	Polarization state generation with a metasurface
CN118707744A (en)	2018-07-02	2024-09-27	梅特兰兹股份有限公司	Metasurfaces for laser speckle reduction
US11978752B2 (en)	2019-07-26	2024-05-07	Metalenz, Inc.	Aperture-metasurface and hybrid refractive-metasurface imaging systems
CN110609039B (en) *	2019-09-23	2021-09-28	上海御微半导体技术有限公司	Optical detection device and method thereof
US11578968B1 (en)	2019-10-31	2023-02-14	President And Fellows Of Harvard College	Compact metalens depth sensors
US11927769B2 (en)	2022-03-31	2024-03-12	Metalenz, Inc.	Polarization sorting metasurface microlens array device

Citations (3)

* Cited by examiner, † Cited by third party
Publication number	Priority date	Publication date	Assignee	Title
US20020041327A1 (en) *	2000-07-24	2002-04-11	Evan Hildreth	Video-based image control system
US20040145808A1 (en) *	1995-02-03	2004-07-29	Cathey Wade Thomas	Extended depth of field optical systems
US20060187196A1 (en) *	2005-02-08	2006-08-24	Underkoffler John S	System and method for gesture based control system

Family Cites Families (7)

* Cited by examiner, † Cited by third party
Publication number	Priority date	Publication date	Assignee	Title
US7164117B2 (en) *	1992-05-05	2007-01-16	Automotive Technologies International, Inc.	Vehicular restraint system control system and method using multiple optical imagers
JP2000275582A (en) *	1999-03-24	2000-10-06	Olympus Optical Co Ltd	Depth-of-field enlarging system
SE0000850D0 (en) *	2000-03-13	2000-03-13	Pink Solution Ab	Recognition arrangement
US7151246B2 (en)	2001-07-06	2006-12-19	Palantyr Research, Llc	Imaging system and methodology
US6842297B2 (en)	2001-08-31	2005-01-11	Cdm Optics, Inc.	Wavefront coding optics
WO2008008084A2 (en) *	2005-09-19	2008-01-17	Cdm Optics, Inc.	Task-based imaging systems
JP2008070319A (en)	2006-09-15	2008-03-27	Canon Inc	Object measuring apparatus and method

2009
- 2009-04-02 CN CN200980120542.XA patent/CN102047203B/en not_active Expired - Fee Related
- 2009-04-02 WO PCT/US2009/039285 patent/WO2009124181A2/en not_active Ceased
- 2009-04-02 JP JP2011503166A patent/JP5697590B2/en not_active Expired - Fee Related
- 2009-04-02 KR KR1020107024659A patent/KR101550478B1/en not_active Expired - Fee Related
- 2009-04-02 EP EP09728557.1A patent/EP2266016A4/en not_active Withdrawn

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number	Priority date	Publication date	Assignee	Title
US20040145808A1 (en) *	1995-02-03	2004-07-29	Cathey Wade Thomas	Extended depth of field optical systems
US20020041327A1 (en) *	2000-07-24	2002-04-11	Evan Hildreth	Video-based image control system
US20060187196A1 (en) *	2005-02-08	2006-08-24	Underkoffler John S	System and method for gesture based control system

Also Published As

Publication number	Publication date
KR20100136993A (en)	2010-12-29
EP2266016A2 (en)	2010-12-29
KR101550478B1 (en)	2015-09-04
JP2011523112A (en)	2011-08-04
JP5697590B2 (en)	2015-04-08
CN102047203B (en)	2016-08-17
CN102047203A (en)	2011-05-04
WO2009124181A3 (en)	2009-12-30
WO2009124181A2 (en)	2009-10-08

Publication	Publication Date	Title
EP2266016A4 (en)	2014-10-29	Gesture based control using three-dimensional information extracted over an extended depth of field
IL280133A (en)	2021-03-01	Methods and devices for nucleic acids synthesis
EP2526528A4 (en)	2017-05-31	Blur function modeling for depth of field rendering
EP2271952A4 (en)	2014-06-04	Visulation of geologic features using data representations thereof
EP2697743A4 (en)	2014-09-24	Gesture recognition using depth images
EP2319016A4 (en)	2012-02-01	Stereoscopic depth mapping
BRPI0822727A2 (en)	2015-07-14	3d Navigation Data Display Method
SG10201503145QA (en)	2015-08-28	Writing instrument
GB201109198D0 (en)	2011-07-13	Gesture based edit mode
BRPI1016047A2 (en)	2017-07-18	conducting sync level information
GB0822149D0 (en)	2009-01-14	Provision of image data
AU332377S (en)	2010-08-24	Writing instrument
AU333110S (en)	2010-10-06	Writing instrument
AU333477S (en)	2010-11-03	Writing instrument
GB0822104D0 (en)	2009-01-07	Criticality of data
EP2617013A4 (en)	2017-04-12	A method for enhancing depth maps
AU333112S (en)	2010-10-06	Writing instrument
EP2452506A4 (en)	2014-01-22	Method for displaying three-dimensional user interface
GB201120524D0 (en)	2012-01-11	Zeroable depth scale for drill presses and methods therefor
AU334048S (en)	2010-12-07	Writing instrument
AP2012006484A0 (en)	2012-10-31	An improved multi drill cultivator
AU333124S (en)	2010-10-07	Writing instrument
IL221437A0 (en)	2012-10-31	Data expansion using an approximate method
EP2799838A4 (en)	2015-09-02	Information signal generating method
PL2279832T3 (en)	2016-07-29	User-specific inlay for objects

Legal Events

Date	Code	Title	Description
2010-11-26	PUAI	Public reference made under article 153(3) epc to a published international application that has entered the european phase	Free format text: ORIGINAL CODE: 0009012
2010-12-29	17P	Request for examination filed	Effective date: 20101102
2010-12-29	AK	Designated contracting states	Kind code of ref document: A2 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO SE SI SK TR
2010-12-29	AX	Request for extension of the european patent	Extension state: AL BA RS
2011-07-06	DAX	Request for extension of the european patent (deleted)
2014-10-29	A4	Supplementary search report drawn up and despatched	Effective date: 20140929
2014-10-29	RIC1	Information provided on ipc code assigned before grant	Ipc: G06F 3/01 20060101AFI20140923BHEP Ipc: G02B 27/00 20060101ALI20140923BHEP Ipc: G02B 27/52 20060101ALI20140923BHEP Ipc: G06F 3/03 20060101ALI20140923BHEP Ipc: G06K 9/00 20060101ALI20140923BHEP
2018-06-22	STAA	Information on the status of an ep patent application or granted ep patent	Free format text: STATUS: EXAMINATION IS IN PROGRESS
2018-07-25	17Q	First examination report despatched	Effective date: 20180626
2019-05-10	STAA	Information on the status of an ep patent application or granted ep patent	Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN
2019-06-12	18D	Application deemed to be withdrawn	Effective date: 20190108