[go: up one dir, main page]

WO2009093027A1 - Périphérique d'ordinateur se fixant au poignet - Google Patents

Périphérique d'ordinateur se fixant au poignet Download PDF

Info

Publication number
WO2009093027A1
WO2009093027A1 PCT/GB2009/000172 GB2009000172W WO2009093027A1 WO 2009093027 A1 WO2009093027 A1 WO 2009093027A1 GB 2009000172 W GB2009000172 W GB 2009000172W WO 2009093027 A1 WO2009093027 A1 WO 2009093027A1
Authority
WO
WIPO (PCT)
Prior art keywords
wrist
computer
movements
acceleration
microcontroller
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/GB2009/000172
Other languages
English (en)
Inventor
Erik Lea
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
GUILDFORD TECHNOLOGIES Ltd
Original Assignee
GUILDFORD TECHNOLOGIES Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by GUILDFORD TECHNOLOGIES Ltd filed Critical GUILDFORD TECHNOLOGIES Ltd
Publication of WO2009093027A1 publication Critical patent/WO2009093027A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/011—Arrangements for interaction with the human body, e.g. for user immersion in virtual reality
    • G06F3/014—Hand-worn input/output arrangements, e.g. data gloves
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/017—Gesture based interaction, e.g. based on a set of recognized hand gestures
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
    • G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
    • G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
    • G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors

Definitions

  • the invention relates to the interface and control of computer programmes in electronic devices, such as computers, mobile phones and PDAs, which are today mostly controlled via keyboards, mouse devices, keypads and touch screens. More specifically, the device described here detects the movements of the user's wrist, and sends control signals to the electronic device based upon these movements. In most implementations, it is intended that the device be able to send the control signals to the electronic device wirelessly.
  • Keyboards have been the main interface device for computers since their introduction to the market, and they are still essentially the same input device as patented by Christopher Sholes for typewriters in 1878, except that they are now electrical.
  • button and keypad devices which are normally used on mobile phones, PDAs and teller machines, they offer a relatively quick way of entering alphanumeric data and predefined commands into a computer programme.
  • a major drawback with these devices, especially full-sized computer keyboards is that they take up a lot of space, and they are one of the main factors why portable computers are not becoming smaller.
  • Several manufacturers have implemented full, but miniaturized, keyboards on mobile phones and PDAs.
  • the computer mouse was invented in the 1960s by Douglas Engelbart [1], and was introduced to the popular market by Logitech in the 1980s [2]. Virtually all computers today are supplied with a computer mouse.
  • the mouse normally gives input based upon a two-dimensional movement relative to a table or a mouse pad. This normally gives a positional input to the computer, which is often used to position a point or a cursor on a graphical user interface (GUI) on a computer monitor.
  • GUI graphical user interface
  • most mouse devices come with one or more buttons, or scrolling wheels, to be used in conjunction with the positional information.
  • the button inpxit is generally used for selecting, grabbing or instantiating whatever the cursor is pointing at.
  • Voice control has been implemented in various applications, and is commercially available for PCs and mobile units in Microsoft's Voice Command programme.
  • the useful aspect of voice control is that it does not restrict the user's working position, and it does not necessarily take more space than a microphone. It could also easily be implemented for the same user on multiple systems, such as computers, teller machines, mobile phones and PDAs, without making the users carry hardware with them.
  • the major drawback of voice control is that it lacks the quick and precise positional control, which is common with pointing devices.
  • Notable motion detecting devices include the Revolution console system from Nintendo, presented at the Tokyo Game Show on 16 September 2005, Compaq's Rock n Scroll photo album [12], the Sharp V603SH mobile phone and the GO 2.4 Series Cordless Optical Air Mouse from Gyration.
  • FogScreen technology [13] by FogScreen Inc., which allows for both display and interactive work.
  • FogScreen Inc. which allows for both display and interactive work.
  • these systems are set up with fog screens or cameras for image analysis or holographic light rasters, they tend to be dedicated systems, which are not suited for moving between computers.
  • the main purpose of the new invention is to control computer programmes in a convenient, intuitive and efficient manner.
  • the device be able to work in wireless mode, and so enabling the user to control a computer from any position, where the only restriction is the choice of wireless range in the particular implementation of the device.
  • the invention is a wrist-mounted device, worn in a similar way to a watch, as shown in Figure 3.
  • it detects the linear and rotational movements of the user's wrist, and control signals are sent to a computer programme based upon these wrist movements.
  • the computer programme can run on any type of electronic equipment, such as a computer, a mobile phone, or a PDA. Normally, the signals generated by the wrist-mounted device would be transmitted wirelessly to the computer programme, as stated in claim 8.
  • transient movements such as those generated by snapping of fingers, where the position of the wrist can be the same before and after the transient movement, can be detected by the wrist-mounted device, and used to generate singular programme instructions, similar to a computer mouse click, as described in claim 3.
  • Figure 1 shows various common hand gestures: Grabbing, waving, pushing and lifting.
  • Figure 2 shows the six degrees of freedom of movement measured on a device, where the rotational movements are roll, pitch and yaw, and the linear movements are x, y and z.
  • the arrow marked n indicates the normal vector relative to the top of the device.
  • Figure 3 shows a hand with the proposed computer peripheral strapped to the wrist.
  • a significant amount of hand gesture information can be extracted from the user's wrist, without knowing the details of the user's hand.
  • Some common hand gestures are illustrated in Figure 1, showing a grabbing motion, waving left to right, pushing forward and lifting.
  • Grabbing, pointing and moving objects are normally motions of the hand, which are related to movements of the wrist.
  • the invention aims to detect the linear motion as well as the rotation of the wrist of the user, and use these data to generate control information for computer programmes.
  • Figure 2 illustrates a device, which can detect six degrees of freedom of motion of the wrist. As illustrated, it detects three rotational movements, namely roll, pitch and yaw, and three linear movements of the device, being x, y and z in a Cartesian coordinate system.
  • a detector like in Figure 2 is strapped to the user's wrist, in the same way as a watch. While it is possible to have a bigger device, extending over more of the hand or the forearm, or a device extending further round the wrist, like a bracelet, a device similar to a wrist watch is preferable, in that it is small and portable, and because it is similar to what people are used to wearing as wrist watches.
  • the detection of the wrist motions can be implemented in various ways. At least three linear sensors are required to detect the six degrees of freedom of movement illustrated in Figure 2. All the degrees of freedom illustrated in Figure 2 will be the same for the device and the user's wrist, except for the roll.
  • Rotational movements can be detected by placing two or more linear sensors in the plane normal to the rotational axis. For a wrist detector, this can be implemented by placing a linear sensor at the left and right ends of the device, to allow the measurement of the roll to be relative to the centre of the user's wrist. This is to provide the user with a more natural and intuitive feel.
  • a microcontroller being a programmable integrated circuit, with integrated memory and analogue- to-digital converters, is readily available from companies like Texas Instruments and Microchip, and their size is typically less than 1 cm 2 . It is intended that the sensor signals be recorded and processed within the device, before sending the signals to another electronic device to control a computer programme.
  • the motion sensors for a wrist sensor will be force or acceleration sensors, and the conversion to position and relative movement will be calculated in a processing circuit. It is intended that this takes place in a microcontroller located inside the device.
  • a sensor like illustrated in Figure 3 can detect any gesture indicated in Figure 1, there is another important kind of movement which can be detected by the device. This is the transient movement, generated by snapping or tapping of the fingers, or by a quick shake of the hand. In this case, the wrist generally stays in the same position before and after the transient, while for instance a snap of the fingers will be detectable as a very rapid shake of the wrist. It is intended that this be used as singular computer instructions, similar to clicking a computer mouse.
  • the signals detected from the wrist are used to generate control signals for a computer programme located on an electronic device.
  • the transmission can be performed in several ways.
  • the signals be transmitted wirelessly, for instance by Bluetooth, which is a wireless protocol commonly implemented in computers, mobile phones and PDAs. This will allow the device to control computer programmes on multiple electronic devices supporting the same wireless interface. While at a dedicated home or work computer, however, the device may be plugged in by physical connection if required, to allow the wireless connection to be switched off.

Landscapes

  • Engineering & Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Human Computer Interaction (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Position Input By Displaying (AREA)

Abstract

La présente invention concerne un nouveau type de périphérique d'ordinateur destiné à être utilisé sous forme d'un dispositif sans fil, pouvant être en interface avec des ordinateurs, des téléphones mobiles, des assistants numériques et d'autres dispositifs à interface sans fil. Le périphérique est fixé au poignet d'une personne, comme une montre, et il détecte les mouvements du poignet de la personne, qui sont transmis vers un ordinateur ou autre dispositif sous forme d'instructions de programme. Outre la détection de gestes, qui sont détectés sous forme de tangage, roulis, lacet et mouvement linéaire du poignet, le dispositif peut capter des brefs mouvements transitoires dans le poignet, qui peuvent être générés par le claquement ou le tapotement des doigts.
PCT/GB2009/000172 2008-01-24 2009-01-22 Périphérique d'ordinateur se fixant au poignet Ceased WO2009093027A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB0801287.4 2008-01-24
GB0801287A GB0801287D0 (en) 2008-01-24 2008-01-24 Wrist-mounted computer periferal

Publications (1)

Publication Number Publication Date
WO2009093027A1 true WO2009093027A1 (fr) 2009-07-30

Family

ID=39186247

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/GB2009/000172 Ceased WO2009093027A1 (fr) 2008-01-24 2009-01-22 Périphérique d'ordinateur se fixant au poignet

Country Status (2)

Country Link
GB (1) GB0801287D0 (fr)
WO (1) WO2009093027A1 (fr)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2015055890A1 (fr) * 2013-10-14 2015-04-23 Nokia Technologies Oy Saisie par poignet dans un plan de déviation
US9195219B2 (en) 2013-09-25 2015-11-24 Lg Electronics Inc. Smart watch and control method thereof
EP3076267A1 (fr) * 2015-04-03 2016-10-05 LG Electronics Inc. Terminal mobile et son procédé de contrôle
US10684693B2 (en) 2017-03-02 2020-06-16 Samsung Electronics Co., Ltd. Method for recognizing a gesture and an electronic device thereof

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1394665A1 (fr) * 2001-06-01 2004-03-03 Sony Corporation Appareil de saisie
US20050210418A1 (en) * 2004-03-23 2005-09-22 Marvit David L Non-uniform gesture precision

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1394665A1 (fr) * 2001-06-01 2004-03-03 Sony Corporation Appareil de saisie
US20050210418A1 (en) * 2004-03-23 2005-09-22 Marvit David L Non-uniform gesture precision

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9195219B2 (en) 2013-09-25 2015-11-24 Lg Electronics Inc. Smart watch and control method thereof
WO2015055890A1 (fr) * 2013-10-14 2015-04-23 Nokia Technologies Oy Saisie par poignet dans un plan de déviation
US9213044B2 (en) 2013-10-14 2015-12-15 Nokia Technologies Oy Deviational plane wrist input
JP2016537710A (ja) * 2013-10-14 2016-12-01 ノキア テクノロジーズ オサケユイチア 偏位平面手首入力
EP3076267A1 (fr) * 2015-04-03 2016-10-05 LG Electronics Inc. Terminal mobile et son procédé de contrôle
US9939948B2 (en) 2015-04-03 2018-04-10 Lg Electronics Inc. Mobile terminal and controlling method thereof
US10345959B2 (en) 2015-04-03 2019-07-09 Lg Electronics Inc. Watch terminal and method of controlling the same
US10684693B2 (en) 2017-03-02 2020-06-16 Samsung Electronics Co., Ltd. Method for recognizing a gesture and an electronic device thereof

Also Published As

Publication number Publication date
GB0801287D0 (en) 2008-03-05

Similar Documents

Publication Publication Date Title
US10838495B2 (en) Devices for controlling computers based on motions and positions of hands
Lee et al. Interaction methods for smart glasses: A survey
CN210573659U (zh) 计算机系统、头戴式设备、手指设备和电子设备
Perng et al. Acceleration sensing glove (ASG)
Gong et al. Wristwhirl: One-handed continuous smartwatch input using wrist gestures
EP2733574B1 (fr) Commande d'une interface utilisateur graphique
US8810514B2 (en) Sensor-based pointing device for natural input and interaction
KR101666096B1 (ko) 강화된 제스처 기반 상호작용 시스템 및 방법
EP1779221B1 (fr) Procede et appareil de communication d'informations graphiques a un malvoyant par reaction haptique
US20030142065A1 (en) Ring pointer device with inertial sensors
JP6171016B2 (ja) 磁場センサを用いて使用者入力を判断する電気装置
US20120127070A1 (en) Control signal input device and method using posture recognition
US20100090949A1 (en) Method and Apparatus for Input Device
CN102063183A (zh) 一种手套式虚拟输入装置
Howard et al. Lightglove: Wrist-worn virtual typing and pointing
CN104254816A (zh) 数据输入装置
CN104769522A (zh) 具有3d 指向和手势识别功能的远程控制器
WO2011076057A1 (fr) Appareil d'entrée basé sur la sensation corporelle et procédé d'entrée associé
CN103294226B (zh) 一种虚拟输入装置及方法
Oh et al. FingerTouch: Touch interaction using a fingernail-mounted sensor on a head-mounted display for augmented reality
US20120262369A1 (en) Hand-mountable device for providing user input
WO2009093027A1 (fr) Périphérique d'ordinateur se fixant au poignet
Pandit et al. A simple wearable hand gesture recognition device using iMEMS
KR101211808B1 (ko) 동작인식장치 및 동작인식방법
US20050264522A1 (en) Data input device

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 09704363

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 09704363

Country of ref document: EP

Kind code of ref document: A1