WO2021090102A1

WO2021090102A1 - System for operating joystick

Info

Publication number: WO2021090102A1
Application number: PCT/IB2020/059959
Authority: WO
Inventors: Vinay Krishna SHARMA; Pradipta Biswas
Original assignee: Indian Institute of Science IISC
Current assignee: Indian Institute of Science IISC
Priority date: 2019-11-04
Filing date: 2020-10-23
Publication date: 2021-05-14
Anticipated expiration: 2022-05-04

Abstract

The present disclosure provides a system for controlling operations of a joystick. The system includes: an input unit comprising a set of sensors, the set of sensors to sense input gestures and generate an input signal corresponding to the sensed input gestures; one or more rotary devices operatively coupled to one or more controlling pins of the joystick to move the corresponding controlling pins; and a control unit operatively coupled to the input unit and the one or more rotary devices, the control unit configured to: extract one or more attributes from the generated input signal; and generate a control signal by comparing the extracted one or more attributes with a dataset comprising a set of predefined attributes and corresponding control action, wherein the one or more rotary devices move the corresponding controlling pins in response to the generated control signals.

Description

SYSTEM FOR OPERATING JOYSTICK

TECHNICAL FIELD

[0001] The present disclosure generally relates to controlling devices. More particularly, the present disclosure relates to system for controlling operation of joystick according to multiple input techniques.

BACKGROUND

[0002] Background description includes information that may be useful in understanding the present invention. It is not an admission that any of the information provided herein is prior art or relevant to the presently claimed invention, or that any publication specifically or implicitly referenced is prior art.

[0003] With astounding growth of technologies observed in recent years, consumer electronics have also seen tremendous advancement in terms of interactive devices. As the technology is leaping ahead, size of various electronic components is shrinking. Now, it is possible to have various sensors, transducers or devices such as an eye gaze tracker, gyroscope, haptic vibrator and the like in a single device such as a mobile phone. Further, in recent times, various industries such as automotive, consumer electronics, medicalhaveseen a gradual increase in integration of various sensors, transducers, devices with existing technologies to help automate them. For example, gesture-based, speech-based and primitive eye gaze-based controlled interfaces inside cockpit. However, human-robot interaction and gaming devices still require ajoystick-based controller (like a video game console) or an application rendered on a touch screen-based display for controlling any robotic agent starting from a single robotic arm to drones and the like.

[0004] The joystick is an input device that includes plurality of vertical levers mounted on a base. The levers can be moved in various directions, which correspond to the motion or manoeuvring of car, drone, robot ora virtual game object. The levers need to be moved manually in a requisite direction responsive to the dynamic environment of the object being controlled (car, drone or a game). Hence, the feedback and response of the joystick becomes crucial for precision and effectiveness of operation.

[0005] Efforts have been made in the past to overcome problems associated with joysticks. For example, to improve the re-centring and stabilizing property of the lever, David W. Reeves employed two orthogonal gimbals that provides geared potentiometer actuation. The joystick having mechanical linkages with direct connection has irregular and unexpected response, so deliberate work has been done to use electronic joysticks employing Hall Effect sensors for position and magnitude detection. Analog joystick controllers with handle were mechanically coupled to the wipers of two potentiometer that relates the tilting of the handle to the impedance.

[0006] The joystick with digital logic representation for the shifting was developed by

Edmund J. Goresk. The use of joystick was also extended for generating switch closures including micro switches. Joysticks were modified to allow reconfiguration and recalibration as per user’s preference, simulator choice and camera activation. The contact type switches used in joysticks cannot withstand multiple actuations in a short duration of time and thus, the controller needs maintenance and switch replacement. Thomas B. Martin developed a contactless switch comprising of magnet mounted against the spring assembly inside the joystick. There are some thumb-stick mountings developed for the game consoles to reduce the effort and pressure while operating. Work has also been done in modifying the general gaming console design so as to incorporate new buttons and functionalities.

[0007] However, the existing techniques do not provide a system and techniques that can control the movements of the levers of joysticks using multiple input modes that includes speech, gesture, eye gaze inputs and the likes further, the existing techniques require hardware as well as software integration to help controlling of the objects based on the gestures that is very time consuming and also costly to execute. Further, the existing techniques require software interfacing platform such as software development kit (SDK) etc. to help control movement of the objects. Further, the existing techniques cannot be used by persons with disability, motor impairment and situationally impaired.

[0008] There is, therefore, a need in the art to provide a device for operating the joystick to control movement of the objects for multiple input sources such as speech, gesture, eye gaze and the like. In particular what is needed is device for controlling joystick that seeks to overcome or at least ameliorate one or more of the above-mentioned problems and other limitations of the existing solutions and utilize techniques, which are robust, accurate, fast, efficient, cost-effective and simple.

OBJECTS OF THE PRESENT DISCLOSURE

[0009] Some of the objects of the present disclosure, which at least one embodiment herein satisfies are as listed herein below.

[0010] It is an object of the present disclosure to provide a system for controlling a joystick. [0011] It is another object of the present disclosure to provide a system for controlling a joystick that can take various human gestures as input gestures for controlling the joystick operation.

[0012] It is another object of the present disclosure to provide a system for controlling a joystick that can help reduce effort in controlling the joystick.

[0013] It is another object of the present disclosure to provide a system for controlling a joystick that helps remediate wear and tear of the joystick due to excessive force exerted by a user.

[0014] It is another object of the present disclosure to provide a system that can empower person with disability for controlling a joystick to perform various tasks.

[0015] It is another object of the present disclosure to provide a system for controlling a joystick that is cost effective and easy to implement.

[0016] It is yet another object of the present disclosure to provide a system for controlling an analog as well as digital joystick.

SUMMARY

[0017] The present disclosure generally relates to controlling devices. More particularly, the present disclosure relates to system for controlling operation of joystick according to multiple input techniques.

[0018] An aspect of the present disclosure provides a system for controlling a joystick. The system includes: an input unit comprising a set of sensors, the set of sensors to sense input gestures and generate an input signal corresponding to the sensed input gestures; one or more rotary devices operatively coupled to one or more controlling pins of the joystick to move the corresponding controlling pins; and a control unit operatively coupled to the input unit and the one or more rotary devices, the control unit configured to: extract one or more attributes from the generated input signal; and generate a control signal by comparing the extracted one or more attributes with a dataset comprising a set of predefined attributes and corresponding control action, wherein the one or more rotary devices move the corresponding controlling pins in response to the generated control signals.

[0019] In an aspect, the system comprises one or more manipulator members configured with the one or more rotary devices such that each of the one or more manipulator members is having a cavity to enable fitment of the one or more manipulator members with the corresponding controlling pins of the joystick. [0020] In an aspect, each of the one or more manipulator members comprising an orifice to enable fitment of the one or more rotary devices with the one or more manipulator members.

[0021] In an aspect, the cavity of the one or more manipulator member is U-shaped.

[0022] In an aspect, the system comprises one or more support members for supporting the one or more rotary devices.

[0023] In an aspect, the one or more supporting members having a hole to enable fitment of the one or more rotary members with the one or more supporting members.

[0024] In an aspect, the one or more rotary devices is selected from a group comprising of any of a servo motor, a stepper motor, an AC motor, a DC motor, and an actuator.

[0025] In an aspect, the set of sensors comprises a gesture recognition sensor, an eye gaze sensor, an EEG sensor and a microphone.

[0026] In an aspect, the input gesture comprises a hand gesture, an eye gaze gesture and control input gesture.

[0027] In an aspect, the input gestures are depicted by a user.

BRIEF DESCRIPTION OF THE DRAWINGS

[0028] In the figures, similar components and/or features may have the same reference label. Further, various components of the same type may be distinguished by following the reference label with a second label that distinguishes among the similar components. If only the first reference label is used in the specification, the description is applicable to any one of the similar components having the same first reference label irrespective of the second reference label.

[0029] FIG. 1 illustrates an exemplary block diagram representation of a device for controlling a joystick, in accordance with an embodiment of the present disclosure.

[0030] FIG. 2A illustrates an exemplary implementation of device to control the joystick in accordance with an embodiment of the present disclosure.

[0031] FIG. 2B illustrates an exemplary representation of a supporting member and manipulator member of the device, in accordance with an embodiment of the present disclosure. DETAILED DESCRIPTION

[0032] The following is a detailed description of embodiments of the disclosure depicted in the accompanying drawings. The embodiments are in such detail as to clearly communicate the disclosure. However, the amount of detail offered is not intended to limit the anticipated variations of embodiments; on the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the present disclosure as defined by the appended claims.

[0033] In the following description, numerous specific details are set forth in order to provide a thorough understanding of embodiments of the present invention. It will be apparent to one skilled in the art that embodiments of the present invention may be practised without some of these specific details.

[0034] Embodiments of the present invention include various steps, which will be described below. The steps may be performed by hardware components or may be embodied in machine-executable instructions, which may be used to cause a general-purpose or special- purpose processor programmed with the instructions to perform the steps. Alternatively, steps may be performed by a combination of hardware, software, and firmware and/or by human operators.

[0035] Various methods described herein may be practised by combining one or more machine-readable storage media containing the code according to the present invention with appropriate standard computer hardware to execute the code contained therein. An apparatus for practising various embodiments of the present invention may involve one or more computers (or one or more processors within a single computer) and storage systems containing or having network access to computer program(s) coded in accordance with various methods described herein, and the method steps of the invention could be accomplished by modules, routines, subroutines, or subparts of a computer program product. [0036] If the specification states a component or feature “may”, “can”, “could”, or

“might” be included or have a characteristic, that particular component or feature is not required to be included or have the characteristic. As used in the description herein and throughout the claims that follow, the meaning of “a,” “an,” and “the” includes plural reference unless the context clearly dictates otherwise. Also, as used in the description herein, the meaning of “in” includes “in” and “on” unless the context clearly dictates otherwise. [0037] The present disclosure generally relates to controlling devices. More particularly, the present disclosure relates to device for controlling operation of joystick according to multiple input techniques. [0038] An aspect of the present disclosure provides a device for controlling a joystick(stand alone or mounted on Video Game Console). The device includes an input unit to receive an input for controlling the joystick; a processing unit operatively coupled with the input unit, the processing unit comprising a processor coupled to a memory, the memory storing instructions executable by the processor to: receive an input signal generated by the input unit; extract one or more features pertaining to controlling instructions for manoeuvring of an object from the received input signal; and compare the extracted one or more features with a dataset comprising a set of predefined features associated with one or more controlling instructions, wherein based on the comparison one or more control signals are generated for controlling the joystick; and one or more motors operatively coupled to the processing unit, each of the one or more motors configured with manipulator members detachably fitted with corresponding controlling pin of one or more controlling pins of the joystick, wherein the generated one or more control signals are used for controlling rotary movement of the one or more motors, and wherein the rotatory movement of the one or more motors controls movement of the controlling pins to facilitate manoeuvring of an object operatively coupled with the joystick.

[0039] The present disclosure also considers the different type of operation modes of the joystick: both Digital and Analog. Digital joysticks are those whose motion are fixed like a switch button operation i.e. digit joysticks can take binary values like on/off or 0/1 type. Analog joysticks can take a range of continuous values corresponding to the physical range of motion of the lever of the joystick. So an Analog joystick can control and game object, a car ( AGV), with control parameters (Action, Direction, Speed, Acceleration) being proportional to the magnitude and direction of the joystick being moved. Whereas in digital joysticks the control parameters not only limited but fixed and are not proportional to the magnitude of the joystick motion.

[0040] In an embodiment, the input unit can include a set of sensors to sense one or more parameters pertaining to the input for controlling the joystick, where the set of sensors can include a gesture sensor, a speech sensor, a gaze sensor and an electronic pulse sensor. [0041] In an embodiment, the device can include one or more supporting members such that each of the one or more supporting members can be coupled with corresponding motor of the one or more motors.

[0042] In an embodiment, the input unit can be operatively coupled to the processing unit using a wired or a wireless network depending upon the scope of the implementation and purpose to be served. [0043] The present disclosure generally relates to controlling devices. More particularly, the present disclosure relates to system for controlling operation of joystick according to multiple input techniques.

[0044] An aspect of the present disclosure provides a system for controlling a joystick. The system includes: an input unit comprising a set of sensors, the set of sensors to sense input gestures and generate an input signal corresponding to the sensed input gestures; one or more rotary devices operatively coupled to one or more controlling pins of the joystick to move the corresponding controlling pins; and a control unit operatively coupled to the input unit and the one or more rotary devices, the control unit configured to: extract one or more attributes from the generated input signal; and generate a control signal by comparing the extracted one or more attributes with a dataset comprising a set of predefined attributes and corresponding control action, wherein the one or more rotary devices move the corresponding controlling pins in response to the generated control signals.

[0045] In an aspect, the system comprises one or more manipulator members configured with the one or more rotary devices such that each of the one or more manipulator members is having a cavity to enable fitment of the one or more manipulator members with the corresponding controlling pins of the joystick.

[0046] In an aspect, each of the one or more manipulator members comprising an orifice to enable fitment of the one or more rotary devices with the one or more manipulator members.

[0047] In an aspect, the cavity of the one or more manipulator member is U-shaped.

[0048] In an aspect, the system comprises one or more support members for supporting the one or more rotary devices.

[0049] In an aspect, the one or more supporting members having a hole to enable fitment of the one or more rotary members with the one or more supporting members.

[0050] In an aspect, the one or more rotary devices is selected from a group comprising of any of a servo motor, a stepper motor, an AC motor, a DC motor, and an actuator.

[0051] In an aspect, the set of sensors comprises a gesture recognition sensor, an eye gaze sensor, an EEG sensor and a microphone.

[0052] In an aspect, the input gesture comprises a hand gesture, an eye gaze gesture and control input gesture.

[0053] In an aspect, the input gestures are depicted by a user. [0054] FIG. 1 illustrates an exemplary block diagram representation of device for controlling joystick, in accordance with an embodiment of the present disclosure.

[0055] According to an embodiment, a device for controlling joysticks can include an input unit 102 adapted for receiving an input from an external source. The input unit 102 can include, without any limitations, a set of sensors and/or a set of transducers and various input peripheral devices to sense various input gestures. The various input gestures can include but not be limited to a hand gesture, an eye gaze gesture and control input gesture. The various sensors of the input unit can include but not limited to a motion sensor, a gesture sensor, a proximity sensor, an eye gaze sensor and an electronic pulse sensor.

[0056] The device can include a control unit 106 operatively coupled to the input unit

102 through a network 104. The network 104 can be a wireless network, a wired network or a combination thereof that can be implemented as one of the different types of networks, such as Intranet, Local Area Network (LAN), Wide Area Network (WAN), Internet, and the like. Further, the network 104 can either be a dedicated network or a shared network. The shared network can represent an association of the different types of networks that can use a variety of protocols, for example, Hypertext Transfer Protocol (HTTP), Transmission Control Protocol/Internet Protocol (TCP/IP), Wireless Application Protocol (WAP), and the like. [0057] The control unit 106 can be adapted for receiving the sensed input from the input unit 102 and subsequently, extracting one or more features from the received input. The extracted one or more features can pertain to controlling instructions for moving controlling pins of the joystick. In one embodiment, the control unit 106 can select the mode of input from the input unit. In another embodiment, the control unit can have multiple modes, and any mode from a set of modes can be automatically selected corresponding to the received input by the input unit 102.

[0058] Further, the extracted one or more features can be compared with a dataset comprising a set of predefined features associated with one or more controlling instructions. The one or more controlling instructions can be modally selected based on the received input signal. Now, based on the comparison of the extracted features and the predefined features a control signal can be generated by the control unit.

[0059] In an embodiment, the device can include motors 108-1 and 108-2

(collectively referred to as motors 108 herein and individually referred to as motor 108 herein) operatively coupled to the control unit 106. The motors 108 can be configured such that rotary movement of the motors 108 can be controlled using the generated control signal. In an embodiment, the motors can include but not limited to a stepper motor, an induction motor, a servo motor and the like. In one embodiment, the generated control signal can effect selective rotation of the motor 108. In another embodiment, the generated control signal can selectively control direction of rotation of the motor 108.

[0060] It would be appreciated by persons skilled in the art that the control signal generated to control the rotary movement of the motors 108 can, inturn, control movement of the controlling pins of the joystick.

[0061] FIG. 2A illustrates an exemplary representation of implementation of device to control the joystick in accordance with an embodiment of the present disclosure.

[0062] In an exemplary implementation, as illustrated, the motors 210-1, 210-2

(collectively referred to as motors 210 herein and individually referred to as motor 210 herein) can be fitted with corresponding supporting members 202-1, 202-2 (collectively referred to as supporting members 202 herein and individually referred to as supporting member 202 herein). The supporting members 202 can have a U-shaped bend (as shown in FIG. 2B).A non-open end of the supporting member can have a hole to help fitment of the corresponding motor 210 with the supporting member 202. In one embodiment, the supporting members 202 can be coupled with a joystick 208. This joystick 208 can be any generic video game console or any other commercially available joystick controller for a RC Car, Drone, Robot or a Video game. Member 208 can come in similar yet shapes based on the purpose and choice of manufacturer. Our invention considers all shapes and size of such gaming consoles and works with all such variations available. In another embodiment, the supporting member can be placed adjacent to the joystick 208. In yet another embodiment, the supporting members 202 can be used for supporting the motors 210 to facilitate smoothly controlling the joystick without any vibrations as the supporting members 202 can be fixed to a surface, an object or the joystick 208.

[0063] Further, the device can include manipulator members 204-1, 204-2

(collectively referred to as manipulator members 204 herein and individually referred to as manipulator member 204 herein) configured with the motors 210 to facilitate controlling of controlling pins 206-1, 206-2 (collectively referred to as controlling pins 206 herein and individually referred to as controlling pin 206 herein) of the joystick 208. As shown in FIG. 2B, the manipulator member 204 can include a U-shaped cavity on one end and an orifice at the other end. The U-shaped cavity of the manipulator member 204 can facilitate fitment of the manipulator member 204 with the motor 210, and the orifice on the manipulator member 204 can facilitate fitment of the manipulator member 204 with the controlling pin 206 of the joystick 208 such that the rotary movement of the motor 210 can be translated in to controlling action of the controlling pins 206 of the joystick.

[0064] It would be appreciated by persons skilled in the art that, by controlling the movement of the controlling pins 208 of the joystick 208, various objects can be controlled that are operatively coupled to the joystick 208. Also, since the various gesture means can be used for controlling the movement of the joystick 208, hence the technique can be help physically disabled people to control or perform various jobs.

[0065] Although the proposed device has been elaborated as above to include all the main parts, it is possible that actual implementations may include only a part of the proposed modules/engines or a combination of those or a division of those in various combinations across multiple devices that can be operatively coupled with each other, including in the cloud. Further, the modules/engines can be configured in any sequence to achieve objectives elaborated. Also, it can be appreciated that proposed system can be configured in a computing device or across a plurality of computing devices operatively connected with each other, wherein the computing devices can be any of a computer, a laptop, a smart phone, an Internet enabled mobile device and the like. All such modifications and embodiments are completely within the scope of the present disclosure.

[0066] Thus, the invention allows to mount any joystick console (general Video game like controllers are called consoles on which multiple joysticks are mounted) on the controlling pin mechanism (a kinematic combination of linkages) to manoeuvre the joystick in response to the user gaze, gesture, voice etc and a combination of these input modalities. Embodiments of the present disclosure house different algorithms and methods of operation based on the type of joystick. For Digital joysticks a simple combination of manipulators can be employed to operate the joystick console in response to a live video game, toy car, drone or robot. The housing provided in the invention comes with adjustable positions of the support, motor and manipulator assembly to confer to joystick consoles of all shapes, sizes and kinds. For Analog Joysticks an orthogonal combination of manipulators in employed to obtain full 360 degree rotation and amplitude. The processor contains different algorithms based on different calibration profiles available. Once calibrated to the current joystick controller the invention selects the best approach for joystick control to get a seamless and responsive control of the game object, toy car(AGV), Drone, robot, etc connected to the joystick based on the user’s eye gaze, gesture , speech and the likes of input modality [0067] Embodiments of the present disclosure may be implemented entirely hardware, entirely software (including firmware, resident software, micro-code, etc.) or combining software and hardware implementation that may all generally be referred to herein as a “circuit,” “module,” “component,” or “system.” Furthermore, aspects of the present disclosure may take the form of a computer program product comprising one or more computer readable media having computer readable program code embodied thereon.

[0068] Thus, it will be appreciated by those of ordinary skill in the art that the diagrams, schematics, illustrations, and the like represent conceptual views or processes illustrating systems and methods embodying this invention. The functions of the various elements shown in the figures may be provided through the use of dedicated hardware as well as hardware capable of executing associated software. Similarly, any switches shown in the figures are conceptual only. Their function may be carried out through the operation of program logic, through dedicated logic, through the interaction of program control and dedicated logic, or even manually, the particular technique being selectable by the entity implementing this invention. Those of ordinary skill in the art further understand that the exemplary hardware, software, processes, methods, and/or operating systems described herein are for illustrative purposes and, thus, are not intended to be limited to any particular named.

[0069] As used herein, and unless the context dictates otherwise, the term "coupled to" is intended to include both direct coupling (in which two elements that are coupled to each other contact each other) and indirect coupling (in which at least one additional element is located between the two elements). Therefore, the terms "coupled to" and "coupled with" are used synonymously. Within the context of this document terms "coupled to" and "coupled with" are also used euphemistically to mean “communicatively coupled with” over a network, where two or more devices are able to exchange data with each other over the network, possibly via one or more intermediary device.

[0070] It should be apparent to those skilled in the art that many more modifications besides those already described are possible without departing from the inventive concepts herein. The inventive subject matter, therefore, is not to be restricted except in the spirit of the appended claims. Moreover, in interpreting both the specification and the claims, all terms should be interpreted in the broadest possible manner consistent with the context. In particular, the terms “comprises” and “comprising” should be interpreted as referring to elements, components, or steps in a non-exclusive manner, indicating that the referenced elements, components, or steps may be present, or utilized, or combined with other elements, components, or steps that are not expressly referenced. Where the specification claims refers to at least one of something selected from the group consisting of A, B, C .... and N, the text should be interpreted as requiring only one element from the group, not A plus N, or B plus N, etc.

[0071] While the foregoing describes various embodiments of the invention, other and further embodiments of the invention may be devised without departing from the basic scope thereof. The scope of the invention is determined by the claims that follow. The invention is not limited to the described embodiments, versions or examples, which are included to enable people having ordinary skill in the art to make and use the invention when combined with information and knowledge available to the person having ordinary skill in the art.

ADVANTAGES OF THE PRESENT DISCLOSURE

[0072] The present disclosure provides a system for controlling a joystick.

[0073] The present disclosure provides a system for controlling a joystick that can take various human gestures as input gestures for controlling the joystick operation.

[0074] The present disclosure provides a system for controlling a joystick that can help reduce effort in controlling the joystick.

[0075] The present disclosure provides a system for controlling a joystick that helps remediate wear and tear of the joystick due to excessive force exerted by a user.

[0076] The present disclosure provides a system that can empower person with disability for controlling a joystick to perform various tasks.

[0077] The present disclosure provides a system for controlling a joystick that is cost effective and easy to implement.

[0078] The present disclosure provides a system for controlling an analog as well as digital joystick.

Claims

We Claim:

1. A system for controlling a joystick, said system comprises: an input unit comprising a set of sensors, the set of sensors to sense input gestures and generate an input signal corresponding to the sensed input gestures; one or more rotary devices operatively coupled to one or more controlling pins of the joystick to move the corresponding controlling pins; and a control unit operatively coupled to the input unit and the one or more rotary devices, the control unit configured to: extract one or more attributes from the generated input signal; and generate a control signal by comparing the extracted one or more attributes with a dataset comprising a set of predefined attributes and corresponding control action, wherein the one or more rotary devices move the corresponding controlling pins in response to the generated control signals.

2. The system as claimed in claim 1, wherein the system comprises one or more manipulator members configured with the one or more rotary devices such that each of the one or more manipulator members is having a cavity to enable fitment of the one or more manipulator members with the corresponding controlling pins of the joystick.

3. The system as claimed in claim 2, wherein each of the one or more manipulator members comprising an orifice to enable fitment of the one or more rotary devices with the one or more manipulator members.

4. The system a claimed in claim 2, wherein the cavity of the one or more manipulator member is U-shaped.

5. The system as claimed in claim 1, wherein the system comprising one or more support members for supporting the one or more rotary devices.

6. The system as claimed in claim 5, wherein the one or more supporting members having a hole to enable fitment of the one or more rotary members with the one or more supporting members.

7. The system as claimed in claim 1, wherein the one or more rotary devices is selected from a group comprising of any of a servo motor, a stepper motor, an AC motor, a DC motor, and an actuator.

8. The system as claimed in claim 1, wherein the set of sensors comprises a gesture recognition sensor, an eye gaze sensor, an EEG sensor and a microphone.

9. The system as claimed in claim 1, wherein the input gesture comprises a hand gesture, an eye gaze gesture and control input gesture.

10. The system as claimed in claim 1, wherein the input gestures are depicted by a user.