WO2007013063A2 - Multidimensional multifunctional computer interface device - Google Patents
Multidimensional multifunctional computer interface device Download PDFInfo
- Publication number
- WO2007013063A2 WO2007013063A2 PCT/IL2006/000854 IL2006000854W WO2007013063A2 WO 2007013063 A2 WO2007013063 A2 WO 2007013063A2 IL 2006000854 W IL2006000854 W IL 2006000854W WO 2007013063 A2 WO2007013063 A2 WO 2007013063A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- sensors
- environment according
- interactive environment
- sads
- sad
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/033—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor
- G06F3/0346—Pointing devices displaced or positioned by the user, e.g. mice, trackballs, pens or joysticks; Accessories therefor with detection of the device orientation or free movement in a 3D space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/01—Input arrangements or combined input and output arrangements for interaction between user and computer
- G06F3/03—Arrangements for converting the position or the displacement of a member into a coded form
- G06F3/041—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means
- G06F3/046—Digitisers, e.g. for touch screens or touch pads, characterised by the transducing means by electromagnetic means
Definitions
- the invention generally relates to a multidimensional & multifunctional computer interface device and to a method utilizing the same. More specifically, the present invention relates to a spatial computer interface, allowing the functional and spatial allocation of different sensor activation devices (SADs) relative to a spatial array of sensors, providing output according to sensor activation devices location, size, shape, movement detection and determined functionality.
- SADs sensor activation devices
- keyboards and computer mouse Conventional computer interface utilizes keyboards and computer mouse. These commercially available input devices are limited in that keyboard input is used one keystroke at a time; activity is provided solely by a singular user at any given time; no interaction is provided with day to day objects; in the large number of keys existing on the keyboard, which is inflexible, and cannot be reduced if need is limited, nor can extra keys be added if required; no flexibility exists in designing key location and shape at a given time; no flexibility is provided in the selection of key activation method; each key has a unique predetermined function of sending the letter/ character allocated to it in advance; mouse is characterized solely by a specific shape providing a single simultaneous pointing device etc.
- available technology in this field is characterized by a single user- computer interface, provided by pointing and typing commands, activating programs running on the computer.
- the role of the screen in the interaction is predominant and physical proximity of the user is required.
- figure 1 presents a schematic flowchart defining a method of applying the computerized interface according to one specific embodiment of the present invention
- figure 2 presents a perspective view of a computerized interface according to yet another embodiment of the present invention
- figure 3 presents a lateral cross-section of a computerized interface according to yet another embodiment of the present invention
- figure 4 presents an electronic schematic view of sensors array according to yet another embodiment of the present invention
- figure 5 presents a plurality of passive, not actuated or fixed SADs according to yet another embodiment of the present invention
- figure 6 presents a plurality of active, actuated or maneuverable SADs according to yet another embodiment of the present invention.
- SIE spatial interactive environment
- SADs Sensor Activation Devices
- said system comprising at least one affecting, manipulatable or maneuverable SAD which is assigned and/or interacts with a plurality of sensors in a multidimensional environment; wherein the functionality assigned to said SAD and/or sensor is set either prior to or after positioning the SAD; said functionality of the same can further be determined either by its location, interaction, encoding characteristics and by the application running on said computer or any combination thereof.
- the SIE may comprise means selected from computing means, communicating means and output transmitting means or any combination thereof; preferably wherein said means are provided manually, especially by being activated by a user, or operated automatically in a predetermined protocol. Moreover, it may be adapted to communicate with one or more computers, SADs, sensors, external or remote output devices or any combination thereof. The SIE may be further adapted to transmit information to one or more remote and/or adjacent targets; said targets are selected from video, audio, mechanical or electrical means or any combination thereof.
- the SIE is optionally adapted to provide simultaneous operation of multiple SADs. It may comprise at least one array of SADs; optionally, at least a portion of the SADs is of 2D or 3D orientation.
- the SIE may comprise at least one array of sensors. Possibly, at least a portion of the sensors is of 2D or 3D orientation. At least a portion of the aforesaid sensors is selected in a non-limiting manner from magnetic sensors, proximity sensors, electromagnetic coupling, touch sensors, heat sensors, light sensors, acceleration sensors, velocity sensors, audio sensors, directional sensors, pressure sensors or the like.
- the number and location of the sensors and/or SADs are possibly varied, interchangeable and user configurable.
- each SAD and/or each of sensors' arrays may spatially be determined by the sensors it activates.
- the sensors are possibly activated by proximity, especially magnet, electromagnetic coupling, or paramagnet proximity switches.
- the sensors are possibly activated or operated by one or more sensing techniques, as a function of the sensors' type, 2D or 3D configuration and number; wherein each sensor or each sensors array is spatially designed for the activation of multiple sensors, thus allowing recognition of the spatial structure of the sensor or SAD.
- SADs are possibly coded using RFID or different resonance frequencies in electromagnetic coupling to allow distinguishing different SADs. At least a portion of the SADs may comprise output capabilities.
- the computing means are possibly adapted for analyzing the 2D or 3D location or change in location and direction of at least a portion of the SADs.
- a plurality of SADs is possibly adapted to activate multiple sensors for simultaneously supporting multiple inputs in parallel.
- the SIE may be further characterized by multiple data input provided simultaneously by more than a single user. It may comprise connecting sensor surfaces for achieving larger area of sensors. Alternatively or additionally, it may comprise curved surfaced sensors, such that tunnels, round surfaces and other non-flat surfaces with sensors are provided.
- the SIE may comprise a top layer. This layer is at least partially comprised of either organic or inorganic fabric, polymeric texture or the like, adapted to accept scotch, or any other adhering material, for affixing SADs thereon.
- the SADs are preferably yet not exclusively selected from every day objects, infant's games or toddler's games.
- the games are hence adapted to (z) be played in any fashion, while (H) providing an input to the computer program, via the sensor platform, identifying a 2D or 3D configuration of the object or game, and providing the system a relevant feedback.
- the SADs may have a VelcroTM or any other adhering means adapted to affix the same to a surface.
- SIE may comprise at least one SAD which is adapted to be maneuvered or actuated in or on an intercommunicated interface; said interface has either two or three dimensions. At least a portion of the SADs may be adapted to maneuver, actuate or to move on the surface to emulate mouse movement. At least a portion of the SADs may be adapted to maneuver, actuate or to move on the surface to emulate movement of multiple objects simultaneously.
- At least one non-fixed SAD is interconnected with at least one sensor.
- the SAD may comprise at least one control button.
- the software within the computer is adapted to detect more than a single SAD from within the object, thus allowing activation related to the object, especially by pressing a button allocated to the object.
- the application of the controller within the device is possibly set to define the active area to be used by the user, especially wherein the active area is limited on the sensor area, so that only parts of it accept detection of movement.
- the application of the controller within the system is possibly set for the definition of an active area on the computer screen to be used by the user, so that the activity with the objects will not cross the border of the predefined area.
- SIE may interact with SADs including at least one magnet, resonator or paramagiiet utilized for detecting movement.
- the SAD is located adjacent to at least one sensor adapted to sense said magnetism emitted by said SAD.
- SIE may be connected to at least one keyboard or USB port or any other computer communication port for parallel input from the keyboard and the device. It may comprise a programming mode. This programming mode is utilized for correlating the sequence of keys pressed with the corresponding sensors activated, such that when the system is in its active mode, activation of a specific sensor causes the system to emulate sending the predefined keys sequence to the computer.
- SIE may comprise a learning mode, wherein sensor activation in location (xl, yl) of the sensing surface is assigned to emulate a mouse button press/ release/hold in location (x2, y2) on the screen.
- ( ⁇ 2, y2) coordinates is similar to (xl, yl) coordinates.
- (x2, y2) coordinates is different from (xl, yl) coordinates, thus allowing different allocation of SADs to represent mouse button pressing emulation on the display.
- SIE may comprise at least one surface with dedicated backgrounds for dedicated games. This background is preferably attached by scotch, or any other adhering material, as an option to provide the surface background for the activity.
- the surface comprises a display, such as LCD, on which SADs are located and further wherein said display comprises electromagnetic coupling sensing capabilities, adapted to detect the location and allocation of resonators above the display.
- the sensors and SADs technology are possibly adapted to detect SAD's height above the surface and orientation, especially by using technology selected in a non-limiting manner from electromagnetic coupling with resonators, metallic magnetic conductance or a combination thereof.
- SIE may be interconnected to output means, selected in a non-limiting manner from television, PDA, mobile phone, or any entertainment/computerized devices.
- Another object of the present invention is to disclose a method of obtaining a spatial interactive environment.
- This environment is adapted to project, complete, or replace the 2D virtual computerized display of a computer and interactions thereof with real objects, namely SADs.
- the system comprises at least one affecting, manipulatable or maneuverable SAD which is assigned and/or interacts with a plurality of sensors in a multidimensional environment; wherein the functionality assigned to the SAD and/or sensor is set either prior to or after positioning the SAD.
- This functionality of the same can further be determined either by its location, interaction, encoding characteristics or by the application running on said computer or any combination thereof.
- the method comprises inter alia steps of (a) selecting desired application; (b) placing at least one SADs, and/or selecting at least one appropriate SADs; (c) assigning a SAD-sensor functionality; and, (d) activating the same.
- Ii is in the scope of the present invention wherein a method of obtaining a spatial interactive environment is provided.
- This environment is adapted to project, complete, or replace the 2D virtual computerized display of a computer and interactions thereof with real objects namely SADs.
- the system comprises at least one affecting, manipulatable or maneuverable SAD which is assigned and/or interacts with a plurality of sensors in a multidimensional environment; wherein the functionality assigned to the SAD and/or sensor is set either prior to or after positioning the SAD.
- the functionality of the same can further be determined either by its location, interaction, encoding characteristics or by the application running on the computer or any combination thereof as defined and described above.
- the invention pioneers a breakthrough approach, which rather than using virtual objects and artificial and non-natural objects as interface to a computer, provides real- world, tangible day to day items to be used as input devices for the computer to analyze and respond to.
- Another breakthrough approach of the invention is the parallel and multiple simultaneous inputs for interacting with the computer.
- serial input i.e. one keystroke at a time from a keyboard, or a single mouse cursor on screen
- multiple items are present, some with fixed identity and location, others with mobility, of which all can coexist at the same time as possible inputs to the computer.
- Using this approach for example, in the case of children playing a game, instead of only one user playing while the others watch the child play, would allow many children to play and interact, each with a real object to play with.
- a subset of the invention is the ability to provide dedicated 'keyboard' emulation and mouse emulations, which are the specific case of using the keyboard and mouse as the objects to be used.
- any day-to-day object can be used as the mouse, while any 'pressable' or otherwise mechanically movable object can be used as a key of the keyboard.
- the number of required objects to be used as well as their functionality can be set according to the needs (i.e. number of keys if not all keyboard keys are required for the application in use)
- Activation of an object can respond, in the simplest case to the sending of an ASCII character- which totally emulates the response followed by a key press on a computer keyboard, but can also be defined as a sequence of inputs, such as string of ASCII characters.
- the interface may comprise at least one array of sensors, which can be activated by SADs.
- sensors also refers to transmitters, receivers, touch screen, RFID means in SADs etc.
- the sensors are arranged on a flat surface in matrix format, preferably similar to a mat with a fabric cover on top, which can be folded when not in use.
- one of the preferred embodiments for the sensors would be sensors activated by sensing proximity of magnets, thus metallic switches would be activated and close a circuit whenever a magnet is in their vicinity.
- the resolution of the system is varied, wherein high resolution is achieved by utilizing flat screen techniques and related field.
- Magnetic proximity mechanism is preferred so as to allow real-life objects to be used as SADs, by simply attaching magnets into them, followed by simply locating the SADs on the surface, without having to directly constitute a mechanical/ electrical path between the SADs and the device.
- This embodiment may also include sensors of linear behavior, rather than just a switching on/off concept, to allow SADs of linear information such as pressure, proximity, weight, light level, sound level etc.
- SADs can be provided, starting with drum-like keys, which when hit or pressed provide the proximity of an embedded magnet within the SAD.
- the type of SADs may vary in many ways, including providing sockets within the dome of the drums, in which drawings can be inserted to match the implication of hitting or pressing the SAD, or the possibility of providing feedback directly from the SAD when pressed, squeezed, hit, rolled etc. Different SADs for different application may be used.
- SADs A more complicated variant of SADs is encoded SADs. This type of SADs is required whenever a detection of a specific object is required, amongst other objects on the device's surface, which may be present simultaneously, and whose location on device's surface may change during usage.
- SADs encoding is also mandatory for detection of SAD's orientation in space.
- SAD has the shape of a car and we wish to know in which direction it is heading, at least 3 magnets forming a triangle/ arrow would be needed to indicate the direction it is pointing to.
- SADs providing linear output to correspond to linear input sensors of the device.
- Simple linear SADs would again include a magnet, but this time, the linear level of proximity is detected.
- Other configurations could include other linear outputs as described for the linear sensors.
- the invention is also applicable in various music applications.
- different musical instruments may be implemented, those instruments are selected in a non limiting manner for a group including inter alia piano and other keyboard instruments, drums and other percussion instruments, string instruments such as guitars and violins, wind instruments such as flutes and trumpets.
- each key pressed activates a sensor, so as the computer produces the corresponding sound.
- polyphonic sounds can be achieved by pressing multiple keys on the keyboard.
- Drums can be located, where the hitting sticks include the magnets or resonance circuit, thus with each drum hit, the computer produces different related drum sound.
- Xylophone and other instruments can be implemented allowing multiple users play multiple instruments, with the computer producing the sounds relating to the instruments according to the relevant activated sensing location on the matrix.
- the computer application can further include tutoring for teaching the user how to play the instruments.
- the invention is also applicable for either 2D or 3D puzzles and related applications.
- Puzzles preferably yet not exclusively referred hereinafter to any game or educational theme composed of differently shaped of otherwise signed pieces which fit together to form a picture or a predetermined meaning.
- SADs e.g., shapes, numbers, letters, images
- the computer detects which shape is inserted and produce a relevant vocal feedback, such as stating the shape inserted, if inserted in the right place, produce the sound of the animal in case of animals puzzle, pronounce letters and letters sequences as in text to speech etc.
- contactless inductive position sensing where or when windings of electrically excited metal wires, transmit or emit an electromagnetic signal, while a resonator circuit, typically a coil and capacitor, comprise the SAD.
- This technology implemented in existing digitizing tablets used for stylus interface to computers, allow 2D or 3D (i.e., X,Y and possibly Z dimension) detection of the SADs above the surface, as well as detection of tilt and orientation, with a high location resolution, as well as supporting discrimination between multiple SADs, by implementing different resonance frequency to each SAD.
- This technology is found to be cost effective and allows production of large sensing surfaces, as well as the ability of integrating with a projection screen, as the metal windings are placed behind the image projection elements, such as LCD screens.
- FIG 1 presenting a flow chart of a method of applying a spatial computer interface with at least one array of 2D or 3D coordinated SADs.
- This method comprises inter alia the steps of selecting SAD's, e.g., mouse, joystick, an X- shaped pointer, wherein the cross is provided by 5 or more adjacent SADs; predefining function; defying function; locating SAD's; selecting SAD's activation and then SAD's activating SAD's.
- figure 2 a perspective upper view
- figure 3 a lateral cross section
- the interface is connected either by wire or wireless communication means to a computer (3), via the keyboard input of the computer, and possibly to a mouse input or an USB port or other alternative while preferably the keyboard (4) is connected to the device.
- interface (1) is covered by fabric (21), which is potentially adhered or sewed (22) affixed with scotch tape (23) different fabric coatings (2) with preset drawings on them to be ready for specific applications and activities such as car racing, bowling, checkers, backgammon, etc.
- SADs are either fixed (7) to the device by scotch or are maneuverable or actuated (8) and for example have either a fixed magnet for continuous activation of sensors, or active mechanical part to achieve proximity of magnet to sensor for activation by the user, e.g., car blowing the horn, dog-barking etc.
- other SADs potentially comprise one or more magnets adapted for decoding of object types, differentiating objects belonging to different users, i.e. black from white in case of checkers) and orientation of SADs, for example when playing air dog-fight with two participants.
- FIG 4 illustrating a matrix of sensors (24). These sensors, preferably yet not exclusively made of metal ware or any other conductive materials, are activated by magnet proximity which is located below the fabric (21) and is presented electrically in Figure 4.
- the matrix has X axis and Y axis (35a, 35b... 35n for X-axis and 36a, 36b... 36m for Y-axis), whereat the intersection point the sensors (24) are located (24m, 24n for all intersection points).
- the matrix is controlled by a controller (34), who repeatedly scans the X (35) and Y axis (36) lines for changes in state of the sensors (24) of the matrix. It is acknowledged in this respect that the controller can either be embedded within the system or use the processing power of an external computer/network that it is connected to.
- the sensors states are analyzed by the controller (34) or sent to the PC for analysis and according to the relevant action to take, it communicates instructions to and from the computer it connects to, via the communication link (32).
- the present invention hence provides a mode switch (38) which selects the operation mode to be either the learning mode or the working mode.
- the previously mentioned interface comprises a learning mode
- the controller (34) is adapted to search for an active sensor. Key strokes on the connected keyboard (39) during detection of an active sensor, are programmed to the active sensor, so that whenever that sensor is active, when the operation mode selected using switch (38) is the working mode, the sequence of keystrokes presented during learning mode to that sensor will be transmitted to the host computer via the communication link to the computer (32).
- Another feature proposed in learning mode relates to mouse activity simulation.
- movement of the mouse to the corners of the active area and locating the SAD to be used as mouse with the device would define the working area and boundaries for the activity of the mouse (e.g., achieved by pressing the button of the SADs button).
- An encoded SAD comprises at least one magnet and is identified by the coordinated movement of all magnets enclosed in it.
- said interface comprises a working mode.
- working mode at least a portion of the keyboard activities and mouse activities are directly transmitted to the host computer, so that it is possible to work with the standard keyboard and mouse without having to disconnect the keyboard and mouse from the device.
- SADs are defined as fixed, when a press will initiate the submission of the character or string of characters/instructions, as defined when in a program mode. Activity in areas that are not defined for fixed SADs will submit location information, and thus emulate object movement and specifically - mouse movement.
- FIG. 5 presenting various fixed SADs, some of the SADs are similar to commercially available toys, wherein item (41) presents a simple drum/ key that is adapted for activating at least one sensor by moving the magnet towards the sensors surface.
- Scales (42) are adapted to indicate which side is heavier when a magnet is attached to the bottom side of the scales, Velocity and counter are utilized to indicate how many times the wheel has been turned, which can be achieved by fixing a single magnet to the carousel (43).
- Encoding each block (44) can differentiate the blocks and allow checking correct allocation of items.
- Yet another example of encoded signs when implementing a driving lesson application is presented with the stop sign (45). Additionally or alternatively, encoded plates having numbers (46) are disclosed.
- mobile SADs comprising single magnet and/or multiple magnets for encoding and orientation identification.
- item (51) presents a simple embodiment of the same, namely a ball or the like, comprising magnetic or paramagnetic materials, adapted to be maneuvered and/or actuated along the surface of the device while inline, online or offline, indicating its location in either 2D or 3D coordinated space.
- Item (52) presents mobile objects being differentiated, such as items of games e.g., backgammon, chess, etc.
- Item (53) is an equivalent of a computer mouse or any other decoded object which is adapted to provide 2D or 3D orientated information, as well as provide activation trigger.
- Magnet (53 a) presents the front side of the object while (53b) and (53c) present the rear side view of the object, while (53d) is a dome of a button which, when pressed, moves a hidden internal magnet indicating activation.
- Other fixed SADs are further possible, wherein it acknowledged in this respect that fixed objects can also be utilized as mobile objects and vice versa.
- the present invention provides a novel and cost effective means for utilizing various 2D or 3D computer-enabled games.
- the user is instructed to utilize a plurality of either maneuverable or fixed (immobilized) at least one SAD of any shape or size, position the same on or in the surface or space of the device, while assigning at least a portions of the SADs with a corresponding key function.
- One example is using games from any source, wherein the games require activation by mouse.
- the 2D area or 3D space of the device whereat the mouse is maneuvered is set and preferably screened.
- the user does not leave the specified boundaries of the game.
- the user utilizes the SAD or SADs as a cordless mouse It is in the scope of this example wherein at least one mouse button is comprised in the said mouse.
- the location of the button is potentially detected by at least one sensor within a predetermined distance from the mouse or by different resonance frequency.
- Another example is using various games, which require activation by both mouse and keyboard keys.
- the mouse active areas are set and relevant SADs assigned.
- a playing vehicle e.g., a tank
- SAD direction of the SAD
- possibly large SADs as blocking areas. Accordingly, each player has to shoot the other player's tank.
- the software analyses if the route from one tank to the other is clear (not interrupted by SADs).
- a plurality of players is instructed to shoot one or more escaping objects, e.g., a hunters and bear game, etc.
- the maze can be flat (e.g., a 2D item) or comprise walls (e.g., a 3D environment).
- the player goes from entry to the exit with the SAD. Cheatings are detected by computer, which can provide the user with hints.
- the game is additionally designed to display traces on a screen, such as paths that were already tried.
- a radio controlled vehicle may hence be provided as the maneuverable SAD and move controllably within said maze.
- Another example is playing checkers, chess, backgammon, cards etc.
- a mat comprising a printed game surface is hence provided.
- Each of the player's parts is encoded differently by magnets or paramagnets.
- the first player is characterized by having one magnet per each token
- the second player is characterized by having two magnets per token or two different resonance frequencies in case of electromagnetic coupling and so on and so forth.
- a mouse pad with dedicated SADs is hereto provided for specific activities, selected in a non-limiting manner from open outlook, check list for every day activities, professional to-do list etc.
- the device provides a plurality of 2D or 3D allowed paths, signs such as no entrance, stop etc. Signs are decoded and recognized. If a vehicle drives against a predetermined rule, appropriate feedback is provided by the computer software.
- Another example is flight-simulator controls — where instead of complex keyboard combinations, different SADs emulate the cockpit controls as in the real environment.
Landscapes
- Engineering & Computer Science (AREA)
- General Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- Human Computer Interaction (AREA)
- General Physics & Mathematics (AREA)
- Electromagnetism (AREA)
- Position Input By Displaying (AREA)
- Facsimiles In General (AREA)
- User Interface Of Digital Computer (AREA)
Abstract
The present invention discloses a system for obtaining a Spatial Interactive Environment, adapted to project, complete, or replace 2D virtual computerized input devices and display of a computer and interactions thereof with real objects, namely Sensor Activation Devices (SADs), said system comprising at least one affecting, manipulatable or maneuverable SAD which is assigned and/or interacts with a plurality of sensors in a multidimensional environment; wherein the functionality assigned to said SAD and/or sensor is set either prior to or after positioning the SAD; said functionality of the same can further be determined either by its location, interaction, encoding characteristics and by the application running on said computer or any combination thereof.
Description
MULTIDIMENSIONAL MULTIFUNCTIONAL COMPUTER INTERFACE DEVICE
FIELD OF THE INVENTION
The invention generally relates to a multidimensional & multifunctional computer interface device and to a method utilizing the same. More specifically, the present invention relates to a spatial computer interface, allowing the functional and spatial allocation of different sensor activation devices (SADs) relative to a spatial array of sensors, providing output according to sensor activation devices location, size, shape, movement detection and determined functionality.
BACKGROUND OF THE INVENTION
Conventional computer interface utilizes keyboards and computer mouse. These commercially available input devices are limited in that keyboard input is used one keystroke at a time; activity is provided solely by a singular user at any given time; no interaction is provided with day to day objects; in the large number of keys existing on the keyboard, which is inflexible, and cannot be reduced if need is limited, nor can extra keys be added if required; no flexibility exists in designing key location and shape at a given time; no flexibility is provided in the selection of key activation method; each key has a unique predetermined function of sending the letter/ character allocated to it in advance; mouse is characterized solely by a specific shape providing a single simultaneous pointing device etc.
Although new computerized techniques were suggested in the art and several advanced interfaces are now available, e.g., computer tablets, keyboards and mice especially adapted for toddler's use, touch-screens etc., these innovations merely embody the long felt need for two incorporable approaches, i.e. a pointing device and ASCII letters input device. Hence, an advanced commercially available technology traded as IntelliKeys™ presents a computer tablet with a plurality of overlays.
Moreover, available technology in this field is characterized by a single user- computer interface, provided by pointing and typing commands, activating programs
running on the computer. The role of the screen in the interaction is predominant and physical proximity of the user is required.
BRIEF DESCRIPTION OF THE FIGURES
In order to understand the invention and to see how it may be implemented in practice, a preferred embodiment will now be described, by way of non-limiting example only, with reference to the accompanying drawing, in which figure 1 presents a schematic flowchart defining a method of applying the computerized interface according to one specific embodiment of the present invention; figure 2 presents a perspective view of a computerized interface according to yet another embodiment of the present invention; figure 3 presents a lateral cross-section of a computerized interface according to yet another embodiment of the present invention; figure 4 presents an electronic schematic view of sensors array according to yet another embodiment of the present invention; figure 5 presents a plurality of passive, not actuated or fixed SADs according to yet another embodiment of the present invention; and, figure 6 presents a plurality of active, actuated or maneuverable SADs according to yet another embodiment of the present invention.
SUMMARY OF THE INVENTION
It is thus one object of the present invention to disclose a system for obtaining a spatial interactive environment (SIE), adapted to project, complete, or replace 2D virtual computerized input devices and display of a computer and interactions thereof with real objects, namely Sensor Activation Devices (SADs), said system comprising at least one affecting, manipulatable or maneuverable SAD which is assigned and/or interacts with a plurality of sensors in a multidimensional environment; wherein the functionality assigned to said SAD and/or sensor is set either prior to or after positioning the SAD; said functionality of the same can further be determined either
by its location, interaction, encoding characteristics and by the application running on said computer or any combination thereof.
The SIE may comprise means selected from computing means, communicating means and output transmitting means or any combination thereof; preferably wherein said means are provided manually, especially by being activated by a user, or operated automatically in a predetermined protocol. Moreover, it may be adapted to communicate with one or more computers, SADs, sensors, external or remote output devices or any combination thereof. The SIE may be further adapted to transmit information to one or more remote and/or adjacent targets; said targets are selected from video, audio, mechanical or electrical means or any combination thereof.
It is in the scope of the present invention wherein the SIE is optionally adapted to provide simultaneous operation of multiple SADs. It may comprise at least one array of SADs; optionally, at least a portion of the SADs is of 2D or 3D orientation. The SIE may comprise at least one array of sensors. Possibly, at least a portion of the sensors is of 2D or 3D orientation. At least a portion of the aforesaid sensors is selected in a non-limiting manner from magnetic sensors, proximity sensors, electromagnetic coupling, touch sensors, heat sensors, light sensors, acceleration sensors, velocity sensors, audio sensors, directional sensors, pressure sensors or the like. The number and location of the sensors and/or SADs are possibly varied, interchangeable and user configurable. The functionality of each SAD and/or each of sensors' arrays may spatially be determined by the sensors it activates. The sensors are possibly activated by proximity, especially magnet, electromagnetic coupling, or paramagnet proximity switches. Moreover, the sensors are possibly activated or operated by one or more sensing techniques, as a function of the sensors' type, 2D or 3D configuration and number; wherein each sensor or each sensors array is spatially designed for the activation of multiple sensors, thus allowing recognition of the spatial structure of the sensor or SAD. Alternatively or additionally, SADs are possibly coded using RFID or different resonance frequencies in electromagnetic coupling to allow distinguishing different SADs. At least a portion of the SADs may comprise output capabilities. The computing means are possibly adapted for analyzing the 2D or 3D location or change in location and direction of at least a portion of the SADs. A plurality of SADs is possibly adapted to activate multiple sensors for simultaneously supporting multiple inputs in parallel. The SIE may be
further characterized by multiple data input provided simultaneously by more than a single user. It may comprise connecting sensor surfaces for achieving larger area of sensors. Alternatively or additionally, it may comprise curved surfaced sensors, such that tunnels, round surfaces and other non-flat surfaces with sensors are provided. The SIE may comprise a top layer. This layer is at least partially comprised of either organic or inorganic fabric, polymeric texture or the like, adapted to accept scotch, or any other adhering material, for affixing SADs thereon. The SADs are preferably yet not exclusively selected from every day objects, infant's games or toddler's games. The games are hence adapted to (z) be played in any fashion, while (H) providing an input to the computer program, via the sensor platform, identifying a 2D or 3D configuration of the object or game, and providing the system a relevant feedback. The SADs may have a Velcro™ or any other adhering means adapted to affix the same to a surface. SIE may comprise at least one SAD which is adapted to be maneuvered or actuated in or on an intercommunicated interface; said interface has either two or three dimensions. At least a portion of the SADs may be adapted to maneuver, actuate or to move on the surface to emulate mouse movement. At least a portion of the SADs may be adapted to maneuver, actuate or to move on the surface to emulate movement of multiple objects simultaneously.
It is also in the scope of the present invention wherein at least one non-fixed SAD is interconnected with at least one sensor. The SAD may comprise at least one control button. The software within the computer is adapted to detect more than a single SAD from within the object, thus allowing activation related to the object, especially by pressing a button allocated to the object. The application of the controller within the device is possibly set to define the active area to be used by the user, especially wherein the active area is limited on the sensor area, so that only parts of it accept detection of movement. The application of the controller within the system is possibly set for the definition of an active area on the computer screen to be used by the user, so that the activity with the objects will not cross the border of the predefined area. SIE may interact with SADs including at least one magnet, resonator or paramagiiet utilized for detecting movement. The SAD is located adjacent to at least one sensor adapted to sense said magnetism emitted by said SAD. SIE may be connected to at least one keyboard or USB port or any other computer communication port for parallel input from the keyboard and the device. It may comprise a programming
mode. This programming mode is utilized for correlating the sequence of keys pressed with the corresponding sensors activated, such that when the system is in its active mode, activation of a specific sensor causes the system to emulate sending the predefined keys sequence to the computer. Additionally or alternatively, SIE may comprise a learning mode, wherein sensor activation in location (xl, yl) of the sensing surface is assigned to emulate a mouse button press/ release/hold in location (x2, y2) on the screen. Alternatively, (χ2, y2) coordinates is similar to (xl, yl) coordinates. Alternatively, (x2, y2) coordinates is different from (xl, yl) coordinates, thus allowing different allocation of SADs to represent mouse button pressing emulation on the display. SIE may comprise at least one surface with dedicated backgrounds for dedicated games. This background is preferably attached by scotch, or any other adhering material, as an option to provide the surface background for the activity. The surface comprises a display, such as LCD, on which SADs are located and further wherein said display comprises electromagnetic coupling sensing capabilities, adapted to detect the location and allocation of resonators above the display. The sensors and SADs technology are possibly adapted to detect SAD's height above the surface and orientation, especially by using technology selected in a non-limiting manner from electromagnetic coupling with resonators, metallic magnetic conductance or a combination thereof. SIE may be interconnected to output means, selected in a non-limiting manner from television, PDA, mobile phone, or any entertainment/computerized devices.
Another object of the present invention is to disclose a method of obtaining a spatial interactive environment. This environment is adapted to project, complete, or replace the 2D virtual computerized display of a computer and interactions thereof with real objects, namely SADs. The system comprises at least one affecting, manipulatable or maneuverable SAD which is assigned and/or interacts with a plurality of sensors in a multidimensional environment; wherein the functionality assigned to the SAD and/or sensor is set either prior to or after positioning the SAD. This functionality of the same can further be determined either by its location, interaction, encoding characteristics or by the application running on said computer or any combination thereof. The method comprises inter alia steps of (a) selecting desired application; (b) placing at least one SADs, and/or selecting at least one appropriate SADs; (c) assigning a SAD-sensor functionality; and, (d) activating the same.
Ii is in the scope of the present invention wherein a method of obtaining a spatial interactive environment is provided. This environment is adapted to project, complete, or replace the 2D virtual computerized display of a computer and interactions thereof with real objects namely SADs. The system comprises at least one affecting, manipulatable or maneuverable SAD which is assigned and/or interacts with a plurality of sensors in a multidimensional environment; wherein the functionality assigned to the SAD and/or sensor is set either prior to or after positioning the SAD. The functionality of the same can further be determined either by its location, interaction, encoding characteristics or by the application running on the computer or any combination thereof as defined and described above.
DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS
The following description is provided, alongside all chapters of the present invention, so as to enable any person skilled in the art to make use of said invention and sets forth the best modes contemplated by the inventor of carrying out this invention. Various modifications, however, will remain apparent to those skilled in the art, since the generic principles of the present invention have been defined specifically to provide a spatial interactive environment, adapted to project, complete, or replace the 2D virtual computerized display of a computer and interactions thereof with real objects (e.g., SADs), said system comprising at least one affecting, manipulatable or maneuverable SAD which is assigned and/or interact with a plurality of sensors in a multidimensional environment and to provide a method utilizing the same.
The invention pioneers a breakthrough approach, which rather than using virtual objects and artificial and non-natural objects as interface to a computer, provides real- world, tangible day to day items to be used as input devices for the computer to analyze and respond to.
This opens a broad and new approach, with different possible application according to different needs.
Another breakthrough approach of the invention is the parallel and multiple simultaneous inputs for interacting with the computer. Instead of the philosophy of serial input (i.e. one keystroke at a time from a keyboard, or a single mouse cursor on screen), according to the invention, multiple items are present, some with fixed
identity and location, others with mobility, of which all can coexist at the same time as possible inputs to the computer. Using this approach, for example, in the case of children playing a game, instead of only one user playing while the others watch the child play, would allow many children to play and interact, each with a real object to play with.
A subset of the invention is the ability to provide dedicated 'keyboard' emulation and mouse emulations, which are the specific case of using the keyboard and mouse as the objects to be used. However, within the scope of the invention, any day-to-day object can be used as the mouse, while any 'pressable' or otherwise mechanically movable object can be used as a key of the keyboard.
Additionally, besides defining different objects as keys and mouse, the number of required objects to be used as well as their functionality, can be set according to the needs (i.e. number of keys if not all keyboard keys are required for the application in use)
Yet another subset of the above can be the ability to defining more complex responses or functionality for object activation. Activation of an object can respond, in the simplest case to the sending of an ASCII character- which totally emulates the response followed by a key press on a computer keyboard, but can also be defined as a sequence of inputs, such as string of ASCII characters.
The interface may comprise at least one array of sensors, which can be activated by SADs. The term 'sensors' also refers to transmitters, receivers, touch screen, RFID means in SADs etc.
In one of the preferred embodiments, the sensors are arranged on a flat surface in matrix format, preferably similar to a mat with a fabric cover on top, which can be folded when not in use. In this embodiment, one of the preferred embodiments for the sensors, would be sensors activated by sensing proximity of magnets, thus metallic switches would be activated and close a circuit whenever a magnet is in their vicinity.
The resolution of the system is varied, wherein high resolution is achieved by utilizing flat screen techniques and related field.
Magnetic proximity mechanism is preferred so as to allow real-life objects to be used as SADs, by simply attaching magnets into them, followed by simply locating the
SADs on the surface, without having to directly constitute a mechanical/ electrical path between the SADs and the device.
This embodiment may also include sensors of linear behavior, rather than just a switching on/off concept, to allow SADs of linear information such as pressure, proximity, weight, light level, sound level etc.
Different types of the SADs can be provided, starting with drum-like keys, which when hit or pressed provide the proximity of an embedded magnet within the SAD. The type of SADs may vary in many ways, including providing sockets within the dome of the drums, in which drawings can be inserted to match the implication of hitting or pressing the SAD, or the possibility of providing feedback directly from the SAD when pressed, squeezed, hit, rolled etc. Different SADs for different application may be used.
A more complicated variant of SADs is encoded SADs. This type of SADs is required whenever a detection of a specific object is required, amongst other objects on the device's surface, which may be present simultaneously, and whose location on device's surface may change during usage.
SADs encoding is also mandatory for detection of SAD's orientation in space. Thus, for example, when the SAD has the shape of a car and we wish to know in which direction it is heading, at least 3 magnets forming a triangle/ arrow would be needed to indicate the direction it is pointing to.
Other variants of SADs are also possible, such as SADs providing linear output to correspond to linear input sensors of the device. Simple linear SADs would again include a magnet, but this time, the linear level of proximity is detected. Other configurations could include other linear outputs as described for the linear sensors.
The invention is also applicable in various music applications. Hence for example, different musical instruments may be implemented, those instruments are selected in a non limiting manner for a group including inter alia piano and other keyboard instruments, drums and other percussion instruments, string instruments such as guitars and violins, wind instruments such as flutes and trumpets. In the piano and keyboards musical instruments, each key pressed activates a sensor, so as the computer produces the corresponding sound. Similarly, polyphonic sounds can be achieved by pressing multiple keys on the keyboard. Drums can be located, where the
hitting sticks include the magnets or resonance circuit, thus with each drum hit, the computer produces different related drum sound. Xylophone and other instruments can be implemented allowing multiple users play multiple instruments, with the computer producing the sounds relating to the instruments according to the relevant activated sensing location on the matrix. The computer application can further include tutoring for teaching the user how to play the instruments.
The invention is also applicable for either 2D or 3D puzzles and related applications. Puzzles preferably yet not exclusively referred hereinafter to any game or educational theme composed of differently shaped of otherwise signed pieces which fit together to form a picture or a predetermined meaning. By implementing SADs into kids puzzle pieces, e.g., shapes, numbers, letters, images, the computer detects which shape is inserted and produce a relevant vocal feedback, such as stating the shape inserted, if inserted in the right place, produce the sound of the animal in case of animals puzzle, pronounce letters and letters sequences as in text to speech etc.
It is also in the scope of the present invention wherein contactless inductive position sensing where or when windings of electrically excited metal wires, transmit or emit an electromagnetic signal, while a resonator circuit, typically a coil and capacitor, comprise the SAD. This technology, implemented in existing digitizing tablets used for stylus interface to computers, allow 2D or 3D (i.e., X,Y and possibly Z dimension) detection of the SADs above the surface, as well as detection of tilt and orientation, with a high location resolution, as well as supporting discrimination between multiple SADs, by implementing different resonance frequency to each SAD. This technology is found to be cost effective and allows production of large sensing surfaces, as well as the ability of integrating with a projection screen, as the metal windings are placed behind the image projection elements, such as LCD screens.
It is also in the scope of the present invention wherein the terms 'magnet', 'magnets', 'emitters of electromagnetic signal' or 'resonance circuit' are interchangeably and generally denoted to any effecter activating a sensor.
Reference is now made to figure 1, presenting a flow chart of a method of applying a spatial computer interface with at least one array of 2D or 3D coordinated SADs. This method comprises inter alia the steps of selecting SAD's, e.g., mouse, joystick, an X- shaped pointer, wherein the cross is provided by 5 or more adjacent SADs;
predefining function; defying function; locating SAD's; selecting SAD's activation and then SAD's activating SAD's.
Reference is now made to figure 2 (a perspective upper view) and figure 3 (a lateral cross section), presenting the device according to yet another embodiment of the present invention, wherein the interface is connected either by wire or wireless communication means to a computer (3), via the keyboard input of the computer, and possibly to a mouse input or an USB port or other alternative while preferably the keyboard (4) is connected to the device.
It is in the scope of the present invention wherein interface (1) is covered by fabric (21), which is potentially adhered or sewed (22) affixed with scotch tape (23) different fabric coatings (2) with preset drawings on them to be ready for specific applications and activities such as car racing, bowling, checkers, backgammon, etc.
It is further in the scope of the present invention wherein SADs are either fixed (7) to the device by scotch or are maneuverable or actuated (8) and for example have either a fixed magnet for continuous activation of sensors, or active mechanical part to achieve proximity of magnet to sensor for activation by the user, e.g., car blowing the horn, dog-barking etc. Similarly, other SADs potentially comprise one or more magnets adapted for decoding of object types, differentiating objects belonging to different users, i.e. black from white in case of checkers) and orientation of SADs, for example when playing air dog-fight with two participants.
Reference is now made to figure 4, illustrating a matrix of sensors (24). These sensors, preferably yet not exclusively made of metal ware or any other conductive materials, are activated by magnet proximity which is located below the fabric (21) and is presented electrically in Figure 4. The matrix has X axis and Y axis (35a, 35b... 35n for X-axis and 36a, 36b... 36m for Y-axis), whereat the intersection point the sensors (24) are located (24m, 24n for all intersection points).
A SAD (30) located on the fabric, if pressed from on top, as an example of one of the many possible configurations for SADs, generates proximity of magnet (31) to the sensor (24) below the fabric layers, and thus generates a contact on the sensor (24).
It is also in the scope of the invention wherein the matrix is controlled by a controller (34), who repeatedly scans the X (35) and Y axis (36) lines for changes in state of the sensors (24) of the matrix.
It is acknowledged in this respect that the controller can either be embedded within the system or use the processing power of an external computer/network that it is connected to.
It is also in the scope of the invention wherein the sensors states are analyzed by the controller (34) or sent to the PC for analysis and according to the relevant action to take, it communicates instructions to and from the computer it connects to, via the communication link (32).
Another aspect of the hereto-defined interface is its ability to function without the need to install any dedicated software on the host computer. Hence, unnecessary incompatibility is prevented, and crashes and other common problematic symptoms which may occur when installing new drivers on existing computers are prohibited. The present invention hence provides a mode switch (38) which selects the operation mode to be either the learning mode or the working mode.
It is also in the scope of the invention wherein the previously mentioned interface comprises a learning mode, wherein the controller (34) is adapted to search for an active sensor. Key strokes on the connected keyboard (39) during detection of an active sensor, are programmed to the active sensor, so that whenever that sensor is active, when the operation mode selected using switch (38) is the working mode, the sequence of keystrokes presented during learning mode to that sensor will be transmitted to the host computer via the communication link to the computer (32).
Another feature proposed in learning mode relates to mouse activity simulation. In this learning mode, movement of the mouse to the corners of the active area and locating the SAD to be used as mouse with the device, would define the working area and boundaries for the activity of the mouse (e.g., achieved by pressing the button of the SADs button).
Another feature proposed during learning mode relates to encoded SADs definition. An encoded SAD comprises at least one magnet and is identified by the coordinated movement of all magnets enclosed in it.
It is also in the scope of the invention wherein said interface comprises a working mode. During working mode, at least a portion of the keyboard activities and mouse activities are directly transmitted to the host computer, so that it is possible to work with the standard keyboard and mouse without having to disconnect the keyboard and
mouse from the device. SADs are defined as fixed, when a press will initiate the submission of the character or string of characters/instructions, as defined when in a program mode. Activity in areas that are not defined for fixed SADs will submit location information, and thus emulate object movement and specifically - mouse movement. Some examples of fixed SADs with single magnet or multiple magnets for encoding are presented in figure 5.
Reference is now made to figure 5, presenting various fixed SADs, some of the SADs are similar to commercially available toys, wherein item (41) presents a simple drum/ key that is adapted for activating at least one sensor by moving the magnet towards the sensors surface. Scales (42) are adapted to indicate which side is heavier when a magnet is attached to the bottom side of the scales, Velocity and counter are utilized to indicate how many times the wheel has been turned, which can be achieved by fixing a single magnet to the carousel (43). Encoding each block (44) can differentiate the blocks and allow checking correct allocation of items. Yet another example of encoded signs when implementing a driving lesson application is presented with the stop sign (45). Additionally or alternatively, encoded plates having numbers (46) are disclosed.
It is further in the scope of the invention wherein mobile SADs are disclosed, such as mobile SADs comprising single magnet and/or multiple magnets for encoding and orientation identification.
Reference is now made to figure 6, presenting various mobile SADs, wherein item (51) presents a simple embodiment of the same, namely a ball or the like, comprising magnetic or paramagnetic materials, adapted to be maneuvered and/or actuated along the surface of the device while inline, online or offline, indicating its location in either 2D or 3D coordinated space. Item (52) presents mobile objects being differentiated, such as items of games e.g., backgammon, chess, etc. Item (53) is an equivalent of a computer mouse or any other decoded object which is adapted to provide 2D or 3D orientated information, as well as provide activation trigger. Magnet (53 a) presents the front side of the object while (53b) and (53c) present the rear side view of the object, while (53d) is a dome of a button which, when pressed, moves a hidden internal magnet indicating activation. Other fixed SADs are further possible, wherein it acknowledged in this respect that fixed objects can also be utilized as mobile objects and vice versa.
EXAMPLES
The present invention provides a novel and cost effective means for utilizing various 2D or 3D computer-enabled games. In one embodiment of the present invention the user is instructed to utilize a plurality of either maneuverable or fixed (immobilized) at least one SAD of any shape or size, position the same on or in the surface or space of the device, while assigning at least a portions of the SADs with a corresponding key function.
One example is using games from any source, wherein the games require activation by mouse. The 2D area or 3D space of the device whereat the mouse is maneuvered is set and preferably screened. The user does not leave the specified boundaries of the game. The user utilizes the SAD or SADs as a cordless mouse It is in the scope of this example wherein at least one mouse button is comprised in the said mouse. The location of the button is potentially detected by at least one sensor within a predetermined distance from the mouse or by different resonance frequency.
Another example is using various games, which require activation by both mouse and keyboard keys. The mouse active areas are set and relevant SADs assigned. Hence for example, two players or more maneuver a playing vehicle (e.g., a tank), using the ability to detect the direction of the SAD (e.g., said tank) and using possibly large SADs as blocking areas. Accordingly, each player has to shoot the other player's tank. The software analyses if the route from one tank to the other is clear (not interrupted by SADs). Alternatively, a plurality of players is instructed to shoot one or more escaping objects, e.g., a hunters and bear game, etc.
Another example is playing mazes. The maze can be flat (e.g., a 2D item) or comprise walls (e.g., a 3D environment). The player goes from entry to the exit with the SAD. Cheatings are detected by computer, which can provide the user with hints. The game is additionally designed to display traces on a screen, such as paths that were already tried. A radio controlled vehicle may hence be provided as the maneuverable SAD and move controllably within said maze.
Another example is playing checkers, chess, backgammon, cards etc. A mat comprising a printed game surface is hence provided. Each of the player's parts is encoded differently by magnets or paramagnets. According to this example, the first player is characterized by having one magnet per each token, the second player is
characterized by having two magnets per token or two different resonance frequencies in case of electromagnetic coupling and so on and so forth.
Moreover, a mouse pad with dedicated SADs is hereto provided for specific activities, selected in a non-limiting manner from open outlook, check list for every day activities, professional to-do list etc.
It is according to yet another example wherein a novel family of games is disclosed, said games comprising coding of different SADs with magnets or paramagnets. Those games are selected in a non-limited manner from checkers, chess, backgammon, cards etc adapted to be played with real parts while the computer records the player's location.
Another example is providing driving lessons or the like. The device provides a plurality of 2D or 3D allowed paths, signs such as no entrance, stop etc. Signs are decoded and recognized. If a vehicle drives against a predetermined rule, appropriate feedback is provided by the computer software.
Another example is flight-simulator controls — where instead of complex keyboard combinations, different SADs emulate the cockpit controls as in the real environment.
Claims
1. A system for obtaining a Spatial Interactive Environment (SIE), adapted to project, complete, or replace 2D virtual computerized input devices and display of a computer and interactions thereof with real objects, namely Sensor Activation Devices (SADs), said system comprising at least one affecting, manipulatable or maneuverable SAD which is assigned and/or interacts witli a plurality of sensors in a multidimensional environment; wherein the functionality assigned to said SAD and/or sensor is set either prior to or after positioning the SAD; said functionality of the same can further be determined either by its location, interaction, encoding characteristics and by the application running on said computer or any combination thereof.
2. A spatial interactive environment according to claim 1, comprising means selected from computing means, communicating means and output transmitting means or any combination thereof; preferably wherein said means are provided manually, especially by being activated by a user, or operated automatically in a predetennined protocol.
3. The spatial interactive environment according to claim 2, adapted to communicate with one or more computers, SADs, sensors, external or remote output devices or any combination thereof.
4. The spatial interactive environment according to claim 2, adapted to transmit information to one or more remote and/or adjacent targets, said targets are selected from video, audio, mechanical or electrical means or any combination thereof.
5. A spatial interactive environment according to claim 1, adapted to provide simultaneous operation of multiple SADs.
6. The spatial interactive environment according to claim 5, comprising at least one array of SADs.
7. The spatial interactive environment according to claim 1, wherein at least a portion of the SADs is of 2D or 3D orientation.
8. The spatial interactive environment according to claim 1, comprising at least one array of sensors.
9. The spatial interactive environment according to claim 1, wherein at least a portion of the sensors is of 2D or 3D orientation.
10. The spatial interactive environment according to claim ) , wherein at least a portion of the sensors is selected from magnetic sensors, proximity sensors, electromagnetic coupling, touch sensors, heat sensors, light sensors, acceleration sensors, velocity sensors, audio sensors, directional sensors, pressure sensors or the like.
11. The spatial interactive environment according to claim I5 wherein the number and location of the sensors and/or SADs are varied, interchangeable and user configurable.
12. The spatial interactive environment according to claim 1 , wherein the functionality of each SAD and/or each of sensors' arrays is spatially determined by the sensors it activates.
13. The spatial interactive environment according to claim 10, wherein the SADs activate the sensors of the SIE sensors by proximity, especially magnet, electromagnetic coupling, or paramagnet proximity switches.
14. The spatial interactive environment according to claim 1, wherein sensors are activated or operated by one or more sensing techniques, as a function of the sensors' type, 2D or 3D configuration and number; wherein each sensor or each sensors array is spatially designed for the activation of multiple sensors, thus allowing recognition of the spatial structure of the sensor or SAD.
15. The spatial interactive environment according to claim 13, wherein SADs are coded using RFID or different resonance frequencies in electromagnetic coupling to allow distinguishing different SADs.
16. The spatial interactive environment according to claim 1, wherein at least a portion of the SADs comprises output capabilities.
17. The spatial interactive environment according to claim 1, wherein the computing means are adapted for analyzing the 2D or 3D location or change in location and direction of at least a portion of the SADs.
18. The spatial interactive environment according to claim 1, wherein a plurality of SADs is adapted to activate multiple sensors for simultaneously supporting multiple inputs in parallel.
19. The spatial interactive environment according to claim 1, characterized by multiple data input provided simultaneously by more than a single user.
20. The spatial interactive environment according to claim 1, comprising connecting sensor surfaces for achieving larger area of sensors.
21. The spatial interactive environment according to claim 1, comprising curved surfaced sensors such that tunnels, round surfaces and other non-flat surfaces with sensors are provided.
22. The spatial interactive environment according to claim 1, comprising a top layer; said layer is at least partially comprised of either organic or inorganic fabric, polymeric texture or the like, adapted to accept scotch, or any other adhering material, for affixing SADs thereon.
23. The spatial interactive environment according to claim 1, wherein SADs are selected from every day objects, infants games or toddlers games; said games are adapted to (z) be played in any fashion, while (U) providing an input to the computer program, via the sensor platform, identifying a 2D or 3D configuration of the object or game, and providing the system a relevant feedback.
24. The spatial interactive environment according to claim 1, SADs having a Velcro™ or any other adhering means adapted to affix the same to a surface.
25. The spatial interactive environment according to claim 1, comprising at least one SAD which is adapted to be maneuvered or actuated in or on an intercommunicated interface; said interface has either two or three dimensions.
26. The spatial interactive environment according to claim 1, wherein at least a portion of the SADs are adapted to maneuver, actuate or to move on the surface to emulate mouse movement.
27. The spatial interactive environment according to claim 25, wherein at least a portion of the SADs is adapted to maneuver, actuate or to move on the surface to emulate movement of multiple objects simultaneously.
28. The spatial interactive environment according to claim 1, comprising at least one non-fixed SAD interconnected with at least one sensor.
29. The spatial interactive environment according to claim 27, wherein the SAD comprises at least one control button.
30. The spatial interactive environment according to claim 27, wherein the software within the computer is adapted to detect more than a single SAD from within the object, thus allowing activation related to the object, especially by pressing a button allocated to the object.
31. The spatial interactive environment according to claim 27, wherein the application of the controller within the device or a PC is set to define the active area to be used by the user, especially wherein the active area is limited on the sensor area, so that only parts of it accept detection of movement.
32. The spatial interactive environment according to claim 27, wherein the application of the controller within the device or a PC is set for the definition of an active area on the computer screen to be used by the user, so that the activity with the objects will not cross the border of the predefined area.
33. The spatial interactive environment according to claim 27, interacting with SADs comprising at least one magnet, resonator or paramagnet utilized for detecting movement; said SAD is located adjacent to at least one sensor adapted to sense said magnetism emitted by said SAD.
34. The spatial interactive environment according to claim 1, connected to at least one keyboard or USB port or any other computer communication port for parallel input from the keyboard and the device.
35. The spatial interactive environment according to claim 1, comprising a programming mode; said programming mode is utilized for correlating the sequence of keys pressed with the corresponding sensors activated, such that when the system is in its active mode, activation of a specific sensor causes the system to emulate sending the predefined keys sequence to the computer.
36. The spatial interactive environment according to claim 35 comprising a learning mode wherein a sensor activation in location (xl,yl) of the sensing surface is assigned to emulate a mouse button press/ release/hold in location (x2,y2) on the screen.
37. The spatial interactive environment according to claim 35 (x2,y2) coordinates is similar to (xl,yl) coordinates.
38. The spatial interactive environment according to claim 35 (x2,y2) coordinates is different from (xl,yl) coordinates, thus allowing different allocation of SADs to represent mouse button pressing emulation on the display.
39. The spatial interactive environment according to claim 1, comprising at least one surface with dedicated backgrounds for dedicated games. Said background is attached by scotch, or any other adhering material, as an option to provide the surface background for the activity.
40. The spatial interactive environment according to claim 1, wherein the surface comprises a display, on which SADs are located, and further wherein said display comprises electromagnetic coupling sensing capabilities, adapted to detect the location and allocation of resonators above the display.
41. The spatial interactive environment according to claim 1 wherein the sensors and SADs technology are adapted to detect SAD's height above the surface and orientation, especially by using technology selected from electromagnetic coupling with resonators, metallic magnetic conductance or a combination thereof.
42. The spatial interactive environment according to claim 1, being interconnected to output means, selected from television, PDA, mobile phone, or any entertainment/computerized devices.
43. A method of obtaining a spatial interactive environment, said environment is adapted to project, complete, or replace the 2D virtual computerized display of a computer and interactions thereof with real objects, namely Sensor Activation Devices, (SADs), said system comprising at least one affecting, manipulalable or maneuverable SAD which is assigned and/or interacts with a plurality of sensors in a multidimensional environment; wherein the functionality assigned to said SAD and/or sensor is set either prior to or after positioning the SAD; said functionality of the same can further be determined either by its location, interaction, encoding characteristics and by the application running on said computer or any combination thereof; said method comprising inter alia the following steps: a. selecting desired application; b. placing at least one SADs, and/or selecting at least one appropriate SADs; c. assigning a SAD-sensor functionality; and, d. activating the same.
44. The method of obtaining a spatial interactive environment, said environment is adapted to project, complete, or replace the 2D virtual computerized display of a computer and interactions thereof with real objects namely Sensor Activation Device (SADs), said system comprising at least one affecting, manipulatable or maneuverable SAD which is assigned and/or interact with a plurality of sensors in a multidimensional environment; wherein the functionality assigned to said SAD and/or sensor is set either prior to or after positioning the SAD; said functionality of the same can further be determined either by its location, interaction, encoding characteristics and by the application running on said computer or any combination thereof.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| IL169910 | 2005-07-26 | ||
| IL16991005 | 2005-07-26 |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| WO2007013063A2 true WO2007013063A2 (en) | 2007-02-01 |
| WO2007013063A3 WO2007013063A3 (en) | 2011-05-19 |
Family
ID=37683735
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/IL2006/000854 Ceased WO2007013063A2 (en) | 2005-07-26 | 2006-07-24 | Multidimensional multifunctional computer interface device |
Country Status (1)
| Country | Link |
|---|---|
| WO (1) | WO2007013063A2 (en) |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JPH0769767B2 (en) * | 1991-10-16 | 1995-07-31 | インターナショナル・ビジネス・マシーンズ・コーポレイション | Touch overlay for detecting finger touch or stylus position, and detection system |
| DE69528212T2 (en) * | 1994-06-09 | 2003-04-24 | Corp For Nat Res Initiatives R | Note device interface |
-
2006
- 2006-07-24 WO PCT/IL2006/000854 patent/WO2007013063A2/en not_active Ceased
Also Published As
| Publication number | Publication date |
|---|---|
| WO2007013063A3 (en) | 2011-05-19 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8184100B2 (en) | Inertia sensing input controller and receiver and interactive system using thereof | |
| US8259072B2 (en) | Input control apparatus and an interactive system using the same | |
| US9925456B1 (en) | Single manipulatable physical and virtual game assembly | |
| US20110215998A1 (en) | Physical action languages for distributed tangible user interface systems | |
| KR20200109351A (en) | Interaction system and method | |
| CN107608518A (en) | The system and method for multiple pressure interaction on touch sensitive surface | |
| EP3593406B1 (en) | Interactive digital platform device and method | |
| US20160162040A1 (en) | System and method for operating a computer program with physical objects | |
| CA2588914A1 (en) | Electronic game board | |
| WO2015113358A1 (en) | System and method for operating computer program with physical objects | |
| EP2004299A2 (en) | Interactive playmat | |
| US10709971B2 (en) | Information processing system, extended input device, and information processing method | |
| JP2024138324A (en) | Handheld controller with interchangeable controls | |
| US20180071626A1 (en) | Tag reader and system comprising a tag reader | |
| JP4825306B2 (en) | GAME DEVICE, GAME METHOD, AND GAME PROGRAM | |
| US20100309154A1 (en) | Two-dimensional input device, control device and interactive game system | |
| CN116056771A (en) | User configurable interactive toy | |
| CN104288993B (en) | A chess and card game interactive auxiliary device and method | |
| JP5911995B1 (en) | Apparatus, information processing apparatus, program, and information processing system | |
| CN203803099U (en) | Chess and card game interaction auxiliary device | |
| JP7272273B2 (en) | First information processing device, information processing method, program and information processing system | |
| US20100309155A1 (en) | Two-dimensional input device, control device and interactive game system | |
| WO2007013063A2 (en) | Multidimensional multifunctional computer interface device | |
| CN101940841B (en) | Two-dimensional input device, control device and interactive type game system | |
| JP7566964B2 (en) | program |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
| NENP | Non-entry into the national phase |
Ref country code: DE |
|
| 122 | Ep: pct application non-entry in european phase |
Ref document number: 06766169 Country of ref document: EP Kind code of ref document: A2 |