ES2392895B2 - Data entry method in electronic devices with touch screen. - Google Patents

Abstract

 Method of data entry in electronic devices with touch surface, comprising: # - for each user interaction with a touch surface area, a stage of detection of primary actions (100) comprising: # - detecting the presence of contact (102 ) on the touch surface; # - monitor interaction parameters of said contact on the touch surface, including the position of the contact; # - check if said interaction corresponds to a primary action within a list of primary actions (401, 402, 403 , 404, 405) considered; # - assign to said interaction the corresponding primary action detected; # - a stage of combination of primary actions (200), comprising: # - check, based on the detected primitive actions and their corresponding parameters of interaction monitored, if user interactions with at least one area of the touch surface corresponds to a combined action within from a list of combined actions (501, 502, 503, 504, 601, 602, 603, 604, 605, 606) considered; # - assign to said user interactions the corresponding combined action detected.

Description

Data entry method on electronic devices with touch screen

Field of the Invention The present invention falls within the field of data entry methods and 5 orders for touch surface devices by detecting changes in the pressure or surface area of one or more contact points.

BACKGROUND OF THE INVENTION There are more and more products with a touch surface used in daily life. its

The industry is very diverse, in which a large number of companies are betting on different technologies, and due to their increasing acceptance, the touch surfaces are reaching a sufficient degree of maturity, which has allowed them to currently have high reliability .

15 The advantages they present as data entry devices lie in their simplicity of use and their speed compared to other input peripherals. Currently, the software associated with this type of surfaces interprets different parameters and reports them to the system to carry out the set of actions for which it is designed.

20 This set of parameters encompasses both the position and duration of contact on the surface of the device, as well as the direction and speed of the gestures, as well as the distance and relative position between two or more contact points in the case of surfaces with multi-touch technology

25 Progressively, the number of functionalities attributed to the touch surfaces is being increased, so the introduction of commands should be done in a more efficient way. This is why its properties should not be wasted, such as the detection of the amount of pressure applied or the area in

30 contact on its surface, as well as the possible functionalities that these parameters would imply, achieving a more intuitive control of the user interface.

In the field of tactile surface introduction methods, there are some references based on pressure detection. It is known from patent US6590568B1, an input method based on the detection of pressure on the

surface of a touch screen. Additionally, US6943778B1, discloses another method of introduction in touch screens sensitive to pressure on its surface.

5 However, in both input methods, only the detection of the pressure at two different levels is contemplated, differentiated by a predetermined pressure threshold, so that the sensitivity to this parameter is reduced to that the contact pressure is above or below that threshold, and in both cases only touch screens are considered as input devices.

Description of the invention The invention consists of a method that allows the entry of orders and data using changes in pressure or surface area and its shape as one.

or several points in contact that activate the touch surface according to one or more

15 decision thresholds that differentiate pressure at two or more different levels. Making the system sensitive to changes in pressure or pressured areas allows greater functionality, increasing the input capacity of the device, providing more information about the environment to that system.

20 Changes in pressure can be detected by the force or pressure sensors of the touch device itself and that allow measuring its magnitude or intensity within a defined range and its variation according to two or more levels.

Changes in the area of contact with the surface may be obtained by

25 touch sensor contact sensors that detect the zones of one or more contacts and compute the variations in their extension. A practical, non-limiting case of the invention, to exemplify variations in the contact area may correspond to the situation of touching the touch surface with a small area of the tip of a finger and then immediately supporting the fingertip of said finger.

30 completely, which would increase the contact area, and then remove the finger completely eliminating contact with the surface, which would correspond to a decrease in the contact area.

Depending on the pressure exerted on the surface, at one or several points, or on the size of their area, as well as their shape and distribution, different processes assigned to these pressure levels or areas in contact can be activated.

5 The input method that provides information regarding surface pressure

or the pressed area makes use of various wasted resources of conventional touch surfaces.

The sensitivity added to the system through this method of introduction allows a

10 greater interactivity with the user granting additional functionalities to habitual actions, so the control is intuitive and easy to learn. It also increases the efficiency of use of the touch surface and does not require specific auxiliary hardware.

The main advantage of this method of entry lies in the contribution of a

15 new information to the system that contributes to increase the amount of actions with which the user interacts with the touch surface of a device, also increasing the functionalities that can be attributed to the system, associated with those actions.

The method of data entry in electronic devices with a touch surface object of the present invention comprises: - for each user interaction with a zone of the touch surface, a stage of detection of primary actions, said step comprising:

• detect the presence of new or existing contact on the touch surface 25;

• monitor at least one interaction parameter of said contact on the touch surface, said at least one interaction parameter including the position of the contact;

• check, depending on the interaction parameters monitored,

30 if said user interaction corresponds to a primary action within a list of primary actions considered;

• assign the corresponding primary action detected to said user interaction; -a stage of combination of primary actions, comprising:

35 • check, based on the detected primitive actions and their

corresponding monitored interaction parameters, if user interactions with at least one area of the touch surface corresponds to a combined action within a list of combined actions considered;

5 • assign the corresponding combined action detected to these user interactions.

The at least one contact interaction parameter on the touch surface may additionally include the contact pressure level. The level monitoring

The contact pressure preferably comprises: monitoring the contact pressure value; -assign a pressure level based on pressure thresholds

determined.

The at least one contact interaction parameter on the touch surface may additionally include any one of the following: the contact area detected as a function of one or more determined extension thresholds; -the contact time;

20 -the movement of the contact on the touch surface; -the direction of contact movement on the touch surface; -the speed of contact movement on the touch surface; -the acceleration of contact movement on the touch surface.

The combined actions are preferably generated from sequential primary actions over time. Combined actions can also be generated from primary actions simultaneously performed on at least two different areas of the touch surface. In this case, the combined action generated from simultaneous primary actions may take into account the information

30 corresponding distance between the two or more contact areas as well as the pressure difference between them.

BRIEF DESCRIPTION OF THE DRAWINGS Next, a series of drawings that help to better understand the invention and that expressly relate to a design are described very briefly.

embodiment of said invention presented as a non-limiting example thereof.

Figure 1 represents a flow chart of an exemplary process to detect and process low-level primary actions.

5 Figure 2 shows a flow chart of an exemplary process for processing combinations of primary actions from the exemplary flow chart of Figure 1.

10 Figure 3 represents a flowchart illustrating the combination of the exemplary process flowcharts of Figure 1 and Figure 2.

Figure 4 shows a table with the primary actions in which an embodiment consists.

15 Figure 5 shows a table with some of the compound gestures constituted by two primary actions performed simultaneously according to the embodiment described.

20 Figure 6 presents a table with some of the compound gestures consisting of two or more primary actions performed sequentially according to the embodiment described.

Figure 7 presents a table that exemplifies in a non-limiting way the decision thresholds for the different parameters that define the primary actions, in the case of a single threshold that defines two levels of decision.

Detailed description of the invention The method of introduction consists in the detection of a series of primary actions

30 (Figure 1) and its possible combination (Figure 2) for performing gestures with a greater degree of complexity (Figure 3), with the purpose of executing actions in the system that implements it. From now on, primary actions (or simple gestures) are those basic actions that the user performs on the touch screen, which will be detected by a function for monitoring and detecting actions

35 primary (for example as shown in Figure 1). It will be understood as action or

composite gesture the combination of two or more primary actions, if they are combinable, and will be detected by a combination function of primary actions (for example as shown in Figure 2). The gesture can be monotactile, when it only depends on the action on a single point or area of the

5 screen, or multi-touch gesture when it depends on the action on several simultaneous points of the screen, for which this must be a multi-touch screen.

Figure 1 represents an example flow chart for detecting primary actions, which comprises a first stage of contact detection 102 on the touch screen of the electronic device consisting of locating at least one contact area on the surface of the tactile surface that has just been produced or already existing since the end of the detection of a gesture 212. From the contact detection, the position of the contact 104 and the change of pressure or contact area, if any, are processed , on the screen. For this, it is checked if

15 releases contact 106 on the screen: -In case there is still contact, it is checked if there is movement 108 of the contact, in which case the position of the contact and the direction of movement 110 are processed and then the time and change is processed pressure on screen 112. If it did not exist

20 movement only the time and the pressure change on the screen 112 would be processed. After this last stage 112, it is checked whether the primary action has been completed 114 according to the time thresholds, variation of contact position on the surface and variation of pressure or contact area that has been established in the configuration of

25 said parameters for each primary action. -For the verification of the type of primary 114 detected on the touch surface, the configuration parameters corresponding to each primary action can be stored in a query table, where you can compare the parameters obtained in real time with the actions

30 previously configured primaries. - In order to illustrate this process, a possible, non-limiting, embodiment is shown for the primary move 403 and drag 404 (Figure 4). To do this, Figure 7 shows a table that exemplifies in a non-limiting way the decision thresholds for the different parameters that define

35 the primary actions, in the case of a single threshold that defines two

decision levels The primary move action consists in moving a contact 102 with the tactile surface, such as the contact of the fingertip of a finger, from one point to another of the same 108 with a significant position variation 110 and greater than a predefined threshold 702 and with a 5 or more variations in pressure or contact area along the path of travel 112 greater than a predetermined threshold 701. When contact with the touch surface does not vary from position 108 or varies by a magnitude less than the preset threshold 702 for a certain period of time 704, or change the direction of the path described in a

10 value greater than a predetermined threshold 703, the primary move action is considered completed 114. With respect to the primary drag action, the same procedure is considered, however in this case the primary drag is detected when the pressure variation or the Contact area 112 is lower than the preset threshold for said action 701.

15 -If the primary action had been completed, the primary action detection function would have ended 116. If a primary action had not yet been detected, it would return to the contact release check step 106 on the screen. -In case the contact is released, the primary type 114 is checked and

20 ends 116 the primary action detection function. -The process of monitoring the variations of pressure or contact area, time, position and direction on the touch surface described 100 is carried out simultaneously, replicating in as many cases as the maximum number of contacts detected by said surface in a

25 instant of time.

Figure 2 shows a flow chart, by way of example, for processing combinations of primary actions detected by the previous process of Figure

1. Once a primary 202 is received, it is checked whether it is combinable 204 with a

30 primary received immediately before or with one or more primary that are being performed simultaneously. If not combinable, the primary combination function 212 is terminated. If it were combinable, it would be checked if it corresponds to a multi-touch composite gesture 206, in which case 208 the time, distance and pressure difference between the contact areas on the surface is processed.

35 screen, to analyze later if the compound gesture has been completed 210. All

The primary actions can be combined sequentially as long as the time elapsed from the end of a primitive 116 to the next contact detection 102 is less than a predefined threshold. All primary actions can be combined simultaneously according to the capabilities of detecting a limited number of contacts on the touch surface to form a multi-touch gesture

206.

Figure 3 represents a flowchart with the combination of the process flowcharts of Figures 1 and 2. Specifically, a continuous flow is performed.

10 detection and processing of primary actions 100, which are fed to the reception and combination stage of primary actions 200.

These primary actions take into account changes in position, pressure or area and time on the touch surface as well as speed, and direction if

15 there is a movement associated with the action, for a single area in contact on its entire surface.

Figure 4 shows a table with different examples of primary actions, which could logically vary. The primary continuous touch action (401) is defined as a stronger pressure, or an area of contact with the larger tactile surface, and its position, applied for a short period of time immediately followed by a lighter pressure, or an area of minor contact on the tactile surface, where the time and the difference of pressure or area in contact will depend on the sensitivity considered for the system or the applications that use the present method of

25 data entry or orders. It is important to indicate that "a lighter pressure" means any contact whose pressure is lower, also including zero pressure, that is, the absence of contact.

The primary hold action (402) is described as contact with the touch surface

30 maintained for a period of time estimated as a long pressure for the system (above a certain time threshold), with a pressure or area in contact that is considered constant for that system.

In the following primary actions the movement 35 will be taken into account, which can describe any curve, and therefore the direction, speed and

the duration of this movement as well as the pressure or the area in contact with the tactile surface along the gesture, in accordance with the precision that the system supports.

5 The move gesture 403 is defined as the contact with the touch surface that describes a movement on it and there are one or several changes in pressure or contact area throughout the description of the movement. For this primary action, the information on the contact position, the pressure or the area in contact, the speed and the direction from the beginning to the end of the gesture are processed, as well as its

10 duration according to the rigor and needs of the system in which this input method is used.

The primary drag 404 action is described analogously to the move action, except for the pressure or the contact area on the touch surface, which in this

The case is considered constant during the description of the gesture for the specifications of the system or application in which the input method sensitive to these parameters is used.

Finally, the 405 launch action is defined as a gesture, considered quickly by the

20 system, which uses this method of entry, and that begins with a pressure or area in contact that becomes lighter or decreases throughout the description of the gesture until it ends with the release of contact with the touch surface.

These primary actions can be considered as a simple gesture or be part of a gesture composed of several same or different primary actions.

On the other hand, the method of introduction sensitive to pressure or to the area in contact with the touch surface has the ability to detect compound gestures as a combination of several successive or simultaneous primary actions. Figure 5

30 shows a table with some of the compound gestures consisting of two primary actions performed simultaneously, while Figure 6 presents a table with some of the composite gestures consisting of two or more primary actions performed successively or sequentially.

The realization of a gesture can consist of two or more primary actions of the same type executed in parallel simultaneously on the touch surface, the limit number of areas being pressed simultaneously imposed by the surface sensitivity or the system using this input method.

5 Another class of compound gestures is one that encompasses successive primary actions temporarily and which in turn can be performed in a single pressure zone on the touch surface, as well as several simultaneously. The sequence of continuous touches 502 is part of this class (Figure 5), described as two or

10 more continuous touch primary actions, performed sequentially in a short period of time, to be considered by the system in which the pressure sensitive input method or contact area is used. This gesture can be performed in a single contact area with the touch surface or in several simultaneously as explained above.

15 The sequence of continuous touches has a variant, formed by a sequence of continuous touches immediately terminated by a primary action to maintain 503.

20 For this kind of gestures it is important to highlight that, in the event that the performance of the gesture is executed at several points or pressure zones simultaneously, the system will process the corresponding distance information between the two or more points or contact areas, as well as the difference in pressure between them.

25 Finally, there are compound actions that can be performed only with two or more contact points on the touch surface simultaneously, the maximum limit of contact points being imposed, imposed by the sensitivity of the touch surface

or the system that uses said input method.

30 To this type of actions belongs the 501 balancing gesture that combines two or more simultaneous continuous touch primary actions between which there is a pressure difference, which can alternate between the contact points, and a distance between those points. This pressure and distance difference information will be processed by the system in question.

The zooming action has two variants, the first one consists of two primary actions move 601 (Figure 6) in the same direction and opposite directions such that the areas in contact with the touch surface approach each other, decreasing the distance between them. Because it consists of moving actions, pressure or

5 area in contact on the surface will have a perceptible variation by the system along the course of the gesture.

The second variant is identical to the previous one, changing the primary actions to move by dragging 602, in which case the pressure or the area in contact would be considered

10 constant by the system that uses the input method sensitive to pressure or the area in contact on the touch surface. In both cases the system will process the distance information between the contact areas and the direction of movement.

In this case, if the primaries are to cast 603, the composite action appears to zoom in and out.

15 release, where throughout the movement the pressure or area decreases until the contact with the surface is released.

The zoom out action (604,605,606) is identical to the zoom in action with the exception that movements on the surface describe opposite directions that separate between

20 yes, so the system will also handle the same information parameters.

The composite gesture touching another point 504 (Figure 5) is composed of a first primary action or compound gesture that maintains pressure or area in contact on the touch surface, without releasing it from contact, followed by the appearance of a point

25 additional, or several, contact in another area of the surface, initiation of any other primary action or compound gesture. Therefore the number of contact points detected increases, up to the limit imposed by the sensitivity of the touch surface or the system using the method in question.

30 Finally, all the actions mentioned above can be combined with each other in order to increase the amount of reproducible gestures on the touch surface of the device and thus its input capacity.

Claims (6)

1.-Method of data entry in electronic devices with touch surface, comprising: 5 -for each user interaction with a touch surface area, a stage of detection of primary actions (100), said step comprising: • detect the presence of new or existing contact (102) on the touch surface;

•

monitor a plurality of interaction parameters of said contact on the touch surface, including the position of the contact;

• check, based on the monitored interaction parameters, whether said user interaction corresponds to a primary action within a list of primary actions (401,402,403,404,405) considered;

•

assign the corresponding primary action detected to said user interaction;

characterized in that it additionally comprises: -a stage of combination of primary actions (200), comprising: • check, based on the primitive actions detected and their corresponding interaction parameters monitored, if 20 user interactions with at least one area of the touch surface corresponds to a combined action within a list of combined actions (501,502,503,504,601,602,603,604,605,606) considered; • assign the corresponding combined action detected to these user interactions; 25 and why the interaction parameters of the contact on the touch surface also include the variation of the pressure or contact area of said contact during its interaction on the touch surface. 2. Method according to claim 1, characterized in that the monitoring of the Variation of pressure or contact area is performed according to one or more decision thresholds. 3. Method according to any of the preceding claims, characterized in that the contact interaction parameters on the touch surface include 35 additionally the contact time. 4. Method according to any of the preceding claims, characterized in that the contact interaction parameters on the touch surface additionally include any one of the following: 5 -the movement of the contact on the touch surface; -the direction of contact movement on the touch surface; -the speed of contact movement on the touch surface; -the acceleration of contact movement on the touch surface. Method according to any of the preceding claims, characterized in that the combined actions are generated from sequential primary actions over time. 6. Method according to any of the preceding claims, characterized by 15 that the combined actions are generated from primary actions simultaneously performed on at least two different areas of the touch surface. 7. Method according to claim 6, characterized in that the combined action 20 generated from simultaneous primary actions takes into account the corresponding distance information between the two or more contact areas as well as the pressure difference between them.  Fig 2   100 200  Fig. 3    Fig. 4    Fig. 5    Fig. 6   Fig. 7