JP2023122662A - Information processing system, terminal device, control method, and additional program - Google Patents

Abstract

To provide an information processing system, a terminal device, a control method and a program that use mouse events to control a non-contact digitizer that reduces the time lag of a key response to an input of a key press operation.SOLUTION: In a terminal device which is a non-portable POS terminal equipped with an input/output device and an information processing device and installed in a facility such as a store, an information processing device 3 is provided with first event generating means 31 for generating a first event indicating a pointer down corresponding to a first operation when the first operation corresponding to the pointer down is input to a non-contact type digitizer, second event generating means 41 for generating a second event indicating both of a mouse down and a mouse up at a position where the first operation is input when the first event occurs, and key response means 51 for causing a software key to respond in response to the mouse down and the mouse up indicated by the second event when the second event occurs.SELECTED DRAWING: Figure 4

Description

The present disclosure relates to an information processing system and the like.

2. Description of the Related Art In an information processing system, a non-contact digitizer is used in an operation input unit of a terminal device. For example, in a POS (Point of Sales) system, a non-contact touch panel is used as an operation input unit of a POS terminal. Patent Documents 1 to 3 disclose techniques related to non-contact digitizers.

Japanese Patent Application Laid-Open No. 2020-170311 JP 2020-170297 A JP 2018-147054 A

A terminal usually comprises an operating system. Hereinafter, the operating system may be referred to as "OS". A so-called "event" is used for the control of the digitizer by the OS. Specifically, for example, mouse events, touch events, or pointer events are used. Which of the mouse event, touch event, and pointer event is used depends on the type of digitizer, digitizer method, OS, application software, and the like. Hereinafter, application software may be referred to as "application".

For example, WINDOWS (registered trademark, hereinafter abbreviated as "registered trademark") is widely used as an OS for POS terminals. In addition, a capacitive contact touch panel is widely used for the operation input unit of the POS terminal. In WINDOWS, mouse events are sometimes used to control capacitive contact touch panels. Therefore, in the POS system, many applications corresponding to mouse events have been developed. Hereinafter, a touch panel controlled using mouse events may be referred to as a "mouse device touch panel".

Hereinafter, an object (for example, a user's finger) used for inputting an operation on a non-contact digitizer (for example, a non-contact touch panel) may be referred to as an "indicator". Also, an area in the air where a pointer is detected by a non-contact digitizer may be referred to as a "detection area". When mouse events are used to control a non-contact digitizer, when a user inputs an operation to press a software key (hereinafter sometimes referred to as "button"), a predetermined OS (for example, WINDOWS) and application , perform the following:

First, when the digitizer detects that the pointer has entered the detection area, the OS generates a pointer down event. The OS then generates a pointer-up event when the digitizer detects that the pointer has left the detection area. When a pointer-up event occurs next to a pointer-down event, the OS generates a mouse-down event and a mouse-up event. This is the specification of a given OS (eg WINDOWS). In response to such mouse-down and mouse-up events, the app reacts the buttons. That is, the button responds only after the digitizer detects that the pointer has left the detection area.

In other words, after the user puts the pointer into the detection area, the button does not respond until the user moves the pointer out of the detection area. For this reason, the timing at which the button responds is delayed with respect to the timing at which the user puts the pointer into the detection area (that is, the timing at which the user starts pressing the button). Due to the occurrence of such a time lag, there has been a problem that the user feels uncomfortable with the operation.

In view of the problems described above, an object of the present disclosure is to reduce the time lag of the button response to the input of the operation of pressing the button in an information processing system or the like that uses mouse events to control a non-contact digitizer. be.

An information processing system according to one aspect of the present disclosure generates a first event indicating pointer down corresponding to a first operation when a first operation corresponding to pointer down is input to a non-contact digitizer. first event generation means; second event generation means for generating a second event indicating both mouse-down and mouse-up at a position where the first operation is input when the first event occurs; and button reaction means for causing the software keys to react in response to mouse-down and mouse-up indicated by the second event when they occur.

A terminal device according to an aspect of the present disclosure generates a first event indicating pointer down corresponding to a first operation when a first operation corresponding to pointer down is input to a non-contact digitizer. 1 event generation means, 2nd event generation means for generating a second event indicating both mouse down and mouse up at the position where the first operation is input when the first event is generated, and the second event is generated. button reaction means for causing the software key to react in response to the mouse-down and mouse-up indicated by the second event when the mouse is pressed.

In the control method according to one aspect of the present disclosure, when a first operation corresponding to pointer down is input to the non-contact digitizer, the first event generating means indicates pointer down corresponding to the first operation. A first event is generated, and when the first event is generated, a second event generating means generates a second event indicating both mouse-down and mouse-up at the position where the first operation is input, and the second event is generated. occurs, the button reacting means reacts the software key according to the mouse-down and mouse-up indicated by the second event.

An additional program according to an aspect of the present disclosure generates a first event indicating pointer down corresponding to a first operation when a first operation corresponding to pointer down is input to a non-contact digitizer. When the 1-event generation function and the second event indicating both mouse-down and mouse-up at the position where the first operation is input occur, the software key is reacted according to the mouse-down and mouse-up indicated by the second event. This additional program operates by being added to a basic program for realizing a button reaction function on a computer, and causes the computer to realize a second event generation function for generating a second event when a first event occurs.

According to the present disclosure, in an information processing system or the like that uses mouse events to control a non-contact digitizer, it is possible to reduce the time lag of the button response to the input of the operation of pressing the button.

FIG. 1 is a block diagram showing a terminal device according to the first embodiment. FIG. 2 is a perspective view showing the terminal device according to the first embodiment. 3 is a side view showing an input/output device in the terminal device according to the first embodiment; FIG. FIG. 4 is a block diagram showing an information processing device in the terminal device according to the first embodiment. FIG. 5 is a block diagram showing the hardware configuration of the information processing device in the terminal device according to the first embodiment. 6A is a flowchart showing the operation of the information processing device in the terminal device according to the first embodiment; FIG. 6B is a flowchart showing the operation of the information processing device in the terminal device according to the first embodiment; FIG. FIG. 7 is a block diagram showing a terminal device for comparison. FIG. 8 is a block diagram showing an information processing device in a terminal device for comparison. FIG. 9A is a flowchart showing the operation of the information processing device in the terminal device for comparison. FIG. 9B is a flowchart showing the operation of the information processing device in the terminal device for comparison. FIG. 10A is an explanatory diagram showing a specific example of operation input and screen transition in a terminal device for comparison. FIG. 10B is an explanatory diagram showing a specific example of operation input and screen transition in a terminal device for comparison. FIG. 10C is an explanatory diagram showing a specific example of operation input and screen transition in a terminal device for comparison. FIG. 10D is an explanatory diagram showing a specific example of operation input and screen transition in a terminal device for comparison. 11A is an explanatory diagram showing a specific example of operation input and screen transition in the terminal device according to the first embodiment; FIG. 11B is an explanatory diagram showing a specific example of operation input and screen transition in the terminal device according to the first embodiment; FIG. 11C is an explanatory diagram showing a specific example of operation input and screen transition in the terminal device according to the first embodiment; FIG. FIG. 12 is a block diagram showing an information processing system according to the first embodiment. FIG. 13 is a block diagram showing an information processing system according to the second embodiment. FIG. 14 is a block diagram showing a terminal device according to the second embodiment. FIG. 15 is a block diagram showing additional software according to the second embodiment.

Embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings.

[First embodiment]
FIG. 1 is a block diagram showing a terminal device according to the first embodiment. FIG. 2 is a perspective view showing the terminal device according to the first embodiment. 3 is a side view showing an input/output device in the terminal device according to the first embodiment; FIG. FIG. 4 is a block diagram showing an information processing device in the terminal device according to the first embodiment. A terminal device according to the first embodiment will be described with reference to FIGS. 1 to 4. FIG.

As shown in FIG. 1, the terminal device 1 includes an input/output device 2 and an information processing device 3 . The input/output device 2 includes a display device 11 , a first operation device 12 and a second operation device 13 . The information processing device 3 includes an operating system 21 , additional software 22 and application software 23 .

As shown in FIG. 2, the terminal device 1 is, for example, a non-portable POS terminal installed in a facility such as a store. The POS terminal can freely communicate with a POS server (not shown). The POS terminal and POS server constitute a main part of a POS system (not shown). The input/output device 2 is attached to the main body 4 of the terminal device 1 . On the other hand, the information processing device 3 is accommodated inside the main body 4 . In addition, in FIG. 2, the information processing device 3 is omitted. On the other hand, in FIG. 1, illustration of the main body 4 is omitted.

The display device 11 is configured by a display. Specifically, for example, the display device 11 is configured by a liquid crystal display or an organic EL (Electro Luminescence) display. Hereinafter, a direction perpendicular or substantially perpendicular to the screen of the display device 11 may be referred to as a "vertical direction".

The first operation device 12 is composed of a contact-type digitizer. Specifically, for example, the first operation device 12 is configured by a capacitive contact touch panel. That is, a capacitive touch sensor (not shown) is provided along the screen of the display device 11 . The first operating device 12 includes such a touch sensor. The first operation device 12 uses such a touch sensor to detect an operation input by the user. Here, various known techniques can be used as a method of detecting an operation input using a capacitive touch sensor. A detailed description of these techniques is omitted.

The second operation device 13 is composed of a non-contact digitizer. Specifically, for example, the second operation device 13 is configured by a non-contact touch panel using infrared rays. That is, as shown in FIG. 3, a detection area A is set in the air along the screen of the display device 11 . Also, an infrared sensor (not shown) is provided at the end of the detection area A. As shown in FIG. The second operating device 13 contains such an infrared sensor. The second operation device 13 uses such an infrared sensor to detect an operation input by the user.

More specifically, the infrared sensor emits infrared rays L to the detection area A. As shown in FIG. When the indicator O exists in the detection area A, the emitted infrared light L is reflected by the indicator O. As shown in FIG. An infrared sensor receives the reflected infrared light L. The second operation device 13 detects the presence or absence of the indicator O in the detection area A and detects the position of the indicator O in the detection area A based on the emitted infrared rays L and the received infrared rays L. Further, the second operation device 13 detects an operation input by the user based on the change in the position of the pointer O in the detection area A over time.

Here, operations to be detected by the second operation device 13 include the following operations.

Firstly, operations to be detected by the second operation device 13 include operations corresponding to so-called "pointer down". Hereinafter, the operation corresponding to pointer down may be referred to as "pointer down operation" or "first operation". The pointer-down operation is, for example, an operation in which the user puts the tip of the indicator O into the detection area A from outside the detection area A, and is performed by the user moving the indicator O in the vertical direction.

Secondly, operations to be detected by the second operation device 13 include operations corresponding to so-called "pointer up". Hereinafter, the operation corresponding to pointer-up may be referred to as "pointer-up operation" or "second operation". The pointer-up operation is, for example, an operation in which the user moves the tip of the indicator O from inside the detection area A to outside the detection area A, and is performed by the user moving the indicator O in the vertical direction.

As described above, the information processing device 3 includes the operating system 21, additional software 22, and application software 23 (see FIG. 1). The operating system 21 is, for example, WINDOWS. The additional software 22 is software that is added separately from the operating system 21 and the application software 23 and operates. Specifically, for example, the additional software 22 is software additionally downloaded and installed on the operating system 21 . The application software 23 is, for example, application software (hereinafter sometimes referred to as “POS application”) for realizing POS functions.

The operating system 21 has a function of controlling the display device 11 , a function of controlling the first operation device 12 , and a function of controlling the second operation device 13 . The operating system 21 also has a function of controlling application software 23 . This implements a POS terminal.

Here, the operating system 21 uses mouse events to control the first operation device 12 . In the operating system 21, mouse events are used to control the second operation device 13. FIG. The application software 23 is software corresponding to mouse events.

For example, in the operating system 21 , correspondence relationships between pointer events (or touch events) and mouse events are set in advance for the first operation device 12 . When an operation input is detected by the first operation device 12, the operating system 21 generates a pointer event (or touch event) corresponding to the detected operation. The operating system 21 then generates a mouse event corresponding to the generated pointer event (or touch event). The application software 23 executes processing according to the generated mouse event.

Further, in the operating system 21, the correspondence relationship between the pointer event and the mouse event is set in advance for the second operation device 13. FIG. When an operation input is detected by the second operation device 13, the operating system 21 generates a pointer event corresponding to the detected operation. The operating system 21 then generates a mouse event corresponding to the generated pointer event. The application software 23 executes processing according to the generated mouse event.

That is, when the first operation device 12 is configured by a contact-type touch panel, this touch panel is a touch panel of a mouse device. Further, when the second operation device 13 is composed of a non-contact touch panel, this touch panel is a touch panel of a mouse device.

In the following, among the functions of the operating system 21, the additional software 22, and the application software 23, the functions related to the process of making the buttons respond to the input of the operation of pressing the buttons will be mainly described. It is assumed that the operation of pressing the button is input to the second operation device 13 .

As shown in FIG. 4, the operating system 21 includes first event generating means 31, third event generating means 32 and fourth event generating means 33. FIG. The additional software 22 includes second event generating means 41 and event discarding means 42 . Application software 23 includes button response means 51 .

When the user presses a button using the second operation device 13, the user first moves the pointer O in the vertical direction so that the tip of the pointer O enters the detection area A from outside the detection area A. . Next, the user brings the tip of the indicator O out of the detection area A from inside the detection area A by moving the indicator O in the vertical direction. That is, the user first inputs a pointer-down operation and then inputs a pointer-up operation. Hereinafter, a virtual plane in the detection area A that is parallel to the screen of the display device 11 may be referred to as a "detection plane" (not shown). A pointer-down operation and a pointer-up operation are input at the same or substantially the same position on the detection plane.

When an input of a pointer down operation is detected by the second operation device 13, the first event generating means 31 of the operating system 21 generates a pointer down event (for example, "WM_POINTERDOWN" event) corresponding to the detected pointer down operation. generate. That is, the first event generating means 31 generates a pointer event indicating pointer down at the position where the pointer down operation is input. Hereinafter, the pointer event (more specifically, the pointer down event) generated by the first event generation means 31 may be referred to as "first event".

When an input of a pointer-up operation is detected by the second operation device 13, the third event generating means 32 of the operating system 21 generates a pointer-up event (for example, "WM_POINTERUP" event) corresponding to the detected pointer-up operation. generate. That is, the third event generating means 32 generates a pointer event indicating pointer-up at the position where the pointer-up operation is input. Hereinafter, a pointer event (more specifically, a pointer-up event) generated by the third event generation means 32 may be referred to as a "third event".

A fourth event generating means 33 of the operating system 21 generates a mouse-down event (for example, "WM_LBUTTONDOWN" event) and a mouse-up event (for example, "WM_LBUTTONUP" event) when a pointer-up event occurs next to a pointer-down event in the operating system 21. generate This is the specification of the operating system 21 .

More specifically, the fourth event generator 33 generates a mouse event indicating mouse down at the position where the pointer down operation and the pointer up operation are input. Further, the fourth event generator 33 generates a mouse event indicating mouse-up at the position where the pointer-down operation and the pointer-up operation are input. A mouse event (more specifically, a mouse-down event and a mouse-up event) generated by the fourth event generating means 33 is hereinafter sometimes referred to as a "fourth event".

The second event generating means 41 of the additional software 22 generates a mouse-down event (eg, "WM_LBUTTONDOWN" event) and a mouse-up event (eg, "WM_LBUTTONUP" event) when the operating system 21 generates a pointer-down event.

More specifically, when the first event generating means 31 generates the first event, the second event generating means 41 generates a mouse-down indicating mouse-down at the position where the pointer-down operation corresponding to the first event is input. raise an event. Also, the second event generating means 41 generates a mouse event indicating mouse up at the position where the pointer down operation corresponding to the first event is input. A mouse event (more specifically, a mouse-down event and a mouse-up event) generated by the second event generating means 41 is hereinafter sometimes referred to as a "second event".

When the operating system 21 generates a mouse-down event and a mouse-up event, the event discarding means 42 of the additional software 22 discards the generated mouse-down event and mouse-up event. More specifically, the event discarding means 42 discards the generated fourth event when the fourth event generating means 33 generates the fourth event.

When a mouse-down event and a mouse-up event occur, the button reaction means 51 of the application software 23 causes the button to react according to the mouse-down and mouse-up indicated by these events. More specifically, when the second event generating means 41 generates the second event, the button reaction means 51 causes the button to react according to mouse-down and mouse-up indicated by the generated second event.

Here, as described above, the fourth event generated by the fourth event generator 33 is discarded by the event discarder 42 . Therefore, when the fourth event generation means 33 generates the fourth event, the process of reacting the button according to the mouse-down and mouse-up indicated by the generated fourth event is not executed. In other words, by discarding the fourth event, the execution of the process of reacting the button in response to mouse-down and mouse-up indicated by the fourth event is canceled or skipped.

In this manner, the main part of the terminal device 1 is configured.

Next, the hardware configuration of the information processing device 3 in the terminal device 1 will be described with reference to FIG.

As shown in FIG. 5, the information processing device 3 is composed of a computer 61 . The computer 61 has a processor 71 and a memory 72 . The memory 72 stores programs corresponding to the operating system 21 , programs corresponding to the additional software 22 , and programs corresponding to the application software 23 . The processor 71 reads and executes these programs. Thereby, the functions of the operating system 21, the functions of the additional software 22, and the functions of the application software 23 are realized.

Here, the programs corresponding to the operating system 21 include programs for causing the computer 61 to function as the first event generating means 31 , the third event generating means 32 and the third event generating means 32 . Also, the program corresponding to the additional software 22 includes a program for causing the computer 61 to function as the second event generator 41 and the event discarder 42 . Also, the programs corresponding to the application software 23 include programs for causing the computer 61 to function as the button reaction means 51 .

Also, the program corresponding to the additional software 22 is added to the computer 61 separately from the program corresponding to the operating system 21 and the program corresponding to the application software 23 and operates.

The processor 71 is composed of one or more processors. The individual processors are, for example, CPUs (Central Processing Units), GPUs (Graphics Processing Units), microprocessors, microcontrollers or DSPs (Digital Signal Processors).

The memory 72 is composed of one or more memories. Individual memories are those using volatile memory or non-volatile memory. Specifically, for example, the individual memories include RAM (Random Access Memory), ROM (Read Only Memory), flash memory, EPROM (Erasable Programmable Read Only Memory), EEPROM (Electrically Erasable Programmable Rea d Only Memory), solid state Drives, hard disk drives, flexible discs, compact discs, DVDs (Digital Versatile Discs), Blu-ray discs, MO (Magneto Optical) discs, or mini discs are used.

Next, the operation of the information processing device 3 in the terminal device 1 will be described with reference to the flowcharts shown in FIGS. 6A and 6B. More specifically, when the user inputs an operation of pressing a button to the second operation device 13, the operation of the information processing device 3 to cause the button to react will be mainly described.

First, the user inputs a pointer down operation to the second operation device 13 . The second operation device 13 detects the input pointer down operation. When the input of the pointer-down operation is detected by the second operation device 13 (step ST1 "YES"), the first event generating means 31 of the operating system 21 generates a pointer-down event corresponding to the detected pointer-down operation. is generated (step ST2). That is, the first event generator 31 generates the first event.

Next, the second event generator 41 of the additional software 22 generates a mouse-down event and a mouse-up event (step ST3). That is, the second event generator 41 of the additional software 22 generates the second event.

Next, the button reaction means 51 of the application software 23 causes the button to react according to mouse-down and mouse-up indicated by the second event generated in step ST3 (step ST4).

After inputting a pointer down operation to the second operation device 13 , the user inputs a pointer up operation to the second operation device 13 . The second operation device 13 detects the input pointer-up operation. When the input of the pointer-up operation is detected by the second operation device 13 (step ST5 "YES"), the third event generating means 32 of the operating system 21 generates a pointer-up event corresponding to the detected pointer-up operation. is generated (step ST6). That is, the third event generator 32 generates the third event.

Next, the fourth event generator 33 of the operating system 21 generates a mouse-down event and a mouse-up event (step ST7). That is, the fourth event generator 33 generates the fourth event.

Next, the event discarding means 42 of the additional software 22 discards the mouse-down event and mouse-up event generated in step ST7 (step ST8). As a result, the process of reacting the button in response to mouse-down and mouse-up indicated by the fourth event is not executed.

Next, a terminal device 1' for comparison with the terminal device 1 according to the first embodiment will be described with reference to FIGS. 7, 8, 9A and 9B.

As shown in FIG. 7, the terminal device 1' includes an input/output device 2' and an information processing device 3'. The input/output device 2' comprises a display device 11', a first operating device 12' and a second operating device 13'. The information processing device 3' comprises an operating system 21' and application software 23'.

The display device 11 ′ is the same as the display device 11 in the terminal device 1 . The first operation device 12 ′ is the same as the first operation device 12 in the terminal device 1 . The second operation device 13 ′ is the same as the second operation device 13 in the terminal device 1 . The operating system 21 ′ is similar to the operating system 21 in the terminal device 1 . The application software 23 ′ is similar to the application software 23 in the terminal device 1 .

That is, as shown in FIG. 8, the operating system 21' comprises first event generating means 31', third event generating means 32' and fourth event generating means 33'. The first event generating means 31 ′ is the same as the first event generating means 31 in the terminal device 1 . The third event generating means 32 ′ is the same as the third event generating means 32 in the terminal device 1 . The fourth event generating means 33 ′ is the same as the fourth event generating means 33 in the terminal device 1 .

The application software 23' also comprises button reaction means 51'. The button reaction means 51 ′ is the same as the button reaction means 51 in the terminal device 1 .

Here, the information processing device 3 ′ does not have software corresponding to the additional software 22 in the terminal device 1 . That is, the information processing device 3 ′ does not have means corresponding to the second event generating means 41 in the terminal device 1 . In addition, the information processing device 3 ′ does not have means corresponding to the event discarding means 42 in the terminal device 1 .

Therefore, in the terminal device 1', when the first event generating means 31' generates the pointer down event, the mouse down event and mouse up event corresponding to the second event do not occur. As a result, the process of reacting the button in response to mouse-down and mouse-up indicated by the second event is not executed either. On the other hand, in the terminal device 1', when the fourth event generator 33' generates the fourth event, the generated fourth event is not discarded. For this reason, a process of reacting the button is executed according to the mouse-down and mouse-up indicated by the generated fourth event.

9A and 9B are flowcharts showing the operation of the information processing device 3' in the terminal device 1'. More specifically, FIGS. 9A and 9B show how the information processing device 3' makes the button react when the user inputs an operation of pressing the button to the second operation device 13'.

First, the user inputs a pointer down operation to the second operation device 13'. The second operation device 13' detects the input pointer down operation. When the input of the pointer down operation is detected by the second operation device 13′ (step ST1′ “YES”), the first event generating means 31′ of the operating system 21′ responds to the detected pointer down operation. A pointer down event is generated (step ST2'). That is, the first event generator 31' generates the first event.

After inputting a pointer-down operation to the second operation device 13', the user inputs a pointer-up operation to the second operation device 13'. The second operation device 13' detects the input pointer-up operation. When the input of the pointer-up operation is detected by the second operation device 13' (step ST5' "YES"), the third event generating means 32' of the operating system 21' responds to the detected pointer-up operation. A pointer-up event is generated (step ST6'). That is, the third event generator 32' generates the third event.

Next, the fourth event generator 33' of the operating system 21' generates a mouse-down event and a mouse-up event (step ST7'). That is, the fourth event generator 33' generates the fourth event.

Next, the button reaction means 51' of the application software 23' causes the button to react according to the mouse-down and mouse-up indicated by the fourth event generated in step ST7' (step ST4').

Next, specific examples of operation inputs and screen transitions in the terminal device 1' will be described with reference to FIGS. 10A to 10D. Further, specific examples of operation inputs and screen transitions in the terminal device 1 will be described with reference to FIGS. 11A to 11C. In addition, the advantages of the terminal device 1 compared to the terminal device 1' will be described.

As shown in FIG. 10A, an image including a plurality of buttons is displayed on the screen S of the display device 11'. The user presses one button B out of the plurality of buttons using the second operation device 13'.

First, the user puts the indicator O (for example, finger) in the position corresponding to the button B in the detection area A by moving the indicator O (for example, a finger) in the vertical direction. That is, the user inputs a pointer down operation (see FIG. 10B). At this time, since software corresponding to the additional software 22 is not installed in the terminal device 1', no mouse-down event or mouse-up event occurs. Therefore, button B does not react.

Next, the user brings out the indicator O from the detection area A by moving the indicator O in the vertical direction. That is, the user inputs a pointer-up operation (see FIG. 10C). At this time, the fourth event generator 33' of the operating system 21' generates a mouse-down event and a mouse-up event. The button reacting means 51' of the application software 23' reacts the button B according to the mouse-down and mouse-up indicated by the generated mouse-down event and mouse-up event.

More specifically, the button reaction means 51' causes the screen S to display an effect indicating that the button B has reacted (see FIG. 10C). Next, the button reaction means 51' changes the screen S of the display device 11' (see FIG. 10D). FIG. 10D shows the screen S after transition.

Thus, in the terminal device 1', after the user inputs the pointer down operation, the button B does not react until the user inputs the pointer up operation. In other words, the timing at which the button B reacts is delayed with respect to the timing at which the user starts pressing the button B. Due to the occurrence of such a time lag, there has been a problem that the user feels uncomfortable with the operation.

Note that the operating system 21' displays a visual feedback F at a position on the screen S where the pointer-down operation is input when a pointer-down event (for example, a pointer-down event included in the first event) occurs. (see FIG. 10B). Also, the operating system 21' displays the mouse pointer P at a position corresponding to the mouse down on the screen S when a mouse down event (for example, a mouse down event included in the fourth event) occurs. is also good (see FIG. 10C).

However, the operating system 21' may have a function to make the displayed mouse pointer P invisible. For example, the operating system 21' may have a function to make the displayed mouse pointer P transparent.

On the other hand, when using the terminal device 1, it is as follows.

As shown in FIG. 11A, the screen S of the display device 11 displays an image including a plurality of buttons. The user uses the second operation device 13 to press one button B out of the plurality of buttons.

First, the user puts the indicator O (for example, finger) in the position corresponding to the button B in the detection area A by moving the indicator O (for example, a finger) in the vertical direction. That is, the user inputs a pointer down operation (see FIG. 11B). At this time, since the additional software 22 is installed in the terminal device 1, a mouse-down event and a mouse-up event occur. The button reaction means 51 of the application software 23 causes the button B to react according to the mouse-down and mouse-up indicated by the generated mouse-down event and mouse-up event.

More specifically, the button reaction means 51 causes the screen S to display an effect indicating that the button B has reacted (see FIG. 11B). Next, the button reaction means 51 transitions the screen S of the display device 11 (see FIG. 11C). FIG. 11C shows the screen S after transition.

As described above, in the terminal device 1, the button B reacts when the user inputs the pointer down operation. Therefore, it is possible to prevent the timing of the response of the button B from being delayed with respect to the timing of starting the operation of pressing the button B by the user. In other words, the time lag can be reduced compared to the terminal device 1'. As a result, it is possible to prevent the user from feeling uncomfortable with the operation due to such a time lag.

Note that the operating system 21 displays a visual feedback F at a position on the screen S where the pointer-down operation is input when a pointer-down event (for example, a pointer-down event included in the first event) occurs. There may be (see FIG. 11B). Further, the operating system 21 displays the mouse pointer P at the position corresponding to the mouse down on the screen S when a mouse down event (for example, the mouse down event included in the second event) occurs. Good (see FIG. 11B).

However, the operating system 21 may have a function of making the displayed mouse pointer P invisible. For example, the operating system 21 may have a function to make the displayed mouse pointer P transparent.

Further, when the additional software 22 discards the mouse-down event and the mouse-up event (that is, the mass-down event and the mouse-up event included in the fourth event), the additional software 22 cancels or cancels the display of the mouse pointer P corresponding to the mouse-down event. It may have a skip function.

Next, a modification of the terminal device 1 will be described with reference to FIG. 12 . More specifically, the terminal device 1 included in the information processing system 100 will be described. In other words, an information processing system 100 including the terminal device 1 will be described. In FIG. 12, blocks similar to those shown in FIG. 1 are denoted by the same reference numerals, and descriptions thereof are omitted.

As shown in FIG. 12 , the information processing system 100 includes a terminal device 1 and a server device 5 . The terminal device 1 can freely communicate with the server device 5 via the network NW. The network NW is configured by the Internet, for example.

The terminal device 1 is, for example, a POS terminal. The server device 5 is, for example, a POS server. The terminal device 1 and the server device 5 constitute a main part of the POS system. That is, the information processing system 100 is, for example, a POS system.

As shown in FIG. 12 , the application software 23 may be provided in the server device 5 instead of being provided in the terminal device 1 . Even in this case, the operating system 21 and the additional software 22 can cooperate with the application software 23 by the terminal device 1 communicating with the server device 5 . As a result, the processing shown in FIGS. 6A and 6B can be realized.

Next, another modified example of the terminal device 1 will be described. Note that these modifications are similarly applied to the information processing system 100 as well.

First, the terminal device 1 may not have the first operation device 12 . In other words, the terminal device 1 may include only the second operation device 13 out of the first operation device 12 and the second operation device 13 .

Second, the second operation device 13 is not limited to a non-contact touch panel using infrared rays. The second operating device 13 may be any non-contact digitizer that is controlled using mouse events.

Thirdly, the terminal device 1 is not limited to a POS terminal. The terminal device 1 may be any terminal as long as it has the input/output device 2 and the information processing device 3 . Also, the server device 5 is not limited to a POS server. The server device 5 may be any server as long as it realizes the information processing system 100 by cooperating with the terminal device 1 . Moreover, the information processing system 100 is not limited to a POS system. The information processing system 100 may be any system as long as it includes the terminal device 1 .

For example, the terminal device 1 may be a kiosk terminal installed in a facility such as a store. In this case, the server device 5 may be a server for a kiosk system. Also, the information processing system 100 may be a kiosk system.

Alternatively, for example, the terminal device 1 may be a lending management terminal installed in a facility such as a library. In this case, the server device 5 may be a server for a rental management system. The information processing system 100 may also be a rental management system.

Alternatively, for example, the terminal device 1 may be a reception terminal installed in a facility such as a hospital. In this case, the server device 5 may be a server for a reception system. Also, the information processing system 100 may be a reception system.

Alternatively, for example, the terminal device 1 may be a terminal for an ATM (Automatic Teller Machine) installed in a facility such as a bank. In this case, the server device 5 may be a server for the ATM system. Also, the information processing system 100 may be an ATM system.

Next, effects of the terminal device 1 will be described. Note that these effects are similarly realized in the information processing system 100 as well.

As described above, the first event generating means 31 generates the first operation (pointer down operation) corresponding to pointer down when the first operation (pointer down operation) is input to the non-contact digitizer (second operation device 13). A first event (pointer-down event) indicating pointer-down corresponding to the pointer-down operation) is generated. The second event generating means 41 generates a second event (mouse-down event) indicating both mouse-down and mouse-up at the position where the first operation (pointer-down operation) is input when the first event (pointer-down event) occurs. event and mouseup event). When a second event (mouse-down event and mouse-up event) occurs, the button reaction means 51 activates a software key (button) in response to mouse-down and mouse-up indicated by the second event (mouse-down event and mouse-up event). to react.

By providing the second event generating means 41 in this manner, the button can be made to react when the user inputs the pointer down operation. As a result, compared to the terminal device 1', it is possible to reduce the time lag of the reaction of the button to the input of the operation of pressing the button.

Further, the third event generation means 32 responds to the second operation (pointer-up operation) when a second operation (pointer-up operation) corresponding to pointer-up is input to the digitizer (second operation device 13). A third event (pointer-up event) is generated to indicate pointer-up. The fourth event generation means 33 generates a first operation (pointer down operation) and a second operation (pointer up operation) when a third event (pointer up event) occurs after the first event (pointer down event) has occurred. generate a fourth event (mousedown event and mouseup event) that indicates both mousedown and mouseup at the entered position. Event discarding means 42 discards the fourth event (mouse-down event and mouse-up event) when the fourth event (mouse-down event and mouse-up event) occurs.

By providing the event canceling means 42 in this way, it is possible to avoid double execution of the button reaction process when the user inputs an operation of pressing a button. That is, after the process of making the button respond to mouse-down and mouse-up indicated by the second event is executed, the process of making the button react to mouse-down and mouse-up indicated by the fourth event is executed. can be avoided.

Also, the first event generation means 31 and the button reaction means 51 are implemented by the operating system 21 and the application software 23 . The second event generation means 41 is implemented by the additional software 22 . Additional software 22 is added to terminal device 1 separately from operating system 21 and application software 23 .

As a result, the time lag as described above can be reduced without modifying the operating system 21 . Specifically, for example, the above time lag can be reduced without modifying the operating system 21 so as to generate a mouse-down event and a mouse-up event when a pointer-down event occurs. Moreover, the time lag as described above can be reduced without changing the application software 23 . Specifically, for example, it is possible to reduce the time lag as described above without changing a POS application that makes a button react in response to a mouse event to a POS application that makes a button respond in response to a pointer event. can be done.

Also, the first event generation means 31 , the button reaction means 51 , the third event generation means 32 and the fourth event generation means 33 are realized by the operating system 21 and the application software 23 . The second event generating means 41 and the event discarding means 42 are implemented by the additional software 22 . Additional software 22 is added to terminal device 1 separately from operating system 21 and application software 23 .

As a result, it is possible to reduce the time lag as described above without modifying the operating system 21, and to avoid the double reaction of the buttons. Moreover, the time lag as described above can be reduced without changing the application software 23, and the double reaction of the button can be avoided.

[Second embodiment]
FIG. 13 is a block diagram showing an information processing system according to the second embodiment. An information processing system according to the second embodiment will be described with reference to FIG. Also, FIG. 14 is a block diagram showing a terminal device according to the second embodiment. A terminal device according to the second embodiment will be described with reference to FIG. FIG. 15 is a block diagram showing additional software according to the second embodiment. Additional software according to the second embodiment will be described with reference to FIG. 13 to 15, elements similar to those shown in FIGS. 1 to 4 are denoted by the same reference numerals, and description thereof is omitted.

Here, the information processing system 100 according to the first embodiment is an example of the information processing system 100a according to the second embodiment. Also, the terminal device 1 according to the first embodiment is an example of the terminal device 1a according to the second embodiment. Further, the additional software 22 according to the first embodiment is an example of the additional software 22a according to the second embodiment.

That is, as shown in FIG. 13, the terminal device 1a includes first event generating means 31, second event generating means 41, and button reaction means 51. FIG. Further, as shown in FIG. 14, the information processing system 100a includes a first event generation means 31, a second event generation means 41 and a button response means 51. FIG. Further, as shown in FIG. 15, the additional software 22a includes the second event generating means 41 out of the first event generating means 31, the second event generating means 41 and the button reaction means 51. FIG. Even in these cases, the same effects as those described in the first embodiment can be obtained.

That is, when the first operation (pointer-down operation) corresponding to pointer-down is input to the non-contact digitizer (second operation device 13), the first event generation means 31 generates the first operation (pointer-down operation). A first event (pointer down event) indicating pointer down corresponding to the operation) is generated. The second event generation means 41 generates a second event (mouse-down event) indicating both mouse-down and mouse-up at the position where the first operation (pointer-down operation) is input when the first event (pointer-down event) occurs. event and mouseup event). When a second event (mouse-down event and mouse-up event) occurs, the button reaction means 51 activates a software key (button) in response to mouse-down and mouse-up indicated by the second event (mouse-down event and mouse-up event). to react.

By providing the second event generating means 41 in this manner, the button can be made to react when the user inputs the pointer down operation. As a result, compared to the case where the second event generating means 41 is not provided, it is possible to reduce the time lag of the reaction of the button to the input of the operation of pressing the button.

The information processing system 100a includes third event generating means 32, fourth event generating means 33, and event discarding means 42 in addition to first event generating means 31, second event generating means 41, and button reaction means 51. It can be anything. These means may be distributed among a plurality of devices (including terminal devices and server devices).

Further, the terminal device 1a includes third event generating means 32, fourth event generating means 33 and event discarding means 42 in addition to first event generating means 31, second event generating means 41 and button reaction means 51. can be

Further, the additional software 22a includes the third event generating means 32, the fourth event generating means 33 and the event discarding means 42 among the event discarding means 42 in addition to the second event generating means 41. can be That is, the additional software 22a may include the second event generating means 41 and the event discarding means 42. FIG.

Although the present disclosure has been described with reference to the embodiments, the present disclosure is not limited to the above embodiments. Various changes that can be understood by those skilled in the art can be made to the configuration and details of the present disclosure within the scope of the present disclosure.

Some or all of the above-described embodiments can also be described in the following supplementary remarks, but are not limited to the following.

Hereinafter, the function of the first event generating means 31 will be referred to as "first event generating function". Also, the function of the second event generating means 41 is called a "second event generating function". Further, the function of the button reaction means 51 is called "button reaction function". Also, the function of the third event generating means 32 is called a "third event generating function". Also, the function of the fourth event generating means 33 is called a "fourth event generating function". Also, the function of the event discarding means 42 is called an "event discarding function". A program corresponding to the operating system 21 and a program corresponding to the application software 23 are collectively referred to as "basic program". A program corresponding to the additional software 22 or the additional software 22a is called an "additional program".

[Appendix]
[Appendix 1]
first event generating means for generating a first event indicating pointer down corresponding to the first operation when a first operation corresponding to pointer down is input to the non-contact digitizer;
a second event generating means for generating a second event indicating both mouse-down and mouse-up at the position where the first operation is input when the first event occurs;
button reaction means for causing a software key to react in response to mouse-down and mouse-up indicated by said second event when said second event occurs;
An information processing system comprising
[Appendix 2]
third event generating means for generating a third event indicating pointer-up corresponding to the second operation when a second operation corresponding to pointer-up is input to the digitizer;
generating a fourth event indicating both mouse-down and mouse-up at a position where both the first operation and the second operation are input when the third event occurs after the first event occurs; 4 event generation means;
event discarding means for discarding the fourth event when the fourth event occurs;
The information processing system according to appendix 1, comprising:
[Appendix 3]
The first event generating means and the button reaction means are realized by an operating system and application software,
The second event generation means is realized by additional software,
The information processing system according to appendix 1, wherein the additional software is added to the information processing system separately from the operating system and the application software.
[Appendix 4]
The first event generating means, the button reaction means, the third event generating means, and the fourth event generating means are realized by an operating system and application software,
The second event generating means and the event discarding means are realized by additional software,
The information processing system according to appendix 2, wherein the additional software is added to the information processing system separately from the operating system and the application software.
[Appendix 5]
first event generating means for generating a first event indicating pointer down corresponding to the first operation when a first operation corresponding to pointer down is input to the non-contact digitizer;
a second event generating means for generating a second event indicating both mouse-down and mouse-up at the position where the first operation is input when the first event occurs;
button reaction means for causing a software key to react in response to mouse-down and mouse-up indicated by said second event when said second event occurs;
terminal device.
[Appendix 6]
third event generating means for generating a third event indicating pointer-up corresponding to the second operation when a second operation corresponding to pointer-up is input to the digitizer;
generating a fourth event indicating both mouse-down and mouse-up at a position where both the first operation and the second operation are input when the third event occurs after the first event occurs; 4 event generation means;
event discarding means for discarding the fourth event when the fourth event occurs;
The terminal device according to appendix 5, comprising:
[Appendix 7]
The first event generating means and the button reaction means are realized by an operating system and application software,
The second event generation means is realized by additional software,
The terminal device according to appendix 5, wherein the additional software is added to the terminal device separately from the operating system and the application software.
[Appendix 8]
The first event generating means, the button reaction means, the third event generating means, and the fourth event generating means are realized by an operating system and application software,
The second event generating means and the event discarding means are realized by additional software,
The terminal device according to appendix 6, wherein the additional software is added to the terminal device separately from the operating system and the application software.
[Appendix 9]
when a first operation corresponding to pointer down is input to the non-contact digitizer, a first event generating means generates a first event indicating pointer down corresponding to the first operation;
when the first event occurs, a second event generating means generates a second event indicating both mouse-down and mouse-up at the position where the first operation is input;
A control method, wherein when the second event occurs, the button reaction means reacts a software key according to mouse-down and mouse-up indicated by the second event.
[Appendix 10]
when a second operation corresponding to pointer-up is input to the digitizer, a third event generating means generates a third event indicating pointer-up corresponding to the second operation;
When the third event occurs after the first event occurs, a fourth event generating means indicates both mouse down and mouse up at a position where both the first operation and the second operation are input. generate a fourth event,
The control method according to appendix 9, wherein the event discarding means discards the fourth event when the fourth event occurs.
[Appendix 11]
The first event generating means and the button reaction means are realized by an operating system and application software,
The second event generation means is realized by additional software,
The control method according to appendix 9, wherein the additional software is added to the information processing system or the terminal device separately from the operating system and the application software.
[Appendix 12]
The first event generating means, the button reaction means, the third event generating means, and the fourth event generating means are realized by an operating system and application software,
The second event generating means and the event discarding means are realized by additional software,
11. The control method according to appendix 10, wherein the additional software is added to the information processing system or the terminal device separately from the operating system and the application software.
[Appendix 13]
a first event generation function for generating a first event indicating pointer down corresponding to the first operation when a first operation corresponding to pointer down is input to the non-contact digitizer;
a button reaction function for causing a software key to react in response to the mouse-down and mouse-up indicated by the second event when a second event indicating both mouse-down and mouse-up at the position where the first operation is input occurs; ,
An additional program that operates in addition to the basic program that implements on a computer,
An additional program that causes the computer to implement a second event generation function that generates the second event when the first event occurs.
[Appendix 14]
The basic program is
a third event generation function for generating a third event indicating pointer up corresponding to the second operation when a second operation corresponding to pointer up is input to the digitizer;
generating a fourth event indicating both mouse-down and mouse-up at a position where both the first operation and the second operation are input when the third event occurs after the first event occurs; 4 event generation function,
on the computer,
Such additional programs are:
14. The additional program according to Supplementary Note 13, causing the computer to implement an event discarding function of discarding the fourth event when the fourth event occurs.
[Appendix 15]
15. The additional program according to appendix 13 or appendix 14, which is added to the computer separately from the base program.
[Appendix 16]
16. The additional program according to any one of appendices 13 to 15, wherein the basic program includes a program corresponding to an operating system and a program corresponding to application software.
[Appendix 17]
A recording medium recording the additional program according to any one of appendices 13 to 16.

1, 1a terminal device 2 input/output device 3 information processing device 4 main body 5 server device 11 display device 12 first operation device 13 second operation device 21 operating system 22, 22a additional software 23 application software 31 first event generating means 32 second 3 event generating means 33 fourth event generating means 41 second event generating means 42 event discarding means 51 button reaction means 61 computer 71 processor 72 memory 100, 100a information processing system

Claims (10)

first event generating means for generating a first event indicating pointer down corresponding to the first operation when a first operation corresponding to pointer down is input to the non-contact digitizer;
a second event generating means for generating a second event indicating both mouse-down and mouse-up at the position where the first operation is input when the first event occurs;
button reaction means for causing a software key to react in response to mouse-down and mouse-up indicated by said second event when said second event occurs;
An information processing system comprising third event generating means for generating a third event indicating pointer-up corresponding to the second operation when a second operation corresponding to pointer-up is input to the digitizer;
generating a fourth event indicating both mouse-down and mouse-up at a position where both the first operation and the second operation are input when the third event occurs after the first event occurs; 4 event generation means;
event discarding means for discarding the fourth event when the fourth event occurs;
The information processing system according to claim 1, comprising: first event generating means for generating a first event indicating pointer down corresponding to the first operation when a first operation corresponding to pointer down is input to the non-contact digitizer;
a second event generating means for generating a second event indicating both mouse-down and mouse-up at the position where the first operation is input when the first event occurs;
button reaction means for causing a software key to react in response to mouse-down and mouse-up indicated by said second event when said second event occurs;
terminal device. third event generating means for generating a third event indicating pointer-up corresponding to the second operation when a second operation corresponding to pointer-up is input to the digitizer;
generating a fourth event indicating both mouse-down and mouse-up at a position where both the first operation and the second operation are input when the third event occurs after the first event occurs; 4 event generation means;
event discarding means for discarding the fourth event when the fourth event occurs;
The terminal device according to claim 3, comprising: when a first operation corresponding to pointer down is input to the non-contact digitizer, a first event generating means generates a first event indicating pointer down corresponding to the first operation;
when the first event occurs, a second event generating means generates a second event indicating both mouse-down and mouse-up at the position where the first operation is input;
A control method, wherein when the second event occurs, the button reaction means reacts a software key according to mouse-down and mouse-up indicated by the second event. when a second operation corresponding to pointer-up is input to the digitizer, a third event generating means generates a third event indicating pointer-up corresponding to the second operation;
When the third event occurs after the first event occurs, a fourth event generating means indicates both mouse down and mouse up at a position where both the first operation and the second operation are input. generate a fourth event,
6. The control method according to claim 5, wherein when said fourth event occurs, event discarding means discards said fourth event. a first event generation function for generating a first event indicating pointer down corresponding to the first operation when a first operation corresponding to pointer down is input to the non-contact digitizer;
a button reaction function for causing a software key to react in response to the mouse-down and mouse-up indicated by the second event when a second event indicating both mouse-down and mouse-up at the position where the first operation is input occurs; ,
An additional program that operates in addition to the basic program that implements on a computer,
An additional program that causes the computer to implement a second event generation function that generates the second event when the first event occurs. The basic program is
a third event generation function for generating a third event indicating pointer up corresponding to the second operation when a second operation corresponding to pointer up is input to the digitizer;
generating a fourth event indicating both mouse-down and mouse-up at a position where both the first operation and the second operation are input when the third event occurs after the first event occurs; 4 event generation function,
on the computer,
Such additional programs are:
8. The additional program according to claim 7, causing the computer to realize an event discarding function of discarding the fourth event when the fourth event occurs. 9. The additional program according to claim 7, wherein the additional program is added to the computer separately from the basic program. 10. The additional program according to any one of claims 7 to 9, wherein the basic program includes a program corresponding to an operating system and a program corresponding to application software.

Images