WO2023100584A1 - Control device, control method, and program - Google Patents

Abstract

[Problem] To enable more effective utilization of a screen displayed by a display device. [Solution] Provided is a control device comprising a control unit that controls a display so that one or a plurality of selection candidates are displayed as pop-ups, such control performed on the basis of the detection of a finger of a user by an operation input device which is provided separately from the display device.

Description

Control device, control method and program

The present invention relates to a control device, control method and program.

In recent years, there has been known a technique for displaying selectable candidates on a screen based on user operations. For example, a technique has been disclosed in which a button for activating a function is always displayed at a position separate from other display contents (see, for example, Patent Document 1).

JP 2019-45282 A

However, it is required to make more effective use of the screen displayed by the display device.

Therefore, the present invention has been made in view of the above problems, and an object of the present invention is to enable more effective utilization of the screen displayed by the display device.

In order to solve the above problems, according to an aspect of the present invention, one or more selection candidates are popped up based on detection of a user's finger by an operation input device provided separately from a display device. A control device is provided comprising a control unit for controlling the display device to be displayed.

In order to solve the above problems, according to another aspect of the present invention, one or more selections are made based on detection of the user's finger by an operation input device provided separately from the display device. A method of control is provided including controlling the display device to pop up a candidate.

Further, in order to solve the above problems, according to another aspect of the present invention, a computer is operated by an operation input device provided separately from a display device based on detection of a user's finger. A program functioning as a control device is provided, which includes a control unit that controls the display device so that a plurality of selection candidates are popped up.

As described above, according to the present invention, the screen displayed by the display device can be used more effectively.

It is a figure which shows the example of the appearance of the system which concerns on embodiment of this invention. FIG. 10 is a diagram for explaining an example of detection of a finger moving direction along the Y-axis; It is a figure which shows the functional structural example of a control apparatus. FIG. 10 is a diagram showing an example of a screen on which upper-level icons are popped up; FIG. 10 is a diagram showing an example of a screen on which a function activation icon and a function adjustment icon are popped up; 4 is a flow chart showing an operation example of the control device according to the embodiment of the present invention;

Preferred embodiments of the present invention will be described in detail below with reference to the accompanying drawings. In the present specification and drawings, constituent elements having substantially the same functional configuration are denoted by the same reference numerals, thereby omitting redundant description.

<0. Background>
First, the background of the embodiments of the present invention will be described.

In general, in order for the user to select the function to activate, it is necessary to provide a switch for selecting the function. For example, there are cases where a switch (hereinafter also referred to as an "independent switch") independent of the display device is provided outside the display device visually recognized by the user. Alternatively, an icon having a switch function may always be provided in the screen of the display device visually recognized by the user.

If an independent switch is provided, a space separate from the display device will be required for the independent switch. On the other hand, if an icon having a switch function is always provided, the space in which the icon is provided will not be used for other display content, so the other display content will always be narrow.

Furthermore, if many icons are displayed at once, other display contents will become narrower. Therefore, hierarchization may be used in which an icon positioned higher than a plurality of icons is displayed, and when the higher-ranked icon is selected, the plurality of icons are displayed. However, when layered, it may take a long time to display the icon corresponding to the function that the user actually wants to activate.

In order to avoid hierarchies, it is also conceivable to predetermine frequently used functions and to always display icons corresponding to the predetermined functions (hereinafter also referred to as "shortcut icons"). However, the space in which the shortcut icon is displayed is no longer used for other display contents, so other display contents tend to become narrower.

Therefore, in this specification, the technology that enables more effective use of the screen displayed by the display device will be mainly described.

The background of the embodiments of the present invention has been described above.

<1. embodiment>
Next, details of embodiments of the present invention will be described.

(1.1. System configuration)
First, a configuration example of a system according to an embodiment of the present invention will be described with reference to FIG.

FIG. 1 is a diagram showing an example of the appearance of a system according to an embodiment of the present invention. As shown in FIG. 1, a system 1 according to an embodiment of the present invention includes an operation input device 10 and a display device 20. FIG. Note that the system 1 further includes a control device (FIG. 3) as will be described later.

In the embodiment of the present invention, it is mainly assumed that the system 1 is installed inside the vehicle. In such a case, the user using the system 1 may be a user in the vehicle (for example, a driver, a person sitting in a front passenger seat, etc.). However, the place where the system 1 is installed is not limited to the interior of the vehicle.

Also, as shown in FIG. 1, in the embodiment of the present invention, it is assumed that the operation input device 10 and the display device 20 are provided separately. More specifically, in the embodiment of the present invention, unlike the configuration in which the operation input device 10 and the display device 20 are stacked (the configuration of a so-called touch panel), the operation input device 10 and the display device 20 are stacked. and separate configurations are employed.

Therefore, in the embodiment of the present invention, it is required to give the user a feeling that the operation on the operation input device 10 and the display by the display device 20 are linked.

(Display device 20)
The display device 20 displays various information under the control of the control device 30 (FIG. 3). Here, the type of display device 20 is not limited. For example, the display device 20 may be an LCD (Liquid Crystal Display), an organic EL (Electro-Luminescence) display, or a PDP (Plasma Display Panel).

In the example shown in FIG. 1, the user does not touch the operation input device 10 with his finger. At this time, no icon is displayed on the screen of the display device 20, and other display contents are displayed. As a result, other display contents are displayed in a large size, and the screen is effectively utilized. In the example shown in FIG. 1, a map (for example, a navigation screen) is displayed as another example of display content. However, other display contents displayed on the screen of the display device 20 are not limited to the map.

(Operation input device 10)
The operation input device 10 includes an operation unit 110 that receives an operation input by a user's finger. The operation unit 110 has an operation surface 115 with which the user touches with a finger when inputting an operation. The operation surface 115 is provided with a sensor that detects the contact of the user's finger. As an example of such a sensor, an electrostatic sensor can be used, but the type of sensor is not particularly limited.

The operation unit 110 detects the position of the user's finger on the X axis (first axis) as the detection position. More specifically, the operation unit 110 detects the contact position of the user's finger on the operation surface 115 on the X axis as the detection position.

Furthermore, the operation unit 110 detects the moving direction of the user's finger along the Y axis (second axis). More specifically, the operation unit 110 detects the direction in which the user moves the finger along the Y-axis while touching the operation surface 115 as the finger movement direction. Here, an example of detection of the moving direction of the finger along the Y-axis will be described with reference to FIG.

FIG. 2 is a diagram for explaining an example of detection of the finger movement direction along the Y-axis. As shown in FIG. 2, display device 20 has display surface 215 . A screen is displayed on the display surface 215 . The operation unit 110 includes a tact switch 120a and a tact switch 120b.

For example, when the user moves the finger in the +Y direction while touching the operation surface 115, the operation unit 110 moves so that the direction of the operation surface 115 approaches the horizontal direction (that is, counterclockwise in FIG. 2). It rotates and the tact switch 120a is pressed. The operation unit 110 detects the movement of the finger in the +Y direction as the movement direction of the finger by detecting the pressing of the tact switch 120a.

On the other hand, when the user moves the finger in the -Y direction while touching the operation surface 115, the operation unit 110 is moved so that the direction of the operation surface 115 approaches the vertical direction (that is, clockwise in FIG. 2). It rotates and the tact switch 120b is pressed. The operation unit 110 detects the movement of the finger in the -Y direction as the movement direction of the finger by detecting the depression of the tactile switch 120b.

Note that the detection of the finger movement direction along the Y-axis is not limited to this example. For example, instead of tact switch 120a and tact switch 120b, other switches (eg, two contact rubber switches, etc.) may be used. Alternatively, a sensor capable of detecting a finger moved in the +Y direction and a sensor capable of detecting a finger moved in the -Y direction may be additionally provided. At this time, the operation unit 110 does not have to rotate with the movement of the finger. As an example of the sensor, an electrostatic sensor can be used, but the type of sensor is not particularly limited.

Return to Figure 1 and continue the explanation. The X-axis direction and the Y-axis direction are different directions. As shown in FIG. 1, the X and Y axes may be orthogonal. For example, as shown in FIG. 1 , the X-axis may be the longitudinal direction of the operating surface 115 and the Y-axis may be the lateral direction of the operating surface 115 . The Z-axis is orthogonal to both the X-axis and the Y-axis.

For example, the operation surface 115 may be a concave surface curved along the Y-axis. This makes it easier for the operation surface 115 to fit the pad of the finger, so that the usability during operation by the user and the detection accuracy of the contact position of the finger on the operation surface 115 can be improved. The operation input device 10 transmits the detected position of the user's finger on the X-axis to the control device 30 . Furthermore, the operation input device 10 transmits the direction of movement of the user's finger along the Y-axis to the control device 30 .

Here, as an example, it is mainly assumed that the user wants to select icon H2 (Fig. 4) or icon I3 (Fig. 5). At this time, as shown in FIG. 1, the user touches the operation surface 115 with his/her finger. The contact position of the finger on the operation surface 115 on the X-axis is acquired by the control device 30 via the operation input device 10 as a detection position. It should be noted that similar operations can be performed by the system 1 when an icon other than icon H2 (FIG. 4) and icon I3 (FIG. 5) is selected.

(control device 30)
Controller 30 may be implemented by a computer. The control device 30 is connected to the operation input device 10 wirelessly or by wire. Further, the control device 30 is connected to the display device 20 wirelessly or by wire. Note that the control device 30 may be integrated with the operation input device 10 or the display device 20 . A configuration example of the control device 30 will be described with reference to FIG.

FIG. 3 is a diagram showing an example of the functional configuration of the control device 30. As shown in FIG. As shown in FIG. 3 , the control device 30 includes an input section 310 , a control section 320 , a storage section 330 and an output section 340 .

(Input unit 310)
The input unit 310 functions as an input interface with the operation input device 10 . More specifically, the input unit 310 receives input of the detected position of the user's finger on the X-axis, which is transmitted from the operation input device 10 . The input unit 310 outputs the detected position of the user's finger on the X-axis to the control device 30 .

Furthermore, the input unit 310 receives an input of the moving direction of the user's finger along the Y-axis, which is transmitted from the operation input device 10 . The input unit 310 outputs the movement direction of the user's finger along the Y-axis to the control device 30 .

(control unit 320)
Control unit 320 includes a processor, and its functions can be realized by the processor executing a program stored in a memory. At this time, a computer-readable recording medium recording the program may also be provided. Alternatively, these blocks may be composed of dedicated hardware, or may be composed of a combination of multiple pieces of hardware.

For example, the control unit 320 acquires the detected position of the user's finger on the X-axis output from the input unit 310 . Control unit 320 outputs a control signal for controlling display by display device 20 to output unit 340 based on the detected position of the user's finger on the X axis. Details of such display control executed by the control unit 320 will be described later.

Furthermore, the control unit 320 acquires the moving direction of the user's finger along the Y-axis output from the input unit 310 . The control unit 320 outputs a control signal for controlling display by the display device 20 to the output unit 340 based on the moving direction of the user's finger along the Y-axis. Details of such display control executed by the control unit 320 will be described later.

(storage unit 330)
The storage unit 330 appropriately stores data necessary for computation by the processor. The storage unit 330 may be composed of a memory such as a RAM (Random Access Memory), a hard disk drive, or a flash memory.

(Output unit 340)
The output unit 340 functions as an output interface with the display device 20 . More specifically, the output section 340 outputs the control signal output from the control section 320 to the display device 20 . Thereby, the control of the display by the display device 20, which is executed by the control unit 320, can be realized.

(Details of control unit 320)
Next, the details of the functions of the control unit 320 will be described. As described above, when the user wishes to select icon H2 (FIG. 4) or icon I3 (FIG. 5), the user touches operation surface 115 with a finger. The contact position of the finger on the operation surface 115 on the X-axis is acquired by the control unit 320 via the operation input device 10 as a detection position.

The control unit 320 controls the display device 20 so that one or more icons are popped up based on acquisition of the detection position from the operation input device 10 (that is, detection of the user's finger). . As a result, the icon pops up only when the user wants to operate it, so the screen is effectively used.

It should be noted that pop-up display can mean displaying one or more icons so as to be superimposed in front of other display content that has already been displayed.

Here, the type of icon that pops up is not limited. For example, the pop-up icon may include an icon (first selection candidate) for activating a certain function (first function). An icon for activating a function is hereinafter also referred to as a "function activation icon".

Alternatively, the pop-up icon may include an icon (second selection candidate) for adjusting the details of a certain function (second function). Below, the icon for adjusting the detailed content of the function is also referred to as "function adjustment icon".

Alternatively, the popup-displayed icon may include an icon (third selection candidate) for popup-displaying a function activation icon or a function adjustment icon on the display device 20 . Hereinafter, an icon for popping up a function activation icon or a function adjustment icon on the display device 20 is also referred to as a "higher-level icon".

FIG. 4 is a diagram showing an example of a screen in which upper-level icons are popped up. In the example shown in FIG. 4, the control unit 320 controls the display device 20 so that the icons H1 to H4 are popped up based on the detection of the user's finger by the operation input device . Note that each of the icons H1 to H4 is a shortcut icon corresponding to a higher-level icon.

That is, the icon H1 is an icon for pop-up displaying various icons corresponding to functions related to cooling, heating, and air conditioning equipment. The icon H2 is an icon for popping up various icons corresponding to functions related to music. The icon H3 is an icon for popping up various icons corresponding to functions related to driving. The icon H4 is an icon for popping up various icons corresponding to optional functions.

Each of the icons H1 to H4 is an example of selection candidates. Therefore, some or all of the icons H1 to H4 displayed by the display device 20 may be replaced with selection candidates other than icons. For example, a selection candidate may be any object that is displayed to be visually perceived by the user.

Assume that the user wants to select icon H2. At this time, the user touches the position corresponding to the icon H2 on the X-axis on the operation surface 115 with the finger. When the user touches a position corresponding to the icon H2 on the X axis on the operation surface 115, the touch position of the finger on the X axis is detected by the operation input device 10 as a detection position, and the detection position is acquired by the control unit 320. be done.

Then, the user performs a predetermined confirmation operation. Here, the confirmation operation may be an operation of moving the finger along the Y-axis while touching the operation surface 115 with the finger. As an example of a confirmation operation, when the user moves the finger along the Y-axis while touching the operation surface 115, the operation input device 10 moves the finger along the Y-axis (+Y direction or -Y direction). ) is detected, and the direction of movement of the finger along the Y-axis is obtained by the control unit 320 .

Based on the detection of the confirmation operation, the control unit 320 confirms the selection of an icon from the icons H1 to H4 according to the detection position and movement direction. Here, the selection of the icon H2 corresponding to the detected position is confirmed. Upon confirming the selection of the icon H2, the control unit 320 causes the display device 20 to pop-up display various icons corresponding to functions related to music.

FIG. 5 is a diagram showing an example of a screen on which a function activation icon and a function adjustment icon are popped up. In the example shown in FIG. 5, the control unit 320 controls the display device 20 so that the icons I1 to I8 are popped up based on the detection of the user's finger by the operation input device .

The icons I1 to I8 are examples of selection candidates. Therefore, some or all of the icons I1 to I8 popped up by the display device 20 may be replaced with selection candidates other than icons. For example, a selection candidate may be any object that is displayed to be visually perceived by the user.

Icons I1, I3, I5, and I7 form an upper row of icons. On the other hand, icons I2, I4, I6, and I8 form the lower row of icons. Here, it is mainly assumed that the number of icons forming the upper row of icons is four, and the number of icons forming the lower row of icons is four. However, the number of icons forming each of the upper icon row and the lower icon row may be plural.

Icons I1 to I8 are icons corresponding to functions. Icons I1, I2, I7, and I8 are function adjustment icons. Each time one of these function adjustment icons is selected, the details of the function are adjusted. Icons I3 to I6 are function activation icons. Each time one of these feature activation icons is selected, the feature is activated or deactivated.

More specifically, the icon I1 is an icon corresponding to control to increase the audio volume. The icon I2 is an icon corresponding to control for decreasing the audio volume. Icon I3 is an icon corresponding to the cooling function and the dehumidifying function. Icon I4 is an icon corresponding to the automatic setting function of the air conditioner.

Icon I5 is an icon that corresponds to the function (independent mode) of independently adjusting the set temperature on the driver's seat side and the front passenger's seat side. When this function is stopped, it switches to a function (interlocking mode) in which the set temperatures on the driver's side and passenger's side are interlocked. Icon I6 is an icon corresponding to a defroster function for removing fog from the windshield. The icon I7 is an icon corresponding to control for increasing the temperature, which is the reference for adjustment by the air conditioner. The icon I8 is an icon corresponding to the control of lowering the temperature that is the reference for adjustment by the air conditioner.

Note that the types of functions corresponding to the icons I1 to I8 are not limited to these examples.

Assume that the user wants to select icon I3. At this time, the user touches the position corresponding to the icon I3 on the X-axis on the operation surface 115 with the finger. When the user touches a position corresponding to the icon I3 on the X axis on the operation surface 115, the touch position of the finger on the X axis is detected by the operation input device 10 as a detection position, and the detection position is acquired by the control unit 320. be done.

The control unit 320 controls display by the display device 20 of predetermined feedback information according to the detected position of the finger on the X axis. This allows the user to grasp which icon the position corresponding to has been detected.

More specifically, the control unit 320 controls the icon I3 corresponding to the detected position in the upper row of icons (icons I1, I3, I5, I7) and the The display of the feedback information F1 by the display device 20 is controlled at a position sandwiched between the icon I4 corresponding to the detection position.

Note that FIG. 5 shows, as an example of the feedback information F1, a case where the feedback information is displayed with a higher luminance than the luminance of other places where the feedback information is not displayed. However, the feedback information F1 is not limited to such an example. For example, the feedback information F1 may be displayed in some manner different from the display at other locations where the feedback information F1 is not displayed.

Then, as an example of a confirmation operation, when the user moves the finger in the +Y direction while touching the operation surface 115, the operation input device 10 detects the movement direction of the finger (+Y direction), and the control unit 320 The direction of finger movement along the Y-axis is obtained.

Based on the detection of the confirmation operation, the control unit 320 confirms the selection of an icon from the icons I1 to I8 according to the detection position and movement direction. Here, the selection of the icon I3 corresponding to the detection position and movement direction (+Y direction) is confirmed. When the cooling function and the dehumidifying function are stopped, the control unit 320 activates the cooling function and the dehumidifying function based on the confirmation of the selection of the icon I3. On the other hand, when the cooling function and the dehumidification function are activated, the control unit 320 stops the cooling function and the dehumidification function based on the confirmation of the selection of the icon I3.

If the moving direction (−Y direction) of the finger is detected and the confirmation operation is detected, the control unit 320 confirms the selection of the icon I4 corresponding to the detected position and the moving direction (−Y direction). . When the automatic setting function of the air conditioner is stopped, the control unit 320 activates the automatic setting function of the air conditioner based on the confirmation of the selection of the icon I4. On the other hand, when the automatic setting function of the air conditioner is activated, the control unit 320 stops the automatic setting function of the air conditioner based on the confirmation of the selection of the icon I4.

The configuration example of the system 1 according to the embodiment of the present invention has been described above.

(1.2. Operation of the control device)
Next, an operation example of the control device 30 according to the embodiment of the present invention will be described with reference to FIG. 6 (also referring to FIGS. 1 to 5 as appropriate).

FIG. 4 is a flow chart showing an operation example of the control device 30 according to the embodiment of the present invention. As shown in FIG. 4, when the user's finger is not detected on the operation input device 10 ("NO" in S11), no icon is popped up. Then, the control unit 320 shifts the operation to S11.

On the other hand, when the user touches a position corresponding to an icon on the operation surface 115, the operation input device 10 detects the contact position of the user's finger on the X axis as the finger detection position on the X axis. When the user's finger is detected by the operation input device 10 ("YES" in S11), the control unit 320 controls the display device 20 so that one or more icons are popped up (S12).

When the user's confirmation operation is not detected by the operation input device 10 ("NO" in S13), the control unit 320 causes the operation to proceed to S13. The confirmation operation may be an operation of moving the finger while touching the operation surface 115 along the Y-axis. On the other hand, when the user's confirmation operation is detected by the operation input device 10 ("YES" in S13), the control unit 320 confirms the selection of the icon corresponding to the detected position (S14).

The control unit 320 performs control corresponding to the function corresponding to the icon whose selection has been confirmed. For example, when the icon whose selection is confirmed is the function adjustment icon, the control unit 320 performs control to adjust the detailed content of the function. Alternatively, when the selected icon is the function activation icon, control unit 320 activates or deactivates the function. Alternatively, control unit 320 may cause display device 20 to pop-up display a function activation icon or a function adjustment icon when the selected icon is a higher-level icon.

The operation example of the control device 30 according to the embodiment of the present invention has been described above.

(1.3. Effect)
Next, the effects of the embodiment of the present invention will be described. As described above, based on detection of the user's finger by the operation input device 10 provided separately from the display device 20, the control unit 320 displays one or more icons in a pop-up manner. A control unit 320 for controlling the device 20 is provided.

According to this configuration, the screen is effectively used because the icon pops up only when the user wants to operate.

<2. Supplement>
Although the preferred embodiments of the present invention have been described in detail above with reference to the accompanying drawings, the present invention is not limited to such examples. It is obvious that a person having ordinary knowledge in the technical field to which the present invention belongs can conceive of various modifications or modifications within the scope of the technical idea described in the claims. It is understood that these also belong to the technical scope of the present invention.

Above, we explained the high-level icon, function adjustment icon, and function activation icon as examples of pop-up icons. However, the pop-up icon may be determined according to the usage status of the user.

For example, the control unit 320 causes the storage unit 330 to store the user's selection frequency for each of a plurality of icons (a plurality of candidates), and based on the selection frequency stored in the storage unit 330, a pop-up icon is displayed on the display device 20. At least part of the displayed icons may be determined. This is expected to improve user convenience.

As an example, the control unit 320 may include the icon with the highest selection frequency among the plurality of icons in the icons to be popped up. This is expected to further improve user convenience.

10: operation input device, 110: operation unit, 115: operation surface, 120: tact switch, 20: display device, 215: display surface, 30: control device, 310: input unit, 320: control unit, 330: storage unit , 340: output unit

Claims (11)

A control unit that controls the display device so that one or more selection candidates are popped up based on the detection of the user's finger by an operation input device provided separately from the display device,
Control device. the selection candidates include a first selection candidate for activating a first function;
A control device according to claim 1 . the selection candidates include a second selection candidate for adjusting the details of the second function;
A control device according to claim 1 . The selection candidates include a third selection candidate for pop-up displaying a first selection candidate for activating a first function on the display device,
A control device according to claim 1 . The control unit determines at least part of the selection candidates based on the frequency of selection by the user for each of a plurality of candidates.
A control device according to claim 1 . The control unit includes a candidate with the highest selection frequency among the plurality of candidates in the selection candidates.
A control device according to claim 5 . The control unit acquires the detected position of the finger on a first axis detected by the operation input device.
A control device according to claim 1 . The control unit confirms selection of a selection candidate corresponding to the detection position among the selection candidates based on detection of a predetermined confirmation operation by the finger by the operation input device.
A control device according to claim 7 . the confirmation operation is movement of the finger along a second axis different from the first axis;
A control device according to claim 8 . Controlling the display device so that one or more selection candidates are popped up based on detection of the user's finger by an operation input device provided separately from the display device,
control method. the computer,
A control unit that controls the display device so that one or more selection candidates are popped up based on the detection of the user's finger by an operation input device provided separately from the display device,
A program that acts as a controller.

Images