CN119536606A - Method for providing one or more operating areas for user interaction on a touch display of an input device - Google Patents

Abstract

The present invention relates to a method for providing one or more operating areas for user interaction on a touch display of an input device to generate control inputs for moving a mobile working device, in particular a transport vehicle or a robot that moves at least partially automatically, in an environment, comprising: providing orientation information indicating which orientation the input device currently has; determining one of a plurality of different operating area groups as a selected operating area group based on the current orientation of the input device, wherein each of the plurality of different operating area groups includes one or more motion operating areas for user interaction; manipulating the touch display to display the selected operating area group; obtaining one or more control inputs based on one or more user interactions performed via one or at least one of the plurality of displayed motion operating areas; and providing manipulation instructions to the mobile working device based on the one or more control inputs for moving the mobile working device.

Description

Method for providing one or more operation areas for user interaction on a touch display of an input device

Technical Field

The present invention relates to a method for providing one or more operation areas for user interaction on a touch display of an input device for generating control inputs for a mobile work device, in particular a vehicle or robot that is at least partly automatically moving, such as a mowing robot, as well as a computing unit and a computer program for performing the method, and the use of such an input device.

Background

Mobile devices or work devices, such as at least partially automatically moving vehicles or robots, are often moved in an environment, in particular in an environment or work area to be treated, such as in a house, garden, factory hall or street, in the air or in water.

Disclosure of Invention

The method for providing one or more operation areas for user interaction on a touch display of an input device for generating control inputs for a mobile working device, as well as a computing unit and a computer program for performing the method, and the use of such an input device are proposed according to the invention with the features of the independent patent claims. Advantageous developments are the subject matter of the dependent claims and the following description.

The present invention relates generally to mobile devices that move or at least are capable of moving in an environment or there, for example in a work area. Thus, a mobile working device may also be mentioned. Examples of such mobile devices (or mobile working devices) are, for example, robots and/or unmanned aerial vehicles and/or vehicles that move partly automatically or (fully) automatically (in land, water or air). As robots, for example, domestic robots, such as cleaning robots (for example in the form of suction robots and/or mopping robots), floor or street cleaning devices, construction robots or lawn mowing robots, and also other so-called service robots, are considered, as transport means which are at least partly moved automatically, such as passenger transport means or freight transport means (also so-called land transport means, for example in a warehouse), but also air transport means, such as so-called unmanned aerial vehicles, or water transport means are considered.

Such a mobile device has in particular a control or regulating unit and a drive unit for moving the mobile device, so that the mobile device can be moved in the environment, in particular along a movement path. For this purpose, navigation information may be determined based on the movement path, for example a specific indication (Anweisung) that the mobile device should travel in that direction in order to follow the movement path. These indications can then be realized by a control or regulating unit and a drive unit.

For example, an environment map may be used for the navigation, which may be obtained or determined in particular by SLAM. As SLAM ("Simultaneous Localization AND MAPPING", for example translated as synchronized positioning and mapping) means a method in robotics in which a mobile device (e.g., a robot) can or must simultaneously create a map of its environment and estimate its own spatial orientation within the map. Thereby identifying the obstacle and thus supporting autonomous navigation.

In addition, the mobile work device may have one or more sensors by means of which the environment or information in the environment may be detected (erfassen). Which may be, for example, a camera, a lidar sensor or even an inertial sensor, by means of which the movement of the environment and/or the mobile device is detected, for example, in two or three dimensions.

Furthermore, such mobile devices are typically arranged to receive data and/or to transmit data via a communication connection, i.e. to communicate or exchange data in general. In this way, communication with the mobile device may be performed, such as sending an indication to the mobile device, transmitting other data to the mobile device, or receiving data or information from the mobile device. In particular, wireless communication connections are considered here. For this purpose, the mobile device may have, for example, corresponding (possibly different) modules for wireless communication, which modules may also be integrated, for example, into the computing unit.

For such mobile devices there is often also a function that the mobile device may perform, i.e. the mobile device is arranged to perform one or more, preferably different functions. Instead of a plurality of functions, a plurality of applications may also be mentioned. Such a function may be, for example, a work function or a teaching function (Einlernfunktion).

The work function includes, for example, the mobile device automatically moving in an environment and performing a work process in the environment at least temporarily during movement in the environment. In the case of a lawn mowing robot, the work function may thus comprise, for example (during movement) mowing. For this purpose, for example, a start instruction for executing the work function can be issued to the mobile device, for example, by transmitting corresponding data via the wireless communication connection.

The teaching function includes, for example, a manually controlled movement of the mobile device in the environment, in particular in the case of no execution of a working process in the environment. In the case of a lawn mowing robot, the teaching function may thus comprise, for example, (manual) movement or control along the boundary of the work area in order to teach (beibringen) the boundary to the lawn mowing robot. For this purpose, control instructions for navigating or moving in the environment can be issued, for example, (continuously) to the mobile device by sending corresponding data via a wireless communication connection. Also mentioned In this case is the so-called "Teach-In (teaching)".

For such a mobile working device, an exercise mode of the mobile working device can be usedIn the exercise mode, the mobile work device can be moved in the environment on the basis of the control commands, but has limited working functionality in this case in the exercise mode. Thus, for example, provision may be made for the mowing function (i.e., for example, turning or moving the cutting blade) to be inactive or unavailable in the exercise mode. Instead, the exercise mode is intended to enable the user to manually move the mobile work device for exercise purposes, for example, in order to be able to better perform the teaching functions mentioned later.

For moving (or controlling) the mobile working device, an input device, in particular a mobile input device, such as a smart phone or other input device with a touch display, may be used.

In this case, an operation region for user interaction may be displayed on the touch display of the input device. Such an operating field may be, for example, a graphically displayed key or button or a joystick (Joystick) or the like. In this way, control inputs may be obtained, and in particular based on one or more user interactions through the operation region. The control input may in particular be a driving indication, such as forward, left, right or backward. For example, when a user touches a forward button displayed on a touch display, a travel instruction for forward may be generated. The corresponding content is equally applicable to other operating areas.

As already pointed out, the operation of such an input device for moving the mobile working device can become significantly easier if there are different groups of operation blocks (Bedienfeld-Satz) displayed according to the respective current orientations of the input device.

In which case orientation information is provided that describes which orientation the input device currently has. For example, the orientation may be determined by one or more sensors (e.g., inertial measurement units) integrated in the input device.

One of a plurality of different operation granule groups is then determined as the selected operation granule group, and in particular one of a plurality of different operation granule groups is determined as the selected operation granule group based on a current orientation of the input device, wherein each of the plurality of different operation granule groups comprises one or more movement operation granule groups (Bewegungs-Bedienfelder) for user interaction. The touch display is then manipulated to display the selected group of operation blocks.

Further, one or more control inputs are then obtained based on one or more user interactions via one or at least one of the plurality of displayed sports operating regions. For this purpose, as described above, the user may, for example, touch a forward button or another operation area displayed on the touch display. The control input may in particular be a driving indication, such as forward, left, right or backward. For example, when a user touches a forward button displayed on a touch display, a travel instruction for forward may be generated. The corresponding content is equally applicable to other operating areas. The mobile work device is then provided with steering instructions, and specifically based on the one or more control inputs for moving the mobile work device. This may be done, for example, via one of the already mentioned wireless communication connections. The mobile work device itself is then correspondingly arranged to move in response to such manipulation instructions.

In one embodiment, the plurality of operation granules includes a first operation granule and a second operation granule. Here, the first operation area group includes a sport operation area allowing user interaction for control inputs including forward travel, backward travel, leftward travel, and rightward travel. In another aspect, the second operation area group includes a first sport operation area that allows user interaction for control inputs including forward travel and backward travel, and the second operation area group includes a second sport operation area that allows user interaction for control inputs including leftward travel and rightward travel.

This is achieved either by two different operating fields for forward and backward movement on the one hand and for left and right travel on the other hand, i.e. by two hands, or by only one operating field for forward, backward, left and right travel, i.e. by only one hand, or even one finger.

It is particularly suitable that the first operation granule is determined as the selected operation granule if the current orientation of the input device corresponds to the portrait format of the touch display (Hochformat) and/or that the second operation granule is determined as the selected operation granule if the current orientation of the input device corresponds to the landscape format of the touch display. Therefore, the display possibilities of the touch display can be particularly effectively utilized.

In one embodiment, when the touch display is manipulated to display the selected operation granule and when the changed orientation information is provided, one of the plurality of operation granules is re-determined as the selected operation granule, and in particular one of the plurality of operation granules is re-determined as the selected operation granule based on the current orientation of the input device. The touch display is then manipulated to display the selected group of operation blocks. In this way, if the user rotates the input device, for example during use, the display may be adapted accordingly.

In one embodiment, at least one (preferably all) of the plurality of operation granule groups comprises a speed selection operation region for user interaction. Provision is then made for a speed selection input to be obtained, for example fast or slow, on the basis of a user interaction via the displayed speed selection operating zone. Then, a speed command is provided to the mobile work device, and specifically, based on the speed selection input, to configure the mobile work device to move at a speed corresponding to the speed selection input when the manipulation command is obtained. In the mobile device, a setting is therefore made as to at what speed the mobile device is operated with the corresponding actuation command for the mobile device, for example for forward travel, being obtained. Thus, the manipulation instruction itself does not have to contain any information about the speed.

However, it may also be provided that the manipulation instructions are provided to the mobile working device based on one or more control inputs for moving the mobile working device such that the mobile working device moves at a speed corresponding to the speed selection input. In this case, the manipulation instruction itself may contain information about the speed.

It is convenient that the speed selection operating zone comprises at least two different speeds at which the mobile device should be moved, displayed for selection, for example fast and slow as described above. The speed selection input then sets one of at least two different speeds. These two speeds may be, for example, 2 km/h and 5 km/h. This allows individual exercises to move the mobile work device depending on the user or, for example, on his experience. It will be appreciated that other values and more than two different speeds may be provided.

The computing unit according to the invention, i.e. the system for data processing in general, such as an input device, such as a smart phone or a processor thereof, is arranged, in particular in programming technology, to perform the method according to the invention.

It is also advantageous to implement the method according to the invention in the form of a computer program or a computer program product having a program code for performing all the method steps, since this results in particularly low costs, in particular if the control device performing the execution is also used for other tasks and is therefore present anyway. Finally, a machine readable storage medium is provided, on which a computer program as described above is stored. Suitable storage media or data carriers for providing the computer program are in particular magnetic, optical and electrical memories, such as hard disks, flash memories, EEPROMs, DVDs, etc. The program may also be downloaded via a computer network (internet, intranet, etc.). Such downloading may be performed here in a wired or cabled manner or in a wireless manner (e.g., via a WLAN network, 3G, 4G, 5G, or 6G connection, etc.).

Further advantages and embodiments of the invention emerge from the description and the drawing.

The invention is schematically illustrated in the drawings using embodiments and is described below with reference to the drawings.

Drawings

Fig. 1a schematically shows a mobile device for explaining the invention.

Fig. 1b shows schematically the mobile device of fig. 1a in another view.

Fig. 1c schematically shows the mobile working device of fig. 1a in a larger environment.

Fig. 2a schematically shows an input device for explaining the present invention.

Fig. 2b schematically shows the input device of fig. 2b in another view.

Fig. 3 schematically shows the flow of the method according to the invention in a preferred embodiment.

Detailed Description

In fig. 1a, a mobile device 100, in particular a working device, is shown schematically and by way of example to explain the invention. In fig. 1b, the mobile device 100 is shown in different views and in different aspects. Figures 1a and 1b and figure 1c are described fully below.

The mobile working device 100 is, for example, a mowing robot with a control or regulating unit 102 and a drive unit 104 (with wheels) for use in an environment 120 and there in particular in a working area 122

For example, navigating or moving the lawn mowing robot 100 in or on a lawn or garden. The mowing robot 100 can be moved or moved, for example, along a movement path or trajectory 130. Furthermore, the robot mower 100 has a sensor 106, which is designed as a camera, for example. Using the camera 106, images of the environment can be detected, which in turn can be used for navigation. In addition, for example, a docking station 110 is provided, at which the mowing robot can be charged, for example.

In fig. 1b, also shown in this environment are the building 124, the tree 126 and the person 128, which may be considered objects or obstacles when navigating the lawn mowing robot.

Furthermore, the robot lawnmower 100 has a computing unit 108, for example a control device, by means of which data can be received and/or transmitted. As already mentioned, this may be done by means of different types of wireless communication connections, for example. These types of wireless communication connections are shown at 170, 172, 174 in fig. 1 a. For example, this is a mobile radio connection 170, a bluetooth connection 172, and a WLAN connection or WiFi connection 174. The computing unit 108 may for example have corresponding radio modules or be connected to them, which modules then become part of the robot 100.

In addition, a signal of a GPS satellite 180 is denoted 176, which can be received by the robot mower 100 or by a correspondingly designed computing unit 108. In particular, the computing unit 108 may have a GPS module, i.e. be designed to determine a position using GPS signals. It should be appreciated that signals from multiple satellites are typically required for this purpose, but this is only shown here as an example.

Furthermore, in fig. 1a, a mobile input device 140 (e.g., a smart phone), a central computing system 150 (or server, which may represent a so-called cloud), and a WLAN router 160 in a building 162 (which may be another building than building 124, but may also be the same building). Wireless communication connections 170, 172, 174 of the type already mentioned are provided between the robot mower 100 or its computing unit 108, the mobile input device 140, the computing system 150 and the WLAN router 160. It should be noted that the mobile radio connection 170 is established via a mobile radio transmitter 152, which mobile radio transmitter 152 in turn is connected to the computing system 150.

A bluetooth connection 172 is provided between the robot 100 or its computing unit 108 and the mobile input device 140, i.e. a bluetooth connection may be established between the robot 100 or its computing unit 108 and the mobile input device 140. It will be appreciated that the mobile input device 140 has a suitable radio module for this purpose.

A WLAN connection 174 is provided between the robot 100 or its computing unit 108 and the WLAN router, i.e. a WLAN connection may be established between the robot 100 or its computing unit 108 and the WLAN router 160. It should be appreciated that WLAN router 160 has suitable radio modules for this purpose. The WLAN router 160 may in turn be connected to the internet via, for example, a wired connection.

A mobile radio connection 170 is provided between the robot 100 or its computing unit 108 and the computing system 150, i.e. a mobile radio connection may be established between the robot 100 or its computing unit 108 and the computing system 150. Here, it should be mentioned that such a mobile radio connection 170 is established by the mowing robot 100 or its computing unit 108 or a radio module therein, for example with the mobile radio transmitter 152 or a corresponding mobile radio station to which the computing system 150 is in turn connected, for example also via a mobile radio and/or a wire.

In addition, a mobile radio connection 170 is provided between the mobile input device 140 and the computing system 150, i.e. a mobile radio connection can be established between the mobile input device 140 and the computing system 150. It is also applicable here that a mobile input device 140 or a radio module therein is established, for example such a mobile radio connection 170 with a mobile radio transmitter or a corresponding mobile radio station to which the computing system 150 is in turn connected. It should be mentioned that the mobile input device 140 comprises for this purpose a radio module for WLAN, as is often the case with a typical smart phone.

Likewise, a WLAN connection 174 may be provided between the mobile input device 140 and the computing system 150, i.e., a WLAN connection may be established between the mobile input device 140 and the computing system 150. For this purpose, a WLAN connection 174 may be provided between the mobile input device 140 and the WLAN router. As already mentioned, the WLAN router 160 may in turn be connected to the internet, e.g. via a wired connection, and to the computing system 150 via it.

Accordingly, the lawnmower robot 100 or the computing unit 108 thereof may send and receive data, i.e., exchange data, via each of the mentioned wireless communication connections 170, 172, 174. Here, with the mobile input device 140, data may be exchanged not only over a bluetooth connection, but also over a mobile radio connection 170 or a WLAN connection 174, i.e. indirectly over the computing system 150. It should be mentioned that in principle a WLAN connection can also be established between the robot lawnmower 100 or its computing unit 108 and the mobile input device 140.

The mobile work device or mowing robot 100 is configured to perform one or more functions. In one embodiment, these functions include work functions, such as mowing and teaching functions.

Work functions include, for example, automatic movement of the lawn mowing robot 100 in the environment 120, and at least temporarily performing a work process in the environment when moving in the environment, such as mowing (it is also possible, depending on the situation, for the lawn mowing robot to initially travel to a specific location without mowing in order to start or continue mowing).

A mobile radio connection 170 may be assigned to the work function. This means that the robot lawnmower 100 or its computing unit 108 obtains and/or transmits data needed to perform the work function at least partly via the mobile radio connection. This may for example comprise a start instruction for starting the mowing process, which is sent from the mobile input device (possibly via the computing system 150) to the mowing robot 100.

This may also include, for example, obtaining trajectories (or navigation information in general) from the computing system 150, for example, which trajectories (or navigation information) are determined in the computing system 150, and which the mowing robot should then follow for the mowing process. However, it may also be provided that the trajectory (or in general navigation information) is determined in the robot mower 100 or its computing unit 108 itself or is otherwise obtained there. Instead of the trajectory, the computing unit 108 may also (only) obtain control information that has been determined based on the trajectory (which in turn may have been determined in the computing system 150), and based on this control information the control or adjustment unit 102, via the drive unit 104, is able to move the robot 100 so as to follow the trajectory, such as the trajectory 130 shown here only as an example.

The mowing robot 100 can then move autonomously or navigate there, for example, independently, via the working area 122 or in the surroundings 120 and mow in the process. As already mentioned, various objects can be detected here by the mowing robot 100 or its camera 106 (i.e. they are visible in the image taken by the camera) and then taken into account during navigation, i.e. when determining navigation information. To this end, the detected images or corresponding data may be transferred to the computing system 150, for example via the mobile radio connection 170.

The teaching function includes, for example, a manually controlled movement of the mowing robot in the environment, in particular along the boundary of the work area 122, in order to teach the mowing robot the boundary. As an example, such a boundary is denoted by 123 in fig. 1 b. In this case, the work function, i.e. mowing, does not have to be (or should not be) used. For this purpose, control instructions (or manipulation instructions) for navigation or movement may be transmitted (continuously), for example, to the robot lawnmower 100. Such control instructions or corresponding data are here sent from the mobile input device 140 to the lawn mowing robot via the bluetooth connection 172. Likewise, the robot lawnmower 100 or its computing unit 108 may send data back to the mobile input device 140 via a bluetooth connection. In this case, also mentioned is the so-called "Teach-In (teaching)".

Furthermore, the mobile work device may be operated in an exercise mode, which may also be a function. In this case, the mobile work device can be moved in the environment in the exercise mode on the basis of the control commands, and also has limited working functionality in the exercise mode. For example, in the case of a mowing robot, it may be provided that the mowing function or at least the use of a cutting blade is not possible or provided in the exercise mode.

Thus, the basic functionality of the exercise mode may correspond to the basic functionality of the teaching function, at least in terms of manually controlled movements of the mobile working device. However, unlike the teaching function, it is applicable in this environment to move the mowing robot along the boundary of the work area so that the boundary can be taught there, but rather it involves practicing moving (or controlling) the mobile work device or the mowing robot itself. For example, the user may first exercise moving (or controlling) the mobile work device in the exercise mode so that the mobile work device can be controlled along the boundary as skillfully and precisely as possible later in the scope of the teaching function.

In fig. 1c, the environment 120 in fig. 1b is again shown, but in a different type and representation. In this environment are a house 160 and a work area or lawn 122. For example, the docking station 110 is also disposed in the work area 122.

Furthermore, fig. 1c shows a predefined region 135, which surrounds docking station 110, for example, at a distance. In the map, for example on a smart phone or mobile input device 140, the user can for example determine the predefined area 135. Likewise, the predefined area 135 may be fixedly set, for example, by the position of the docking station. If docking station 110 is moved, for example, predefined area 135 may also change.

The predefined area 135 is in particular the area in which the robot lawnmower 100 has to be located in order to be able to end the exercise mode. In contrast, the exercise mode should not end outside of predefined area 135.

By way of example, the robot 100 is shown in a first position P1 within the predefined area 135 and in a second position P2 outside the predefined area 135. If the robot lawnmower 100 is in the second position P2, the exercise mode should not end, but has ended in the first position P1.

As already mentioned, the position of the mowing robot can be determined, for example, using GPS or other satellite-supported positioning. Likewise, for example, contact of charging or other contacts on docking station 110 by robot 100 may also indicate that the current position is within predefined area 135—in this regard, it is dependent only on the relative position of robot 100 with respect to predefined area 135 or, for example, docking station 110.

An input device 200 is schematically shown in fig. 2a to explain the invention. The input device 200 may be, for example, the mobile input device 140 of fig. 1a or a similar device, such as a smart phone.

A computing unit 202, such as a processor, of the input device 200 is shown as an example. In addition, a touch display 204 of the input device 200 is shown. By means of the computing unit 202, various steps may be performed, for example, manipulating the touch display 204 to display an operation area for user interaction, obtaining control inputs based on user interaction via the operation area, and communicating with the mobile device, for example, through a corresponding radio module (not shown here).

On the touch display 202, a plurality of operation areas, and precisely a movement operation area 210, a movement operation area 212, a speed selection operation area 216 and a confirmation operation area 218, are exemplarily shown in fig. 2 a. The sports operating area 210 and the sports operating area 212 allow user interaction for control inputs, wherein the sports operating area 210 allows user interaction for control inputs for enabling forward travel and backward travel of the mobile device. The sport operating area 212 allows user interaction for control inputs for enabling leftward and rightward traveling of the mobile device. Depending on the type of mobile device, a left-hand or right-hand drive may correspond, for example, to a left-hand or right-hand turn, or also to a left-hand or right-hand turn (for example, in the case of non-steerable but individually driven wheels).

The control input may be generated and obtained through user interaction via the operation region. For example, the user may drag a button shown in the center on the movement operation region 210 upward or forward when he touches the touch display with his finger, thereby generating a control input for forward travel. The same applies to the backward travel and the leftward and rightward travel on the sport operation area 212.

For example by releasing the touch display or removing a finger from the touch display, the control input is not regenerated. However, as long as the touch display is touched, for example, a button shown in the center on the movement operation region is pulled upward (or downward or leftward or rightward), the control input can be continuously generated. It is also conceivable that the set situation is preserved, i.e. the control input continues to be generated, by releasing the touch display or removing a finger from the touch display. Thus, for example, it may be necessary to actively move the button shown in the center again to the center.

For example, a speed selection input may be generated and obtained via the speed selection operation area 216. On this basis, a speed command may then be generated and obtained to move the mobile work device at a speed corresponding to the speed selection input.

For example, the speed selection operation area 216 allows two different speeds, e.g., slow and fast, to be displayed for selection at which the mobile device should move. This is indicated by a slow turtle symbol and a fast rabbit symbol, which in the case shown is set to fast. One of two different speeds can thus be set by the speed selection input.

Via the confirmation operation area 218, the user can for example input an end instruction to end the exercise mode, on the basis of which (depending on the situation) for example a manipulation instruction for disabling the exercise mode in the mobile working device can be generated for the mobile working device.

In fig. 2b, the input device 200 of fig. 2a is again shown, but in a different orientation or situation. While the input device 200 in fig. 2a is shown in a first orientation O1 (here in landscape format), the input device 200 in fig. 2b is shown in an additional second orientation O2 (here in portrait format).

In the orientation O2, a plurality of operation regions are displayed, but some of the operation regions are different from the orientation O1. Although the speed selection operation area 216 and the confirmation operation area 218 correspond to the speed selection operation area and the confirmation operation area 218 according to the orientation O1, the movement operation area 214 is shown instead of the movement operation areas 210 and 212.

The motion manipulation zone 214 allows user interaction for control inputs that enable the mobile device to travel forward, backward, left, and right. Here, the user interactions for the control inputs of the two sports operating areas 210 and 212 are thus combined in the sports operating area 214.

Thus, two different groups of operations may be displayed on the touch display 204 depending on the orientation of the input device 200. For example, the orientation may be determined by one or more sensors (e.g., inertial measurement units) integrated in the input device. It is conceivable that when changing the orientation, the display of one of the operation blocks, for example according to orientation O1 in fig. 2a, is transformed into the display of the other operation block, for example according to orientation O2 in fig. 2 b.

Fig. 3 schematically shows the flow of the method according to the invention in a preferred embodiment. The method is used for providing one or more operation areas for user interaction on a touch display of an input device, e.g. the input device 200 according to fig. 2a, 2b, for generating control inputs for moving a mobile work device, i.e. the mowing robot 100 according to fig. 1a, 1b, 1c, for example. This flow will also be explained below with reference to fig. 1a, 1b, 1c and 2a, 2 b.

In step 300, orientation information 302 is provided that indicates which orientation the input device currently has. For example, the orientation may be determined by one or more sensors (e.g., inertial measurement units) integrated in the input device. For example, it may thus be determined whether the input device is held in portrait or landscape format, e.g., in the case of a smart phone. This may require a directional component of the touch display normal that is not parallel to gravity in order to be able to distinguish between portrait and landscape formats.

In step 304, one of the plurality of different operation granule groups 306, 308 is then determined as the selected operation granule group, and in particular one of the plurality of different operation granule groups 306, 308 is determined as the selected operation granule group based on the current orientation of the input device. Each of the plurality of distinct operation granule groups includes one or more sports operation granule groups for user interaction. The operation granule may in particular be the operation granule shown in fig. 2a and 2 b. In step 310, the touch display is then manipulated to display the selected operation granule.

In step 312, one or more control inputs 314 are obtained based on one or more user interactions via one or at least one of the displayed plurality of sports operating regions. In step 316, a manipulation instruction 318 is then provided to the mobile work device, and specifically the manipulation instruction 318 is provided to the mobile work device based on the one or more control inputs for moving the mobile work device.

In particular, these manipulation instructions 318 are then transmitted to the mobile working device, for example via the mentioned bluetooth connection, in step 320, so that they can be moved accordingly.

In addition, at step 322, a speed selection input 320 may be obtained, and specifically the speed selection input 320 is obtained based on user interaction via the displayed speed selection operation region, e.g. as explained in relation to fig. 2a, 2 b. Then, at step 326, a speed command 328 may be provided to the mobile work device based on the speed selection input to configure the mobile work device to move at a speed corresponding to the speed selection input when the maneuver instruction is obtained.

In other words, the mobile device is then moved directly at the relevant or selected speed based on the mentioned manipulation instruction 318, whereas the manipulation instruction 318 itself does not comprise any information about the possible speeds.

However, it is also contemplated that based on the one or more control inputs for moving the mobile work device, a manipulation instruction 318 for the mobile work device is provided such that the mobile work device moves at a speed corresponding to the speed selection input. In this case, the steering instructions 318 themselves already contain information about the selected speed.

This type of control of the mobile work device is preferably suitable for (manual) moving or controlling the mobile work device, such as the robot lawnmower 100, in particular with respect to the mentioned teaching functions and exercise modes.

Claims (13)

1. A method for providing one or more operating areas (210, 212, 214, 216) for user interaction on a touch display (204) of an input device (140, 200) for generating control inputs for moving a mobile working device (100), in particular a transport device or a robot that moves at least partially automatically, in particular a lawn mowing robot, in an environment (120), comprising: providing (300) orientation information (302), the orientation information indicating which orientation the input device (140, 200) currently has; determining (304) one of a plurality of different operation area groups (306, 308) as a selected operation area group based on a current orientation of the input device, wherein each of the plurality of different operation area groups includes one or more motion operation areas (210, 212, 214) for user interaction; Manipulating (310) the touch display to display the selected operation area group; obtaining (312) one or more control inputs (314) based on one or more user interactions via one or at least one of a plurality of displayed motion operation areas; and A control instruction (318) is provided (316) to the mobile working machine (100) based on the one or more control inputs for moving the mobile working machine (100). 2. The method according to claim 1, wherein the plurality of operation area groups include a first operation area group and a second operation area group, wherein the first operation area group includes a motion operation area (214), the motion operation area allowing user interaction for the following control inputs, the control inputs including driving forward, driving backward, driving left and driving right, and The second operation area group includes a first motion operation area (310) allowing user interaction for the following control inputs, the control inputs including driving forward and driving backward, and the second operation area group includes a second motion operation area (312) allowing user interaction for the following control inputs, the control inputs including driving left and driving right. 3. A method according to claim 2, wherein the first operation area group is determined as the selected operation area group if the current orientation of the input device corresponds to the portrait format of the touch display; and/or wherein the second operation area group is determined as the selected operation area group if the current orientation of the input device corresponds to the landscape format of the touch display. 4. The method according to any one of the preceding claims, further comprising, when the touch display (204) is manipulated to display the selected operating area group and when providing the changed orientation information: re-determining one of the plurality of operation area groups as the selected operation area group based on the current orientation of the input device; and The touch display is manipulated to display the selected operation area group. 5 . The method according to claim 1 , wherein providing the control instructions to the mobile working device comprises: controlling a Bluetooth communication connection ( 172 ) to send the control instructions to the mobile device. 6. The method according to any one of the preceding claims, wherein at least one of the plurality of operating area groups comprises a speed selection operating area (216) for user interaction, The method further comprises: obtaining (322) a speed selection input (324) based on a user interaction via the displayed speed selection operation area; and providing (326) a speed instruction (328) to the mobile working equipment (100) based on the speed selection input so as to configure the mobile working equipment to move at a speed corresponding to the speed selection input when the steering instruction (318) is obtained, or Based on one or more control inputs for moving the mobile working machine, a control command is provided to the mobile working machine in such a way that the mobile working machine moves at a speed corresponding to the speed selection input. 7. The method of claim 6, wherein the speed selection operation area (216) displays at least two different speeds at which the mobile device should move for selection, and wherein the speed selection input sets one of the at least two different speeds. 8. The method according to any of the preceding claims, wherein the mobile working device (100) is designed as a lawnmower robot. 9. A computing unit (202) comprising means for performing the method according to any one of the preceding claims. 10. An input device (200) having a computing unit (202) according to claim 9 and a touch display (204). 11. Use of the input device (200) according to claim 10, wherein the input device is used for moving a mobile working device (100) in an environment (120). 12. A computer program comprising instructions which, when executed by a computer, cause the computer to perform the method steps of the method according to any one of claims 1 to 8 when the program is executed on the computer. 13. A computer-readable storage medium having stored thereon the computer program according to claim 12.