JP2025099255A - Information processing device, control method for information processing device, and program - Google Patents

Abstract

[Problem] It is an object to provide an information processing device, a control method for the information processing device, and a program that can improve the operability of a virtual menu. [Solution] An HMD (100) includes a CPU (101) that stores information on the type of UI in use as operation information, determines whether an operation to display a virtual menu has been performed, and, if it is determined that an operation to display a virtual menu has been performed, determines, based on the operation information, the drawing mode of the virtual menu in the virtual space to be a drawing mode suitable for the type of UI in use. [Selected Figure] Figure 1

Description

The present invention relates to an information processing device, a control method for an information processing device, and a program.

In conventional XR (cross reality), a user can operate a virtual object (hereinafter referred to as a "virtual menu") of a menu drawn in a virtual space for purposes such as games and simulations. XR is a general term for VR (virtual reality), AR (augmented reality), MR (mixed reality), etc. When operating a virtual menu in XR, a user uses various UIs (user interfaces), such as hand gestures, ray, gaze input, or a controller. In this case, the virtual menu is displayed on the display unit in a uniform position and in a uniform shape, regardless of the type of UI the user is using. Therefore, there have been cases where the user's work has been interrupted or operability has been impaired. In this regard, for example, Patent Document 1 discloses a technology for selecting and targeting a virtual object using information from multiple UIs.

Special Publication No. 2021-524629

However, the technology disclosed in Patent Document 1 is not effective when displaying a new virtual object. Therefore, even if the technology disclosed in Patent Document 1 is applied to displaying a virtual menu, there is a problem in that the virtual menu is displayed in a uniform shape and at a uniform position on the display unit, as in the conventional technology.

The present invention has been made in consideration of the above problems. The present invention aims to provide an information processing device, a control method for an information processing device, and a program that can improve the operability of a virtual menu.

To achieve the above object, the information processing device of the present invention is characterized by comprising: a storage means for storing information on the type of UI being used as operation information; a determination means for determining whether an operation to display a virtual menu has been performed; and, when the determination means determines that an operation to display a virtual menu has been performed, a determination means for determining, based on the operation information, the drawing mode of the virtual menu in the virtual space to be a drawing mode suitable for the type of UI being used.

The present invention can improve the operability of virtual menus.

FIG. 1 is a block diagram showing the configuration of an HMD (head mounted display). FIG. 2 is a diagram showing an example of an image captured by a camera of the HMD. 13 is a diagram showing an example of an image displayed on the display unit of the HMD when the type of UI being used is a hand gesture. FIG. 13 is a diagram showing an example of an image displayed on the display unit of the HMD when the type of UI in use is Ray. FIG. 10 is a flowchart showing the flow of operations of the HMD for determining the drawing style of the virtual menu to be suitable for the type of UI being used. 13A and 13B are diagrams illustrating an example of a drawing mode of a virtual menu when the type of UI being used is a hand gesture; 13A and 13B are diagrams illustrating an example of a drawing mode of a virtual menu when the type of UI being used is a ray.

The following describes an embodiment of the present invention in detail with reference to the drawings. However, the configuration described in the following embodiment is merely an example, and the scope of the present invention is not limited by the configuration described in the present embodiment. For example, each part constituting the present invention can be replaced with any configuration that can perform a similar function. Any configuration may also be added. Any two or more configurations (features) of the present embodiment can also be combined. Furthermore, in the attached drawings, the same reference numerals are used to denote the same or similar configurations, and duplicated explanations are omitted. The following describes the present embodiment with reference to Figures 1 to 7. In this embodiment, an HMD is described as an example of an information processing device of the present invention.

[HMD]
1 is a block diagram showing the configuration of the HMD 100. The HMD 100 includes a CPU 101, a GPU 102, a ROM 103, a RAM 104, a display unit 105, a communication unit 106, an inertial measurement unit 107, a geomagnetic sensor 108, a camera 109, a hand gesture detection unit 110, and a system bus 111. The CPU 101, the GPU 102, the ROM 103, the RAM 104, the display unit 105, the communication unit 106, the inertial measurement unit 107, the geomagnetic sensor 108, the camera 109, and the hand gesture detection unit 110 are connected to the system bus 111. The CPU 101 (storage means) (determination means) (decision means) is a central processing unit that uses the RAM 104 as a work memory, executes a program stored in the ROM 103, and controls each component connected to the system bus 111. As a result, the CPU 101 provides a space realized by VR, AR, MR, or the like to a user wearing the HMD 100 on his or her head.

The GPU 102 is a graphics processing unit that draws virtual objects in a virtual space. The ROM 103 is a non-volatile storage means and a program storage device. The RAM 104 is a work memory required for the CPU 101 to execute the programs. The display unit 105 is an output device such as a liquid crystal panel or an organic EL panel that is used to display drawn graphics. The communication unit 106 has a wired or wireless communication function for sending and receiving data. The inertial measurement unit 107 is a sensor for detecting the attitude and movement of the HMD 100.

The geomagnetic sensor 108 is a sensor for detecting the direction of the HMD 100. The camera 109 is a device for capturing images of the surroundings of the HMD 100. The hand gesture detection unit 110 has a function of analyzing the images captured by the camera 109 and detecting the user's hands, fingers, etc. A detailed explanation of the function of the hand gesture detection unit 110 will be given later with reference to FIG. 2. The HMD 100 may be an optically transparent type, a video transparent type, or a non-transparent type.

[Function of hand gesture detection unit]
Here, the function of the hand gesture detection unit 110 will be described with reference to Fig. 2. Fig. 2 is a diagram showing an example of an image 200 captured by the camera 109 of the HMD 100 worn on the user's head. The image 200 shows a user's hand 201. The hand gesture detection unit 110 detects information on an area 202 indicating the position and size of the user's hand 201 from the image 200. Furthermore, the hand gesture detection unit 110 detects information on the tips and positions 204 of each joint point of the fingers 203 of the user's hand 201.

Note that the leader lines 203 and 204 in FIG. 2 are drawn from the index finger of the user's hand 201, but similar information is detected not only from the index finger of the user's hand 201 but also from the other fingers of the user's hand 201. Furthermore, in this embodiment, unless otherwise specified, the fingers 203 refer to each finger of the user's hand 201. The CPU 101 controls the hand gesture detection unit 110 and stores the information obtained by these detections in the RAM 104 as three-dimensional coordinate information in the virtual space. Furthermore, the hand gesture detection unit 110 can detect the movements of the user's hand 201 and fingers 203 by analyzing the images continuously captured by the camera 109 of the HMD 100.

[UI]
Here, an example of a UI used when a user operates a virtual object displayed on the display unit 105 of the HMD 100 will be described with reference to FIGS. 3 and 4. FIG. 3 is a diagram showing an example of an image 300 displayed on the display unit 105 of the HMD 100 worn on the user's head. When the camera 109 captures the surroundings including the user's hand 201 to obtain the image 300, the CPU 101 controls the hand gesture detection unit 110 to detect the positions of the user's hand 201 and fingers 203 from the image 300. Furthermore, the CPU 101 controls the GPU 102 to draw the virtual object 301 in the virtual space so that the virtual object 301 is displayed on the display unit 105 at a position slightly away from the user's hand 201 and fingers 203. The user can perform actions such as pushing and grabbing the virtual object 301 with the hand 201 and fingers 203. The CPU 101 controls the GPU 102 to change the drawing position and drawing shape of a virtual object 301 in a virtual space in response to a user's action. Such a user's action on the virtual object 301 is one of the UIs that the user can use in XR, and is known as a hand gesture.

Figure 4 is a diagram showing an example of an image 400 displayed on the display unit 105 of the HMD 100 worn on the user's head. When the camera 109 captures the surroundings including the user's hand 201 to obtain the image 400, the CPU 101 controls the hand gesture detection unit 110 to detect the positions of the user's hand 201 and fingers 203 from the image 400. Furthermore, the CPU 101 controls the GPU 102 to draw the virtual object 401 in the virtual space so that the virtual object 401 is displayed on the display unit 105 at a position far away from the user's hand 201 and fingers 203. The CPU 101 also controls the GPU 102 to draw the ray 402 in the virtual space so that the ray 402 is displayed on the display unit 105 in a state where it is extended from the tip of one of the user's fingers 203.

The CPU 101 can detect the irradiation position 403 of the ray 402 on the virtual object 401, and stores information on the irradiation position 403 obtained by this detection in the RAM 104 as three-dimensional coordinate information in the virtual space. Note that the irradiation position 403 is not limited to the intersection of the virtual object 401 and the ray 402. The irradiation position 403 may be, for example, the intersection of the ray 402 and a real object, or the tip position of the ray 402. The user can perform an action such as selecting or grabbing the virtual object 401 with the ray 402.

The CPU 101 controls the GPU 102 to change the drawing position and drawing shape of the virtual object 401 and the ray 402 in the virtual space in response to the user's actions using the ray 402. The ray 402 used in such user actions is one of the UIs that the user can use in XR. Note that in the image 400, the ray 402 extends from the tip of one of the user's fingers 203, but is not limited to this. The ray 402 may extend from the palm of the user's hand 201, for example.

[Virtual menu display operation]
Here, the display operation of the virtual menu will be described. The display operation of the virtual menu is an operation for causing the CPU 101 to display the virtual menu on the display unit 105. Therefore, when the user performs the display operation of the virtual menu using the UI, the CPU 101 controls the GPU 102 to draw the virtual menu (i.e., the virtual object of the menu) in the virtual space. As a result, the virtual menu is displayed on the display unit 105. Note that the UI that the user can use in the display operation of the virtual menu includes, for example, gaze input and a controller in addition to the above-mentioned hand gestures and rays.

In addition, in the case of gaze input, for example, when the HMD 100 detects that the user has directed their gaze to a specific position, a virtual menu is displayed on the display unit 105. In addition, the controller may include at least one of a button incorporating an OTP (optical track pad), a touch pad, a touch panel, a cross key, a joystick, a track pad device, a motion sensor, etc. In addition, this virtual menu may be displayed by a display operation on a different virtual menu from the virtual menu.

[Virtual menu drawing style]
The drawing mode of the virtual menu varies depending on the type of UI being used. In this embodiment, the drawing mode of the virtual menu includes a drawing mode for hand gestures, a drawing mode for rays, and a general-purpose drawing mode. Therefore, when the type of UI being used by the user is other than hand gestures and rays, the virtual menu is drawn in the virtual space in the general-purpose drawing mode. Note that the general-purpose drawing mode is a drawing mode of the virtual menu that is not for a specific type of UI.

[Determining the Virtual Menu Drawing Mode]
5 is a flowchart showing an operation flow 500 of the HMD 100 that determines the drawing mode of the virtual menu to be a drawing mode suitable for the type of UI being used. The operation flow 500 of the HMD 100 (control method of the information processing device) shown in the flowchart of FIG. 5 is realized by the CPU 101 (computer) expanding a program stored in the ROM 103 into the RAM 104 and executing it. In step S501, the CPU 101 stores operation information in the RAM 104 (storage process). The operation information includes at least information on the type of the UI being used and information on the position where the UI is used. The information on the position where the UI is used includes, for example, three-dimensional coordinate information in the virtual space described above.

The operation information therefore includes information on the area 202 indicating the position and size of the user's hand 201, information on the tips of the fingers 203 of the user's hand 201 and the positions 204 of each joint point, and information on the irradiation position 403 of the ray 402. Furthermore, if the UI is not being used, the CPU 101 includes information to the effect that the UI is not being used in the operation information. In step S502, the CPU 101 determines whether or not a display operation of a virtual menu has been performed (determination step). If the CPU 101 determines that a display operation of a virtual menu has not been performed, the process returns to step S501. On the other hand, if the CPU 101 determines that a display operation of a virtual menu has been performed, the process proceeds to step S503.

In step S503, CPU 101 refers to the operation information stored in RAM 104. In step S504, CPU 101 determines the type of UI being used. This determination is made based on the information on the type of UI being used that is included in the operation information referenced in step S503. If CPU 101 determines that the type of UI being used is a hand gesture, the process proceeds to step S505. If CPU 101 determines that the type of UI being used is a ray, the process proceeds to step S506. If CPU 101 determines that the type of UI being used is different from a hand gesture and a ray, the process proceeds to step S507. Note that if the operation information referenced in step S503 includes information that the UI is not being used, that is, if the operation information does not include information on the type of UI being used, the process also proceeds to step S507.

In step S505, the CPU 101 determines the drawing mode of the virtual menu to be a drawing mode for hand gestures (determination process). As a result, the virtual menu is drawn in the virtual space in the drawing mode for hand gestures. As a result, the virtual menu is displayed on the display unit 105 in the drawing mode for hand gestures, for example, as shown in FIG. 6. Note that a detailed description of FIG. 6 will be given later. In step S506, the CPU 101 determines the drawing mode of the virtual menu to be a drawing mode for rays (determination process). As a result, the virtual menu is drawn in the virtual space in the drawing mode for rays. As a result, the virtual menu is displayed on the display unit 105 in the drawing mode for rays, for example, as shown in FIG. 7. Note that a detailed description of FIG. 7 will be given later. In step S507, the CPU 101 determines the drawing mode of the virtual menu to be a general-purpose drawing mode (determination process). As a result, the virtual menu is drawn in the virtual space in the general-purpose drawing mode. As a result, the virtual menu is displayed on the display unit 105 in a general-purpose drawing style (not shown). In this way, the process executed after step S504 changes depending on the type of UI being used, so that the virtual menu is drawn in the virtual space in a drawing style suitable for the type of UI being used, and is then displayed on the display unit 105. When the process of step S505, step S506, or step S507 is executed, the operation flow 500 of the HMD 100 shown in the flowchart of FIG. 5 ends.

[Virtual menu drawing style]
Here, the drawing mode of the virtual menu will be described with reference to Fig. 6 and Fig. 7. Fig. 6 is a diagram for explaining an example of the drawing mode of the virtual menu when the type of UI being used is hand gesture. When the type of UI being used is hand gesture and an operation to display the virtual menu is executed, CPU 101 controls GPU 102 to draw virtual menu 601 in the virtual space in a drawing mode for hand gestures. As a result, CPU 101 displays virtual menu 601 on display unit 105 in the drawing mode for hand gestures.

Specifically, the CPU 101 determines the drawing position of the virtual menu 601 to be near the user's hand 201 and fingers 203 based on information on the tips of the fingers 203 of the user's hand 201 and the positions 204 of each joint point, which are included in the operation information. At this time, the CPU 101 may determine the drawing position of the virtual menu 601 to be near the user's hand 201, or may determine the drawing position of the virtual menu 601 to be near one of the fingers 203 of the user's hand 201. For example, the CPU 101 determines the drawing position of the virtual menu 601 to be a position slightly opposite the tip of the index finger of the user's hand 201. The CPU 101 may also determine the drawing position of the virtual menu 601 based on information on the area 202 indicating the position and size of the user's hand 201, which is included in the operation information. In this way, the drawing position of the virtual menu 601 in the virtual space is determined, making it easier for the user to recognize the virtual menu 601 on the display unit 105, and allowing the user to operate the virtual menu 601 with hand gestures without having to move the hand 201 significantly.

Furthermore, based on the information of the area 202 indicating the position and size of the user's hand 201 included in the operation information, the CPU 101 determines the drawing size of the virtual menu 601 to a size that is easier to operate with a hand gesture compared to a general-purpose drawing mode. For example, the CPU 101 determines the drawing size of the virtual menu 601 to be a compact size compared to a general-purpose drawing mode. Note that, when the button 602 of the virtual menu 601 is operated with the palm of the user's hand 201, the CPU 101 may determine the drawing size of the virtual menu 601 to be larger compared to the general-purpose drawing mode. On the other hand, when the button 602 of the virtual menu 601 is operated with the tip of the finger 203 of the user's hand 201, the CPU 101 may determine the drawing size of the virtual menu 601 to be smaller compared to the general-purpose drawing mode. The CPU 101 may also determine the drawing size of the virtual menu 601 based on information about the tips of the fingers 203 of the user's hand 201 and the positions 204 of each joint point, which is included in the operation information.

Furthermore, the CPU 101 determines the drawing shape of the button 602 in the virtual menu 601 to be a three-dimensional shape that allows the user to easily recognize that the button 602 has been operated by a hand gesture. Examples of such a three-dimensional shape of the button 602 include the three-dimensional shape of a push button and the three-dimensional shape of a slide button.

FIG. 7 is a diagram for explaining an example of the drawing mode of a virtual menu when the type of UI being used is a ray. When the type of UI being used is a ray, and an operation to display the virtual menu is executed, the CPU 101 controls the GPU 102 to draw the virtual menu 601 in the virtual space in the drawing mode for the ray. As a result, the CPU 101 displays the virtual menu 601 on the display unit 105 in the drawing mode for the ray. Specifically, the CPU 101 determines the drawing position of the virtual menu 701 to be a position near the irradiation position 403 of the ray 402 based on the information on the irradiation position 403 of the ray 402 included in the operation information. In this way, by determining the drawing position of the virtual menu 701 in the virtual space, the user can easily recognize the virtual menu 701 on the display unit 105 and can easily point to the virtual menu 701 with the tip of the ray 402.

The CPU 101 also determines the spacing between the buttons 702 of the virtual menu 701 to be wider than the general-purpose drawing mode. The CPU 101 may also widen the spacing between the buttons 702 by determining the drawing size of the virtual menu 701 to be larger than the general-purpose drawing mode. The CPU 101 may also determine the spacing between the buttons 702 of the virtual menu 701 or the drawing size of the virtual menu 701 in proportion to the length of the ray 402, for example. That is, the longer the length of the ray 402, the wider the spacing between the buttons 702 of the virtual menu 701, or the larger the drawing size of the virtual menu 701. When the ray 402 extends from the tip of one finger 203 of the user's hand 201, the length of the ray 402 is calculated from the position 204 of the tip of the finger 203 and the irradiation position 403 of the ray 402. Furthermore, when the ray 402 extends from the palm of the user's hand 201, the length of the ray 402 is calculated from the position of the hand 201 and the irradiation position 403 of the ray 402. Note that, as described above, information on the position 204 of the tip of the finger 203 from which the ray 402 extends, information on the irradiation position 403 of the ray 402, and information on the area 202 indicating the position of the hand 201 are included in the operation information. In this manner, the spacing between the buttons 702 of the virtual menu 701 is determined, thereby reducing erroneous operation of the ray 402.

Furthermore, the CPU 101 determines the drawing color of the button 702 of the virtual menu 701 to be the color that changes when the user selects it with the ray 402. In this way, by determining the drawing color of the button 702 of the virtual menu 701 in the virtual space, it becomes easier for the user to recognize on the display unit 105 that the button 702 of the virtual menu 701 has been selected with the ray 402.

As described above, the HMD 100 determines the drawing style of the virtual menus 601 and 701 in the virtual space based on the operation information stored in the RAM 104 to be a drawing style suitable for the type of UI being used by the user. This enables the HMD 100 to improve the operability of the virtual menus 601 and 701.

Although the preferred embodiment of the present invention has been described above, the present invention is not limited to the above embodiment, and various modifications and changes are possible within the scope of the gist. For example, if the HMD 100 is an optically transmissive type, smart glasses may be used instead of the HMD 100. In addition, the operation flow 500 of the HMD 100 shown in the flowchart of FIG. 5 may be performed by a smartphone, tablet terminal, personal computer, digital camera, or the like connected to the HMD 100 by wire or wirelessly. However, in this case, the smartphone, tablet terminal, personal computer, digital camera, or the like constitutes the information processing device of the present invention.

The present invention can also be realized by supplying a program that realizes one or more of the functions of the above embodiments to a system or device via a network or storage medium, and having one or more processors of the computer in the system or device read and execute the program. The present invention can also be realized by a circuit (e.g., an ASIC) that realizes one or more of the functions.

The disclosure of this embodiment includes the following configuration, method, and program.
(Configuration 1) A storage means for storing information on a type of a UI being used as operation information;
A determination means for determining whether a display operation of a virtual menu has been performed;
an information processing device characterized in that it comprises a determination means for, when the determination means determines that a display operation of a virtual menu has been performed, determining, based on the operation information, the drawing manner of the virtual menu in the virtual space to a drawing manner suitable for the type of UI being used.
(Configuration 2) The information processing device according to configuration 1, wherein the type of UI being used is a hand gesture.
(Configuration 3) The operation information includes information on a position of a user's hand or finger,
3. The information processing apparatus according to claim 2, wherein the determining means determines the drawing position of the virtual menu to be a position near the user's hand or finger as a drawing mode suitable for the type of UI being used.
(Configuration 4) The operation information includes information on a position and a size of a user's hand,
The information processing device according to configuration 2 or 3, wherein the determining means determines the drawing size of the virtual menu to be larger or smaller than a general-purpose drawing mode as a drawing mode suitable for the type of UI being used.
(Configuration 5) The information processing apparatus according to any one of configurations 2 to 4, wherein the determining means determines the drawing shape of the virtual menu button to be a three-dimensional shape as a drawing style suited to the type of UI being used.
(Configuration 6) The information processing device according to configuration 1, wherein the type of UI being used is Ray.
(Configuration 7) The operation information includes information on a ray irradiation position,
7. The information processing apparatus according to configuration 6, wherein the determining means determines the drawing position of the virtual menu to be a position near the irradiation position of the ray as a drawing mode suitable for the type of UI being used.
(Configuration 8) The information processing device according to configuration 6 or 7, wherein the determining means determines the spacing between buttons of the virtual menu to be wider than a general-purpose drawing style, as a drawing style suitable for the type of UI being used.
(Configuration 9) The information processing device according to configuration 6 or 7, wherein the determining means determines an interval between buttons of a virtual menu in proportion to a length of a ray as a drawing mode suitable for a type of UI being used.
(Configuration 10) The information processing device according to any one of configurations 6 to 9, wherein the determining means determines a drawing color of a button of a virtual menu to be a color that changes when selected by a ray, as a drawing style suitable for a type of UI in use.
(Configuration 11) The information processing device according to any one of configurations 1 to 10, wherein the determination means determines a general-purpose drawing mode as the drawing mode suitable for the type of UI in use when the type of UI in use is different from hand gestures and rays, or when information on the type of UI in use is not included in the operation information.
(Configuration 12) The information processing device according to any one of configurations 1 to 11, characterized in that the types of UI that can be used in the information processing device include eye-gaze input or a controller.
(Method 1) A storage step of storing information on the type of a UI being used as operation information;
a determination step of determining whether a display operation of the virtual menu has been performed;
A control method for an information processing device, comprising: a determination step of, when the determination step determines that a display operation of a virtual menu has been executed, determining, based on the operation information, a drawing mode of the virtual menu in the virtual space to a drawing mode suitable for the type of UI being used.
(Program 1) A program for causing a computer to execute each of the means of the information processing device according to any one of configurations 1 to 12.

100 HMD (information processing device)
101 CPU (storage means) (determination means) (determination means)
201 User's hand 203 User's finger 402 Ray 403 Ray irradiation position 601, 701 Virtual menu 602, 702 Button of virtual menu

Claims (14)

A storage means for storing information on the type of UI being used as operation information;
A determination means for determining whether a display operation of a virtual menu has been performed;
an information processing device characterized in that it comprises a determination means for, when the determination means determines that a display operation of a virtual menu has been performed, determining, based on the operation information, the drawing manner of the virtual menu in the virtual space to a drawing manner suitable for the type of UI being used. The information processing device according to claim 1, characterized in that the type of UI being used is a hand gesture. The operation information includes information on the position of a user's hand or finger,
3. The information processing apparatus according to claim 2, wherein the determining means determines the drawing position of the virtual menu to be a position near a user's hand or finger as a drawing mode suitable for the type of UI being used. The operation information includes information on the position and size of a user's hand,
3. The information processing apparatus according to claim 2, wherein the determining means determines the drawing size of the virtual menu to be larger or smaller than a general-purpose drawing size as the drawing mode suitable for the type of UI being used. The information processing device according to claim 2, characterized in that the determining means determines the drawing shape of the virtual menu button to be a three-dimensional shape as a drawing style suitable for the type of UI being used. The information processing device according to claim 1, characterized in that the type of UI being used is Ray. The operation information includes information on a ray irradiation position,
7. The information processing apparatus according to claim 6, wherein the determining means determines the drawing position of the virtual menu to be a position near the irradiation position of the ray as a drawing mode suitable for the type of UI being used. The information processing device according to claim 6, characterized in that the determining means determines the spacing between buttons in the virtual menu to be wider than the spacing in a general-purpose drawing mode, as a drawing mode suitable for the type of UI being used. The information processing device according to claim 6, characterized in that the determining means determines the spacing between buttons in the virtual menu in proportion to the length of the ray as a drawing style suitable for the type of UI being used. The information processing device according to claim 6, characterized in that the determining means determines the drawing color of the virtual menu button to be the color that changes when selected with a ray, as a drawing style suitable for the type of UI being used. The information processing device according to claim 1, characterized in that the determination means determines a general-purpose drawing mode as the drawing mode suitable for the type of UI being used when the type of UI being used is different from hand gestures and rays, or when information on the type of UI being used is not included in the operation information. The information processing device according to claim 1, characterized in that the types of UI that can be used on the information processing device include gaze input or a controller. a storage step of storing information on the type of UI being used as operation information;
a determination step of determining whether a display operation of the virtual menu has been performed;
A control method for an information processing device, comprising: a determination step of, when the determination step determines that a display operation of a virtual menu has been executed, determining, based on the operation information, a drawing mode of the virtual menu in the virtual space to a drawing mode suitable for the type of UI being used. 2. A program for causing a computer to execute each of the means of the information processing apparatus according to claim 1.

Images