CN118057266A - Method and device for controlling user position in virtual scene - Google Patents

Abstract

The embodiment of the present application provides a method and device for controlling the position of a user in a virtual scene. When a target gesture is detected, a ray is displayed in the virtual scene. The starting point of the ray indicates the current position of the user, and the end of the ray indicates the target position after the user moves. By detecting the movement direction and speed of the target gesture, when the movement speed of the target gesture is less than a preset speed, the end position of the ray is controlled to move according to the movement direction of the target gesture. When the movement speed of the target gesture is greater than or equal to the preset speed, the user in the virtual scene is controlled to move to the end position of the ray. This method can control the rapid movement of the user's position in the virtual scene according to the movement direction and speed of the user's gesture in the real scene. The movement of the user's position can be achieved without an additional controller, which is convenient for user operation and improves the user experience.

Description

Method and device for controlling user position in virtual scene

Technical Field

The embodiments of the present application relate to the technical field of electronic devices, and in particular, to a method and device for controlling a user position in a virtual scene.

Background technique

Extended Reality (XR) refers to the combination of reality and virtuality through computers to create a virtual environment for human-computer interaction. XR is also a general term for multiple technologies such as Virtual Reality (VR), Augmented Reality (AR) and Mixed Reality (MR). By integrating the visual interaction technologies of the three, it brings the experiencer an "immersive feeling" of seamless transition between the virtual world and the real world.

In the XR scenario, users can interact with the XR device through one or more of gaze control, handheld hardware device (such as a controller) control, gesture control, wearable device (such as a wristband) control, voice control, etc., thereby controlling virtual objects in the virtual environment corresponding to the XR device, such as selecting objects, moving, rotating, resizing, activating controls, changing color or skin, defining interactions between virtual objects, setting virtual forces to act on virtual objects, and other operations.

In the prior art, the movement of a virtual object corresponding to a user is usually achieved by moving a handheld controller worn by the user, which is inconvenient to operate.

Summary of the invention

The embodiments of the present application provide a method and device for controlling the user position in a virtual scene. The method can control the rapid movement of the user position in the virtual scene according to the movement direction and speed of the user's gesture in the real scene. The user position can be moved without an additional controller, which facilitates user operation and improves user experience.

In a first aspect, an embodiment of the present application provides a method for controlling a user position in a virtual scene, the method comprising:

When a target gesture is detected, a ray is displayed in the virtual scene, wherein the starting point of the ray represents the current position of the user, and the end point of the ray represents the target position after the user moves;

Detecting the movement direction and movement speed of the target gesture;

When the movement speed of the target gesture is less than a preset speed, controlling the position movement of the ray according to the movement direction of the target gesture;

When the movement speed of the target gesture is greater than or equal to the preset speed, the user in the virtual scene is controlled to move to the end position of the ray.

In some embodiments, controlling the position movement of the ray according to the movement direction of the target gesture includes:

When the movement direction of the target gesture is upward or downward movement and/or inward or outward rotation, controlling the position of the ray to move far or near; and/or

When the movement direction of the target gesture is leftward or rightward movement and/or leftward or rightward rotation, the position of the ray is controlled to move leftward or rightward.

In some embodiments, when the position of the ray is controlled to move far, near, left, or right, the starting position of the ray remains unchanged, and the end position of the ray moves.

In some embodiments, when the position of the ray is controlled to move far, near, left, or right, both the starting position and the end position of the ray move, and the moving distance of the starting position of the ray is smaller than the moving distance of the end position.

In some embodiments, when a target gesture is detected, displaying a ray in the virtual scene includes:

When the target gesture is detected, the ray is generated and displayed with the preset position in the virtual scene as the starting point of the ray.

In some embodiments, when a target gesture is detected, displaying a ray in the virtual scene includes:

When the target gesture is detected, a virtual object is displayed in the virtual scene, and a point on the virtual object is used as a starting point of the ray to generate and display the ray.

In some embodiments, the virtual object is a virtual gesture corresponding to the target gesture, and the starting point of the ray is a palm position or a fingertip position of the virtual gesture.

In some embodiments, the initial length of the ray is a preset length.

In some embodiments, the extending direction of the ray is the direction the user is facing.

In some embodiments, in the process of controlling the position movement of the ray according to the movement direction of the target gesture, the method further includes:

The initial position and the position after the movement of the ray are displayed separately.

In some embodiments, the target gesture is a palm-up and finger-pinching posture, and the movement speed of the target gesture is the speed at which the pinched fingers pop open.

In some embodiments, when the movement speed of the target gesture is greater than or equal to the preset speed, controlling the user in the virtual scene to move to the end position of the ray includes:

When the movement speed is greater than or equal to the preset speed, controlling the user to teleport to the end position of the ray;

Alternatively, when the movement speed is greater than or equal to the preset speed, the user is controlled to move to the end position of the ray at a preset target speed.

In some embodiments, the method further includes: hiding the ray in the virtual scene after the user moves to an end position of the ray.

On the other hand, an embodiment of the present application provides a device for controlling a user position in a virtual scene, the device comprising:

A display module, used for displaying a ray in a virtual scene when a target gesture is detected, wherein the starting point of the ray represents the current position of the user, and the end point of the ray represents the target position after the user moves;

A detection module, used to detect the movement direction and movement speed of the target gesture;

A control module, configured to control the position movement of the ray according to the movement direction of the target gesture when the movement speed of the target gesture is less than a preset speed;

The control module is further configured to control the user in the virtual scene to move to the end position of the ray when the movement speed of the target gesture is greater than or equal to the preset speed.

On the other hand, an embodiment of the present application provides a control device for a user position in a virtual scene, wherein the control device for a user position in a virtual scene comprises: a processor and a memory, wherein the memory is used to store a computer program, and the processor is used to call and run the computer program stored in the memory to execute any of the methods described above.

On the other hand, an embodiment of the present application provides a computer-readable storage medium, wherein the computer-readable storage medium is used to store a computer program, and the computer program enables a computer to execute any of the methods described above.

On the other hand, an embodiment of the present application provides a computer program product, including a computer program, which implements any of the methods described above when executed by a processor.

The control method and device of the user position in the virtual scene provided by the embodiment of the present application, when a target gesture is detected, a ray is displayed in the virtual scene, the starting point of the ray indicates the current position of the user, and the end of the ray indicates the target position after the user moves, by detecting the movement direction and movement speed of the target gesture, when the movement speed of the target gesture is less than the preset speed, the position movement of the ray is controlled according to the movement direction of the target gesture, and when the movement speed of the target gesture is greater than or equal to the preset speed, the user in the virtual scene is controlled to move to the end position of the ray. This method can control the rapid movement of the user position in the virtual scene according to the movement direction and movement speed of the user gesture in the real scene, and can realize the movement of the user position without an additional controller, which is convenient for user operation and improves the user experience.

BRIEF DESCRIPTION OF THE DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings required for use in the description of the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

FIG1 is a flow chart of a method for controlling a user position in a virtual scene provided by an embodiment of the present application;

FIG2 is a schematic diagram of an interface of a virtual scene when the user's position movement is triggered;

FIG3 is a schematic diagram of the interface transformation of the virtual scene from the user's position movement trigger to the end;

FIG4 is a schematic diagram of the structure of a device for controlling a user position in a virtual scene provided by an embodiment of the present application;

FIG5 is a schematic diagram of a structure of a device for controlling a user's position in a virtual scene provided in an embodiment of the present application.

Detailed ways

The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of the present invention.

It should be noted that the terms "first", "second", etc. in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product, or server that includes a series of steps or units is not necessarily limited to those steps or units clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products, or devices.

An embodiment of the present application provides a method for controlling a user position in a virtual scene, which can be applied to XR devices, including but not limited to VR devices, AR devices, and MR devices.

VR: Technology for creating and experiencing a virtual world. It generates a virtual environment by computation. It is a multi-source information (the virtual reality mentioned in this article includes at least visual perception, and can also include auditory perception, tactile perception, motion perception, and even taste perception, olfactory perception, etc.). It realizes the simulation of the fusion and interactive three-dimensional dynamic vision and entity behavior of the virtual environment, immersing users in a simulated virtual reality environment, and realizing applications in various virtual environments such as maps, games, videos, education, medical care, simulation, collaborative training, sales, assisted manufacturing, maintenance and repair.

VR device refers to a terminal that realizes virtual reality effects, which can usually be provided in the form of glasses, helmet-mounted displays (Head Mount Display, HMD), and contact lenses to realize visual perception and other forms of perception. Of course, the form of virtual reality devices is not limited to this, and can be further miniaturized or enlarged as needed.

AR: AR scenery refers to a simulated scenery in which at least one virtual object is superimposed on a physical scenery or a representation thereof. For example, an electronic system may have an opaque display and at least one imaging sensor for capturing images or videos of a physical scenery, which are representations of the physical scenery. The system combines the image or video with the virtual object and displays the combination on the opaque display. An individual uses the system to indirectly view the physical scenery via an image or video of the physical scenery and observes the virtual object superimposed on the physical scenery. When the system uses one or more image sensors to capture images of the physical scenery and uses those images to present the AR scenery on an opaque display, the displayed image is referred to as video pass-through. Alternatively, an electronic system for displaying an AR scenery may have a transparent or translucent display through which an individual can directly view the physical scenery. The system may display virtual objects on a transparent or translucent display so that an individual uses the system to observe virtual objects superimposed on the physical scenery. As another example, the system may include a projection system that projects virtual objects into a physical scenery. Virtual objects may be projected, for example, on a physical surface or as a hologram so that an individual uses the system to observe virtual objects superimposed on the physical scenery. Specifically, a technology that calculates the camera's posture parameters in the real world (or three-dimensional world, real world) in real time during the process of the camera capturing images, and adds virtual elements to the images captured by the camera based on the camera posture parameters. Virtual elements include but are not limited to: images, videos, and three-dimensional models. The goal of AR technology is to integrate the virtual world with the real world on the screen for interaction.

MR: By presenting virtual scene information in the real scene, an interactive feedback information loop is established between the real world, the virtual world and the user to enhance the realism of the user experience. For example, computer-created sensory input (e.g., virtual objects) is integrated with sensory input from the physical scene or its representation in the simulated scene. In some MR scenes, the computer-created sensory input can adapt to changes in sensory input from the physical scene. In addition, some electronic systems used to present MR scenes can monitor the orientation and/or position relative to the physical scene so that virtual objects can interact with real objects (i.e., physical elements from the physical scene or their representations). For example, the system can monitor movement so that virtual plants appear stationary relative to physical buildings.

A virtual scene is a virtual scene displayed (or provided) when an application is running on an electronic device. The virtual scene can be a simulation environment of the real world, a semi-simulated and semi-fictitious virtual scene, or a purely fictitious virtual scene. The virtual scene can be any one of a two-dimensional (2D) virtual scene, a 2.5-dimensional virtual scene, or a three-dimensional (3D) virtual scene. The embodiment of the present application does not limit the dimension of the virtual scene. For example, a virtual scene may include the sky, land, ocean, etc., and the land may include environmental elements such as deserts and cities, and users can control virtual objects to move in the virtual scene.

Virtual field of view refers to the area in the virtual environment that the user can perceive through the lens in the virtual reality device. The field of view (FOV) of the virtual field of view is used to represent the perceived area. The virtual field of view can also be called a virtual viewpoint.

Virtual objects are objects that interact in virtual scenes. They are controlled by users or robot programs (for example, robot programs based on artificial intelligence) and can be still, move, and perform various behaviors in virtual scenes, such as various characters in games.

The virtual field of view is constantly changing. In the prior art, the changes in the user's virtual field of view are usually controlled by the controller of the XR device. Taking HMD as an example, the HMD is provided with a posture detection sensor (such as a nine-axis sensor) for real-time detection of the posture changes of the HMD. If the user wears the HMD, then when the user's head posture changes, the real-time posture of the head will be transmitted to the processor to calculate the user's gaze point in the virtual environment, and the image in the user's gaze range (i.e., virtual field of view) in the three-dimensional model of the virtual environment is calculated based on the gaze point, and displayed on the display screen, so that people can have an immersive experience as if they were watching in the real environment.

The change of the virtual field of view can be understood as the change of the user's position. The change of both will cause the virtual scene seen by the user to change. Therefore, the movement of the user's position in the embodiment of the present application can also be understood as the movement of the virtual field of view. In some scenes, the virtual scene will display a virtual object corresponding to the user. Accordingly, the movement of the user's position can be expressed as the movement of the virtual object in the virtual scene.

In the embodiments of the present application, the virtual scene may be referred to as a virtual environment, and the real scene may be referred to as a real environment or an artificial real environment.

The present application embodiment provides a method for controlling the position of a user in a virtual scene. FIG1 is a flow chart of a method for controlling the position of a user in a virtual scene provided by the present application embodiment. The present embodiment is described by taking an XR device as an example. As shown in FIG1 , the method for controlling the position of a user in a virtual scene includes the following steps:

S101. When a target gesture is detected, a ray is displayed in a virtual scene, wherein a starting point of the ray indicates a current position of a user, and an end point of the ray indicates a target position after the user moves.

XR devices can monitor the user's hand posture in real scenes, and XR devices can continuously or periodically detect the user's hand posture (i.e., gestures). Gestures can be understood as the shape formed by the user's hands in real scenes. In one implementation, the user's gestures can be recognized using images captured by the camera of the XR device or an external camera, which captures a description of the user's hands. In another implementation, gestures can be based on input from a wearable device, such as a glove or wristband that tracks the user's hand movements. Optionally, when identifying gestures through images captured by the above-mentioned camera or motion data collected by the wearable device, the collected data can be input into a pre-trained machine learning model for identifying gestures, and the gestures are recognized by the machine learning model, thereby improving the accuracy of gesture recognition.

The target gesture is used to trigger the user's position movement, which is also called position transmission. That is, when the target gesture is detected in the real scene, it means that the user is about to start position movement.

The target gesture can be palm up, fist, palm up with fingers in a pinching posture, "OK" gesture, thumbs up gesture, etc. The target gesture can also be a gesture made by two palms together, for example, both hands are clasped in fists, both hands are put together, both hands are up at the same time, both hands are down at the same time, etc. These are just examples, and the embodiments of the present application do not limit the specific posture of the target gesture.

After the target gesture is detected, a ray is displayed in the virtual scene, which can be used to notify the user that the position movement is triggered. Of course, the user can also be prompted that the position movement is triggered in other ways, for example, by using text to prompt that the position movement is triggered in a blank position or a fixed position in the virtual scene, or by notifying the user that the position movement is triggered through voice playback.

Rays are also used to indicate the user's position before and after movement. The starting point of the ray indicates the user's current position, and the end of the ray indicates the target position after the user moves. It can be understood that the starting point of the ray does not indicate the user's actual current position. This is just a position diagram used to indicate changes in the user's position. Changes in the position of the end of the ray indicate changes in the target position. Users can continuously adjust the target position according to their needs.

This embodiment does not limit the color and style of the ray, and the style of the ray includes line thickness, solid line or dotted line, etc.

Optionally, an arrow may be added to the end of the ray to distinguish the starting point and the end of the ray by the arrow, or other patterns, such as a circular cursor or a solid dot, may be added to the end of the ray to distinguish the starting point and the end of the ray.

In one implementation, when a target gesture is detected, a ray is generated and displayed with a preset position in the virtual scene as the starting point of the ray.

The preset position may be any position in the virtual scene, for example, the preset position may be a position near the middle of the bottom of the virtual scene, or a blank position in the virtual scene, or a position at the lower left corner or lower right corner of the virtual scene.

In another implementation, when a target gesture is detected, a virtual object is displayed in the virtual scene, and a ray is generated and displayed using a point on the virtual object as a starting point of the ray.

The virtual object may be a virtual gesture corresponding to the target gesture, an arbitrary gesture, a cartoon image, an eye, a five-pointed star, a circle or other objects, etc., which is not limited in this embodiment.

The display position of the virtual object can be any position in the virtual scene, for example, the display position of the virtual object is near the middle of the bottom of the virtual scene, or a blank position in the virtual scene, or the lower left corner or lower right corner of the virtual scene.

When the virtual object is a virtual gesture corresponding to the target gesture, the starting point of the ray can be any point on the virtual gesture, such as the center of the palm or the fingertip position. The fingertip position can be the fingertip position of any finger, such as the fingertip position of the middle finger or the fingertip position of the thumb.

In addition to determining the starting point of the ray, the XR device also needs to determine the initial length and extension direction of the ray. Optionally, the initial length of the ray can be a preset length, which can be configured by the system or set by the user.

The extension direction of the ray may be a preset direction, which is configured by the system or set by the user. The extension direction of the ray may also be related to the current orientation of the user, for example, the extension direction of the ray may be set to the direction the user is facing, or to the left front or right front of the user, which is not limited in this embodiment.

Figure 2 is a schematic diagram of an interface of a virtual scene when the user's position movement is triggered. As shown in Figure 2, when it is detected that the user's posture is with the palm facing up and the fingers pinched, the gesture is displayed in the virtual scene, and a ray is emitted with the finger pinching position as the starting point. The end of the ray is the end with a circular cursor, and the position of the circular cursor is the target position after the user moves.

S102: Detect the movement direction and movement speed of the target gesture.

After the position movement is triggered, the user can maintain the target gesture and move and/or rotate the position of the hand to adjust the position of the ray by changing the direction and movement speed of the hand.

The movement direction and speed of the target gesture may be the movement speed and direction of the hand where the target gesture is located. The detection of the movement direction and speed of the target gesture may be obtained by using the image captured by the camera of the XR device or an external camera, or may be based on input from a wearable device, such as a glove or wristband that tracks the movement of the user's hand, and detecting the movement direction and speed of the hand based on the data collected by the wearable device. The movement direction and speed of the target gesture may also be detected in combination with the image data collected by the camera and the sensor data collected by the wearable device worn on the hand. Optionally, the movement speed of the target gesture may also be the flicking speed of the fingers in the target gesture.

The movement of the target gesture includes movement and/or rotation, and accordingly, the movement direction of the target gesture includes the movement direction and/or the rotation direction, and the movement speed of the target gesture includes the movement speed and/or the rotation speed. Exemplarily, the movement direction is, for example, upward, downward, leftward, and rightward, and the rotation direction is, for example, inward rotation, outward rotation, leftward rotation, and rightward rotation.

When the motion direction of the target gesture is a moving direction, the moving direction of the target gesture may be a single direction, for example, the moving direction of the target gesture is moving upward. The moving direction of the target gesture may also be multiple directions, for example, the moving direction of the target gesture is moving to the upper right, in which case the moving direction may be understood as two directions: moving upward and moving to the right.

When the movement direction of the target gesture is a rotation direction, the rotation direction is relative to a rotation point, and the rotation point may be a wrist. At this time, the user keeps the wrist still and the hand rotates inward, outward, leftward, or rightward, etc. The rotation point may also be an elbow. At this time, the user keeps the elbow still and the hand rotates inward, outward, leftward, or rightward, etc.

Optionally, the movement direction of the target gesture may also be toward the user and away from the user, the direction toward the user refers to the direction toward the user's face, and the direction away from the user refers to the direction away from the user's face. Towards the user and away from the user are two relative directions.

It can be understood that in actual operation, it is difficult to move or rotate in only one direction when the target gesture moves. At this time, you can select a main direction as the movement direction to control the position movement of the ray, or you can select a combination of multiple directions to control the position movement of the ray.

S103: When the movement speed of the target gesture is less than a preset speed, controlling the movement of the ray according to the movement direction of the target gesture.

Optionally, it is determined whether the movement speed of the target gesture is less than a preset speed. If the movement speed of the target gesture is less than the preset speed, the position of the ray is controlled to move according to the movement direction of the target gesture. If the movement speed of the user gesture is greater than or equal to the preset speed, the user in the virtual scene is controlled to move to the end position of the ray. At this time, the position of the ray is not adjusted, and the position after the user moves is the initial position of the ray, that is, the user is moved to a default position.

In this embodiment, the user can keep the target posture unchanged, and then slowly raise the hand up and down or swing the hand left and right to change the position of the ray, thereby changing the user's target position.

Exemplarily, when the target gesture moves in the direction of up or down, and/or rotates inward or outward, the position of the ray is controlled to move far or near; and/or, when the target gesture moves in the direction of left or right, and/or rotates left or right, the position of the ray is controlled to move left or right.

For example, when the user maintains the target posture and raises his hand upward, or when the user maintains the target posture and turns outward, the position of the ray moves away; when the user maintains the target posture and raises his hand downward, or when the user maintains the target posture and turns inward, the position of the ray moves closer; when the user maintains the target posture and swings his hand to the right, or when the user maintains the target posture and turns to the right, the position of the ray moves to the right; when the user maintains the target posture and swings his hand to the left, or when the user maintains the target posture and turns to the left, the position of the ray moves to the left.

For another example, when the target gesture moves toward the user, the position of the ray moves closer, and when the target gesture moves away from the user, the position of the ray moves farther. In this scenario, when determining the movement direction of the user's target gesture, it is not necessary to pay attention to whether the movement of the target finger is moving, rotating, or a combination of the two. When the user moves the target gesture, the movement direction can be toward the user or away from the user. When the user rotates the target gesture, the rotation direction can be toward the user or away from the user. When the user moves and rotates the target gesture at the same time, the movement direction can be toward the user or away from the user.

The correspondence between the movement direction of the target gesture and the movement direction of the ray can be set according to the needs of the user, and is not limited to the correspondence in the above example.

In an exemplary manner, when the position of the ray is controlled to move far, near, left, or right, the starting position of the ray remains unchanged, and the end position of the ray moves, that is, the current position of the user remains unchanged, and only the target position of the user is changed.

In another exemplary manner, when the position of the ray is controlled to move far, near, left, or right, both the starting position and the end position of the ray move, but the moving distance of the starting position of the ray is less than the moving distance of the end position. That is, the moving distance of the starting position of the ray and the moving distance of the end position have a certain proportional relationship, and the proportional relationship is, for example, 1:3, that is, the end position of the ray moves 3 centimeters and the starting position moves 1 centimeter. It can be understood that in this manner, although the starting position of the ray moves, the actual position of the user does not move.

In one implementation, the distance that the end of the ray moves is associated with the distance that the target gesture moves. For example, the greater the distance that the target gesture moves, the greater the distance that the end of the ray moves, and the smaller the distance that the target gesture moves, the smaller the distance that the end of the ray moves. The two can be linearly related or nonlinearly related, and this embodiment does not limit this.

In another implementation, the distance that the end of the ray moves is independent of the distance that the target gesture moves. Each time the target gesture movement is detected, the end of the ray is controlled to move a preset distance. No matter how far the target gesture moves, the end of the ray moves a fixed distance. The user can move the end of the ray to the target position desired by the user by moving his hand multiple times.

Optionally, in the process of controlling the position movement of the ray, the initial position of the ray and the position after the movement may be displayed differently, where the initial position of the ray refers to the position of the ray when the ray is first displayed by triggering the target gesture.

For example, the initial position and the position after the movement of the ray can be distinguished by using rays of different colors, and the initial position of the ray can be represented by a black ray, and the position after the movement of the ray can be represented by a red ray. The initial position and the position after the movement of the ray can also be distinguished by using different lines, for example, a solid line can be used to represent the initial position of the ray, and a dotted line can be used to represent the position after the movement of the ray.

In actual scenarios, the user may adjust the position of the ray by moving the hand multiple times. It can be understood that after each adjustment, the initial position of the ray remains unchanged, and only the adjusted position of the ray moves.

S104: When the movement speed of the target gesture is greater than or equal to a preset speed, control the user in the virtual scene to move to the end position of the ray.

After adjusting the end of the ray to the final position, the user can keep the target gesture unchanged and quickly move the hand in any direction. At this time, the movement speed of the detected target gesture is greater than or equal to the preset speed, so that the user's position movement takes effect, or it is called teleportation.

Optionally, when the target gesture is a palm-up and finger-pinch gesture, the pinch gesture may be quickly released to achieve rapid hand movement, and the movement speed of the target gesture detected at this time refers to the speed at which the pinched fingers are released.

Exemplarily, when the movement speed is greater than or equal to a preset speed, the user can be controlled to teleport to the end position of the ray. The user usually cannot feel the position movement process in the teleportation mode, that is, from the user's perspective, he can only feel the perspective before and after the movement.

Optionally, when the movement speed is greater than or equal to the preset speed, the user can also be controlled to move to the end position of the ray according to the preset target speed. Moving according to the target speed is usually slow, and the user can feel the position movement process. The user's perspective keeps changing during the movement of the user's position.

Optionally, after the user moves to the end position of the ray, the ray is hidden in the virtual scene, and the hiding of the ray indicates that the user's position movement has ended. Optionally, in the virtual scene, the user can also be prompted to end the position movement through text and/or voice, and the embodiments of the present application are not limited to this. If the ray is processed in the virtual scene and other related virtual objects are displayed, such as a virtual gesture corresponding to the target gesture, then after the user moves to the end position of the ray, the virtual object will also be hidden, that is, all objects on the interface that are triggered and introduced due to position movement are hidden.

After this position movement is completed, the XR device will continue to detect user gestures. When a user gesture is detected but the user gesture is not the target gesture, it will return to continue detecting the user gesture. When the user gesture is the target gesture, the above-mentioned position movement process is triggered.

FIG3 is a schematic diagram of the interface transformation of the virtual scene from the user's position movement trigger to the end. As shown in FIG3, the whole process is divided into four stages. Stage a: When the user gesture is detected to be a palm-up and finger-pinch gesture, the gesture is displayed in the virtual scene, and a ray is emitted from the finger-pinch position as the starting point. Stage b: When the user maintains this gesture and moves to the upper right, the ray moves away and to the right. Ray 1 in FIG3 represents the initial position of the ray, and ray 2 represents the position after ray 1 moves. Stage c: After moving the end of the ray to the target position, the user keeps the gesture unchanged and quickly moves the hand in any direction. As shown in FIG3, the user quickly moves the hand to the right, and the position movement takes effect. Stage d: The user moves from the current position to the target position corresponding to the end of the ray. In the figure, after the user moves to the target position, the ray disappears. At the end of the ray, that is, at the position of the circular cursor, a character image is displayed to indicate that the user has moved to this position. Although not shown in FIG3, optionally, after the ray is hidden, the user gesture and the circular cursor will also be hidden in turn, that is, all objects introduced by the position movement on the interface are hidden.

In this embodiment, when a target gesture is detected, a ray is displayed in the virtual scene, the starting point of the ray indicates the current position of the user, and the end of the ray indicates the target position after the user moves. By detecting the movement direction and speed of the target gesture, when the movement speed of the target gesture is less than a preset speed, the position movement of the ray is controlled according to the movement direction of the target gesture, and when the movement speed of the target gesture is greater than or equal to the preset speed, the user in the virtual scene is controlled to move to the end position of the ray. This method can control the rapid movement of the user's position in the virtual scene according to the movement direction and speed of the user's gesture in the real scene, and can realize the movement of the user's position without an additional controller, which is convenient for user operation and improves the user experience.

In order to better implement the method for controlling the user position in a virtual scene of the embodiment of the present application, the embodiment of the present application also provides a device for controlling the user position in a virtual scene. FIG4 is a schematic diagram of the structure of a device for controlling the user position in a virtual scene provided by the embodiment of the present application. As shown in FIG4 , the device 100 for controlling the user position in a virtual scene may include:

A display module 11 is used to display a ray in a virtual scene when a target gesture is detected, wherein the starting point of the ray represents the current position of the user, and the end point of the ray represents the target position after the user moves;

A detection module 12, used to detect the movement direction and movement speed of the target gesture;

A control module 13, configured to control the position movement of the ray according to the movement direction of the target gesture when the movement speed of the target gesture is less than a preset speed;

The control module 13 is further configured to control the user in the virtual scene to move to the end position of the ray when the movement speed of the target gesture is greater than or equal to the preset speed.

In some embodiments, the control module 13 is specifically used for:

When the movement direction of the target gesture is upward or downward movement and/or inward or outward rotation, controlling the end position of the ray to move far or near; and/or

When the movement direction of the target gesture is leftward or rightward movement and/or leftward or rightward rotation, the end position of the ray is controlled to move leftward or rightward.

In some embodiments, when the position of the ray is controlled to move far, near, left, or right, the starting position of the ray remains unchanged, and the end position of the ray moves.

In some embodiments, when the position of the ray is controlled to move far, near, left, or right, both the starting position and the end position of the ray move, and the moving distance of the starting position of the ray is smaller than the moving distance of the end position.

In some embodiments, the display module 11 is specifically used for:

When the target gesture is detected, the ray is generated and displayed with the preset position in the virtual scene as the starting point of the ray.

In some other embodiments, the display module 11 is specifically used for:

When the target gesture is detected, a virtual object is displayed in the virtual scene, and a point on the virtual object is used as a starting point of the ray to generate and display the ray.

In some embodiments, the virtual object is a virtual gesture corresponding to the target gesture, and the starting point of the ray is a palm position or a fingertip position of the virtual gesture.

In some embodiments, the initial length of the ray is a preset length.

In some embodiments, the extending direction of the ray is the direction the user is facing.

In some embodiments, the display module 11 is further used for:

The initial position and the position after the movement of the ray are displayed separately.

In some embodiments, the target gesture is a palm-up and finger-pinching posture, and the movement speed of the target gesture is the speed at which the pinched fingers pop open.

In some embodiments, the control module 13 is specifically used for:

When the movement speed is greater than or equal to the preset speed, controlling the user to teleport to the end position of the ray;

Alternatively, when the movement speed is greater than or equal to the preset speed, the user is controlled to move to the end position of the ray at a preset target speed.

In some embodiments, the apparatus 100 further comprises:

A hiding module is used to hide the ray in the virtual scene after the user moves to the end position of the ray.

It should be understood that the device embodiment and the method embodiment may correspond to each other, and similar descriptions may refer to the method embodiment. To avoid repetition, they will not be described here.

The above describes the device 100 of the embodiment of the present application from the perspective of the functional module in conjunction with the accompanying drawings. It should be understood that the functional module can be implemented in hardware form, can be implemented by instructions in software form, and can also be implemented by a combination of hardware and software modules. Specifically, the steps of the method embodiment in the embodiment of the present application can be completed by the hardware integrated logic circuit and/or software form instructions in the processor, and the steps of the method disclosed in the embodiment of the present application can be directly embodied as a hardware decoding processor to perform, or a combination of hardware and software modules in the decoding processor to perform. Optionally, the software module can be located in a mature storage medium in the field such as a random access memory, a flash memory, a read-only memory, a programmable read-only memory, an electrically erasable programmable memory, a register, etc. The storage medium is located in a memory, and the processor reads the information in the memory, and completes the steps in the above method embodiment in conjunction with its hardware.

The embodiment of the present application also provides a control device for the user position in a virtual scene. FIG5 is a schematic diagram of a structure of a control device for the user position in a virtual scene provided by an embodiment of the present application. As shown in FIG5 , the control device 200 for the user position in the virtual scene may include:

The memory 21 and the processor 22, the memory 21 is used to store the computer program and transmit the program code to the processor 22. In other words, the processor 22 can call and run the computer program from the memory 21 to implement the method in the embodiment of the present application.

For example, the processor 22 may be configured to execute the above method embodiments according to instructions in the computer program.

In some embodiments of the present application, the processor 22 may include but is not limited to:

General-purpose processor, digital signal processor (DSP), application-specific integrated circuit (ASIC), field programmable gate array (FPGA) or other programmable logic device, discrete gate or transistor logic device, discrete hardware components, etc.

In some embodiments of the present application, the memory 21 includes but is not limited to:

Volatile memory and/or non-volatile memory. Among them, the non-volatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM) or a flash memory. The volatile memory can be a random access memory (RAM), which is used as an external cache. By way of example but not limitation, many forms of RAM are available, such as static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDR SDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM) and direct memory bus random access memory (DR RAM).

In some embodiments of the present application, the computer program may be divided into one or more modules, which are stored in the memory 21 and executed by the processor 22 to complete the method provided by the present application. The one or more modules may be a series of computer program instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program in the control device of the user's position in the virtual scene.

As shown in FIG. 5 , the control device for the user position in the virtual scene may further include: a transceiver 23 , which may be connected to the processor 22 or the memory 21 .

The processor 22 may control the transceiver 23 to communicate with other devices, specifically, to send information or data to other devices, or to receive information or data sent by other devices. The transceiver 23 may include a transmitter and a receiver. The transceiver 23 may further include an antenna, and the number of antennas may be one or more.

It can be understood that, although not shown in FIG. 5 , the control device 200 for visually viewing the user's position in the virtual scene may also include a camera module, a wireless fidelity WIFI module, a positioning module, a Bluetooth module, a display, a controller, etc., which will not be repeated here.

It should be understood that the various components in the control device at the user's position in the virtual scene are connected via a bus system, wherein the bus system includes not only a data bus but also a power bus, a control bus and a status signal bus.

The present application also provides a computer storage medium on which a computer program is stored, and when the computer program is executed by a computer, the computer can perform the method of the above method embodiment. In other words, the present application embodiment also provides a computer program product containing instructions, and when the instructions are executed by a computer, the computer can perform the method of the above method embodiment.

The present application also provides a computer program product, which includes a computer program, and the computer program is stored in a computer-readable storage medium. The processor of the control device of the user position in the virtual scene reads the computer program from the computer-readable storage medium, and the processor executes the computer program, so that the control device of the user position in the virtual scene executes the corresponding process in the control method of the user position in the virtual scene in the embodiment of the present application, which will not be repeated here for the sake of brevity.

In the several embodiments provided in the present application, it should be understood that the disclosed systems, devices and methods can be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the module is only a logical function division. There may be other division methods in actual implementation, such as multiple modules or components can be combined or integrated into another system, or some features can be ignored or not executed. Another point is that the mutual coupling or direct coupling or communication connection shown or discussed can be through some interfaces, indirect coupling or communication connection of devices or modules, which can be electrical, mechanical or other forms.

The modules described as separate components may or may not be physically separated, and the components displayed as modules may or may not be physical modules, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the modules may be selected according to actual needs to achieve the purpose of the scheme of this embodiment. For example, each functional module in each embodiment of the present application may be integrated into a processing module, or each module may exist physically separately, or two or more modules may be integrated into one module.

The above is only a specific implementation of the present application, but the protection scope of the present application is not limited thereto. Any technician familiar with the technical field can easily think of changes or substitutions within the technical scope disclosed in the present application, which should be included in the protection scope of the present application. Therefore, the protection scope of the present application should be based on the protection scope of the claims.

Claims (17)

1. A method for controlling a user's position in a virtual scene, comprising: When a target gesture is detected, a ray is displayed in the virtual scene, wherein the starting point of the ray represents the current position of the user, and the end point of the ray represents the target position after the user moves; Detecting the movement direction and movement speed of the target gesture; When the movement speed of the target gesture is less than a preset speed, controlling the position movement of the ray according to the movement direction of the target gesture; When the movement speed of the target gesture is greater than or equal to the preset speed, the user in the virtual scene is controlled to move to the end position of the ray. 2. The method according to claim 1, characterized in that controlling the position movement of the ray according to the movement direction of the target gesture comprises: When the movement direction of the target gesture is upward or downward movement and/or inward or outward rotation, controlling the position of the ray to move far or near; and/or When the movement direction of the target gesture is leftward or rightward movement and/or leftward or rightward rotation, the position of the ray is controlled to move leftward or rightward. 3. The method according to claim 2 is characterized in that when the position of the ray is controlled to move far, near, left or right, the starting position of the ray remains unchanged, and the end position of the ray moves. 4. The method according to claim 2 is characterized in that when the position of the ray is controlled to move far, near, left or right, both the starting position and the end position of the ray move, and the moving distance of the starting position of the ray is smaller than the moving distance of the end position. 5. The method according to claim 1, characterized in that when a target gesture is detected, displaying a ray in a virtual scene comprises: When the target gesture is detected, the ray is generated and displayed with the preset position in the virtual scene as the starting point of the ray. 6. The method according to claim 1, characterized in that when a target gesture is detected, displaying a ray in a virtual scene comprises: When the target gesture is detected, a virtual object is displayed in the virtual scene, and a point on the virtual object is used as a starting point of the ray to generate and display the ray. 7. The method according to claim 6 is characterized in that the virtual object is a virtual gesture corresponding to the target gesture, and the starting point of the ray is the palm position or fingertip position of the virtual gesture. 8. The method according to claim 5 or 6, characterized in that the initial length of the ray is a preset length. 9 . The method according to claim 7 , wherein the extending direction of the ray is the direction the user is facing. 10. The method according to any one of claims 1 to 7, characterized in that, in the process of controlling the position movement of the ray according to the movement direction of the target gesture, it further comprises: The initial position and the position after the movement of the ray are displayed separately. 11. The method according to any one of claims 1 to 7, characterized in that the target gesture is a gesture of palm facing up and fingers pinching, and the movement speed of the target gesture is a speed at which the pinched fingers bounce off. 12. The method according to any one of claims 1 to 7, characterized in that when the movement speed of the target gesture is greater than or equal to the preset speed, controlling the user in the virtual scene to move to the end position of the ray comprises: When the movement speed is greater than or equal to the preset speed, controlling the user to teleport to the end position of the ray; Alternatively, when the movement speed is greater than or equal to the preset speed, the user is controlled to move to the end position of the ray at a preset target speed. 13. The method according to any one of claims 1 to 7, further comprising: After the user moves to an end position of the ray, the ray is hidden in the virtual scene. 14. A device for controlling a user's position in a virtual scene, comprising: A display module, used for displaying a ray in a virtual scene when a target gesture is detected, wherein the starting point of the ray represents the current position of the user, and the end point of the ray represents the target position after the user moves; A detection module, used to detect the movement direction and movement speed of the target gesture; A control module, configured to control the position movement of the ray according to the movement direction of the target gesture when the movement speed of the target gesture is less than a preset speed; The control module is further configured to control the user in the virtual scene to move to the end position of the ray when the movement speed of the target gesture is greater than or equal to the preset speed. 15. A device for controlling a user's position in a virtual scene, comprising: A processor and a memory, the memory being used to store a computer program, and the processor being used to call and run the computer program stored in the memory to execute the method according to any one of claims 1 to 13. 16. A computer-readable storage medium, characterized in that it is used to store a computer program, wherein the computer program enables a computer to execute the method according to any one of claims 1 to 13. 17. A computer program product, comprising a computer program, wherein when the computer program is executed by a processor, the method according to any one of claims 1 to 13 is implemented.