CN114564106B - Method and device for determining interaction indication line, electronic equipment and storage medium - Google Patents

Abstract

The embodiment of the disclosure provides a method, a device, electronic equipment and a storage medium for determining an interaction indication line, wherein the method comprises the following steps: acquiring target pointing information of a direction indicator; determining an interaction indication line to be corrected and an object to be controlled which is intersected with the interaction indication line to be corrected according to the target pointing information and the viewpoint position information of the viewpoint controller; and determining a target interaction indication line according to the indicator position information of the direction indicator and the to-be-repaired orthogonal interaction indication line, so as to control the object to be controlled based on the target interaction indication line. According to the technical scheme provided by the embodiment of the disclosure, the user can select and control any object which can be observed in the sight range through the handle, so that the interestingness of the virtual scene and the use experience of the user are improved.

Description

Method, device, electronic device and storage medium for determining interactive indicator line

Technical field

The embodiments of the present disclosure relate to the field of data processing technology, and in particular, to a method, device, electronic device, and storage medium for determining an interactive indicator line.

Background technique

With the development of virtual technology, extended reality (XR) devices can enable users to interact with corresponding virtual objects. In order to interact with distant objects, an interaction indicator line is needed to determine the interactive object that the user is paying attention to. The interactive indicator line works similarly to a traditional mouse.

In practical applications, users can use indicators worn on the head to see objects within a specific visual range. However, some of these objects cannot be directly related through the curve of the hand. The main reason is that the head indicator cannot project the corresponding curve, and the curve projected by the hand is likely to be blocked by other objects, which results in the target object that the user wants to select unable to be selected by a straight line or curve.

Contents of the invention

Embodiments of the present disclosure provide a method, device, electronic device, and storage medium for determining an interactive indicator line, allowing users to select and control any object that can be observed within the line of sight through a handle, thereby improving the fun of the virtual scene and improving the user experience. usage experience.

In a first aspect, embodiments of the present disclosure provide a method for determining an interactive indicator line, which method includes:

Get the target pointing information of the direction indicator;

According to the target pointing information and the viewpoint position information of the viewpoint controller, determine the interaction indication line to be corrected and the object to be controlled that intersects with the interaction indication line to be corrected;

According to the indicator position information of the direction indicator and the interaction indication line to be corrected, a target interaction indication line is determined to control the object to be controlled based on the target interaction indication line.

In a second aspect, embodiments of the present disclosure also provide a device for determining an interactive indicator line, which device includes:

The pointing information determination module is used to obtain the target pointing information of the direction indicator;

An interaction indication line to be corrected determination module, configured to determine an interaction indication line to be corrected and an object to be controlled that intersects the interaction indication line to be corrected based on the target pointing information and the viewpoint position information of the viewpoint controller;

A target interaction indication line determination module is configured to determine a target interaction indication line based on the indicator position information of the direction indicator and the interaction indication line to be corrected, so as to control the object to be controlled based on the target interaction indication line.

In a third aspect, embodiments of the present disclosure also provide an electronic device, where the electronic device includes:

one or more processors;

a storage device for storing one or more programs,

When the one or more programs are executed by the one or more processors, the one or more processors are caused to implement the method for determining the interaction indicator line as described in any one of the embodiments of the present disclosure.

In a fourth aspect, embodiments of the disclosure further provide a storage medium containing computer-executable instructions, which when executed by a computer processor are used to perform interactive instructions as described in any embodiment of the disclosure. How to determine the line.

The technical solution of the embodiment of the present disclosure obtains the target pointing information of the direction indicator, that is, determines the direction of the handle held by the user's hand; determines the interaction indication line to be corrected based on the target pointing information and the viewpoint position information of the viewpoint controller, and determines the interaction indication line to be corrected, and The object to be controlled that intersects the interaction indication line to be corrected determines the user's line of sight and the object expected to be controlled; further, according to the indicator position information of the direction indicator and the interaction indication line to be corrected, the target interaction indication line is determined to based on the target The interactive indicator line controls the object to be controlled, allowing the user to select and control any object that can be observed within the line of sight through the handle, avoiding the problem that some objects cannot be selected due to occlusion between the user and the user, and enriching the user's interaction with the user. The interactive effect of various objects in the scene improves the fun of the virtual scene and the user experience.

Description of the drawings

The above and other features, advantages, and aspects of various embodiments of the present disclosure will become more apparent with reference to the following detailed description taken in conjunction with the accompanying drawings. Throughout the drawings, the same or similar reference numbers refer to the same or similar elements. It is to be understood that the drawings are schematic and that elements and elements are not necessarily drawn to scale.

Figure 1 is a schematic flowchart of a method for determining an interactive indicator line provided by Embodiment 1 of the present disclosure;

Figure 2 is a schematic diagram of selecting and controlling objects in a scene based on XR equipment according to Embodiment 1 of the present disclosure;

Figure 3 is a schematic diagram of determining a target connection point on an interaction indication line to be corrected according to Embodiment 1 of the present disclosure;

Figure 4 is a schematic diagram of drawing a Bezier curve provided by Embodiment 1 of the present disclosure;

Figure 5 is a structural block diagram of a device for determining an interactive indicator line provided in Embodiment 2 of the present disclosure;

FIG. 6 is a schematic structural diagram of an electronic device provided by Embodiment 3 of the present disclosure.

Detailed ways

Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the disclosure are shown in the drawings, it should be understood that the disclosure may be embodied in various forms and should not be construed as limited to the embodiments set forth herein, which rather are provided for A more thorough and complete understanding of this disclosure. It should be understood that the drawings and embodiments of the present disclosure are for illustrative purposes only and are not intended to limit the scope of the present disclosure.

It should be understood that various steps described in the method implementations of the present disclosure may be executed in different orders and/or in parallel. Furthermore, method embodiments may include additional steps and/or omit performance of illustrated steps. The scope of the present disclosure is not limited in this regard.

As used herein, the term "include" and its variations are open-ended, ie, "including but not limited to." The term "based on" means "based at least in part on." The term "one embodiment" means "at least one embodiment"; the term "another embodiment" means "at least one additional embodiment"; and the term "some embodiments" means "at least some embodiments". Relevant definitions of other terms will be given in the description below.

It should be noted that concepts such as “first” and “second” mentioned in this disclosure are only used to distinguish different devices, modules or units, and are not used to limit the order of functions performed by these devices, modules or units. Or interdependence.

It should be noted that the modifications of "one" and "plurality" mentioned in this disclosure are illustrative and not restrictive. Those skilled in the art will understand that unless the context clearly indicates otherwise, it should be understood as "one or Multiple”.

Embodiment 1

Figure 1 is a schematic flowchart of a method for determining an interactive indicator line provided in Embodiment 1 of the present disclosure. This embodiment can be applied to situations where a user uses an XR device to select an object being observed in a scene. This method can be determined by an interactive indicator line. The determination device is executed, and the device can be implemented in the form of software and/or hardware. The hardware can be an electronic device, such as a mobile terminal, a PC, or a server. The scene displayed by any image is usually implemented by the cooperation of the client and the server. The method provided in this embodiment can be executed by the server, the client, or the client and the server cooperate.

As shown in Figure 1, the method in this embodiment includes:

S110. Obtain the target pointing information of the direction indicator.

In this embodiment, users can use XR equipment to observe, select and control various objects in the 3D space. Specifically, extended reality refers to a real and virtual combination and human-computer interaction environment generated through computer technology and wearable devices. It is a combination of augmented reality (AR), virtual reality (VR) and hybrid It is a collective name for various forms such as Mixed Reality (MR). By integrating three visual interaction technologies, it can achieve an "immersive" experience of seamless transition between the virtual world and the real world.

Correspondingly, XR devices are devices related to extended reality technology, such as handle indicators. Specifically, the handle indicator can be a handheld device developed based on wireless communication technology. When the handle indicator is started, it can be associated with a specific network and other types of XR devices. Further, by adjusting the handle indicator The triggering operation of the relevant buttons can generate signals for selecting or controlling objects in the extended reality scene. In actual application, the user can use the handle indicator to generate control signals in the form of rays for objects in the scene. Therefore, depending on the type of rays generated, the handle indicator is also divided into handle indicators that can emit linear rays. (straight curve), and the handle Bezier curve indicator (beziercurve) that can emit curved rays.

Since the rays emitted by the handle indicator have directionality, in this embodiment, the handle held by the user is the direction indicator, and the target pointing information is the pointing information of the end of the handle that emits the ray. For example, the handle held by the user A handle linear indicator, and based on the indicator aiming in the horizontal north direction, the system can determine the target pointing information corresponding to the horizontal north direction.

In this embodiment, the target pointing information of the direction indicator can be determined based on a gyroscope provided in the direction indicator.

Among them, the gyroscope is an angular motion detection device that uses a momentum-moment-sensitive shell of a high-speed rotating body to rotate around one or two axes orthogonal to the rotation axis relative to the inertial space. It can be understood that when a gyroscope is installed in the direction indicator, not only the orientation of the direction indicator can be accurately determined, but also the direction of the end of the direction indicator emitting ray can be determined, so that the system can obtain the target pointing information corresponding to the direction indicator. .

Taking Figure 2 as an example, when the user points the handle indicator to an object in the virtual scene, based on the gyroscope built into the handle indicator, it can be determined in real time that the direction pointed by the arrow in the picture is the direction of the handle. That is, the target pointing information of the controller at the current moment is determined. It can be understood that integrating a directional gyroscope that is not affected by a magnetic field into a direction indicator can determine the target pointing information of the direction indicator with high accuracy and efficiency.

S120. Determine the interaction indication line to be corrected and the object to be controlled that intersects the interaction indication line to be corrected according to the target pointing information and the viewpoint position information of the viewpoint controller.

Among many types of XR devices, in addition to handle indicators, there are also head Gaze indicators. Based on this, in this embodiment, the viewpoint controller may be a head indicator associated with a direction indicator. Specifically, when the user wears the head pointer, he or she can at least observe objects in the extended reality scene.

Compared with traditional VR headsets and AR smart glasses and other devices, the viewpoint controller can not only provide the user with a certain visual range, but also determine the user's viewpoint position information, where the viewpoint position information refers to the user's observation point. , when the user is at the current observation point, he can at least see the objects in the extended reality scene. As shown in Figure 2, when the user wears the head indicator and starts it, object A and object B in the extended reality scene can be observed at the current observation point. Correspondingly, the head indicator is based on the current posture of the user's head. The corresponding viewpoint position information can be determined.

In this embodiment, after the target pointing information of the direction indicator and the viewpoint position information of the viewpoint controller are determined, an interaction indication line to be corrected can be further determined. Specifically, the interaction indicator line to be corrected is a line constructed by taking the viewpoint position information as the starting point and extending in the direction corresponding to the target pointing information. Based on this, it can be understood that the process of constructing the interactive indicator line to be corrected is the process of taking the user's viewpoint as the starting point and emitting a ray along the handle.

Further, when the interaction indication line to be corrected continues to extend along the direction corresponding to the target pointing information and intersects with the object in the extended reality space, the intersecting object can be determined as the object to be selected. It can be understood that the object to be selected is an object that the user can see within the current field of view, and at the same time, the direction of sight between the user and the object is consistent with the direction of the handle.

Since in this embodiment, the user can select and control any object in the extended reality scene based on the XR device, the object to be selected can also be used as the object to be controlled. Specifically, the intersection point between the object and the interaction indication line to be corrected can be used as the control point of the object to be controlled, thereby allowing the user to control the object to be controlled based on the control points.

Continuing to use Figure 2 as an example to illustrate, when the viewpoint position information and handle pointing are determined, the head indicator viewpoint can be used as the starting point to construct a straight line, and the straight line can be extended along the direction of the handle pointing. When the straight line intersects with object A, Object A is the object to be controlled, the intersection hitpoint is the control point, and the line segment between the viewpoint and the control point is the final interaction indicator line to be corrected.

S130. Determine the target interaction indication line according to the indicator position information of the direction indicator and the interaction indication line to be corrected, so as to control the object to be controlled based on the target interaction indication line.

Among them, the target interactive indicator line refers to the ray finally emitted by the direction indicator and used to control the object to be controlled. This ray is processed on the basis of the interactive indicator line to be corrected. The following is a combination of Figure 3 and Figure 4. The process of determining the target interaction indicator line is explained in detail.

In this embodiment, since the target interaction indication line only includes a part of the interaction indication line to be corrected, and the other part is the connection between the end of the direction indicator that emits a ray and the interaction indication line to be corrected, therefore, when determining the target interaction In the process of indicating the line, it is also necessary to determine the connection points to be selected on the interactive indicator line to be corrected.

Specifically, the connection point adjustment range is determined based on the length information of the interactive indicator line to be corrected and the preset adjustment parameters; within the connection point adjustment range, the viewpoint position information is used as the starting point, and each to be selected is determined in sequence according to the preset step size. Junction.

Among them, the length information is the actual length of the interactive indicator line to be corrected, which can be understood as the distance between the viewpoint of the viewpoint controller and the object to be controlled. The connection point is the ray finally emitted by the direction indicator and the interactive indicator line to be corrected. connection points between. Correspondingly, the adjustment parameters are parameters that determine which part of the interaction indicator line the connection point is located on.

Taking Figure 3 as an example, when the length information of the interaction indicator line to be corrected between the viewpoint and the object A to be controlled is determined, and the preset adjustment parameter is determined to be 0.5, the length of the ray finally emitted by the handle and the interaction indicator line to be corrected can be determined. The connection point is in the first half of the interaction indicator line to be corrected, that is, the part between the viewpoint and the midpoint of the interaction indicator line to be corrected. Further, when the step size is determined to be 0.1, starting from the current viewpoint of the viewpoint controller, multiple connection points to be selected can be determined one by one on the interaction indication line to be corrected. Those skilled in the art should understand that the adjustment parameters can be selected and set from the range of (0, 1) according to actual needs, and the embodiments of the present disclosure are not specifically limited here. At the same time, the step length can also be set according to the actual length of the interactive indicator line to be corrected (for example, when the interactive indicator line to be corrected is 1m, the step length can be set to 0.1m). It can be understood that when the interactive indicator line to be corrected is When the line is long, the step size can be adaptively increased, that is, the number of determined connection points to be selected can be reduced, thereby reducing the waste of system computing resources.

Further, the target connection point is determined based on the indicator position information and each connection point to be selected. The target connection point is a point determined from a plurality of connection points to be selected. It can be understood that the target connection point is also the point where the ray finally emitted by the direction indicator intersects the interaction indicator line to be corrected.

Specifically, based on the sequence information that determines each connection point to be selected, it is determined whether the connection between the indicator position information and the corresponding connection point to be selected intersects with the obstacle for the first time; if so, the sequence information is used to determine the point when it intersects with the obstacle. The previous connection point to be selected is used as the target connection point. Among them, the obstacle is an object between the user and the object to be controlled. It can be understood that due to the obstruction of the obstacle, the direction indicator in the user's hand cannot control the object to be controlled by emitting linear rays.

Continuing to use Figure 3 as an example for explanation, after multiple connection points to be selected are determined on the interactive indicator line to be corrected, the viewpoint on the interactive indicator line to be corrected can be used as the first end to connect with the direction indicator that emits rays. At the same time, it is judged whether the connecting line intersects with the obstacle object B blocking the object to be controlled. As can be seen from the figure, the first connection line does not intersect object B. At this time, the end of the direction indicator that emits the ray can be connected to the second connection point to be selected in the direction corresponding to the target pointing information, and the same method to determine whether the connection line intersects with object B, and so on. When the fifth connection line is constructed, it can be determined that the connection line intersects with object B. At this time, in order to construct the target interaction indicator line, it is necessary to select the previous connection point of the connection point to be selected corresponding to the connection line (i.e. In Figure 3, the fourth point from the viewpoint on the interaction indication line to be corrected is used as the target connection point.

In this embodiment, after the target connection point is determined, the target interaction indication line can be determined based on the indicator position information, the target connection point, and the interaction indication line to be corrected. Specifically, the Bezier curve is determined based on the indicator position information and the target connection point; the target interactive indicator line is determined based on the Bezier curve and the interactive indicator line to be corrected.

Among them, the Bezier curve, also known as the Bezier curve or the Bezier curve, is a mathematical curve used in two-dimensional graphics applications. It consists of line segments and nodes. Since its nodes are draggable fulcrums, In general vector graphics software or bitmap software, the accuracy of the generated curves can be improved through Bezier curves.

In this embodiment, the Bezier curve can be determined based on the position information of one end of the ray emitted by the direction indicator and the target connection point determined on the interactive indicator line to be corrected. It can be understood that the determined Bezier curve is Part of the resulting target interaction indicator line. It should be noted that the target connection point is also the connection point between the Bezier curve and the interaction indicator line to be corrected which is a part of the line segment after the target connection point.

Taking Figure 3 as an example, when the fourth connection point to be selected is determined as the target connection point using the viewpoint as the starting point, a Bezier curve can be constructed based on the current position information of the direction indicator and the target connection point. At the same time, for For the Bezier curve (guidance part) and the part on the interactive indicator line to be corrected between the target connection point and the control point, the target connection point is also the connection point of the above two parts.

In the actual application process, in order to improve the accuracy of the determined Bezier curve, it is also necessary to determine the degree of curvature of the Bezier curve in different directions. Specifically, determine the first intensity corresponding to the target pointing information and the second intensity in the vertical direction to the target pointing information; based on the first intensity, the second intensity, the indicator position information, the target connection point, the target pointing information and The vertical pointing information perpendicular to the target pointing information determines the Bezier curve.

Among them, the first intensity reflects the bending degree of the Bezier curve in the target direction, and the second intensity reflects the bending degree of the Bezier curve in the vertical direction of the target direction. It can be understood that the first intensity and the second intensity also represent The weight of the influence of different directions on the constructed Bezier curve. Taking Figure 4 as an example, the direction of the connection between the handle controller and startOutHandler is that the target points in the vertical direction, that is, the direction of the exit point of the Bezier curve from the direction indicator. Correspondingly, the target connection point contrastPoint and endInHandler The direction of the connecting line is the target direction, that is, the direction of the entry point when the Bezier curve passes through the target connection point and intersects the interaction indicator line to be corrected. While the above two directions are determined, the first intensity and the second intensity may also be determined based on preset parameters. Specifically, the intensity of the Bezier curve's exit point from the direction indicator is determined according to the curveBeginIntensity parameter, that is, the degree of curvature of the Bezier curve in the vertical direction of the target point is determined, and the entry point of the Bezier curve from the target connection point is determined according to the curveEndIntensity parameter. The strength of the Bezier curve determines the degree of curvature of the Bezier curve in the target direction. It should be noted that during actual application, at least the preset values of the above two parameters do not exceed 1, and distortion of the Bezier curve generally does not occur.

Since in actual application, the Bezier curve is drawn based on multiple points, therefore, optionally, based on the first intensity, the second intensity, the indicator position information, the target connection point, the target pointing information and the vertical Point to the information to determine the Bezier curve to be drawn; determine multiple discrete points corresponding to the Bezier curve to be drawn based on the preset drawing parameters; determine the Bezier curve based on the multiple discrete points.

Continuing to use Figure 4 as an example to illustrate, when the bending degree of the Bezier curve in the above two directions is determined based on the first determination and the second intensity respectively, and the target connection point is determined, the connection point to be drawn can be determined. Bezier curve. Further, the preset drawing parameter guidanceForwardOffset is obtained. It can be understood that the drawing parameter is at least used to determine multiple discrete points for drawing the Bezier curve in a two-dimensional plane. At the same time, these discrete points can also be presented to the user based on the viewpoint controller. When the user determines to use these discrete points, he can issue a confirmation instruction to the system. Based on this instruction, the system can connect multiple discrete points in order, thus Get the Bezier curve between a section of the ray emitted by the direction indicator and the target connection point. It should be noted that the Bezier curve constructed based on the determined discrete points usually exceeds the interaction indicator line to be corrected by a certain distance. This distance can be used as the breakdown distance, thereby avoiding the ray determination threshold caused by the breakdown distance being zero. Something went wrong.

In this embodiment, in order to enable the user to control the object to be controlled in the extended reality scene through the direction indicator, after determining the Bezier curve as part of the target interaction indication line, it is also necessary to modify the interaction indication line The connection line between the target connection point and the control point of the object to be controlled is used as the interaction indicator line to be spliced; the target interaction indicator line is determined based on the Bezier curve and the interaction indicator line to be spliced.

Taking Figure 2 as an example to illustrate, after the Bezier curve as the guidance part is determined, the hitpoint and the part between the connection points can be connected to obtain the interactive indicator line to be spliced. Further, after the ray emitted by the direction indicator along the Bezier curve reaches the target connection point, it continues to be emitted along the interactive indicator line to be spliced. When the ray intersects with object A as the object to be controlled, the path of the ray is the target. As for the interactive indicator line, it can be understood that the path can be seen as the splicing of the Bezier curve and the interactive indicator line to be spliced. At the same time, the user can select and control object A based on the target interaction indicator line. For example, after selecting object A, the system can present the information of object A to the user through the display device associated with the viewpoint controller. When the user presses the direction indicator After pressing the corresponding button, you can also generate a grabbing signal corresponding to the ray on the target interaction indicator line, thereby achieving the effect of grabbing object A in the extended reality space.

It should be noted that during the process of controlling the motion of the object to be controlled, optionally, repeatedly updating the target interaction indicator line based on the acquired target pointing information of the direction indicator and the viewpoint position information of the viewpoint controller.

Specifically, since the user's hand holding the handle is in constant motion, during the user's movement, the system can continuously obtain the target pointing information of the direction indicator according to the solution described above in this embodiment, and combine it with the viewpoint The controller's viewpoint position information continuously determines the objects to be controlled that the user expects to control within the extended reality scene. Further, for the determined object, the currently generated target interaction indicator line is updated, and a control signal corresponding to the ray on the updated target interaction indicator line is generated according to the user's trigger operation, thereby achieving continuous control of an object. Control, or continuously switch objects in the scene for control according to the user's actual situation.

The technical solution of this embodiment is to obtain the target pointing information of the direction indicator, that is, to determine the direction of the handle held by the user's hand; according to the target pointing information and the viewpoint position information of the viewpoint controller, determine the interaction indication line to be corrected, and determine the interaction indicator line to be corrected, and determine the direction of the handle held by the user's hand. Correct the object to be controlled that the interaction indicator line intersects, that is, determine the user's line of sight and the object expected to be controlled; further, according to the indicator position information of the direction indicator and the interaction indicator line to be corrected, determine the target interaction indicator line to base on the target interaction The indicator line controls the object to be controlled, allowing the user to select and control any object that can be observed within the line of sight through the handle, avoiding the problem that some objects cannot be selected due to occlusion between the user and the user, enriching the user and the scene The interactive effect of various objects in the virtual scene improves the fun of the virtual scene and the user experience.

Embodiment 2

Figure 5 is a structural block diagram of a device for determining an interactive indicator line provided in Embodiment 2 of the present disclosure. It can execute the method for determining an interactive indicator line provided by any embodiment of the present disclosure, and has functional modules and beneficial effects corresponding to the execution method. . As shown in FIG. 5 , the device specifically includes: a pointing information determination module 210 , an interaction indication line to be corrected determination module 220 , and a target interaction indication line determination module 230 .

The pointing information determination module 210 is used to obtain the target pointing information of the direction indicator.

The interaction indication line to be corrected determination module 220 is configured to determine the interaction indication line to be corrected and the objects to be controlled that intersect the interaction indication line to be corrected based on the target pointing information and the viewpoint position information of the viewpoint controller.

The target interaction indication line determination module 230 is configured to determine a target interaction indication line according to the indicator position information of the direction indicator and the interaction indication line to be corrected, so as to control the object to be controlled based on the target interaction indication line. .

Optionally, the pointing information determination module 210 is also configured to determine the target pointing information of the direction indicator based on the gyroscope provided in the direction indicator.

Based on the above technical solutions, the interaction indication line to be corrected determination module 220 includes an interaction indication line to be corrected determining unit and an object to be controlled determining unit.

The interactive indication line to be corrected determining unit is configured to use the viewpoint position information as a starting point to determine the interactive indication line to be corrected corresponding to the target pointing information.

The object to be controlled determination unit is configured to use the object to be selected that intersects the interaction indication line to be corrected as the object to be controlled, and the intersection point as the control point of the object to be controlled, to control based on the Point controls the object to be controlled.

Based on the above technical solutions, the target interaction indication line determination module 230 includes a connection point to be selected determination unit, a target connection point determination unit and a target interaction indication line determination unit.

A connection point determination unit to be selected is used to determine each connection point to be selected on the interaction indication line to be corrected.

A target connection point determination unit is configured to determine a target connection point based on the indicator position information and each connection point to be selected.

A target interaction indication line determination unit is configured to determine a target interaction indication line based on the indicator position information, the target connection point, and the interaction indication line to be corrected.

Optionally, the connection point determination unit to be selected is also configured to determine the connection point adjustment range according to the length information of the interaction indicator line to be corrected and the preset adjustment parameters; within the connection point adjustment range, the The viewpoint position information is used as the starting point, and each connection point to be selected is determined in sequence according to the preset step size.

Optionally, the target connection point determination unit is also used to determine whether the connection line between the indicator position information and the corresponding connection point to be selected intersects the obstacle for the first time based on the sequence information for determining each connection point to be selected; if so, then The previous connection point to be selected when intersecting the obstacle is determined according to the sequence information as the target connection point.

Optionally, the target interactive indicator line determination unit is further configured to determine a Bezier curve based on the indicator position information and the target connection point; based on the Bezier curve and the interactive indicator line to be corrected, Determine the target interaction indicator line.

Optionally, the target interaction indication line determination unit is also used to determine the first intensity corresponding to the target pointing information, and the second intensity in the direction perpendicular to the target pointing information; based on the first intensity, the third intensity The Bezier curve is determined by two intensities, pointer position information, target connection points, target pointing information and vertical pointing information perpendicular to the target pointing information.

Optionally, the target interactive indicator line determination unit is also configured to determine the Bezier to be drawn based on the first intensity, the second intensity, the indicator position information, the target connection point, the target pointing information and the vertical pointing information. Curve; determine a plurality of discrete points corresponding to the Bezier curve to be drawn according to preset drawing parameters; determine the Bezier curve based on the plurality of discrete points.

Optionally, the target interaction indication line determination unit is also configured to use the connection line between the target connection point on the modified interaction indication line and the control point of the object to be controlled as the interaction indication line to be spliced; based on the The Bezier curve and the interactive indicator line to be spliced are used to determine the target interactive indicator line.

Based on the above technical solutions, the device for determining the interaction indication line also includes a target interaction indication line update module.

A target interactive indicator line update module, configured to repeatedly execute, in the process of controlling the movement of the object to be controlled, to update the target based on the acquired target pointing information of the direction indicator and the viewpoint position information of the viewpoint controller. Interactive indicator lines.

The technical solution provided by this embodiment obtains the target pointing information of the direction indicator, that is, determines the direction of the handle held by the user's hand; determines the interaction indication line to be corrected based on the target pointing information and the viewpoint position information of the viewpoint controller, and The object to be controlled that intersects the interaction indication line to be corrected determines the user's line of sight and the object expected to be controlled; further, according to the indicator position information of the direction indicator and the interaction indication line to be corrected, the target interaction indication line is determined based on The target interactive indicator line controls the object to be controlled, allowing the user to select and control any object that can be observed within the line of sight through the handle, avoiding the problem that some objects cannot be selected due to occlusion between the user and the user, and enriching the user experience The interaction effect with various objects in the scene improves the fun of the virtual scene and the user experience.

The device for determining the interactive indicator line provided by the embodiments of the present disclosure can execute the method for determining the interactive indicator line provided by any embodiment of the present disclosure, and has functional modules and beneficial effects corresponding to the execution method.

It is worth noting that the various units and modules included in the above-mentioned devices are only divided according to functional logic, but are not limited to the above-mentioned divisions, as long as they can achieve the corresponding functions; in addition, the specific names of each functional unit are just In order to facilitate mutual differentiation, it is not used to limit the protection scope of the embodiments of the present disclosure.

Embodiment 3

FIG. 6 is a schematic structural diagram of an electronic device provided by Embodiment 3 of the present disclosure. Referring now to FIG. 6 , a schematic structural diagram of an electronic device (such as the terminal device or server in FIG. 6 ) 300 suitable for implementing embodiments of the present disclosure is shown. Terminal devices in embodiments of the present disclosure may include, but are not limited to, mobile phones, laptops, digital broadcast receivers, PDAs (Personal Digital Assistants), PADs (Tablets), PMPs (Portable Multimedia Players), vehicle-mounted terminals (such as Mobile terminals such as car navigation terminals) and fixed terminals such as digital TVs, desktop computers, etc. The electronic device shown in FIG. 6 is only an example and should not impose any limitations on the functions and scope of use of the embodiments of the present disclosure.

As shown in FIG. 6, the electronic device 300 may include a processing device (such as a central processing unit, a graphics processor, etc.) 301, which may be loaded into a random access device according to a program stored in a read-only memory (ROM) 302 or from a storage device 306. The program in the memory (RAM) 303 executes various appropriate actions and processes. In the RAM 303, various programs and data required for the operation of the electronic device 300 are also stored. The processing device 301, the ROM 302 and the RAM 303 are connected to each other via a bus 304. An editing/output (I/O) interface 305 is also connected to bus 304.

Generally, the following devices may be connected to the I/O interface 305: an editing device 306 including, for example, a touch screen, touch pad, keyboard, mouse, camera, microphone, accelerometer, gyroscope, etc.; including, for example, a liquid crystal display (LCD), speaker, vibration An output device 307 such as a computer; a storage device 308 including a magnetic tape, a hard disk, etc.; and a communication device 309. The communication device 309 may allow the electronic device 300 to communicate wirelessly or wiredly with other devices to exchange data. Although FIG. 6 illustrates electronic device 300 with various means, it should be understood that implementation or availability of all illustrated means is not required. More or fewer means may alternatively be implemented or provided.

In particular, according to embodiments of the present disclosure, the processes described above with reference to the flowcharts may be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product including a computer program carried on a non-transitory computer-readable medium, the computer program containing program code for performing the method illustrated in the flowchart. In such embodiments, the computer program may be downloaded and installed from the network via communication device 309, or from storage device 306, or from ROM 302. When the computer program is executed by the processing device 301, the above-mentioned functions defined in the method of the embodiment of the present disclosure are performed.

The names of messages or information exchanged between multiple devices in the embodiments of the present disclosure are for illustrative purposes only and are not used to limit the scope of these messages or information.

The electronic device provided by the embodiments of the present disclosure and the method for determining the interactive indicator line provided by the above embodiments belong to the same inventive concept. Technical details that are not described in detail in this embodiment can be referred to the above embodiments, and this embodiment is different from the above embodiments. Have the same beneficial effects.

Embodiment 4

Embodiments of the present disclosure provide a computer storage medium on which a computer program is stored. When the program is executed by a processor, the method for determining the interactive indicator line provided in the above embodiments is implemented.

It should be noted that the computer-readable medium mentioned above in the present disclosure may be a computer-readable signal medium or a computer-readable storage medium, or any combination of the above two. The computer-readable storage medium may be, for example, but is not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus or device, or any combination thereof. More specific examples of computer readable storage media may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard drive, random access memory (RAM), read only memory (ROM), removable Programmed read-only memory (EPROM or flash memory), fiber optics, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above. In this disclosure, a computer-readable storage medium may be any tangible medium that contains or stores a program for use by or in connection with an instruction execution system, apparatus, or device. In the present disclosure, a computer-readable signal medium may include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code therein. Such propagated data signals may take many forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. A computer-readable signal medium may also be any computer-readable medium other than a computer-readable storage medium that can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device . Program code embodied on a computer-readable medium may be transmitted using any suitable medium, including but not limited to: wire, optical cable, RF (radio frequency), etc., or any suitable combination of the above.

In some embodiments, the client and server can communicate using any currently known or future developed network protocol such as HTTP (HyperText Transfer Protocol), and can communicate with digital data in any form or medium. (e.g., communications network) interconnection. Examples of communication networks include local area networks ("LAN"), wide area networks ("WAN"), the Internet (e.g., the Internet), and end-to-end networks (e.g., ad hoc end-to-end networks), as well as any currently known or developed in the future network of.

The above-mentioned computer-readable medium may be included in the above-mentioned electronic device; it may also exist independently without being assembled into the electronic device.

The above-mentioned computer-readable medium carries one or more programs. When the above-mentioned one or more programs are executed by the electronic device, the electronic device:

In response to the special effect triggering operation, determine at least one special effect image to be displayed, and display the at least one special effect image to be displayed according to a preset image display method;

If it is detected during the display process that the page turning condition is met, the target page turning special effect is performed on the currently displayed special effect image to be displayed, and the remaining special effect images to be displayed are displayed according to the image display method until a stop special effect is received. Demonstrate operations.

Computer program code for performing the operations of the present disclosure may be written in one or more programming languages, including but not limited to object-oriented programming languages—such as Java, Smalltalk, C++, and Includes conventional procedural programming languages—such as "C" or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In situations involving remote computers, the remote computer can be connected to the user's computer through any kind of network, including a local area network (LAN) or a wide area network (WAN), or it can be connected to an external computer (such as an Internet service provider through Internet connection).

The flowcharts and block diagrams in the figures illustrate the architecture, functionality, and operations of possible implementations of systems, methods, and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagram may represent a module, segment, or portion of code that contains one or more logic functions that implement the specified executable instructions. It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown one after another may actually execute substantially in parallel, or they may sometimes execute in the reverse order, depending on the functionality involved. It will also be noted that each block of the block diagram and/or flowchart illustration, and combinations of blocks in the block diagram and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or operations. , or can be implemented using a combination of specialized hardware and computer instructions.

The units involved in the embodiments of the present disclosure can be implemented in software or hardware. The name of the unit does not constitute a limitation on the unit itself under certain circumstances. For example, the first acquisition unit can also be described as "the unit that acquires at least two Internet Protocol addresses."

The functions described above herein may be performed, at least in part, by one or more hardware logic components. For example, and without limitation, exemplary types of hardware logic components that may be used include: Field Programmable Gate Arrays (FPGAs), Application Specific Integrated Circuits (ASICs), Application Specific Standard Products (ASSPs), Systems on Chips (SOCs), Complex Programmable Logical device (CPLD) and so on.

In the context of this disclosure, a machine-readable medium may be a tangible medium that may contain or store a program for use by or in connection with an instruction execution system, apparatus, or device. The machine-readable medium may be a machine-readable signal medium or a machine-readable storage medium. Machine-readable media may include, but are not limited to, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor systems, devices or devices, or any suitable combination of the foregoing. More specific examples of machine-readable storage media would include one or more wire-based electrical connections, laptop disks, hard drives, random access memory (RAM), read only memory (ROM), erasable programmable read only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination of the above.

According to one or more embodiments of the present disclosure, [Example 1] provides a method for determining an interactive indicator line, which method includes:

Get the target pointing information of the direction indicator;

According to the target pointing information and the viewpoint position information of the viewpoint controller, determine the interaction indication line to be corrected and the object to be controlled that intersects with the interaction indication line to be corrected;

According to the indicator position information of the direction indicator and the interaction indication line to be corrected, a target interaction indication line is determined to control the object to be controlled based on the target interaction indication line.

According to one or more embodiments of the present disclosure, [Example 2] provides a method for determining an interactive indicator line, further including:

Optionally, the target pointing information of the direction indicator is determined based on a gyroscope provided in the direction indicator.

According to one or more embodiments of the present disclosure, [Example 3] provides a method for determining an interactive indicator line, which also includes:

Optionally, using the viewpoint position information as a starting point, determine an interactive indicator line to be corrected corresponding to the target pointing information;

The object to be selected that intersects the interaction indication line to be corrected is used as the object to be controlled, and the intersection point is used as the control point of the object to be controlled, so as to control the object to be controlled based on the control point.

According to one or more embodiments of the present disclosure, [Example 4] provides a method for determining an interactive indicator line, further including:

Optionally, determine each connection point to be selected on the interaction indication line to be corrected;

Determine the target connection point according to the indicator position information and each connection point to be selected;

A target interaction indication line is determined based on the pointer position information, the target connection point and the interaction indication line to be corrected.

According to one or more embodiments of the present disclosure, [Example 5] provides a method for determining an interactive indicator line, which also includes:

Optionally, determine the connection point adjustment range according to the length information of the interactive indicator line to be corrected and the preset adjustment parameters;

Within the adjustment range of the connection point, taking the viewpoint position information as the starting point, each connection point to be selected is determined sequentially according to the preset step size.

According to one or more embodiments of the present disclosure, [Example 6] provides a method for determining an interactive indicator line, which further includes:

Optionally, based on the sequence information for determining each connection point to be selected, determine whether the connection line between the indicator position information and the corresponding connection point to be selected intersects with the obstacle for the first time;

If so, the previous connection point to be selected when intersecting the obstacle is determined based on the sequence information as the target connection point.

According to one or more embodiments of the present disclosure, [Example 7] provides a method for determining an interactive indicator line, which also includes:

Optionally, determine a Bezier curve based on the indicator position information and the target connection point;

The target interaction indication line is determined based on the Bezier curve and the interaction indication line to be corrected.

According to one or more embodiments of the present disclosure, [Example 8] provides a method for determining an interactive indicator line, further including:

Optionally, determine a first intensity corresponding to the target pointing information, and a second intensity in a direction perpendicular to the target pointing information;

The Bezier curve is determined based on the first intensity, the second intensity, pointer position information, a target connection point, target pointing information, and vertical pointing information perpendicular to the target pointing information.

According to one or more embodiments of the present disclosure, [Example 9] provides a method for determining an interactive indicator line, further including:

Optionally, determine the Bezier curve to be drawn based on the first intensity, the second intensity, the indicator position information, the target connection point, the target pointing information and the vertical pointing information;

Determine multiple discrete points corresponding to the Bezier curve to be drawn according to preset drawing parameters;

Based on the plurality of discrete points, the Bezier curve is determined.

According to one or more embodiments of the present disclosure, [Example 10] provides a method for determining an interactive indicator line, further including:

Optionally, the connection line between the target connection point on the modified interaction indication line and the control point of the object to be controlled is used as the interaction indication line to be spliced;

The target interaction indication line is determined based on the Bezier curve and the interaction indication line to be spliced.

According to one or more embodiments of the present disclosure, [Example 11] provides a method for determining an interactive indicator line, further including:

Optionally, repeatedly update the target interaction indication line according to the acquired target pointing information of the direction indicator and the viewpoint position information of the viewpoint controller.

According to one or more embodiments of the present disclosure, [Example 12] provides a device for determining an interactive indicator line, including:

The pointing information determination module is used to obtain the target pointing information of the direction indicator;

An interaction indication line to be corrected determination module, configured to determine an interaction indication line to be corrected and an object to be controlled that intersects the interaction indication line to be corrected based on the target pointing information and the viewpoint position information of the viewpoint controller;

A target interaction indication line determination module is configured to determine a target interaction indication line based on the indicator position information of the direction indicator and the interaction indication line to be corrected, so as to control the object to be controlled based on the target interaction indication line.

The above description is only a description of the preferred embodiments of the present disclosure and the technical principles applied. Those skilled in the art should understand that the disclosure scope involved in the present disclosure is not limited to technical solutions composed of specific combinations of the above technical features, but should also cover solutions composed of the above technical features or without departing from the above disclosed concept. Other technical solutions formed by any combination of equivalent features. For example, a technical solution is formed by replacing the above features with technical features with similar functions disclosed in this disclosure (but not limited to).

Furthermore, although operations are depicted in a specific order, this should not be understood as requiring that these operations be performed in the specific order shown or performed in a sequential order. Under certain circumstances, multitasking and parallel processing may be advantageous. Likewise, although several specific implementation details are included in the above discussion, these should not be construed as limiting the scope of the present disclosure. Certain features that are described in the context of separate embodiments can also be implemented in combination in a single embodiment. Conversely, various features that are described in the context of a single embodiment can also be implemented in multiple embodiments separately or in any suitable subcombination.

Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are merely example forms of implementing the claims.

Claims (13)

1. A method for determining an interaction indicator, comprising:

acquiring target pointing information of a direction indicator;

determining an interaction indication line to be corrected and an object to be controlled which is intersected with the interaction indication line to be corrected according to the target pointing information and the viewpoint position information of the viewpoint controller;

determining a target interaction indication line according to the indicator position information of the direction indicator and the to-be-repaired orthogonal interaction indication line, so as to control the object to be controlled based on the target interaction indication line;

the determining a target interaction indication line according to the indicator position information of the direction indicator and the to-be-repaired orthogonal interaction indication line comprises the following steps:

determining a plurality of to-be-selected connection points on the to-be-repaired orthogonal mutual indication line;

determining a target connection point according to the indicator position information and a plurality of connection points to be selected;

And determining a target interaction indication line according to the indicator position information, the target connection point and the to-be-repaired orthogonal interaction indication line.

2. The method of claim 1, wherein the obtaining target pointing information for the direction indicator comprises:

target pointing information of the direction indicator is determined based on a gyroscope provided in the direction indicator.

3. The method according to claim 1, wherein the determining the interactive indication line to be corrected and the object to be controlled intersecting the interactive indication line to be corrected according to the target pointing information and the viewpoint position information of the viewpoint controller includes:

determining an orthogonal mutual indication line to be repaired corresponding to the target pointing information by taking the viewpoint position information as a starting point;

and taking the object to be selected intersecting with the to-be-repaired orthogonal interaction indication line as the object to be controlled, and taking the intersecting intersection point as a control point of the object to be controlled so as to control the object to be controlled based on the control point.

4. The method of claim 1, wherein the determining a plurality of points of attachment to be selected on the orthogonal mutual indication line to be repaired comprises:

Determining a connection point adjustment range according to the length information of the orthogonal mutual indication line to be repaired and preset adjustment parameters;

and in the connection point adjustment range, sequentially determining a plurality of connection points to be selected according to a preset step length by taking the viewpoint position information as a starting point.

5. The method of claim 4, wherein determining a target connection point based on the pointer location information and a plurality of connection points to be selected comprises:

determining whether a connection line between the indicator position information and the corresponding connection point to be selected intersects an obstacle for the first time according to the sequence information of the plurality of connection points to be selected;

if yes, determining a previous to-be-selected connection point when crossing the obstacle according to the sequence information, and taking the previous to-be-selected connection point as the target connection point.

6. The method of claim 1, wherein the determining a target interaction indicator line based on the indicator location information, the target connection point, and the to-be-repaired orthogonal interaction indicator line comprises:

determining a Bezier curve according to the indicator position information and the target connection point;

and determining the target interaction indication line according to the Bezier curve and the to-be-repaired orthogonal interaction indication line.

7. The method of claim 6, wherein said determining a bezier curve based on said pointer location information and said target connection point comprises:

determining a first intensity corresponding to the target pointing information and a second intensity in a direction perpendicular to the target pointing information;

the Bezier curve is determined based on the first intensity, the second intensity, the pointer location information, the target connection point, the target pointing information, and the perpendicular pointing information perpendicular to the target pointing information.

8. The method of claim 7, wherein the determining the bezier curve based on the first intensity, the second intensity, the pointer location information, the target connection point, the target pointing information, and the vertical pointing information perpendicular to the target pointing information comprises:

determining a Bezier curve to be drawn according to the first intensity, the second intensity, the indicator position information, the target connection point, the target pointing information and the vertical pointing information;

determining a plurality of discrete points corresponding to the Bezier curve to be drawn according to preset drawing parameters;

the Bezier curve is determined based on the plurality of discrete points.

9. The method of claim 6, wherein the determining the target interaction indicator from the bezier curve and the to-be-repaired orthogonal interaction indicator comprises:

a connecting line between the target connecting point on the correction interaction indicating line and the control point of the object to be controlled is used as an interaction indicating line to be spliced;

and determining the target interaction indication line based on the Bezier curve and the interaction indication line to be spliced.

10. The method of claim 1, further comprising, in controlling the movement of the object to be controlled:

and repeatedly executing the updating of the target interaction indication line according to the acquired target pointing information of the direction indicator and the viewpoint position information of the viewpoint controller.

11. A device for determining an interactive indicator line, comprising:

the pointing information determining module is used for acquiring target pointing information of the direction indicator;

the to-be-repaired orthogonal mutual indication line determining module is used for determining an to-be-repaired interactive indication line and an object to be controlled which is intersected with the to-be-repaired orthogonal mutual indication line according to the target pointing information and the viewpoint position information of the viewpoint controller;

The target interaction indication line determining module is used for determining a target interaction indication line according to the indicator position information of the direction indicator and the to-be-repaired orthogonal interaction indication line so as to control the to-be-controlled object based on the target interaction indication line;

the target interaction indication line determining module further includes:

a to-be-selected connection point determining unit, configured to determine each to-be-selected connection point on the to-be-repaired orthogonal mutual indication line;

the target connection point determining unit is used for determining a target connection point according to the indicator position information and each connection point to be selected;

and the target interaction indication line determining unit is used for determining a target interaction indication line according to the indicator position information, the target connection point and the to-be-repaired orthogonal interaction indication line.

12. An electronic device, the electronic device comprising:

one or more processors;

storage means for storing one or more programs,

the one or more programs, when executed by the one or more processors, cause the one or more processors to implement the method of determining interaction indication lines of any of claims 1-10.

13. A storage medium containing computer executable instructions for performing the method of determining an interaction indication line according to any of claims 1-10 when executed by a computer processor.