WO2019095090A1 - Method and device for data processing - Google Patents

Abstract

A method and device for data processing. The method comprises: acquiring a motion state parameter of the head of a user while wearing a head-mounted display device, compensating the motion state parameter on the basis of a preset length of delay time, and utilizing the compensated motion state parameter to adjust a displayed picture outputted by the head-mounted display device. Embodiments of the present invention implement the synchronization of the displayed picture and the motion state of the head of the user and effectively reduce dizziness when using the head-mounted display device.

Description

Data processing method and device Technical field

The present invention relates to the field of smart wear technology, and in particular, to a data processing method and apparatus.

Background technique

Head-mounted playback devices represented by virtual reality (VR) glasses are developing rapidly and become more and more popular. Head-mounted playback devices can provide users with excellent audio-visual enjoyment. When the user views the VR image using the head-mounted playback device, when the user's head rotates the angle of view or moves, the processor of the head-mounted playback device receives and processes the motion data of the user's head from the sensor and presents the change. It takes a certain amount of time to get to the screen, causing a delay in the display. In a full-view screen such as VR, such delay can cause the user to feel dizzy.

Summary of the invention

The embodiment of the invention discloses a data processing method and device, which can synchronize the display screen with the movement state of the user's head, and effectively reduce the stun feeling when using the head mounted display device.

A first aspect of the embodiments of the present invention discloses a data processing method, including:

Obtaining a motion state parameter of the head of the user during wearing the head mounted display device.

The motion state parameter is compensated according to a preset delay duration.

Using the compensated motion state parameter, the display screen output by the head mounted display device is adjusted such that the display screen is synchronized with the motion state of the user's head.

A second aspect of the embodiments of the present invention discloses a data processing apparatus, including:

The obtaining module is configured to acquire a motion state parameter of the head of the user during the wearing of the head mounted display device.

The compensation module is configured to compensate the motion state parameter according to a preset delay duration.

And an adjustment module, configured to adjust a display screen output by the head mounted display device by using the compensated motion state parameter, so that the display screen is synchronized with a motion state of the user head.

A third aspect of embodiments of the present invention discloses a computer readable storage medium storing instructions that, when run on a computer, cause the computer to implement the data portion described in the first aspect above Method.

A fourth aspect of an embodiment of the present invention discloses a computer program product comprising instructions for causing a computer to implement the data processing method of the first aspect described above when it is run on a computer.

The motion state parameter of the head in the process of wearing the head mounted display device can be obtained by the user in the embodiment of the present invention, and the motion state parameter is compensated according to the preset delay duration, and the compensated motion state parameter is used to adjust The display screen outputted by the head-mounted display device can synchronize the display screen with the movement state of the user's head, and effectively reduce the stun feeling when using the head-mounted display device.

DRAWINGS

In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the drawings to be used in the embodiments will be briefly described below. It is obvious that the drawings in the following description are only some embodiments of the present invention. Those skilled in the art can also obtain other drawings based on these drawings without paying for creative labor.

1 is a schematic flow chart of a data processing method according to an embodiment of the present invention;

2a is a schematic diagram of a user's head movement disclosed in an embodiment of the present invention;

2b is a schematic diagram of another user's head movement disclosed in the embodiment of the present invention;

FIG. 3 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

The embodiment of the invention discloses a data processing method and device, which can synchronize the display screen with the movement state of the user's head, and effectively reduce the stun feeling when using the head mounted display device.

The head-mounted display device in the embodiment of the present invention may also be referred to as video glasses, a glasses-type display, a portable theater, etc., and can realize playback of multimedia files, including 3D images, 3D videos, and the like.

FIG. 1 is a schematic flowchart diagram of a data processing method according to an embodiment of the present invention. The data processing method described in this embodiment includes:

101. The head mounted display device acquires a motion state parameter of a head of the user during wearing the head mounted display device.

Among them, the user is likely to move in the head during the process of wearing the head-mounted display device to view the display screen (such as 3D video). As shown in FIG. 2a, the user wears the head-mounted display device to swing left or right, and of course, it can also swing forward or backward. As shown in Figure 2b, the user wears the head-mounted display ® to pan left or right, which of course can be forward or backward §. The above-mentioned form of motion is only an example. In the actual application scenario, the user's head can perform any form of motion. The embodiment of the present invention does not limit the specific motion form of the user's head.

Specifically, the sensor configured by the head mounted display device can collect the motion state parameter of the head during the process of wearing the head mounted display device, and the processor of the head mounted display device reads the collected user from the sensor. The motion state parameter of the head, or the sensor reports the motion state parameter of the collected user's head to the processor.

The motion state parameter may specifically include at least one of an angular velocity, an angular acceleration, an axial velocity, and an axial acceleration. As shown in FIG. 2a, the motion state parameter may specifically include an angular velocity ω and an angular acceleration a _{ω of the} user when swinging the head. As further shown in FIG. 2b, the motion state parameter may specifically include the axial velocity v and the axial acceleration _{av of the} user when the head is translated.

In a possible implementation, the motion of the user's head can generally be considered to include both the swinging head and the translational motion, that is, the motion state parameters specifically include: an angular velocity ω and an angular acceleration a _ω corresponding to the oscillating weight, and a translation Corresponding axial velocity v and axial acceleration a _v .

The sensor may specifically be a gravity sensor, a three-axis acceleration sensor, a gyroscope, or the like.

102. The head mounted display device compensates the motion state parameter according to a preset delay duration.

The preset delay duration specifically refers to the length of time from the movement of the user's head to the adjustment of the display screen of the head-mounted display device, that is, the length of time required for the user's head to move to the change of the motion to the display interface. The specific value of the preset delay duration is mainly related to the performance of the processor and can be considered equal on the same type of processor.

Specifically, since the head-mounted display device acquires the motion state parameter and parses the motion state parameter, and then reflects the motion generated by the user's head on the display interface, the preset delay time needs to be occupied, if the direct use is The motion state parameter acquired by the sensor adjusts the display screen output by the head mounted display device, so that the change of the display screen is likely to lag behind the motion state of the user's head, so that the head mounted display device can be based on the preset delay time. And compensating for the acquired motion state parameter, that is, at least one of an angular velocity, an angular acceleration, an axial velocity, and an axial acceleration.

103. The head mounted display device adjusts the output display screen by using the compensated motion state parameter to synchronize the display screen with the motion state of the user's head.

Specifically, the head-mounted display device adjusts the output display screen by using the compensated motion state parameter (angular speed and/or axial speed), so that the change of the display screen can keep up with the motion state of the user's head, thereby making The display screen is synchronized with the motion state of the user's head.

In a possible implementation manner, the motion state parameter may include an angular velocity ω and an angular acceleration a _ω , and the angular velocity ω may specifically include an angular velocity in a direction of three axes (ie, an X axis, a Y axis, and a Z axis), and an angular acceleration a _ω Specifically, the angular acceleration in the three-axis (ie, the X-axis, the Y-axis, and the Z-axis) directions may be included. In the embodiment of the present invention, the compensation of the angular velocity and/or the angular acceleration in a single axial direction will be described as an example. The head mounted display device can compensate for the angular velocity ω according to a preset delay duration (denoted as T _delay ) and an angular acceleration a _ω . For example, the head mounted display device determines the compensation amount Vω of the angular velocity ω according to the preset delay time length T _delay and the angular acceleration a _ω , and Vω=a _ω ×T _delay , and further uses the angular velocity compensation amount Vω to perform the angular velocity ω. For compensation, the angular velocity after compensation is denoted by ω', and ω' = ω + Vω = ω + a _ω × T _delay .

In a possible implementation, it is necessary to consider whether the angular acceleration is changing. If it is changing, the angular acceleration should be compensated first, and then the compensated angular acceleration is used to compensate the angular velocity to improve the accuracy of the diagonal velocity compensation. . It is assumed that the angular acceleration in the motion state parameter specifically includes the currently acquired first angular acceleration a _ω1 and the previously acquired second angular acceleration a _ω2 , if the first angular acceleration changes relative to the second angular acceleration, ie, a _ω1 and a _{If the ω2 is} not equal, the head-mounted display device may first obtain the rate of change Ra _{ω of the} second angular acceleration a _ω2 , according to the preset delay time T _delay and the rate of change Ra _{ω of the} second angular acceleration a _ω2 , to the first angle The acceleration a _ω1 is compensated, and the compensated first angular acceleration is recorded as a _ω1′ , and a _ω1′ = a _ω1 + Ra _ω × T _delay , according to the preset delay time T _delay and the compensated first angular acceleration a _ω1' , the compensation amount Vω of the angular velocity ω is determined, and Vω=a _ω1 ′×T _delay =(a _ω1 +Ra _ω ×T _delay )×T _delay , and the angular velocity ω is compensated by the compensation amount Vω of the angular velocity. The compensated angular velocity is denoted by ω', and ω' = ω + Vω = ω + (a _ω1 + Ra _ω × T _delay ) × T _delay = ω + a _ω1 × T _delay + Ra _ω × T _delay ² .

In one possible implementation, the second angular acceleration _a ω2 as the angular acceleration before the current time n × T, the rate of change of the second angular acceleration _Ra ω particular _a ω2 may be a second preset angular acceleration _a ω2 The statistical variation is the average rate of change Ra _{ω in} n × T, and Ra _ω = (a _ω1 - a _ω2 ) / (n × T), where T is the time interval during which the processor reads the motion state parameter from the sensor, n Is a positive integer.

Similarly, in a possible implementation manner, the motion state parameter may include an axial velocity v and an axial acceleration a _v , and the axial velocity v may specifically include three directions (ie, an X axis, a Y axis, and a Z axis) direction. The axial velocity above, the axial acceleration a _v may specifically include the axial acceleration in the direction of the three axes (ie, the X-axis, the Y-axis, and the Z-axis), and the embodiment of the present invention has an axial velocity in a single axial direction and/or The compensation of the axial acceleration is explained as an example. The head mounted display device can compensate for the axial velocity v according to a preset delay duration (denoted as T _delay ) and an axial acceleration a _v . For example, the head mounted display device determines the compensation amount Vv for the axial velocity v according to the preset delay time length T _delay and the axial acceleration a _v , and Vv=a _v ×T _delay , and further utilizes the compensation amount Vv of the axial velocity. The axial velocity v is compensated, and the compensated axial velocity is denoted as v', and v'=v+Vv=v+a _v × _Tdelay .

In a possible implementation, it is necessary to consider whether the axial acceleration is changing. If it is changing, the axial acceleration should be compensated first, and then the axial acceleration is compensated by the compensated axial acceleration to improve the The accuracy of axial speed compensation. It is assumed that the axial acceleration in the motion state parameter specifically includes the currently acquired first axial acceleration a _v1 and the pre-acquired second axial acceleration a _v2 , if the first axial acceleration changes relative to the second axial acceleration, That is, a _v1 and a _{v2 are} not equal, the head-mounted display device may first obtain the rate of change Ra _{v of the} second axial acceleration a _v2 according to the preset rate of change of the delay time T _delay and the second axial acceleration a _v2 . Ra _v , the first axial acceleration a _v1 is compensated, the compensated first axial acceleration is recorded as a _{v1 ′} , and a _v1′ = a _v1 + Ra _v × T _delay , and then according to a preset delay time T _{The delay} and the compensated first axial acceleration a _{v1 '} determine the compensation amount Vv for the axial velocity v, and Vv = a _{v1 '} × T _delay = (a _v1 + Ra _v × T _delay ) × T _delay , and further The axial velocity v is compensated by the compensation amount Vv of the axial velocity, and the compensated axial velocity is denoted as v', and v'=v+Vv=v+(a _v1 +Ra _v ×T _delay )×T _delay =v+a _v1 ×T _delay +Ra _v ×T _delay ² .

In a possible implementation manner, the second axial acceleration a _v2 is an axial acceleration before the current time n×T, and the change rate Ra _{v of the} second axial acceleration a _v2 may specifically be the second axial acceleration a _V2 is an average rate of change Ra _v within a predetermined statistical duration n×T, and Ra _v =(a _v1 -a _v2 )/(n×T), where T is the processor reading the motion state parameter from the sensor Time interval, n is a positive integer.

It should be noted that the above methods for compensating the angular velocity, the angular acceleration, the axial velocity, and the axial acceleration are merely examples, including but not limited to the above compensation method.

In the embodiment of the present invention, the head mounted display device can acquire the motion state parameters of the head, such as angular velocity, angular acceleration, axial velocity, and axial acceleration, during the process of wearing the head mounted display device, according to preset The delay time is used to compensate the motion state parameter, and the compensated motion state parameter is used to adjust the display screen output by the head-mounted display device, so that the synchronization between the display screen and the user's head motion state can be realized, and the use head is effectively reduced. Dizziness when wearing a display device.

FIG. 3 is a schematic structural diagram of a data processing apparatus according to an embodiment of the present invention. The data processing apparatus described in this embodiment includes:

The obtaining module 301 is configured to acquire a motion state parameter of the head of the user during the wearing of the head mounted display device.

The compensation module 302 is configured to compensate the motion state parameter according to a preset delay duration.

The adjusting module 303 is configured to adjust a display screen output by the head mounted display device by using the compensated motion state parameter, so that the display screen is synchronized with a motion state of the user head.

In some possible implementations, the motion state parameter includes at least one of angular velocity, angular acceleration, axial velocity, and axial acceleration.

In some possible implementations, the motion state parameter includes the angular velocity and the angular acceleration, and the compensation module 302 is specifically configured to:

The amount of compensation for the angular velocity is determined according to a preset delay duration and the angular acceleration.

The angular velocity is compensated by the amount of compensation of the angular velocity.

In some possible implementations, the angular acceleration includes a first angular acceleration that is currently acquired and a second angular acceleration that is acquired in advance, and the compensation module 302 is specifically configured to:

And if the first angular acceleration changes relative to the second angular acceleration, the first angular acceleration is compensated according to a preset delay duration and a rate of change of the second angular acceleration.

Determining the angular velocity according to the preset delay duration and the compensated first angular acceleration The amount of compensation.

In some possible implementations, the rate of change of the second angular acceleration is an average rate of change of the second angular acceleration over a predetermined statistical time period.

In some possible implementations, the motion state parameter includes the axial velocity and the axial acceleration, and the compensation module 302 is specifically configured to:

The amount of compensation for the axial velocity is determined based on a preset delay duration and the axial acceleration.

The axial velocity is compensated by the amount of compensation of the axial velocity.

In some possible implementations, the axial acceleration includes a first axial acceleration currently acquired and a second axial acceleration acquired in advance, and the compensation module 302 is specifically configured to:

If the first axial acceleration changes relative to the second axial acceleration, the first axial acceleration is compensated according to a preset delay duration and a rate of change of the second axial acceleration.

And determining a compensation amount for the axial velocity according to the preset delay duration and the compensated first axial acceleration.

In some possible implementations, the rate of change of the second axial acceleration is an average rate of change of the second axial acceleration over a predetermined statistical time period.

In some possible implementations, the preset delay duration is a length of time elapsed from movement of the user's head to adjustment of the display screen.

It is to be understood that the functions of the functional modules of the data processing apparatus of the present embodiment may be specifically implemented according to the method in the foregoing method embodiments. For the specific implementation process, refer to the related description of the foregoing method embodiments, and details are not described herein again.

In the embodiment of the present invention, the acquiring module 301 can obtain the motion state parameter of the head in the process of wearing the head mounted display device, and the compensation module 302 compensates the motion state parameter according to the preset delay duration, and the adjusting module 303 By using the compensated motion state parameter and adjusting the display screen output by the head-mounted display device, synchronization between the display screen and the movement state of the user's head can be realized, and the stun feeling when using the head-mounted display device is effectively reduced.

The embodiment of the invention further provides a computer readable storage medium, characterized in that the storage medium stores instructions, when it is run on a computer, causes the computer to implement the above method embodiment.

Embodiments of the present invention also provide a computer program product comprising instructions that, when run on a computer, cause the computer to implement the above-described method embodiments.

It should be noted that, for the foregoing various method embodiments, for the sake of simple description, they are all expressed as a series of action combinations, but those skilled in the art should understand that the present invention is not limited by the described action sequence. Because certain steps may be performed in other sequences or concurrently in accordance with the present invention. In addition, those skilled in the art should also understand that the embodiments described in the specification are all preferred embodiments, and the actions and modules involved are not necessarily required by the present invention.

A person skilled in the art may understand that all or part of the various steps of the foregoing embodiments may be performed by a program to instruct related hardware. The program may be stored in a computer readable storage medium, and the storage medium may include: Flash disk, Read-Only Memory (ROM), Random Access Memory (RAM), disk or optical disk.

The above disclosure is only a preferred embodiment of the present invention, and of course, the scope of the present invention is not limited thereto, and those skilled in the art can understand all or part of the process of implementing the above embodiments, and according to the present invention. The equivalent changes required are still within the scope of the invention.

Claims (20)

A data processing method, comprising: Obtaining a motion state parameter of a head of the user during wearing the head mounted display device; Compensating for the motion state parameter according to a preset delay duration; Using the compensated motion state parameter, the display screen output by the head mounted display device is adjusted such that the display screen is synchronized with the motion state of the user's head. The method of claim 1 wherein the motion state parameter comprises at least one of angular velocity, angular acceleration, axial velocity, and axial acceleration. The method according to claim 2, wherein the motion state parameter comprises the angular velocity and the angular acceleration, and the compensating the motion state parameter according to a preset delay duration comprises: Determining a compensation amount for the angular velocity according to a preset delay duration and the angular acceleration; The angular velocity is compensated by the amount of compensation of the angular velocity. The method according to claim 3, wherein the angular acceleration comprises a currently acquired first angular acceleration and a pre-acquired second angular acceleration, and the determining the pair according to the preset delay duration and the angular acceleration The compensation amount of the angular velocity includes: If the first angular acceleration changes relative to the second angular acceleration, the first angular acceleration is compensated according to a preset delay duration and a rate of change of the second angular acceleration; And determining a compensation amount for the angular velocity according to the preset delay duration and the compensated first angular acceleration. The method according to claim 4, wherein the rate of change of the second angular acceleration is an average rate of change of the second angular acceleration over a predetermined statistical time period. The method according to claim 2, wherein said motion state parameter comprises said axial velocity and said axial acceleration, said motion state parameter being according to a predetermined delay duration Make compensation, including: Determining a compensation amount for the axial velocity according to a preset delay duration and the axial acceleration; The axial velocity is compensated by the amount of compensation of the axial velocity. The method according to claim 6, wherein the axial acceleration comprises a currently acquired first axial acceleration and a pre-acquired second axial acceleration, the predetermined delay duration and the axial direction Acceleration, determining the amount of compensation for the axial velocity, including: If the first axial acceleration changes relative to the second axial acceleration, the first axial acceleration is compensated according to a preset delay duration and a rate of change of the second axial acceleration; And determining a compensation amount for the axial velocity according to the preset delay duration and the compensated first axial acceleration. The method of claim 7, wherein the rate of change of the second axial acceleration is an average rate of change of the second axial acceleration over a predetermined statistical time period. The method according to any one of claims 1 to 8, wherein the predetermined delay duration is a length of time elapsed from movement of the user's head to adjustment of the display screen. A data processing device, comprising: An obtaining module, configured to acquire a motion state parameter of a head of the user during wearing the head mounted display device; a compensation module, configured to compensate the motion state parameter according to a preset delay duration; And an adjustment module, configured to adjust a display screen output by the head mounted display device by using the compensated motion state parameter, so that the display screen is synchronized with a motion state of the user head. The apparatus of claim 10 wherein said motion state parameter comprises at least one of angular velocity, angular acceleration, axial velocity, and axial acceleration. The apparatus according to claim 11, wherein the motion state parameter comprises the angular velocity and the angular acceleration, and the compensation module is specifically configured to: Determining a compensation amount for the angular velocity according to a preset delay duration and the angular acceleration; The angular velocity is compensated by the amount of compensation of the angular velocity. The apparatus according to claim 12, wherein the angular acceleration comprises a currently acquired first angular acceleration and a second angular acceleration obtained in advance, and the compensation module is specifically configured to: If the first angular acceleration changes relative to the second angular acceleration, the first angular acceleration is compensated according to a preset delay duration and a rate of change of the second angular acceleration; And determining a compensation amount for the angular velocity according to the preset delay duration and the compensated first angular acceleration. The apparatus according to claim 13, wherein the rate of change of the second angular acceleration is an average rate of change of the second angular acceleration over a predetermined statistical time period. The apparatus according to claim 11, wherein the motion state parameter comprises the axial velocity and the axial acceleration, and the compensation module is specifically configured to: Determining a compensation amount for the axial velocity according to a preset delay duration and the axial acceleration; The axial velocity is compensated by the amount of compensation of the axial velocity. The apparatus according to claim 15, wherein the axial acceleration comprises a first axial acceleration currently acquired and a second axial acceleration obtained in advance, and the compensation module is specifically configured to: If the first axial acceleration changes relative to the second axial acceleration, the first axial acceleration is compensated according to a preset delay duration and a rate of change of the second axial acceleration; And determining a compensation amount for the axial velocity according to the preset delay duration and the compensated first axial acceleration. The apparatus according to claim 16, wherein the rate of change of the second axial acceleration is an average rate of change of the second axial acceleration over a predetermined statistical time period. The apparatus according to any one of claims 10 to 17, wherein the predetermined delay duration is a length of time elapsed from movement of the user's head to adjustment of the display screen. A computer readable storage medium, wherein the storage medium stores instructions that, when run on a computer, cause the computer to implement the data processing method of any one of claims 1-9. A computer program product comprising instructions, characterized in that, when run on a computer, the computer implements the data processing method according to any one of claims 1 to 9.

Images