CN112399168B - A multi-viewpoint image generation method, storage medium, and display device - Google Patents

Abstract

A multi-viewpoint image generation method, a storage medium, and a display device, the multi-viewpoint image generation method comprising: determining the number of viewpoints contained in a single sub-pixel in the first direction according to the total viewpoint number and the number of sub-pixels covered by the grating unit in the first direction; determining the number of viewpoints contained by a single sub-pixel in a second direction according to the first length of the sub-pixel in the first direction and the second length of the sub-pixel in the second direction, the attaching angle of the image splitting device and the display panel and the number of viewpoints contained by a single sub-pixel in the first direction; determining the viewpoint to which the sub-pixel belongs according to the number of viewpoints contained by the single sub-pixel in the first direction and the number of viewpoints contained by the single sub-pixel in the second direction; and determining the gray-scale value of the sub-pixel according to the image of the viewpoint to which the sub-pixel belongs. The scheme provided by the embodiment realizes the generation of the multi-view three-dimensional image.

Description

A multi-viewpoint image generation method, storage medium, and display device

technical field

Embodiments of the present disclosure relate to, but are not limited to, display technologies, and in particular, refer to a method for generating a multi-viewpoint image, a storage medium, and a display device.

Background technique

The naked-eye three-dimensional (3D) display device includes a display panel and an image splitting device. The display panel usually includes a liquid crystal display (Liquid Crystal Display, LCD), an organic light-emitting diode (Organic Light-Emitting Diode, OLED) and other displays, and the image splitting device includes a slit grating or lenticular lens grating etc. The display panel includes a plurality of pixels, and generally each pixel includes sub-pixels RGB of three colors. The image-splitting device includes a plurality of image-splitting units arranged in parallel, and the image-splitting device is pasted in front of the display panel at a certain angle, so that the sub-pixels at different positions can be split to different positions in space, so that the multi-viewpoint image can be displayed according to the image-splitting device. The light-splitting characteristics are arranged and rendered on the display panel and displayed on the display panel. After passing through the image-splitting device, people's eyes can see images from different viewpoints, and then processed by the brain to make people feel a sense of three-dimensionality.

Contents of the invention

The following is an overview of the topics described in detail in this article. This summary is not intended to limit the scope of the claims.

Embodiments of the present disclosure provide a method for generating a multi-viewpoint image, a storage medium, and a display device, so as to realize multi-viewpoint three-dimensional display.

On the one hand, an embodiment of the present disclosure provides a method for generating a multi-viewpoint image, which is applied to a display device including a display panel and an image splitting device, where the display panel includes a plurality of pixels distributed in an array, and the pixels include a plurality of sub-pixels, The image splitting device includes a plurality of grating units parallel to each other, and the method includes:

Determine the number of sub-pixels covered by the grating unit in the first direction, and determine the number of viewpoints contained in a single sub-pixel in the first direction according to the total number of viewpoints and the number of sub-pixels covered by the grating unit in the first direction; the first The direction is the pixel row direction, that is, the arrangement direction of the sub-pixels in the same pixel;

According to the first length of the sub-pixel in the first direction and the second length in the second direction, the bonding angle between the image splitting device and the display panel, and the viewpoint contained in a single sub-pixel in the first direction The number determines the number of viewpoints contained in a single sub-pixel in the second direction, and the second direction is the pixel column direction;

determining the viewpoint to which the subpixel belongs according to the number of viewpoints contained in a single subpixel in the first direction and the number of viewpoints contained in a single subpixel in the second direction;

The gray scale value of the sub-pixel is determined according to the image of the viewpoint to which the sub-pixel belongs.

In an exemplary embodiment, the determining the number of sub-pixels covered by the grating unit in the first direction includes:

The number of sub-pixels covered by the grating unit in the first direction

The P is the width of the grating unit, the S _w is the length of the sub-pixel along the first direction, the θ∈(-90°, 90°), the θ is the image splitting device and The lamination angle of the display panel, that is, the angle between the extension direction of the orthographic projection of the grating unit and the second direction on a plane parallel to the display panel, according to the angle of the orthographic projection of the grating unit The orientation of the extending direction to the second direction determines whether the θ is positive or negative.

In an exemplary embodiment, the determining the number of viewpoints included in a single subpixel in the first direction according to the total number of viewpoints and the number of subpixels covered by the grating unit in the first direction includes:

The number of viewpoints contained in a single sub-pixel in the first direction

The V is the total number of viewpoints, and P _x is the number of sub-pixels covered by the grating unit in the first direction.

In an exemplary embodiment, according to the first length of the sub-pixel in the first direction and the second length in the second direction, the bonding angle between the image splitting device and the display panel, the The number of viewpoints contained in a single subpixel in the first direction determines the number of viewpoints contained in a single subpixel in the second direction, including:

Determine an offset value according to the first length of the sub-pixel in the first direction and the second length in the second direction, and the bonding angle between the image splitting device and the display panel; according to the first direction in the first direction The number of viewpoints contained in a single subpixel and the offset value determine the number of viewpoints contained in a single subpixel in the second direction; wherein,

The offset value

Wherein, the _Sw is the first length of the sub-pixel in the first direction, the _Sh is the second length of the sub-pixel in the second direction, and θ is the image splitting device and the display panel The bonding angle, that is, on the plane parallel to the display panel, the angle between the extending direction of the orthographic projection of the grating unit and the second direction, according to the extending direction of the orthographic projection of the grating unit to the The orientation of the second direction determines the sign of the θ.

In an exemplary embodiment, the determining the number of viewpoints included in a single subpixel in the second direction according to the number of viewpoints included in a single subpixel in the first direction and the offset value includes:

The number of viewpoints contained in a single sub-pixel in the second direction V _y =V _x *Shift _x

Wherein, V _x is the number of viewpoints contained in a single sub-pixel in the first direction, and Shift _x is the offset value.

In an exemplary embodiment, the determining the viewpoint to which the subpixel belongs according to the number of viewpoints included in a single subpixel in the first direction and the number of viewpoints included in a single subpixel in the second direction includes:

V _i,1 =(V _first -(i-1)*V _y )modV, if V _i,1 =0, then V _i,1 =V,i∈[1,M]

V _i,j =(V _i,1 +(j-1)*V _x )modV, if V _i,j =0, then V _i,j =V,j∈[1,N]

Among them, V is the total number of viewpoints, V _{i, j} is the viewpoint to which the sub-pixel in row i and column j belongs, V _first is the viewpoint to which the sub-pixel in row 1 and column 1 belongs, and M is the row of sub-pixels N is the number of columns of sub-pixels, V _x is the number of viewpoints contained in a single sub-pixel in the first direction, and V _y is the number of viewpoints contained in a single sub-pixel in the second direction.

In an exemplary embodiment, the determining the gray scale value of the sub-pixel according to the image of the viewpoint to which the sub-pixel belongs includes:

The position of the sub-pixel is determined, and the gray-scale value of the corresponding position in the image of the viewpoint to which the sub-pixel belongs is used as the gray-scale value of the sub-pixel.

In an exemplary embodiment, after the viewpoint to which the subpixel belongs is determined according to the number of viewpoints contained in a single subpixel in the first direction and the number of viewpoints contained in a single subpixel in the second direction, according to the viewpoint to which the subpixel belongs Before determining the grayscale values of the subpixels in the image, also include:

Replace the viewpoints of some sub-pixels, and when the viewpoints of different sub-pixels are the same, replace them with the same viewpoint, so that after the replacement, the first parallax of the left-eye viewpoint and the right-eye viewpoint is the same as the first parallax when no replacement is performed. The ratio of the second parallax of the viewpoint to which the upward adjacent sub-pixels belong satisfies a preset condition.

In an exemplary embodiment, the satisfying the preset condition includes: a ratio of the first parallax to the second parallax is in [-1, 1].

In an exemplary embodiment, replacing the viewpoint to which some sub-pixels belong includes:

The viewpoint includes viewpoint 1 to viewpoint V distributed sequentially along the first direction. When the viewpoint k to which the sub-pixel belongs is in the range from viewpoint K to viewpoint V, replace viewpoint k with viewpoint S-k, where S-k is less than or equal to V and greater than is equal to 1, and the K is a preset value.

On the other hand, an embodiment of the present disclosure provides a computer-readable storage medium storing computer-executable instructions, and the computer-executable instructions are used to execute the above-mentioned method for generating a multi-viewpoint image.

In yet another aspect, an embodiment of the present disclosure provides a display device, including a processor and a memory storing a computer program that can run on the processor, wherein, when the processor executes the program, the above-mentioned method for generating a multi-viewpoint image is realized A step of.

An embodiment of the present disclosure provides the multi-viewpoint image generation method, storage medium, and display device. The multi-viewpoint image generation method includes: determining a single subpixel in the first direction according to the total number of viewpoints and the number of subpixels covered by the grating unit in the first direction The number of viewpoints included; according to the first length of the sub-pixel in the first direction and the second length in the second direction, the bonding angle between the image splitting device and the display panel, and the single sub-pixel in the first direction The number of viewpoints contained in a sub-pixel determines the number of viewpoints contained in a single sub-pixel in the second direction; the sub-pixel is determined according to the number of viewpoints contained in a single sub-pixel in the first direction and the number of viewpoints contained in a single sub-pixel in the second direction The viewpoint to which the subpixel belongs: determining the grayscale value of the subpixel according to the image of the viewpoint to which the subpixel belongs. The solution provided in this embodiment realizes the generation of multi-viewpoint three-dimensional images.

Additional features and advantages of the invention will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention may be realized and attained by the structure particularly pointed out in the written description as well as the appended drawings.

Other aspects will be apparent to others upon reading and understanding the drawings and detailed description.

Description of drawings

The accompanying drawings are used to provide a further understanding of the technical solution of the present invention, and constitute a part of the description, and are used together with the embodiments of the application to explain the technical solution of the present invention, and do not constitute a limitation to the technical solution of the present invention.

Fig. 1 is a three-dimensional display schematic diagram provided by an embodiment;

FIG. 2 is a schematic diagram of a display device provided by an embodiment of the present disclosure;

Fig. 3 is a schematic diagram of a display panel provided by an embodiment;

Fig. 4 is a schematic diagram of an image splitting device and a display panel provided by an embodiment;

FIG. 5 is a flowchart of a method for generating a multi-viewpoint image provided by an embodiment;

FIG. 6 is a schematic diagram of a viewpoint provided by a sub-pixel according to an embodiment;

FIG. 7 is a schematic diagram of an embodiment after replacement of the viewpoint to which the sub-pixel belongs;

FIG. 8 is a schematic diagram of a display device provided by an embodiment.

Detailed ways

Embodiments of the present invention will be described in detail below in conjunction with the accompanying drawings. In the case of no conflict, the embodiments in the present application and the features in the embodiments can be combined arbitrarily with each other.

The steps shown in the flowcharts of the figures may be performed in a computer system, such as a set of computer-executable instructions. Also, although a logical order is shown in the flowcharts, in some cases the steps shown or described may be performed in an order different from that shown or described herein.

Unless otherwise defined, the technical terms or scientific terms used in the present disclosure shall have the usual meanings understood by those skilled in the art to which the present invention belongs.

In the drawings, the size of each component, the thickness of a layer, or a region is sometimes exaggerated for the sake of clarity. Therefore, the embodiments of the present disclosure are not necessarily limited to the dimensions, and the shapes and sizes of the components in the drawings do not reflect the true scale. In addition, the drawings schematically show ideal examples, and the embodiments of the present disclosure are not limited to the shapes or numerical values shown in the drawings.

Ordinal numerals such as "first", "second", and "third" in the present disclosure are provided to avoid confusion of constituent elements, and do not indicate any order, quantity or importance.

In this disclosure, "middle", "upper", "lower", "front", "rear", "vertical", "horizontal", "top", "bottom", "inner" are used for convenience , "external" and other words indicating the orientation or positional relationship are used to illustrate the positional relationship of the constituent elements with reference to the drawings, which are only for the convenience of describing this specification and simplifying the description, rather than indicating or implying that the referred device or element must have a specific orientation , are constructed and operate in a particular orientation and therefore are not to be construed as limitations on the present disclosure. The positional relationship of the constituent elements changes appropriately according to the direction in which each constituent element is described. Therefore, it is not limited to the words and phrases described in the publication, and may be appropriately replaced according to circumstances.

In the present disclosure, “parallel” refers to a state where the angle formed by two straight lines is not less than -10° and not more than 10°, and therefore also includes a state where the angle is not less than -5° and not more than 5°. In addition, "perpendicular" means a state in which the angle formed by two straight lines is 80° to 100°, and therefore also includes an angle of 85° to 95°.

Figure 1 shows the principle of naked-eye 3D display with lenticular lens. The pixels at different positions on the display panel are refracted and split by the lenticular lens, and the light path changes to form different viewing areas in space. When the human eyes are in the correct viewing area In the middle (that is, the left eye receives the left view image while the right eye also receives the right view image) just can feel the stereoscopic effect.

In the embodiment of the present disclosure, a multi-viewpoint image generation method (or image layout method) is provided, which can fuse multi-viewpoint content according to the relevant parameters of the display panel and the image splitting device, and the number of viewpoints to be displayed, so that Able to accurately display stereoscopic images.

Fig. 2 is a schematic diagram of a display device provided by an exemplary embodiment. As shown in FIG. 2 , the display device includes a display panel 10 and an image splitting device 20 , the image splitting device 20 includes a plurality of grating units 21 parallel to each other, and the width of the grating units 21 is P. There is an angle θ between the extending direction Q of the grating unit 21 and the pixel column direction of the display panel (Y direction in the figure), that is, the image splitting device 20 is attached to the surface of the display panel 10 at the angle θ. The display panel 10 includes a plurality of pixels, and the pixels are located on the focal plane of the grating unit 21 . In this embodiment, a lenticular lens grating is shown as the image splitting device 20 . However, the embodiment of the present disclosure is not limited thereto, and may be other gratings.

As shown in FIG. 3 , the display panel 10 includes a plurality of pixels 11 distributed in an array, and the pixels 11 include a plurality of sub-pixels 12, such as red sub-pixels R, green sub-pixels G and blue sub-pixels B, However, the embodiment of the present disclosure is not limited thereto, and may be sub-pixels of other colors, or may be more than 3 sub-pixels, such as 4 sub-pixels. The sub-pixels 12 in the same pixel 11 are distributed along the first direction X, which is also called the pixel row direction, and the second direction Y is also called the pixel column direction, and the first direction X and the second direction Y may be perpendicular. The length of the sub-pixel 12 along the first direction X is S _w (also referred to as a sub-pixel width), and the length of the sub-pixel 12 along the second direction Y is _Sh (also referred to as a sub-pixel height).

As shown in FIG. 4 , the image splitting device 20 is attached to the surface of the display panel 10 at an angle θ, the θ∈(-90°, 90°), and the angle θ is parallel to the surface of the display panel 10. On the plane, the angle between the extension direction Q of the orthographic projection of the grating unit 21 and the second direction Y is determined according to the orientation from the extension direction Q of the orthographic projection of the grating unit 21 to the second direction Y. As for the positive and negative of θ, when Q to P is clockwise, θ is positive, as shown in Figure 4, θ is positive, and when Q to P is counterclockwise, θ is negative.

Since the design parameters of different 3D display devices are different, multi-viewpoint images can be determined according to the parameters that match the 3D display devices, so that the compatibility is strong and can meet more application scenarios. For devices with the same design parameters, these parameters only need to be configured. Just once, and the parameters can be as shown in Table 1.

Table 1 Display panel and image splitting device parameters

Fig. 5 is a flowchart of a method for generating a multi-viewpoint image provided by an exemplary embodiment. As shown in FIG. 5, the method for generating a multi-viewpoint image provided by this embodiment is applied to the above-mentioned display device, including:

Step 501, determine the number P x of sub-pixels covered by the grating unit 21 in the first direction X, and determine the number of sub-pixels P _x covered by the grating unit 21 in the first direction X according to the total number of viewpoints V and the number P _x of sub-pixels covered by the grating unit 21 in the first direction X. The number of viewpoints V _x contained in a single sub-pixel; the first direction X is the pixel row direction, that is, the arrangement direction of sub-pixels in the same pixel;

Step 502, according to the first length S _w of the sub-pixel in the first direction X and the second length _Sh in the second direction Y, the bonding angle θ between the image splitting device 20 and the display panel 10, The number of viewpoints V _x included in a single subpixel in the first direction X determines the number of viewpoints V _y included in a single subpixel in the second direction Y; the second direction Y is the pixel column direction;

Step 503, determining the viewpoint to which the subpixel belongs according to the number of viewpoints V _x included in a single subpixel in the first direction X and the number of viewpoints V _y included in a single subpixel in the second direction Y;

Step 504: Determine the gray scale value of the sub-pixel according to the image of the viewpoint to which the sub-pixel belongs.

The solution provided in this embodiment can determine the viewpoint to which the sub-pixel belongs according to the relevant parameters of the display panel and the image splitting device, as well as the number of viewpoints to be displayed, can accurately display stereoscopic images, bring continuous 3D effects, and has strong compatibility , can be applied to a variety of equipment.

In an exemplary embodiment, the images of the viewpoints may be captured by an imaging device; or, after the images of some viewpoints are captured, images of other viewpoints are generated according to the images of existing viewpoints.

In an exemplary embodiment, the determining the number of sub-pixels P _x covered by the grating unit 21 in the first direction X includes:

The P is the width of the grating unit, the _Sw is the length of the sub-pixel along the first direction X, the θ∈(-90°, 90°), and the θ is the image splitting device The lamination angle with the display panel, that is, the angle between the extending direction of the orthographic projection of the grating unit 21 and the second direction Y on a plane parallel to the display panel, according to the The orientation from the extending direction Q of the orthographic projection to the second direction Y determines whether the θ is positive or negative.

In an exemplary embodiment, the determining the number of viewpoints V _x included in a single sub-pixel in the first direction according to the total number of viewpoints V and the number of sub-pixels P _x covered by the grating unit in the first direction includes:

The number of viewpoints contained in a single sub-pixel in the first direction

Subpixels at different positions in the grating unit 21 have different directions after image division, and each grating unit covers the display panel in parallel at an angle of θ, so subpixels at the same position in different grating units 21 have the same viewpoint direction, when the number of input viewpoints is V, and the number of sub-pixels P _x covered by the grating unit 21 in the first direction, then the number of viewpoints contained in a single sub-pixel in the first direction X is V _x (also can be understood as the horizontal direction The difference between the number of viewpoints of adjacent sub-pixels V _x ) is

In an exemplary embodiment, according to the first length S _w of the sub-pixel in the first direction X and the second length _Sh in the second direction Y, the relationship between the image splitting device 20 and the display panel 10 The fitting angle θ and the number of viewpoints V _x included in a single subpixel in the first direction X determine the number of viewpoints V _y included in a single subpixel in the second direction Y, including:

An offset is determined according to the first length S _w of the sub-pixel in the first direction X and the second length _Sh in the second direction Y, and the bonding angle θ between the image splitting device 20 and the display panel 10 Value Shift _x , Shift _x can also be referred to as the number of sub-pixel offsets in adjacent rows;

The number of viewpoints included in a single subpixel in the second direction Y is determined according to the number of viewpoints V _x included in a single subpixel in the first direction X and the offset value.

In an exemplary embodiment, according to the first length S _w of the sub-pixel in the first direction X and the second length _Sh in the second direction Y, the attachment of the image splitting device to the display panel Determining an offset value for angle θ may include:

The offset value

In an exemplary embodiment, the determining the number of viewpoints included in a single subpixel in the second direction Y according to the number of viewpoints Vx included in a single subpixel in the first direction _X and the offset value includes:

The number of viewpoints contained in a single sub-pixel in the second direction V _y =V _x *Shift _x

Wherein, the number of viewpoints V _y contained in a single sub-pixel in the vertical direction can also be understood as the difference V _y between the number of viewpoints of adjacent sub-pixels in the vertical direction.

In an exemplary embodiment, the determination of the viewpoint to which the subpixel belongs according to the viewpoint number V _x contained in a single subpixel in the first direction X and the viewpoint number V _y contained in a single subpixel in the second direction Y includes :

V _i,1 =(V _first -(i-1)*V _y )modV, if V _i,1 =0, then V _i,1 =V,i∈[1,M]

V _i,j =(V _i,1 +(j-1)*V _x )mod V, if V _i,j =0, then V _i,j =V,j∈[1,N]

Among them, mod is a modulo operation, V _{i, j} is the viewpoint to which the sub-pixel in row i and column j belongs, V _first is the viewpoint to which the sub-pixel in row 1 and column 1 belongs, and M is the number of rows of sub-pixels , the N is the number of columns of sub-pixels. In this embodiment, the viewpoint V _i,1 to which the subpixel in the first column of each row belongs may be calculated first, and then the viewpoints to which subpixels in other columns of the row belong are calculated according to the viewpoint V _i,1 to which the subpixel in the first column of each row belongs. That is, the viewpoint to which the sub-pixels belong can be calculated from the first row and the first column, and after the viewpoint to which the sub-pixels of one row is calculated, the viewpoint to which the sub-pixels of the next row belongs is calculated. The sub-pixels in the first row and the first column may be sub-pixels in the upper left corner of the display panel. The number of rows of sub-pixels may be the same as the number of rows of pixels, and the number of columns of sub-pixels may be three times the number of columns of pixels (when each pixel includes 3 sub-pixels).

V _first may be specified as required, for example, it may be the second viewpoint, and the embodiment of the present disclosure is not limited thereto, and may be other values. In another embodiment, V _first may be the viewpoint to which sub-pixels in other rows and columns belong.

In an exemplary embodiment, V _i,j of the same row may be cyclically shifted to be the viewpoint to which the subpixels of the row belong.

In an exemplary embodiment, taking V _x =6, V _y =3, Vfirst=2 (that is, V _1,1 =2), V=28 (viewpoints are numbered from 1 to 28) as an example, the sub-pixels are calculated belonging viewpoint. in:

The viewpoint to which the sub-pixels in the first row and the second column belong is V _1,2 = (V _1,1 +(j-1)*V _x )mod V=(2+(2-1)*6)mod28=8;

The viewpoint to which the sub-pixels in the first row and third column belong is V _1,3 = (2+(3-1)*6)mod28=14;

By analogy, the viewpoint to which the sub-pixels in the 1st row and 14th column belong is V _1,3 = (2+(14-1)*6) mod28 = 24; the following is similar and will not be described again.

The viewpoint of the sub-pixel in the second row and the first column is V _2,1 = (V _first -(i-1)*V _y )modV=(2-(2-1)*3)mod28=27; the second row The calculation of the viewpoints of the sub-pixels in the second column to the Nth column is similar to the calculation of the viewpoints of the sub-pixels in the first row, the second column to the Nth column, and will not be described again. The calculation results are shown in Figure 6. FIG. 6 only shows the viewpoints of the sub-pixels in rows 4 and 18 columns, and the viewpoints of other sub-pixels are not shown, and can be calculated in a similar way. In addition, it can be seen that the subpixels in the 1st column and the 15th column belong to the same viewpoint, and the subpixels in the 2nd column and the 16th column belong to the same viewpoint. Therefore, it is only possible to calculate the viewpoint to which one column of subpixels belongs to among multiple columns of subpixels with the same viewpoint. Alternatively, the calculated viewpoint to which the column of sub-pixels belongs may be used as the viewpoint to which other columns of sub-pixels to which the column of sub-pixels belong are the same.

In this embodiment, the negative number modulo operation outputs a positive remainder, for example, V _2,1 = (2-(2-1)*3) mod28 = (-1) mod28 = 27; V _3,1 = (V _first - (i-1)*V _y )modV=(2-(3-1)*3)mod28=(-4)mod28=24; V _4,1 =(V _first -(i-1)*V _y ) modV=(2-(4-1)*3)mod28=(-7)mod28=21; V _5,1 =(V _first -(i-1)*V _y )modV=(2-(5-1 )*3)mod28=(-10)mod28=18; V _12,1 =(V _first -(i-1)*V _y )modV=(2-(12-1)*3)mod28=(-31 ) mod 28 = 25.

In an exemplary embodiment, the determining the gray scale value of the sub-pixel according to the image of the viewpoint to which the sub-pixel belongs includes:

The position of the sub-pixel is determined, and the gray-scale value of the corresponding position in the image of the viewpoint to which the sub-pixel belongs is used as the gray-scale value of the sub-pixel. For example, for the sub-pixel in row i and column j, use the grayscale value of row i and column j in the image of the viewpoint to which it belongs as the grayscale value of the subpixel. This is only an example, and the grayscale value of the i-th row and j-th column in the image of the viewpoint may be weighted as the grayscale value of the sub-pixel, and so on.

The 3D movie in the cinema is 2 viewpoints, and the left eye receives the left viewpoint image and the right eye also receives the right viewpoint image by the 3D glasses. However, naked-eye 3D display devices generally display multi-viewpoint content. When the human eye moves, it is easy to be in the The anti-view zone or "dead zone" means that the left eye receives the right viewpoint image while the right eye also receives the left viewpoint image, which makes people feel uncomfortable. In an exemplary embodiment, the view point arrangement is optimized (the view point to which the sub-pixel belongs is changed), the anti-view effect is weakened, the dizziness and ghosting caused by the anti-view area are alleviated, the view points are more continuous, and the naked-eye 3D effect is more enhanced. comfortable. In the embodiment of the present disclosure, the degree of negative parallax can be alleviated by sacrificing the number of viewpoints.

In an exemplary embodiment, after the viewpoint to which the subpixel belongs is determined according to the number of viewpoints contained in a single subpixel in the first direction and the number of viewpoints contained in a single subpixel in the second direction, according to the viewpoint to which the subpixel belongs Before determining the grayscale values of the subpixels in the image, also include:

Replace the viewpoints of some sub-pixels, and when the viewpoints of different sub-pixels are the same, replace them with the same viewpoint, so that after the replacement, the first parallax of the left-eye viewpoint and the right-eye viewpoint is the same as the first parallax when no replacement is performed. The ratio of the second disparity (also referred to as the normalized first disparity) of the viewpoint to which the upward adjacent sub-pixels belong satisfies a preset condition. The solution provided in this embodiment realizes the control of the parallax of the left and right eyes by replacing part of the viewpoints, so as to improve the 3D experience. Taking FIG. 6 as an example, the second parallax of the viewpoints to which adjacent sub-pixels belong is 6 in the first direction.

In an exemplary embodiment, the satisfying the preset condition may include: a ratio of the first parallax to the second parallax is in [-1, 1]. This is just an example, and you can set other conditions that can reduce reverse vision as needed. For example, it can be smaller than the third parallax and the second parallax of the left eye viewpoint and right eye viewpoint at the same corresponding position when the viewpoint replacement is not performed. ratio. For example, take 28 viewpoints as an example. When the viewpoint is not replaced, the second parallax is 6. When the left eye viewpoint is 23, the right eye viewpoint is 1. At this time, the parallax of the left and right eyes is -22, then normalize The final parallax is -3.6, and some viewpoints can be replaced so that the absolute value of the normalized parallax at the same position is less than 3.6.

In an exemplary embodiment, replacing the viewpoint to which some sub-pixels belong includes:

The viewpoint includes viewpoint 1 to viewpoint V distributed sequentially along the first direction. When the viewpoint k to which the sub-pixel belongs is in the range from viewpoint K to viewpoint V, replace viewpoint k with viewpoint S-k, where S-k is less than or equal to V and greater than is equal to 1, and the K is a preset value. In this embodiment, reverse order replacement is performed. For example, for V=28 viewpoints and K=16, viewpoint 16 to viewpoint 28 can be replaced by viewpoint 14 to viewpoint 2 respectively, and S=30 at this time.

Taking the 28 viewpoints shown in Figure 6 as an example, the difference between two adjacent sub-pixels in the horizontal direction is 6 viewpoints (the second viewpoint). It can be understood that every 6 viewpoints are a pair of left and right eyes. The viewing zone corresponding to the viewpoint is the front viewing zone. At this time, the right eye must fall in the viewing zone of 7-28 viewpoints, and when the left eye moves to the viewing zone corresponding to 23-28 viewpoints, it is in the anti-viewing zone. Feel dizzy and double image. As shown in Table 2-1 and Table 2-2, the first two rows are the positions of the left and right eyes, the third and fourth rows are the disparity between the right eye viewpoint and the left eye viewpoint, which is the first disparity, and the first disparity is normalized The result after (first parallax/second parallax). It can be seen that when the left eye is at 23-28 viewpoints, the first parallax is a negative number, and the negative vision area cannot be completely eliminated, but the degree of reverse vision can only be weakened.

In this embodiment, the degree of negative parallax is alleviated by sacrificing the number of viewpoints, so that the maximum negative parallax is consistent with the positive parallax. For example, replace the original viewpoints 16 to 28 with viewpoints 14 to 2, and recalculate the parallax results at this time. After the replacement, see Table 3-1 and Table 3-2 (Table 3-1, Table 3-2 The bold part in the center is the replacement viewpoint), the first two lines are the positions of the left and right eyes, the third and fourth lines are the disparity between the right eye viewpoint and the left eye viewpoint, that is, the first disparity, and the first disparity is normalized ( The results after the first parallax/second parallax), in Table 3-1 and Table 3-2, the positive and negative parallax in the fourth row are both between [-1, 1], which weakens the degree of inversion. In this embodiment, after calculating the viewpoint to which each sub-pixel belongs, replace viewpoints 16 to 28 with viewpoints 14 to 2 to achieve the effect of inverse viewing area optimization, that is, replace viewpoint 16 with viewpoint 14, and replace viewpoint 17 with is viewpoint 13, and so on, replace viewpoint 28 with viewpoint 2, as shown in FIG. 7 after replacing the viewpoint of the sub-pixel in FIG. 6 .

In the above embodiment, the original 16 to 28 viewpoints are all replaced. In another embodiment, only some of the viewpoints can be replaced, that is, the display effect of only part of the inverse viewing area can be improved.

In the above-mentioned embodiment, 28 viewpoints are taken as an example for illustration. For other viewpoints, the scheme is similar, and some viewpoints can be replaced in reverse order so that the normalized parallax is between [-1, 1] to realize the optimization of the reverse viewing area.

Table 2-1 Parallax

Table 2-2 Parallax

Table 3-1 Solutions for Alleviating Anti-Vision

Table 3-2

An embodiment of the present disclosure provides a computer-readable storage medium storing computer-executable instructions, and the computer-executable instructions are used for the above-mentioned method for generating a multi-viewpoint image.

As shown in FIG. 8 , an embodiment of the present disclosure provides a display device, including a processor 801 and a memory 802 storing a computer program that can run on the processor 801, wherein, when the processor 801 executes the program, the The steps of the above multi-viewpoint image generation method. The display device may be any product or component with a display function such as a mobile phone, a tablet computer, a television, a monitor, a notebook computer, a digital photo frame, a navigator, and the like. The display device may be a naked-eye 3D display device.

Those of ordinary skill in the art can understand that all or some of the steps in the methods disclosed above, the functional modules/units in the system, and the device can be implemented as software, firmware, hardware, and an appropriate combination thereof. In a hardware implementation, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be composed of several physical components. Components cooperate to execute. Some or all of the components may be implemented as software executed by a processor, such as a digital signal processor or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). As known to those of ordinary skill in the art, the term computer storage media includes both volatile and nonvolatile media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules, or other data. permanent, removable and non-removable media. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cartridges, tape, magnetic disk storage or other magnetic storage devices, or can Any other medium used to store desired information and which can be accessed by a computer. In addition, as is well known to those of ordinary skill in the art, communication media typically embodies computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and may include any information delivery media .

Those skilled in the art should understand that the technical solutions of the embodiments of the present disclosure can be modified or equivalently replaced without departing from the spirit and scope of the technical solutions of the present disclosure, and should be covered by the claims of the present disclosure.

Claims (12)

1. A method for generating a multi-viewpoint image, characterized in that it is applied to a display device including a display panel and an image splitting device, the display panel includes a plurality of pixels distributed in an array, the pixels include a plurality of sub-pixels, and the split The imaging device comprises a plurality of grating units parallel to each other, the method comprising: Determine the number of sub-pixels covered by the grating unit in the first direction, and determine the number of viewpoints contained in a single sub-pixel in the first direction according to the total number of viewpoints and the number of sub-pixels covered by the grating unit in the first direction; the first The direction is the pixel row direction, that is, the arrangement direction of the sub-pixels in the same pixel; According to the first length of the sub-pixel in the first direction and the second length in the second direction, the bonding angle between the image splitting device and the display panel, and the viewpoint contained in a single sub-pixel in the first direction The number determines the number of viewpoints contained in a single sub-pixel in the second direction, and the second direction is the pixel column direction; determining the viewpoint to which the subpixel belongs according to the number of viewpoints contained in a single subpixel in the first direction and the number of viewpoints contained in a single subpixel in the second direction; The gray scale value of the sub-pixel is determined according to the image of the viewpoint to which the sub-pixel belongs. 2. The multi-viewpoint image generation method according to claim 1, wherein the determining the number of sub-pixels covered by the grating unit in the first direction comprises: The number of sub-pixels covered by the grating unit in the first direction

The P is the width of the grating unit, the S _w is the length of the sub-pixel along the first direction, the θ∈(-90°, 90°), the θ is the image splitting device and The lamination angle of the display panel, that is, the angle between the extension direction of the orthographic projection of the grating unit and the second direction on a plane parallel to the display panel, according to the angle of the orthographic projection of the grating unit The orientation of the extending direction to the second direction determines whether the θ is positive or negative. 3. The method for generating a multi-viewpoint image according to claim 1, wherein the viewpoint contained in a single subpixel in the first direction is determined according to the total number of viewpoints and the number of subpixels covered by the grating unit in the first direction Numbers include: The number of viewpoints contained in a single sub-pixel in the first direction

The V is the total number of viewpoints, and P _x is the number of sub-pixels covered by the grating unit in the first direction. 4. The multi-viewpoint image generation method according to claim 1, characterized in that, according to the first length of the sub-pixel in the first direction and the second length in the second direction, the image splitting device and The bonding angle of the display panel, the number of viewpoints contained in a single sub-pixel in the first direction determine the number of viewpoints contained in a single sub-pixel in the second direction includes: Determine an offset value according to the first length of the sub-pixel in the first direction and the second length in the second direction, and the bonding angle between the image splitting device and the display panel; according to the first direction in the first direction The number of viewpoints contained in a single subpixel and the offset value determine the number of viewpoints contained in a single subpixel in the second direction; wherein, The offset value

Wherein, the _Sw is the first length of the sub-pixel in the first direction, the _Sh is the second length of the sub-pixel in the second direction, and θ is the image splitting device and the display panel The bonding angle, that is, on the plane parallel to the display panel, the angle between the extending direction of the orthographic projection of the grating unit and the second direction, according to the extending direction of the orthographic projection of the grating unit to the The orientation of the second direction determines the sign of the θ. 5. The method for generating a multi-viewpoint image according to claim 4, characterized in that, according to the number of viewpoints contained in a single subpixel in the first direction and the offset value, it is determined that a single subpixel in the second direction contains The number of viewpoints includes: The number of viewpoints contained in a single sub-pixel in the second direction V _y =V _x *Shift _x Wherein, V _x is the number of viewpoints contained in a single sub-pixel in the first direction, and Shift _x is the offset value. 6. The multi-viewpoint image generation method according to any one of claims 1 to 5, characterized in that, according to the number of viewpoints included in a single subpixel in the first direction and the number of viewpoints included in a single subpixel in the second direction The number to determine the viewpoint to which the sub-pixel belongs includes: V _i,1 =(V _first -(i-1)*V _y )modV, if V _i,1 =0, then V _i,1 =V,i∈[1,M] V _i,j =(V _i,1 +(j-1)*V _x )modV, if V _i,j =0, then V _i,j =V,j∈[1,N] Among them, V is the total number of viewpoints, V _{i, j} is the viewpoint to which the sub-pixel in row i and column j belongs, V _first is the viewpoint to which the sub-pixel in row 1 and column 1 belongs, and M is the row of sub-pixels N is the number of columns of sub-pixels, V _x is the number of viewpoints contained in a single sub-pixel in the first direction, and V _y is the number of viewpoints contained in a single sub-pixel in the second direction. 7. The method for generating a multi-viewpoint image according to any one of claims 1 to 5, wherein said determining the grayscale value of the subpixel according to the image of the viewpoint to which the subpixel belongs comprises: The position of the sub-pixel is determined, and the gray-scale value of the corresponding position in the image of the viewpoint to which the sub-pixel belongs is used as the gray-scale value of the sub-pixel. 8. The multi-viewpoint image generation method according to any one of claims 1 to 5, characterized in that, it is determined according to the number of viewpoints contained in a single subpixel in the first direction and the number of viewpoints contained in a single subpixel in the second direction After the viewpoint to which the sub-pixel belongs, before determining the grayscale value of the sub-pixel according to the image of the viewpoint to which the sub-pixel belongs, further include: Replace the viewpoints of some sub-pixels, and when the viewpoints of different sub-pixels are the same, replace them with the same viewpoint, so that after the replacement, the first parallax of the left-eye viewpoint and the right-eye viewpoint is the same as the first parallax when no replacement is performed. The ratio of the second parallax of the viewpoint to which the upward adjacent sub-pixels belong satisfies a preset condition. 9. The multi-viewpoint image generation method according to claim 8, wherein: The meeting the preset condition includes: the ratio of the first parallax to the second parallax is in [-1, 1]. 10. The multi-viewpoint image generation method according to claim 8, wherein said replacing the viewpoints to which some sub-pixels belong comprises: The viewpoint includes viewpoint 1 to viewpoint V distributed sequentially along the first direction. When the viewpoint k to which the sub-pixel belongs is in the range from viewpoint K to viewpoint V, replace viewpoint k with viewpoint S-k, where S-k is less than or equal to V and greater than is equal to 1, and the K is a preset value. 11. A computer-readable storage medium storing computer-executable instructions, the computer-executable instructions being used to execute the multi-viewpoint image generation method according to any one of claims 1-10. 12. A display device, comprising a processor and a memory storing a computer program that can run on the processor, wherein, when the processor executes the program, the multiple functions described in any one of claims 1 to 10 are realized. Steps of the viewpoint image generation method.

Images