CN112399168A - Multi-view image generation method, storage medium, and display device - Google Patents

Abstract

A method for generating a multi-viewpoint image, a storage medium and a display device, the method for generating a multi-viewpoint image comprises: determining a viewpoint included in a single subpixel in a first direction according to the total number of viewpoints and the number of subpixels covered by a grating unit in a first direction according to the first length of the sub-pixel in the first direction and the second length in the second direction, the bonding angle between the image splitting device and the display panel, and a single sub-pixel in the first direction contains The number of viewpoints in the second direction determines the number of viewpoints contained in a single subpixel; the viewpoints to which the subpixel belongs are determined according to the number of viewpoints contained in a single subpixel in the first direction and the number of viewpoints contained in a single subpixel in the second direction; The grayscale value of the sub-pixel is determined according to the image of the viewpoint to which the sub-pixel belongs. The solution provided by this embodiment realizes the generation of multi-view three-dimensional images.

Description

A multi-view image generation method, storage medium, and display device

technical field

The embodiments of the present disclosure relate to, but are not limited to, display technologies, and more particularly, to a method for generating a multi-viewpoint image, a storage medium, and a display device.

Background technique

The naked-eye three-dimensional (3D) display device includes a display panel and an image splitting device. The display panel usually includes a liquid crystal display (LCD), an organic light-emitting diode (Organic Light-Emitting Diode, OLED) and other displays, and the image splitting device includes a slit. grating or lenticular lens grating etc. The display panel includes a plurality of pixels, and each pixel generally includes sub-pixels RGB of three colors. The image splitting device includes a plurality of image splitting units arranged in parallel. The image splitting device is attached to the front of the display panel at a certain angle, and the sub-pixels at different positions can be split to different positions in the space, so that the multi-viewpoint image can be divided according to the image splitting device. The spectroscopic characteristics are arranged and rendered and displayed on the display panel. After the splitting device, people's eyes can see images from different viewpoints, and then they can be processed by the brain to make people feel three-dimensional.

SUMMARY OF THE INVENTION

The following is an overview of the topics detailed in this article. This summary is not intended to limit the scope of protection of the claims.

Embodiments of the present disclosure provide a multi-viewpoint image generation method, a storage medium, and a display device to realize multi-viewpoint three-dimensional display.

In one aspect, an embodiment of the present disclosure provides a method for generating a multi-viewpoint image, which is applied to a display device including a display panel and an image splitting device, where the display panel includes a plurality of pixels distributed in an array, and the pixels include a plurality of sub-pixels, The image splitting device includes a plurality of grating units parallel to each other, and the method includes:

determining the number of sub-pixels covered by the grating unit in the first direction, and determining the number of viewpoints contained in a single sub-pixel in the first direction according to the total number of viewpoints and the number of sub-pixels covered by the grating unit in the first direction; the first The direction is the pixel row direction, that is, the arrangement direction of sub-pixels in the same pixel;

According to the first length of the sub-pixel in the first direction and the second length in the second direction, the bonding angle between the image splitting device and the display panel, and the viewpoint included in a single sub-pixel in the first direction The number determines the number of viewpoints contained in a single sub-pixel in a second direction, where the second direction is the pixel column direction;

Determine the viewpoint to which the sub-pixel belongs according to the number of viewpoints included in a single sub-pixel in the first direction and the number of viewpoints included in a single sub-pixel in the second direction;

The grayscale value of the sub-pixel is determined according to the image of the viewpoint to which the sub-pixel belongs.

In an exemplary embodiment, the determining the number of sub-pixels covered by the grating unit in the first direction includes:

The number of sub-pixels covered by the grating unit in the first direction

The P is the width of the grating unit, the S _w is the length of the sub-pixel along the first direction, the θ∈(-90°, 90°), and the θ is the image separation device and the The attachment angle of the display panel, that is, on the plane parallel to the display panel, the angle between the extension direction of the orthographic projection of the grating unit and the second direction, according to the orthographic projection of the grating unit. The orientation of the extending direction to the second direction determines the sign of the θ.

In an exemplary embodiment, the determining the number of viewpoints included in a single sub-pixel in the first direction according to the total number of viewpoints and the number of sub-pixels covered by the grating unit in the first direction includes:

The number of viewpoints contained in a single subpixel in the first direction

The V is the total number of viewpoints, and P _x is the number of sub-pixels covered by the grating unit in the first direction.

In an exemplary embodiment, according to the first length of the sub-pixel in the first direction and the second length in the second direction, the attachment angle of the image splitting device and the display panel, the The number of viewpoints contained in a single sub-pixel in the first direction determines the number of viewpoints contained in a single sub-pixel in the second direction, including:

An offset value is determined according to the first length of the sub-pixel in the first direction and the second length in the second direction, and the attachment angle between the image splitting device and the display panel; The number of viewpoints contained in a single sub-pixel and the offset value determine the number of viewpoints contained in a single sub-pixel in the second direction; wherein,

the offset value

The S _w is the first length of the sub-pixel in the first direction, the _Sh is the second length of the sub-pixel in the second direction, and θ is the image splitting device and the display panel The bonding angle, that is, on the plane parallel to the display panel, the angle between the extending direction of the orthographic projection of the grating unit and the second direction, according to the extending direction of the orthographic projection of the grating unit to the The orientation of the second direction determines the positive or negative of the θ.

In an exemplary embodiment, the determining the number of viewpoints included in a single subpixel in the second direction according to the number of viewpoints included in a single subpixel in the first direction and the offset value includes:

The number of viewpoints included in a single sub-pixel in the second direction V _y =V _x *Shift _x

Wherein, V _x is the number of viewpoints included in a single sub-pixel in the first direction, and Shift _x is the offset value.

In an exemplary embodiment, the determining the viewpoint to which the sub-pixel belongs according to the number of viewpoints included in a single sub-pixel in the first direction and the number of viewpoints included in a single sub-pixel in the second direction includes:

Vi _,1 =(V _first -(i-1)*V _y )modV, if Vi _,1 =0, then Vi _,1 =V,i∈[1,M]

V _i,j =(V _i,1 +(j-1)*V _x )modV, if V _i,j =0, then V _i,j =V,j∈[1,N]

Among them, V is the total number of viewpoints, V _i,j is the viewpoint to which the sub-pixel in the i-th row and the j-th column belongs, V _first is the viewpoint to which the sub-pixel in the first row and the first column belongs, and M is the row of the sub-pixel where N is the number of columns of sub-pixels, V _x is the number of viewpoints included in a single sub-pixel in the first direction, and V _y is the number of viewpoints included in a single sub-pixel in the second direction.

In an exemplary embodiment, the determining the gray-scale value of the sub-pixel according to the image of the viewpoint to which the sub-pixel belongs includes:

The position of the sub-pixel is determined, and the gray-scale value of the corresponding position in the image of the viewpoint to which the sub-pixel belongs is used as the gray-scale value of the sub-pixel.

In an exemplary embodiment, after the viewpoint to which the sub-pixel belongs is determined according to the number of viewpoints contained in a single sub-pixel in the first direction and the number of viewpoints contained in a single sub-pixel in the second direction, the viewpoint to which the sub-pixel belongs is determined according to the number of viewpoints to which the sub-pixel belongs. Before determining the grayscale value of the sub-pixel, the image further includes:

The viewpoints to which some sub-pixels belong are replaced, and when the viewpoints to which different sub-pixels belong are the same, the same viewpoints are used for replacement, so that after the replacement, the first parallax of the left-eye viewpoint and the right-eye viewpoint is different from that when no replacement is performed. The ratio of the second disparity of the viewpoints to which the upwardly adjacent sub-pixels belong satisfies a preset condition.

In an exemplary embodiment, the satisfying the preset condition includes: the ratio of the first parallax to the second parallax is located at [-1, 1].

In an exemplary embodiment, replacing the viewpoints to which some sub-pixels belong includes:

The viewpoints include viewpoints 1 to V distributed in sequence along the first direction. When viewpoint k to which the sub-pixel belongs is located in the range from viewpoint K to viewpoint V, viewpoint k is replaced by viewpoint S-k, which is less than or equal to V and greater than or equal to V. equal to 1, the K is a preset value.

On the other hand, an embodiment of the present disclosure provides a computer-readable storage medium storing computer-executable instructions, where the computer-executable instructions are used to execute the above-mentioned method for generating a multi-viewpoint image.

In yet another aspect, an embodiment of the present disclosure provides a display device, including a processor and a memory storing a computer program that can be executed on the processor, wherein the processor implements the above-mentioned method for generating a multi-view image when the program is executed. A step of.

Embodiments of the present disclosure provide the multi-viewpoint image generation method, storage medium, and display device. The multi-viewpoint image generation method includes: determining a single subpixel in the first direction according to the total number of viewpoints and the number of subpixels covered by the grating unit in the first direction The number of viewpoints included; according to the first length of the sub-pixel in the first direction and the second length in the second direction, the attachment angle of the image splitting device and the display panel, the single The number of viewpoints contained in a sub-pixel determines the number of viewpoints contained in a single sub-pixel in the second direction; the sub-pixel is determined according to the number of viewpoints contained in a single sub-pixel in the first direction and the number of viewpoints contained in a single sub-pixel in the second direction The viewpoint to which the sub-pixel belongs; the gray-scale value of the sub-pixel is determined according to the image of the viewpoint to which the sub-pixel belongs. The solution provided by this embodiment realizes the generation of multi-view three-dimensional images.

Other features and advantages of the present invention will be set forth in the description which follows, and in part will be apparent from the description, or may be learned by practice of the invention. The objectives and other advantages of the invention may be realized and attained by the structure particularly pointed out in the description and drawings.

Other aspects will become apparent upon reading and understanding of the drawings and detailed description.

Description of drawings

The accompanying drawings are used to provide a further understanding of the technical solutions of the present invention, and constitute a part of the specification. They are used to explain the technical solutions of the present invention together with the embodiments of the present application, and do not limit the technical solutions of the present invention.

1 is a schematic diagram of a three-dimensional display provided by an embodiment;

FIG. 2 is a schematic diagram of a display device provided by an embodiment of the present disclosure;

3 is a schematic diagram of a display panel provided by an embodiment;

4 is a schematic diagram of an image splitting device and a display panel provided by an embodiment;

5 is a flowchart of a method for generating a multi-viewpoint image provided by an embodiment;

6 is a schematic diagram of a viewpoint to which a sub-pixel belongs according to an embodiment;

FIG. 7 is a schematic diagram after the viewpoints to which sub-pixels belong according to an embodiment are replaced;

FIG. 8 is a schematic diagram of a display device according to an embodiment.

Detailed ways

Hereinafter, the embodiments of the present invention will be described in detail with reference to the accompanying drawings. The embodiments in the present application and the features in the embodiments may be arbitrarily combined with each other if there is no conflict.

The steps shown in the flowcharts of the figures may be performed in a computer system, such as a set of computer-executable instructions. Also, although a logical order is shown in the flowcharts, in some cases the steps shown or described may be performed in an order different from that herein.

Unless otherwise defined, technical or scientific terms used in this disclosure should have the ordinary meaning as understood by one of ordinary skill in the art to which this invention belongs.

In the drawings, the size of each constituent element, the thickness of a layer, or a region are sometimes exaggerated for clarity. Therefore, embodiments of the present disclosure are not necessarily limited to this size, and the shapes and sizes of components in the drawings do not reflect true scale. Further, the drawings schematically show ideal examples, and embodiments of the present disclosure are not limited to the shapes or numerical values shown in the drawings.

In the present disclosure, ordinal numbers such as "first", "second" and "third" are set to avoid confusion of constituent elements, and do not indicate any order, quantity or importance.

In the present disclosure, "middle", "upper", "lower", "front", "rear", "vertical", "horizontal", "top", "bottom", "inside" are used for convenience , "outside" and other words indicating orientation or positional relationship are used to describe the positional relationship of constituent elements with reference to the drawings, which are only for the convenience of describing this specification and simplifying the description, rather than indicating or implying that the referred device or element must have a specific orientation. , are constructed and operated in a particular orientation and are therefore not to be construed as limitations of the present disclosure. The positional relationship of the constituent elements is appropriately changed according to the direction in which each constituent element is described. Therefore, it is not limited to the words and phrases described in the disclosure, and can be appropriately replaced according to the situation.

In the present disclosure, "parallel" refers to a state where the angle formed by two straight lines is -10° or more and 10° or less, and therefore, also includes a state where the angle is -5° or more and 5° or less. In addition, "perpendicular" refers to the state where the angle formed by two straight lines is 80° or more and 100° or less, and therefore includes the state where the angle is 85° or more and 95° or less.

As shown in Figure 1, the naked eye 3D display principle of the lenticular lens is shown. The pixels at different positions on the display panel are refracted and split by the lenticular lens, and the light path changes to form different viewing areas in space. When the human eyes are in the correct viewing area In the middle (that is, when the left eye receives the left viewpoint image and the right eye also receives the right viewpoint image), the stereoscopic effect can be felt.

In the embodiment of the present disclosure, a method for generating a multi-viewpoint image (or a method for arranging images) is provided, which can fuse the multi-viewpoint content according to the relevant parameters of the display panel and the image splitting device, and the number of viewpoints to be displayed, so that the Stereoscopic images can be displayed accurately.

FIG. 2 is a schematic diagram of a display device provided by an exemplary embodiment. As shown in FIG. 2 , the display device includes a display panel 10 and an image splitting device 20 , and the image splitting device 20 includes a plurality of barrier units 21 parallel to each other, and the width of the barrier units 21 is P. There is an angle θ between the extending direction Q of the barrier unit 21 and the middle pixel row direction of the display panel (the Y direction in the figure), that is, the image splitting device 20 is attached to the surface of the display panel 10 at the angle θ. The display panel 10 includes a plurality of pixels, and the pixels are located on the focal plane of the barrier unit 21 . In this embodiment, a lenticular lens grating is shown as the image splitting device 20 . However, the embodiments of the present disclosure are not limited thereto, and other gratings may be used.

As shown in FIG. 3 , the display panel 10 includes a plurality of pixels 11 distributed in an array, and the pixels 11 include a plurality of sub-pixels 12, for example, a red sub-pixel R, a green sub-pixel G and a blue sub-pixel B, However, the embodiment of the present disclosure is not limited thereto, and may be sub-pixels of other colors, or may be more than 3 sub-pixels, such as 4 sub-pixels. The sub-pixels 12 in the same pixel 11 are distributed along the first direction X, also called the pixel row direction, the second direction Y is also called the pixel column direction, and the first direction X and the second direction Y may be perpendicular. The length of the sub-pixel 12 along the first direction X is _Sw (also referred to as the sub-pixel width), and the length of the sub-pixel 12 along the second direction Y is _Sh (also referred to as the sub-pixel height).

As shown in FIG. 4 , the image splitting device 20 is attached to the surface of the display panel 10 at an angle θ, where the angle θ is (-90°, 90°), and the angle θ is parallel to the surface of the display panel 10 . On the plane, the angle between the extending direction Q of the orthographic projection of the grating unit 21 and the second direction Y is determined according to the orientation of the extending direction Q of the orthographic projection of the grating unit 21 to the second direction Y. Describe the positive and negative of θ, when Q to P are clockwise, θ is positive, as shown in FIG. 4, θ is positive, and when Q to P is counterclockwise, θ is negative.

Since the design parameters of different 3D display devices are different, the multi-view image can be determined according to the parameters matching the 3D display device, so that the compatibility is strong and can meet more application scenarios. For devices with the same design parameters, these parameters only need to be configured. One time is enough, and the parameters can be as shown in Table 1.

Table 1 Display panel and image splitting device parameters

FIG. 5 is a flowchart of a method for generating a multi-view image provided by an exemplary embodiment. As shown in FIG. 5 , the method for generating a multi-viewpoint image provided in this embodiment is applied to the above-mentioned display device, including:

Step 501: Determine the number of sub-pixels P _x covered by the barrier unit 21 in the first direction X, and determine the first direction X according to the total number of viewpoints V and the number of sub-pixels P _x covered by the barrier unit 21 in the first direction The number of viewpoints V _x included in a single sub-pixel; the first direction X is the pixel row direction, that is, the arrangement direction of sub-pixels in the same pixel;

Step 502, according to the first length _Sw of the sub-pixel in the first direction X and the second length _Sh in the second direction Y, the bonding angle θ of the image splitting device 20 and the display panel 10, The number of viewpoints V _x included in a single sub-pixel in the first direction X determines the number of viewpoints V _y included in a single sub-pixel in the second direction Y; the second direction Y is the pixel column direction;

Step 503: Determine the viewpoint to which the sub-pixel belongs according to the viewpoint number V _x included in a single sub-pixel in the first direction X and the viewpoint number V _y included in a single sub-pixel in the second direction Y;

Step 504: Determine the grayscale value of the sub-pixel according to the image of the viewpoint to which the sub-pixel belongs.

The solution provided by this embodiment can determine the viewpoint to which the sub-pixel belongs according to the relevant parameters of the display panel and the image splitting device, and the number of viewpoints to be displayed, can accurately display stereoscopic images, bring continuous 3D effects, and has strong compatibility , can be applied to a variety of equipment.

In an exemplary embodiment, the images of the viewpoints may be obtained by using an imaging device to capture; or, after capturing images of some viewpoints, images of other viewpoints are generated according to the images of existing viewpoints.

In an exemplary embodiment, the determining the number P _x of sub-pixels covered by the barrier unit 21 in the first direction X includes:

The P is the width of the grating unit, the S _w is the length of the sub-pixel along the first direction X, the θ∈(-90°, 90°), and the θ is the image splitting device The bonding angle with the display panel, that is, on the plane parallel to the display panel, the angle between the extension direction of the orthographic projection of the grating unit 21 and the second direction Y, according to the The orientation of the extension direction Q of the orthographic projection to the second direction Y determines the positive and negative of the θ.

In an exemplary embodiment, the determining the number of viewpoints _Vx included in a single subpixel in the first direction according to the total number of viewpoints V and the number of subpixels _Px covered by the grating unit in the first direction includes:

The number of viewpoints contained in a single subpixel in the first direction

The sub-pixels at different positions in the barrier unit 21 have different directions after image splitting, and each barrier unit is covered in parallel on the display panel at an angle of θ, so the sub-pixels at the same position of different barrier units 21 have the same viewpoint direction, when the number of input viewpoints is V, the number of sub-pixels _Px covered by the grating unit 21 in the first direction, then the number of viewpoints Vx included in a single sub-pixel in the first direction _X (which can also be understood as the horizontal direction The number of viewpoints of adjacent sub-pixels differs by V _x ) as

In an exemplary embodiment, according to the first length _Sw of the sub-pixels in the first direction X and the second length _Sh in the second direction Y, the relationship between the image splitting device 20 and the display panel 10 is determined. The fitting angle θ, the number of viewpoints V _x included in a single sub-pixel in the first direction X determine the number of viewpoints V _y included in a single sub-pixel in the second direction Y, including:

An offset is determined according to the first length _Sw of the sub-pixels in the first direction X and the second length _Sh in the second direction Y, and the attachment angle θ of the image splitting device 20 and the display panel 10 The value Shift _x , Shift _x can also be called the number of adjacent row sub-pixel offsets;

The number of viewpoints contained in a single sub-pixel in the second direction Y is determined according to the number of viewpoints V _x contained in a single sub-pixel in the first direction X and the offset value.

In an exemplary embodiment, according to the first length _Sw of the sub-pixels in the first direction X and the second length _Sh in the second direction Y, the bonding of the image splitting device and the display panel. Determining an offset value for the angle θ may include:

the offset value

In an exemplary embodiment, the determining the number of viewpoints contained in a single subpixel in the second direction Y according to the number of viewpoints Vx contained in a single subpixel in the first direction _X and the offset value includes:

The number of viewpoints included in a single sub-pixel in the second direction V _y =V _x *Shift _x

The number of viewpoints V _y included in a single sub-pixel in the vertical direction can also be understood as the difference in the number of viewpoints of adjacent sub-pixels in the vertical direction by V _y .

In an exemplary embodiment, determining the viewpoint to which the sub-pixel belongs according to the number of viewpoints V _x included in a single sub-pixel in the first direction X and the number of viewpoints V _y included in a single sub-pixel in the second direction Y includes: :

Vi _,1 =(V _first -(i-1)*V _y )modV, if Vi _,1 =0, then Vi _,1 =V,i∈[1,M]

V _i,j =(V _i,1 +(j-1)*V _x )mod V, if V _i,j =0, then V _i,j =V,j∈[1,N]

Wherein, mod is the modulo operation, V _i,j is the viewpoint to which the sub-pixel in the ith row and the jth column belongs, V _first is the viewpoint to which the sub-pixel in the 1st row and the 1st column belongs, and M is the number of rows of the sub-pixels , where N is the number of columns of sub-pixels. In this embodiment, the viewpoints V _i,1 to which the sub-pixels in the first column of each row belong can be calculated first, and then the viewpoints to which sub-pixels in other columns of the row belong are calculated according to the viewpoints V _i,1 to which the sub-pixels in the first column of each row belong. That is, the viewpoints to which the sub-pixels belong can be calculated from the first row and the first column, and after the viewpoints to which the sub-pixels of one row belong are calculated, the viewpoints to which the sub-pixels of the next row belong are calculated. The sub-pixels in the first row and the first column may be the sub-pixels in the upper left corner of the display panel. The number of rows of sub-pixels may be the same as the number of rows of pixels, and the number of columns of sub-pixels may be three times the number of columns of pixels (when each pixel includes 3 sub-pixels).

V _first may be specified as required, for example, may be the second viewpoint, the embodiment of the present disclosure is not limited to this, and may be other values. In another embodiment, V _first may be a viewpoint to which sub-pixels of other rows and columns belong.

In an exemplary embodiment, the V _i,j of the same row may be cyclically shifted to serve as the viewpoint to which the sub-pixels of this row belong.

In an exemplary embodiment, taking V _x =6, V _y =3, Vfirst=2 (ie V _1,1 =2), and V=28 (viewpoints are numbered from 1 to 28) as an example, the sub-pixels are calculated own viewpoint. in:

The viewpoint to which the sub-pixel in the first row and the second column belongs is V _1,2 =(V _1,1 +(j-1)*V _x )mod V=(2+(2-1)*6)mod28=8;

The viewpoint to which the sub-pixel in the first row and the third column belongs is V _1,3 =(2+(3-1)*6)mod28=14;

By analogy, the viewpoint to which the sub-pixels in the first row and the 14th column belong is V _1,3 =(2+(14-1)*6)mod28=24; the following is similar and will not be described again.

The viewpoint to which the sub-pixel in the second row and the first column belongs is V _2,1 =(V _first -(i-1)*V _y )modV=(2-(2-1)*3)mod28=27; the second row The calculation of the viewpoints to which the sub-pixels in the second to Nth columns belong is similar to the calculation of the viewpoints to which the sub-pixels in the first row, the second to the Nth column belong, and will not be described again. The calculation results are shown in Figure 6. In FIG. 6 , only the viewpoints to which the sub-pixels belong to 4 rows and 18 columns are shown, and the viewpoints to which other sub-pixels belong are not shown, and can be calculated by a similar method. In addition, it can be seen that the sub-pixels in the 1st and 15th columns belong to the same viewpoint, and the sub-pixels in the 2nd and 16th columns belong to the same viewpoint. Therefore, it is possible to only calculate the viewpoint to which one column of sub-pixels belongs to the sub-pixels with the same viewpoint. Optionally, the calculated viewpoint to which the sub-pixels of the column belong may be regarded as the viewpoints of other columns of sub-pixels that are the same as the viewpoints to which the sub-pixels of the column belong.

In this embodiment, the negative modulo operation outputs a positive remainder, for example, V _2,1 =(2-(2-1)*3)mod28=(-1)mod28=27; V _3,1 =(V _first - (i-1)*V _y )modV=(2-(3-1)*3)mod28=(-4) _mod28 =24; V _4,1 =(V first-(i-1)*V _y ) modV=(2-(4-1)*3)mod28=(-7)mod28=21; V5,1=( _Vfirst- (i-1)* _Vy ) _modV =(2-(5-1) )*3)mod28=(-10)mod28=18; V12,1=( _Vfirst- (i-1)* _Vy ) _modV =(2-(12-1)*3)mod28=(-31 ) mod28=25.

In an exemplary embodiment, the determining the gray-scale value of the sub-pixel according to the image of the viewpoint to which the sub-pixel belongs includes:

The position of the sub-pixel is determined, and the gray-scale value of the corresponding position in the image of the viewpoint to which the sub-pixel belongs is used as the gray-scale value of the sub-pixel. For example, for the sub-pixel in the i-th row and the j-th column, the gray-scale value of the i-th row and the j-th column in the image of the corresponding viewpoint is used as the gray-scale value of the sub-pixel. This is just an example, and the gray-scale value of the i-th row and the j-th column in the image of the corresponding viewpoint can be weighted as the gray-scale value of the sub-pixel, and so on.

The 3D movie in the cinema has 2 viewpoints. The left eye receives the left viewpoint image and the right eye receives the right viewpoint image by the 3D glasses. The naked-eye 3D display device generally displays multi-viewpoint content, and it is easy to be in the position when the human eye moves. The reverse view zone or "dead zone" means that the left eye receives the right view point image and the right eye also receives the left view point image, which makes people feel uncomfortable. In an exemplary embodiment, the viewpoint layout is optimized (the viewpoint to which the sub-pixel belongs is changed), the reverse vision effect is weakened, the dizziness and ghosting caused by the reverse vision area are alleviated, and the viewpoints are more continuous and the naked-eye 3D effect is better. Comfortable. In the embodiment of the present disclosure, the degree of negative parallax can be alleviated by sacrificing the number of viewpoints.

In an exemplary embodiment, after the viewpoint to which the sub-pixel belongs is determined according to the number of viewpoints contained in a single sub-pixel in the first direction and the number of viewpoints contained in a single sub-pixel in the second direction, the viewpoint to which the sub-pixel belongs is determined according to the number of viewpoints to which the sub-pixel belongs. Before determining the grayscale value of the sub-pixel, the image further includes:

The viewpoints to which some sub-pixels belong are replaced, and when the viewpoints to which different sub-pixels belong are the same, the same viewpoints are used for replacement, so that after the replacement, the first parallax of the left-eye viewpoint and the right-eye viewpoint is different from that when no replacement is performed. The ratio of the second parallax of the viewpoint to which the upwardly adjacent sub-pixels belong (also referred to as the normalized first parallax) satisfies a preset condition. In the solution provided in this embodiment, by replacing some viewpoints, the parallax control of the left and right eyes is realized, which is convenient to improve the 3D experience. Taking FIG. 6 as an example, the second disparity of the viewpoint to which the adjacent sub-pixels in the first direction belong is 6.

In an exemplary embodiment, the satisfying the preset condition may include: the ratio of the first parallax to the second parallax is located at [-1, 1]. This is just an example, you can set other conditions that can reduce the reverse vision as needed. For example, it can be smaller than the third parallax and the second parallax of the left eye viewpoint and right eye viewpoint at the same corresponding position when viewpoint replacement is not performed. ratio. For example, taking 28 viewpoints as an example, when no viewpoint replacement is performed, the second parallax is 6, and when the left eye viewpoint is 23, the right eye viewpoint is 1 as an example, and the left eye parallax is -22, then normalized The resulting parallax is -3.6, and some viewpoints can be replaced, so that the absolute value of the normalized parallax at the same position is less than 3.6.

In an exemplary embodiment, replacing the viewpoints to which some sub-pixels belong includes:

The viewpoints include viewpoints 1 to V distributed in sequence along the first direction. When viewpoint k to which the sub-pixel belongs is located in the range from viewpoint K to viewpoint V, viewpoint k is replaced by viewpoint S-k, which is less than or equal to V and greater than or equal to V. equal to 1, the K is a preset value. In this embodiment, reverse order replacement is performed. For example, for V=28 viewpoints and K=16, viewpoints 16 to 28 can be replaced with viewpoints 14 to 2 respectively, and at this time S=30.

Taking the 28 viewpoints shown in Figure 6 as an example, two adjacent sub-pixels in the horizontal direction differ by 6 viewpoints (the second viewpoint), which can be understood as a pair of left and right eyes every 6 viewpoints, so when the left eye is located at 1 to 22 The viewing area corresponding to the viewpoint is the front vision area. At this time, the right eye must fall in the viewing area of the 7-28 viewpoint, and when the left eye moves to the viewing area corresponding to the 23-28 viewpoint, it is in the reverse vision area. Feel dizzy and ghosting. As shown in Table 2-1 and Table 2-2, the first two rows are the positions of the left and right eyes respectively, the third and fourth rows are the parallax between the right eye viewpoint and the left eye viewpoint, namely the first parallax, and the first parallax is normalized The result after transformation (first parallax/second parallax). It can be seen that the first parallax is negative when the left eye is at viewpoints 23 to 28, and the negative vision area cannot be completely eliminated, but the degree of reverse vision can only be reduced.

In this embodiment, the degree of negative parallax is relieved by sacrificing the number of viewpoints, so that the maximum negative parallax is consistent with the positive parallax. For example, replace the original viewpoints 16 to 28 with viewpoints 14 to 2, and recalculate the disparity results at this time. After replacement, see Table 3-1 and Table 3-2 (Table 3-1, Table 3-2). The bold part in the middle is the replaced viewpoint), the first two lines are the positions of the left and right eyes, the third and fourth lines are the parallax between the right eye viewpoint and the left eye viewpoint, that is, the first parallax, and the first parallax is normalized ( The results after the first parallax/second parallax), in Table 3-1 and Table 3-2, the positive and negative parallax of the fourth row are between [-1, 1], which reduces the degree of reverse vision. In this embodiment, after calculating the viewpoints to which each sub-pixel belongs, viewpoints 16 to 28 are respectively replaced with viewpoints 14 to 2 to achieve the effect of inverse viewing area optimization, that is, viewpoint 16 is replaced by viewpoint 14, and viewpoint 17 is replaced by viewpoint For viewpoint 13, and so on, the viewpoint 28 is replaced with viewpoint 2, and the viewpoint to which the sub-pixel belongs in FIG. 6 is replaced as shown in FIG. 7 .

In the above embodiment, all the original viewpoints 16 to 28 are replaced. In another embodiment, only part of the viewpoints may be replaced, that is, the display effect of only part of the reverse view area may be improved.

In the above embodiment, 28 viewpoints are used as an example for description. For other viewpoints, the solution is similar, and some viewpoints can be replaced in reverse order so that the normalized parallax is between [-1, 1] to realize the optimization of the inverse viewing area.

Table 2-1 Parallax

Table 2-2 Parallax

Table 3-1 Anti-vision mitigation solutions

Table 3-2

An embodiment of the present disclosure provides a computer-readable storage medium storing computer-executable instructions, where the computer-executable instructions are used for the above-described multi-view image generation method.

As shown in FIG. 8 , an embodiment of the present disclosure provides a display device, including a processor 801 and a memory 802 storing a computer program that can be executed on the processor 801 , wherein the processor 801 implements the program when the processor 801 executes the program. The steps of the above-mentioned multi-view image generation method. The display device may be any product or component with a display function, such as a mobile phone, a tablet computer, a TV, a monitor, a notebook computer, a digital photo frame, and a navigator. The display device may be a naked eye 3D display device.

Those of ordinary skill in the art can understand that all or some of the steps in the methods disclosed above, functional modules/units in the systems, and devices can be implemented as software, firmware, hardware, and appropriate combinations thereof. In a hardware implementation, the division between functional modules/units mentioned in the above description does not necessarily correspond to the division of physical components; for example, one physical component may have multiple functions, or one function or step may be composed of several physical components Components execute cooperatively. Some or all of the components may be implemented as software executed by a processor, such as a digital signal processor or microprocessor, or as hardware, or as an integrated circuit, such as an application specific integrated circuit. Such software may be distributed on computer-readable media, which may include computer storage media (or non-transitory media) and communication media (or transitory media). As known to those of ordinary skill in the art, the term computer storage media includes both volatile and nonvolatile implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules or other data flexible, removable and non-removable media. Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disk (DVD) or other optical disk storage, magnetic cartridges, magnetic tape, magnetic disk storage or other magnetic storage devices, or may Any other medium used to store desired information and which can be accessed by a computer. In addition, communication media typically embodies computer readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism, and can include any information delivery media, as is well known to those of ordinary skill in the art .

Those of ordinary skill in the art should understand that the technical solutions of the embodiments of the present disclosure may be modified or equivalently replaced without departing from the spirit and scope of the technical solutions of the present disclosure, and should be included in the scope of the claims of the present disclosure.

Claims (12)

1. A multi-view image generating method applied to a display apparatus including a display panel and a sub-imaging device, wherein the display panel includes a plurality of pixels distributed in an array, the pixels include a plurality of sub-pixels, and the sub-imaging device includes a plurality of grating units parallel to each other, the method comprising:

determining the number of sub-pixels covered by the grating unit in the first direction, and determining the number of viewpoints contained by a single sub-pixel in the first direction according to the total number of viewpoints and the number of sub-pixels covered by the grating unit in the first direction; the first direction is a pixel row direction, namely the arrangement direction of sub-pixels in the same pixel;

determining the number of viewpoints contained in a single sub-pixel in a second direction according to the first length of the sub-pixel in the first direction and the second length of the sub-pixel in the second direction, the attaching angle of the image splitting device and the display panel and the number of viewpoints contained in the single sub-pixel in the first direction, wherein the second direction is a pixel column direction;

determining the viewpoint to which the sub-pixel belongs according to the number of viewpoints contained by the single sub-pixel in the first direction and the number of viewpoints contained by the single sub-pixel in the second direction;

and determining the gray-scale value of the sub-pixel according to the image of the viewpoint to which the sub-pixel belongs.

2. The method of claim 1, wherein the determining the number of sub-pixels covered by the raster unit in the first direction comprises:

the number of sub-pixels covered by the grating unit in the first direction

P is the width of the grating unit, S_wAnd determining the positive and negative of theta according to the direction from the extending direction of the orthographic projection of the grating unit to the second direction, wherein the theta is the attaching angle of the image splitting device and the display panel, namely the included angle between the extending direction of the orthographic projection of the grating unit and the second direction on a plane parallel to the display panel.

3. The method of claim 1, wherein determining the number of views a single sub-pixel in the first direction contains based on the total number of views and the number of sub-pixels covered by the raster unit in the first direction comprises:

number of views contained by a single sub-pixel in a first direction

V is the total number of viewpoints, P_xThe number of the sub-pixels covered by the grating unit in the first direction is shown.

4. The method according to claim 1, wherein the determining the number of viewpoints included in a single sub-pixel in the second direction based on a first length of the sub-pixel in the first direction and a second length of the sub-pixel in the second direction, a bonding angle of the image splitter to the display panel, and the number of viewpoints included in a single sub-pixel in the first direction comprises:

determining an offset value according to a first length of the sub-pixel in a first direction, a second length of the sub-pixel in a second direction and a joint angle between the image splitting device and the display panel; determining the number of viewpoints contained by a single sub-pixel in a second direction according to the number of viewpoints contained by the single sub-pixel in the first direction and the offset value; wherein,

the offset value

Wherein, the S_wIs a first length of the sub-pixel in a first direction, S_hThe second length of the sub-pixel in the second direction is theta, the joint angle of the image splitting device and the display panel is theta, namely the angle between the extending direction of the orthographic projection of the grating unit and the second direction is on a plane parallel to the display panel, and the angle between the extending direction of the orthographic projection of the grating unit and the second direction is thetaThe orientation determines the positive and negative of theta.

5. The method according to claim 4, wherein the determining the number of views contained by a single sub-pixel in a second direction from the number of views contained by a single sub-pixel in the first direction and the offset value comprises:

number of views V contained by a single sub-pixel in the second direction_y＝V_x*Shift_x

Wherein, V_xFor the number of views, Shift, contained by a single sub-pixel in said first direction_xIs the offset value.

6. The method according to any of claims 1 to 5, wherein said determining the viewpoint of a single sub-pixel in the first direction according to the number of viewpoints of the sub-pixel and the number of viewpoints of the sub-pixel in the second direction comprises:

V_i，1＝(V_first-(i-1)*V_y) mod V, if V_i，1When the value is 0, then V_i，1＝V，i∈[1，M]

V_i，j＝(V_i，1+(j-1)*V_x) mod V, if V_i，jWhen the value is 0, then V_i，j＝V，j∈[1，N]

Wherein V is the total number of view points, V_i，jIs the view point, V, to which the sub-pixel of the ith row and the jth column belongs_firstIs the viewpoint to which the sub-pixel of the 1 st row and the 1 st column belongs, M is the row number of the sub-pixel, N is the column number of the sub-pixel, V_xNumber of views, V, contained for a single sub-pixel in a first direction_yIs the number of views a single sub-pixel contains in the second direction.

7. The method according to any of claims 1 to 5, wherein said determining a gray level value of said sub-pixel from the image of the viewpoint to which said sub-pixel belongs comprises:

and determining the position of the sub-pixel, and taking the gray-scale value of the corresponding position in the image of the viewpoint to which the sub-pixel belongs as the gray-scale value of the sub-pixel.

8. The method according to any one of claims 1 to 5, wherein after determining the viewpoint to which the sub-pixel belongs based on the number of viewpoints contained in a single sub-pixel in the first direction and the number of viewpoints contained in a single sub-pixel in the second direction, before determining the gray level value of the sub-pixel based on the image of the viewpoint to which the sub-pixel belongs, the method further comprises:

and replacing the viewpoints of part of the sub-pixels, and replacing the viewpoints with the same viewpoint when the viewpoints of different sub-pixels are the same, so that the ratio of the first parallax of the left-eye viewpoint and the right-eye viewpoint after replacement to the second parallax of the viewpoint of the adjacent sub-pixel in the first direction meets the preset condition when the viewpoints of the left-eye viewpoint and the right-eye viewpoint are not replaced.

9. The multi-viewpoint image generation method according to claim 8,

the meeting of the preset conditions comprises: the ratio of the first disparity to the second disparity is at [ -1, 1 ].

10. The method according to claim 8, wherein said replacing the viewpoints to which the partial sub-pixels belong comprises:

the viewpoints comprise viewpoints 1 to V which are sequentially distributed along a first direction, when a viewpoint K to which the sub-pixels belong is located in a range from a viewpoint K to the viewpoint V, the viewpoint K is replaced by a viewpoint S-K, the viewpoint S-K is smaller than or equal to V and larger than or equal to 1, and the viewpoint K is a preset value.

11. A computer-readable storage medium storing computer-executable instructions for performing the multi-view image generation method of any one of claims 1-10.

12. A display device comprising a processor and a memory storing a computer program operable on the processor, wherein the processor when executing the program performs the steps of the multi-view image generation method according to any of claims 1 to 10.

Images