RU78958U1 - VOLUME IMAGE RECEIVING AND RECOVERY SYSTEM - Google Patents

Abstract

1. The system for obtaining and restoring a three-dimensional image contains a flat screen that is made in the form of a dual matrix, the external matrix of which is made of controlled cells that have the property of alternately transmitting light from the subject, and the inner matrix is made of photosensitive cells that directly display the subject, each cell of the external matrix is a microscopic lens or a small diameter hole controlled on the basis of a liquid crystal or other structure; yuschee camera obscura effect; the system is configured to form a shooting camera in the form of a portion of an external matrix, the central cell of which is open for transmitting light, and a frame of the internal matrix, consisting of a rectangular array of pixels capturing the image; moreover, there are n cameras in the system, the number of which is determined by the formula, where d is the camera size, w is the screen width and h is the screen height. 2. The system for obtaining and restoring a three-dimensional image according to claim 1, characterized in that each cell of the internal matrix is a photosensitive element corresponding to one pixel of the image.

Description

The utility model relates to a means of obtaining and reproducing a three-dimensional image and can be used to obtain three-dimensional photographs, for the implementation of three-dimensional television, in video phones, in computer games, in outdoor advertising, for window dressing, etc.

State of the art

A known method of obtaining photographs realizing the effect of a volumetric image using a set of small cylindrical lenses. The fingerprint glued to it is a picture of the stripes, each strip is deflected by the microlens at a certain angle so that slightly different pictures fall into the left and right eyes, and we see either a three-dimensional image or changing with the angle of rotation of the varioframe. An optical analogue of a lens raster is a trellis raster, consisting of alternating transparent and opaque stripes. Likewise, small holes - pinhole cameras - are analogous to a lens (PHOTO Siberian Success magazine, 2003, Novosibirsk, article “History of raster stereo and vario-images”).

Gabriel Lippmann has the idea of obtaining volumetric photographs using a plate consisting of a set of small spherical lenses (integral photograph). A similar method as applied to volumetric cinematography and television was mentioned in patent No. 2098855 (12/10/1997), author Golenko G.G. (according to data dated April 29, 2008, it has expired). The image source in this patent is made in the form of a single two-dimensional object, and the lenses of the optical lens raster are made in a sagittal section with a variable radius of curvature that varies according to the law of a stochastically oscillating or periodic function.

The disadvantage of this method when receiving a television three-dimensional image is a decrease in the resolution of the image, since each microlens corresponds to a set of pixels, that is, the resolution

image corresponds to the number of microlenses in the raster, the number of which is several times less than the number of pixels in the transmitted image. There are also known methods of creating a three-dimensional image using a stereoscopic system, the separation of angles for the left and right eyes of the viewer is carried out using polaroid glasses (patents No. 2006123344, No. 2096926, No. 2113771, No. 2202860). In some cases, a modification of television signals when broadcasting volumetric images in the form of stereo images (patent No. 2211545).

The disadvantage of this method is the use by viewers of additional equipment - polaroid glasses, to separate images for different eyes. Known methods for the formation and restoration of three-dimensional images by measuring the coordinates of captured objects, determining the position of the eyes of the viewer, calculating the required parallax for each viewer (patent No. 2097940). Such a technology is too complicated for implementation and mass use, both in television and in cinema. The most promising use is advisable in computer games, simulators. Also published methods of obtaining and restoring volumetric images using light-emitting elements moving along a cyclic path in space (by rotation) and creating a realistic volumetric image (patent No. 2173893).

This method is also quite difficult to implement when creating surround television or cinema and is most applicable when creating images of certain objects for advertising purposes.

The technical result is that the system excludes the use of spectators of polaroid glasses, does not require calculation of the position of the eyes of the audience, does not provide moving parts. An increase in the resolution of a conventional television or computer image is also provided. The system allows you to play back a screen system that simultaneously captures the plot and reproduces a three-dimensional image.

Brief Description of the Drawings

Figure 1 shows the device of the internal matrix; arrows schematically shown

bypass direction, where 1 is the cell of the inner matrix, 2 is the inner matrix, 3 is the outer matrix, 4 is the central open cell of the outer matrix, 5 is the frame of the inner matrix, 6 is an array of pixels capturing the image, 7 is the closed cell of the outer matrix.

Figure 2 shows the portion of the external matrix, the central cell of which is "open" for transmitting light, and the frame of the internal matrix, consisting of a rectangular array of pixels capturing the image. The arrows in the drawing show the bypass direction when converting the image to digital.

Figure 3 presents in section the process of obtaining a three-dimensional image (left) and the recovery process of this image.

Figure 4 shows the principle of the pixel bypass of the internal matrix, which is the opposite of the bypass direction in figure 2.

Fig. 5 is a diagram for explaining a process of capturing objects and reproducing a three-dimensional image.

Figure 6 shows a diagram of a system device that explains the structure of a dual matrix and the processes of converting an image into a digital form and vice versa.

7 is a diagram illustrating the "bypass" of the controlled elements of the external matrix and the formation of a multi-angle image on the internal matrix.

On Fig shows a schematic image of the scan of the internal matrix during the formation of the video signal, where 8 is the start of scanning.

Utility Model Implementation

The claimed technical result is achieved due to the fact that the system for obtaining and restoring a three-dimensional image contains a flat screen that is made in the form of a dual matrix, the external matrix of which is made of controlled cells with the property of alternately transmitting light from the subject, and the internal matrix is made of photosensitive cells directly displaying the subject, and each cell of the external matrix is controllable based on a liquid crystal or other structure a microscopic lens or a small diameter hole that realizes the effect of a pinhole camera; the system is configured to form a shooting camera in the form of a portion of an external matrix, the central cell of which is open for transmitting light, and a frame of the internal matrix, consisting of a rectangular array of pixels fixing

picture; and in the system there are n cameras, the number of which is determined by the formula: where d _i is the size of the camera, w is the width of the screen and h is the height of the screen.

Each cell of the internal matrix may be a photosensitive element corresponding to one pixel of the image.

The advantage of the system is that for its implementation it is enough to only modify the devices for shooting scenes - not video cameras or a set of video cameras, but a shooting device in the form of a screen. The television signal practically does not change, but an additional signal is introduced into it, which synchronizes the beginning of the cycle traversing the angles of the multi-angle system. When creating a television signal, some image processing is required, but when introducing a special addressing of the pixels of the internal matrix, the reading order will provide the necessary preliminary signal processing. On the playback screen, it is possible to switch the image from surround to the currently existing flat image. Computer processing of the volumetric image is possible to create the effect of image output in front of the screen.

The proposed system can also be used to increase the resolution of a conventional television or computer image due to the fact that the number of elements of the external matrix exceeds the number of elements of the internal matrix.

Creating a screen that simultaneously captures the plot and reproduces a three-dimensional image is capable of realizing an ideal video phone system, video conferencing, etc.

The system provides maximum realism of the resulting images. The system is based on the principle that when displaying a three-dimensional object, each point on the screen should carry information about the entire object. Thus, the effect of image volume is created by recording, processing and transmitting redundant information.

Typically, the excess of information is limited to creating a stereo image, viewed using special rasters or using special glasses.

In this system, such a restriction is removed due to the distribution of redundant information in space and time, and to view the restored image

no additional fixtures and devices are required, and there is no need for an interactive process with determining the position of the viewer. To convert a three-dimensional image into digital form, a flat “multi-angle screen” in the form of a double matrix is used: the external matrix consists of controlled cells that alternately transmit light from the subject, and the inner or inner matrix consists of photosensitive cells that directly display the subject. The dimensions of the "multi-angle screen" correspond to the size of the display on which the image will be restored. Each cell of the external matrix is a microscopic lens controlled on the basis of a liquid crystal or other structure or, in the simplest case, simply a small diameter hole that realizes the effect of a pinhole camera. In this case, the cells of the external matrix are controlled by alternate “opening” for the passage of light. Each cell (1) of the internal matrix (2) is a photosensitive element corresponding to one pixel of the image (see Figure 1). Moreover, the small relative cell size of the external matrix provides image sharpness.

In a dual matrix, it is possible to conditionally distinguish elements that at one moment in time form a complete image of an object - these are a kind of miniature cameras. One such mini-camera corresponds to: a section of the external matrix (3), the central cell (4) of which is “open” for transmitting light, and a frame of the internal matrix (5), consisting of a rectangular array (6) of pixels capturing the image (see Fig. .2). The arrows in the drawing show the bypass direction when converting the image to digital.

In order to achieve a high density of angles, they are distributed not only in space, but also in time, that is, two angles are located next to each other - adjacent "lenses", while the image of these neighboring angles is read at successive times.

That is, when scanning the image, the mini-camera shifts by only one cell of the external matrix (by one kind of “lens”) - in Fig. 1, the arrows show the bypass direction schematically. All mini-cameras bypass the rectangular area - the "bypass area of one mini-camera" corresponding to the image frame on the internal matrix - this area in Fig. 1 is shown by black lines on the surface of the external matrix.

The size of the mini-camera (d _i ) is determined by the frame size of the internal matrix. The angle at which the resulting image can be viewed depends on the frame size. The number of mini-cameras depends on the size of the "multi-angle screen" (w - width and h - height) and is equal to: .

Thus, at one moment of exposure, n elementary frames are converted into a digital form. At the next moment in time, all mini-cameras, as well as all camera angles, are “shifted” by one cell of the external matrix. The switching cycle of mini-cameras should be short enough to provide a flicker-free image of the object.

The image is restored from a digital view using the same dual matrix, the external matrix of which also consists of controlled cells that alternately transmit light from the internal matrix on which the image is reproduced. Switching the cells of the external matrix is carried out according to the same algorithm as when shooting an object, that is, information about open cells of the external matrix is not transmitted.

The internal matrix is scanned upon receipt of the image and during its reproduction also according to the standard algorithm.

A distinctive feature of the scanning process of the internal matrix during image reproduction is that the direction of the crawl of each elementary frame is back to the direction of its crawl when receiving the image, that is, each elementary section of the matrix corresponding to one shooting angle is reflected both on the vertical axis and the horizontal axis. Figure 3 shows that the viewer's eyes see one point of the subject at different times, since the elements of the external matrix and, therefore, the elementary frames are switched sequentially with a frequency that provides a continuous image.

The elementary frames during playback are scanned in the opposite direction. If one frame obtained from one angle consists of n * m pixels, where n is the number of columns and m is the number of lines in the frame, then the frame will be traversed according to the shooting coordinates i and j during image playback according to the algorithm: “frame line number "= Ni, and the number of the" column "= mj. Figure 4 shows the scanning direction of one frame of the internal matrix during image restoration.

In Fig. 4, the arrows show the direction of the pixel bypass of the inner matrix, which is the opposite of the bypass direction of Figure 2.

The proposed system also makes it possible to digitally process images in order to obtain various volumetric effects.

Fig. 5 is a diagram for explaining a process of capturing objects and reproducing a three-dimensional image.

Here on the left is a "multi-angle" screen that converts the image of three-dimensional objects into a digital sequence. On the right is a screen that reproduces the captured volumetric image. Obviously, the difference between the shooting equipment and the existing cameras.

The conversion of a three-dimensional image into a digital form and restoration of an image from a digital sequence transmitted over communication channels or read from a recording device can be implemented based on the following actions. The basis for calculating the coordinates of the controlled elements of the external matrix and the read coordinates of the image of the internal matrix is the size of one view (d), that is, the size of the image obtained from one "open" element of the external matrix. The clarity of the volume image, the maximum angle at which the resulting image can be viewed, as well as the technical characteristics of communication channels and equipment with which the image is converted, depends on the basic size. For convenience, we call the rectangular region of the external matrix, which corresponds to the size of one view with an elementary frame, or just a frame.

The size of one view is most easily expressed in pixels of the internal matrix. Moreover, if the resolution of the internal matrix is different from the resolution of the external matrix, then the coordinates of the controlled element of the external matrix will be calculated using a coefficient numerically equal to the ratio of the number of elements located on one side of the elementary frame, s to the base size d (in pixels of the internal matrix ) In this case, the geometric size of the side of the frame corresponds to the geometric size of one angle. If both the internal matrix and the elementary frame of the external matrix have the same number of pixels per unit area, that is, s = d, then one element of the external matrix is associated with one pixel of the internal matrix.

We denote the coordinates of the active element of the external matrix within the elementary

frame, as x is the column number and y is the row number. It is obvious that both coordinates, x and y, vary from 1 (upper left frame element) to s (the number of elements of the external matrix on the side of the frame). The number of elementary square-shaped frames on the external matrix, width w and height h, expressed in pixels, is q = w * h / s ² .

We also denote the coordinates of each pixel of the internal matrix within the entire screen, as i is the column number and j is the row number. They vary from 1 to, respectively, w + d and h + d.

6 is a diagram for explaining the structure of a dual matrix and processes for converting an image into a digital form and vice versa.

Here d is the basic size of one angle, on the basis of which the digital information reading algorithm is formed, and s is the number of elements of the external matrix located on the side of the square, the area of which is geometrically equal to the size of one angle d.

In Fig. 6, in the upper left elementary frame of the external matrix (3), the arrows show the direction of the frame bypass, in which the controlled cells are sequentially opened to transmit light. The same path is used to bypass the cells of each elementary frame (6) of the internal matrix (2) of the screen. All controllable elements of all elementary frames (6) are connected in parallel, which simplifies the procedure for scanning the entire screen. With the width of the external matrix (3) in w pixels, w / s elements are horizontally open at the same time, that is, each element that is s elements apart from the previous open element (5) is open.

For clarity, Fig. 7 shows four successive states of the screen (out of s ² similar states) in which shifted angles are recorded on the internal matrix (2). Each of the depicted states corresponds to one frame of a television image, and to ensure the continuity of the image, it is necessary to ensure the frequency of such frames at least 25 frames per second.

The internal matrix can be scanned in a standard way, forming a video signal that is recorded or transmitted for playback. To ensure synchronization, the video signal may contain control pulses necessary to control the external matrix.

A similar algorithm is implemented on the external matrix (3) of the screen on which the captured volumetric image is reproduced. However, the video signal received after

scanning of the internal matrix should be modified in such a way as to obtain a mirror image of one angle. For these purposes, you can get a mirror image of each angle when taking an image from the internal matrix, or when playing an image. However, it seems more convenient to perform such a conversion at the time of shooting, so the video signal will be fully ready for playback of the final display. So, when converting the image, the external matrix is scanned as shown above, and the video signal is read from the internal matrix as follows:

- counter n varies within one frame from 1 to w * h;

- the starting point from where the scan i ₀ = s, j ₀ = s starts, when forming the subsequent multi-angle images, the initial coordinates are calculated as i ₀ = s + x and j ₀ = s + y (here x and y are the coordinates of the current active element external matrix, vary from 1 to s);

- when the counter is increased to s ^{2, the} coordinates i and j decrease from i ₀ and j ₀ to 1;

- after this, the current coordinate is, respectively, i = k * s + x and j = k * s + y, where k corresponds to the number of the next angle and varies from 1 to q (see above).

Schematically, this algorithm is shown in Fig. 8.

When reproducing the image, scanning of the internal matrix is carried out in a standard way, that is, the current coordinate of the pixel i and j to which the information is transmitted, changes sequentially from x and y to w and h, respectively. In the hardware structure, therefore, there must be a computing unit that calculates the current coordinates of the active elements of both matrices.

Claims (2)

1. The system for obtaining and restoring a three-dimensional image contains a flat screen that is made in the form of a dual matrix, the external matrix of which is made of controlled cells with the property of alternately transmitting light from the subject, and the inner matrix is made of photosensitive cells that directly display the subject, each cell of the external matrix is a microscopic lens or a small diameter hole controlled on the basis of a liquid crystal or other structure; yuschee camera obscura effect; the system is configured to form a shooting camera in the form of a portion of an external matrix, the central cell of which is open for transmitting light, and a frame of the internal matrix, consisting of a rectangular array of pixels capturing the image; moreover, the system contains n cameras, the number of which is determined by the formula

where d _i is the size of the camera, w is the width of the screen and h is the height of the screen. 2. The system for obtaining and restoring a three-dimensional image according to claim 1, characterized in that each cell of the internal matrix is a photosensitive element corresponding to one pixel of the image.