WO2025205220A1 - Display system and information processing method - Google Patents

Abstract

The present technology relates to a display system and an information processing method that make it possible to suppress an uneven appearance of a video due to viewing angle characteristics of an LED. A display system according to the present technology comprises: a division display unit that constitutes one display unit by being arranged in a tile shape; an acquisition unit that acquires viewing position information indicating a viewing position of a display video displayed on the display unit; and a luminance control unit that controls the luminance of the division display unit on the basis of the viewing position information. The present technology can be applied to, for example, an imaging system used in virtual production.

Description

Display system and information processing method

This technology relates to a display system and information processing method, and in particular to a display system and information processing method that can prevent uneven image appearance caused by the viewing angle characteristics of LEDs.

In recent years, the market for large, direct-view, tiling-type displays that use LEDs (Light Emitting Diodes) has been expanding. For example, virtual production, in which a background such as a landscape is recreated on a content production site by displaying it on a large LED display, and then the background and subject are photographed with a camera, is growing rapidly.

Patent document 1 describes a display system that adjusts brightness to avoid color shifts on large LED displays, and adjusts brightness to display images with uniformity across the entire large LED display.

International Publication No. 2023/203985

In LED displays, the viewing angle characteristics of each RGB LED are different, so depending on the viewing angle of the LED display, the brightness and color of some areas of the image displayed on the LED display may appear different from other areas.

This technology was developed in light of these circumstances, and makes it possible to prevent uneven image appearance caused by the viewing angle characteristics of LEDs.

The display system according to a first aspect of the present technology comprises a split display unit that is arranged in a tiled pattern to form a single display unit, an acquisition unit that acquires viewing position information indicating the viewing position of the display image displayed on the display unit, and a brightness control unit that controls the brightness of the split display unit based on the viewing position information.

An information processing method according to a second aspect of the present technology includes a display system having split display sections that are arranged in a tiled pattern to form a single display section, acquiring viewing position information indicating the viewing position of a display image displayed on the display section, and controlling the brightness of the split display sections based on the viewing position information.

In the first and second aspects of the present technology, a display system including split display sections that are arranged in a tiled pattern to form a single display section acquires viewing position information indicating the viewing position of the display image displayed on the display section, and controls the brightness of the split display section based on the viewing position information.

FIG. 1 is a diagram illustrating an overview of an imaging system to which the present technology is applied. FIG. 1 is a diagram showing an example of a captured image taken by a camera. FIG. 1 is a diagram illustrating an example of the configuration of an imaging system. FIG. 1 is a diagram showing an example of the viewing angle characteristics of an LED of a display. FIG. 1 is a first diagram illustrating color shift caused by the viewing angle characteristics of an LED. FIG. 10 is a second diagram illustrating color shift caused by the viewing angle characteristics of an LED. FIG. 1 is a first diagram illustrating the correction of split images performed by a display cabinet. FIG. 10 is a diagram illustrating a case where the camera is moved. FIG. 10 is a third diagram illustrating color shift caused by the viewing angle characteristics of an LED. FIG. 4 is a fourth diagram illustrating color shift caused by the viewing angle characteristics of an LED. FIG. 2 is a second diagram illustrating the correction of split images performed by the display cabinet. FIG. 10 is a third diagram illustrating the correction of split images performed by the display cabinet. FIG. 1 is a block diagram illustrating an example of the configuration of an imaging system. 10A and 10B are diagrams illustrating panel position information, viewing position information, and viewing angles. FIG. 10 is a diagram illustrating an example of an LUT. 10 is a flowchart illustrating processing performed by the imaging system 1.

Hereinafter, embodiments of the present technology will be described in the following order.
1. Overview of the imaging system 2. Configuration and operation of the imaging system

<1. Overview of the imaging system>
FIG. 1 is a diagram illustrating an overview of an imaging system 1 to which the present technology is applied.

The filming system 1 in Figure 1 is a system used, for example, for filming using virtual production (in-camera VFX). Filming system 1 is used to film, for example, movies or dramas. Filming system 1 is made up of a camera 11, a video storage device (not shown) that stores the footage filmed by camera 11, a wall-mounted display 12, and a display controller (not shown) that controls display 12.

Display 12 is, for example, an LED display, and is placed in a real space such as a studio. Display 12 displays, for example, an image of a three-dimensional space created using CG (Computer Graphics) as the displayed image. Photographer P1 uses camera 11 to photograph the subject, motorbike M1, with the CG image displayed on display 12 as the background.

Figure 2 shows an example of footage captured by camera 11.

As shown in Figure 2, the image captured by the camera 11 shows the motorcycle M1 as if it were present in the three-dimensional space shown in the CG image. In this way, by using the photography system 1, photographer P1 can capture in a studio footage in which the space shown in the CG image appears to be spreading out in the background of the motorcycle M1.

Figure 3 shows an example configuration of the imaging system 1.

As shown in Figure 3, the imaging system 1 (display system) is composed of a camera 11, a display 12, a video server 61, a PC (personal computer) 62, and a display controller 63.

In response to a command from photographer P1 to start shooting, camera 11 captures a subject with the image displayed on display 12 as the background.

The display 12 (display unit) is a large LED display configured with n (n is a positive integer) display cabinets (display units) 41-1 to 41-n arranged in a tiled pattern. In the example of Figure 3, the display 12 is configured with 6 x 24 display cabinets. Note that, hereinafter, when there is no need to distinguish between the individual display cabinets 41-1 to 41-n, they will simply be referred to as display cabinets 41.

The display cabinet 41 is configured with m (m is a positive integer) LED arrays 51-1 to 51-m arranged in a tiled pattern, with LEDs (not shown) corresponding to each pixel arranged in a matrix (two-dimensional array). In the example of Figure 3, the display cabinet 41 is configured with 4 x 3 LED arrays. Note that below, when there is no need to distinguish between the LED arrays 51-1 to 51-m, they will simply be referred to as LED arrays 51. The group of LED arrays 51 that make up one display cabinet 41 are arranged in a tiled pattern and function as a divided display section that makes up one display 12.

Each display cabinet 41 of the display 12 is connected to the display controller 63 via a cable such as a LAN (Local Area Network) cable. Based on the video data supplied from the display controller 63, the display 12 displays the display image indicated by that video data. The video data supplied to each display cabinet 41 is video data of divided images in which the display image is divided to correspond to the position on the display 12 of that display cabinet 41. Each display cabinet 41 displays the divided image indicated by that video data, and the entire display image is displayed on the display 12.

The display cabinets 41 of the display 12 may be daisy-chained. In this case, the display cabinets 41 are connected to each other by a cable such as a LAN cable. When video data is supplied from the display controller 63 to the display chain of daisy-chained display cabinets 41, each display cabinet 41 displays an image based on the video data that corresponds to it from the supplied video data. Note that a daisy-chain connection is also referred to as a cascade connection.

Among the display cabinets 41 connected in a daisy chain, the (first) display cabinet 41 directly connected to the display controller 63 receives video data supplied from the display controller 63 and supplies the video data to subsequent display cabinets 41 connected in the daisy chain. Subsequent display cabinets 41 connected in the daisy chain acquire video data from the previous display cabinet 41 and supply the video data to further subsequent display cabinets 41 connected in the daisy chain.

The video server 61 is composed of, for example, a server computer. The video server 61 stores video data such as video content, and generates video data by rendering three-dimensional spaces created using CG. The video server 61 supplies the video data to the display controller 63.

Instead of the video server 61, video data may be provided to the display controller 63 from a recording medium such as an HDD (Hard Disk Drive) or BD (Blu-ray Disc) (registered trademark).

The PC 62 is a general-purpose computer. The PC 62 generates control commands for controlling the display controller 63 and sends them to the display controller 63, thereby controlling the display controller 63.

The display controller 63 divides the video data supplied from the video server 61 into n parts according to the position of the display cabinet 41 and transmits them to each display cabinet 41. The display controller 63 also transmits information based on control commands supplied from the PC 62 to each display cabinet 41.

The display controller 63 may be connected to the display cabinets 41 in a daisy chain. The display controller 63 transmits information based on video data supplied from the video server 61 and control commands supplied from the PC 62 to the display cabinet 41 at the head of the display chain that includes the corresponding display cabinet 41. In addition, multiple display chains may be connected to the display controller 63.

The display controller 63 and the display 12 may be integrated into one unit, or may form a single display device. The PC 62, display controller 63, and display 12 may be integrated into one unit, or may form a single display device.

Figure 4 is a diagram showing an example of the viewing angle characteristics of the LEDs of the display 12. In Figure 4, the horizontal axis represents the angle (viewing angle) of the camera 11 relative to each LED (each pixel) of the display 12, and the vertical axis represents the brightness of each LED as seen by the camera 11.

In the example of Figure 4, the viewing angle characteristics of the red LED are shown by a solid line, the viewing angle characteristics of the blue LED are shown by a dashed line, and the viewing angle characteristics of the green LED are shown by a dotted line.

As shown in Figure 4, the viewing angle characteristics of each RGB LED on the display 12 are different, so the brightness and color of some areas of the displayed image may appear different from other areas depending on the viewing angle of the camera 11 relative to the display 12.

For example, as shown in Figure 5A, when camera 11 faces the center of display 12, the viewing angle of camera 11 with respect to the pixel at the center of display 12 is 0 degrees. The viewing angle of camera 11 with respect to the pixel on the left edge as seen from camera 11 is -60 degrees, and the viewing angle of camera 11 with respect to the pixel on the right edge is 60 degrees.

In this case, due to the different viewing angle characteristics of the RGB LEDs, the colors in the center and periphery of the display 12 appear different when viewed from the camera 11, as shown in Figure 5B.

Furthermore, for example, as shown in Figure 6, if a semi-cylindrical display 12A is installed in a studio and a display 12B is installed on the ceiling of the studio, the viewing angle of the camera 11 relative to each pixel of display 12B will be particularly large, resulting in significant color shifts on display 12B.

In this technology, the imaging system 1 controls the brightness of the LED array 51 in each display cabinet 41 based on the viewing angle characteristics of the LEDs, thereby making it possible to align the color and brightness of the entire displayed image as viewed by the camera 11. The brightness of the LED array 51 is controlled, for example, by performing correction on the divided images based on the viewing angle characteristics of the LEDs.

Figure 7 is a diagram illustrating the correction of split images performed by the display cabinet 41.

As shown in the upper left part of Figure 7, in the imaging system 1, the angle at which light incident on the camera 11 is emitted from the LEDs at each corner (four corners) of the display cabinet 41 (viewing angle) is calculated in real time based on viewing position information indicating the viewing position of the camera 11.

Furthermore, as shown in the upper right part of Figure 7, the imaging system 1 pre-stores viewing angle data D1R indicating the correspondence between the viewing angle of the camera 11 for the red LED and the correction value, viewing angle data D1G indicating the correspondence between the viewing angle of the camera 11 for the green LED and the correction value, and viewing angle data D1B indicating the correspondence between the viewing angle of the camera 11 for the blue LED and the correction value.

The display cabinet 41 calculates the gain for each pixel of the display cabinet 41 as a correction value, as shown in the middle of Figure 7, based on the viewing angle information indicating the viewing angle of the camera 11 for each corner pixel and the viewing angle data D1R, D1G, and D1B.

Specifically, first, the display cabinet 41 calculates the gain for each corner pixel (pixels Pi1, Pi2, Pi3, Pi4) as a reference gain based on the viewing angle information for each corner and the viewing angle data D1R, D1G, D1B. Next, the display cabinet 41 calculates the gain for pixels other than the corner pixels of the display cabinet 41 based on the reference gain. The display cabinet 41 calculates the gain for pixels other than the corner pixels of the display cabinet 41, for example, by performing linear interpolation using the reference gain. Linear interpolation allows for the acquisition of gain values that change smoothly between pixels.

In addition, a uniform gain value may be calculated for all pixels of the display cabinet 41.

The display cabinet 41 performs gain correction on the split images by multiplying the calculated gain for each pixel of the display cabinet 41 by the pixel values of the R channel, G channel, and B channel of each pixel of the displayed image. By displaying the corrected split images on the display cabinet 41, the camera 11 can capture displayed images with consistent overall brightness, color, and other aspects, as shown in the lower part of Figure 7.

Figure 8 is a diagram explaining the case where the camera 11 is moved.

As shown in A of Figure 8, when the camera 11 is moved from right to left toward the display 12 during the period from time t1 to time t2, the viewing angle of the camera 11 relative to the pixels at each corner of the display cabinet 41 is calculated at each of times t1 and t2.

At time t1, correction is made to the split image according to the viewing angle of camera 11 at time t1, and at time t2, correction is made to the split image according to the viewing angle of camera 11 at time t2, and so on. In this way, corrections are made to the split image in accordance with the movement of camera 11. As a result, as shown in B of Figure 8, even if camera 11 is moved during the period from time t1 to time t2, camera 11 can continue to capture display images with consistent overall brightness, color, and other aspects.

When shooting using virtual production with two cameras 11, viewing angle information indicating the viewing angles of each of the two cameras 11 can also be input to the display cabinet 41. In this case, split images corrected according to the viewing angle of one camera 11 and split images corrected according to the viewing angle of the other camera 11 are displayed alternately for each frame, allowing both cameras 11 to shoot display images that are consistent in terms of overall brightness, color, etc.

The display system of this technology can be applied not only to display devices used in virtual production, but also to display devices that viewers actually view. Even on the display 12 that viewers actually view, the viewing angle characteristics of each RGB LED are different, so the brightness and color of some areas of the displayed image may appear different from other areas depending on the viewer's viewing angle relative to the display 12.

For example, as shown in A of Figure 9, when viewer P11 faces the center of display 12, the viewing angle of viewer P11 to the pixel at the center of display 12 is 0 degrees. The viewing angle of viewer P11 to the pixel on the left edge as seen from viewer P11 is -60 degrees, and the viewing angle of viewer P11 to the pixel on the right edge is 60 degrees.

In this case, due to the different viewing angle characteristics of the RGB LEDs, the colors in the center and periphery of the display 12 appear different to viewer P11, as shown in Figure 9B.

Furthermore, for example, as shown in Figure 10, if the display 12 is installed at a position higher than the eye level of the viewer P11, the viewing angle of the viewer P11 with respect to each pixel of the display 12 will be large, resulting in significant color shift on the display 12.

As described above, the display 12 of the present technology allows each display cabinet 41 to control the brightness of the LED array 51 based on the viewing angle characteristics of the LEDs, thereby making it possible to align the brightness and color of the entire displayed image as seen by the viewer P11. The brightness of the LED array 51 is controlled, for example, by performing correction on the divided image based on the viewing angle characteristics of the LEDs.

Figures 11 and 12 are diagrams explaining the correction of split images performed by the display cabinet 41.

In the imaging system 1, the viewing position of viewer P11 is determined in advance, and viewing position information for viewer P11 is input. Next, as shown in the upper left parts of Figures 11 and 12, the angle at which light entering the eyes of viewer P11 is emitted from the LEDs at each corner (four corners) of the display cabinet 41 (viewing angle) is calculated based on the viewing position information for viewer P11.

As shown in the upper right part of Figure 12, the imaging system 1 pre-stores viewing angle data D11R indicating the correspondence between the viewing angle of viewer P11 for the red LED and the correction value, viewing angle data D11G indicating the correspondence between the viewing angle of viewer P11 for the green LED and the correction value, and viewing angle data D11B indicating the correspondence between the viewing angle of viewer P11 for the blue LED and the correction value.

The display cabinet 41 calculates the gain for each pixel of the display cabinet 41 as a correction value, as shown in the middle of Figure 12, based on the viewing angle information indicating the viewing angle of the viewer P11 for each corner pixel and the viewing angle data D11R, D11G, and D11B.

Specifically, first, the display cabinet 41 calculates the gain for each corner pixel (pixels Pi1, Pi2, Pi3, Pi4) as a reference gain based on the viewing angle information for each corner and the viewing angle data D11R, D11G, D11B. Next, the display cabinet 41 calculates the gain for pixels other than the corner pixels of the display cabinet 41, for example, by performing linear interpolation using the reference gain. Linear interpolation allows for the acquisition of gain values that change smoothly between pixels.

In addition, a uniform gain value may be calculated for all pixels of the display cabinet 41.

The display cabinet 41 performs gain correction on the split images by multiplying the calculated gain for each pixel of the display cabinet 41 by the pixel values of the R channel, G channel, and B channel of each pixel of the displayed image. By displaying the corrected split images on the display cabinet 41, viewer P11 can capture split images with consistent overall brightness, color, and other aspects, as shown in the lower left part of Figure 12.

As shown in the lower right part of Figure 12, if viewer P11 moves during the period from time t11 to time t12, and the distance between display 12 and viewer P11 does not change, some color shift will occur, but the brightness, color, and other aspects of the overall displayed image will remain uniform.

2. Configuration and operation of the imaging system
FIG. 13 is a block diagram showing an example of the configuration of the imaging system 1.

As shown in FIG. 13, the photography system 1 is composed of multiple display cabinets 41, a video server 61, a PC 62, a display controller 63, and a tracker 64.

The video server 61 transmits the video data to the display controller 63.

The producer of the film or drama operates the input unit (not shown) of the PC 62 to input installation information, which is information relating to the installation position of the display 12, into the PC 62. Based on the installation information, the PC 62 calculates the position of each corner of all display cabinets 41 that make up the display 12, and sends panel position information indicating the position of each corner of the display cabinet 41 to the display controller 63.

The display controller 63 divides the video data sent from the video server 61 into n parts according to the position of the display cabinet 41 and sends them to each display cabinet 41. The display controller 63 also sends to each display cabinet 41 panel position information sent from the PC 62 that indicates the position of each corner of the destination display cabinet 41. Furthermore, the display controller 63 sends to each display cabinet 41 the viewing position information of the camera 11 sent (input) from the tracker 64.

When display cabinets 41 are daisy-chained to the display controller 63, the display controller 63 supplies video data, panel position information, and viewing position information to the first display cabinet 41 in the display chain that includes the corresponding display cabinet 41.

The tracker 64 acquires viewing position information for the camera 11. For example, the tracker 64 is placed on the camera 11 and acquires the viewing position information for the camera 11 by tracking using a marker installed in the studio. The tracker 64 transmits the viewing position information for the camera 11 to the display controller 63.

In addition, if a camera tracking system including a tracker 64 is not provided, for example, a producer or cameraman of a movie or drama operates a PC 62 to input the viewing position of the camera 11, and the PC 62 transmits viewing position information based on the operation content to a display controller 63.
When the display system of the present technology is applied to a display device that a viewer actually views, for example, the viewer operates a controller connected to PC 62 to input the viewer's own viewing position, and PC 62 transmits viewing position information based on the operation content to the display controller.
It is also possible for an installer or the like who installs the display 12 to input into the PC 62, as the viewer's viewing position, a position where it is expected that the viewer will frequently view the displayed video.

The display cabinet 41 is composed of a control unit 101, a register 102, an LED driver 103, and an LED 104. In the display cabinet 41, a LUT (Look-Up Table) is stored as viewing angle data, which takes the viewing angle of the camera 11 and the viewer as input and outputs the gain used for gain correction.

The control unit 101 is composed of a CPU and other components. A viewing angle calculation unit 121, an arithmetic unit 122, and a correction unit 123 are realized by the CPU and other components executing a predetermined program. The control unit 101 functions as a brightness control unit that controls the brightness of the divided display units. The display 12, which is composed of multiple display cabinets 41, can also be said to be a display device equipped with multiple divided display units (groups of LED arrays 51) and multiple brightness control units corresponding to each of the multiple divided display units.

The viewing angle calculation unit 121 functions as an acquisition unit that receives and acquires viewing position information and panel position information transmitted from the display controller 63. Based on the viewing position information and panel position information, the viewing angle calculation unit 121 calculates the viewing angle for a specific pixel on the display cabinet 41 itself. For example, the viewing angle of the camera 11 for each corner pixel of the pixels that make up the display cabinet 41 is calculated.

When display cabinets 41 are connected in a daisy chain, the viewing angle calculation unit 121 of each display cabinet 41 other than the first in the display chain acquires video data, panel position information, and viewing position information from the previous display cabinet. The supply unit (not shown) of each display cabinet 41 then supplies the video data, panel position information, and viewing position information to the subsequent display cabinet.

Figure 14 is a diagram explaining panel position information, viewing position information, and viewing angle. In the example of Figure 14, the display 12 is explained as being composed of 4 x 4 display cabinets 41, and viewer P21 is viewing the displayed video.

In the panel position information and viewing position information, the pixel positions at each corner of the display cabinet 41 and the viewing position of viewer P21 are indicated by coordinates on a three-dimensional coordinate system with the center point Po1 of the bottom of the display 12 as the origin. For example, the position of pixel Pi11 in the upper left corner of display cabinet 41-1-1 in the first row is indicated by coordinates (Xp, Yp, Zp), and the viewing position of viewer P21 is indicated by coordinates (Xc, Yc, Zc). The x-axis indicates the horizontal direction as seen by viewer P21, the y-axis indicates the depth direction, and the z-axis indicates the height direction.

Display cabinet 41-1-1 receives panel position information indicating the position of pixel Pi11 in the upper left corner, pixel Pi12 in the upper right corner, pixel Pi13 in the lower left corner, and pixel Pi14 in the lower right corner. Display cabinet 41-1 calculates the viewing angle of viewer P21 for each of pixels Pi11 to Pi14.

The viewing angle is expressed by the vertical viewing angle (zenith angle) θ and the horizontal viewing angle (azimuth angle) φ. For example, the vertical viewing angle θ for pixel Pi11 in the upper left corner of display cabinet 41-1-1 in the first row and first tier (the pixel viewer P21 looks up at) is shown as a negative value, and the vertical viewing angle θ for pixel Pi31 in the lower left corner of display cabinet 41-1-4 in the fourth row and first tier (the pixel viewer P21 looks down at) is shown as a positive value. Also, for example, the horizontal viewing angle φ for pixel Pi11 in the upper left corner of display cabinet 41-1-1 in the first row and first tier (the pixel on the left side as seen by viewer P21) is shown as a positive value, and the horizontal viewing angle φ for pixel Pi21 in the upper right corner of display cabinet 41-4-1 in the first row and fourth tier (the pixel on the right side as seen by viewer P21) is shown as a negative value.

Returning to Figure 13, the viewing angle calculation unit 121 obtains a gain for each corner pixel based on the viewing angle for that pixel. Specifically, the viewing angle calculation unit 121 refers to the stored LUT and converts the viewing angle for that pixel into a gain for that pixel.

Figure 15 shows an example of an LUT.

The top row of Figure 15 shows the LUT for the red LED (R channel), the middle row shows the LUT for the green LED (G channel), and the bottom row shows the LUT for the blue LED (B channel). Each LUT is registered with a corresponding combination of horizontal viewing angle (-60°, -40°, -20°, 0°, 20°, 40°, 60°) and vertical viewing angle (-60°, -40°, -20°, 0°, 20°, 40°, 60°) and gain.

The viewing angle calculation unit 121 supplies the gain for each corner pixel to the register 102.

The calculation unit 122 obtains the gain for each corner pixel from the register 102 and calculates the gain for pixels other than the corner pixels, for example by performing linear interpolation. The calculation unit 122 supplies the gains for all pixels to the correction unit 123.

The correction unit 123 performs gain correction on the video data by multiplying the pixel values of the R channel, G channel, and B channel of each pixel in the video data transmitted from the display controller 63 by the gain for each pixel supplied from the calculation unit 122. Based on the corrected video data, the correction unit 123 generates light emission data indicating the light emission intensity of the LED 104 and supplies this to the LED driver 103.

Register 102 stores the gain for each corner pixel supplied from the viewing angle calculation unit 121.

The LED driver 103 controls the LED 104 based on the light emission data supplied from the correction unit 123, causing the LED 104 to emit light.

LED 104 is an LED arranged in each of the multiple LED arrays 51 that make up the display cabinet 41.

Next, the processing performed by the photography system 1 configured as described above will be explained with reference to the flowchart in Figure 16.

In step S1, the PC 62 calculates the pixel position of each corner of the display cabinet 41, and the display controller 63 transmits panel position information indicating the position of each corner of the destination display cabinet 41 to each display cabinet 41. Note that the processing of step S1 only needs to be performed once before the display of the display image on the display 12 begins.

In step S2, the display controller 63 acquires viewing position information from the tracker 64 or the like.

In step S3, the display controller 63 transmits the viewing position information to each display cabinet 41.

In step S4, the viewing angle calculation unit 121 of the display cabinet 41 acquires the gain for each corner pixel. Specifically, the viewing angle calculation unit 121 calculates the viewing angle for each corner pixel of the display cabinet 41 itself based on the viewing position information and panel position information transmitted from the display controller 63. The viewing angle calculation unit 121 refers to the LUT stored in the display cabinet 41 and converts the viewing angle for each corner pixel into a gain for the corner pixel.

In step S5, the calculation unit 122 calculates the gain for all pixels based on the gain for the pixels at each corner.

In step S6, the correction unit 123 performs gain correction on the video data using the gains for all pixels calculated by the calculation unit 122.

In step S7, the display cabinet 41 displays the corrected split image. By displaying the split image on all display cabinets 41, the entire display image is displayed on the display 12.

As described above, in the imaging system 1 of the present technology, viewing position information indicating the viewing position of the displayed image is acquired by the viewing angle calculation unit 121, and the brightness of the divided display unit (the group of LED arrays 51 that make up the display cabinet 41), which is arranged in a tiled pattern to form a single display unit, is controlled by the control unit 101 based on the viewing position information.

This makes it possible to prevent uneven image appearance due to the viewing angle characteristics of the LED, such as the brightness or color of some areas of the image displayed on the display 12 appearing differently from other areas.

The above-described series of processes can be executed by either hardware or software. When executing the series of processes by software, the programs that make up the software are installed on a computer that is built into dedicated hardware, or on a general-purpose personal computer.

The program to be installed is provided by being recorded on removable media such as an optical disc (CD-ROM (Compact Disc-Read Only Memory), DVD (Digital Versatile Disc), etc.) or semiconductor memory. It may also be provided via wired or wireless transmission media such as a local area network, the Internet, or digital broadcasting. The program can be pre-installed in ROM or memory.

The program executed by the computer may be a program in which processing is performed chronologically in the order described in this specification, or a program in which processing is performed in parallel or at the required timing, such as when called.

In this specification, a system refers to a collection of multiple components (devices, modules (parts), etc.), regardless of whether all of the components are contained in the same housing. Therefore, multiple devices housed in separate housings and connected via a network, and a single device with multiple modules housed in a single housing, are both systems.

The effects described in this specification are merely examples and are not limiting, and other effects may also occur.

The embodiments of this technology are not limited to the above-described embodiments, and various modifications are possible without departing from the spirit of this technology.

Furthermore, each step described in the above flowchart can be performed by a single device, or can be shared and executed by multiple devices.

Furthermore, if one step includes multiple processes, the multiple processes included in that one step can be executed by one device, or they can be shared and executed by multiple devices.

<Configuration combination example>
The present technology can also be configured as follows.

(1)
a split display unit that is arranged in a tiled pattern to form a single display unit;
A display system comprising: an acquisition unit that acquires viewing position information indicating a viewing position of a display image displayed on the display unit; and a brightness control unit that controls brightness of the split display unit based on the viewing position information.
(2)
The display system according to (1), wherein the brightness control unit controls the brightness by performing gain correction on split images obtained by dividing the display image and displayed on the split display unit.
(3)
the acquisition unit calculates a viewing angle for a predetermined pixel constituting the split display unit based on the viewing position information,
The display system according to (2), wherein the luminance control unit acquires a gain used for the gain correction based on the viewing angle.
(4)
The display system according to (3), wherein the luminance control unit calculates a gain used for the gain correction of pixels other than the predetermined pixel among the pixels constituting the divided display unit by linear interpolation using a gain for the predetermined pixel.
(5)
The display system according to (3), wherein the acquisition unit calculates the viewing angle with respect to a corner pixel among pixels constituting the divided display unit based on the viewing position information.
(6)
The display system described in (5), wherein the brightness control unit obtains a reference gain to be used for the gain correction of the corner pixel based on the viewing angle for the corner pixel, and calculates a gain to be used for the gain correction of pixels other than the corner pixel among the pixels constituting the divided display unit based on the reference gain.
(7)
The display system according to (6), wherein the luminance control unit calculates a gain used for the gain correction of pixels other than the corner pixels by linear interpolation using the reference gain.
(8)
The display system according to any one of (3) to (7), wherein the luminance control unit acquires the gain used for the gain correction by referring to an LUT that receives the viewing angle as an input and outputs a gain used for the gain correction.
(9)
The display system according to any one of (2) to (8), further comprising a display controller connected to a plurality of brightness control units corresponding to the plurality of split display units, and supplying the split images to the plurality of brightness control units, respectively.
(10)
The display system according to (9), wherein the acquisition unit acquires the viewing position information via the display controller.
(11)
The display system according to (10), wherein the acquisition unit acquires, as the viewing position information, information indicating a position of a camera that captures an image of a subject with the display unit as a background.
(12)
The display system according to (11), wherein the display controller supplies the viewing position information input from a tracker that tracks the camera to the acquisition unit.
(13)
The display system according to (10), wherein the acquisition unit acquires, as the viewing position information, information indicating a position of a viewer who actually views the display unit.
(14)
A plurality of the divided display sections;
The display system according to any one of (1) to (13), further comprising: a plurality of the brightness control units corresponding to the plurality of split display units, respectively.
(15)
The display system according to any one of (1) to (14), wherein the acquisition unit acquires the viewing position information from at least one other divided display unit that constitutes the display unit.
(16)
The display system according to any one of (1) to (15), further comprising a supply unit that supplies the viewing position information to at least one other divided display unit that constitutes the display unit.
(17)
The display system according to any one of (1) to (16), wherein the split display unit is daisy-chain connected to at least one other split display unit that constitutes the display unit.
(18)
A display system including divided display units arranged in a tiled pattern to form a single display unit,
acquiring viewing position information indicating a viewing position of a display image displayed on the display unit;
and controlling the brightness of the split display unit based on the viewing position information.
(19)
The information processing method according to (18), wherein the brightness is controlled by performing gain correction on split images obtained by dividing the display image and displayed on the split display unit.
(20)
calculating a viewing angle for a predetermined pixel constituting the split display unit based on the viewing position information;
The information processing method according to (19), further comprising: acquiring a gain used for the gain correction based on the viewing angle.

1. Filming system, 11. Camera, 12. Display, 41. Display cabinet, 51. LED array, 61. Video server, 62. PC, 63. Display controller, 64. Tracker, 101. Control unit, 102. Register, 103. LED driver, 104. LED, 121. Viewing angle calculation unit, 122. Calculation unit, 123. Correction unit

Claims (20)

a split display unit that is arranged in a tiled pattern to form a single display unit;
A display system comprising: an acquisition unit that acquires viewing position information indicating a viewing position of a display image displayed on the display unit; and a brightness control unit that controls brightness of the split display unit based on the viewing position information. The display system according to claim 1 , wherein the brightness control unit controls the brightness by performing gain correction on split images obtained by dividing the display image and displayed on the split display unit. the acquisition unit calculates a viewing angle for a predetermined pixel constituting the split display unit based on the viewing position information,
The display system according to claim 2 , wherein the luminance control unit acquires a gain used for the gain correction based on the viewing angle. The display system according to claim 3 , wherein the luminance control unit calculates a gain used for the gain correction of pixels other than the predetermined pixel among the pixels constituting the divided display unit by linear interpolation using a gain for the predetermined pixel. The display system according to claim 3 , wherein the acquisition unit calculates the viewing angle with respect to a corner pixel among pixels that configure the divided display unit based on the viewing position information. The display system according to claim 5, wherein the brightness control unit obtains a reference gain to be used for the gain correction of the corner pixel based on the viewing angle for the corner pixel, and calculates a gain to be used for the gain correction of pixels other than the corner pixel among the pixels constituting the divided display unit based on the reference gain. The display system according to claim 6 , wherein the luminance control unit calculates a gain used for the gain correction of pixels other than the corner pixels by linear interpolation using the reference gain. The display system according to claim 3 , wherein the luminance control unit acquires the gain used for the gain correction by referring to an LUT that receives the viewing angle as an input and outputs a gain used for the gain correction. The display system according to claim 2 , further comprising a display controller connected to a plurality of the brightness control units corresponding to the plurality of split display units, and supplying the split video to each of the plurality of brightness control units. The display system according to claim 9 , wherein the acquisition unit acquires the viewing position information via the display controller. The display system according to claim 10 , wherein the acquisition unit acquires, as the viewing position information, information indicating a position of a camera that captures an image of a subject with the display unit as a background. The display system according to claim 11 , wherein the display controller supplies the viewing position information input from a tracker that tracks the camera to the acquisition unit. The display system according to claim 10 , wherein the acquisition unit acquires, as the viewing position information, information indicating a position of a viewer who actually views the display unit. A plurality of the divided display units;
The display system according to claim 1 , further comprising: a plurality of the brightness control units corresponding to the plurality of split display units, respectively. The display system according to claim 1 , wherein the acquisition unit acquires the viewing position information from at least one other divided display unit that configures the display unit. The display system according to claim 1 , further comprising a supply unit that supplies the viewing position information to at least one other divided display unit that constitutes the display unit. The display system according to claim 1 , wherein the split display section is daisy-chain connected to at least one other split display section that constitutes the display section. A display system including divided display units arranged in a tiled pattern to form a single display unit,
acquiring viewing position information indicating a viewing position of a display image displayed on the display unit;
and controlling the brightness of the split display unit based on the viewing position information. The information processing method according to claim 18 , wherein the brightness is controlled by performing gain correction on split images obtained by dividing the display image and displayed on the split display unit. calculating a viewing angle for a predetermined pixel constituting the split display unit based on the viewing position information;
The information processing method according to claim 19 , further comprising: acquiring a gain used for the gain correction based on the viewing angle.