[go: up one dir, main page]

WO2025238848A1 - Système de commande d'affichage et procédé de commande d'affichage - Google Patents

Système de commande d'affichage et procédé de commande d'affichage

Info

Publication number
WO2025238848A1
WO2025238848A1 PCT/JP2024/018343 JP2024018343W WO2025238848A1 WO 2025238848 A1 WO2025238848 A1 WO 2025238848A1 JP 2024018343 W JP2024018343 W JP 2024018343W WO 2025238848 A1 WO2025238848 A1 WO 2025238848A1
Authority
WO
WIPO (PCT)
Prior art keywords
display
image
module
display control
priority
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
PCT/JP2024/018343
Other languages
English (en)
Japanese (ja)
Inventor
敦司 今野
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Sharp NEC Display Solutions Ltd
Original Assignee
Sharp NEC Display Solutions Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sharp NEC Display Solutions Ltd filed Critical Sharp NEC Display Solutions Ltd
Priority to PCT/JP2024/018343 priority Critical patent/WO2025238848A1/fr
Publication of WO2025238848A1 publication Critical patent/WO2025238848A1/fr
Pending legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • G—PHYSICS
    • G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
    • G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
    • G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators

Definitions

  • the present invention relates to a display control system and a display control method.
  • Such displays are called tiling displays or multi-displays, and are used as one way to create large screens or flexible screen configurations.
  • Patent Document 1 discloses technology in which an importance level is assigned to each display device that makes up a multi-display, and in the event that one display device malfunctions, the image displayed on a display device with a lower importance level is modified to prevent important information from being unable to be presented.
  • each display module is set in advance and cannot be changed. Since the images displayed on a tiling display usually change from moment to moment, it would be better to be able to set the importance of each display module according to the image being displayed on the tiling display.
  • the present invention aims to provide a display control system and display control method that can set the importance of each display module according to the image displayed on a tiling display.
  • One aspect of the present invention is a display control device that displays a display image on the display screen of a tiling display in which multiple display modules are arranged, and is a display control system that includes: a priority setting unit that sets the priority of each of the display modules that make up the display screen based on line-of-sight information of a viewer viewing the display image; and a display control unit that, in response to a failure of a display module that makes up part of the display screen, causes a complementary module that is a display module that complements the image that was displayed on the failed non-display module to display the image that was displayed on the failed non-display module, based on the priority.
  • Another aspect of the present invention is a display control method performed by a display control system, which is a computer that displays a display image on the display screen of a tiling display in which multiple display modules are arranged.
  • the display control method sets a priority for each of the display modules that make up the display screen based on line-of-sight information from a viewer viewing the display image, and, in response to a failure of a display module that makes up part of the display screen, causes the image that was being displayed on the failed display module to be displayed on another display module that is not malfunctioning, based on the priority.
  • each display module can be set according to the image displayed on the tiling display.
  • FIG. 1 is a block diagram illustrating a configuration of a display control system according to a first embodiment.
  • FIG. 1 is a diagram for explaining a display control system according to a first embodiment.
  • 4A and 4B are diagrams for explaining a process of setting a priority performed by the display control device in the first embodiment.
  • FIG. 2 is a diagram for explaining processing performed by a display control device in the first embodiment.
  • FIG. 2 is a diagram for explaining processing performed by a display control device in the first embodiment.
  • 10 is a flowchart showing the flow of a process for setting a priority performed by the display control device in the first embodiment.
  • 10 is a flowchart showing the flow of processing for complementing a non-displayed image performed by the display control device in the first embodiment.
  • FIG. 10 is a diagram for explaining a process performed by a display control device in a modified example of the first embodiment.
  • FIG. 10 is a block diagram illustrating the configuration of a display control system according to a second embodiment.
  • 10 is a flowchart showing the flow of a process for setting a priority performed by a display control device according to a second embodiment.
  • 10 is a flowchart showing the flow of processing for determining a character area performed by a display control device according to a second embodiment.
  • 1 is a diagram illustrating a basic configuration of a display control device according to an embodiment.
  • Figure 1 is a block diagram illustrating the configuration of a display control system in the first embodiment.
  • Figure 2 is a diagram illustrating the display control system in the first embodiment.
  • the display control system 1 includes a display control device 10, an imaging device 20, an imaging device 30, and a tiling display 40.
  • the display control device 10 is connected to each of the imaging device 20, the imaging device 30, and the tiling display 40 so as to be able to communicate with each other.
  • the imaging devices 20 and 30 are, for example, imaging devices formed by digital cameras.
  • the tiling display 40 is a display in which a plurality of display modules are arranged to form a single display screen.
  • the tiling display 40 is sometimes called a multi-display.
  • the display control device 10 is, for example, a computer such as a PC (personal computer), a server device, etc.
  • the display control device 10 controls the display screen to be displayed on the tiling display 40.
  • the tiling display 40 includes multiple display modules 400 (display modules 400-1 to 400-9).
  • the display modules 400 are arranged in tiles in the vertical and horizontal directions.
  • the tiling display 40 displays an image based on a video signal using the entire display area of the multiple display modules 400 arranged in this manner.
  • the display modules 400 are, for example, liquid crystal display devices or LED display devices.
  • arrangement information is set for each of the display modules 400 arranged in the tiling display 40.
  • the arrangement information is information that specifies the arrangement position.
  • the arrangement information is shown in the upper left corner of the rectangle representing the display module 400.
  • arrangement information (0, 0) is set for display module 400-1.
  • Array information (0, 1) is set for display module 400-2.
  • Array information (0, 2) is set for display module 400-3.
  • Array information (1, 0) is set for display module 400-4.
  • Array information (1, 1) is set for display module 400-5.
  • Array information (1, 2) is set for display module 400-6.
  • Array information (2, 0) is set for display module 400-7.
  • Array information (2, 1) is set for display module 400-8.
  • Array information (2, 2) is set for display module 400-9.
  • the display control device 10 acquires images captured by the imaging devices 20 and 30, and controls the display images to be displayed on the tiling display 40 based on the acquired images.
  • the captured images and the visually recognized images may be captured by the same imaging device (e.g., imaging device 20 or 30).
  • the display control device 10 includes a display control unit 11, a priority setting unit 12, a fault detection unit 13, and a line-of-sight information acquisition unit 14.
  • the fault detection unit 13 extracts the contour of the display image captured in the captured image by performing any image processing, such as object recognition, on the captured image.
  • the fault detection unit 13 divides the area surrounded by the extracted contour based on the arrangement of the display modules 400 that make up the tiling display 40, and calculates a representative pixel value (e.g., an average value of the pixel values of each pixel) of a group of pixels in each divided small area.
  • the fault detection unit 13 calculates the difference between the representative pixel value and a pixel value corresponding to a specific color (e.g., black) that indicates that the display module 400 is not displaying an image because it is not emitting light.
  • a specific color e.g., black
  • the fault detection unit 13 determines that no image is displayed in the small area corresponding to the representative pixel value. If no image is displayed in the small area, the fault detection unit 13 determines that the display module 400 arranged to display an image in that small area has malfunctioned, causing part of the display image to be hidden. The failure detection unit 13 determines whether or not the display module 400 has failed for each display module 400 and outputs the determination result to the display control unit 11 .
  • the gaze information acquisition unit 14 acquires gaze information based on the visual image captured by the imaging device 30.
  • the gaze information is information indicating the degree to which an image is viewed by the viewers U.
  • the gaze information acquisition unit 14 extracts, from the visual image, the number of viewers U viewing each image displayed by the display module 400. Any method can be used to determine whether the viewers U are viewing the image, and for example, a method can be used that makes the determination based on the positions of the viewers U's pupils in the visual image.
  • the gaze information acquisition unit 14 calculates the cumulative gaze time for each display module 400 periodically or each time a display image displayed on the tiling display 40 changes.
  • the cumulative gaze time is a value obtained by accumulating the gaze time for viewing the image portion displayed by the display module 400 out of the display image displayed by the tiling display 40.
  • Whether or not the display image displayed on the tiling display 40 has changed is determined based on whether or not the display image shown in the captured image captured by the imaging device 20 has changed.
  • the line-of-sight information acquisition unit 14 acquires the captured image captured by the imaging device 20 via the fault detection unit 13 and stores the acquired captured image.
  • the line-of-sight information acquisition unit 14 determines that the display image has changed if there is a difference between the pixel distribution of the display image area in the previously acquired captured image and the pixel distribution of the display image area in the currently acquired captured image.
  • the pixel distribution of the display image area can be determined using statistics of the pixels in the display image area, such as the average pixel value of each pixel in the display image area.
  • the gaze information acquisition unit 14 first extracts the viewer U viewing the display image displayed by the tiling display 40 from the viewing image captured by the imaging device 30. For example, the gaze information acquisition unit 14 extracts the viewer U captured in the viewing image by performing any image processing such as object recognition on the viewing image. The gaze information acquisition unit 14 detects the pupils of the extracted viewer U. The gaze information acquisition unit 14 detects the pupils of the viewer U by performing any image processing such as extracting feature points of the viewer U extracted from the viewing image.
  • the gaze information acquisition unit 14 detects the positions of a reference point (e.g., the inner corner of the eye) and a moving point (e.g., the iris) in the detected pupil of the viewer U, and calculates the gaze of the viewer U based on the relative positional relationship between the reference point and the moving point.
  • the gaze information acquisition unit 14 considers that the viewer U is viewing the display module 400 located at the end of the calculated gaze.
  • the gaze information acquisition unit 14 identifies the display module 400 that each viewer U is viewing.
  • the gaze information acquisition unit 14 calculates the cumulative gaze time as the value obtained by accumulating the viewing time of each viewer U for each display module 400.
  • the viewed image captured by the imaging device 30 may be a moving image (video) or a still image.
  • a moving image (video) is captured by the imaging device 30
  • the line-of-sight information acquisition unit 14 can calculate the viewing time of the viewer U based on the frame rate of the moving image.
  • a still image is captured by the imaging device 30, if the same viewer U is captured viewing the image displayed by the display module 400 in both an image captured at a certain imaging time and an image captured at the next imaging time, the viewing time of the viewer U can be calculated by assuming that the viewer U continued to view the image displayed by the display module 400 from one imaging time to the next imaging time.
  • the gaze information acquisition unit 14 outputs the cumulative gaze time as gaze information to the priority setting unit 12.
  • the priority setting unit 12 sets a priority for each of the display modules 400 that make up the tiling display 40. This priority is determined based on the image that each of the display modules 400 is displaying. In this embodiment, the priority setting unit 12 acquires gaze information from the gaze information acquisition unit 14, and sets a high priority to the display module 400 that displays an image that is highly recognized by the viewer U based on the acquired gaze information.
  • Figure 3 is a diagram for explaining the priority setting processing performed by the display control device in the first embodiment.
  • Figure 3 shows the cumulative gaze time for each display module.
  • the horizontal axis of Figure 3 represents the display module, and the vertical axis represents the cumulative gaze time.
  • the array number N of the display module 400 identified by the array information (0,0) is shown below the array information (0,0).
  • display module 400-1 with array information (0,0) has array number N (1).
  • Display module 400-2 with array information (0,1) has array number N (2).
  • Display module 400-3 with array information (0,2) has array number N (3).
  • Display module 400-4 with array information (1,0) has array number N (4).
  • Display module 400-5 with array information (1,1) has array number N (5).
  • Display module 400-6 with array information (1,2) has array number N (6).
  • Display module 400-7 with array information (2,0) has array number N (7).
  • Display module 400-8 for array information (2, 1) has array number N (8).
  • Display module 400-9 for array information (2, 2) has array number N (9).
  • This diagram shows that display module 400-5 with sequence number N(5) has the longest cumulative gaze time. This is followed by display module 400-6 with sequence number N(6), display module 400-4 with sequence number N(4), display module 400-2 with sequence number N(2), display module 400-3 with sequence number N(3), display module 400-1 with sequence number N(1), display module 400-8 with sequence number N(8), display module 400-9 with sequence number N(9), and display module 400-7 with sequence number N(7), in that order.
  • the priority setting unit 12 assigns the highest priority (1) to the display module 400-5 with the array number N(5), which has the longest cumulative gaze time.
  • the priority setting unit 12 assigns a priority (2) to the display module 400-6 with the array number N(6), a priority (3) to the display module 400-4 with the array number N(4), a priority (4) to the display module 400-2 with the array number N(2), a priority (5) to the display module 400-3 with the array number N(3), a priority (6) to the display module 400-1 with the array number N(1), a priority (7) to the display module 400-8 with the array number N(8), a priority (8) to the display module 400-9 with the array number N(9), and a priority (9) to the display module 400-7 with the array number N(7).
  • the priority setting unit 12 determines the priority according to the arrangement position. For example, the priority setting unit 12 assigns a higher priority to the display module 400 with a smaller array number N and a lower priority to the display module 400 with a larger array number N. For example, assume that priorities (1) to (7) are set, and the cumulative gaze times of the remaining two display modules 400, display module 400-8 with array number N(8) and display module 400-9 with array number N(9), are the same. In this case, the priority setting unit 12 sets priority (8) to display module 400-8 with array number N(8), and sets priority (9) to display module 400-9 with array number N(9).
  • the priority setting unit 12 resets and updates the priority based on the calculated cumulative gaze time each time the gaze information acquisition unit 14 calculates the cumulative gaze time.
  • the display control unit 11 controls the images to be displayed on each of the display modules 400.
  • the display control unit 11 acquires the determination result from the fault detection unit 13, and determines whether or not a hidden portion has occurred in the display image displayed on the tiling display 40 based on the acquired determination result. If a hidden portion has occurred, the display control unit 11 controls the images to be displayed on each of the display modules 400 so as to compensate for the hidden portion.
  • the display control unit 11 selects a display module 400 (complementary module) that will compensate for the display of the hidden image, depending on the position and priority of the faulty display module 400 (non-display module).
  • the display control unit 11 causes the complement module to alternately display a first image that was originally displayed by the complement module and a second image that was displayed by the hidden module before the failure.
  • the display control unit 11 sets the switching time for switching between the display of the first image and the second image according to the ratio of the accumulated gaze times of the hidden module and the complement module. For example, if the ratio of the accumulated gaze times of the complement module and the hidden module is "1:2", the display control unit 11 causes the complement module to display the first image and the second image at a time ratio of "1:2".
  • the display control device 10 selects all display modules 400 that have a lower priority than the hidden module as candidates for complementary modules, and then selects the display module 400 that is closest to the position where the hidden module is set as the complementary module among the candidate complementary modules.
  • the display control device 10 selects the display module 400 with the lowest priority among the multiple display modules 400 located closest to the position where the hidden module is set as the complementary module.
  • the display control device 10 designates the display module 400 with a priority set one level higher than the priority of the hidden module as the hidden module.
  • Figures 4 and 5 are diagrams for explaining the processing performed by the display control device in the first embodiment.
  • a priority of (6) is set for the display module 400-1.
  • a priority of (4) is set for the display module 400-2.
  • a priority of (5) is set for the display module 400-3.
  • a priority of (3) is set for the display module 400-4.
  • a priority of (1) is set for the display module 400-5.
  • a priority of (2) is set for the display module 400-6.
  • a priority of (9) is set for the display module 400-7.
  • a priority of (7) is set for the display module 400-8.
  • a priority of (8) is set for the display module 400-9.
  • the display module 400-6 which is set to priority (2), breaks down. 4 shows hidden modules and candidate complementary modules.
  • the display control unit 11 designates the faulty display module 400-6 as a hidden module, and extracts the display modules 400 set with priorities lower than the priority (2) set for the hidden module, i.e., priority (3) to priority (9), as candidate complementary modules.
  • the display module 400-4 set with priority (3), the display module 400-2 set with priority (4), the display module 400-3 set with priority (5), the display module 400-1 set with priority (6), the display module 400-8 set with priority (7), the display module 400-9 set with priority (8), and the display module 400-7 set with priority (9) are extracted as candidate complementary modules.
  • the display control unit 11 extracts display modules 400-3 and 400-9, which are display modules located closest to the hidden module, from the candidate complementary modules. Furthermore, the display control unit 11 sets the display module 400-9, which has the lowest priority among the extracted display modules 400-3 and 400-9, as the complementary module.
  • FIG. 6 is a flowchart showing the flow of the priority setting process performed by the display control device in the first embodiment.
  • the display control device 10 determines whether or not there is a faulty display module in the tiling display 40 (step S10).
  • the display control device 10 determines whether or not there is a faulty display module based on the determination result made by the fault detection unit 13 as to whether or not a display module 400 has failed. If there is a faulty display module 400, the display control device 10 executes the process indicated by symbol A (processing to complement a non-displayed image). The flow of the process to complement a non-displayed image will be described later.
  • the display control device 10 determines whether or not a viewer is viewing the display image (step S11). The display control device 10 determines whether or not a viewer is viewing the display image by performing image processing or the like on the viewing image (an image of the viewer U captured by the imaging device 30) acquired by the line-of-sight information acquisition unit 14. If it is determined in step S11 that there is no viewer viewing the display image, the process returns to step S10. If it is determined in step S11 that a viewer is present viewing the display image, the display control device 10 detects the viewer's line of sight (step S12). The display control device 10 identifies the display module 400 viewed by the viewer based on the detected line of sight of the viewer. For each display module 400, the display control device 10 accumulates the viewing time of each viewer viewing that display module 400, and calculates the accumulated viewing time (step S13).
  • the display control device 10 determines whether there are multiple display modules 400 with the same cumulative viewing time (step S14). If there are no multiple display modules 400 with the same cumulative viewing time, the display control device 10 sets the priority of the display modules 400 in descending order of the cumulative gaze time (step S15). If there are multiple display modules 400 with the same cumulative viewing time, the display control device 10 sets a higher priority to the display module 400 with the smallest array number among the display modules 400 with the same cumulative gaze time (step S16). The display control device 10 determines whether the display image has changed (step S17), and if the display image has changed, returns to the processing shown in step S10. On the other hand, if the display image has not changed, the display control device 10 ends the processing.
  • FIG. 7 is a flowchart showing the process flow for complementing a hidden image performed by the display control device in the first embodiment. Execution of this flowchart is triggered when it is determined in step S10 that there is a faulty display module 400.
  • the display control device 10 sets the display module 400 determined to be faulty as a hidden module (step S20).
  • the display control device 10 acquires the priority set for the hidden module and determines whether the acquired priority is the lowest priority (step S21). If the priority set for the hidden module is not the lowest, the display control device 10 sets all display modules 400 that have a lower priority than the priority set for the hidden module as candidates for complementary modules (step S22). The display control device 10 sets the display module that is located closest to the non-display module among the candidates for the complementary module as the complementary module (step S23). On the other hand, if the priority set for the non-display module is the lowest in step S21, the display control device 10 sets the display module 400, which has a priority one level higher than the non-display module, as a complementary module (step S24).
  • the display control device 10 sets the screen switching time according to the ratio of the cumulative gaze times of the hidden module and the complementary module (step S25).
  • the display control device 10 causes the complementary module to alternately display the first image originally displayed by the complementary module and the second image displayed by the hidden module before the failure, according to the set switching time (step S26). Then, the display control device 10 proceeds to the processing shown in step S17, as indicated by symbol B.
  • the display control device 10 of the first embodiment displays a display image on the display screen of a tiling display 40 in which a plurality of display modules 400 are arranged.
  • the display control device 10 includes a priority setting unit 12 and a display control unit 11.
  • the priority setting unit 12 sets a priority for each of the display modules 400 that make up the display screen based on line-of-sight information of a viewer U who views the display image.
  • the display control unit 11 controls the image to be displayed on each of the display modules 400 based on the priority of each of the display modules 400 determined by the priority setting unit 12, and causes a complementary module that complements the image displayed on the non-display module to display the image that was displayed on the non-display module.
  • the display control device 10 of the embodiment can set the priority of each of the display modules 400 that make up the display screen based on the line-of-sight information of the viewer U, making it possible to set the priority depending on whether the viewer U is viewing the display screen. Therefore, it is possible to set the importance of each display module depending on the image displayed on the tiling display.
  • the priority setting unit 12 calculates the cumulative gaze time for each display module 400.
  • the cumulative gaze time is the accumulated gaze time of each viewer U viewing the display module 400.
  • the priority setting unit 12 sets the priority of the display module 400 according to the calculated cumulative gaze time.
  • the display control device 10 of the first embodiment further includes a gaze information acquisition unit 14.
  • the gaze information acquisition unit 14 acquires gaze information by performing image analysis on a viewing image captured of the viewer U viewing the display image.
  • the priority setting unit 12 sets priorities using the gaze information acquired by the gaze information acquisition unit 14. As a result, the display control device 10 of the embodiment can easily and accurately acquire gaze information using existing image analysis technology, and therefore can easily and accurately set priorities.
  • the display control unit 11 designates, as a complementary module, the display module 400 that is located closest to the position of the hidden module, among the display modules 400 that have a lower priority than the hidden module.
  • the display module 400 that has a lower priority than the hidden module and is located close to the hidden module can display the image that was being displayed on the hidden module before it failed, thereby minimizing the sense of discomfort felt by the viewer U and preventing a situation in which an important image is not being displayed from continuing.
  • the display control unit 11 causes the complement module to alternately display the first image that has been displayed in the complement module and the second image that has been displayed in the non-display module at each switching time. This allows the display control device 10 of the embodiment to alternately display the first image and the second image, and by having the complement module complement the image, it is possible to prevent the image originally displayed by the complement module from being continuously displayed.
  • the display control unit 11 sets the switching time according to the cumulative viewing time of the non-display module and the complementary module before a failure occurs.
  • the display control device 10 of the embodiment can alternately display the first image and the second image at a switching time according to their priority, so that an image that is likely to be viewed by many viewers U can be displayed for a longer period of time.
  • the display control device 10 of the first embodiment also includes a fault detection unit 13.
  • the fault detection unit 13 determines whether or not a fault has occurred in one of the display modules 400 that make up the display screen, based on the captured image.
  • the display control unit 11 controls the image to be displayed on each of the display modules 400, depending on the determination result by the fault detection unit 13. This allows the display control device 10 of the embodiment to easily and accurately detect faults using existing image analysis technology.
  • the display control system 1 of the first embodiment includes a display control device 10 and an imaging device 30.
  • the imaging device 30 captures an image of the viewer U viewing the display image displayed on the tiling display 40, and outputs the captured viewing image to the display control device 10.
  • the display control system 1 of the embodiment achieves the effects described above.
  • the image projection system 41 is a system that projects an image onto a single display screen by causing a plurality of projectors to project images, respectively.
  • FIG. 8 is a diagram for explaining the processing performed by the display control device in the modified example of the first embodiment.
  • the image projection system 41 includes a plurality of projectors 410 (projectors 410-1, 410-2, 410-3, ). Each of the plurality of projectors 410 displays an image on the screen SC, thereby displaying one display image on the screen SC.
  • the projector 410-1 projects an image onto an area E41-1.
  • the projector 410-2 projects an image onto an area E41-2.
  • the projector 410-3 projects an image onto an area E41-3. 4 and 5, in FIG. 8, arrangement information is shown above and to the left of a rectangle showing an image projected by the projector 410, and priority is shown in the center of the rectangle.
  • the display control device 10 controls the images to be displayed on each of the multiple projectors 410 .
  • the failure detection unit 13 determines whether a part of the display image projected on the screen SC is hidden using the captured image, using the same method as in the first embodiment.
  • the display control unit 11 designates the failed projector 410 as a hidden module.
  • the display control unit 11 selects a complementary module, which is a projector 410 that complements the hidden module, using the same method as in the first embodiment. 8, it is assumed that the projector 410-2 has broken down and is unable to project an image onto the area E41-2. In this case, the display control unit 11 sets the projector 410-2 as a non-display module and selects the projector 401-3 as a complementary module by the same processing as in the first embodiment.
  • the projector's lens shift function is used to complement the projection of the image that the non-display module was projecting before the failure.
  • the display control unit 11 determines whether the area onto which the non-display module projected an image (non-display position, area E41-2 in FIG. 8 ) is included in the area that can be projected by lens-shifting the projection lens of the complementary module (projection area). If the non-display area is included in the projection area, the display control unit 11 shifts the projection lens of the complementary module to display a non-display image from the complementary module in the non-display area.
  • the non-display image is the image that would be projected from the non-display module if it were not malfunctioning.
  • the display control unit 11 shifts the projection lens of the projector 410-3, which is a complementary module, and causes the projector 410-3 to display a non-display image in the area E41-2, which is a non-display area.
  • the display control unit 11 may alternately project the first image projected by the complement module and the second image projected by the non-display module at each switching time according to the cumulative viewing time.
  • the display control unit 11 may alternately shift the projection lens in the complement module to display the non-display image in the non-display area and the complement image in the complement area.
  • the complement area is the area where the complement module projected an image before the failure.
  • the complement image is the image the complement module was projecting before the failure.
  • the display control device 10 uses a projector 410 that projects an image as the display module.
  • the display control unit 11 causes the complementary module to project the image (non-displayed image) that was being projected by the non-display module onto the area (non-displayed area) into which the non-display module projected an image before the failure, by lens shifting the projection lens of the complementary module.
  • the display of the hidden image can be compensated for (complemented).
  • lens shifting the projection lens an image can be displayed in the hidden area.
  • the priority of the display module 400 is determined according to the content of the image displayed by the display module 400. Specifically, in this embodiment, the area that the viewer will view when the display image is displayed is estimated based on the image information of the display image, and the estimation result is used instead of the line-of-sight information of the first embodiment to determine the priority. For example, when airport flight arrival and departure information is displayed on the tiling display 40, information such as the flight number, destination, scheduled departure time, scheduled arrival time, and whether or not there has been a delay is displayed in text. Information displayed in text, such as this arrival and departure information, is highly likely to be recognized by the viewer U. In this embodiment, a high priority is set to the display module 400 that displays an image including many characters that are highly likely to be recognized.
  • Figure 9 is a block diagram explaining the configuration of a display control system in the second embodiment.
  • differences from the first embodiment will be mainly explained, and components equivalent to those in the first embodiment will be assigned the same reference numerals and will not be explained again.
  • the display control system 1 includes a display control device 10, an imaging device 20, and a tiling display 40.
  • the display control device 10 further includes a display image storage unit 15 and a character recognition unit 16.
  • the display image storage unit 15 stores image information of the display image to be displayed on the tiling display 40 .
  • the character recognition unit 16 uses the image information of the display image stored in the display image storage unit 15 to perform character recognition on the image displayed by the display module 400 for each display module 400.
  • the character recognition unit 16 extracts, for example, image information (e.g., raster information) of the display image.
  • the character recognition unit 16 recognizes characters included in the display image based on the image information of the display image.
  • Optical Character Recognition/Reader (OCR) technology can be used as a character recognition method.
  • the priority setting unit 12 acquires character information from the character recognition unit 16 indicating the size (amount of text) of the area recognized as a character in the divided image, and based on the acquired character information, sets a high priority to the display module 400 that is displaying an image containing a large amount of text in the divided image.
  • FIG. 10 is a flowchart showing the flow of the priority setting process performed by the display control device in the second embodiment.
  • the display control device 10 determines whether or not there is a faulty display module in the tiling display 40 (step S30). As in the first embodiment, the display control device 10 determines whether or not there is a faulty display module based on the determination result made by the fault detection unit 13 as to whether or not a display module 400 has failed. If there is a faulty display module 400, the display control device 10 executes the process indicated by symbol A (processing to complement a non-displayed image).
  • the display control device 10 determines whether image information of the display image has been input to the tiling display 40 (step S31).
  • the display control device 10 performs character recognition based on the image information of the display image to detect areas recognized as characters (step S32).
  • the display control device 10 accumulates the number of areas recognized as characters detected from the divided image displayed by that display module 400, and calculates the accumulated value as the amount of text (step S33).
  • the display control device 10 sets the priority of the display modules 400 in descending order of the amount of text (step S34).
  • the display control device 10 determines whether the display image has changed (step S35), and if the display image has changed, returns to the processing shown in step S30. On the other hand, if the display image has not changed, the display control device 10 ends the processing.
  • FIG. 11 is a flowchart showing the flow of processing performed by a display control device in the second embodiment to detect character areas. Note that the method is not limited to the method described here, and any character recognition method can be used.
  • the character recognition unit 16 binarizes the pixel value of each pixel in the display image and converts it into a color corresponding to the background (e.g., white) and a color corresponding to the character (e.g., black) (step S40).
  • the character recognition unit 16 detects, as character candidate blocks, locations in the binarized display image where the contrast value is equal to or greater than a threshold value (step S41). For example, the character recognition unit 16 divides the display image into divided images. The divided images are images obtained by dividing the display image based on the arrangement of the display modules 400 that make up the tiling display 40. The character recognition unit 16 further divides the divided images into a plurality of blocks. The size of the divided blocks is set, for example, according to the size of one character displayed in the display image. The character recognition unit 16 calculates the contrast of the pixel groups contained in the blocks, and detects blocks that include locations where the calculated contrast is equal to or greater than a threshold value as character candidate blocks.
  • the character recognition unit 16 Based on the pixel information of the detected character candidate block, the character recognition unit 16 extracts four directional components for the rectangle of the character candidate block in four directions: vertical, horizontal, upward-to-right diagonal, and downward-to-right diagonal (step S42).
  • the four directional components are extracted as character feature components by extracting color components (e.g., black) corresponding to the characters along each of the four directions.
  • the character recognition unit 16 calculates the Euclidean distance between four directional components extracted from pixel information indicating a pre-stored character font and four directional components extracted from the character candidate block.
  • the Euclidean distance D here is an index indicating the degree to which the image of the character candidate block resembles the character font, and can be calculated using the following formula (1):
  • the character recognition unit 16 calculates the Euclidean distance D for all pre-stored font data for each of the four directional components extracted from the character candidate block. If any of the Euclidean distances D calculated for a character candidate block is equal to or less than a threshold value, the character recognition unit 16 extracts that character candidate block as a block containing a character (step S44). The character recognition unit 16 calculates the cumulative value of the number of blocks extracted as characters as the amount of text (step S45).
  • the priority setting unit 12 determines the priority by using the line-of-sight information in the first embodiment as the line-of-sight information in the first embodiment an estimation result of the area that the viewer will view when the display image is displayed, based on the image information of the display image displayed on the tiling display 40.
  • a high priority can be set to the display module 400 that displays an image that is likely to be viewed by the viewer U, based on the image information of the display image, and the importance of each display module can be set according to the image displayed on the tiling display.
  • the display control unit 101 controls the image to be displayed on each display module 400 based on the priority of the display module 400 set by the priority setting unit 102, and causes the image that was displayed on the hidden module to be displayed on the complementary module, which is a display module 400 that complements the image that was displayed on the non-display module (the failed display module).
  • the display control device 100 with a basic configuration to set the importance of each display module according to the image being displayed on the tiling display.
  • the "computer system” also includes the homepage providing environment (or display environment).
  • “computer-readable recording media” refers to portable media such as flexible disks, optical magnetic disks, ROMs, and CD-ROMs, as well as storage devices such as hard disks built into computer systems.
  • “computer-readable recording media” also includes devices that retain programs for a certain period of time, such as volatile memory within a computer system that serves as a server or client.
  • the program may be designed to realize some of the aforementioned functions, or may be capable of realizing the aforementioned functions in combination with a program already stored in the computer system.
  • the program may also be stored on a designated server, and distributed (e.g., downloaded) via a communication line in response to a request from another device.
  • REFERENCE SIGNS LIST 1 Display control system 10, 100 Display control device 11, 101 Display control unit 12, 102 Priority setting unit 13 Fault detection unit 14 Line-of-sight information acquisition unit 15 Display image storage unit 16 Character recognition unit 20 Imaging device 30 Imaging device 40 Tiling display 400 to 407 Display module

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Controls And Circuits For Display Device (AREA)

Abstract

L'invention concerne un système de commande d'affichage qui amène une image d'affichage à être affichée sur un écran d'affichage d'un afficheur en pavage dans lequel une pluralité de modules d'affichage sont agencés, le système de commande d'affichage comprenant : une unité d'établissement de priorité qui établit, sur la base d'informations de ligne de visée d'un spectateur qui reconnaît visuellement l'image d'affichage, une priorité pour chacun des modules d'affichage qui constituent l'écran d'affichage ; et une unité de commande d'affichage qui, en réponse à la défaillance d'un module d'affichage qui constitue une partie de l'écran d'affichage, commande, sur la base des priorités des modules d'affichage établis par l'unité d'établissement de priorité, une image à afficher sur chacun des modules d'affichage, et amène l'image affichée sur un module de non-affichage, qui est le module d'affichage qui a été défaillant, à être affichée dans un module supplémentaire qui est un module d'affichage pour compléter l'image affichée sur le module de non-affichage.
PCT/JP2024/018343 2024-05-17 2024-05-17 Système de commande d'affichage et procédé de commande d'affichage Pending WO2025238848A1 (fr)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/JP2024/018343 WO2025238848A1 (fr) 2024-05-17 2024-05-17 Système de commande d'affichage et procédé de commande d'affichage

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/JP2024/018343 WO2025238848A1 (fr) 2024-05-17 2024-05-17 Système de commande d'affichage et procédé de commande d'affichage

Publications (1)

Publication Number Publication Date
WO2025238848A1 true WO2025238848A1 (fr) 2025-11-20

Family

ID=97719746

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2024/018343 Pending WO2025238848A1 (fr) 2024-05-17 2024-05-17 Système de commande d'affichage et procédé de commande d'affichage

Country Status (1)

Country Link
WO (1) WO2025238848A1 (fr)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11147469A (ja) * 1997-11-14 1999-06-02 Toshiba Corp 旅客案内表示システム
US20020003592A1 (en) * 2000-07-10 2002-01-10 Hett Charles L. LCD tile display
JP2014002343A (ja) * 2012-06-21 2014-01-09 Seiko Epson Corp プロジェクターシステム、プロジェクターシステムの制御方法、及びプロジェクター
JP2017068036A (ja) * 2015-09-30 2017-04-06 株式会社Ｊｖｃケンウッド モニタ制御システム、モニタ制御方法、及び、モニタ制御プログラム
JP2017121841A (ja) * 2016-01-06 2017-07-13 株式会社デンソー 表示装置
WO2018016464A1 (fr) * 2016-07-19 2018-01-25 富士フイルム株式会社 Système d'affichage d'images, dispositif de commande de casque à réalité virtuelle, et leur procédé et leur programme d'actionnement
JP2020201437A (ja) * 2019-06-12 2020-12-17 三菱電機株式会社 マルチディスプレイシステム、および、マルチディスプレイの表示方法

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH11147469A (ja) * 1997-11-14 1999-06-02 Toshiba Corp 旅客案内表示システム
US20020003592A1 (en) * 2000-07-10 2002-01-10 Hett Charles L. LCD tile display
JP2014002343A (ja) * 2012-06-21 2014-01-09 Seiko Epson Corp プロジェクターシステム、プロジェクターシステムの制御方法、及びプロジェクター
JP2017068036A (ja) * 2015-09-30 2017-04-06 株式会社Ｊｖｃケンウッド モニタ制御システム、モニタ制御方法、及び、モニタ制御プログラム
JP2017121841A (ja) * 2016-01-06 2017-07-13 株式会社デンソー 表示装置
WO2018016464A1 (fr) * 2016-07-19 2018-01-25 富士フイルム株式会社 Système d'affichage d'images, dispositif de commande de casque à réalité virtuelle, et leur procédé et leur programme d'actionnement
JP2020201437A (ja) * 2019-06-12 2020-12-17 三菱電機株式会社 マルチディスプレイシステム、および、マルチディスプレイの表示方法

Similar Documents

Publication Publication Date Title
US7250978B2 (en) Multi-vision system and method of controlling the same
KR101125978B1 (ko) 표시 장치 및 방법
US9167233B2 (en) Naked-eye stereoscopic display apparatus
US20150205565A1 (en) Multi-screen display system and display method
US20070058034A1 (en) Stereoscopic image display device, stereoscopic display program, and stereoscopic display method
US20240275936A1 (en) Multiview autostereoscopic display using lenticular-based steerable backlighting
US6262694B1 (en) Image display system
KR20040014294A (ko) 이미지 디스플레이 방법 및 시스템, 광 변조기를 이용한이미지 디스플레이 방법 및 이미지 프레임 디스플레이시스템
TW201317970A (zh) 影像防窺方法
JP2008268968A (ja) 表示装置および方法
US20150193625A1 (en) Display device
US6853354B2 (en) Multi display projector
US11307410B2 (en) Display apparatus and method incorporating adaptive pose locking
WO2025238848A1 (fr) Système de commande d'affichage et procédé de commande d'affichage
US20110255057A1 (en) Multi-Projector Servo-Controlled Display System
US6817722B1 (en) Method and system for reducing moiré in displays
KR102593453B1 (ko) 가상 현실용 디스플레이 시스템 및 그 구동 방법
JP6726889B2 (ja) 映像表示システム
JP4502608B2 (ja) プロジェクション方法並びにプロジェクション装置
JP2013064802A (ja) マルチディスプレイシステムおよび画像表示装置の配置位置検出方法
CN102495516A (zh) 一种显示系统及方法
US11570409B2 (en) Operation apparatus, multi-apparatus system, control method, and storage medium
US11353971B2 (en) Method for controlling display device, and display device
US20240179277A1 (en) Projection system
US10019918B2 (en) In-band tear detection system