JP2008170581A - Image display device, terminal control program, and image display system - Google Patents

Abstract

An image display device, a terminal control program, and an image display system capable of simultaneously displaying a plurality of windows displayed on terminal screens of a plurality of terminals on a display unit are provided.
In an image display system, various windows respectively displayed on displays 24 and 34 of terminal devices 20 and 30 can be simultaneously displayed on a screen 100 by a projector 10. In the terminal devices 20 and 30, a detection list in which window information of various windows displayed on the displays 24 and 34 is registered is created. These detection lists are wirelessly transmitted to the projector 10 and used by the CPU of the projector 10 to create a projection screen. The CPU creates a display list based on the detection list, creates a projection screen based on the display list, and projects it onto the screen 100. Thereby, various windows can be simultaneously displayed on the projection screen of the screen 100.
[Selection] Figure 1

Description

  The present invention relates to an image display device, a terminal control program, and an image display system, and more specifically, an image display device that displays images displayed on display screens of a plurality of terminals connected on a network on a display unit, and terminal control. The present invention relates to a program and an image display system.

  2. Description of the Related Art Conventionally, there has been known a liquid crystal projector that can be connected to a plurality of terminal devices (PCs) and can enlarge and project one image formed based on image information transmitted from each terminal device on a screen. Such a projector is very convenient particularly when discussing the display screens of a plurality of terminal devices by comparing them with each other in a meeting or the like. Among them, for example, the projector is transmitted from each terminal device having a screen capture function. There is known a network-compatible display device that can receive captured image data received by a communication unit, and can synthesize the received captured image data into image data of one screen by dividing the screen by the image synthesis unit (for example, Patent Document 1).

  The network-compatible display device includes a display size determining unit that determines a display size of a divided screen to be assigned to a terminal device to be displayed, and a display size determined by the display size determining unit to each corresponding terminal device by a communication unit. A control unit that transmits the received captured image data that has been converted to the display size of the divided screen assigned to the terminal device from each terminal device that has transmitted the display size. The display control unit is controlled so that each captured image data is combined with one screen of image data and displayed on the display unit. Note that one screen displayed on the display unit is composed of divided screens of each terminal device, and one screen displayed on the display screen of each terminal device is displayed on each of the divided screens. .

JP 2004-54783 A

  However, the object that the user wants to display on the screen is an image of a work window opened on the display screen of each terminal device, and it is not always necessary to display an area outside the window frame on the screen. In other words, the network-compatible display device described in Patent Document 1 has a problem in that an image outside the window frame is displayed on the screen, so that the image of the window displayed on each divided screen becomes small and very difficult to see. there were. Further, since the position of each divided screen assigned to the terminal device cannot be changed by the terminal device, there is a problem that the operation of the display device is inconvenient.

  The present invention has been made to solve the above problems, and provides an image display device, a terminal control program, and an image display system capable of simultaneously displaying a plurality of windows displayed on terminal screens of a plurality of terminals on a display unit. The purpose is to do.

  To achieve the above object, an image display device according to claim 1 detects a window displayed on a terminal screen, obtains window information of the window, and outputs the window information to the outside. An image display device connected to each of the terminals, window information receiving means for receiving the window information from the terminal, and window management means for managing the plurality of window information received by the window information receiving means Layout image creating means for laying out the window and creating a display image based on the window information; and image output means for outputting the display image created by the layout image creating means to a display unit. ing.

  According to a second aspect of the present invention, in addition to the configuration of the first aspect of the invention, the window information includes XY coordinate data indicating a two-dimensional position of the window on the terminal screen, Image data of a window and a window identifier for identifying the window from other windows in the terminal screen, and the window management means identifies the terminal using the window information received from the terminal The layout image creating means lays out the window so that the window is arranged at the coordinate position of the XY coordinate data, and uses the image data of the window to display the display image. It is characterized by creating.

  According to a third aspect of the present invention, in addition to the configuration of the first or second aspect of the invention, the window information indicates whether the window is active or inactive on the terminal screen. The layout image creating means includes a plurality of the windows, and arranges the window in the active state on the front side of the display image relative to the window in the inactive state. Features.

  According to a fourth aspect of the present invention, in addition to the configuration of the first or second aspect of the invention, the window information indicates whether the window is active or inactive on the terminal screen. Including active information, the layout image creating means lays out only the window in the active state.

  According to a fifth aspect of the present invention, in addition to the configuration of the third aspect of the invention, the image display device according to the fifth aspect includes an active state in which switching of the window from the inactive state to the active state is detected based on the active information. Switching detection means, and when the active state switching detection means detects the switching of the window to the active state, the layout image creation means arranges the window switched to the active state in the forefront. It is characterized by layout.

  According to a sixth aspect of the present invention, in addition to the configuration of the second aspect of the present invention, the window information includes size information indicating a size of the window on the terminal screen. The window is displayed in the display image from size acquisition means for acquiring the size of the window based on the size information, the size of the display image, and the coordinate position of the window arranged according to the layout. Displayable area calculation means for calculating a displayable area that can be displayed; size comparison means for comparing the displayable area calculated by the displayable area calculation means and the size of the window acquired by the size acquisition means; Depending on the comparison result of the size comparison means, the window is larger than the size of the displayable area. Size determining means for determining whether the size of the dough is larger, and when the size determining means determines that the size of the window is larger than the size of the displayable area, Image data truncation means for truncating a portion of the image data that protrudes from the displayable area.

In addition to the configuration of the invention described in claim 1, the image display device of the invention according to claim 7 includes:
The window information includes XY coordinate data indicating a two-dimensional position of the window on the terminal screen, image data of the window, and a window identifier for identifying the window from other windows in the terminal screen. The window management means stores the window information received from the terminal together with a terminal identifier for identifying the terminal, and the layout image creating means adds the window information received by the window information receiving means to the window information received by the window information receiving means. Based on the XY coordinate data of the window so that the display area of the display unit is divided based on the number of windows, and the image of the window is displayed on each of the divided screens. And laying out a plurality of the windows. That.

  In addition to the configuration of the invention described in claim 1 or 2, the window information includes non-display information indicating whether or not to hide the window. The layout image creating means does not lay out a window whose non-display information indicates non-display.

  A terminal control program according to a ninth aspect of the invention is a terminal control program for causing a computer to function as the terminal according to the first aspect, wherein the window displayed on the terminal screen is detected, and The method includes a first step for acquiring the window information and a second step for outputting the window information acquired in the first step to the outside.

  In addition to the configuration of the invention according to claim 9, the terminal control program of the invention according to claim 10 creates a detection list of the windows detected in the first step in the second step, and After the window information is set for each window in the detection list, the detection list is output to the outside.

  In addition to the configuration of the invention according to claim 10, the terminal control program of the invention according to claim 11 is specified to be hidden on the terminal screen in the detection list in the second step. The window information of the window is not set.

  In addition to the configuration of the invention according to claim 10 or 11, the terminal control program of the invention according to claim 12 is minimized in the terminal screen in the detection list in the second step. The window information of the window is not set.

  An image display system according to a thirteenth aspect of the invention includes the image display device according to any one of the first to eighth aspects, and a terminal having the terminal control program according to any one of the ninth to twelfth aspects. ing.

  In the image display device according to the first aspect of the present invention, the window information output from each of the plurality of terminals is received by the window information receiving means. The plurality of window information received by the window information receiving unit is managed by the window information managing unit, and the layout of the window to be displayed on the display unit is performed by the layout image creating unit based on the managed window information. Further, the image laid out by the layout image creating means is output to the display unit by the image output means. Thereby, a plurality of windows respectively displayed on each terminal screen can be displayed on the display unit at the same time. Furthermore, since the layout by the layout image creating means is performed according to the window information output from each terminal, the layout of the window displayed on the display unit at each terminal can be freely operated.

  According to a second aspect of the present invention, in addition to the effect of the first aspect of the invention, the window management means stores the window information received from the terminal together with a terminal identifier for identifying the terminal. Therefore, it is possible to individually identify and store which terminal the window information is the window information of the window output from. Further, since the XY coordinate data is included in the window information, the position of the window displayed on the display unit can be changed by changing the XY coordinate data. That is, when the window position is changed on the terminal, the window information in which the XY coordinate data is changed is output, so that the layout of the window displayed on the display unit can be freely operated. Furthermore, since the layout image creating means can perform window layout using the XY coordinate data, more accurate layout work can be performed. The window information includes window image data, and the layout image creating means creates a display image using the window image data, so that a display image in which a plurality of window images are laid out can be created.

  According to a third aspect of the present invention, in addition to the effect of the first or second aspect of the invention, the layout image creating means overlaps a plurality of windows and sets the active state window to the inactive state. Since the layout is arranged on the front side of the display image rather than the window, the window in the active state desired to be displayed on the display unit can be displayed with priority on the front side.

  In addition to the effect of the invention according to claim 1 or 2, the image display device according to claim 4 lays out only the window in the active state, so that the window in the inactive state is Not laid out. As a result, only the window in the active state can be displayed on the display unit.

  According to a fifth aspect of the present invention, in addition to the effect of the third aspect of the present invention, when the active state switching detecting means detects the switching of the window from the inactive state to the active state, the layout image is displayed. The creation means can lay out the window that has been switched to the active state in the foreground. In other words, the window can be displayed in the foreground simply by selecting the window in a certain inactive state and making it active, thereby improving the display operability of the window.

  According to a sixth aspect of the present invention, there is provided an image display device according to the second aspect, wherein the displayable area calculating means is based on the size of the display image and the coordinate position of the window. Thus, a displayable area in which the window can be displayed on the display image is calculated. Then, the displayable area calculated by the displayable area and the size of the window are compared by the size comparison means, and it is determined from the comparison result that the size of the window is larger than the size of the displayable area. In this case, the image cutout means cuts off the portion of the image data of the window that protrudes from the displayable area. As a result, the extra data portion of the image data included in the window information is discarded, so that the amount of information included in the window information can be reduced and the load on the layout image creating means can be reduced.

  According to a seventh aspect of the present invention, in addition to the effect of the first aspect of the invention, the image display device includes a plurality of windows so that the layout image creating means displays a window image for each divided screen. Since each is laid out, it is easy to compare windows. Further, the window information includes XY coordinate data, and the layout image creating means lays out a plurality of windows based on the XY coordinate data of the window, so that it is displayed on the display unit by changing the XY coordinate data. You can change the window position. That is, when the window position is changed on the terminal, the window information in which the XY coordinate data is changed is output, so that the layout of the window displayed on the display unit can be freely operated. In addition, since the divided screen obtained by dividing the display area of the display unit is divided based on the number of windows counted by the layout image creation means based on the window information, an appropriate number of divisions is always set for the number of windows. can do.

  According to an eighth aspect of the present invention, in addition to the effect of the first or second aspect of the invention, the layout image creating means may lay out a window in which non-display information included in the window information indicates non-display. Therefore, it is possible to prevent the window designated not to be displayed on the terminal from being displayed on the display unit.

  A terminal control program according to a ninth aspect of the present invention is a terminal control program that causes a computer to function as the terminal according to the first aspect. In the first step, all windows displayed on the terminal screen are detected. In addition, the window information of the window is acquired, and in the second step, the window information detected in the first step is output to the image display device. As a result, the window information of the window displayed on the terminal screen is output to the image display device, and the image display device displays the window image on the display unit based on the window information. You can manipulate the position.

  In addition to the effect of the invention according to claim 9, the terminal control program of the invention according to claim 10 creates a detection list in which the window information of the windows detected in the first step is set in the second step. The Since the created detection list is output to the image display device, management of window information regarding a plurality of windows can be facilitated in the image display device.

  In addition to the effect of the invention described in claim 10, the terminal control program of the invention according to claim 11 includes, in the second step, the window information of the window that is specified not to be displayed on the terminal screen in the detection list. Since it is not set, it is possible to prevent the window from being displayed on the display unit by designating a window that is not to be displayed on the display unit.

  In addition to the effect of the invention according to claim 10 or 11, the terminal control program of the invention according to claim 12 is a window that is minimized on the terminal screen. Therefore, it is not necessary to display the window on the display unit. Therefore, in the third step, since the window information of the window minimized on the terminal screen is not set in the detection list, the window is not laid out by the layout image creating means. Therefore, the window can not be displayed on the display unit.

  An image display system according to a thirteenth aspect includes the image display device according to any one of the first to eighth aspects and a terminal having the terminal control program according to any one of the ninth to twelfth aspects. Therefore, a plurality of windows respectively displayed on each terminal screen can be simultaneously displayed on the display unit of the image display device. Furthermore, since the layout by the layout image creating means is performed according to the window information output from each terminal, the layout of each window displayed on the display unit on each terminal can be freely adjusted.

  Hereinafter, an image display system 1 according to an embodiment of the present invention will be described with reference to FIGS. FIG. 1 is a conceptual diagram showing the configuration of the image display system 1, FIG. 2 is a block diagram showing the electrical configuration of the terminal device 20, and FIG. 3 is a block diagram showing the electrical configuration of the projector 10. 4 is a conceptual diagram showing the storage area of the ROM 52, FIG. 5 is a conceptual diagram showing the configuration of the window information 60, FIG. 6 is a conceptual diagram of the detection list 701, and FIG. 8 is a conceptual diagram of the detection list 702, FIG. 8 is a conceptual diagram of the empty list 703, FIG. 9 is a conceptual diagram of the window 4 in which the check box 27 is displayed, and FIG. 10 is a conceptual diagram of the display list 800. FIG. 11 is a flowchart of the detection list creation process, FIG. 12 is a flowchart of the detection list update process, and FIG. 13 is a main process executed by the CPU 51 of the projector 10. FIG. 14 is a flowchart of the projection screen creation process, FIG. 15 is a flowchart of the layout order update process, and FIG. 16 is a conceptual diagram of the display list 800 after detection of switching to the active state. is there.

  First, the configuration of the image display system 1 will be described. As shown in FIG. 1, the image display system 1 includes a projector 10 that projects an image on a screen 100 and terminal devices 20 and 30 that can wirelessly communicate with the projector 10. These terminal devices 20 and 30 are general computers (PC) provided with displays 24 and 34 on which various windows are displayed and operation keyboards 22 and 32. In the image display system 1, the windows 4 and 5 displayed on the display 24 and the windows 14 and 15 displayed on the display 34 are simultaneously displayed on the projection screen of the screen 100 projected by the projector 10. Can do. Therefore, this image display system can be effectively used for, for example, a meeting or a presentation. Hereinafter, the electrical configuration of the terminal devices 20 and 30, the electrical configuration of the projector 10, and their control operations will be sequentially described in detail.

  First, the electrical configuration of the terminal devices 20 and 30 will be described. Since the terminal device 20 and the terminal device 30 have the same configuration, only the terminal device 20 will be described here. As shown in FIG. 2, the terminal device 20 is provided with a CPU 11 as a controller that controls the terminal device 20. The CPU 11 includes a RAM 12 that temporarily stores various data, and a ROM 13 that stores BIOS and the like. And an I / O interface 23 that mediates data transfer. A hard disk device 120 is connected to the I / O interface 23, and the hard disk device 120 is provided with at least a detection list storage area 121, a program storage area 122, and other information storage areas 123.

  In the program storage area 122, there is a detection list creation program for creating a detection list 701 (see FIG. 6) in which window information 60 (see FIG. 5) relating to the window displayed on the display 24 is registered for each window. It is remembered. The detection list storage area 121 stores a detection list 701 created by executing the detection list creation program. The other information storage area 123 stores other information used by the terminal device 20. If the terminal device 20 is a dedicated machine that does not include the hard disk device 120, a program is stored in the ROM 13.

  The I / O interface 23 includes a wireless communication device 19 for wireless communication with the projector 10, a mouse 21 (not shown in FIG. 1), a video controller 16, a key controller 17, and a CD. -The ROM drive 18 is connected. A display 24 is connected to the video controller 16, and a keyboard 22 is connected to the key controller 17. The CD-ROM 114 inserted into the CD-ROM drive 18 stores a detection list creation program. At the time of introduction, this detection list creation program is set up from the CD-ROM 114 to the hard disk device 120 and is stored in the program storage area 122. Is remembered.

  Next, the electrical configuration of the projector 10 will be described. As shown in FIG. 3, the projector 10 is used for wireless communication between an operation panel 49 for a user to operate the projector 10, a computer 50 that controls the projector 10, and terminal devices 20 and 30. Lamp control for driving a wireless communication device 40, a video processing circuit 42 for converting a video signal transmitted from the terminal devices 20 and 30 into a signal necessary for driving the LCD 47, which is a light modulation element, and a lamp 45 described later. The circuit 44 and a default input port 41 for inputting a video signal or the like from the outside are connected via a data path 55. A lamp 45 is connected to the lamp control circuit 44, an illumination lens 46 is disposed on the front side of the lamp 45, an LCD 47 is disposed on the front side of the illumination lens 46, and a front side of the LCD 47 is not shown. An imaging unit 48 having a projection lens and a mirror is disposed. An image is projected from the imaging unit 48 toward the screen 100. In addition, an LCD drive circuit 43 is connected to the video processing circuit 42, and an LCD 47 is connected to the LCD drive circuit 43. The computer 50 includes a CPU 51 as a controller that controls the projector 10, a ROM 52 that is connected to the CPU 51 and stores BIOS, and a RAM 53 that is connected to the CPU 51 and temporarily stores various data. It is a chip microcomputer.

  Next, the ROM 52 will be described. As shown in FIG. 4, the ROM 52 stores a display list creation program storage area 52a for executing a display list creation process described later, and a drawing order update program for executing a drawing order update process described later. An order update program storage area 52b, a projection screen creation program storage area 52c for storing a projection screen creation program for executing a projection screen creation process described later, and the like are provided.

  Next, the window information 60 will be described. As shown in FIG. 5, the window information 60 is data relating to various windows displayed on the displays 24 and 34 of the terminal devices 20 and 30. The window information 60 includes a window ID for individually identifying the window, X and Y coordinates of the upper left vertex of the window, active information indicating whether the window is in an active state or an inactive state, and the window Image data. As the window ID, the window handler of each window is set. The active information indicates whether the window is in an active state or an inactive state, and is set to “YES” when the window is in an active state and “NO” when the window is in an inactive state. The window information 60 having such a configuration is registered for each window in detection lists 701 and 702 described later.

  Next, the detection lists 701 and 702 will be described. As shown in FIGS. 6 and 7, the detection lists 701 and 702 are list data in which window information 60 of various windows displayed on the displays 24 and 34 of the terminal devices 20 and 30 is registered for each window. For example, as shown in FIG. 6, window information 61 and 62 of windows 4 and 5 displayed on the display 24 are registered in the detection list 701 created by the terminal device 20. On the other hand, in the detection list 702 created by the terminal device 30 shown in FIG. 7, the window information 63 and 64 of the windows 14 and 15 displayed on the display 34 are registered.

  As shown in FIG. 6, the detection list 701 is registered in order from the top to the frontmost window from the rearmost window. That is, the window information 61 of the window 4 arranged on the backmost side of the display 24 is registered in the first line of the detection list 701, and the window 5 arranged on the frontmost side of the display 24 is registered in the second line. Window information 62 is registered. As window information 61 of window 4, window ID = “1”, X and Y coordinates of window 4 = “90, 50”, active information = “NO”, and image data = “image data” are registered in this order. As window information 62 of window 5, window ID = “2”, window X and Y coordinates = “800, 150”, active information = “YES”, and image data = “image data” are registered in this order. . Furthermore, in the detection list 701 in which these two window information 61 and 62 are registered, the Mac address acquired from the OS of the terminal device 20 is assigned with, for example, PCID = “0012345567890” as the PC identification number. .

  On the other hand, as shown in FIG. 7, the detection list 702 is also registered in order from the window on the backmost side to the window on the frontmost side. That is, the window information 63 of the window 14 on the foremost side of the display 34 is registered in the first line of the detection list 702, and the window information 64 of the window 15 on the foremost side of the display 34 is registered in the second line. Has been. The window information 63 of the window 14 is registered in the order of window ID = “1”, window X and Y coordinates = “35, 150”, active information = “NO”, and image data = “image data”. The window information 64 of the window 15 is registered in the order of window ID = “2”, window X and Y coordinates = “550, 61”, active information = “YES”, and image data = “image data”. Further, in the detection list 702 in which these two window information 63 and 64 are registered, the Mac address acquired from the OS of the terminal device 30 is assigned with, for example, PCID = “001234567891” as the PC identification number. . The numerical values of the X, Y coordinates of the windows 4, 5, 14, 15 shown in FIGS. 6 and 7 do not indicate the actual X, Y coordinates of the windows 4, 5, 14, 15 shown in FIG. Absent.

  By the way, in this embodiment, in the terminal devices 20 and 30, a projection application (hereinafter referred to as a projection application) is started in order to display various windows on the projector 10 simultaneously. When the activation application is activated, detection lists 701 and 702 are created. When this projection application is terminated by a user operation, an empty list 703 shown in FIG. 8 is transmitted to the projector 10 side as an end command. In this empty list 703, no window information 60 is registered, and only a Mac address (PCID = “0012345567890”) acquired from the OS of the terminal devices 20 and 30 is attached.

  Next, window non-display designation will be described. In the present embodiment, when the projection application is activated, for example, as illustrated in FIG. 9, a check box 27 is displayed on the upper part of the window frame 26 of the window 4 displayed on the display 24. Then, by placing the pointer (not shown) in the check box 27 and clicking, a “re” point (not shown) is displayed, and the non-display designation of the window is completed. That is, the window whose check box 27 is checked is not displayed on the projection screen of the screen 100. Therefore, the user can freely set a specific window from the plurality of windows displayed on the displays 24 and 34 so as not to be displayed on the projection screen of the screen 100.

  Next, the display list 800 will be described. As shown in FIG. 10, the display list 800 is list data in which the window information 61 to 64 of the windows 4, 5, 14, and 15 displayed on the projection screen of the screen 100 is registered in a predetermined order. The layout order of the windows on the projection screen is set in descending order with respect to the registration order of the window information 61 to 64. That is, the windows 4, 5, 14, and 15 are drawn according to this layout order, so that the windows 4, 5, 14, and 15 are laid out from the rearmost side to the frontmost side on the projection screen of the screen 100. Can do.

  Here, the registration order of the window information 61 to 64 in the display list 800 will be described. As shown in FIG. 10, the registration of the window information 61 to 64 with respect to the display list 800 is registered from the window information of the detection list 701 or 702 of the terminal connected to the projector 10 first among the terminal devices 20 and 30. Then, the registration order is changed so that the window information of the window in the active state has an earlier layout order than the window information of the window in the inactive state. For example, when the terminal device 20 is connected to the projector 10 before the terminal device 30, the window information 61 and 62 of the detection list 701 transmitted from the terminal device 20 is registered in the display list 800. Since the active information of the window information 61 is “NO” and the active information of the window information 62 is “YES”, the window information 61 and the window information 62 are replaced, and the window information 62 is the head of the display list 800. It becomes.

  Next, the window information 63 and 64 of the detection list 702 transmitted from the terminal device 30 is registered in the third and fourth lines of the display list 800. Since the active information of the window information 63 is “NO” and the active information of the window information 64 is “YES”, the window information 64 is moved up between the window information 62 and the window information 61, and two lines are displayed. Registered in the eye, the subsequent window information 61, 63 is carried forward. Thus, the window information 62 of the window 5 in the layout order “4”, the window information 64 of the window 15 in the layout order “3”, the window information 61 of the window 4 in the layout order “2”, and the window 14 in the layout order “1”. Window information 63 is registered. As a result, the active windows 5 and 15 are arranged and displayed on the front side of the inactive windows 4 and 14. That is, an active window that is being worked on can be displayed on the front side of the projection screen of the screen 100.

  Next, the projection process by the image display system 1 having the above configuration will be described. First, processing executed by the CPU 11 of the terminal devices 20 and 30 will be described with reference to the flowcharts of FIGS. Since the same processing is executed in both terminal devices 20 and 30, only the processing on the terminal device 20 side will be described here. First, when the projection application is activated by a user operation, the detection list creation program stored in the program storage area 122 is read, and the detection list creation process shown in FIG. 11 is executed. First, a non-display designation check box 27 is displayed above the window frames 26 of all the windows 4 and 5 displayed on the display 24 (S1). Next, the detection list 701 stored in the detection list storage area 121 of the hard disk device 120 is initialized (S2).

  Next, detection list update processing is executed (S3). As shown in FIG. 12, in this detection list update process, first, the PCID (Mac address) of the terminal device 20 is acquired from the OS, and the PCID is registered in the detection list 701 (S10). Here, “0012345567890” which is the PCID of the terminal device 20 is registered in the detection list 701 (see FIG. 6). Next, the arrangement order (Z coordinate) of all the windows 4 and 5 displayed on the display 24 is acquired (S11). Based on all the Z coordinates acquired here, the rearmost window to be registered in the detection list 701 is set (S12). For example, when the Z coordinate of the window 4 is “10” and the Z coordinate of the window 5 is “40”, since the window 4 is on the back side of the window 5, the window information 61 of the window 4 is added to the detection list 701. be registered.

  Here, before registering the window 4 in the detection list 701, it is necessary to determine whether the window 4 is a window to be displayed on the projection screen of the screen 100 or not. Therefore, it is determined whether or not the window 4 is minimized on the display 24 (S13). If the window 4 is not minimized (S13: NO), it is subsequently determined whether or not the window 4 is designated not to be displayed (S14). Here, it is determined whether or not the check box 27 (see FIG. 9) displayed in the window frame 26 of the windows 4 and 5 is checked. If the check box 27 is not checked (S14: NO), the process proceeds to the registration operation of the window 4.

  Next, the registration work for window 4 is started. First, the window ID of the window 4 is acquired from the OS, and the window ID “1” is registered in the detection list 701 (S15). Then, the X and Y coordinates of the upper left vertex of the window 4 are acquired from the OS (S16). In this case, the X and Y coordinates “90, 50” of the upper left vertex are acquired and registered in the detection list 701. Furthermore, the active information of the window 4 is acquired from the OS and registered in the detection list 701 (S17). In this case, since the window 4 is in an inactive state, “NO” is registered. Then, “image data” of the window 4 is acquired and registered in the detection list 701 (S18). Thus, the registration work of the window information 61 of the window 4 is completed. Next, it is determined whether all the windows displayed on the display 24 have been processed (S19). Here, since the window 5 has not been processed yet (S19: NO), the window 5 arranged on the front side of the window 4 is set as the next processing target window (S20).

  If the window 4 is minimized on the display 24 (S13: YES), since it is not a window to be displayed on the screen 100, has all the displayed windows been processed without registering the window 4? It is determined whether or not (S19). Further, even when the window 4 is not minimized on the display 24 (S13: NO), when the non-display is designated (S14: YES), all the windows 4 that are being displayed are not registered. Is determined (S19), and window 5 is set as the next processing target window (S20).

  By the way, when the window 5 is set as the next processing target window (S20), it is determined whether the window 5 is a window to be displayed on the projection screen of the screen 100, similarly to the processing of the window 4 described above (S13, S14) If the window is to be displayed (S13: NO, S14: NO), the registration work for window 5 is executed (S15 to S18). Specifically, “2”, “800, 150”, “YES”, and “image data” are registered in the detection list 701 (see FIG. 6) as the window information 62 of the window 5. Thereafter, it is determined again whether all the windows displayed on the display 24 have been processed (S19). Here, since the processing of the windows 4 and 5 displayed on the display 24 has been completed (S19: YES), the detection list 701 is completed. Returning to the flowchart shown in FIG. 11, the detection list 701 is wirelessly transmitted to the projector 10 (S4).

  Further, the projection application is terminated by the user, and it is determined whether or not the projection is terminated (S5). When the projection application is terminated by the user (S5: YES), an empty list 703 (see FIG. 8) is transmitted to the projector 10 as an end command (S6). On the other hand, when the projection application is continuously activated (S5: NO), the process returns to S2 and the series of processes is repeated.

  Next, the display list creation process executed by the CPU 51 of the projector 10 will be described with reference to the flowcharts of FIGS. First, when a start button (not shown) on the operation panel 49 is turned on, the display list creation program stored in the ROM 52 is read, and the display list creation process shown in FIG. 13 is executed. First, the display list 800 stored in the RAM 53 is initialized (S30). Next, it is determined whether or not the data of the detection lists 701 and 702 has been received from the terminal devices 20 and 30 (S31). Here, when the data of the detection lists 701 and 702 have not been received yet (S31: NO), the process returns to S31 to monitor whether or not data has been received.

  When data of the detection lists 701 and 702 is received from the terminal devices 20 and 30 (S31: YES), it is determined whether or not window information is registered in the display list 800 (S32). Here, when the display list 800 is initialized and the window information is not yet registered (S32: NO), the process proceeds to the registration of the window information 61 to 64 as it is. Then, the top window 4 of the detection list 701 transmitted from the previously received terminal device 20 is set as the processing target window (S34).

  Next, it is determined whether or not the window 4 is registered in the display list 800 (S35). Here, since the window 4 is registered for the first time (S35: YES), the window information 61 of the window 4 is registered at the head of the display list 800 (S42). Next, it is determined whether or not all the window information registered in the detection lists 701 and 702 has been registered (S39). Here, since the window information 62 of the detection list 701 and the window information 63 and 64 of the detection list 702 are not processed (S39: NO), the second window of the detection list 701 is the next processing target window. 5 is set (S43).

  Next, it is determined whether or not the window 5 is registered in the display list 800 (S35). Here, since the window information 62 of the window 5 is registered for the first time (S35: YES), the window information 62 is registered in the second line of the display list 800 (S42). However, the active information of the window information 62 of the window 5 is “YES”, and the active information of the window information 61 of the previously registered window 4 is “NO”. Therefore, the window information 61 and the window information 62 are replaced, the window information 62 is registered at the top position of the display list 800, and the window information 61 is registered on the second line.

  Next, it is determined whether or not all the window information registered in the detection lists 701 and 702 has been registered (S39). Since the window information 63 and 64 of the detection list 702 has not been processed (S39: NO), the first window 14 of the detection list 702 is set as the next processing target window (S43). Then, by sequentially registering the window information 63 and 64 of the detection list 702 by the same process as described above, the window information 62 of the window 5 is registered at the head position of the display list 800 as shown in FIG. The window information 64 of the window 15 is registered in the second line, the window information 61 of the window 4 is registered in the third line, and the window information 63 of the window 14 is registered in the fourth line. In this case, the layout order is set in descending order with respect to the registration order of the window information 61 to 64 in the display list 800.

  In this way, since all windows registered in the detection lists 701 and 702 are registered (S39: YES), the projection screen creation program stored in the projection screen creation program storage area 52c of the ROM 52 is then read and created. A projection screen creation process for creating a projection screen based on the displayed list 800 is executed (S40).

  Next, the projection screen creation process will be described. As shown in FIG. 15, in the projection screen creation process, first, the rearmost window is set as a drawing window in accordance with the layout order of the display list 800 shown in FIG. 10 (S55). In this embodiment, since the window 14 is set to the first in the layout order, the window 14 is set first as a drawing window. Next, the image data of the window 14 is drawn in a frame memory (not shown) provided in the computer 50 (S56). The image data of the window 14 is drawn based on the window X and Y coordinates of the window information 63. Next, it is determined whether or not drawing of all windows registered in the display list 800 has been completed (S57). Here, since the drawing of the window 14 has only been completed (S57: NO), the window 4 having the second layout order is set as the next drawing window (S58). Since the image data of the window 4 is drawn in the frame memory in the same manner as the drawing process of the window 14 (S56), the portion where the image data overlaps the window 14 is rewritten by the image data of the window 4. A window 4 is arranged on the front side of the. In this way, each image data is drawn in the frame memory in the order of the window 15 and the window 5. The image data drawn in the frame memory is processed by the video processing circuit 42, the lamp control circuit 44, etc., and windows 4, 5, 14, and 15 are simultaneously displayed in layers on the projection screen of the screen 100.

  Thereafter, returning to the flowchart shown in FIG. 13, it is determined whether or not the projection is finished (S41). Here, it is determined whether or not the projection of the display device is finished by the user. If it is determined that the projection is still continuing (S41: NO), the process returns to S31, and it is monitored again whether or not the data of the detection lists 701 and 702 has been received from the terminal devices 20 and 30 ( S31).

  By the way, when the data of the detection lists 701 and 702 transmitted from the terminal devices 20 and 30 are received again (S31: YES) and a window is already registered in the display list 800 (S32: YES), the display list 800 Among the various windows already registered in (1), the windows not registered in the newly transmitted detection lists 701 and 702 are deleted (S33). Thus, for example, a window that has been deleted from the display 24 can be deleted from the display list 800, so that the window can be deleted from the projection screen of the screen 100. In addition, when the terminal device 20 (or the terminal device 30) stops image output, the empty list 703 is transmitted from the terminal device 20 (or the terminal device 30), and thus the corresponding window information is deleted from the display list 800. (S33).

  For example, when the terminal device 20 is connected to the projector 10 before the terminal device 30 as the processing target window, the top window 4 of the detection list 701 transmitted from the terminal device 20 is set ( S34). Further, it is determined whether or not the window 4 is an unregistered window in the display list 800 (S35). If the window 4 is already registered in the display list 800 (S35: NO), the coordinate position of the window 4 is updated (S36). For example, when the position of the window 4 displayed on the display 24 is shifted to the left, the X and Y coordinates of the upper left vertex of the window 4 are changed, and the contents of the window information 61 are changed. The contents of the display list 800 are updated according to the coordinates.

  Subsequently, the drawing order update program stored in the drawing order update program storage area 52b of the ROM 52 is read, and the drawing order update process shown in FIG. 14 is executed (S37). In this drawing order update process, first, the newly received detection lists 701 and 702 are compared with the display list 800 (S50). Then, it is determined whether or not the window 4 is switched from the inactive state to the active state. (S51). Here, if the window 4 is still in an inactive state (S51: NO), the process ends as it is, and the process returns to the flowchart shown in FIG. It is determined whether all registered windows have been processed (S39). In order to process the remaining windows (S39: NO), the window 5 is set as the processing target window (S43), and the process returns to S35 and is repeated.

  Also, as shown in FIG. 14, in contrast to this case, when the window 4 is switched from the inactive state to the active state in the new detection list 701 (S51: YES), the window 4 that has entered the active state The window information 61 is changed to the head position of the display list 800, and the registration order of the window information of the other windows is lowered (S52). That is, as shown in FIG. 16, the window information 61 of the window 4 whose active information is switched from “NO” to “YES” is changed to the top position of the display list 800. Further, the window information 62 of the window 5 whose active information is switched from “YES” to “NO” is lowered to the second line, and the window information 64 of the window 15 is lowered to the third line. Thereby, in the displays 24 and 34 of the terminal devices 20 and 30, the window switched from the inactive state to the active state can be laid out in the foreground.

  Thus, the drawing order update process (S37) shown in FIG. 13 is completed, the image data of the window 4 is updated (S38), and it is determined whether all the windows registered in the detection lists 701 and 702 have been processed. (S39). When all the window information 61 to 64 registered in the newly received detection lists 701 and 702 are registered in the display list 800 (S39: YES), based on the newly created display list 800, Projection screen creation processing is executed (S40). Next, it is determined whether or not the user has instructed termination (S41). When the termination is instructed (S41: YES), the window projection operation on the screen 100 is terminated. On the other hand, if the termination is not instructed (S41: NO), the process returns to S31, and monitoring is performed again whether or not the data of the detection lists 701 and 702 has been received from the terminal devices 20 and 30 (S31).

  As described above, in the image display system 1 according to the first embodiment, various windows respectively displayed on the displays 24 and 34 of the terminal devices 20 and 30 are simultaneously displayed on the projection screen of the screen 100 by the projector 10. Layers can be displayed. In the terminal devices 20 and 30, detection lists 701 and 702 in which the window information 60 of various windows displayed on the displays 24 and 34 are registered are created based on the detection list creation program stored in the hard disk device 120. These detection lists 701 and 702 are wirelessly transmitted to the projector 10 side, and are used by the CPU 51 of the computer 50 provided in the projector 10 to create a projection screen. The CPU 51 creates a display list 800 based on the received detection lists 701 and 702, creates a projection screen based on the display list 800, and projects the projection screen onto the screen 100. Thereby, various windows respectively displayed on the displays 24 and 34 of the terminal devices 20 and 30 can be simultaneously displayed in layers on the projection screen of the screen 100.

  Furthermore, since the display list 800 is created based on the detection lists 701 and 702 created by the terminal devices 20 and 30, respectively, the display mode on the displays 24 and 34 is reflected on the projection screen of the screen 100 as it is. Can do. That is, there is a great feature in that the display modes of various windows on the projection screen of the screen 100 can be operated on the terminal devices 20 and 30 side. In the displays 24 and 34, the window information 60 of the minimized window is not registered in the detection lists 701 and 702, and may not be displayed on the projection screen of the screen 100 by designating the non-display of the window. it can.

  In the above description, the projector 10 shown in FIG. 1 corresponds to the “image display device” of the present invention, the screen 100 corresponds to the “display unit” of the present invention, and the terminal devices 20 and 30 correspond to the “image display device” of the present invention. The display 24, 34 corresponds to the “terminal screen” of the present invention, the CPU 51 that stores the display list 800 in the RAM 53 corresponds to the “window management means” of the present invention, the video processing circuit 42, the LCD The drive circuit 43, the lamp control circuit 44, the lamp 45, the illumination lens 46, the LCD 47, and the imaging unit 48 correspond to the “image output means” of the present invention. Further, the CPU 51 that executes the process of S31 in the flowchart shown in FIG. 13 corresponds to the “window information management unit” of the present invention, and the CPU 51 that executes the processes of S32 to S43 corresponds to the “layout image creation unit” of the present invention. To do. Further, the CPU 51 that executes the processing of S51 of the drawing order creation processing shown in FIG. 14 corresponds to the “active state switching detection means” of the present invention. Furthermore, the detection list creation program stored in the detection list storage area 121 of the hard disk device 120 of the terminal devices 20 and 30 corresponds to the “terminal control program” of the present invention.

  By the way, the image display system 1 which is this embodiment can be variously modified by the control of the CPU 11 of the terminal devices 20 and 30 or the control of the CPU 51 of the projector 10. Therefore, first, second, third, and fourth modified examples of the image display system 1 in which the control methods of the CPUs 11 and 51 are modified will be described below.

  First, a first modification will be described with reference to FIGS. In the first modification, image data of a portion that cannot be drawn by comparing the sizes of various windows respectively displayed on the displays 24 and 34 of the terminal devices 20 and 30 with the size of the drawable area of the frame memory 70 of the projector 10. It is characterized in that the amount of image data registered in the display list 800 can be reduced by truncating. Thereby, the image processing of the projector 10 can be promptly executed. Since the first modification has the same configuration as that of the image display system 1 of the above embodiment, the same components will be described with the same reference numerals. Further, regarding the control operation by the CPU 11 of the terminal devices 20 and 30 and the control operation executed by the CPU 51 of the projector 10, the detection list update processing executed by each CPU 11 of the terminal devices 20 and 30 and the CPU 51 of the projector 10. Therefore, only the display list creation process executed by the above-described detection list update process and the display list creation process will be mainly described.

  FIG. 17 is a conceptual diagram (first modification) of the detection list 711, FIG. 18 is a conceptual diagram (first modification) of the display list 810, and FIG. 19 is a flowchart of the detection list update process. 20 is a flowchart of the display list creation process (first modification), FIG. 21 is a flowchart of the image size cut-out process (first modification), and FIG. These are explanatory drawings (the 1st modification) of image size truncation processing.

  First, the detection list 711 will be described. As illustrated in FIG. 17, the window information 611 of the window 4 and the window information 612 of the window 5 displayed on the display 24 of the terminal device 20 are registered in the detection list 711. In the window information 611 and 612, size information indicating the size of the windows 4 and 5 is newly added to various data constituting the window information 61 and 62 (see FIG. 6) of the above embodiment. This size information indicates the window width (W) and the window height (H) by numerical values. Therefore, in the detection list 711, window information 611 including size information (100, 40) of the window 4 and window information 612 including size information (300, 100) of the window 5 are registered. Although not described in detail, a detection list (not shown) created on the terminal device 30 side is created in the same manner, and window information 613 (see FIG. 18) including size information of the window 14 displayed on the display 34, Window information 614 including size information of the window 15 (see FIG. 18) is registered.

  Next, the display list 810 will be described. As shown in FIG. 18, the display list 810 is created based on the detection list 711 created by the terminal device 20 and the detection list created by the terminal device 30. In the display list 810, window information 611 to 614 added with size information of the windows 4, 5, 14, and 15 are registered in a predetermined registration order. The registration order of the window information 611 to 614 is the same as the display list 800 (see FIG. 10) of the above embodiment. Therefore, the CPU 151 of the projector 10 can compare the size information of each of the window information 611 to 614 registered in the display list 800 with the drawing area of the frame memory 70. Can be truncated from data. Note that the image cutting process for cutting off the image data is executed by the CPU 51 of the projector 10, and an image cutting program for executing the image cutting process is stored in the ROM 52 (see FIG. 3).

  Next, processing executed by the CPU 11 of the terminal devices 20 and 30 will be described with reference to the flowcharts of FIGS. Since the same processing is executed in both terminal devices 20 and 30, only the processing on the terminal device 20 side will be described here. In the first modification, the same detection list creation process (see FIG. 11) as in the above embodiment and a detection list update process (see FIG. 19) different from the above embodiment are executed. The detection list update process shown in FIG. 19 will be mainly described.

  First, when the projection application is activated by a user operation, a detection list creation process shown in FIG. 11 is executed. First, a non-display designation check box 27 is displayed above the window frames 26 of all the windows 4 and 5 displayed on the display 24 (S1). Next, the detection list 701 stored in the detection list storage area 121 of the hard disk device 120 is initialized (S2).

  Next, detection list update processing is executed (S3). In this detection list update process, as shown in FIG. 19, first, the PCID of the terminal device 20 is acquired from the OS, and the PCID is registered in the detection list 701 (S60). Here, “001234556790”, which is the PCID of the terminal device 20, is registered in the detection list 711 (see FIG. 17). Next, the arrangement order (Z coordinate) of the windows 4 and 5 displayed on the display 24 is acquired (S61). Then, based on the Z coordinate acquired here, the window on the rearmost side registered in the detection list 711 is set (S62).

  Next, it is determined whether or not the window 4 is minimized on the display 24 (S63). If the window 4 is not minimized (S63: NO), since the window 4 is displayed on the display 24, it is subsequently determined whether or not the window 4 is designated not to be displayed ( S64). Here, it is determined whether or not the check box 27 displayed in the window frame 26 of the windows 4 and 5 is checked. If the check box 27 is not checked (S64: NO), the window 4 is not designated not to be displayed, and the process proceeds to the registration of the window information 61 of the window 4.

  Next, the registration work of the window information 61 of the window 4 is started. First, the window ID of the window 4 is acquired from the OS, and the window ID “1” is registered in the detection list 711 (S65). Then, the X and Y coordinates of the upper left vertex of the window 4 are acquired from the OS (S66). In this case, the X and Y coordinates “90, 50” of the upper left vertex are acquired and registered in the detection list 711. Furthermore, the active information of the window 4 is acquired from the OS and registered in the detection list 711 (S67). In this case, since the window 4 is in an inactive state, “NO” is registered. Then, “image data” of the window 4 is acquired and registered in the detection list 711 (S68). Furthermore, in the first modification, the size of the window 4 is acquired from the OS and registered in the detection list 711 (S69). In this case, the size (W, H) = (100, 40) on the display 24 of the window 4 is acquired and registered in the detection list 711. Thus, the registration work of the window information 611 of the window 4 is completed. Next, it is determined whether all the windows displayed on the display 24 have been processed (S70). Here, since the window 5 has not yet been processed (S70: NO), the window 5 arranged on the front side of the window 4 is set as the next processing target window (S71).

  When the window 4 is minimized on the display 24 (S63: YES), it is determined whether or not all windows being displayed have been processed (S19). Further, even if the window 4 is not minimized on the display 24 (S63: NO), even when the non-display is designated (S64: YES), the window information 61 is being displayed without being registered. It is determined whether or not all the windows have been processed (S19), and the window 5 arranged on the front side of the window 4 is set as the next processing target window (S71).

  By the way, when the window 5 is set as the next processing target window (S71), it is determined whether or not the window 5 is a window to be displayed on the screen 100, similarly to the processing of the window 4 described above (S63, S64). If the window is to be displayed (S63: NO, S64: NO), the registration work of the window information 612 of the window 5 is executed (S65 to S69). Specifically, “2”, “800, 150”, “YES”, “image data”, and “300, 100” are registered in the detection list 711 as the window information 612. Thereafter, it is determined again whether all windows displayed on the display 24 have been processed (S70). Here, since the processing of the windows 4 and 5 displayed on the display 24 has been completed (S70: YES), the detection list 711 is completed. Then, returning to the flowchart shown in FIG. 11, the detection list 711 is transmitted to the projector 10 (S4).

  Further, it is determined whether or not the projection application is closed by the user and the projection is finished (S5). If the projection application is closed by the user (S5: YES), an empty list 703 (see FIG. 9) is transmitted to the projector 10 as an end command (S6). On the other hand, when the projection application is continuously activated (S5: NO), the process returns to S2 and is repeated.

  Next, processing executed by the CPU 51 of the projector 10 will be described with reference to the flowcharts of FIGS. 14, 15, 20, and 21. In the first modification, the same processing is executed for the projection screen creation processing (see FIG. 14) and the drawing order creation processing (see FIG. 15) of the above-described embodiment. In the following description, the processing different from the above embodiment, that is, the display list creation processing shown in FIG. 20 and the image size truncation processing shown in FIG. 21 will be mainly described.

  When a start button (not shown) on the operation panel 49 is turned on, the display list creation program stored in the ROM 52 is read, and the display list creation process shown in FIG. 20 is executed. First, the display list 800 stored in the RAM 53 is initialized (S100). Next, it is determined whether detection list data has been received from the terminal devices 20 and 30 (S101). If the detection list data has not been received yet (S101: NO), the process returns to S101 to continue monitoring whether data has been received.

  When the detection list data is received from the terminal devices 20 and 30 (S101: YES), it is determined whether or not the window information is registered in the display list 810 (S102). Here, when the window information is not registered in the display list 800 (S102: NO), the process proceeds to the window information registration operation as it is. As the processing target window, for example, when the terminal device 20 is connected to the projector 10 before the terminal device 30, the top window 4 of the detection list 711 transmitted from the terminal device 20 is set ( S104). Next, it is determined whether or not the window 4 is registered in the display list 810 (S105). Here, when the window information 611 of the window 4 is registered for the first time (S105: YES), the image size truncation process, which is a feature of the first modification, is executed (S113).

  As shown in FIG. 21, in the image size cut-off process, first, the size of the projection screen is acquired (S90). Here, the size of the frame memory 70 shown in FIG. 22 is acquired. Further, the size of the drawable area 75 that can be drawn in the frame memory 70 is acquired from the acquired size of the frame memory 70 and the P point that is the X and Y coordinate position of the upper left vertex of the window 4. Then, the acquired size of the drawable area 75 is compared with the size of the window 4 (S92). Then, it is determined whether or not the size of the window 4 is included in the size of the drawable area 75 (S93). That is, when the upper left vertex of the window 4 is overlapped with the point P of the drawable area 75, it is determined whether there is an area of the window 4 that does not overlap the drawable area. Here, when the window 4 includes a protruding area that does not overlap the drawable area (S93: YES), the image data of the protruding area is not displayed on the projection screen of the screen 100.

  In this case, the non-displayable area that protrudes is discarded (S94). As a result, unnecessary image data that is not displayed on the projection screen of the screen 100 is eliminated, so that the amount of image data of the window information 611 registered in the display list 810 can be reduced. In this way, returning to the flowchart of FIG. 20, the window information 611 of the window 4 including the image data with unnecessary portions discarded is registered, and the window information 61 is registered at the top of the display list 800 (S114). As shown in FIG. 21, when all the sizes of the window 4 are included in the size of the frame memory 70 (S93: NO), all the image data of the window 4 can be displayed on the projection screen of the screen 100. Returning to the flowchart of FIG. 20, the window information 611 of the window 4 is registered at the head of the display list 800 (S114).

  Next, it is determined whether or not all windows registered in the detection list are registered (S110). If all the windows have not been registered yet (S110: NO), the window 5 of the detection list 711 is set as the next processing target window (S115). Further, the window 5 of the detection list 711 and the windows 5 and 15 of the detection list transmitted from the terminal device 30 are performed in the same manner as the registration operation of the window 4 described above (S105, S113, S114, S110). This process is repeated until the process is completed. Thus, as shown in FIG. 18, the window information 612 of the window 5 is registered at the head position of the display list 810, the window information 614 of the window 15 is registered in the second line, and the window information 611 of the window 4 is registered in the third line. Is registered, and window information 613 of the window 14 is registered in the fourth line. Since all the window information registered in the detection list is registered (S110: YES), the projection screen creation program stored in the projection screen creation program storage area 52c of the ROM 52 is read out and based on the display list 810. Then, a projection screen creation process is executed (S111). Note that the projection screen creation process (see FIG. 14) is the same as the process described above, and a description thereof will be omitted.

  Next, a case where detection list data is received again from the terminal devices 20 and 30 will be described. When the data of the detection list is received again from the terminal devices 20 and 30 (S101: YES), since the window information 611 to 614 is already registered in the display list 810 (S102: YES), it is registered in the display list 810. Of the various windows, the windows not registered in the newly transmitted detection list are deleted (S103).

  As the processing target window, for example, when the terminal device 20 is connected to the projector 10 before the terminal device 30, the top window 4 of the detection list 711 transmitted from the terminal device 20 is set ( S104). Further, it is determined whether or not the window 4 is an unregistered window in the display list 810 (S105). Since the window 4 is already registered in the display list 810 (S105: NO), the coordinate position of the window 4 is updated (S106). Then, in the first modified example, an image size cutting process is executed (S107). This image size cut-off process is exactly the same as the image cut-out process (see FIG. 21) in S113, and is displayed on the projection screen of the screen 100 by comparing the size of the frame memory 70 with the size of the window 4. It is possible to truncate the image data of the part that is not performed.

  Next, when this image cut-out process (S107) is completed, a drawing order update process is executed (S108), and the layout order of the windows switched to the active state is changed to the top position of the display list 810. Then, when the image data of the display list 810 is updated (S110: YES) and all the windows in the all detection list are processed (S110: YES), a projection screen creation process is executed (S111). Next, it is determined whether or not the projection is completed (S112). Here, it is determined whether or not the projection of the display device is finished by the user. If it is determined that the projection is still continuing (S112: NO), the process returns to S101, and it is monitored again whether the detection list data has been received from the terminal devices 20 and 30. On the other hand, when it is determined that the projection is finished (S112: YES), the process is finished.

  As described above, in the first modification of the image display system 1, the sizes of various windows respectively displayed on the displays 24 and 34 of the terminal devices 20 and 30 and the size of the drawable area of the frame memory 70 of the projector 10. The amount of image data registered in the display list 800 can be reduced by discarding the image data of the portion that cannot be drawn by comparing with. Thereby, the image processing of the projector 10 can be promptly executed.

  In the above description of the first modified example, the CPU 51 that executes the process of S91 of the image size cut-out process of FIG. 21 corresponds to the “displayable area detecting means” of the present invention, and the CPU 51 that executes the process of S92. Corresponds to the “size comparison means” of the present invention, the CPU 51 that executes the process of S93 corresponds to the “size determination means” of the present invention, and the CPU 51 that executes the process of S94 corresponds to the “image data truncation means” of the present invention. Is equivalent to.

  Next, a second modification will be described with reference to FIGS. In the second modified example, the projection screen of the screen 100 is divided based on the number of various windows (hereinafter referred to as the number of windows) displayed on the displays 24 and 34 of the terminal devices 20 and 30, respectively. On the other hand, various windows can be arranged and displayed. In addition, since the 2nd modification is also the structure similar to the image display system 1 of the said embodiment, it attaches | subjects and demonstrates the same code | symbol about the same component. Further, since the control operation by the CPU 11 of the terminal devices 20 and 30 is the same as that in the above embodiment, a description thereof will be omitted, and a display list creation process different from the above embodiment executed by the CPU 51 of the projector 10 (see FIGS. 26 and 27). ) And projection screen creation processing (see FIG. 28).

  FIG. 23 is a conceptual diagram (second modified example) of the window number / division number table 521, FIG. 24 is an explanatory diagram (second modified example) showing a window arrangement method, and FIG. FIG. 26 is a conceptual diagram (second modified example) of the updated display list 820, FIG. 26 is a flowchart of a display list creation process (second modified example), and FIG. 27 is a flowchart showing a continuation of the flowchart of FIG. FIG. 28 is a flowchart of the projection screen creation process (second modification).

  First, the relationship between the number of windows and the number of divisions of the projection screen will be described. In the second modification, the number of divisions of the projection screen is set in advance corresponding to the number of windows. These correspondences are shown in the window number / division number table 521 shown in FIG. 23 stored in the ROM 52 (see FIG. 3) of the projector 10. As shown in FIG. 23, in the window number / division number table 521, the division number of the projection screen is set corresponding to the number of windows. Specifically, the division number = 1 for the window number “1”, the division number = 2 for the window number “2”, the division number = 2 × 2 (4) for the window number “3-4”, For the number of windows “5-9”, the number of divisions = 3 × 3 (9), for the number of windows “10-16”, the number of divisions = 4 × 4 (16), for the number of windows “17-25” The number of divisions is 5 × 5 (25).

  For example, when the number of windows is “5” and the number of divisions = 3 × 3 (9) is set and then the number of windows is reduced to “4”, the number of divided screens on which nothing is displayed increases, so the number of divisions = 2. It is changed to x2 (4). On the other hand, when the number of windows increases from “5” to “10”, a window that cannot be displayed on the divided screen is generated, so the number of divisions is changed to 4 × 4 (16). Thereby, an appropriate division number corresponding to the number of windows can be set. Note that the number of divisions of the projection screen is stored in the RAM 53.

  Next, a method for arranging windows on the divided screen will be described. The arrangement order of windows is set in three steps, and is set based on the X coordinate and Y coordinate of each window. For example, there are four windows W1, W2, W3, and W4 registered in the entire detection list transmitted from the terminal devices 20 and 30, and the X and Y coordinates of each window are W1 (800, 150) and W2 ( 550, 61), W3 (90, 50), and W4 (35, 100). In this case, 2 × 2 (4) split screens are prepared, and windows are arranged on these four split screens. As shown in FIG. 24, first, as Step 1, the windows W1 to W4 are arranged in the X direction according to the X coordinates of the windows W1 to W4. In this case, the four windows are arranged in the order of W4, W3, W2, and W1 in order from the smallest X coordinate. Furthermore, since the number of screens in the Y direction is 2 in step 2, the first and second combinations, the third, and so on, from the four windows W4 to W1 arranged in sequence, two screens from the smallest X coordinate In the fourth combination, the respective Y coordinates are compared. That is, the respective Y coordinates are compared in the combination of W4 and W3 and the combination of W2 and W1.

  Then, as the last step 3, in each combination, the windows having a large Y coordinate are arranged in the upper stage, and the windows having a small Y coordinate are arranged in the lower stage. That is, since the Y coordinate of W4 is larger than the Y coordinate of W3, W4 is arranged in the upper stage and W3 is arranged in the lower stage. On the other hand, since the Y coordinate of W1 is larger than the Y coordinate of W2, W1 is arranged in the upper stage and W2 is arranged in the lower stage. In this way, four windows W1 to W4 are arranged on the 2 × 2 (4) divided screen, respectively. Note that the window arrangement method described above is merely an example, and a different arrangement method may be set.

  Next, the registration order of the windows W1 to W4 with respect to the display list 820 will be described. As shown in FIG. 25, the display list 820 is a list having the same contents as the display list 800 of the above embodiment. In the display list 820, the layout order is set in ascending order, and the windows W1 to W4 are arranged on the divided screens according to the layout order. Here, as shown in FIG. 24, in the 2 × 2 (4) split screen, the window arranged at the upper left is arranged first in the layout order, and the window arranged at the lower left is arranged in the second, upper right of the layout order. The window to be arranged is preset as the third in the layout order, and the window arranged at the lower right is preset as the fourth in the layout order. If the window W4 is arranged at the upper left of the divided screen, the window W3 is arranged at the lower left, the window W1 is arranged at the upper right, and the window W2 is arranged at the lower right, the display list 820 includes the window W4, the window W3, the window W1, and the window from the top. They are registered in the order of W2.

  Next, processing executed by the CPU 51 of the projector 10 in the second modification will be described with reference to the flowcharts of FIGS. In the terminal devices 20 and 30, detection lists 701 and 702 similar to those in the above embodiment are created and wirelessly transmitted to the projector 10 side. First, when a start button (not shown) on the operation panel 49 is turned on, the display list creation program stored in the ROM 52 is read, and the display list creation process shown in FIG. 26 is executed. First, the display list 800 stored in the RAM 53 is initialized (S120). At this time, the division number of the projection screen stored in the RAM 53 is also initialized to “1”. Next, it is determined whether or not the data of the detection lists 701 and 702 has been received from the terminal devices 20 and 30 (S121). Here, when the data of the detection lists 701 and 702 have not been received yet (S121: NO), the process returns to S121, and whether or not data has been received is continuously monitored.

  When the data of the detection lists 701 and 702 are received from the terminal devices 20 and 30 (S121: YES), the number of windows registered in the received detection lists 701 and 702 is acquired (S122). The acquired number of windows is stored in the RAM 53. Next, it is determined whether or not window information is registered in the display list 800 (S123). If the window information is not registered (S123: NO), the process proceeds to the window information registration operation as it is, and the top of the detection list 701 transmitted from the previously connected terminal device 20 as the processing target window. Window 4 is set (S127).

  On the other hand, when a window is already registered in the display list 820 (S123: YES), among the various windows registered in the display list 820, windows that are not registered in the newly transmitted detection lists 701 and 702 are displayed. Is deleted from the display list 820 (S124). That is, windows that do not register in the detection list among the windows having the same PCID are deleted. In this case, since the number of windows may decrease, it is determined whether or not the number of windows is smaller than the lower limit of the number of divisions (S125). In addition, when the terminal device 20 (or the terminal device 30) stops image output, the empty list 703 is transmitted from the terminal device 20 (or the terminal device 30), and thus the corresponding window information is deleted from the display list 820. (S124).

  Next, it is determined whether the number of windows is smaller than the lower limit of the number of divisions (S125). For example, when the number of windows is 4 and the number of divisions stored in the RAM 53 is 3 × 3 (9), the number of windows (4) is smaller than the lower limit (5) of the number of divisions (S125: YES). Therefore, based on the window number / division number table 521 stored in the ROM 52, the division number is changed to 2 × 2 (4) corresponding to the window number 4 (S126). Thereafter, as the processing target window, for example, when the terminal device 20 is connected to the projector 10 before the terminal device 30, the top window of the detection list 701 transmitted from the terminal device 20 is set (S127). ). If the number of windows is not smaller than the lower limit of the number of divisions (S125: NO), the process proceeds to S127 as it is.

  Next, as shown in FIG. 27, it is determined whether or not the window 4 is registered in the display list 800 (S128). Here, when the window information 61 of the window 4 is registered for the first time (S128: YES), the number of windows stored in the RAM 53 is compared with the number of divisions stored in the RAM 53, and the number of windows is determined as the number of divisions. It is determined whether it is larger than the upper limit (S135). Here, since the number of windows inevitably increases because unregistered windows are registered, it is determined whether or not all windows can be displayed on the divided screen of the divided number stored in the RAM 53.

  For example, when the number of windows is 4 and the number of divisions stored in the RAM 53 is 1, the number of windows is larger than the upper limit of the number of divisions (S135: YES). Therefore, based on the window number / division number table 521 stored in the ROM 52, the division number is changed to 2 × 2 (4) corresponding to the window number 4 (S136), and the window information 61 of the window 4 is displayed in the display list 800. It is registered at the head (S137). Further, when the number of windows is 6 and the number of divisions stored in the RAM 53 is 2 × 2 (4), the number of windows 6 is larger than 4 which is the upper limit of the number of divisions 2 × 2 (S135: YES). Therefore, also in this case, based on the window number / division number table 521 stored in the ROM 52, the division number is changed to 3 × 3 (9) corresponding to the window number 6 (S136). On the other hand, when the number of windows is 4 and the number of divisions stored in the RAM 53 is 2 × 2 (4), the number of windows is not larger than 4 which is the upper limit of the number of divisions (S135: NO). In this case, the window information 61 of the window 4 is registered at the top of the display list 800 without changing the number of divisions (S137).

  Subsequently, an enlargement / reduction process of the size of the image data of the window 4 is performed so that the size of the window 4 is adapted to the set size of the divided screen (S129), and the image data subjected to the enlargement / reduction process is performed. Is updated as image data of the window 4 (S130). If the window is not an unregistered window (S128: NO), the size of the image data in the window 4 is enlarged / reduced as it is (S129). Then, it is determined whether or not all window information registered in the detection lists 701 and 702 has been registered (S131). If the processing for all windows has not been completed yet (S131: NO), the next processing target window is set (S134), and the processing is repeated until the processing for all windows is completed. When all the windows have been processed (S131: YES), the projection screen creation program stored in the projection screen creation program storage area 52c of the ROM 52 is read out, and the projection screen is based on the created display list 800. A projection screen creation process (see FIG. 26) for creating a screen is executed (S132).

  Next, the projection screen creation process (S132) will be described. As shown in FIG. 28, in the projection screen creation process, in order to determine the arrangement order of the windows with respect to the divided screen, first, the arrangement order in the X-axis direction is determined as step 1 (S140). Here, when four windows are arranged on a 2 × 2 (4) divided screen, they are arranged in the X-axis direction based on these X coordinates. Subsequently, in step 2, in the combination of the two windows, the upper and lower arrangement order is determined based on the Y coordinate (S141). As a result, the arrangement of all the windows with respect to the divided screens is determined, and the registration order of the display list 820 is updated based on the arrangement order (S142).

  Then, it is determined whether or not there is a change in the arrangement position of the display list 820 (S143). That is, it is determined whether or not the arrangement has been changed between the past display list stored in the RAM 53 and the newly updated display list 820. Here, when there is no change in the arrangement position (S143: NO), only the image data of the received unregistered window is drawn and updated in the frame memory 70 (S148). On the other hand, when the arrangement position of the display list 820 is changed (S143: YES), the top window of the display list 820 is set as a drawing target (S144), and the image data of the window is drawn in the frame memory 70. (S145). Even when the display list 820 is newly registered, it is determined that the arrangement position of the display list 820 has changed.

  Next, it is determined whether or not drawing of all windows in the display list 820 has been completed (S146). If the drawing of all windows has not been completed (S146: NO), the drawing window is updated (S147), the process returns to S143, and the drawing process is performed for all windows. . When the drawing for all windows is completed (S146: YES), the process returns to the flowchart of FIG. 27 to determine whether or not the projection is completed (S133). On the other hand, if it is determined that the projection is still continuing (S133: NO), the process returns to S121 of the flowchart shown in FIG. 26, and again whether the detection list data is received from the terminal devices 20 and 30. Monitoring is performed (S121), and the process is repeated.

  As described above, in the second modification, the projection screen of the screen 100 is divided based on the number of various windows displayed on the displays 24 and 34 of the terminal devices 20 and 30, and various windows are displayed on the divided screens. Each can be displayed. Thereby, it is possible to compare the windows side by side on the projection screen of the screen 100.

  Next, a third modification will be described with reference to FIG. In the third modification, only one window can be displayed per terminal device. That is, when there are two terminal devices, only two windows are displayed on the projection screen of the screen 100. Since the third modification has the same configuration as that of the image display system 1 of the above embodiment, the same components will be described with the same reference numerals. Furthermore, since the difference from the above-described embodiment is only the control operation by the CPU 11 of the terminal devices 20 and 30, the description here will focus on the detection list creation processing of the terminal device 20. FIG. 29 is a flowchart (third modification) of the detection list creation process.

  The detection list creation process executed by the CPU 11 of the terminal device 20 in the third modification will be described with reference to the flowchart of FIG. First, when the projection application is activated by a user operation, the detection list creation program stored in the program storage area 122 is read, and the detection list creation process shown in FIG. 29 is executed. First, the detection list stored in the detection list storage area 121 of the hard disk device 120 is initialized (S150). Next, it is determined whether a window to be transmitted to the projector 10 has been determined (S151). Here, regarding a method for determining a window to be transmitted, for example, when the projection application is activated, the window in the foreground among the plurality of windows displayed on the display 24 is set. That is, since the window in the foreground is specified by comparing the Z-axis coordinates of the windows, that window is set as the transmission window. If the window to be transmitted has not yet been determined (S151: NO), the process returns to S151 and is repeated. If the window to be transmitted is determined (S151: YES), detection list update processing is executed (S152), and the window information of the window is registered in the detection list. This detection list update process is the same as the process described in the above embodiment.

  Then, the detection list in which the window information of the frontmost window is registered is wirelessly transmitted to the projector 10 (S153). Further, it is determined whether or not the projection application is closed by the user and the projection is finished (S154). If the projection application is closed by the user (S154: YES), an empty list 703 (see FIG. 9) is transmitted to the projector 10 as an end command (S156). On the other hand, when the projection application is continuously activated (S154: NO), it is determined whether or not the window is closed (S155). If the window has not been closed (S155: NO), the process returns to S152 and is repeated. If the window is closed, an empty list 703 (see FIG. 9) is transmitted to the projector 10 as an end command (S156), and the process ends.

  As described above, in the third modification, only one window can be displayed per terminal device. Thereby, for example, when there are a large number of terminal devices, it is possible to prevent a large number of windows from being overflowed and displayed on the projection screen of the screen 100.

  Next, a fourth modification will be described. This will be described with reference to FIGS. In the fourth modification, by adding non-display designation information indicating whether or not the window is designated to be hidden to the window information, the projector 10 can determine whether or not to hide the window. . In the above-described embodiment, the window that is checked and checked to be hidden and is not registered in the detection list is not registered in the detection list. However, in the fourth modification, the window that is specified not to be displayed is also registered in the detection list. The difference is that the window hiding function is executed.

  Since the fourth modification has the same configuration as that of the image display system 1 of the above embodiment, the same components will be described with the same reference numerals. Furthermore, the detection list 721 created by the terminal devices 20 and 30 is different from the projection screen creation process executed by the CPU 51 of the projector 10, and all other processing operations are the same. . Further, in the fourth modified example, in the detection list creation process executed by the CPU 11 of the terminal devices 20 and 30, the non-display designated window is also registered, so that the determination process of S 14 in the flowchart shown in FIG. 12 is not performed. In addition, a process for acquiring the non-display designation information is incorporated. 30 is a conceptual diagram (fourth modification) of the detection list 721, and FIG. 31 is a flowchart (fourth modification) of the projection screen creation process.

  First, the detection list 721 will be described. As shown in FIG. 30, the detection list 721 has the same configuration as the detection list 701 described in the above embodiment, and non-display designation information indicating whether or not a window is designated to be hidden is newly added. Is. The non-display designation is the same method as in the above embodiment, and is made by checking the check box 27 displayed at the top of the window frame 26 shown in FIG. If the window is designated not to be displayed, “YES” is set. If not specified, “NO” is set, and the window information is registered in the detection list 721 as component data and is stored in the projector 10. Wirelessly transmitted.

  Next, a projection process executed by the CPU 51 of the projector 10 will be described. Similar to the above embodiment, when a detection list is received from the terminal devices 20 and 30, a display list is created based on these. In the display list, the window information of the windows registered in each detection list 721 is registered, and when all the window information is registered in the display list, the projection screen creation process shown in FIG. 31 is executed.

  In the projection screen creation process, first, the rearmost window is set as a drawing window in accordance with the layout order of the display list (S160). Then, it is determined whether or not the window is designated as non-display (S161). Here, when the non-display designation information of the window is “NO” (S161: NO), since the window is not designated to be non-displayed, the image data of the window is drawn in the frame memory (S162). ). Then, it is determined whether drawing of all windows in the display list has been completed (S163). On the other hand, when the non-display designation information of the window is “YES” (S161: YES), since the window is designated to be non-displayed, the entire display list is not drawn without drawing the window in the frame memory. It is determined whether or not the window drawing is completed (S163). If drawing of all windows has not been completed yet (S163: NO), the window on the front side of the processed window is set as the drawing target window, and the process returns to S161 and is repeated. As described above, since the image data of the window designated not to be displayed is not drawn in the frame memory, it is possible to prevent the window designated not to be displayed on the projection screen of the screen 100 from being displayed.

  As described above, in the fourth modification, the projector 10 side includes the non-display designation information indicating whether or not the window is non-display designated in the window information, and the detection information on which the window information is registered. It can be controlled by. In the fourth modified example, the image data of the window that is designated not to be displayed is not drawn in the frame memory, so that the window that is designated not to be displayed on the projection screen of the screen 100 can be prevented from being displayed.

  Needless to say, the image display system of the present invention is not limited to the above-described embodiment, and various modifications are possible. For example, in the above-described embodiment, the window in the active state is laid out so as to be arranged in front of the inactive state, but the window in the inactive state may not be displayed. In this case, in the projection screen creation process shown in FIG. 31, by replacing the “non-display designation? (S161)” portion with “inactive state?”, The inactive window is drawn in the frame memory. Not.

  In the above embodiment, the window information 60 is registered in the detection lists 701 and 702, and the detection lists 701 and 702 are transmitted to the projector 10. For example, at the start and end of each projection, the projector 10 sends a terminal to the terminal. The window information may be managed by transmitting a predetermined command to the devices 20 and 30, or may be managed by a timer.

  INDUSTRIAL APPLICABILITY The image display device, terminal control program, and image display system of the present invention can be applied to an image display system that includes a display device that can display on a display unit and a terminal device that can transmit and receive data to and from the display device. It is.

1 is a conceptual diagram showing a configuration of an image display system 1. FIG. 3 is a block diagram showing an electrical configuration of a terminal device 20. FIG. 2 is a block diagram illustrating an electrical configuration of the projector 10. FIG. 3 is a conceptual diagram showing a storage area of a ROM 52. FIG. 3 is a conceptual diagram showing a configuration of window information 60. FIG. It is a conceptual diagram of the detection list 701. It is a conceptual diagram of the detection list 702. 6 is a conceptual diagram of an empty list 703. FIG. It is a conceptual diagram of the window 4 in which the check box 27 is displayed. 5 is a conceptual diagram of a display list 800. FIG. It is a flowchart of a detection list creation process. It is a flowchart of a detection list update process. It is a flowchart of a display list creation process. It is a flowchart of a drawing order update process. It is a flowchart of a projection screen creation process. It is a conceptual diagram of the display list 800 after the switch to an active state is detected. It is a conceptual diagram (1st modification) of the detection list 711. FIG. It is a conceptual diagram (1st modification) of the display list 810. It is a flowchart (1st modification) of a detection list update process. It is a flowchart (1st modification) of a display list creation process. It is a flowchart (1st modification) of an image size cut-off process. It is explanatory drawing (1st modification) of an image size cut-off process. It is a conceptual diagram (2nd modification) of the window number / division number table 521. It is explanatory drawing (2nd modification) which shows the arrangement | positioning method of a window. It is a conceptual diagram (2nd modification) of the display list 820 after an update. It is a flowchart (2nd modification) of a display list creation process. 27 is a flowchart (second modification) showing a continuation of the flowchart of FIG. It is a flowchart (2nd modification) of a projection screen creation process. It is a flowchart (3rd modification) of a detection list creation process. It is a conceptual diagram (4th modification) of the detection list 721. It is a flowchart (4th modification) of a projection screen creation process.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Image display system 10 Projector 20 Terminal device 24 Display 30 Terminal device 34 Display 60 Window information 100 Screen 701 Detection list 702 Detection list 800 Display list

Claims (13)

An image display device connected to each of a plurality of terminals that detects a window displayed on a terminal screen, acquires window information of the window, and outputs the window information to the outside,
Window information receiving means for receiving the window information from the terminal;
Window management means for managing a plurality of the window information received by the window information receiving means;
Layout image creating means for creating a display image by laying out the window based on the window information;
An image display device comprising: an image output unit that outputs the display image created by the layout image creation unit to a display unit. The window information is
XY coordinate data indicating the two-dimensional position of the window on the terminal screen;
Image data of the window;
A window identifier for identifying the window from other windows in the terminal screen,
The window management means stores the window information received from the terminal together with a terminal identifier for identifying the terminal;
The layout image creating means lays out the window so that the window is arranged at the coordinate position of the XY coordinate data, and creates the display image using the image data of the window. The image display device according to claim 1. The window information includes active information indicating whether the window is in an active state or an inactive state on the terminal screen,
The layout image creating means overlaps a plurality of the windows, and lays out the active state window by placing it in front of the display image with respect to the inactive state window. 3. The image display device according to 1 or 2. The window information includes active information indicating whether the window is in an active state or an inactive state on the terminal screen,
The image display apparatus according to claim 1, wherein the layout image creating unit lays out only the window in the active state. Active state switching detection means for detecting switching of the window from the inactive state to the active state according to the active information,
When the active state switching detection unit detects the switching of the window to the active state, the layout image creation unit arranges the window that has been switched to the active state in the foreground and performs layout. The image display device according to claim 3. The window information includes size information indicating a size of the window on the terminal screen,
A size acquisition means for acquiring the size of the window based on the size information;
Displayable area calculating means for calculating a displayable area in which the window can be displayed in the display image from the size of the display image and the coordinate position of the window arranged according to the layout;
A size comparison unit that compares the displayable region calculated by the displayable region calculation unit with the size of the window acquired by the size acquisition unit;
Size determination means for determining whether or not the size of the window is larger than the size of the displayable area according to a comparison result of the size comparison means;
When the size determining means determines that the size of the window is larger than the size of the displayable area, the image data truncation that cuts off the portion of the image data of the window that protrudes from the displayable area. The image display apparatus according to claim 2, further comprising: means. The window information is
XY coordinate data indicating the two-dimensional position of the window on the terminal screen;
Image data of the window;
A window identifier for identifying the window from other windows in the terminal screen,
The window management means stores the window information received from the terminal together with a terminal identifier for identifying the terminal;
The layout image creating means counts the number of windows based on the window information received by the window information receiving means, divides the display area of the display unit based on the number of windows, and divides the window into each of the divided screens. The image display apparatus according to claim 1, wherein the plurality of windows are laid out based on XY coordinate data of the windows so that each of the images is displayed. The window information includes hidden information indicating whether or not to hide the window,
The image display device according to claim 1, wherein the layout image creating unit does not lay out a window whose non-display information indicates non-display. A terminal control program for causing a computer to function as the terminal according to claim 1,
Detecting the window displayed on the terminal screen and obtaining the window information of the window;
A terminal control program comprising: a second step of outputting the window information acquired in the first step to the outside. In the second step,
10. The detection list of the window detected in the first step is created, the window information is set in the detection list for each window, and then the detection list is output to the outside. The terminal control program described in 1.   11. The terminal control program according to claim 10, wherein, in the second step, the window information of the window that is designated not to be displayed on the terminal screen is not set in the detection list.   The terminal control program according to claim 10 or 11, wherein, in the second step, the window information of the window minimized on the terminal screen is not set in the detection list.   An image display system comprising: the image display device according to any one of claims 1 to 8; and a terminal having the terminal control program according to any one of claims 9 to 12.

Images