JP2005107546A - Interactive display device - Google Patents

Abstract

An interactive display device capable of interactively displaying a large amount of information while avoiding a case where an effective display area on a screen of a display board is limited is realized.
A display board, display control means for performing display control relating to virtual display using a plurality of layers as subframes, command input means, command analysis means, and an entire display area of the display board. Display control means 1010 for executing subframe display control using content corresponding to the plurality of layers.
[Selection] Figure 10

Description

  The present invention relates to a display device used for an advertising display board, a guide board installed in a street, a shopping mall, or a department store, and in particular, includes a center system, a terminal-side display board, and a communication line connecting them, and a user Dialogue with an interactive function that displays the distribution and display of content typified by still images, text information, and moving images in response to input (demand) from the center system or display board interactively The present invention relates to a mold display system.

  Generally, conventional display boards used for advertising display boards, street and shopping malls, and information boards installed in department stores are equipped with illumination means such as fluorescent lamps in the frame as shown in FIG. A hardware structure in which a translucent panel (panel such as acrylic) printed with advertising information such as store names and photos and guidance information using transparent ink on the surface is fixed by covering the front of the frame It has become.

  However, with such a display board, there is a problem that a quantitative judgment (that is, whether it is useful for the viewer) or an advertisement effect cannot be measured with respect to the installed advertisement board.

  In order to solve such a conventional problem, as shown in FIG. 21, a television camera (image input means in FIG. 21) is provided on the top of the advertising board, and the viewer of the advertising board is processed by image processing. A conventional technique for counting (that is, a person viewing an advertising board) is known.

  However, in such a conventional technique, there is a problem in that determining the attributes of a person with a television camera requires a large-scale device.

  In addition, there is an image input / output system that uses a CRT display, a plasma display, or an LCD as a display board and inputs a command using a touch panel on the surface as shown in Japanese Patent Publication No. 5-75124 (see FIG. 22).

That is, this prior art image input / output system inputs characters and figures as image information by drawing with a finger, and is constructed by baking a transparent conductive film so that the resistivity is uniform on both front and back surfaces of glass. A resolution touch panel is placed on the screen of the display device, and a coordinate detection device that converts the touch position of the touch panel with a finger into X and Y coordinate values and a coordinate signal sent from the coordinate detection device are drawn on the touch panel And a CPU for displaying the corresponding characters and figures on the CRT display device, and the screen of the display device is composed of a combination of an image input / output surface and a menu surface. It consists of a part that displays figures drawn with your finger on the touch panel, and the menu surface has a number of operation keys that allow you to send commands to the CPU. It is constituted by force parts.
Japanese Patent Publication No. 5-75124

  However, the above-described conventional technology has a problem that the effective display area on the screen is limited, and as a result, a large amount of information cannot be displayed.

  An object of the present invention is to solve such a conventional problem, and it is possible to interactively display a large amount of information while avoiding a case where the effective display area on the screen of the display board is limited. Compared to the square matrix arrangement, the gap between the light emitting elements (mold light emitting display elements) can be reduced, and the intermediate gap between the four adjacent light emitting elements can be reduced to improve the integration degree of the light emitting elements. The object is to realize an interactive display device.

  An object of the present invention is to realize an interactive display device capable of displaying advertisement effects matching viewer attributes and movement and contents with high viewer satisfaction on the display board at the best timing.

The invention according to claim 1 made to solve the above problem is an interactive display device used for a guide board for supporting viewing of content,
A display board to display to viewers;
Display control means for performing display control related to virtual display using a plurality of layers as subframes;
Command input means for receiving a command for changing contents interactively or a virtual display command for instructing subframe display from a viewer;
Analyzing means for analyzing the instruction content of the input command;
Reading means for reading content corresponding to the plurality of layers according to the analysis information;
An interactive display device comprising: display control means for executing subframe display control using content corresponding to the plurality of layers with respect to the entire display area of the display board.

  According to the first aspect of the present invention, the command input means receives a command for changing contents interactively or a virtual display command for instructing subframe display from the viewer, and the analysis means inputs the command in response thereto The display control means performs display control related to virtual display using a plurality of layers as sub-frames on the display board in accordance with the instruction content of the received command, so that the effective display area for the screen of the display board Can be avoided, and as a result, a lot of information can be displayed interactively.

The invention according to claim 2 is an interactive display device used for a guide board for supporting viewing of content,
A display board to display to viewers;
Display control means for performing display control related to virtual display using a plurality of layers as subframes;
A command input means for receiving a command for interactively changing the content on the center system side or the display board side or a virtual display command for instructing subframe display from the viewer;
The instruction content of the input command is analyzed, and when it is determined that the analyzed command is the virtual display command, the fact that a virtual display instruction using the subframe has occurred is output as analysis information. Command analysis means;
Various types of content are stored, and when a content output request is received, content storage means for reading out and outputting the content according to the output request;
The content storage unit is instructed to read the content corresponding to the plurality of layers according to the analysis information, and the content corresponding to the plurality of layers received from the content storage unit is output to the display control unit. Display selection means,
The display control means is an interactive display device that performs sub-frame display control using content corresponding to the plurality of layers with respect to an entire display area of the display board.

  According to the second aspect of the present invention, the command input means receives from the viewer a command for changing the content interactively on the center system side or the display board side, or a virtual display command for instructing subframe display. The command analysis means analyzes the instruction content of the input command in response to the analysis information that the virtual display instruction using the subframe has occurred when it is determined that the analyzed command is a virtual display command. In response to this, the display control means performs display control related to virtual display using a plurality of layers as subframes on the display board, so that the effective display area on the screen of the display board is limited. Can be avoided, and as a result, a lot of information can be displayed interactively

  According to the present invention, it is possible to avoid a case where the effective display area on the screen of the display board is limited, and as a result, it is possible to display a lot of information interactively.

  Hereinafter, embodiments of the present invention will be described with reference to the drawings.

(First Reference Example)
FIG. 1 is a functional block diagram for explaining the entire system of the interactive display device 10 of the first reference example.

  The overall system shown in FIG. 1 includes a center system (distribution management host computer 208), a terminal 106 (interactive display device 10) display board 106 (CRT display device 106B), and a communication line (public network 206) connecting them. In response to an input (demand) from the viewer 30, the distribution management host computer 208 or the display board 106 distributes and displays content (particularly, multimedia advertisement) 40 represented by still images, text information, and moving images. An interactive media distribution / display system having an interactive function of displaying while changing interactively, and installed in an advertising display board 106, a street, a shopping mall, or a department store, and supports viewing of content 40 Used for information boards.

  On the terminal side, an interactive display device 10 having a CRT (a plasma display to be described later), a touch panel 1066 attached to the front surface of the display board 106, a touch panel 1066 for detecting the position pressed by the viewer 30 with a finger, and coordinate detection The apparatus 1067 is provided with a storage device (hard disk) 204 that stores various data, reads out and outputs them in a timely manner, and a CPU (personal computer (PC)) 203 that controls them centrally.

  Each of these devices is equipped with a high-speed serial communication interface represented by IEEE (American Institute of Electrical and Electronics Engineers) 1394, or a parallel communication interface represented by SCSI, and is interconnected. As a result, data sharing is achieved.

  The CPU (PC) 203 has a communication interface (communication I / F) 205 for performing data communication (transmission / reception of contents 40) with the distribution management host computer 208 via the public network 206, and a terminal using an ID card. Wireless card ID recognition device 202 for managing security related to usage rights, image recognition device 200 for identifying specific image information from an input image from an image input device (image input means 101, video camera described later) Specifically, an attribute determination unit 102 and an image comparison unit 180) described later are connected.

  The wireless card ID recognition device 202 is provided with an antenna 201 for transmitting and receiving data for managing security.

  In this reference example, content 40 is exchanged with the distribution management host computer 208 via the Internet (public network 206) using an ISDN line. Therefore, a communication modem for ISDN line or a line control device such as DSU is used as the communication interface (communication I / F) 205 described above.

  The interactive display device 10 incorporated in such a network configuration has a hardware configuration centered on a display board 106, an image input unit 101, an attribute determination unit 102, and a storage unit 150 described later.

  Here, the display board 106 has a function of displaying to the viewer 30 who is the person who has watched the content 40, and various display devices such as a CRT, a plasma display, an LED display, and a liquid crystal display can be used.

  The image input means 101 has a function of photographing the viewer 30 of the content 40 and outputting it as a video signal 101a compliant with the format of a transfer packet defined in IEEE (American Institute of Electrical and Electronics Engineers) 1394. For this, an IEEE 1394 digital video camera is used.

  IEEE 1394 (also referred to as FireWire) is an interface standard that connects PCs and peripheral devices, and covers not only PC peripheral devices such as hard disks and printers, but also home appliances such as video cameras and audio products. It plays the role of integrating home appliances. Three types of transmission speeds of 100 MB / second, 200 MB / second, and 400 MB / second are defined. It supports hot plug-in that can be connected while the personal computer is turned on. Up to 63 units can be connected, and it has a plug-and-play function. In addition, the data transfer has two transfer methods, isochronous transfer and asynchronous transfer. Since isochronous transfer can send data (packets) in real time, it is expected as an interface for sending data such as images and sounds. On the other hand, in asynchronous transfer, data is divided and sent, and is used for data transfer of a hard disk or a printer.

  The IEEE 1394 digital video camera converts the image of the viewer 30 into a digital signal that conforms to the format of the transfer packet defined in the IEEE 1394, and generates a video signal 101a (hereinafter, IEEE 1394 digital video signal 101a). ing.

  The IEEE 1394 digital video signal 101a is packet-transferred to an information device connected to this digital bus by isochronous transfer.

  Therefore, there is an advantage that it is not necessary to provide an image processing mechanism for converting an analog image signal into a digital signal on the interactive display device 10 side. By diverting a highly versatile interface such as IEEE 1394, image data can be received from an AV device such as a digital camera 212 (described later) or a DVD, and the flexibility of the system can be improved. High compatibility with existing information resources can be realized.

  The storage unit 150 has a function of storing the attribute determination result 102b related to the content viewer 30. Specifically, the use of a hard disk is advantageous in terms of cost performance.

  FIG. 2 is a configuration diagram in which an IEEE 1394 digital video camera 101, an attribute determination unit 102, and a log storage unit 103 are added to a display board 106 that performs electrical display, such as a plasma display 106A, in the interactive display device 10 of the reference example.

  The attribute determination means 102 has a function of detecting that the movement of the moving object image formed based on the IEEE 1394 digital video signal 101a has decreased, and after viewing that the movement of the moving object image has decreased, It has a function of determining a person attribute related to the person 30 and generating attribute determination result information 102a, and a function of cutting out a person image based on the attribute determination result information 102a, and is realized by the above-described PC.

  The log storage unit 103 has a function of storing a temporal history of the person attribute determination process in the attribute determination unit 102 as a database together with time data, and is realized by the above-described PC and hard disk.

  FIG. 3 is an overall configuration diagram of a specific system of the interactive display device 10 of the first reference example of FIG.

  The entire system shown in FIG. 3 includes a distribution server 211 (distribution management host computer 208), a cache server 210, and an ISDN line 206 connecting them, and in response to an input (demand) from the viewer 30, a still image, text Interactive media distribution provided with an interactive function in which the distribution server 211 or the display board 106 interactively displays the distribution and display of information (particularly multimedia advertisements) 40 represented by information and moving images. A display system that is installed in an advertising display board 106, a street, a shopping mall, or a department store, and is used as a guide board that supports viewing of the content 40.

  The cache server 210 includes a plurality of interactive display devices 10,..., 10 (specifically, a wall-type interactive display device 10A or a floor-type interactive display via a digital bus such as an Ethernet (registered trademark) line. Device 10B) is connected.

  The wall-type interactive display device 10 </ b> A and the floor-type interactive display device 10 </ b> B may be connected so that the distribution server 211 can be directly accessed via the ISDN line 206 without passing through the cache server 210.

  Also, the cache disk provided in the distribution server 211 stores the presentation data 200a that is the contents 40 and the schedule data 200b that is the distribution schedule (distribution destination and distribution time) of the contents 40.

  Therefore, the distribution server 211 converts the presentation data 200a through the ISDN line 206 based on the schedule data 200b, and the cache server 210 and the interactive display devices 10,. It is transmitted to the interactive display device 10A and the floor type interactive display device 10B).

  FIG. 4 illustrates a high school girl who looks at the display board 106 in the interactive display device 10 of the first reference example.

  The display board 106 displays the content “weather forecast Yokohama” (weather information in the suburbs of Yokohama) 40 to the high school girl 32 passing by. The IEEE 1394 digital video camera converts the image of the passing high school girl 32 into a digital signal that conforms to the format of a transfer packet defined in IEEE 1394, and generates an IEEE 1394 digital video signal 101a. The IEEE 1394 digital video signal 101a is packet-transferred to an information device connected to this digital bus by isochronous transfer. The accumulation means 150 accumulates the attribute determination result 102b regarding the passing high school girl 32.

  The attribute determination means 102 determines the attribute of the person by determining the person attribute relating to the passing high school girl 32 after detecting that the movement of the image of the passing high school girl 32 formed based on the IEEE 1394 digital video signal 101a is reduced. Result information 102a is generated, and a person image is cut out based on the attribute determination result information 102a. The log storage unit 103 has a function of accumulating a temporal history of the person attribute determination process in the attribute determination unit 102 as a database together with time data, and is realized by the above-described PC.

  FIG. 5 is a conceptual diagram of feature extraction in the interactive display device 10 of the first reference example.

  It is known that the head has an attribute feature in the hairstyle and eyebrows. However, it is also known in the prior art that conditions such as a high-definition input image and head orientation are narrowed only by the head (face).

  Therefore, as shown in FIG. 5, the attribute determination unit 102 of the present reference example, as the second feature point of the person, the determination centering on the distinction of wearing the trousers and the skirt at the knee, and the third feature As a point, the determination is made based on the characteristics of the footwear, that is, the distance from the ground to the ankle.

  Specifically, the high school girl's personal attributes are set to determine whether he is wearing a skirt (bare feet), whether he is wearing loose socks, whether he is wearing a uniform, and a bag (handbag). It is used whether or not it is possessed.

  In Figure 5, the high school girl is wearing a skirt (○ in the figure), loose socks (○ in the figure), no uniform (× in the figure), and carrying a bag (handbag). (○ in the figure), the determination of the high school girl's personal attributes is skirt (○), loose socks (○), uniform (×), bag (handbag) (○). As a result, the attribute determination unit 102 determines the person attribute relating to the passing high school girl 32 after detecting that the movement of the image of the passing high school girl 32 has become small, and the determination of the person attribute is performed using a skirt (○ ), Loose socks (◯), uniform (×), bag (handbag) (◯), and attribute determination result information 102a is generated. The log storage means 103 is a time history of the person attribute determination processing in the attribute determination means 102, that is, when, skirt (◯), loose socks (○), uniform (×), bag (handbag) (○), etc. It is accumulated as a database whether the high school girl with the personal attribute has stopped in front of the display board 106.

  FIG. 6 is a first example of a screen configuration of the display panel 106 in the interactive display device 10 of the first reference example.

  Examples of the content 40 distributed from the distribution management host computer 208 to the wall-type interactive display device 10A and the floor-type interactive display device 10B via the ISDN line 206 include events, event guides, advertisements, and department store information. Multimedia information such as news provided by newspaper publishers (information combining still images, text information, moving images, and audio) is prepared.

  In addition, as shown in Fig. 6, the department store has information on “BF famous store streets”, “1F cosmetics and shoes”, “2F women's clothing and specialty stores”, “3F watches / glasses, stationery, “Book” and “4F Restaurant Street”.

  The interactive display device 10 receives an input (demand) from the viewer 30 via a touch panel 1066 attached to the front surface of the display board 106, and uses the coordinate detection device 1067 to determine a position pressed by the viewer 30 with a finger. In response to this, the distribution management host computer 208 or the display board 106 interactively changes the distribution and display of the content (particularly, multimedia advertisement) 40 typified by still images, text information, and moving images. And viewing the content 40 is supported.

  For example, the interactive display device 10 receives an input (demand) from the viewer 30 via the touch panel 1066 attached to the front surface of the display board 106, and the viewer 30 presses with a finger using the coordinate detection device 1067. Detect the position ("Touch the finger on the screen, the mark will appear. Please lightly knock the place you want to see"), and accordingly, events, event information, advertisements, department store information Display multimedia information such as news provided by newspaper companies.

  When the viewer 30 designates an object on each floor of the department store, as shown in FIG. 6, “BF famous store street” guidance, “1F cosmetics, shoes” guidance, “2F women's clothing, specialty store” "3F Clock / Glass, Stationery / Books", "4F Restaurant Street", etc. are displayed.

  FIG. 7 is a second example of the screen configuration of the display panel 106 in the interactive display device 10 of the first reference example.

  For the same purpose, the viewer 30 touches the touch panel 1066 displayed as “When you touch your finger on the screen, a mark appears. Please lightly knock on the place you want to see.” Thus, weather forecast information, movie / product advertisements, notifications from government offices, and the like are displayed on the display board 106 in an interactive manner.

  FIG. 8 illustrates how the interactive display device 10 according to the first reference example determines the respective attributes of the head, knee, and footwear for attribute determination. FIG. 9 illustrates an operation of applying the person templates 1021 and 1022 from a small range when the person is cut out from the image in the interactive display device 10 of the first reference example.

  The attribute determination means 102 described above uses the characteristics of a plurality of parts of a person as a person template (for example, a male template 1021 or a female template 1022 described later), and in addition to the person templates 1021 and 1022 expressing each part. Thus, the large person templates 1021 and 1022 are used from the small person templates 1021 and 1022.

  In this reference example, as shown in FIG. 8, as the feature extraction (person attribute determination) of a plurality of parts of a person, the feature extraction of the person's head, the feature extraction of the person's knee, the feature extraction of the person's footwear Three are performed together. Also, as shown in FIG. 9, a male template 1021 and a female template 1022 are used as the person template. In the male template 1021, the male template 1021 having a larger size than the male template 1021 having a smaller size is used in contrast to the male template 1021 representing the head, knees, and footwear of the male. Similarly, in the female template 1022, the female template 1022 having a larger size than the female template 1022 having a smaller size is used for the female template 1022 expressing the head, knees, and footwear of a man. Thus, after the movement of the moving object is reduced (the image frame is always in a stationary state but there is no image blur), the person is cut out with the smaller size of the person templates 1021 and 1022 prepared in advance. Thus, the person image is cut out.

  As a result, the attribute determination unit 102 moves from the small male template 1021 (female template 1022) to the large male template 1021 (female template 1022) with respect to the male template 1021 (female template 1022) representing each part. A function for executing pattern matching with a moving object in order, and determining attribute of the viewer 30 based on a pattern matching result for a male template 1021 (female template 1022) for each part and generating attribute determination result information 102a The human image is cut out based on the function to be performed and the attribute determination result information 102a.

  That is, when detecting a person attribute, the attribute determination unit 102 uses the characteristics of a plurality of parts of a person as the person templates 1021 and 1022, and the person template 1021 having a smaller size than the person templates 1021 and 1022 expressing each part. , 1022, and pattern matching with the moving object in order from the large person templates 1021 and 1022, the stationary viewer 30 may be the target of attribute determination in addition to the viewer 30 walking around. it can.

  Further, after the attribute determining means 102 detects that the movement of the moving object image formed based on the IEEE 1394 digital video signal 101a has become small, the attribute determining means 102 is based on the pattern matching results for the person templates 1021 and 1022 for each part. Then, the person attribute relating to the viewer 30 is determined to generate the attribute determination result information 102a, and the person image is cut out based on the attribute determination result information 102a, so that the person is in a free position and is still. Attributes can be detected for the viewer 30, and in addition to the viewer 30 as a moving object, attributes can be extracted for the viewer 30 who enters the target area and then stops still. In addition, although the head's attribute features appear in the hairstyle and eyebrows, only the head (face) It is possible to increase the degree of freedom for the shooting conditions such as the resolution conditions and viewers 30 orientation of the input image will be able to attribute extraction using multiple sites instead.

  As described above, according to the first reference example, the IEEE 1394 digital video signal 101a based on the IEEE 1394 format is used as the IEEE 1394 digital video camera 101 that captures the person who has watched the content 40. Is unnecessary.

  Further, after the attribute determination means 102 detects that the movement of the moving object image formed based on the IEEE 1394 digital video signal 101a has become small, the attribute determination result information 102a is determined by determining the person attribute relating to the viewer 30. Therefore, in addition to the viewer 30 who walks around, the viewer 30 in a stationary state can also be the target of attribute determination.

  Further, when detecting a person attribute, it becomes possible to detect the attribute even for a viewer 30 who is a person in a free position and is in a stationary state, and in addition to the viewer 30 as a moving object. Thus, it becomes possible to extract attributes for the viewer 30 who enters the target area and then stops still.

  As a result, it is possible to measure quantitatively the installed advertisement board (that is, whether it is useful for the viewer 30) or to measure the advertising effectiveness.

(First embodiment)
FIG. 10 is a functional block diagram of the interactive display device 10 according to the first embodiment, and is a functional block diagram for performing subframe control according to an input command. In addition, about the part same as what was already described in the reference example, the same code | symbol is attached | subjected and the overlapping description is abbreviate | omitted.

  As described above, the interactive display device 10 shown in FIG. 10 is an interactive display device 10 that is installed in an advertising display board 106, a street, a shopping mall, or a department store and used as a guide board that supports viewing of content. The display panel 106, the display control means 105, the command input means 107, and the command analysis means described above are characterized in that virtual display control is performed, sub-frame display is performed on the display surface, and the effective display area is enlarged. 108, a hardware configuration centering on the content storage means 130 and the display selection means 1010.

  The display control means 105 has a function of performing display control related to virtual display using a plurality of layers as subframes.

  The command input means 107 has a function of receiving from the viewer 30 a command for interactively changing the content 40 on the center system 208 side or the display board 106 side or a virtual display command 107 a for instructing subframe display. The touch panel 1066 and the coordinate detection device 1067 are realized.

  The command analysis unit 108 analyzes the instruction content of the input command, and analyzes that the virtual display instruction using the subframe is generated when it is determined that the analyzed command is the virtual display command 107a. And is realized by the above-described PC.

  The content storage unit 130 stores various types of content 40, and has a function of reading out and outputting the content 40 corresponding to the output request when receiving the output request of the content 40, and is realized by the hard disk described above. Yes.

  The display selection unit 1010 has a function of instructing the content storage unit 130 to request to read the content 40 corresponding to a plurality of layers according to the analysis information, and controls the display of the content 40 corresponding to the plurality of layers received from the content storage unit 130. It has a function of outputting to the means 105 and is realized by the aforementioned PC.

  In the present embodiment, each of the plurality of layers is held in each of the layer 1 display memory 1062, the layer 2 display memory 1063, and the layer 3 display memory 1064.

  In such a hardware configuration, the display control unit 105 performs subframe display control using the content 40 corresponding to a plurality of layers with respect to the entire display area of the display board 106.

  Specifically, the display control means 105 has the content 40 corresponding to the layer held in the layer 1 display memory 1062 and the layer held in the layer 2 display memory 1063 with respect to the entire display area of the display board 106. Subframe display control using the content 40 corresponding to the content 40 and the content 40 corresponding to the layer held in the layer 3 display memory 1064 is executed.

  FIG. 11 illustrates an operation of displaying a subframe on the display board 106 in the interactive display device 10 of the first embodiment.

  As shown in FIG. 11A, the touch panel 1066 is provided in response to a message “Please touch here for details” displayed below the touch panel 1066 attached to the front surface of the display board 106. When the viewer 30 presses the touch command input unit 1061 with a finger, the coordinate detection device 1067 described above detects the pressed position.

  In response to this, the command analysis unit 108 analyzes the instruction content of the input command based on the position data from the coordinate detection device 1067 described above, and determines that the analyzed command is the virtual display command 107a. The fact that a virtual display instruction using a subframe has occurred is output as analysis information.

  In response to this, the display selection unit 1010, as shown in FIG. 11B, in accordance with the analysis information from the command analysis unit 108, the content 40 corresponding to the layer held in the layer 1 display memory 1062, A request to read the content 40 corresponding to the layer held in the layer 2 display memory 1063 or the content 40 corresponding to the layer held in the layer 3 display memory 1064 is instructed to the content storage means 130, and further the content storage The corresponding content 40 (subframe display target content 40) received from the means 130 is output to the display control means 105.

  In response to this, the display control means 105, as shown in FIG. 11B, displays the subframe display target content 40 (in the figure, “1st floor men's shoes”, “2nd floor ready-to-wear”, “3rd floor children's clothing”). , “4th floor kitchen utensils”, “5th floor restaurant street”) are displayed in an overlay on the display screen (the female screen in the figure). Here, the sub-frame display means one form of multi-window display used in a PC or the like.

  As described above, according to the first embodiment, the command input means 107 is a command for interactively changing the content 40 on the center system 208 side or the display board 106 side, or a virtual display command for instructing subframe display. 107a is received from the viewer 30, and in response to this, the command analysis means 108 analyzes the instruction content of the input command, and determines that the analyzed command is the virtual display command 107a. The fact that a display instruction has occurred is output as analysis information, and in response to this, the display control means 105 performs display control related to virtual display using a plurality of layers as subframes. The case where the effective display area for the screen of the board 106 is limited Can, as a result, it is possible to display more information interactively.

(Second reference example)
FIG. 14 is a functional block diagram of the interactive display device 10 of the second reference example, and shows a state in which the content 40 to be displayed is changed according to the attribute determination result. In addition, the same code | symbol is attached | subjected about the part same as what was already described in the 1st reference example or 1st Embodiment, and the overlapping description is abbreviate | omitted.

  As shown in FIG. 14, the interactive display device 10 shown in FIG. 14 is characterized in that the content 40 is selected from the determination result based on the attribute and the optimal content is displayed on the viewer 30. 106, the above-described IEEE 1394 digital video camera 101, the above-described attribute determination unit 102, in addition to the content storage unit 130 and the selection unit 110, the hardware configuration.

  In addition to the above-described functions, the attribute determination unit 102 uses the image formed based on the IEEE 1394 digital video signal 101a to determine a person attribute related to the viewer 30 and generate attribute determination result information 102a. A function of cutting out a person image based on the attribute determination result information 102a is provided.

  The content accumulating unit 130 has a function of accumulating the content 40 including at least one of a still image and a moving image as viewer attribute classification data 110a that is classified in advance for each viewer attribute. Is realized by the hard disk described above.

  The selection unit 110 has a function of selecting and reading out the content 40 to be displayed from the viewer attribute classification data 110a from the content storage unit 130 in accordance with the attribute determination result information 102a. It is realized with a PC.

  FIG. 12 is a storage diagram of the viewer attribute classification data 110a used in the interactive display device 10 of the second reference example.

  In the interactive display device 10 of the second reference example, content 40 is prepared as shown in FIG. 12 using the attributes of the viewed person and divided in advance for each attribute.

  Here, as the viewer attribute classification data 110a of this reference example, as shown in FIG. 12, a male content table 111 and a female content table 112 are prepared.

  The viewer attributes constituting the male content table 111 are whether or not a skirt is worn as shown in FIG. 5 and whether or not socks are bare feet.

  On the other hand, the viewer attributes constituting the female content table 112 are whether or not a skirt is worn and whether or not socks are bare feet as shown in FIG.

  In this case, the content accumulating unit 130 accumulates the content 40 including at least one of a still image and a moving image as a male content table 111 and a female content table 112 that are divided into males and females in advance. ing.

  As described above, the attribute determination unit 102 determines the personal attribute (male or female) regarding the viewer 30 (male or female) using the image formed based on the IEEE 1394 digital video signal 101a, and the attribute determination result. Information 102a is generated, and a person image is cut out based on the attribute determination result information 102a.

  According to the attribute determination result information 102a, the selecting means 110 is a content 40 relating to a tie, polo shirt or belt for men to be displayed from the content table 111 for men and the content table 112 for women, or a lipstick for women. The content 40 relating to the blouse or belt is selected and read from the content storage means 130.

  FIG. 13 shows a state where display is performed by the time table 209 used in the interactive display device 10 of the second reference example.

  In addition to the content 40 described above, the content storage unit 130 of this reference example also stores various routinely displayed content 40 corresponding to the time table 209.

  As shown in FIG. 13, such routinely displayed content 40 includes, for example, [display (content 40 # 101 = “time signal”) at time (6: 59.55)], [time ( 7: 00.00) (content 40 # 1 = "weather forecast Yokohama")], [display (content 40 # 2 = "weather forecast Tokyo") at time (7: 00.05)] , [Display (content 40 # 3 = “weather forecast Shizuoka”) at time (7: 00.10)]], [content 40 # 4 = “Chinese cuisine of ○○ .., [Display (content 40 # 101 = "time signal") at time (23: 59.55)], and the like.

  For this reason, the interactive display device 10 displays (content 40 # 101 = “time signal”) at time (6: 59.55) according to the time, and then at (7: 00.00) at time (7: 00.00). Content 40 # 1 = "weather forecast Yokohama") is displayed, and then (content 40 # 2 = "weather forecast Tokyo") is displayed at time (7: 00.05), followed by time (7: 00.10) displays (content 40 # 3 = “weather forecast Shizuoka”), and then displays (content 40 # 4 = “Chinese food ○○ breakfast”) at time (7: 0.015). Then, (content 40 # 101 = "time signal") is routinely displayed at time (23: 59.55).

  As described above, according to the second reference example, the attribute determination unit 102 generates the attribute determination generated by determining the person attribute related to the viewer 30 using the image formed based on the IEEE 1394 digital video signal 101a. The person image is cut out based on the result information 102a, and the selection unit 110 displays the image from the viewer attribute classification data 110a stored in the content storage unit 130 according to the attribute determination result information 102a. Since the content 40 to be selected (that is, suitable for the detected personal attribute) is selected and read from the content storage means 130, unlike the general TV broadcast (ON-AIR), it matches the attributes and movements of the viewer 30 (I.e. high advertising effectiveness and viewer satisfaction) In it will be able to display.

(Third reference example)
FIG. 15 is a functional block diagram of the interactive display device 10 of the third reference example, and shows a state in which a destructor is recorded by the impact detection sensor 160. In addition, about the part same as what was already described in the 1st, 2nd reference example and 1st Embodiment, the same code | symbol is attached | subjected and the overlapping description is abbreviate | omitted.

  In the interactive display device 10 of the third reference example, the impact detection sensor 160 continuously captures images from the buffer area before Δt time from the buffer time (it is possible to skip frames) to the storage unit 140 and displays the images. It is characterized in that the breakage state of the board 106 is monitored (identifying a damaged person), and the display board 106, the impact detection sensor 160, the IEEE1394 digital video camera 101, the storage means 150, and the storage unit 150 described above. The hardware configuration is centered on the attribute determination means 102.

  The impact detection sensor 160 has a function of monitoring whether or not an impact force is applied to the display board 106 by the vandalizer 31 and a function of generating an impact detection signal (trigger) 160a when the impact force is detected. Specifically, it is realized using an acceleration sensor.

  The IEEE 1394 digital video camera 101 has a function of photographing the vicinity of the display panel 106 and outputting it as an IEEE 1394 digital video signal 101a in addition to the above-described functions.

  The storage means 150 has a function of storing the IEEE 1394 digital video signal 101a in addition to the various functions described above.

  In addition to the above-described functions, the attribute determination unit 102 stores and stores the IEEE 1394 digital video signal 101a before and after the timing at which the impact detection signal is received in the storage unit, and displays the damage status of the display board (destructor performing person 31). It has a function of executing control to be monitored, and specifically, is realized using the above-described PC.

  As described above, according to the third reference example, the impact detection sensor 160 monitors whether or not the impact force is applied to the display board 106 by the vandalism performer 31 and detects the impact force. An impact detection signal (trigger) 160a is generated. In response to this, the IEEE 1394 digital video camera 101 shoots the vicinity of the display board 106 (destructive person 31) and outputs it as an IEEE 1394 digital video signal 101a. As a result, it is possible to automatically monitor a damage accident such as the display board 106 being kicked, scribbled, damaged, or taken away by the vandalist 31. Further, since the storage means 150 stores (records) the IEEE 1394 digital video signal 101a from the IEEE 1394 digital video camera 101, the display board 106 is kicked, scribbled, damaged, or taken away by the vandalist 31. It becomes possible to automatically leave evidence of damage accidents such as trying to be. Further, the attribute determination unit 102 accumulates and stores the IEEE 1394 digital video signal 101a before and after the timing of receiving the impact detection signal (trigger) 160a in the accumulation unit 150, and monitors the damage state of the display board 106 by the vandal performer 31. Since it has a function to execute the control, it is possible to keep a record of the causal relationship and background of the occurrence of the damage accident, and it can be used as a powerful situation evidence shooting record at the time of later verification or the like.

(4th reference example)
FIG. 16 is a functional block diagram of the interactive display device 10 of the fourth reference example, and shows a state in which self-diagnosis is performed with an image input from the IEEE 1394 digital video camera 101 as a self-display image. FIG. 17 is a functional block diagram of the interactive display device 10 of the fourth reference example, and shows an image input unit attached to the upper part of the display board 106. In addition, the same code | symbol is attached | subjected about the part same as what was already described in the 1st-3rd reference example, and the overlapping description is abbreviate | omitted.

  The interactive display device 10 of the fourth reference example has a hardware configuration centered on the display board 106, the IEEE 1394 digital video camera 101, the display control unit 105, the mask unit 170, and the image comparison unit 180. Yes.

  The display board 106 whose display contents can be changed by electrical means may cause a so-called failure in which display is not performed due to some cause of the system.

  Therefore, in the interactive display device 10 of the fourth reference example, as shown in FIG. 17, the image input means 101 is attached to the upper part of the display board 106, and a wide-angle lens capable of photographing the viewer 30 and the display board 106 itself is attached. Then, as shown in FIG. 16C, the display board 106 and the front object are shown at the same time. The object image on the front surface is masked 190 and compared with the comparison data 180a that should be correctly displayed on the display panel 106. At this time, if the mismatch threshold is exceeded, it can be determined as a failure. Even when the display color balance is out of order or when the front surface is contaminated, it can be detected by the same method, and the display panel 106 can be operated correctly.

  In addition to the above-described functions, the IEEE 1394 digital video camera 101 has a display board 106 and an object located in front of the display board 106 with a wide-angle lens that can photograph the viewer 30 and the display board 106 itself. It has a function of simultaneously photographing an object (an object located in the upper and lower visual field range shown in FIG. 17) and outputting it as an IEEE 1394 digital video signal 101a.

  The mask means 170 has a function of performing mask processing on the IEEE 1394 digital video signal 101a related to the image of the object on the front surface of the display board 106 among the captured images, and the IEEE 1394 digital video signal related to the image portion of the display board 106. A function of cutting out 101a is provided. Specifically, this is realized by using the above-described PC.

  The image comparison means 180 compares the comparison data 180a that should be correctly displayed on the display board 106 with the IEEE 1394 digital video signal 101a relating to the image portion of the display board 106, and the comparison result exceeds a predetermined threshold value for mismatch. Function for determining that the failure is caused by an imbalance in the display color displayed on the display board 106 or that the dirt is attached to the front surface of the display board 106 and outputting the fact. Specifically, it is realized using the above-described PC.

  As described above, according to the fourth reference example, the IEEE 1394 digital video camera 101 is attached with a wide-angle lens capable of photographing the viewer 30 and the display board 106 itself. The IEEE 1394 digital video camera 101 to which such a wide-angle lens is attached captures the display board 106 and the viewer 30 located in front of it (the viewer 30 located in the upper and lower visual field range shown in FIG. 17) at the same time, and IEEE 1394. The digital video signal 101a is output. In response to this, the mask means 170 performs a mask process on the IEEE 1394 digital video signal 101a related to the image of the object on the front surface of the display board 106 from the images photographed by the IEEE 1394 digital video camera 101, and the mask 190 Based on the result, the IEEE 1394 digital video signal 101a relating to the image portion of the display board 106 is cut out. In response to this, the image comparison means 180 compares the comparison data 180a that should be correctly displayed on the display board 106 with the IEEE 1394 digital video signal 101a relating to the image portion of the display board 106. Specifically, when a wide-angle lens capable of photographing the viewer 30 and the display board 106 itself is attached, the display board 106 and the object on the front surface thereof can be photographed simultaneously. The object image is masked 190 and can be compared with the comparison data 180a that should be correctly displayed on the display board 106. As a result, when the mismatch threshold value is exceeded, it can be determined as a failure. Further, by providing the image comparison means 180, when the comparison result at this time exceeds a threshold value regarding a predetermined mismatch, a failure caused by an imbalance of display colors displayed on the display panel 106, or a display As a result of determining that the failure is caused by the contamination on the front surface of the board 106 and outputting the fact, the display board 106 whose display contents can be changed by electric means is not displayed due to some cause of the system. A failure such as a failure, a failure such as an imbalance in display color, or a failure such as contamination on the front surface can be detected, and the display panel 106 can be operated correctly.

(5th reference example)
The interactive display device 10 of the fifth reference example is used in the above first to fourth reference examples and the first embodiment.

  FIG. 18A shows a square matrix arrangement of the three-color light emitting elements of the display panel 106 used in the conventional display panel 106, and FIG. 18B shows the first to fourth reference examples and the first embodiment. 3 shows a rhombus arrangement of the three-color light emitting elements of the display panel 106 used in the interactive display device 10.

  As shown in FIG. 18B, the display panel 106 is configured by integrating mold light emitting elements 1065 in a rhombus arrangement.

  FIG. 19 illustrates the structure of a three-color light emitting element of the display panel 106 used in the first to fourth reference examples and the interactive display device 10 of the first embodiment.

  A mold light emitting element 1065 illustrated in FIG. 19 includes a display element in which light emitting diodes (LEDs) that emit red (R), green (G), and blue (B) light are formed in one mold. A large number of these can be arranged to form the integrated display panel 106 as shown in FIG.

  In this case, conventionally, a method of forming a square array as shown in FIG. However, in this case, since it is necessary to create a certain gap between the mold light emitting elements 1065, a larger gap is created in the middle of the four mold light emitting elements 1065, and the degree of integration as a whole does not increase.

  As a solution for this, when the mold light emitting element 1065 is arranged and formed in a triangular shape, it is the same as the one in which the mold light emitting element 1065 is arranged in a rhombus shape (FIG. 18B). In comparison, a denser arrangement is possible. As a result, it is possible to express with higher brightness and finer color.

  As shown in FIG. 19, each of the mold light emitting elements 1065 shown in FIG. 18 (b) has a red light emitting element R (LED), a green light emitting element G (LED), and a blue light emitting element B (LED) connected by a common cathode. And it has a shape sealed (molded) with a resin having transparency in the visible light wavelength range. The mold light emitting element 1065 emits red light by applying a voltage between the anode and the cathode of the red light emitting element R, emits green light by applying a voltage between the anode and the cathode of the green light emitting element G, and emits blue light. When a voltage is applied between the anode and cathode of the element B, blue light is emitted.

  As described above, according to the fifth reference example, the light emitting elements R, G, and B constituting the display surface of the display panel 106 are arranged in a diamond shape, so that each light emitting element is compared with the above-described square matrix arrangement. The gap between R, G, B (mold light emitting display elements (R, G, B)) can be reduced, and the gap between the four adjacent light emitting elements R, G, B can be reduced. As a result, the light emitting element The degree of integration of R, G, and B can be improved.

It is a functional block diagram for demonstrating the whole system of the interactive display apparatus of a 1st reference example. In the interactive display device of the first reference example, it is a configuration diagram in which an image input unit, an attribute determination unit, and a log storage unit are added to a display board that performs electrical display such as a plasma display. It is a whole block diagram of the concrete system of the interactive display apparatus of the 1st reference example of FIG. In the interactive display device of the first reference example, a high school girl who looks at a display board is described. It is a conceptual diagram of the feature extraction in the interactive display apparatus of a 1st reference example. It is a 1st example of the screen structure of the display board in the interactive display apparatus of a 1st reference example. It is a 2nd example of the screen structure of the display board in the interactive display apparatus of a 1st reference example. In the interactive display device of the first reference example, a state is described in which determination is made at each part of the head, knee, and footwear for attribute determination. In the interactive display device of the first reference example, an operation of applying a person template from a small range when a person is cut out from an image is described. It is a functional block diagram of the interactive display apparatus of 1st Embodiment, Comprising: It is a functional block diagram for performing sub-frame control according to an input command. In the interactive display device according to the first embodiment, an operation for displaying a subframe on the display board is described. It is a storage figure of the data classified into the viewer attribute used in the interactive display apparatus of the 2nd reference example. It shows a state where display is performed by a time table used in the interactive display device of the second reference example. It is a functional block diagram of the interactive display apparatus of the 2nd reference example, Comprising: The mode which changes the content displayed according to an attribute determination result is shown. It is a functional block diagram of the interactive display apparatus of a 3rd reference example, Comprising: The mode that a destructive person is recorded by the impact detection sensor is shown. It is a functional block diagram of the interactive display apparatus of a 4th reference example, Comprising: It shows a mode that self-diagnosis is carried out with the image input from the image input means. It is a functional block diagram of the interactive display apparatus of the 4th reference example, Comprising: The image input part attached to the display board upper part is shown. FIG. 4A shows a square matrix arrangement of three color light emitting elements of a display panel used in a conventional display panel, and FIG. 4B is a diagram for explaining an interactive display device of a fifth reference example. In addition, a rhombus arrangement of the three-color light emitting elements of the display plate used in the interactive display devices of the first to fourth reference examples and the first embodiment is shown. The structure of the three-color light emitting element of the display panel used in the interactive display devices of the first to fourth reference examples and the first embodiment is described. It is a block diagram for demonstrating one Embodiment of the conventional advertising board which shines. It is a block diagram for demonstrating embodiment which added the image input means to the wide signboard of FIG. It is a figure for demonstrating a prior art.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Interactive display apparatus 10A ... Wall type interactive display apparatus 10B ... Floor type interactive display apparatus 101 ... Image input means (video camera)
101a ... Video signal 102 ... Attribute determination means 102a ... Attribute determination result information (result of attribute determination)
DESCRIPTION OF SYMBOLS 1021 ... Male template 1022 ... Female template 103 ... Log storage means 105 ... Display control means 106 ... Display board 106A ... Plasma display (display board)
106B ... CRT display device (display panel)
106C ... Mold light emitting element integrated display board 1061 ... Touch command input unit 1062 ... Layer 1 display memory 1063 ... Layer 2 display memory 1064 ... Layer 3 display memory 1065 ... Mold light emitting element 1066 ... Touch panel (display board)
1067 ... Coordinate detection device (display board)
DESCRIPTION OF SYMBOLS 107 ... Command input means 107a ... Virtual display command 108 ... Command analysis means 1010 ... Display selection means 110 ... Selection means 110a ... Viewer attribute classification data 111 ... Content table for men 112 ... Content table for women 130 ... Content storage means 150 ... Accumulating means 160 ... Impact detection sensor 160a ... Impact detection signal (trigger)
DESCRIPTION OF SYMBOLS 170 ... Mask means 180a ... Comparison data 180 ... Image comparison means 190 ... Mask 200 ... Image recognition apparatus 200a ... Presentation data 200b ... Schedule data 201 ... Antenna 202 ... Wireless card ID recognition apparatus 203 ... CPU (personal computer)
204 ... Storage device (hard disk)
205 ... Communication I / F
206 ... Public network 208 ... Distribution management host computer 209 ... Time table 210 ... Cache server 211 ... Distribution server 212 ... Digital camera 30 ... Viewer 31 ... Destroyer performer 32 ... Passing high school girl 40 ... Content data R ... Red LED
G ... Green LED
B ... Blue light emitting LED

Claims (2)

An interactive display device used for a guide board for supporting content viewing,
A display board to display to viewers;
Display control means for performing display control related to virtual display using a plurality of layers as subframes;
Command input means for receiving a command for changing contents interactively or a virtual display command for instructing subframe display from a viewer;
Analyzing means for analyzing the instruction content of the input command;
Reading means for reading content corresponding to the plurality of layers according to the analysis information;
An interactive display device comprising: display control means for executing subframe display control using content corresponding to the plurality of layers with respect to the entire display area of the display board. An interactive display device used for a guide board for supporting content viewing,
A display board to display to viewers;
Display control means for performing display control related to virtual display using a plurality of layers as subframes;
A command input means for receiving a command for interactively changing the content on the center system side or the display board side or a virtual display command for instructing subframe display from the viewer;
The instruction content of the input command is analyzed, and when it is determined that the analyzed command is the virtual display command, the fact that a virtual display instruction using the subframe has occurred is output as analysis information. Command analysis means;
Various types of content are stored, and when a content output request is received, content storage means for reading out and outputting the content according to the output request;
The content storage unit is instructed to read the content corresponding to the plurality of layers according to the analysis information, and the content corresponding to the plurality of layers received from the content storage unit is output to the display control unit. Display selection means,
The interactive display device, wherein the display control means performs subframe display control using content corresponding to the plurality of layers with respect to an entire display area of the display board.

Images