JP7193790B2 - table projection device - Google Patents

Description

The present invention relates to, for example, a table projection device, and more particularly to a projection device that projects an image onto a table on which occupants are present.

2. Description of the Related Art In recent years, projection mapping has been effective for advertising, entertainment, and tourism purposes by projecting a wide variety of images onto various objects using a projection device (hereinafter also abbreviated as "projector"). Objects to be projected are buildings, wall surfaces, floor surfaces, and the like, and when the shape of the projection surface or the arrangement of articles on the projection surface changes, it is necessary to change the projection image according to the change.

For example, when projecting an image of flowers onto the veil of a bride moving on a virgin road, it is desirable to move the projector device according to the movement of the bride. That is, when the object to be projected moves, it is necessary to move the projection apparatus along with the movement.

Patent Document 1 discloses a technical idea of projecting a three-dimensional image onto the table surface from above. There is no description of the technical idea of changing the image. Furthermore, the technical idea of moving the projection device in accordance with the projected object is not disclosed.

JP 2018-101312 A

As described above, in the present invention, even if the shape and position of the table to be projected or the arrangement on the table changes, and even if the positions of the occupants change, the projection image is projected in accordance with each change. It is an object of the present invention to provide an automatically adaptable table projection device.

Another object of the present invention is to provide a table projection apparatus capable of displaying a background image projected on the entire table and an individual image for each piece of information related to each seated person near the seated position of the seated person.

Another object of the present invention is to provide a table projection device that can move the projection device according to the movement of the object to be projected.

In order to solve the above problems, in a table projection apparatus according to an aspect of the present invention, a single or a plurality of projectors, a single or a plurality of video cameras, and an audio input device such as a microphone; and a control device for controlling the

According to the table projection device of the present invention, the video camera device can recognize the shape of the table, and the projector can project an image according to the shape. Furthermore, since the seating positions of the occupants around the table can be detected by the images of the video camera and the infrared camera, it is possible to project an individual performance image for each occupant's individual information on the table near the occupants. Also, an article on the table can be recognized by the camera, and an image related to the article can be projected from the projector onto the article-related position.

By recognizing the items on the table and projecting images related to the items, the origin of the items, the manufacturing process, etc. can be known, and interest in and value of the items can be increased. Overall, according to the present invention, the development of new application techniques using projection images is encouraged.

1 is a basic block diagram of a table projection device according to one embodiment of the present invention; FIG. It is a figure which shows the application example of the table projection apparatus which concerns on one Embodiment of this invention. It is a figure which shows the application example of the table projection apparatus which concerns on one Embodiment of this invention. It is a figure which shows the projection match|combined with the table shape of the table projection apparatus which concerns on one Embodiment of this invention. FIG. 4 is an explanatory diagram of individual image projection of the table projection device according to one embodiment of the present invention; It is an example in the case of using an identification mark by a retroreflective material in the table projection apparatus according to one embodiment of the present invention. It is an example in the case of using an identification mark by a retroreflective material in the table projection apparatus according to one embodiment of the present invention. It is an example in the case of using the difference detection method for the table projection apparatus according to one embodiment of the present invention. It is an example of a table projection device according to an embodiment of the present invention. It is an example when a plurality of projectors are used in the table projection apparatus according to one embodiment of the present invention.

Embodiments of the present invention will be described below with reference to the drawings. In the following, the range necessary for the description to achieve the object of the present invention is schematically shown, and the range necessary for the description of the relevant part of the present invention is mainly described. It shall be based on a well-known technique.

FIG. 1 is a basic block diagram of a table projection device according to one embodiment of the present invention. A table projection apparatus 1 according to an embodiment of the present invention basically comprises one or more projectors 2, one or more video cameras 3, and a controller 5 for controlling both. Further, depending on the application, the projector and video camera may be configured by adding an operation mechanism 4 for changing the line-of-sight direction and/or the installation position. Similarly, depending on the application, a sound collecting device 2a such as a microphone (including a wireless microphone) can be added. The controller 5 includes a video and audio analysis unit 6 for analyzing video information from the video camera, a projection video processing unit 7 for controlling the projection video of the projector based on the video analysis result, a video and audio analysis unit 6 and the projected video. A controller 8 mainly composed of a CPU is included for controlling the processor 7 and/or the projector 2, video camera 3, and operating mechanism 4. FIG.

The table projection device 1 according to one embodiment of the present invention can perform independent control to independently control a single device. It may be configured to be controlled by the overall management device 9 by adding the device 9 (not shown).

2A and 2B are conceptual perspective views for explaining application scenes of the table projection device 1 according to one embodiment of the present invention. FIG. 2A shows an example in which a projector 2 and a video camera 3 fixed to each other are installed directly above a table 10 on which a person 11 is seated. As will be described later, it is possible to check the situation of the venue to be projected by the video camera 3, and change the projection position and the projection contents in accordance with the banquet arrangements that differ each time. Note that FIG. 1 shows a mode in which the projector 2 and the video camera 3 are fixed to each other and cannot be moved relative to each other. (not shown).

FIG. 2B illustrates an example in which the projector 2 projects an image onto the table 10 based on the information from the image camera 3 via the mirror 12 directly above the table 10 . Also, this is an example in which the installation positions of the mirror 12, the projector 2, and the video camera 3 can be changed along the guide rail 5 by the drive mechanism 4. FIG. 2B, the projector 2 and video camera 3 can be installed on the wall surface of the room and projected onto the table using the mirror 12, or projected onto the wall surface by changing the mirror angle.

According to the configuration according to this embodiment, the drive mechanism 4 can move the projector 2 and the video camera 3 along the guide rails 5 . For example, if the guide rail 5 is laid on the ceiling of the virgin road of the wedding hall, the projector 2 can be moved to follow the movement of the bride captured by the video camera 3, and the flower pattern can be projected onto the bride's veil while changing it. You can do it, and it will be an outstanding performance effect.

FIG. 3 is a diagram showing an example of changing the projected image according to the shape of the table. That is, the video camera 3 grasps the shape of the top surface of the table as shown in FIG. 3A, cuts out the image to be projected in FIG. do. Since this image is projected over the entire surface of the table, it becomes a so-called background image.

FIG. 4 is a conceptual plan view showing an example in which the shape of the table is square. As shown in the figure, the position of the seated persons 11 around the table 10 is identified by a video camera, and an individual effect image 13 such as a drawing image used for a meeting is displayed on the table in front of the seated persons according to the position information. can be synthesized and projected. Of course, a background image synthesized individual effect image 13A (not shown) obtained by synthesizing the individual effect image 13 with the background image may be projected, or only the individual effect image 13 may be projected. In order to more reliably detect the seated person 11, an infrared camera may be used as the video camera 3. Usually, both a visible light camera and an infrared camera, or a video camera that supports a wide range of wavelengths from visible light to infrared light, may be used.

5A and 5B are explanatory diagrams for explaining a case in which the position and/or information content of an identifier placed on a table are identified by a video camera, and related images are projected according to the identification result. FIG. 5A is its conceptual plan view, and FIG. 5B is its conceptual perspective view. As an identifier, the seated person's number or a two-dimensional bar code can be used to identify the seated person and project a personal related image. In addition, if a pattern made of a retroreflective material is used for the identifier, the identifier, which is difficult to see with the naked eye, can be clearly identified by the video camera by the light from the projector, so that the individual effect image can be projected more reliably. . Furthermore, if the identifier is made of a reflective material with a wavelength that cannot be identified with the naked eye, it will surprise the occupants and can be used effectively. Although FIGS. 5A and 5B show the case where the identification mark is realized by the retroreflecting material, it may be realized without using the retroreflecting material.

In the above description, the video camera identifies the position of the seated person and projects the individual effect image onto the table in front of the seated person. In FIG. 7, which will be described later, an identification mark 14 such as a two-dimensional barcode placed on the table 10 can be identified by the video camera 3, and an individual effect image can be projected by the projector 2 on the identification mark position. Aspects will be described.

FIG. 6 shows another application example of the table projection apparatus according to one embodiment of the present invention, in which a so-called background image 150A to be projected onto the table as described in FIG. On the other hand, the image projected on the table is identified by a video camera, and the portions 15 and 16 different from the stored background image 150A are detected using a so-called difference detection method (right side of FIG. 6). A circular plate in the example of ), and an individual effect image adapted to that part (such as cooking in the example on the right side of FIG. 6) can be projected. Therefore, the image projected on the table is a composite image of the background image 150A and the respective individual effect images for the parts 15 and 16, or the parts 15 and 16 are removed from the background image 150A. A composite image obtained by synthesizing the individual effect images of the parts 15 and 16 with or near the excised portion is obtained.

FIG. 7 shows another application example of the table projection device according to one embodiment of the present invention, which is used for presentation of food on the table. In FIG. 7(a), a fish dish 71 (on a plate) is placed on the table in front of the seated person 70, but the lighting is dim and cannot be clearly seen. In this state, the projector projects a moving image 72 of fish swimming on the table. In FIG. 7(b), the image of the swimming fish approaches the plate, and at the same time the fish jumps up on the image, the spotlight hits the fish dish on the plate. You can produce as if you were cooking.

The above is an example of presentation, and for example, it is possible to project a video of the cooking process of a dish up close, or project an image of a production area, a cooking recipe, or the like. As a result, the combination of the video camera and the projector according to one embodiment of the present invention can increase the added value of the articles on the table, add entertainment, and respond to a wide range of application fields/situations. As described above, according to one embodiment of the present invention, a video camera detects a projection location or an article at the projection location, and projects an image related to the detection result, thereby emphasizing the projection location and the article. can perform.

FIG. 7(c) is a diagram showing still another application of the present invention, in which a menu list 73 of dishes is projected on the table, and when a fingertip 74 is placed on the menu 73 on the list, the position of the fingertip is displayed. is detected by a video camera, and the color of the menu characters at the same position on the projected menu list is changed to inform the surroundings that the order has been received, and/or systematically (not shown) control unit, kitchen server, etc. can let you know. In addition, when canceling an order, the fingertips are crossed, for example, the shape of the hand on the projection surface (other video or image information such as a predetermined number of repetitions, or a predetermined pattern such as clapping a certain number of times) Various types of information can be transmitted by means of sound information, etc., and it is also possible to change the projection content according to the information.

In addition to the hand shape, it is also possible to perform a simulated candle service in which a video camera detects that a simulated torch approaches a projected candle on a table, and the projected image candle is lit. Of course, it is also possible to use an electrically lit candle in place of the projected image of the candle, detect the approach of the simulated torch, send a lighting signal as an optical signal from the projector to the candle, and light the candle electrically.

As with the menu projection above, the participants in front of the table are confirmed and the speech manuscript is projected onto the table. By recognizing the voice of the expression or event, it is possible to change the color of the current characters or change the manuscript according to this progress. Similarly, it is possible to project a schedule for meetings and ceremonies, and change the color of the schedule according to the progress. Similarly, images of meeting materials, advertisements, etc. can be projected. When the projection direction of the projector and/or the projection surface of the table form an angle, it is preferable that the menus and speech manuscripts projected on the table surface are corrected according to the angle and have the same form as the normal paper manuscript. Further, since the speech recognition processing method described above is an existing technology, detailed description thereof will be omitted here.

In the same manner as described above, for example, a person in charge of a ceremony at a banquet can designate a table number and/or the position of a seated person with a wireless microphone, and project a related image for each seated person from the projector. Voice control technology for specifying table numbers and occupant positions is currently established technology as described above.

According to the configuration according to one embodiment of the present invention, the projected image and the shape and motion of the hand of the person seated at the table held over it can be recognized by the video camera, and the projected image can be changed accordingly. can. Using this function, you can play various games by flipping bingo cards projected on the table, moving your hand over the projected image and detecting its movement with a video camera, and changing the projected image. can enjoy.

If the projection direction of the projector is not perpendicular to the plane of the table, but has an acute or obtuse angle, the menu or speech manuscript will be distorted, requiring angle correction of the image. Since this angle correction is a correcting means used in a commonly used projector, a description thereof will be omitted.

FIG. 8 is an explanatory diagram of a case where a plurality of table projection apparatuses (detailed illustration is omitted) of the present invention as explained in FIG. 1 are used.

In the above description, an example of applying the table projection apparatus according to one embodiment of the present invention to a commonly used circular or rectangular planar table has been described. It is self-evident that it can be applied to a table having a three-dimensional shape, and all of these are included in the technical idea of the present invention.

In addition, various expansions, reductions, substitutions, excisions, etc. are also included in the technical concept of the present application. For example, in the above description, the case where the table projection device according to one embodiment of the present application is applied to a scene of a wedding reception has been described as an example. Performing the mapping described in the form, (virtual, that is, it does not actually occur but appears to occur on the video) costume change, (virtual) costume change, etc. A video effect can be played.

Furthermore, in the above case, for example, by separately providing a sound collecting device and interlocking this sound collecting device with the table projection device according to the embodiment of the present application, color/pattern change etc. are performed in conjunction with the sound. This makes it possible to give the participants a new surprise experience by superimposing the sound effect on the virtual surprise effect described above.

Furthermore, in situations where the use of gunpowder such as crackers is regulated/or undesirable, projection of (virtual) crackers (and sound effects) by mapping described in the embodiment of the present application can be used for cracker images (and sound effects). By applying it, it is possible to virtually bring about the effect of using crackers containing gunpowder that cannot be used originally.

One embodiment of the present invention can be used not only for projection on tables at banquets, meetings, restaurants, etc., but also for projection video/images on floors and walls, and because the projection device can be moved, so that the seated people can be placed on the table. It can be used as a projection for guidance, or it can be developed into a total projection using the table and floor wall. In addition, it can be expected to be applied to a wide range of fields such as warehouse management in the distribution industry, guide systems for museums and art galleries, tourism industry, and construction industry. Furthermore, at the tourist information center, when a point on the map projection image is pointed at, a landscape is projected, etc., making it possible to provide very effective sightseeing guidance. It can be expected to be applied to a wide range of fields, such as navigation plans and trajectories displayed on the ship's bridge table, strategy meetings and records in the CIC room, and so on.

DESCRIPTION OF SYMBOLS 1... Table projection apparatus, 2... Projector, 3... Video camera, 4... Operation mechanism part, 5... Controller, 6... Video analysis part, 7... Projected image processing part, 8... Control part, 10... Table, 11... Sitting person, 12...mirror, 13...individual effect image, 14...identification mark, 15, 16...site, 70...seated person, 71...fish dish, 72...video, 73...menu, 74...fingertip

Claims (9)

a projector or projectors;
a single or multiple video cameras for imaging an object;
an operation mechanism unit for changing the line-of-sight direction and/or installation position of the projector and the video camera;
A video that detects a different part between the information from the video camera and the image information related to the stored background image using a difference detection method, and that the projector can project an individual effect video adapted to the part. and a controller for
the projector and the video camera are relatively movable in position;
The projector is moved by the operation mechanism unit following the movement of the object imaged by the video camera, and the combined image of the selected individual effect image and the background image, or from the background image A table characterized by projecting a composite image obtained by cutting out a body part and then synthesizing the individual effect image with the cut-out portion or its vicinity from a position to which the projector is moved by the operation mechanism. projection device. The controller is
a video analysis unit;
a projection video processing unit;
2. The table projection apparatus according to claim 1, further comprising a control section for controlling said image analysis section and said projection image processing section. 3. A table projection apparatus according to claim 1, further comprising a sound collector, wherein a projection position and projection image from said projector are selected according to sound information from said sound collector. 4. The video camera detects the positions of the occupants seated around the table, and projects the individual effect image of the occupants on the table near the occupants. 1. A table projection device according to any one of claims 1 to 3. 5. The table projection apparatus according to any one of claims 1 to 4, wherein at least one of an infrared camera, a normal visible light imaging camera, an infrared camera, and a wide wavelength camera is used as the imaging camera. 6. The table projection device according to any one of claims 1 to 5, wherein an identifier on the table is recognized by the video camera, and the individual effect image is projected in the vicinity of the recognized identifier. . 7. The table projection apparatus according to claim 6, wherein a retroreflective material is used as said identifier. 8. The table projection apparatus according to any one of claims 1 to 7, wherein the projection content is changed according to the shape and movement of an intruding object appearing on the projected image plane from the projector. 9. The table projection according to any one of claims 1 to 8, wherein when the projection direction of said projector is not perpendicular to the plane of the table but forms an acute or obtuse angle, the angle of the image is corrected. Device.

Images