JP3062193U - Image synthesis device - Google Patents

Abstract

(57) [Summary] [Problem] To automatically detect whether a subject is at an appropriate position or within a range, take a subject image at an appropriate position, combine the subject image with another image, and output it. To provide an image synthesizing device capable of performing the above. SOLUTION: In an image synthesizing apparatus for synthesizing a subject image photographed by a camera and an image selected by the subject itself and outputting to a predetermined output medium, whether or not the subject to be photographed is located within the field of view of the camera A sensor for detecting whether
According to the detection result of this sensor, when a part or the whole of the subject to be photographed is located outside the field of view of the camera, means for changing the position or the field of view of the camera so as to fall within the field of view or It is characterized by comprising means for issuing a warning to move the position with respect to the subject.

Description

[Detailed description of the invention]

[0001]

[Technical field to which the invention belongs]

 The present invention relates to an image synthesizing device that synthesizes a subject image photographed by a camera and an image selected by the subject itself and outputs the synthesized image to a predetermined output medium such as a sticker or a magnetic recording medium. The present invention relates to an image synthesizing apparatus in which is set within an appropriate photographing range.

[0002]

[Prior art]

 Conventionally, as a device for automatically photographing a user as a subject with a camera, an automatic photographing device for inserting a coin or the like to photograph an ID photograph, or an image combining device for combining and printing with another background image or the like (or Image synthesis printing devices), but many of these conventional devices use an approximate mirror in front to determine whether or not the subject is at an appropriate position with respect to the camera's field of view. The subject was allowed to judge the range.

Some image synthesizing apparatuses that synthesize an image of a subject with another background image or the like display a monitor image of the subject on a monitor screen so that the subject (user) can view the view range of the camera. In recent years, some people have been recognized.

[0004]

[Problems to be solved by the invention]

 However, in a conventional device that does not have a mechanism for displaying a subject monitor image, the subject itself determines an approximate shooting range using a front mirror surface or the like. Even if it protrudes upward or left or right, it may not be noticed on the spot, and as a result, it may not be possible to obtain an image synthesis result of the pose desired by the subject (user).

On the other hand, recently, by illuminating a wall or the like behind a subject, a shadow of the subject is erased, an image of only the subject is cut out, and various images including the subject image and other background images are obtained. An image synthesizing apparatus using a chroma key synthesizing method for synthesizing has been proposed. In such an apparatus, the subject is often required to be located within a certain distance range from a wall surface or the like so that the illumination sufficiently illuminates the subject. In such an apparatus, by displaying the subject monitor image on the monitor screen, the subject itself can determine whether the position in the up, down, left, and right directions is appropriate. However, there is a problem that it is difficult for the subject itself to determine whether the subject is in an appropriate range in the front-rear direction toward the camera only by displaying the subject monitor image. If the subject is too close to the camera, the illumination from the back of the subject will not be sufficiently illuminated, and it will not be possible to eliminate the shadow generated behind the subject, and the presence of the shadow will make the subject image clear. Can not be cut out. If the subject image cannot be cut out clearly, a high-quality composite image cannot be created.

The present invention has been made to solve such a problem, and automatically detects whether or not a subject is in an appropriate position or range, and shoots an image of the subject at an appropriate position. It is another object of the present invention to provide an image synthesizing apparatus capable of synthesizing the subject image with another image and outputting the synthesized image.

[0007]

[Means for Solving the Problems]

 In order to achieve the above object, the present invention provides an image synthesizing apparatus that synthesizes a subject image captured by a camera and an image selected by the subject itself and outputs the image to a predetermined output medium. A sensor for detecting whether or not the subject to be photographed is located, and according to the detection result of this sensor, when part or all of the subject to be photographed is located outside the field of view of the camera, It is characterized by comprising means for changing the position or the field of view of the camera so as to fall within the field of view, or means for issuing a warning to move the position to the subject.

[0008] The sensor may include a plurality of passive infrared sensors that are arranged around the camera, have a detection range corresponding to a field of view of the camera, and detect far infrared rays emitted from a subject. It is characterized by.

[0009] Further, a sensor for detecting whether or not the front position of the subject toward the camera is within an allowable range is further provided on a ceiling surface and a floor surface of the photographing space of the subject, and based on a detection result of the sensor, If the front position of the subject toward the camera is out of the permissible range, a warning is issued to move the position of the subject so as to fall within the permissible range.

[0010] Furthermore, the apparatus further includes a plurality of sensors having a detection range of a plurality of object portions in the height direction. The height of the object is determined based on detection outputs of the plurality of sensors. It is characterized by comprising means for moving the center of the field of view of the camera.

[0011]

[Embodiment of the invention]

 Hereinafter, embodiments of the present invention will be specifically described with reference to the drawings.

First Embodiment First, in an image synthesizing apparatus that does not have a function of displaying a monitor image of a subject image on a monitor screen, if the subject is not located within the field of view of the camera, A first embodiment will be described in which a warning is issued so as to move the position, and a subject image that is appropriately within the field of view of the camera can be captured.

FIG. 1 is a basic device configuration diagram in the present embodiment, FIG. 2 is a side view showing a relationship between a subject, a camera, and an infrared sensor, and FIG. 3 is a relationship between a subject, a camera, and an infrared sensor. FIG. 2 is a plan view of the device viewed from above the device.

The image synthesizing apparatus shown in FIG. 1 is a camera (for example, a CCD) 2 for photographing an image of a subject 1, and a photographing control for combining a subject image photographed by the camera 2 and a background image selected by the subject 1 itself. A device 3, a printer 4 for printing and outputting the synthesized image on an output medium such as a sticker, and an infrared sensor 5 for detecting whether or not the subject 1 to be photographed is located within the field of view of the camera 2. According to the detection result of the infrared sensor 5, when a part or the whole of the subject 1 to be photographed is located outside the field of view of the camera 2, the subject 1 is set within the field of view of the camera 2. A warning device 6 for issuing a warning from the speaker 9 to move the position with respect to the input device, an input device 7 for performing various operations such as selection of a background image, and a candidate for a background image to be synthesized according to a user request. table And a display device 8 for.

The camera 2 is arranged inside the housing 10 as shown in FIG. 2, and its field of view 13 is set so as to be able to photograph the upper body of the subject 1 as shown by a broken line. The field of view of the camera 2 can be set so that the whole body of the subject 1 can be photographed.

A ceiling cover 11 for blocking light from above the subject 1 from the ceiling of the housing 10 is provided so as to cover the upper part of the subject 1. Further, on the back side of the subject 1, a back screen 12 for blocking extraneous light from the back side is provided. The rear screen 12 has a structure that hangs down to the vicinity of the waist of the subject 1 as shown in FIG. It becomes a configuration that hangs down to around the foot of 1. In the following, the description will be made on the assumption that the image synthesis apparatus of the present embodiment targets the upper body of the subject 1 as an object to be photographed.

The display device 8 is arranged on the front side of the subject 1 in the housing 10, and an input device 7 constituted by a touch panel is provided on the surface of the display screen. The input device 7 including the touch panel detects a resistance value when a position of a selection item such as an operation menu displayed on the screen of the display device 8 is pressed, calculates a coordinate position on the screen, and calculates a coordinate position on the screen. Is used to determine which selection item the user has selected.In addition to detecting the resistance value, it is possible to use an input device that uses electromagnetic coupling, electrostatic coupling, optical coupling, etc. it can.

The printer 4 that prints a composite image of the subject image and the background image on a sheet of a predetermined size is, for example, a video printer, and the lower part of the housing 10 has a print output port facing the front side of the subject 1. Are located in

The imaging control device 3 is configured by, for example, a general-purpose personal computer, and is arranged inside the housing 10 so as not to be seen from the subject 1.

In this embodiment, the infrared sensor 5 for detecting whether the subject 1 is located within the field of view of the camera 2 is an infrared sensor 5 having a detection range 5 U above the upper field limit 13 U of the camera 2. -1 (FIG. 2) and infrared sensors 5-2 and 5-3 having detection ranges 5R and 5L outside the left and right visual field limits 13R and 13L (FIG. 3) of the camera 2.

These infrared sensors 5-1 to 5-3 are configured as passive infrared sensors that detect far infrared rays emitted from the subject 1. A passive infrared sensor uses the well-known property that an object emits infrared energy (far-infrared light) having a wavelength corresponding to the temperature of the object. The infrared sensor detects the difference in the wavelength of far-infrared rays due to the temperature difference between the temperature of the rear screen and the like (35 to 37 degrees C) and the temperature of the rear screen (room temperature of 30 degrees C or less) and outputs a signal.

FIG. 4 is a block diagram showing the functional configuration of the image synthesizing apparatus according to this embodiment in more detail, and includes a CPU (central processing unit) 301 for performing overall control. A memory 302, an I / O control unit 303, a data storage unit 304, an image output unit 305, an image processing unit 306, a pattern memory 307, and an image input unit 308 are connected to the CPU 301. The I / O control unit 303 includes a communication control I / F (interface) 309, a digital camera I / F (interface) 311, an inverter 312, an infrared sensor 5, an input device 7 having a touch panel structure, a coin control unit 313, and a timer 314. , The warning device 6 is connected.

The CPU 301 receives a compressed digital signal from the image input unit 308 and the digital camera I / F (interface) 311 in cooperation with the image processing unit 306 or alone according to a program stored in the memory 302. Then, the contour of the upper body image of the subject 1 (hereinafter, subject image) is extracted, the distortion of the photographed subject image is corrected, and the brightness and saturation of the background image selected by the subject 1 are compared. The saturation and brightness of the subject image are corrected so as to match the saturation and brightness of the background, and the print output processing is performed on the printer 4. Further, the data of the composite image is stored in an auxiliary storage medium 315 such as a floppy disk, PD, or MO as required or in response to a request from a user. When stored, it is encrypted by an encryption program such as PGP. Note that what is encrypted here is a composite image and data related to privacy such as a name and a telephone number input from the input device (touch panel) 7.

The memory 302 stores image data taken in from the image input unit 308, and also stores, as programs, instructions issued to the CPU 301 and instructions for controlling the image synthesizing apparatus. The processing data of the CPU 301 is also temporarily stored as work data.

The data storage unit 304 is configured to transmit and receive various data to and from an auxiliary storage medium 315 such as a floppy disk. The printer 4 and the display device 8 are connected to the image output unit 305 so as to display and print a composite image of the subject image and the background image.

The image processing unit 306 extracts a face outline from the image data of the subject stored in the memory 302 and the color data of the face stored in the pattern memory 307, and arranges the contour at an arbitrary position in the space on the memory 302. The CPU 301 performs processing for synthesizing the image data and synthesizing processing with an arbitrary background image selected by the subject itself or independently, and performs processing such as sending the synthesized image data to the printer 4. The pattern memory 307 stores synthesized pattern data to be superimposed on the subject image, and also stores a guide for an operation menu to be displayed on the display device 8. The contents of the pattern memory 307 can be externally rewritten using the data storage unit 304.

The image input unit 308 converts image data captured by the camera 2 from an analog signal to a digital signal by an A / D converter (not shown). The communication control I / F 309 is used for connection with an external network. This device is connected to an external device management server by a communication control I / F 309 via a dedicated line. The purpose of this device management server (not shown) is to manage the presence or absence of a failure. Also, a new background pattern or character is transmitted from the device management server and stored in the data storage unit 304 via the I / O control unit 303. The data storage unit 304 checks the date of the data written in the pattern memory 307 against the date, and if the data stored in the data storage unit 304 is new, rewrites the data in the pattern memory 307. Also, as described later, by providing the optical communication control I / F 310, a portable information terminal such as a PDA or a personal computer can be directly connected, and binary data such as a program can be exchanged. .

The optical communication control I / F 310 controls IrDA for performing infrared communication and controls for performing communication using an optical fiber. By using this interface, binary data such as a program can be exchanged, and it can be directly connected to an information portable terminal such as a PDA or a notebook personal computer. Device programs and data can be imported. Further, data and programs created by a personal computer can be sent to the image synthesizing apparatus of the present embodiment, and the background pattern and characters can be changed arbitrarily. The I / O control unit 303 controls the inverter 312 to control the illumination in the photographing space to an appropriate brightness. The inverter 312 performs flicker prevention control of the illumination light in the photographing space, and can manually change the flicker prevention cycle.

The coin control unit 313 detects whether or not a coin has been inserted and whether or not an illegal coin has been inserted, under the control of the CPU 301, and measures the shape and weight of the inserted coin. For coins that do not exist, the pattern on the front and back of the coin is further determined, and it is determined whether the inserted coin is a genuine coin, a fraudulent coin, or a counterfeit coin.

The timer 314 is provided in the apparatus main body when there is no environment that can be connected to an external device management server by a dedicated line, and operates according to an instruction from the CPU 301.

The shooting of the subject (user) 1 is performed by the camera 2 when a shooting instruction for the user is given on the display screen of the display device 8 after coin insertion. The image data captured by the camera 2 is subjected to exposure adjustment by an AE (auto iris) function built in the camera 2 and the like, and is stored in the memory 302. The photographing fee is received by the coin control unit 313, but the fee receiving means is not limited to the coin detector, and a bill reader, a prepaid card reader, a credit card, or the like can be used. The photographed image data is converted into RGB data after photographing, and displayed on the display device 8 via the image output unit 305. The display device 8 provided in the present image synthesizing apparatus needs to display a menu screen required at the stage of operation by the user and confirm whether the synthesized image or the like created by the user is appropriate. These screen displays are controlled and displayed by the CPU 301. In addition, since the operation state of display on the screen and image processing is managed by the CPU 301, it is possible to switch and display an image or video previously stored in the pattern memory 307 during the print processing. When the operation screen is not required, switch the menu display to broadcast commercials and product advertisements. The display device 8 is not limited to a CRT type display device, and may be, for example, a liquid crystal type LCD display device or a character display device using LED light emission. 4 are formed as a control board on a semiconductor substrate or a glass epoxy substrate by a known semiconductor integrated circuit application technology, for example, and the photographing control of FIG. It is installed in the device 3.

An equivalent function can be realized by providing a means for changing the position or the field of view of the camera 2 instead of issuing a warning to the subject 1 to move the position.

Next, in the above configuration, a control operation for guiding the subject 1 or changing the field of view of the camera 2 so that the shooting position of the subject 1 properly falls within the field of view of the camera 2 will be described with reference to the flowchart of FIG. This will be described with reference to FIG.

First, the subject 1 inserts a coin from a coin insertion slot (not shown) (step 501), so that the next operation can be accepted.

Next, the subject 1 selects a frame, a background image, and the like to be combined with the subject image by a menu selection operation on the input device 7 and operates the “OK” button (step 502). Operations 1 to 5-3 start (step 503).

In this state, the subject 1 changes its posture or position with respect to the camera 2 in the photographing space of the present apparatus in order to determine the photographing pose (step 504). It monitors whether all or part of the camera is out of the field of view of the camera 2. That is, it is monitored whether or not the subject 1 is located in an appropriate shooting range (step 505). If part of the arm or head of the subject 1 or the entire upper body has advanced into a part of the detection ranges 5U, 5R, and 5L of the infrared sensors 5-1 to 5-3, this is the case. Is sent to the CPU 301 via the I / O control unit 303.

Upon receiving the detection signals from the infrared sensors 5-1 to 5-3, the CPU 301 determines in the memory 302 whether the field of view or the position of the camera 2 is changeable. Judgment is made based on the information (step 509). If the configuration is not changeable, a signal is sent to the warning device 6 to move the position with respect to the subject 1, for example, "The photographing position is not appropriate. Please issue a warning announcement from the speaker 9. Alternatively, a warning announcement or message such as "Please move to the position where the alarm sound stops." Is generated from the speaker 9 while generating an alarm sound from the speaker 9 (step 510).

In this embodiment, when a part of the subject 1 comes to the right side (left side in FIG. 3) of the visual field limit 13R on the right side of the camera 2, a detection signal is output from the infrared sensor 5-2, and the detection signal is output. As a result, a warning announcement urges the subject 1 to move to the right. As a result, if the subject 1 falls within the field of view of the camera 2, the process proceeds to shooting preparation. If the subject 1 still does not fall within the field of view, a warning is issued again to warn the user.

This warning is also detected by the infrared sensors 5-1 and 5-3 when the subject 1 comes out above the upper visual field limit 13U or to the left (right side in FIG. 3) from the left visual field limit 13L. A warning announcement corresponding to the detection result is output.

This warning announcement or message is output continuously until the subject 1 moves within an appropriate shooting range. Thus, the subject 1 is guided to an appropriate shooting range.

In this case, if the warning does not fall within the visual field range even if the warning is given more than a predetermined number of times, or if the warning does not fit within the visual field range after the lapse of the predetermined time, it is considered that there is no intention to move, and immediately Activate the shutter. This prevents a specific subject from occupying the device.

When the subject 1 has moved into an appropriate photographing range, the monitoring operation of the infrared sensors 5-1 to 5-3 is stopped (Step 506), and the shutter of the camera 2 is operated to activate the subject 1. Photographing is performed (step 507). The photographing result is combined with another background image or the like and printed out by the printer 4 (step 508). With this printout, a series of automatic photographing operations is completed.

Here, as shown in FIG. 3, even when there is a person 31 other than the subject 1 behind the rear screen 12, the far infrared rays emitted by the person 31 are blocked by the rear screen 12 and the infrared sensor 5-1. Since it does not reach ~ 5-3, no malfunction occurs due to the person 31 or the like other than the subject 1.

On the other hand, if the apparatus is configured to be able to change the field of view or the position of the camera 2 when receiving the detection signals of the infrared sensors 5-1 to 5-3, the field of view or the position of the camera 2 is changed. This is changed (step 511), and control is performed so that the subject 1 falls within an appropriate shooting range. The configuration for changing the field of view or the position of the camera 2 will be described later.

(Embodiment 2) In this embodiment, in an image synthesizing apparatus using a chroma key synthesizing technique for synthesizing an image by illuminating a subject 1 and a wall behind the subject, the subject can perform significant image synthesis. When it comes out of the illumination range, it detects it and issues a warning to the subject.

FIG. 6 is an internal side view showing an embodiment of the image synthesizing apparatus using the chroma key synthesizing technique, and the same or corresponding parts as those in FIGS. 1 to 4 are denoted by the same reference numerals. In FIG. 6, a camera 2 is installed at an upper position such that the whole body of the subject 1 is within the field of view of the camera 2 inside the outer housing 601, and a ceiling portion of the subject 1 is positioned from the head direction. A lighting fixture 14 for lighting is installed. Further, surface light-emitting display plates 15 and 16 are provided on the back surface and the bottom surface (floor surface) of the subject 1.

In this case, in particular, it is desirable that the surface light emitting display panel 15 on the rear portion be large enough to cover at least the subject 1 from the head to the feet. Further, it is preferable that the surface light emitting display plate 16 at the bottom portion occupies at least 30 cm to 50 cm from the rear surface of the housing where the surface light emitting display plate 15 is installed in order to cancel the shadow generated at the foot. .

Further, below the camera 2, a display device 8 having a touch panel as an input device 7 on the display screen surface and displaying a composite image is provided, and further below the camera 2, a composite image is printed out. A printer 4 is provided. Further, on the rear side of the display device 8, a photographing control device 3 for controlling the entire device including the image synthesizing process is installed.

In FIG. 6, a lighting device for illuminating the subject 1 from the front side is not shown.

The surface-emitting display panel 15 is provided to eliminate a shadow generated on the back side of the subject 1, but its illuminance is weak enough to eliminate the shadow. Therefore, if the subject 1 is too far from the surface-emitting display panel 15, that is, if it is too close to the camera 2, the shadow of the subject 1 cannot be erased. That is, it is required that the position on the front side of the subject 1 be within an allowable range in which shadows can be eliminated by illumination by the surface-emitting display panel 15. Therefore, in this embodiment, a sensor is provided for detecting that the subject 1 is on the camera 2 side from the limit position where the shadow can be erased. This sensor comprises an active infrared sensor 17 comprising an infrared projector 17a provided on the ceiling and an infrared receiver 17b provided at a position facing the floor.

The active infrared sensor 17 does not react when the infrared ray radiated from the light projector 17a is received by the light receiver 17b, but is blocked by an object between the light projector 17a and the light receiver 17b. As a result, when the light receiver 17b cannot receive infrared rays, it outputs a signal.

In this embodiment, when the subject 1 is sufficiently lowered backward (to the side of the surface-emitting display panel 15) and the infrared light 18 emitted from the light projector 17a reaches the light receiver 17b without being blocked. Although the light receiver 17b does not output a detection signal, when the subject 1 moves forward (camera side) and blocks the infrared light 18 emitted from the light projector 17a, the infrared light 18 does not reach the light receiver 17b. The detector 17b outputs a detection signal and sends it to the imaging control device 3. Upon receiving the detection signal from the light receiver 17b, the imaging control device 3 generates a warning announcement from the speaker 9, and urges the subject 1 to go backward. Alternatively, a warning message is displayed on the screen of the display device 8 to urge the subject 1 to go backward.

When only a part of the hand of the subject 1 and the like comes forward, a warning is not issued as noise as shown in FIG. The infrared sensor 19 (two steps in this example) is arranged in the horizontal direction (left and right direction of the subject). If only one slit 19-1 is blocked, it is judged that only part of the body has come out and a warning is issued. When the both slits 19-1 and 19-2 are blocked by the subject 1 as shown in FIG. 8, it is determined that the entire body of the subject 1 has come forward, and a warning is issued. I just need.

The functional configuration of the image synthesizing apparatus using the chroma key synthesizing technique is described in detail in the specification of Japanese Patent Application No. 10-245879 previously filed by the present applicant. The detailed description of is omitted.

(Embodiment 3) In this embodiment, the presence range of one or more subjects with respect to a camera is recognized by a plurality of active infrared sensors, and the field of view (shooting range) or position of the camera is automatically changed. It is something to do.

9 to 11 are plan views of the principle structure of the present embodiment as viewed from above. Here, reference numeral 901 denotes a CCD camera whose field of view (imaging range) can be switched, 902 to 905 denote active infrared sensors, and 906 denotes an imaging control device. In order to be able to detect the existence range of the subject 1 viewed from the camera 901, the boundary near the center of the light receiving range of each of the sensors 902, 903, 904, and 905 is radial with respect to the CCD camera 901 when viewed from above. It is installed at such a position and angle. In order to facilitate such an arrangement, a method of changing the height of the CCD camera 901 and the sensors 902, 903, 904, and 905 as shown in FIG. Further, a zoom lens is used for the CCD camera 901 so that the photographing range can be automatically changed.

In this embodiment, an example in which the shooting range of the camera 901 is changed in three stages will be described.

First, as shown in FIG. 9, when the subject 1 is alone and at a position sufficiently separated from the CCD camera 901, since the subject 1 is not in the light receiving range of the sensors 902 and 903, the photographing control is performed. No signal is sent from the sensors 902 and 903 to the device 906, and the photographing is performed with the photographing range 911 of the CCD camera 901 in the standard state.

Next, as shown in FIG. 10, when the subjects are two persons 1 a and 1 b, the subjects 1 a and 1 b fall within the light receiving range of the sensors 902 and 903. Will send a signal. On the other hand, no signal is sent from the sensors 904 and 905 to the imaging control device 906 because the light receiving areas of the sensors 904 and 905 do not include the subjects 1a and 1b. Based on these information, the imaging control device 906 sends a command to the CCD camera 901 to switch the imaging range to a wide angle. As a result, the shooting range 911 of the CCD camera 901 is switched to the wide-angle shooting range 912 by zooming out, and becomes wider.

Next, as shown in FIG. 11, when there are three or more subjects 1a to 1d, the subjects 1a and 1d fall within the light receiving range of the sensors 904 and 905. A signal is also sent from the camera 905, and the imaging control device 906 sends an instruction to the CCD camera 901 to switch the imaging range to a wider angle. As a result, the shooting range of the CCD camera 901 is further zoomed out and switched to the wide-angle shooting range 913, and the shooting range is further increased. Here, when it is desired to widen only the horizontal shooting range while keeping the vertical shooting range unchanged, a method of automatically switching from the normal size shooting mode to the panorama size shooting mode may be considered. Specific methods for automatically switching from the normal-size shooting mode to the panorama-size shooting mode are disclosed in JP-A-5-281633, JP-A-6-3732, and JP-A-5-175215. This can be achieved by applying technology.

Embodiment 4 In this embodiment, the height of the subject's eyes is recognized by a plurality of or a plurality of pairs of active infrared sensors so that the line of sight to the camera is directed in a natural direction. In addition, the camera is automatically moved or rotated.

FIGS. 13 to 15 are side views showing the principle structure of the present embodiment from the side, and FIG. 16 is an enlarged perspective view showing the vicinity of the lens portion of the camera. Here, reference numeral 1301 denotes a CCD camera, which is attached to a rotating shaft 1302 rotatable in the vertical direction with respect to the subject 1 and a moving shaft 1303 movable in the vertical direction. Reference numerals 1304 and 1305 denote projectors and light receivers of a two-stage active infrared sensor. In this embodiment, an example in which the height of the camera 1301 is changed in three steps will be described.

First, as shown in FIG. 13, when the head position does not reach the lower level of the light receiver 1305 due to the height and posture of the subject 1, the infrared rays 1306 and 1307 emitted from the light projector 1304 receive light. It is not blocked at all until it reaches the container 1305. For this reason, no signal is sent from the light receiver 1305 to the imaging controller 1308, and the imaging controller 1308 moves the height of the CCD camera 1301 on the moving axis 1303 to a position lower than the lower stage of the light receiver 1305. Send instructions. Next, the photographing control device 1308 calculates an angle 1310 such that the whole body of the subject 1 falls substantially in the center of the photographing range 1309, sends a command to the rotation axis 1302, and changes the photographing range of the camera 1301. When the change of the photographing range is completed, photographing of the subject 1 is performed. By changing the photographing range of the camera 1301 so that the whole body of the subject 1 fits substantially in the center of the photographing range 1309, the line of sight of the subject 1 becomes almost the same as the center of the field of view of the camera 1301, so that the line of sight of the photographed image becomes It becomes natural. In other words, the captured image is not a captured image with a depressed feeling or a captured image with an upward gaze, but an image with a line of sight as if looking in the same direction as the eye level.

When the angle 1310 at this time is represented by the symbol θ, θ is obtained by the following equation.

[0065]

(H−h) / L = tan (α−θ) (1)

[0066]

H / L = tan (α + θ) (2) where each symbol represents the following meaning, and each numerical value range is L> 0, 0 <H / 2 <h <H, 0 <Θ <α <π / 2 (3) (angles are expressed in radians).

Α ·· The vertical shooting angle of the CCD camera 901.

H: Height of the focal position of the CCD camera 901 from the floor.

H: Height from the floor of the subject 1 to the tip of the head (estimated value by the light receiver 1305).

L: Forward critical distance within which subject 1 is within the shooting range of camera 1301.

Here, since the forward critical distance L depends on the photographing range angle α, if L 1 is eliminated from the equations (1) and (2),

[0072]

(H−h) / h = tan (α−θ) / tan (α + θ) (4) where a≡tan α, t≡tan θ, C≡ (Hh) / h If you put it, from the additive theorem,

[0073]

## EQU5 ## {(at) / (1 + at)} / {(a + t) / (1-at)} = C (5)

[0074]

From the various conditions of equation (3), 0 <t <a, 0 <C <1 (6) When this is arranged for t, the following quadratic equation is obtained.

[0075]

(1−C) at ² − (1 + C) (1 + a ² ) t + (1−C) a = 0 (7)

[0076]

T = {(1 + C) (1 + a ² ) ± {D} / 2 (1-C) a (8)

[0077]

Where D≡ (1 + C) ² (1 + a ² ) ² -4a ² (1-C) ² = (1 + C) ² (1-a ² ) ² + 16Ca ² (9)> 0 Then, considering the validity of each of the two solutions obtained by decoding the formula (8), firstly, the positive sign is (1 + C) (1 + a ² ) / 2 (1-C) a> a. t = {(1 + C) (1 + a ² ) + {D} / 2 (1-C) a> a, which is not valid contrary to the condition of Expression (6).

On the other hand, when the sign of the expression (8) is a negative sign, (1 + C) (1 + a ² )> √D (∵ (1 + C) ² (1 + a ² ) ² −D = 4 (1-C) ² a ² > 0), t> 0, and (1 + C) (1 + a ² ) −√D / 2 (1-C) a <a (∵ ｛(1 + C) (1 + a ² ) −2 (1 −C) a ² ｝ ² −D = −8C (1−C) a ² (1 + a ² ) <0) Since t <a, the condition of equation (6) is satisfied, and therefore a unique and significant solution is obtained.

[0079]

T１０tan θ = {(1 + C) (1 + a ² ) − {(1 + C) ² (1-a ² ) ² + 16Ca ² } / 2 (1-C) a (10) is obtained.

Here, when the rotation center of the camera 1301 is behind the focal position by the distance d, the height h ′ of the rotation center from the floor is represented by the following equation.

[0081]

H ′ = h + d sin θ (11) As shown in FIG. 16, if the projectors 1304 are arranged on the left and right sides of the camera 1301, the body of the subject 1 is similar to that shown in the second embodiment. Noise can be cut off when a part of the signal comes out. In FIG. 16, a CCD camera 1301 moves up and down an elliptical hole 1601.

Next, as shown in FIG. 14, when the position of the head of the subject 1 is between the lower stage and the upper stage of the light receiver 1305, of the infrared rays emitted from the projector 1304, the upper infrared ray 1306 is blocked. However, the infrared ray 1307 at the lower stage is blocked by the head of the subject 1 and does not reach the light receiver 1305, and a signal to that effect is sent from the light receiver 1305 to the imaging control device 1308. As a result, the imaging control device 1308 sends a command to the moving axis 1303 to set the height of the camera 1301 to the lower position of the light receiver 1305. Next, the photographing control device 1308 calculates an angle 1313 such that the whole body of the subject 1 falls within the photographing range 1312 and sends a command to the rotating shaft 1302 to change the photographing range. After the change of the shooting range is completed, shooting of the subject 1 is performed. The method for obtaining the angle 1313 is the same as that for the angle 1310.

Next, as shown in FIG. 15, when the position of the head of the subject 1 is above the upper stage of the light receiver 1305, the infrared rays emitted from the projector 1304 are both the upper stage infrared 1306 and the lower stage infrared 1307. The light does not reach the light receiver 1305 because of being blocked by the subject 1, and a signal to that effect is sent from the light receiver 1305 to the imaging control device 1308. As a result, the imaging control device 1308 sends a command to the moving axis 1303 to change the height of the camera 1301 to the upper position of the light receiver 1305. Next, the imaging control device 1308 calculates an angle 1315 such that the whole body of the subject 1 falls within the imaging range 1314, and sends a command to the rotation axis 1302 to change the imaging range. After the change is completed, shooting is performed. The method of obtaining the angle 1315 in this case is the same as in the case described above.

In each of the above embodiments, an infrared sensor is used as a sensor for detecting the position of a subject, but the present invention is not limited to this. Instead of an infrared sensor, it is also possible to use a sensor using laser light or weak radio waves.

[0085]

[Effect of the invention]

 As described above, according to the present invention, (1) there is a mechanism such as a monitor for displaying a photographing range by arranging a sensor for detecting the position of a subject around the camera at an appropriate position or angle. Even if a simple image synthesizing apparatus does not exist, if the subject is located outside the shooting range, it can be guided to fall within the shooting range, and the subject image can be shot at an appropriate position.

(2) When the position of the subject in the front-rear direction is out of the allowable range, the image is guided into the allowable range, and the shadow is erased by the back light source to cut out the subject image. In the apparatus, a subject image can be taken at an appropriate position.

(3) By arranging a plurality of sensors around the camera and automatically changing the shooting range of the camera depending on which sensor has detected the subject, it is possible to perform appropriate shooting according to the number of subjects and the like. The range can be obtained without manipulating the subject, which is extremely convenient when performing multi-person shooting.

(4) A plurality of sensors having different detection ranges in the height direction are arranged around the camera, and the height of the camera or the center of the field of view matches the eye height of the subject depending on which sensor has detected the subject. By doing so, the subject does not need to raise and lower the face, and a natural gaze can be obtained. As a result, a natural gaze can be obtained regardless of the height of the person, and even when the user is sitting in a wheelchair or the like.

[Brief description of the drawings]

FIG. 1 is a device configuration diagram showing a first embodiment of the present invention.

FIG. 2 is a side view showing a relationship between a subject, a camera, and an infrared sensor.

FIG. 3 is a plan view showing the relationship between a subject, a camera, and an infrared sensor as viewed from above the apparatus.

FIG. 4 is a block diagram showing the functional configuration of FIG. 1 in further detail;

FIG. 5 is a flowchart illustrating a control operation according to the first embodiment.

FIG. 6 is an internal side view showing a second embodiment of the present invention.

FIG. 7 is an explanatory diagram showing a case where the infrared sensor has a multi-stage configuration and only a part of a subject comes out of an allowable position in the second embodiment.

FIG. 8 is an explanatory diagram showing a case in which the infrared sensor has a multi-stage configuration in the second embodiment, and most of the objects are out of an allowable position.

FIG. 9 is a plan view showing a principle configuration of a third embodiment of the present invention in which a photographing range of a camera is automatically changed.

FIG. 10 is a plan view showing that the number of subjects increases and the shooting range of the camera is changed widely.

FIG. 11 is a plan view showing that the number of subjects further increases and the shooting range of the camera is changed to be wider.

FIG. 12 is a perspective view showing how to arrange an infrared sensor when the photographing range of the camera is automatically changed.

FIG. 13 is a side view showing a principle configuration of a fourth embodiment of the present invention in which a camera height is automatically changed.

FIG. 14 is a first explanatory diagram showing that the height of the camera is automatically changed in accordance with the height of a subject.

FIG. 15 is a second explanatory diagram showing that the height of the camera is automatically changed in accordance with the height of the subject.

FIG. 16 is a perspective view showing an arrangement of an infrared sensor and an operation of a camera in the fourth embodiment.

[Explanation of symbols]

REFERENCE SIGNS LIST 1 subject, 2 901 camera 3 906 photographing control device 4 printer 5 902 to 905 infrared sensor 6 warning device 7 input device 8 display device 9
... Speaker, 10 ... Housing, 12 ... Back screen, 13
U: Upper visual field limit, 13R: Right visual field limit, 13L: Left visual field limit, 14: Lighting equipment, 15: Surface-emitting display panel, 17a
... Infrared light projector, 17b ... Infrared light receiver, 1302 ... Rotating axis, 1303 ... Moving axis, 1304 ... Infrared light projector, 1
305 ... Infrared light receiver.

──────────────────────────────────────────────────の Continued on the front page (51) Int.Cl. ⁶ Identification code FI G07F 17/26 G07F 17/26 H04N 5/225 H04N 5/225 A 5/765 5/781 510C 5/781 5/91 J 5 / 91

Claims (4)

[Utility model registration claims] An image synthesizing apparatus for synthesizing a subject image photographed by a camera and an image selected by the subject itself and outputting the synthesized image to a predetermined output medium, wherein an object to be photographed is located within a field of view of the camera. A sensor for detecting whether or not a part of the subject to be photographed is located outside the field of view of the camera according to the detection result of the sensor. An image synthesizing apparatus, comprising: means for changing the position or the field of view of the subject or a warning means for issuing a warning so as to move the position of the subject. 2. The sensor according to claim 1, wherein the sensor is disposed around the camera, has a detection range corresponding to a field of view of the camera, and includes a plurality of passive infrared sensors that detect far infrared rays emitted from a subject. The image synthesizing apparatus according to claim 1, wherein 3. A sensor for detecting whether or not the front position of the subject toward the camera is within an allowable range, on the ceiling surface and the floor surface of the photographing space of the subject, and the warning unit detects the sensor. 2. The image according to claim 1, wherein as a result, when the front position of the subject toward the camera is out of the allowable range, a warning is issued to move the position of the subject so as to fall within the allowable range. Synthesizer. 4. A camera further comprising a plurality of sensors for detecting a plurality of object parts in a height direction, the height of the object is determined based on detection outputs of the plurality of sensors, and a camera position is determined at the determined position. The image synthesizing apparatus according to claim 1, further comprising a unit that moves a center of a visual field.