WO2014076993A1 - Interface device and input reception method - Google Patents

Abstract

This interface device has: a retroreflective screen (103); a beam-radiating/signal-reading device (101) that releases a beam (102) towards the retroreflective screen (103), detects the beam (102) reflected by the retroreflective screen (103), and generates a signal corresponding to the amount of light; and a recognition means that, on the basis of the signal generated by the beam-radiating/signal-reading device (101), detects that the progress of at least a portion of the beam (102) was obstructed by an object (an operator finger or the like) positioned between the beam-radiating/signal-reading device (101) and the retroreflective screen (103), and receives an input corresponding to the form thereof.

Description

Interface device and input receiving method

The present invention relates to an interface device and an input receiving method.

In recent years, space operation type interface devices that perform input using gestures have been developed. The interface device recognizes a gesture performed by a person and accepts an input corresponding to a predetermined gesture.

For example, Patent Document 1 (Japanese Patent Application Laid-Open No. 2005-138755) describes a false display device that captures the movement of a hand with a camera, recognizes the gesture, and operates what is displayed on the head-up display. The false display device includes an optical unit that projects video information with light toward a translucent reflecting means, and displays the video information as a virtual image by the reflecting means. Then, a line-of-sight specifying means for specifying the line of sight of the operator who operates the false display device, and a virtual image on or near the operator's line of sight specified by the line-of-sight specifying means among the virtual images displayed by the false display device A virtual image specifying means for specifying the gaze virtual image that the operator is gazing at, a display command detecting means for detecting a display control command for controlling display by the virtual image display device, and a display control detected by the display command detecting means When the command is a command for displaying a gaze virtual image, a first display control unit that controls display of the gaze virtual image based on the display control command is provided.

Patent Document 2 (Japanese Patent No. 397002) discloses an input device having a limited detection area. The input device is an input device that supplies an output signal corresponding to the operation to the electronic device according to the operation of the operator, and is in an open space determined by a crossbar and a rim of a steering wheel for steering a moving body. A detection unit is set in advance, and a generation unit that emits a light wave in a plane including the emission direction of the light wave so that an operation instruction point is generated in the detection region by reflection of the light wave corresponding to the operation, and detection that the light wave is emitted Based on the monitoring means using an image sensor that is installed in an area different from the area and monitors the operation instruction point generated in the detection area by monitoring the detection area, and the operation instruction point monitored by the monitoring means Analysis means for analyzing the operation, and supply means for supplying an output signal corresponding to the operation determined by the analysis result of the analysis means to the electronic device.

Japanese Patent Application Laid-Open No. 2000-112651 discloses a pointing mechanism used for specifying a position on a display image. The pointing mechanism includes a projecting unit that projects light, a retroreflector that can reflect light projected by the projecting unit, and an operator that can freely move its position, and a projecting unit that reflects the retroreflector. Position detecting means for detecting the light from the position and detecting the position of the retroreflector, and coordinate information generating means for generating coordinate information corresponding to the position or position change detected by the position detecting means. It is shown that the retroreflector is attached to the operator's finger.

JP 2005-138755 A Japanese Patent No. 397002 JP 2000-112651 A

In the technique described in Patent Document 1 (Japanese Patent Laid-Open No. 2005-138755), the driver's line of sight, hand position, and gesture must be accurately recognized. The line of sight is a very difficult recognition target. It is necessary to carry out calibration and confirm the target object and the eye position every time the posture changes. In addition, recognition of hand position and shape has the same difficulty. Both are generally recognized using a two-dimensional camera, but are not technically mature. Further, the movement of eyes and hands is fast, and a normal camera of about 30 fps may be insufficient in speed. In that case, an expensive high-speed camera is required. This method has a very high possibility of malfunction and high cost.

In the technique described in Patent Document 2 (Japanese Patent No. 397002), there is a problem that the influence of external light is large. Sunlight also pours into the detection area. This is especially true for open cars. When strong external light enters, the overall light amount level increases, and the SN ratio with respect to what is detected decreases. In addition, the reflected image may reach the camera even from a hand outside the detection area, which may cause a malfunction. In order to prevent this, there is no choice but to increase the intensity of the light source so that it reacts only to the reflected image with a high intensity. For this reason, an array of light sources and an increase in power are required, resulting in problems of cost and power. In the embodiment, high output LEDs are used in an array. There is a problem that the size of the apparatus increases by using an array. Moreover, sunlight intensity is very strong, and even if it does in this way, the fall of SN ratio is inevitable.

Further, the reading is performed by a camera as before, and an advanced image recognition technique is required as in the technique described in Patent Document 1 (Japanese Patent Laid-Open No. 2005-138755).

In the case of the technique described in Patent Document 3 (Japanese Patent Application Laid-Open No. 2000-112651), the operator must wear a retroreflector on a finger or the like. Wearing such an instrument is troublesome for the operator, and the device may interfere with other operations (eg driving a car).

This invention makes it a subject to provide the interface technology with a low degree of misrecognition, and a high degree of freedom of operation.

According to the present invention,
A retroreflective screen,
Beam irradiation means for emitting a beam toward the retroreflective screen;
Signal reading means for detecting the beam reflected by the retroreflective screen and generating a signal according to the amount of light;
Based on the signal generated by the signal reading means, it is detected that an object located between the beam irradiation means and the retroreflective screen has hindered the progress of at least a part of the beam. Recognizing means for accepting input according to
An interface device is provided.

Moreover, according to the present invention,
A beam is emitted from the beam irradiating means toward the retroreflective screen, the beam reflected by the retroreflective screen is detected to generate a signal according to the amount of light, the signal is analyzed, and the beam irradiating means and the beam There is provided an input receiving method for detecting that an object located between the retroreflective screen and an advance of at least a part of the beam is hindered and receiving an input corresponding to the mode.

According to the present invention, an interface technology with a low degree of erroneous recognition and a high degree of freedom of operation is realized.

The above-described object and other objects, features, and advantages will become more apparent from the preferred embodiments described below and the accompanying drawings.
It is a figure which shows an example of the example of application of the interface apparatus of this embodiment. It is a figure for demonstrating the path | route of the light ray of the interface apparatus of this embodiment. It is a figure which shows the example of a read signal. It is a figure which shows an example of the beam irradiation means of the interface apparatus of this embodiment. It is a figure which shows an example of a beam shape. It is a figure which shows an example of a scanning beam irradiation means. It is a figure which shows an example of a beam irradiation and a signal reader. It is a figure which shows an example of a beam irradiation and a signal reader. It is a figure which shows an example of the interface apparatus of this embodiment. It is a figure which shows an example of the interface apparatus of this embodiment. It is a figure which shows an example of the interface apparatus of this embodiment. It is a figure which shows an example of the interface apparatus of this embodiment. It is a figure which shows an example of a retroreflection screen. It is a figure which shows the example of installation of a retroreflection screen. It is a figure which shows an example of the interface apparatus of this embodiment. It is a figure which shows an example of the example of application of the interface apparatus of this embodiment.

Hereinafter, embodiments of the present invention will be described with reference to the drawings. In addition, about the component which appears in common in several drawing, a common code | symbol is attached | subjected and description is abbreviate | omitted suitably.

It should be noted that the system and apparatus of the present embodiment include a CPU, a memory, and a program loaded in the memory of any computer (a program stored in the memory from the stage of shipping the apparatus in advance, a storage medium such as a CD, Including a program downloaded from a server or the like on the Internet), a storage unit such as a hard disk for storing the program, and an interface for network connection, and any combination of hardware and software. It will be understood by those skilled in the art that there are various modifications to the implementation method and apparatus.

Further, the functional block diagram used in the description of the present embodiment shows functional unit blocks, not hardware unit configurations. In these drawings, each system and apparatus is described as being realized by a single device, but the means for realizing the same is not limited thereto. That is, it may be a physically separated configuration or a logically separated configuration.

<First Embodiment>
The interface apparatus according to the present embodiment includes a retroreflective screen, a beam irradiation unit that emits a beam toward the retroreflective screen, a signal reading unit that detects a beam reflected by the retroreflective screen and generates a signal corresponding to the amount of light. Based on the signal generated by the signal reading means, it is detected that the progress of at least a part of the beam is hindered by an object located between the beam irradiation means and the retroreflective screen, and the input according to the mode Recognizing means for accepting.

FIG. 1 shows an example of an application scene of the interface device of this embodiment. In this example, the interface device of the present embodiment is applied to an automobile. Note that the interface device of the present embodiment can be applied to other mobile objects (airplanes, trains, buses, motorcycles, ships, etc.), and can also be applied to other usage scenes indoors and outdoors. This premise is the same in all the following embodiments.

In FIG. 1, 101 is a beam irradiation / signal reading device installed on the ceiling, 103 is a retroreflective screen that reflects incident light in the opposite direction, and 102 is toward a retroreflective screen 103 installed on the dashboard. A projected beam, 104 is reflected light reflected by the retroreflective screen 103, and 105 indicates an operation area where an operator (driver) performs a gesture for operation with an object such as a finger.

The beam 102 is a beam having a one-dimensional direction (linear) spread toward the traveling direction, or a beam emitted radially from the beam irradiation / signal reading device 101 in a plurality of directions. Has a planar (curtain-like) spread. The retroreflective screen 103 has a wide configuration capable of reflecting the beam 102 having a one-dimensional spread in the traveling direction.

In this embodiment, the beam irradiation / signal reading device 101 is installed on the ceiling of the vehicle, and the retroreflective screen 103 is installed below the beam irradiation / signal reading device 101. However, the present invention is not limited to this. It is only necessary to form a planar passing area of the beam 102 on the front surface of the operator. For example, the retroreflective screen 103 is installed on the ceiling of the vehicle, and the beam irradiation / signal reading device 101 is installed below the retroreflective screen 103. Alternatively, the beam 102 may be emitted in the left-right direction of the operator.

When the beam 102 emitted from the beam irradiation / signal reading device 101 hits the retroreflection screen 103, the beam 102 is retroreflected, and the reflected light 104 returns to the beam irradiation / signal reading device 101. The signal reading means included in the beam irradiation / signal reading device 101 detects the reflected light 104 and generates a signal corresponding to the amount of light. When a predetermined user operation is performed by inserting an object such as a finger or a hand into the operation area 105, at least a part of the beam 102 emitted from the beam irradiation / signal reading device 101 (primary in the traveling direction). The object is prevented from traveling in the original direction (a part of the beam having a linear shape). Due to this, in the signal generated by the signal reading means, there is a characteristic that the light amount of a part of the beam 102 having a one-dimensional spread in the traveling direction is smaller than the other part. The position, number, size, movement (moving direction, moving speed, etc.), etc., of the portion where the amount of light is smaller than the other portions (hereinafter “shadow portion”) vary depending on the content of the user operation. The recognition means recognizes at least one of the position, size, number, and movement of such a shadow portion and accepts an input according to the recognition result. The recognition means may be located in the beam irradiation / signal reading apparatus 101, or may be located in another housing configured to be able to communicate with the beam irradiation / signal reading apparatus 101 by wire and / or wirelessly. Also good.

The area where the user performs a gesture (operation) with an object such as a finger may be any one of the planar passing areas of the beam 102. For example, as shown in the figure, a space near the top of the steering wheel. Can be set as the operation area 105. In this way, a predetermined operation can be performed without hindering driving. Further, when the interface device of the present embodiment is used to operate an image (virtual image) given by a head mounted display, this virtual image is generally displayed on the front of the driver, so this virtual image is It becomes possible to perform a predetermined user operation as if it were operated directly with a finger or the like.

A more detailed reading operation will be described with reference to FIG. The figure shows the driver looking at the dashboard. The retroreflective screen 103 is a horizontally long screen in accordance with the radiation range of the beam 102 (spread in the one-dimensional direction toward the traveling direction). In the case of the example in FIG. 2, the traveling direction of the beam 102 is substantially vertical, and has a one-dimensional direction (horizontal direction in the figure) spreading toward the traveling direction.

The retroreflective structure includes a bead 201, a reflective film 202, and a base 203. A part of the beam 102 incident on the bead 201 is refracted as shown in the figure, reflected by the reflection film 202, refracted by the bead 201 again, and reflected in the opposite direction as shown in the figure. The figure shows that this is true no matter what direction the light comes from. Further, since the retroreflective screen 103 returns light in the direction in which light comes in this way, even if strong external light enters from the windshield or the like, the external light is reflected in the direction of the windshield. That is, the possibility that the reflected light of the external light is reflected in the direction of the beam irradiation / signal reading apparatus 101 is extremely low. Since the beam irradiation / signal reading apparatus 101 itself blocks a part of the external light, the possibility that the external light traveling in the same direction as the beam 102 is incident on the retroreflective screen 103 is small. In the case of this embodiment, since it is not affected by external light, the intensity of the beam 102 may be low, and operation with low power is possible.

When, for example, the finger 204 enters the beam curtain formed by the beam 102 (passing region of the beam 102 having a planar spread), the beam 102 corresponding to the finger 204 is reflected and scattered by the surface of the finger 204. To do. The beam 102 in the shadowed portion of the finger 204 does not reach the retroreflective screen 103. Reference numeral 205 denotes scattered light from the finger 204. Of the scattered light, only the reflected light 206 that is specularly reflected (reflected back to the direction of incident light) with respect to the beam 102 and only the reflected light in the vicinity of the reflection direction reach the signal reading means of the beam irradiation / signal reading apparatus 101. . However, the light amount of this light (the reflected light 206 and the reflected light in the vicinity of the reflection direction) is a part of the scattered light 205 and 206, which is far greater than the light amount of the reflected light 104 from the retroreflective screen 103. It will be small. Reference numeral 207 denotes light (scattered light) that does not hit the bead 201 but scatters when hitting the reflective film 202. Reflection of the beam 102 also occurs in the reflective film 202, and only a small amount of reflected light 208 including regular reflected light reaches the signal reading means.

FIG. 3 shows an example of the read signal (the signal generated by the signal reading means). The position on the horizontal axis indicates the position in the spreading direction of the beam 102 having a one-dimensional spread in the traveling direction. In an area where the object such as the finger 204 does not exist and the reflected light 104 reflected by the retroreflective screen 103 returns to the beam irradiation / signal reading apparatus 101 (an area that is retroreflected), a signal at a substantially constant level is received. can get. On the other hand, as described above, the area where the object such as the finger 204 enters does not return (is not detected) the reflected light 104 from the retroreflective screen 103, and is one of the scattered light reflected by the object such as the finger 204. Is returned to the beam irradiation / signal reading apparatus 101 and detected. As a result, as indicated by 301 in the figure, the output level of the area where the object such as the finger 204 is present is significantly lower than the other areas.

It should be noted that the signal includes a component due to the reflected light 206 from the object such as the finger 204. However, in the present embodiment, only a portion with a very small expected angle of the reflected light (scattered light) reflected by the object such as the finger 204 returns to the beam irradiation / signal reading apparatus 101. Therefore, as shown in FIG. The output level is greatly different from that of the above region, and a clear distinction can be made.

By the way, the position, number, size, movement, and the like of the region 301 in which the output level of the signal is lowered as compared with other regions due to the object such as the finger 204 vary depending on the content of the user operation. For example, when an operation is performed with a plurality of fingers, that is, when the plurality of fingers impedes the progress of the beam 102, a plurality of regions 301 appear in the signal. Further, when an operation is performed with a fist, that is, when the fist prevents the beam 102 from proceeding, the area 301 becomes larger than when the operation is performed with a finger. Further, when an operation for moving an object such as the finger 204 is performed, for example, when a finger or the like that prevents the beam 102 from moving is slid, the region 301 moves in the same manner as the movement of the object over time. Indicates. The recognition means recognizes at least one of the position, size, number, and movement (movement direction, movement speed, etc.) of the region 301 and receives an input corresponding to the recognition result.

The signal reading means used here may be a one-dimensional image sensor or a single photodiode as will be described later. A two-dimensional camera as in the conventional example is not necessary. One-dimensional image sensors and photodiodes have a smaller number of pixels than two-dimensional cameras, and can be read 10 to 100 times or more faster. For example, in the case of a camera, 30 fps and 60 fps are common, but in this case, processing of one screen is about 33 ms and 16 ms. On the other hand, a one-dimensional image sensor used for a scanner or the like operates in about 1 ms. If the number of pixels is small, the speed can be further increased. This means that it is possible to follow a fast movement of the finger. Because it is one-dimensional and has a high S / N ratio, it can handle binary images instead of halftones. Therefore, recognition processing is very light and processing with a simpler processing system is possible. is there. In the case of a single photodiode, the speed can be further increased. One-dimensional image sensors and single photodiodes are cheaper and smaller than two-dimensional cameras, and are advantageous in terms of device size and cost.

According to this embodiment described above, an interface technology with a low degree of misrecognition and a high degree of freedom of operation is realized.

Further, according to the present embodiment, by using a one-dimensional image sensor element for recognition, it is possible to perform reading and recognition at high speed at a low cost, and has a structure in which reading is performed with a beam light and its shadow. Therefore, the recognition rate is very high, the light source is small and operates with low power, and an intuitive operation can be performed on the operation target image.

<Second Embodiment>
FIG. 4 shows an example of beam irradiation means of the interface apparatus of this embodiment. Since other configurations are the same as those of the first embodiment, description thereof is omitted here.

In this example, a laser is used as the light source. In the figure, 401 is a beam irradiation means, and the beam irradiation means 401 has an infrared laser 402, a collimating lens 403, and a diffractive optical element 404. The diffractive optical element 404 is an optical element that forms a pattern by diffraction, and can form any image. That is, the beam 102 having a one-dimensional direction (linear shape) toward the traveling direction can be formed.

FIG. 5 shows an example of an image pattern (beam shape) applicable to the interface device of the present embodiment. As a matter of course, a linear pattern can be formed as shown in FIG. 5 (A), and as shown in FIG. 5 (B), a dotted line or a broken line pattern with a dot sufficiently smaller than the shadow of a finger or hand should be used. You can also. In addition, a curve can be formed as shown in FIG. 5C, or a double line can be used as shown in FIG. Thereby, it is possible to form a beam having a necessary pattern in a necessary region. Thus, the beam irradiation means has a very simple structure, and can be manufactured in a small size and at low cost.

The above explanation is an example in which the diffractive optical element 404 is used as an optical element for forming an image. However, basically only one line needs to be drawn, and therefore, it can be formed using a simple lens system. Further, as will be described later, the light source may be an LED or the like.

According to the present embodiment, in addition to the above-described operational effects, the operational effects described in the first embodiment are also realized.

<Third Embodiment>
FIG. 6 shows an example of beam irradiation means of the interface apparatus of the present embodiment. Since other configurations are the same as those of the first embodiment, description thereof is omitted here.

In the figure, reference numeral 601 denotes a laser beam irradiation element, 602 denotes a beam emitted from the laser beam irradiation element 601, and 603 denotes a scanning element (scanning mirror) having a mirror that can be swung in at least one axial direction. The scanning mirror 603 can repeatedly perform a swinging motion in one axis direction (reciprocating motion).

When the beam 602 emitted from the laser beam irradiation element 601 is incident on the scanning mirror 603 performing the reciprocating operation, the plurality of beams 102 are sequentially emitted radially by the scanning of the scanning mirror 603. As a result, the passage region of the beam 102 has a planar shape (curtain shape). In this case, the plurality of beams 102 are not radiated at the same time, and only one beam 102 is radiated at a certain moment, but the same functions and operations as in the second embodiment. The effect can be realized.

The signal reading means sequentially reads the reflected light 104 of the plurality of beams 102 sequentially emitted in a radial fashion. Since the reflected light 104 sequentially returns to the signal reading means, a single unit such as a photodiode is used. One element is sufficient, and very high-speed reading is possible. Note that the reciprocating speed of the scanning mirror 603 varies between the center and the end. In signal processing (such as processing for identifying which of the plurality of beams 102 radiated from the read signal is caused), it is necessary to consider such a difference in speed. The position where the photodiode is installed is a position close to the scanning element. This is because the reflected light 104 of the beam 102 returns to the original position (beam irradiation / signal reading apparatus 101) by retroreflection. That is, in this embodiment, a single photodetecting element such as a photodiode may be installed at substantially the same position as the beam irradiation position, which is advantageous in terms of miniaturization.

According to the present embodiment, in addition to the above-described operational effects, the operational effects described in the first embodiment are also realized.

<Fourth Embodiment>
FIG. 7 shows an example of the beam irradiation / signal reading apparatus 101 of the interface apparatus of this embodiment. Since other configurations are the same as those of the first to third embodiments, description thereof is omitted here.

In this example, it is assumed that the reflected light 104 returns to the beam irradiation / signal reading apparatus 101 with a slight spread. That is, the retroreflective screen 103 is configured to reflect the reflected light that is wider than the incident light. Since it is difficult to completely eliminate imperfections, such as when the bead 201 is not a true sphere or when the reflective film 202 is distorted, the reflected light 104 may have a certain extent. For example, when the distance between the beam irradiation / signal reading device 101 and the retroreflective screen 103 is 1 m, if the retroreflective screen 103 falls within a range of ± 1 °, the reflected light 104 is reflected from the beam irradiation / signal reading device 101. It will spread over a range of about ± 1.7 cm in position.

7A is a view of the beam irradiation / signal reading apparatus 101 in FIG. 7B as viewed from the right to the left in the figure. FIG. 7B shows the beam irradiation / signal reading apparatus 101 in FIG. 7A. It is the figure which looked at the signal reader 101 from the left of the figure to the right. Note that the housing 704 is not illustrated in FIG. In the figure, reference numeral 701 denotes the spread of the reflected light 104, which is about 3.4 cm in the above-described example. A condenser lens 702 collects the reflected light 104 in the width direction of the one-dimensional image sensor 703. Reference numeral 704 denotes a housing having a light shielding structure for preventing excess light from entering the image sensor 703.

The housing 704 has a concave portion (light shielding means), and a condensing lens 702 and an image sensor 703 are provided in the concave portion, preferably in the deep portion of the concave portion. The recess has an inner wall made of a light shielding material. The depth direction of the concave portion is substantially parallel to the traveling direction of at least a part of the reflected light 104, and the reflected light 104 can be guided to the deep portion of the concave portion. On the other hand, external light traveling in a direction different from the depth direction of the concave portion is absorbed by the light shielding material constituting the inner wall before proceeding to the deep portion of the concave portion.

In this example, when the reflected light 104 returns to the beam irradiation means 401, it becomes a point in theory, so the image sensor 703 is provided on the near side. That is, the signal reading unit is installed at a position away from the beam irradiation unit. With this configuration, the image sensor 703 detects the reflected light 104 at a stage where the reflected light 104 spreads in a one-dimensional direction (linear) toward the traveling direction, and detects a linear image. The beam irradiation / signal reading apparatus 101 can be configured with such a simple mechanism. In this example, the signal reading means may be a one-dimensional image sensor 703 and can be sufficiently installed. As a result, the number of parts can be reduced as compared with the method described later.

According to the present embodiment, in addition to the above-described operational effects, the operational effects described in the first to third embodiments are also realized.

<Fifth Embodiment>
FIG. 8 shows an example of the beam irradiation / signal reading apparatus 101 of the interface apparatus of this embodiment. Since other configurations are the same as those of the first to third embodiments, description thereof is omitted here.

The position of the image sensor 703 is different in the beam irradiation / signal reading apparatus 101 of this embodiment compared to the beam irradiation / signal reading apparatus 101 of the fourth embodiment. Other configurations are the same as those of the fourth embodiment.

In the fourth embodiment, the image sensor 703 is provided on the front side of the position where the reflected light 104 returns to the theoretical point. In the present embodiment, the image sensor 703 is located behind the position where the reflected light 104 returns to the theoretical point. An image sensor 703 is provided on the side. That is, in the present embodiment, the image sensor 703 detects the signal that has once spread after the reflected light 104 is condensed, and performs signal detection. This configuration makes it easier to deal with a narrow spread range and downsizing of the apparatus, although it is a little. In this embodiment as well, the signal reading unit is installed at a position away from the beam irradiation unit.

According to the present embodiment, in addition to the above-described operational effects, the operational effects described in the first to third embodiments are also realized.

<Sixth Embodiment>
FIG. 9 shows an example of the interface device of this embodiment. Since other configurations are the same as those in the first to fifth embodiments, description thereof is omitted here.

In the figure, 901 is an LED, 902 is a concave mirror, and 903 is a projection lens. In general, LED light has a large spread, and a thin beam does not come out from itself. In order to approach the light beam, the light is condensed on the projection lens 903 using the concave mirror 902. The projection lens 903 projects the projection light shaped so that the passing area is close to a curtain shape (plane shape). Reference numeral 904 denotes a polarizing plate. The projection light from the projection lens 903 passes through the polarizing plate 904. Since LED light is generally non-polarized light, the polarization of the projection light from the projection lens 903 is aligned by the polarizing plate 904. Note that the polarizing plate 904 is unnecessary if a polarized LED that emits polarized light is put into practical use.

905 is a quarter wave plate. The light that has been linearly polarized by the polarizing plate 904 passes through the quarter-wave plate 905 and is changed to circularly polarized light. Thereafter, the retroreflective screen 103 is irradiated with the circularly polarized beam 102.

The retroreflective screen 103 is a kind of mirror. For example, when the beam 102 is clockwise circularly polarized light, the reflected light 104 is counterclockwise circularly polarized light. The reflected light 104 reflected by the retroreflective screen 103 then passes through the quarter wavelength plate 905. The reflected light 104 after passing through the quarter-wave plate 905 becomes linearly polarized light rotated by 90 degrees with respect to the polarization direction made by the polarizing plate 904. Reference numeral 906 denotes a polarizing plate in which the polarization direction (polarization direction of light to be transmitted) is orthogonal to the polarizing plate 904. The reflected light 104 that has passed through the quarter-wave plate 905 then passes through the polarizing plate 906 and then enters the signal reading means 907 and is read.

On the other hand, as shown in FIG. 9, when the finger 204 is positioned between the beam irradiation means and the retroreflective screen 103 and obstructs the progress of at least a part of the beam 102, the light scattered by the beam 102 hitting the finger 204. Of these, only the regularly reflected reflected light 206 bounces back toward the signal reading means. If the finger 204 is a mirror-like surface, the polarization is maintained in the same manner as the reflection from the retroreflective screen 103, but in general, the polarization of light scattered by the surface such as the finger 204 is lost. For this reason, a part of the reflected light 206 regularly reflected by the finger 204 cannot pass through the polarizing plate 906.

In such a configuration, the reflected light 908 after passing through the polarizing plate 906 has a smaller amount of light than the reflected light 206 before passing through the polarizing plate 906 (indicated by the magnitude relationship of arrows in the figure). ing). On the other hand, the reflected light 104 after passing through the polarizing plate 906 has no significant change in the amount of light compared to the reflected light 104 before passing through the polarizing plate 906 (indicated by the magnitude relationship of arrows in the figure). . As a result, it is possible to improve the contrast between the signal of the reflected light 104 reflected by the retroreflective screen 103 and the signal of the reflected lights 206 and 908 reflected by the object such as the finger 204.

It should be noted that when the LED is a light source, the spread range of the reflected light 104, 206, and 908 becomes large, so it is desirable to adopt the configuration shown in the fourth and fifth embodiments.

According to the present embodiment, in addition to the above-described operational effects, the operational effects described in the first to fifth embodiments are also realized.

<Seventh Embodiment>
FIG. 10 shows an example of the interface device of the present embodiment. The interface device according to the present embodiment is based on the configuration of the interface device according to the sixth embodiment, and is different in that the LED 901 is replaced with a beam irradiation unit 909 using a laser as a light source and a polarizing plate 904 is omitted. Since other configurations are the same as those in the first to sixth embodiments, description thereof is omitted here.

In the case of a laser, since the laser itself is polarized, it is not necessary to provide the polarizing plate 904 if the position is adjusted. In the figure, reference numeral 909 denotes a beam irradiation means using a laser as a light source.

According to the present embodiment, it is possible to realize the operational effects described in the first to sixth embodiments.

<Eighth Embodiment>
FIG. 11 shows an example of the interface device of the present embodiment. The interface device of the present embodiment is based on the configuration of the interface device of the sixth embodiment (see FIG. 9), omits the quarter wavelength plate 905, replaces the polarizing plate 906 with the polarizing plate 904, The difference is that the LED 901 is replaced with a beam irradiation means 909 using a laser as a light source. Since other configurations are the same as those of the first to seventh embodiments, description thereof is omitted here.

In this embodiment, the beam 102 irradiated by the beam irradiation unit 909 passes through the polarizing plate 904 before reaching the object such as the retroreflective screen 103 or the finger 204. Even if the light linearly polarized by the polarizing plate 904 is reflected by the retroreflective screen 103, the polarization direction is preserved. Accordingly, the reflected light 104 reflected by the retroreflective screen 103 passes through the same polarizing plate 904 and reaches the signal reading means 907. On the other hand, as in the case of circularly polarized light, the polarization direction of linearly polarized light is not preserved on the scattering surface. Accordingly, the change direction of the reflected light 206 reflected by the object such as the finger 204 is not preserved. For this reason, a part of the reflected light 206 cannot pass through the polarizing plate 904. As a result, as described in the sixth embodiment, the contrast between the signal of the reflected light 104 reflected by the retroreflective screen 103 and the signal of the reflected lights 206 and 908 reflected by the object such as the finger 204 can be improved. Is possible.

According to the present embodiment, it is possible to realize the effects described in the first to seventh embodiments.

<Ninth Embodiment>
FIG. 12 shows an example of the interface device of the present embodiment. Since the other configuration except the illustrated interface device is the same as that of the first to eighth embodiments, the description thereof is omitted here.

This embodiment is configured such that the spread of the reflected light 104 is very small. In the figure, reference numeral 1201 denotes a polarization beam splitter. The linearly polarized beam emitted from the beam irradiation means 909 using a laser as a light source passes through the polarizing beam splitter 1201 and then passes through the quarter wavelength plate 905. The beam 102 that has passed through the quarter-wave plate 905 and has become circularly polarized light is emitted toward the retroreflective screen 103. The reflected light 104 reflected by the retroreflective screen 103 passes through the quarter-wave plate 905 and is then reflected by the polarizing beam splitter 1201 and then imaged on the image sensor 703 through the condenser lens 702 as shown in the figure. . The reflected light 104 reflected by the retroreflective screen 103 has the circularly polarized light rotated in the reverse direction as described in the previous embodiment.

According to this embodiment, a contrast improvement effect is realized. Furthermore, according to the present embodiment, an image can be reliably formed on the image sensor 703 even if the reflected light 104 does not spread. When the configuration of the third embodiment is employed, a photodiode may be installed at the position of the image sensor 703 shown in the drawing.

According to the present embodiment, it is possible to realize the operational effects described in the first to eighth embodiments.

<Tenth Embodiment>
FIG. 13 shows an example of the interface device of the present embodiment. The remaining configuration except for the illustrated interface device is the same as that of the first to ninth embodiments, and a description thereof will be omitted here.

The interface device of this embodiment is different in the configuration of the retroreflective screen 103. That is, a prism is used instead of the beads described above. In the figure, reference numeral 1301 denotes a prism, and 1302 denotes a base that also serves as a reflective layer. As shown in the figure, retroreflection is possible with such a structure. The retroreflective screen 103 is not limited to the one described in the above embodiment or the present embodiment as long as the retroreflective screen 103 can be retroreflected.

According to the present embodiment, it is possible to realize the effects described in the first to ninth embodiments.

<Eleventh embodiment>
FIG. 14 shows an example of the interface device of the present embodiment. Since the other configuration except the illustrated interface device is the same as that of the first to tenth embodiments, description thereof is omitted here.

FIG. 14 shows a structural example of a portion where the retroreflective screen 103 is installed. Reference numeral 1401 denotes a housing having a light shielding structure. The casing is covered with a light shielding material and has a concave portion (light shielding means) having one end opened. And the retroreflective screen 103 is installed in this recessed part, Preferably it is a deep part. The depth direction of the concave portion is substantially parallel to the traveling direction of the beam 102, and the beam 102 can be guided to the deep portion of the concave portion. On the other hand, external light traveling in a direction different from the depth direction of the concave portion is absorbed by the surrounding light shielding material before traveling to the deep portion of the concave portion.

Since the retroreflective screen 103 returns the incoming light in the direction (retroreflects) in principle, it is not necessary to block outside light. However, as shown in FIG. 2, there is a portion that does not work as retroreflection, and there is an effect of blocking light entering that portion. Since the beam 102 has only a very thin width, the retroreflective screen 103 can be stored with a narrow gap in a recessed portion (concave portion) as shown in the figure, and it is possible to greatly reduce noise contamination due to external light. It is. Further, when the beam is visible light, there is an effect that the extra reflected light 104 from the retroreflective screen 103 is not touched by the operator.

According to the present embodiment, it is possible to achieve the effects described in the first to tenth embodiments.

<Twelfth Embodiment>
FIG. 15 shows an example of the interface device and user operation of the present embodiment. The other configurations except for the illustrated interface device and an example of user operation are the same as those in the first to eleventh embodiments, and thus the description thereof is omitted here.

As shown in the figure, the interface apparatus of the present embodiment has a plurality of (two sets in the figure) beam irradiation / signal reading apparatuses 101. In the figure, reference numeral 1501 denotes an operator's hand.

The first beam radiated from the first beam irradiation / signal reading device 101 has a plane-like spreading area. The second beam emitted from the second beam irradiation / signal reading device 101 has a passing area spread in a plane shape, and the passing area is separated from the passing area of the first beam. The recognizing means uses the time difference between the timing at which the object hinders the progress of at least a part of the first beam and the timing at which the object hinders the at least part of the second beam to move the object. The speed (movement speed in the direction penetrating the planar beam passage area) is calculated, and an input corresponding to the calculation result is accepted.

The greatest feature of this embodiment is that, as shown in the figure, the moving speed of an object such as a finger through the light curtain (plane-shaped passing region) by the beam 102 can be measured. If the difference between the timing at which an object such as a finger hinders the progress of the first beam 102 and the timing time at which the second beam 102 is hindered is measured, the distance between the first beam 102 and the second beam 102 is measured. Using the distance (representative value), the speed of finger movement can be measured. In the case of only one beam as described above, the moving speed of the finger in the extending direction of the retroreflective screen 103 can be detected, but the speed in the direction of penetrating the light curtain cannot be detected.

分 か る By knowing the operating speed in this direction, it is possible to set a new action difference based on the speed difference. For example, all gestures are regarded as input gestures only when the movement is fast, or the difference in speed is applied to the above-described volume increase / decrease.

According to the present embodiment, it is possible to realize the operational effects described in the first to eleventh embodiments.

<13th Embodiment>
FIG. 16 shows an example of an installation method when the interface device described in the first to twelfth embodiments is installed on a vehicle.

In FIG. 1, the beam irradiation / signal reading device 101 is installed on the ceiling, but in this embodiment, it is installed near the rearview mirror or on the rim of the windshield. Since the beam irradiation / signal reading apparatus 101 can be made compact, such installation is possible. If it exists in these positions, it is applicable also when there is no ceiling like an open car, or in the case of a movable ceiling.

Even if the beam irradiation / signal reading device 101 is provided on the rearview mirror as in the present embodiment, or the beam 102 is emitted obliquely by providing the beam irradiation / signal reading device 101 on the rim of the windshield, sufficient detection is possible. It is possible to secure an area. That is, a sufficiently wide planar (curtain-like) beam passage region can be formed in front of the driver. Note that it is sufficient that such a beam passing region can be formed at a position that can be reached by the operator, and the installation position of the beam irradiation / signal reading device 101 is not limited to the ones exemplified in the above embodiment and this embodiment.

Further, in the examples so far, the beam has been shown to be emitted from the top to the bottom. However, the beam irradiation / signal reading device 101 is incorporated in the vicinity of the steering shaft described in Japanese Patent No. 397002, and the ceiling portion. A configuration in which the retroreflective screen 103 is installed is also possible.

Furthermore, if the beam irradiation / signal reading device 101 is installed in two different places (for example, the rearview mirror part and the windshield rim part), the speed measurement and spatial measurement described in the twelfth embodiment can be performed. It is also possible to detect an absolute position.

Further, a passing region having a planar spread of the beam 102 emitted from the first beam irradiation / signal reading device 101 and a planar spread of the beam 102 emitted from the second beam irradiation / signal reading device 101 are provided. When the passing area having the position is on the same plane, the recognition means can specify the two-dimensional position coordinates of the operator (driver) finger or the like on the surface.

In other words, the first beam irradiation / signal reading device 101 emits a first beam having a passing area spreading in a plane, and the second beam irradiation / signal reading device 101 outputs the first beam irradiation / signal reading. From a position different from that of the apparatus 101, a second beam can be emitted in which the passing region has a planar shape and the passing region is located on the same plane as the passing region of the first beam. Then, the first beam irradiation / signal reading device 101 detects the first beam reflected by the retroreflective screen 103 and generates a first signal corresponding to the amount of light. The second beam irradiation / signal reading device 101 can detect the second beam reflected by the retroreflective screen 103 and generate a second signal corresponding to the amount of light. The recognizing means can calculate the two-dimensional position coordinates of the object such as the operator's finger using the first signal and the second signal.

For example, the point A in FIG. 16 indicates the position of the shadow portion on the retroreflective screen 103 and the first beam read by the first beam irradiation / signal reading device 101 with an object such as a finger positioned at the point A. The first straight line formed by connecting the position of the irradiation / signal reading device 101 and the position of the shadow portion on the retroreflective screen 103 read by the second beam irradiation / signal reading device 101 in the above state and the first line It can be specified by calculating the intersection of the second straight lines formed by connecting the positions of the two beam irradiation / signal reading devices 101. The point B in FIG. 16 can be calculated similarly. In the case of this example, the two-dimensional position of an object such as a finger can be detected, and more advanced input than before can be performed. For example, when operating the image of the head-up display to be displayed on the windshield, when the operation differs depending on the display position, such as the displayed button or bar, the driver's absolute position can be known, so the driver can be more accurately Input reflecting the intention of If used in combination with the speed detection, the function can be further improved.

As described above, according to this embodiment, there is provided an interface device that can be input with a high recognition rate at a small size, low cost, low power, and high speed without being affected by external light. Since it is small in size, the degree of freedom of installation location of the apparatus is high, and depending on the configuration, it is possible to input an operation speed in any direction and to detect a three-dimensional absolute position.

In addition, according to embodiment described above, it has a projection device which projects an image, has a head-up display installed in a mobile body, and an interface device installed in a mobile body, A display system that accepts a user operation to operate an image obtained by the head-up display is realized.

<< Appendix >>
According to the above description, the following invention is described.
<Invention 1>
A retroreflective screen,
Beam irradiation means for emitting a beam toward the retroreflective screen;
Signal reading means for detecting the beam reflected by the retroreflective screen and generating a signal according to the amount of light;
Based on the signal generated by the signal reading means, it is detected that an object located between the beam irradiation means and the retroreflective screen has hindered the progress of at least a part of the beam. Recognizing means for accepting input according to
An interface device.
<Invention 2>
In the interface device according to invention 1,
The retroreflective screen is configured to reflect reflected light that is wider than incident light;
The signal reading means is an interface device installed at a position away from the beam irradiation means.
<Invention 3>
In the interface device according to the invention 1 or 2,
The beam irradiation means has a laser and a diffractive optical element,
An interface device using the diffractive optical element to convert light from the laser into a beam having a linear spread in the traveling direction.
<Invention 4>
In the interface device according to the invention 1 or 2,
The beam irradiation means includes a laser and a scanning element that swings a mirror in one axis direction,
An interface device that radiates a beam radially by applying light from the laser to the mirror that is swung in one axis direction.
<Invention 5>
In the interface device according to any one of the inventions 1 to 4,
A quarter wave plate and a polarizing plate,
After the beam linearly polarized in a first direction passes through the quarter-wave plate and is circularly polarized, the circularly polarized beam is applied to the retroreflective screen, and then the retroreflective screen The reflected circularly polarized beam passes through the quarter-wave plate and returns to linearly polarized light, and then the beam that has returned to linearly polarized light passes light polarized in a direction orthogonal to the first direction. An interface device configured to detect the beam that has passed through the polarizing plate configured to pass through the polarizing plate and then pass through the polarizing plate.
<Invention 6>
In the interface device according to any one of the inventions 1 to 4,
The retroreflective screen is irradiated with the linearly polarized beam,
A polarizing plate configured to pass the beam reflected by the retroreflective screen;
The signal reading means is an interface device that detects only light that has passed through the polarizing plate.
<Invention 7>
In the interface device according to any one of the inventions 1 to 6,
An interface apparatus further comprising a light shielding unit that guides the beam reflected by the retroreflective screen to the signal reading unit and prevents at least a part of other light from reaching the signal reading unit.
<Invention 8>
In the interface device according to any one of the inventions 1 to 7,
The recognizing means recognizes at least one of the size, number, movement, and position of a shadow portion formed by preventing at least a part of the beam from being advanced by the object, and according to the recognition result. An interface device that accepts input.
<Invention 9>
In the interface device according to any one of the inventions 1 to 8,
The beam irradiating means includes: the first beam having a plane-like spreading area; and the second beam having a plane-like spreading area and separated from the first beam passing area. And
The recognizing unit uses a time difference between a timing at which the object prevents the advancement of at least a part of the first beam and a timing at which the object prevents an advancement of at least a part of the second beam. An interface device for calculating the moving speed of the object and receiving an input according to the calculation result.
<Invention 10>
In the interface device according to any one of the inventions 1 to 8,
A plurality of beam irradiation means;
The first beam irradiating means emits a first beam having a passing area spreading in a plane,
The second beam irradiating means has a passing area extending in a plane shape from a position different from the first beam irradiating means, and the passing area is flush with the passing area of the first beam. Emit a second beam,
The signal reading unit detects the first beam reflected by the retroreflective screen, generates a first signal corresponding to the amount of light, and detects the second beam reflected by the retroreflective screen. , Generate a second signal according to the amount of light,
The recognition device is an interface device that calculates a two-dimensional position coordinate of the object using the first signal and the second signal.
<Invention 11>
A head-up display that has a projection device that projects an image and is installed on a moving body;
The interface device according to any one of inventions 1 to 10 installed in the mobile body;
Have
The interface device is a display system that accepts a user operation for manipulating an image obtained by the head-up display.
<Invention 12>
A beam is emitted from the beam irradiating means toward the retroreflective screen, the signal reflected by the retroreflective screen is detected by a signal reading means, a signal corresponding to the light amount is generated, the signal is analyzed, and the beam is analyzed An input receiving method for detecting that the progress of at least a part of the beam is hindered by an object located between an irradiation means and the retroreflective screen and receiving an input according to the mode.
<Invention 12-2>
In the input acceptance method according to the invention 12,
The retroreflective screen is configured to reflect reflected light that is wider than incident light;
An input receiving method in which the signal reading unit detects the beam at a position away from the beam irradiation unit.
<Invention 12-3>
In the input acceptance method according to the invention 12 or 12-2,
The beam irradiation means has a laser and a diffractive optical element,
An input receiving method that uses the diffractive optical element to convert light from the laser into a beam having a linear spread in the traveling direction.
<Invention 12-4>
In the input acceptance method according to the invention 12 or 12-2,
The beam irradiation means includes a laser and a scanning element that swings a mirror in one axis direction,
An input receiving method in which light from the laser is applied to the mirror that is oscillated in one axis direction, and a beam is emitted radially.
<Invention 12-5>
In the input receiving method according to any one of the inventions 12 to 12-4,
Using a quarter wave plate and a polarizing plate,
After the beam linearly polarized in a first direction passes through the quarter-wave plate and is circularly polarized, the circularly polarized beam is applied to the retroreflective screen, and then the retroreflective screen The reflected circularly polarized beam passes through the quarter-wave plate and returns to linearly polarized light, and then the beam that has returned to linearly polarized light passes light polarized in a direction orthogonal to the first direction. An input receiving method in which the signal reading means detects the beam that has passed through the polarizing plate configured to be.
<Invention 12-6>
In the input receiving method according to any one of the inventions 12 to 12-4,
Irradiating the retroreflective screen with the linearly polarized beam;
An input receiving method in which only the light that has passed through a polarizing plate configured to pass the beam reflected by the retroreflective screen is detected by the signal reading means.
<Invention 12-7>
In the input receiving method according to any one of the inventions 12 to 12-6,
An input receiving method for guiding the beam reflected by the retroreflective screen to the signal reading unit by a light shielding unit and preventing at least a part of other light from reaching the signal reading unit.
<Invention 12-8>
In the input receiving method according to any one of the inventions 12 to 12-7,
Analyzing the signal, recognizing at least one of the size, number, movement, and position of a shadow portion formed by preventing the object from proceeding with at least a part of the beam. An input acceptance method that accepts input in response.
<Invention 12-9>
In the input receiving method according to any one of the inventions 12 to 12-8,
The beam irradiating means includes: the first beam with a passing area extending in a plane; the second beam having a passing area extending in a plane and separated from the passing area of the first beam; And
Analyzing the signal and utilizing a time difference between a timing at which the object hinders at least a part of the first beam and a timing at which the object hinders at least a part of the second beam. An input receiving method for calculating the moving speed of the object and receiving an input according to the calculation result.
<Invention 12-10>
In the input receiving method according to any one of the inventions 12 to 12-8,
Using a plurality of beam irradiation means,
The first beam irradiating means emits a first beam having a plane-like spreading area,
The second beam irradiating means has a passing area extending in a plane shape from a position different from the first beam irradiating means, and the passing area is flush with the passing area of the first beam. Emit a second beam,
The signal reading means detects the first beam reflected by the retroreflective screen, generates a first signal corresponding to the amount of light, and detects the second beam reflected by the retroreflective screen. , Generate a second signal according to the amount of light,
An input receiving method for analyzing the first signal and the second signal and calculating a two-dimensional position coordinate of the object.

This application claims priority based on Japanese Patent Application No. 2012-250554 filed on November 14, 2012, the entire disclosure of which is incorporated herein.

Claims (10)

A retroreflective screen,
Beam irradiation means for emitting a beam toward the retroreflective screen;
Signal reading means for detecting the beam reflected by the retroreflective screen and generating a signal according to the amount of light;
Based on the signal generated by the signal reading means, it is detected that an object located between the beam irradiation means and the retroreflective screen has hindered the progress of at least a part of the beam. Recognizing means for accepting input according to
An interface device. The interface device according to claim 1,
The retroreflective screen is configured to reflect reflected light that is wider than incident light;
The signal reading means is an interface device installed at a position away from the beam irradiation means. The interface device according to claim 1 or 2,
The beam irradiation means has a laser and a diffractive optical element,
An interface device using the diffractive optical element to convert light from the laser into a beam having a linear spread in the traveling direction. The interface device according to claim 1 or 2,
The beam irradiation means includes a laser and a scanning element that swings a mirror in one axis direction,
An interface device that radiates a beam radially by applying light from the laser to the mirror that is swung in one axis direction. The interface device according to any one of claims 1 to 4,
A quarter wave plate and a polarizing plate,
After the beam linearly polarized in a first direction passes through the quarter-wave plate and is circularly polarized, the circularly polarized beam is applied to the retroreflective screen, and then the retroreflective screen The reflected circularly polarized beam passes through the quarter-wave plate and returns to linearly polarized light, and then the beam that has returned to linearly polarized light passes light polarized in a direction orthogonal to the first direction. An interface device configured to detect the beam that has passed through the polarizing plate configured to pass through the polarizing plate and then pass through the polarizing plate. The interface device according to any one of claims 1 to 4,
The retroreflective screen is irradiated with the linearly polarized beam,
A polarizing plate configured to pass the beam reflected by the retroreflective screen;
The signal reading means is an interface device that detects only light that has passed through the polarizing plate. The interface device according to any one of claims 1 to 6,
An interface apparatus further comprising a light shielding unit that guides the beam reflected by the retroreflective screen to the signal reading unit and prevents at least a part of other light from reaching the signal reading unit. The interface device according to any one of claims 1 to 7,
The beam irradiating means includes: the first beam having a plane-like spreading area; and the second beam having a plane-like spreading area and separated from the first beam passing area. And
The recognizing unit uses a time difference between a timing at which the object prevents the advancement of at least a part of the first beam and a timing at which the object prevents an advancement of at least a part of the second beam. An interface device for calculating the moving speed of the object and receiving an input according to the calculation result. The interface device according to any one of claims 1 to 7,
A plurality of beam irradiation means;
The first beam irradiating means emits the first beam having a passage area spreading in a plane,
The second beam irradiating means has a passing area extending in a plane shape from a position different from the first beam irradiating means, and the passing area is flush with the passing area of the first beam. Emit a second said beam located;
The signal reading unit detects the first beam reflected by the retroreflective screen, generates a first signal corresponding to the amount of light, and detects the second beam reflected by the retroreflective screen. , Generate a second signal according to the amount of light,
The recognition device is an interface device that calculates a two-dimensional position coordinate of the object using the first signal and the second signal. A beam is emitted from the beam irradiating means toward the retroreflective screen, the beam reflected by the retroreflective screen is detected to generate a signal according to the amount of light, the signal is analyzed, and the beam irradiating means and the beam An input receiving method for detecting that the progress of at least a part of the beam is hindered by an object positioned between the retroreflective screen and receiving an input according to the mode.

Images