JP2018165879A - Electronic blackboard system and display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an electronic blackboard system and a display method in an electronic blackboard system capable of further reliably identifying a finger per individual.SOLUTION: An electronic blackboard system for reflecting finger input to a projection screen of a projector on the surface of a projection screen includes: a plurality of receiving units that combine to form the projection surface of the projector; a communication device capable of communicating with an IC card carried by a system user and transmitting identification information obtained by communication with the IC card when a system user performs a finger input on any one of the plurality of receiving units, by means of human body communication, to the receiving unit on which the finger input is performed; a camera for imaging an image on the projection screen; and a control unit for determining a finger input from an image taken by the camera and specifying a receiving unit provided correspondingly to a position at which finger input is performed, and for projecting a projection screen corresponding to identification information obtained by performing human body communication by the specified receiving unit onto the projector.SELECTED DRAWING: Figure 2

Description

  The present invention relates to an electronic blackboard system and a display method.

  An electronic blackboard system (IWB: Interactive whiteboard) that performs an input operation on a projection screen of a projector or the like using an electronic pen or a finger and reflects the result on the projection screen is used in a conference room or a classroom.

  Patent Document 1 (2016-184850) discloses an indicator that emits infrared light such as an electronic pen (self-luminous indicator) and an indicator that does not emit light such as a finger (non-luminous indicator). In order to detect both, a method for recognizing images captured by a plurality of visible light cameras has been proposed.

  In the electronic blackboard system, it is possible to perform more efficient conference operations and classes by identifying whether the input operation was performed with either the electronic pen or finger, and displaying differently, so the input operation can be identified. Techniques for doing so have been proposed.

  In Patent Document 2 (Japanese Patent Application Laid-Open No. 2011-145762), when information is received from an electronic pen that outputs pen information and position detection information, the information is input by the electronic pen, and when only position detection information is received, the finger is used. It is disclosed as an input.

  Further, when a plurality of persons perform operations, if different functions can be provided for each person or a trajectory for each person can be extracted, it can be used for more efficient conference management and education analysis.

  Patent Document 3 (Japanese Patent Laid-Open No. 2012-194781) discloses a writing input used for a writer to write information when writing information on a display board such as an electronic blackboard or an interactive whiteboard. In order to reliably determine the information about the device, the identification information assigned to the writing input device and the operation data generated in accordance with the writing operation of the writer are received from the writing input device. Feature point data corresponding to the feature point characterizing the writing operation of the writing information is extracted from the time-series writing data indicating the writing position of the embedded information, and between the extracted feature point data and the received operation data In accordance with the result of the collation, the writing data used for extracting the feature point data is associated with the identification information transmitted together with the operation data, and the writing data associated with the identification information is correlated. Writing information display device for displaying writing information on a display board with is disclosed.

Japanese Patent Laid-Open No. 2006-184850 JP 2011-145762 A JP 2012-194781 A JP 2012-53520 A Japanese Patent Laid-Open No. 2006-184850

  In the invention described in Patent Document 3, when a writer different from the writer M performs writing simultaneously with the writer M using a different writing input device, the writing of the writer (first The write data (first write data) obtained by writing (1) is separated from the write data (second write data) obtained by writing by another writer (second write). Therefore, the groups of write data are distinguished based on the write position indicated by the first write data.

  However, since the touch panel for receiving the identification information shown in Patent Document 3 is a single-panel configuration provided on the display panel, when a plurality of writers simultaneously write, the identification information Reception cannot be performed reliably.

  The present invention realizes an electronic blackboard system that more reliably identifies a finger for each individual and a display method in the electronic blackboard system.

An electronic blackboard system according to the present invention is an electronic blackboard system that reflects finger input to a projection screen of a projector on the projection screen,
A plurality of receivers combined to form the projection surface of the projector;
Communication is possible with an IC card carried by the system user, and the identification information obtained by communication with the IC card when the system user inputs a finger to any of the plurality of receiving units is input by human body communication. A communication device that transmits to the receiving unit
A camera for imaging the projection surface;
It is obtained by detecting finger input from the image captured by the camera and specifying a receiving unit provided corresponding to the position where the finger input is performed, and performing human body communication at the specified receiving unit. A control unit that causes the projector to project a projection screen corresponding to the identification information.

The display method in the electronic blackboard system according to the present invention is a display method in the electronic blackboard system that reflects finger input to the projection screen of the projector on the projection screen,
A projection surface of the projector is formed by combining a plurality of receiving units,
Identification information acquired by communication with the IC card when the system user performs finger input to any of the plurality of receiving units with a communication device capable of communicating with the IC card carried by the system user through human body communication Sent to the receiving part where the finger input was made,
Image the projection surface with a camera,
It is obtained by detecting finger input from the image captured by the camera and specifying a receiving unit provided corresponding to the position where the finger input is performed, and performing human body communication at the specified receiving unit. The projector projects a projection screen corresponding to the identification information.

  In this invention provided with said structure, the identification of the finger for every individual can be performed more reliably.

(A) is a perspective view which shows the structure of one Embodiment of the electronic blackboard system by this invention, (b) is a figure which shows an example of the projection image of the projector which comprises an electronic blackboard system. It is a figure which shows the circuit structure of embodiment of this invention. It is a flowchart which shows the display operation regarding finger input performed by embodiment of this invention. It is a figure which shows the other structural example of a human body communication receiving part, (a) shows the example which arranged the rectangular receiving parts 401A-401D vertically, (b) shows the rectangular receiving parts 402A-402D horizontally. An example is shown below.

  Next, embodiments of the present invention will be described with reference to the drawings.

  In the present invention, identification information obtained by tracking a detection point of a finger from an image captured by a laser curtain of infrared light and using a human body communication technique as disclosed in Patent Document 4 (Japanese Patent Application Laid-Open No. 2012-53520). By making these correspond to each other, a different display is performed for each user who inputs with a finger.

  FIG. 1A is a perspective view showing a configuration of an embodiment of an electronic blackboard system according to the present invention, and FIG. 1B is a diagram showing an example of a projected image of a projector constituting the electronic blackboard system.

  The present embodiment includes a PC (Personal Computer) 101, cables 102 and 107, a human body communication receiving unit 103, a laser light emitting unit 104, a projector 105, and communication devices 106A and 106B.

  The human body communication receiving unit 103 is connected to the PC 101 via the cable 102 and is connected to the projector 105 via the cable 107. The human body communication receiving unit 103 includes a plurality of receiving units arranged in a matrix and also serves as a projection surface of the projector 105. Each receiving unit is an electrode, and it is preferable to use a transparent electrode because the projection surface is preferably white.

  The laser light emitting unit 104 illuminates the upper surface of the human body communication receiving unit 103 with infrared laser light. The projector 105 includes an infrared camera. In addition to the image projection operation similar to that of a normal projector, the projector 105 captures the human body communication receiving unit 103 that is a projection surface, and the captured image is transmitted to the PC 102 via the cable 107 and the cable 102. To send.

  The communication devices 106 </ b> A and 106 </ b> B are used by being attached to different system users. The communication devices 106 </ b> A and 106 </ b> B read information on an IC card such as an employee ID card or student ID card carried by the system user to configure the human body communication receiving unit 103. Send to the receiver. As a specific configuration of the communication devices 106A and 106B, for example, the configuration disclosed in Patent Document 4 can be used. However, the communication device 106A and 106B can communicate with an IC card, and an IC card is used as an electrode for reading information by human body communication technology. The configuration is not particularly limited as long as the identification information (ID) acquired by communication with can be transmitted.

  As shown in FIG. 1 (b), when input is made with fingers 107A and 107B of a system user with communication devices 106A and 106B attached to the human body communication receiving unit 103, the input of each finger 107A and 107B is tracked. The results 108A and 108B are shown in the projected image of the projector 105.

FIG. 2 is a diagram showing a circuit configuration of the present embodiment. As shown in FIG. 2, this embodiment includes an infrared camera 201, an IWB processing unit 202, a video output unit 203, a communication control unit 204, an ID storage unit 205, a human body communication device 206, and receiving units 207 ₁ and 207. ₂ ,..., 207 _n . The system according to the present embodiment also projects an image based on an image signal provided from the PC 101, but this part is performed by a known technique and is not particularly related to image projection by finger input. The description is omitted, and FIG. 2 shows only a portion where image projection corresponding to finger input is performed.

The infrared camera 201 and the video output unit 203 are provided in the projector 105 shown in FIG. The IWB processing unit 202, the communication control unit 204, and the ID storage unit 205 are provided in the PC 101 shown in FIG. The human body communication device 206 corresponds to the communication devices 106A and 106B shown in FIG. 1, and the receiving units 207 ₁ , 207 ₂ ,... 207 _n constitute the human body communication receiving unit 103 shown in FIG.

  The video output unit 203 projects video light at a predetermined frame rate, and the infrared camera 201 transmits the captured video to the IWB processing unit 202 in synchronization with the video light projection rate of the video output unit 203.

  The IWB processing unit 202 transfers the captured image from the infrared camera 201 to the communication control unit 204, and then, depending on the input content by the system user's finger sent from the communication control unit 204 and the system user The video shown in the video signal is displayed on the video output unit 203.

  The ID storage unit 205 stores setting information indicating display contents, and stores predetermined setting information that defines display contents such as colors and line types for each identification information.

The communication control unit 204 detects an input by a finger from the captured image of the infrared camera 201 from the IWB processing unit 202 and receives the detection result and the receiving units 207 ₁ , 207 ₂ ,... Constituting the human body communication receiving unit 203. , 207 _n are associated with the identification information input, and a video signal that is displayed by the finger is generated according to the display content indicated in the setting information stored in the ID storage unit corresponding to the input identification information And transmitted to the IWB processing unit 202.

  Further, the communication control unit 204 stores tracking information for tracking the finger input position. The tracking information is a collection of detection points by the same finger. Whether or not the detection point is the same finger is checked based on whether or not the new detection point is within a predetermined range with respect to the previous detection point stored in the tracking information.

  FIG. 3 is a flowchart showing a display operation related to finger input performed in the present embodiment. When the operation is started, an image by the infrared camera 201 is acquired and transmitted to the communication control unit 204 via the IWB processing unit 202 (step S301).

  The communication control unit 204 detects whether a finger has been input, derives a detection point corresponding to the position, and updates tracking information based on the acquired camera video (step S302).

  Tracking information update is performed by tracking method calculation such as distance calculation with the detection point recorded in the previous tracking information, if there is a detection point that is judged to be by the same finger, Update the previous tracking information to add the detection point position detected this time.

  Since there is no tracking information when the finger is input for the first time, only the detection point of the finger is derived, and tracking information with a new detection point is created. Further, even when the detection point is not determined by the above distance calculation to be input by the same finger, the tracking information as a new detection point is created, and the previous tracking information is deleted.

  Next, it is confirmed whether there is a new detection point among the detection points derived in step S302 (step S303). If it is the first time and at least one detection point has been derived in step S302, the process proceeds to step S304 as all new detection points. In the case of the second and subsequent times, if there is a point that is not determined to be the same as the previous tracking information among the detection points derived in step S302, it is determined as a new detection point. Proceed to step S304.

  If no detection point is derived in step S302, or if all the detection points are determined to be the same as the previous tracking information, only the tracking information is sent to the IWB processing unit 202, and step S313 is performed. Proceed to

Position of step S304 in a new detection points, a plurality of receiving portions 207 _1, 207 _2, ..., whether present on the receiving portion of the human body communication receiver 103 throat consisting of 207 _n, the infrared camera 201 Decide based on the video.

  The communication control unit 204 communicates with the communication device 106A (or 106B) possessed by each operator using the receiving unit corresponding to the position determined in step S304, and acquires ID information (step S305).

  Next, it is confirmed whether the acquisition of the ID information is successful (step S306). If the acquisition of ID information has succeeded, the process proceeds to step S307. If the acquisition of ID information has failed, only the tracking information is sent to the IWB processing unit 202, and the process proceeds to step S313.

  In step S307, the ID acquired in step S305 is referred to the data in the ID storage unit 205. Subsequently, it is confirmed whether the same ID as the ID acquired in step S305 exists in the ID storage unit 205 (step S308).

  In step S308, when it is confirmed that the same ID as the ID acquired in step S305 exists in the ID storage unit 205, setting information stored in association with the confirmed ID is read (step S309). . In step S308, if it is not confirmed that the same ID as the ID acquired in step S305 is present in the ID storage unit 205, the initial setting (default) setting information is read out to be a new ID. The ID is stored in the ID storage unit 205 together with the acquired ID (step S312).

  After step S309 or step S312, the communication control unit 204 transmits the tracking information together with the setting information read in step S309 or step S312 to the IWB processing unit 202 (step S310), and the setting information is sent to the IWB process. Reflect. Subsequently, the IWB processing unit 202 performs drawing / operation processing (step S313).

  In step S313, in the case of transition from step S303 or step S306, if the IWB processing unit 202 receives only tracking information without setting information, the GUI screen is drawn or projected with default setting information. Performs processing operations such as click-up input. In the case of transition from step S310, processing operations such as click input on the GUI screen drawn or projected by the setting information sent from the communication control unit 404 are performed.

  In the present embodiment configured as described above, the human body communication receiving unit provided as the projection screen is configured by a plurality of receiving units, so that a plurality of people perform operations by finger input at the same time. However, since human body communication is performed individually for each receiving unit, no interference occurs. Thereby, each finger input can be reliably identified and operated with each finger having a different function.

  Next, another embodiment of the present invention will be described.

  In the embodiment shown in FIG. 1, the human body communication receiving unit 103 is composed of a plurality of receiving units arranged on a matrix. However, the number of receiving units can be reduced by using another installation method. is there. FIG. 4 shows another installation example of the receiving unit constituting the human body communication receiving unit 103.

  Considering the actual usage environment, users who perform finger input often write side by side or vertically. Therefore, by arranging the rectangular receiving units vertically or horizontally, it is highly possible that each person will touch different receiving units, and human body communication can be performed in the same way as when arranged in a matrix, and the cost due to the reduction in the number of panels It also leads to down.

  4A shows an example in which rectangular receiving units 401A to 401D are vertically arranged to constitute a human body communication receiving unit, and FIG. 4B is an example in which rectangular receiving units 402A to 402D are arranged horizontally to receive human body communication. The example which comprised the part is shown, and it is good also as such a structure.

  In the present invention, the laser emission unit 104 and the infrared camera 201 are used as finger detection means, but other detection methods such as detection by a plurality of visible light cameras as disclosed in Patent Document 5 are also possible. It is. Even in this case, the operation shown in the flowchart shown in FIG. 3 does not change. Further, the camera need not be provided integrally with the projector, and may be arranged independently.

  In FIG. 2, the IWB processing unit 202, the communication control unit 204, and the ID storage unit 205 are illustrated as being different from each other, but these may be an integrated control unit.

101 PC
102, 107 Cable 103 Human body communication unit 104 Laser light emitting unit 105 Projector 106A, 106B Communication device 107A, 107B Finger 108A, 108B Tracking result 201 Infrared camera 202 IWB processing unit 203 Video output unit 204 Communication control unit 205 ID storage unit 206 Human body Communication device 207 ₁ , 207 ₂ ,..., 207 _n receiver

Claims (6)

An electronic blackboard system that reflects finger input on a projection screen of a projector on the projection screen,
A plurality of receivers combined to form the projection surface of the projector;
Communication is possible with an IC card carried by the system user, and the identification information obtained by communication with the IC card when the system user inputs a finger to any of the plurality of receiving units is input by human body communication. A communication device that transmits to the receiving unit
A camera for imaging the projection surface;
It is obtained by detecting finger input from the image captured by the camera and specifying a receiving unit provided corresponding to the position where the finger input is performed, and performing human body communication at the specified receiving unit. And a control unit that causes the projector to project a projection screen corresponding to the identification information. The electronic blackboard system according to claim 1,
The electronic blackboard system, wherein the control unit causes the projector to project a projection screen corresponding to setting information defining display contents set for each identification information. The electronic blackboard system according to claim 1 or 2,
The electronic blackboard system, wherein the plurality of receiving units are arranged in a matrix. The electronic blackboard system according to claim 1 or 2,
The plurality of receiving units are electronic blackboard systems in which rectangular receiving units are vertically arranged. The electronic blackboard system according to claim 1 or 2,
The plurality of receiving units are electronic blackboard systems in which rectangular receiving units are arranged horizontally. A display method in an electronic blackboard system that reflects a finger input on a projection screen of a projector on the projection screen,
A projection surface of the projector is formed by combining a plurality of receiving units,
Identification information acquired by communication with the IC card when the system user performs finger input to any of the plurality of receiving units with a communication device capable of communicating with the IC card carried by the system user through human body communication Sent to the receiving part where the finger input was made,
Image the projection surface with a camera,
It is obtained by detecting finger input from the image captured by the camera and specifying a receiving unit provided corresponding to the position where the finger input is performed, and performing human body communication at the specified receiving unit. A display method in the electronic blackboard system, wherein the projector projects a projection screen corresponding to the identification information.

Images