JP5077277B2 - Terminal apparatus, communication control system, communication control method, and terminal control program - Google Patents

Description

  The present invention relates to a terminal device, a communication control system, a communication control method, and a terminal control program, and more specifically, a terminal device, a communication control system, a communication control method, and a terminal control program that receive information from a remote control terminal. It is about.

  Conventionally, other terminal operation devices that connect a plurality of terminals via a network and display a screen shared by the plurality of terminals in a video conference or the like performed between the terminals are known (for example, Patent Documents). 1). According to the other terminal operation device described in Patent Document 1, the pointer on the display screen of the operation terminal and the pointer on the display screen of the display unit of the operated terminal can be displayed in conjunction with each other. Thus, the pointer identifier on the operated terminal side can be operated in conjunction with the operation of the pointer input device on the operating terminal side, so that the operated terminal can be operated in the same sense as the operating terminal.

JP 2000-57094 A

  However, in the other terminal operation device of the invention described in Patent Literature 1, when a user talks about data displayed on the screen between the users on the operation terminal side, for example, the operated terminal side which is another point When a portion not displayed on the display screen is pointed to, the pointer moves in conjunction with the other operated terminal. For this reason, there is a problem that it is troublesome for the user on the operated terminal side. In addition, there is a problem that portions other than the display screen cannot be pointed by the pointer.

  Therefore, the present invention has been made to solve the above-described problem. When a user talks about data displayed on a screen using a pointer among other users, the other terminal device is used. An object of the present invention is to provide a terminal device, a communication control system, a communication control method, and a terminal control program that alleviate the troublesomeness caused by the movement of the pointer.

  In order to achieve the above object, a terminal device according to claim 1 is capable of receiving an instruction from a remote control terminal that can be connected to a network and that has an instruction means capable of operating a pointer on a display screen for displaying information. A receiving terminal device for receiving from the remote control terminal specific information for specifying a position of the pointer on a plane including the display screen; When receiving the information, the position calculation means for calculating the position of the pointer based on the specific information, and the position of the pointer calculated by the position calculation means is communicated with the other terminal devices via the network. The first determination means for determining whether or not the shared data that is the data shared between the two exists in the shared area to be displayed; Position information transmitting means for transmitting position information for specifying the position of the pointer to a server or other terminal device connected via the network, when it is determined that the position of the inter exists in the shared area; When the first determination means determines that the position of the pointer does not exist within the shared area, the remote control terminal can be instructed by a cursor displayed on the display screen from a cursor instruction means capable of instructing laser. Based on the position information transmitted from the position information transmission means of a plurality of the terminal devices connected via the network and instruction information transmission means for transmitting information instructing to switch to a pointer to the remote control terminal The generated image data including the image of the pointer corresponding to the plurality of terminal devices existing in the shared area is displayed in the table. And a display control means for displaying on the screen.

  According to a second aspect of the present invention, in addition to the configuration of the first aspect of the invention, the position information transmitting means is configured such that the position of the pointer exists in the shared area by the first determining means. If it is determined, the image data receiving means for transmitting the position information to the server and receiving the image data created based on the position information transmitted by the position information transmitting means from the server. The display control means displays the image data received by the image data receiving means on the display screen.

  According to a third aspect of the present invention, in addition to the configuration of the first or second aspect of the invention, the first determination unit determines that the position of the pointer does not exist in the shared area. In this case, there is provided non-display information transmitting means for transmitting non-display information which is information for instructing the server not to display the image of the pointer on the display screen.

  According to a fourth aspect of the present invention, in addition to the configuration of the third aspect of the invention, when the non-display information is transmitted to the server by the non-display information transmitting means, the image is displayed. The data receiving means receives image data including information indicating that the remote control terminal corresponding to the terminal device that has transmitted the non-display information has been switched to the laser pointer from the server.

  In addition, the communication control system of the invention according to claim 5 can be connected to a remote control terminal having an instruction means capable of operating a pointer on a display screen for displaying information and an instruction from the remote control terminal. A specific information receiving means for receiving, from the remote control terminal, specific information for specifying the position of the pointer on a plane including the display screen. And when the specific information is received by the specific information receiving means, a position calculating means for calculating the position of the pointer based on the specific information, and the position of the pointer calculated by the position calculating means, It is determined whether or not shared data, which is data shared with other terminal devices via the network, exists in a shared area to be displayed. When the first determination means and the first determination means determine that the position of the pointer exists in the shared area, position information for specifying the position of the pointer is connected via the network. Created based on the location information transmitted from the location information transmission means of a plurality of the terminal devices connected via the network and the location information transmission means to be transmitted to a server or another terminal device, Display control means for displaying on the display screen image data including images of the pointers corresponding to a plurality of the terminal devices existing in the shared area, and the position of the pointer in the first judging means is the shared area If it is determined that the remote control terminal does not exist within the display screen, the remote control terminal can be instructed by a cursor displayed on the display screen from a cursor pointing means capable of pointing with a laser pointer. Instruction information transmitting means for transmitting information instructing to switch to the remote control terminal, wherein the remote control terminal transmits the specific information to the terminal apparatus, and the terminal apparatus An instruction information receiving means for receiving the instruction information transmitted by the instruction information transmitting means; and when the instruction information is received by the instruction information receiving means, the remote control terminal is moved to the cursor based on the received instruction information. A second determination unit that determines whether to function as an instruction unit or the laser pointer; and when the second determination unit determines to function as the cursor instruction unit, the cursor instruction is issued to the remote control terminal. A first control unit that performs control to function as a unit, and the second determination unit that functions as the laser pointer. If it is determined, second control means for performing control for causing the remote control terminal to function as the laser pointer is provided.

Further, the communication control system of the invention according to claim 6 includes, in addition to the configuration of the invention according to claim 5, third determination means for determining whether or not the remote control terminal is stationary.
And third control means for performing control for preventing the remote control terminal from functioning as the laser pointer when the third determination means determines that the remote control terminal is stationary.

  The communication control method of the invention according to claim 7 is a terminal device that accepts an instruction from a remote control terminal that can be connected to a network and that has an instruction means capable of operating a pointer on a display screen for displaying information. A communication information processing method processed by the step of receiving specific information for specifying the position of the pointer on a plane including the display screen from the remote control terminal; and the specific information receiving step When the specific information is received at the position, the position calculating step for calculating the position of the pointer based on the specific information, and the position of the pointer calculated at the position calculating step A first judgment for judging whether or not shared data, which is data shared with the terminal device, exists in a shared area to be displayed. And when the first determination step determines that the position of the pointer exists in the shared area, position information for specifying the position of the pointer is a server connected via the network, or When it is determined that the position of the pointer does not exist in the shared area in the position information transmission step to be transmitted to another terminal device and the first determination step, the remote control terminal is displayed on the display screen. An instruction information transmission step of transmitting information for instructing to switch from a cursor instruction means that can be instructed by a cursor to a laser pointer to the remote control terminal, and the position information of the plurality of terminal devices connected via the network A plurality of the existing in the shared area created based on the location information transmitted from the transmission step The image data including the image of the pointer corresponding to the end device and a display control step of displaying on the display screen.

  A terminal control program according to an eighth aspect is characterized in that a computer is caused to function as various processing means of the terminal device according to any one of the first to fourth aspects.

  In the terminal device according to the first aspect, the specific information for specifying the position of the pointer is received from the remote control terminal, and the position of the pointer is calculated based on the received specific information. When the position of the pointer exists in the shared area, the position information of the pointer is transmitted to the server or another terminal device. Then, image data obtained by synthesizing the pointer image based on the position information is displayed on the display screen of the terminal device. Further, when the position of the pointer does not exist in the shared area, information for instructing the laser pointer to function is transmitted to the remote control terminal. Thereby, the remote control terminal can be used as a laser pointer by moving the pointer outside the shared area. As a result, when the pointer is used outside the shared area, the pointer image does not move on the display screen of the other terminal device, so that troublesomeness due to the movement of the pointer in the other terminal device can be reduced. For example, when a conversation or the like is performed by instructing a document or the like displayed only on its own terminal device with a pointer, the troublesomeness caused by the movement of the pointer in another terminal device can be reduced. Further, it is possible to point other parts than the display screen with the laser pointer, and there is no need to switch to another device and point to the part other than the display screen.

  In the terminal device according to claim 2, in addition to the effect of the invention according to claim 1, when it is determined that the position of the pointer exists in the shared area, the position information is transmitted to the server. Then, image data in which an image of a pointer is created at a position based on the transmitted position information is received from the server and displayed on the display screen. As a result, the terminal device only needs to receive and display the image data received from the server, and there is no need to synthesize the pointer image, thereby improving the processing speed.

  In addition to the effect of the invention according to claim 1, the terminal device according to claim 3 does not cause the server to display the pointer image on the display screen when the pointer position does not exist in the shared area. Send hidden information to indicate. Thereby, when the position of the pointer of the terminal device does not exist in the shared area, the image of the pointer of the terminal device is not displayed on another terminal device. As a result, it is possible to reduce the troublesomeness caused by the display of the pointer in another terminal device.

  According to a fourth aspect of the present invention, in addition to the effect of the third aspect of the invention, the terminal device includes image data including information indicating that the remote control terminal corresponding to the terminal device that has transmitted the non-display information has been switched to the laser pointer. Image data receiving means for receiving from the server is provided. The received image data is displayed on the display screen. Thereby, it can be easily grasped on the display screen that the remote control terminal has been switched to the laser pointer.

  According to a fifth aspect of the present invention, there is provided a communication control system comprising: a remote control terminal having an instruction unit capable of operating a pointer on a display screen for displaying information; and a terminal device that receives an instruction from the remote control terminal and can be connected to a network. Contains. The terminal device receives the specific information transmitted from the remote control terminal, and calculates the position of the pointer based on the received specific information. When the position of the pointer exists in the shared area, the position information of the pointer is transmitted to the server or another terminal device. Then, image data obtained by synthesizing the pointer image based on the pointer position information with respect to the pointer whose pointer position exists in the shared area is displayed on the display screen of the terminal device. In addition, when the position of the pointer does not exist in the shared area, instruction information for causing the laser pointer to function is transmitted to the remote control terminal. In the remote control terminal, control for functioning the remote control terminal as a laser pointer is performed based on the instruction information transmitted from the terminal device. Accordingly, the remote control terminal can be used as a laser pointer by moving the pointer outside the shared area. As a result, when the pointer is used outside the shared area, the pointer image does not move on the display screen of the other terminal device, so that troublesomeness due to the movement of the pointer in the other terminal device can be reduced. For example, when a conversation or the like is performed by pointing a document or the like displayed only on its own terminal device with a pointer, troublesomeness due to the movement of the pointer in other terminal devices can be reduced. Further, it is possible to point other parts than the display screen with the laser pointer, and there is no need to switch to another device and point to the part other than the display screen.

  In the communication control system according to claim 6, in addition to the effect of the invention according to claim 5, the remote control terminal performs control for preventing the remote control terminal from functioning as a laser pointer when the remote control terminal is stationary. Third control means for performing is provided. Thus, the laser pointer does not function when the remote control terminal is stationary, so that the power consumption of the remote control terminal can be reduced.

  In the communication control method according to the seventh aspect, the specific information for specifying the position of the pointer is received from the remote control terminal, and the position of the pointer is calculated based on the received specific information. When the position of the pointer exists in the shared area, the position information of the pointer is transmitted to the server or another terminal device. Then, image data obtained by synthesizing the pointer image based on the pointer position information with respect to the pointer whose pointer position exists in the shared area is displayed on the display screen of the terminal device. Further, when the position of the pointer does not exist in the shared area, information for instructing the laser pointer to function is transmitted to the remote control terminal. Thereby, the remote control terminal can be used as a laser pointer by moving the pointer outside the shared area. As a result, when the pointer is used outside the shared area, the pointer image does not move on the display screen of the other terminal device, so that troublesomeness due to the movement of the pointer in the other terminal device can be reduced. For example, when a conversation or the like is performed by instructing a document or the like displayed only on its own terminal device with a pointer, the troublesomeness caused by the movement of the pointer in another terminal device can be reduced. Further, it is possible to point other parts than the display screen with the laser pointer, and there is no need to switch to another device and point to the part other than the display screen.

  A terminal control program according to an eighth aspect causes a computer to function as various processing means of the terminal device according to any one of the first to fourth aspects. Therefore, the effect of the invention according to any one of claims 1 to 4 can be achieved by causing a computer to execute a terminal control program.

It is a figure which shows an example of the connection form of the communication control system. 2 is a block diagram showing an electrical configuration of a terminal device 100. FIG. 3 is a block diagram showing an electrical configuration of remote control terminal 200. FIG. 3 is a block diagram showing an electrical configuration of a server 300. FIG. It is a schematic diagram which shows the structure of the pointer position information table. It is a figure which shows one specific example of the video conference screen 171 displayed on the monitor. 4 is a flowchart of main processing executed by the terminal device 100. 5 is a flowchart of a subroutine of image data display processing executed from main processing of the terminal device 100. 5 is a flowchart of main processing of the remote control terminal 200. 10 is a flowchart of a subroutine of pointer flag reception processing executed from the main processing of remote control terminal 200. 10 is a flowchart of a subroutine of operation information transmission processing executed from the main processing of remote control terminal 200. 4 is a flowchart of a subroutine of image composition processing executed by the server 300. It is a figure which shows one specific example of the video conference screen 171 displayed on the monitor. It is a schematic diagram which shows the structure of the pointer position information table 1100 in a 1st modification. It is a flowchart of the main process performed with the terminal device 100 in a 1st modification. It is a flowchart of the subroutine of the image composition process in a 1st modification. It is a flowchart of the subroutine of the image composition process in a 2nd modification. It is a figure which shows one specific example of the video conference screen 171 displayed on the monitor 170 in a 2nd modification.

  Hereinafter, a communication control system 1 according to an embodiment of the present invention will be described with reference to the drawings. First, the outline of the communication control system 1 will be described with reference to FIG.

  As shown in FIG. 1, in the communication control system 1, a plurality of terminal devices 100 are connected to a server 300 via a network 2. In the communication control system 1, a video conference is performed by transmitting and receiving audio and image data between the plurality of terminal devices 100 via the server 300. In FIG. 1, two terminal devices 100 are illustrated. However, in the present invention, it is only necessary that a video conference can be performed between the terminal devices 100 via the network 2, and the number of terminal devices 100 connected is two or more. Good. For example, a plurality of terminal devices 100 may exist in the same site of a certain company, or may exist in different offices or in different regions or countries.

  Further, the terminal device 100 accepts an operation from the remote control terminal 200 having a mouse function. The mouse function is a function capable of operating information displayed on the monitor with a cursor displayed on the monitor of the terminal device 100. The remote control terminal 200 outputs distance information, which is information related to the distance from the terminal device 100, and angle information, which is its own inclination angle with respect to the horizontal plane, to the terminal device 100 periodically (for example, every 20 milliseconds). . Then, the terminal device 100 calculates the position of the pointer to be displayed on the monitor of the terminal device 100 based on the distance information and angle information received from the remote control terminal 200. Hereinafter, information including distance information and angle information is referred to as operation information.

  The terminal device 100 is a known personal computer, for example, and is a general-purpose device. The terminal device 100 includes a camera 150 (see FIG. 2) for acquiring an image for use in a video conference from the outside, and a microphone 140 (see FIG. 2) for acquiring the audio of the video conference participant from the outside. 2). A monitor 170 (see FIG. 2) for outputting image data to the outside and a speaker 160 (see FIG. 2) for outputting audio data to the outside are provided.

  The server 300 is, for example, a well-known personal computer and a general-purpose device. In addition, the server 300 has a function of receiving image data acquired by the camera 150 from each terminal device 100 and creating image data to be used in a video conference by combining the image data. The server 300 realizes a video conference between the terminal devices 100 by transmitting the combined image data to each terminal device 100. Further, the synthesized image data includes an image of a cursor operated on each terminal device 100 that is communicating in the video conference.

  Next, the electrical configuration of the terminal device 100 will be described with reference to the block diagram of FIG. As illustrated in FIG. 2, the terminal device 100 includes a CPU 101 that controls the terminal device 100. The CPU 101 is connected to a ROM 102, a RAM 103, a hard disk drive (HDD) 104, a counter 105, a timing device 106, an input / output control unit 107, a communication device 108, and a wireless communication device 109 via a bus 111. Yes.

  The ROM 102 stores a program for starting the BIOS executed by the CPU 101 and setting values. Various data are temporarily stored in the RAM 103. The HDD 104 stores various programs executed by the terminal device 100. The counter 105 functions as a timer and measures time. The time measuring device 106 measures time as an internal clock.

  The input / output control unit 107 is connected to a keyboard 120 and a mouse 130 for a user to input an operation. In addition, the input / output control unit 107 is connected to a microphone 140 that obtains voice generated by a user's speech and a camera 150 that obtains an image for use in a video conference. Also connected to the input / output control unit 107 are a speaker 160 for outputting audio data transmitted from the server 300 and a monitor 170 for displaying image data transmitted from the server 300 when a video conference is being conducted. Has been. The communication device 108 transmits / receives data to / from the server 300 via the network 2. The wireless communication device 109 transmits / receives data to / from the remote control terminal 200 wirelessly. The wireless communication device 109 performs data communication with the remote control terminal 200 in accordance with the Bluetooth (registered trademark) communication standard. In addition to Bluetooth, data transmission / reception using infrared rays may be used. Moreover, transmission / reception of data by wire may be used.

  The Bluetooth communication standard is a well-known wireless communication standard that uses a radio frequency of 2.4 GHz band (ISM band). It is assumed that the terminal device 100 and the remote control terminal 200 have previously performed Bluetooth pairing. Here, in the present embodiment, it is assumed that the terminal device 100 is used in the same floor of the office, and therefore, Class 2 Bluetooth having a communication distance of about 10 meters is used.

  Next, the electrical configuration of the remote control terminal 200 will be described with reference to the block diagram of FIG. As shown in FIG. 3, the remote control terminal 200 includes a CPU 201 that controls the remote control terminal 200. A ROM 202, a RAM 203, an acceleration sensor 204, a light receiving unit 205, an input unit 206, a wireless communication device 207, and a laser pointer 209 are connected to the CPU 201 via a bus 211.

  The ROM 202 stores programs executed by the CPU 201 and setting values. Various data are temporarily stored in the RAM 203. The acceleration sensor 204 is a well-known acceleration sensor provided to detect that the remote control terminal 200 has been moved. The light receiving unit 205 detects light emitted from a light emitting unit (not shown) provided below the monitor 170 of the terminal device 100 and calculates the distance from the light source. Note that at least two light emitting units are provided, and the calculated distance is the distance between each light emitting unit and the remote control terminal 200. The input unit 206 is provided with various input buttons (not shown) used for the mouse function. The wireless communication device 207 transmits / receives data to / from the terminal device 100 in accordance with the Bluetooth standard. The laser pointer 209 includes an LD (Laser Diode), which is a known light source, and oscillates laser light.

  Next, the electrical configuration of the server 300 will be described with reference to the block diagram of FIG. As illustrated in FIG. 4, the server 300 includes a CPU 301 that controls the server 300. The CPU 301 is connected with a ROM 302, a RAM 303, a hard disk drive (HDD) 304, a counter 305, a display control unit 306, an input control unit 307, a timing device 308, and a communication device 309 via a bus 311. .

  The ROM 302 stores a program for starting the BIOS executed by the CPU 301 and setting values. Various data are temporarily stored in the RAM 303. The HDD 304 stores various programs executed by the server 300. The counter 305 functions as a timer and measures time.

  A monitor 320 that displays information is connected to the display control unit 306. The input control unit 307 is connected to a keyboard 330 and a mouse 340 for a user to input an operation. The time measuring device 308 measures time as an internal clock. The communication device 309 is connected to the network 2 and controls data transmission / reception with the terminal device 100.

  Next, the pointer position information table 1000 will be described with reference to FIG. The pointer position information table 1000 is a table created in the RAM 303 of the server 300 when a video conference is performed. Then, when information related to the position of the pointer (hereinafter referred to as “position information”) is received from the terminal device 100, the data is added or updated.

  As shown in FIG. 5, the pointer position information table 1000 includes a terminal ID column, an X coordinate column, and a Y coordinate column. Information for identifying the terminal device 100 (hereinafter referred to as “terminal ID”) is stored in the terminal ID column. In the X coordinate field, the value of the X coordinate of the position of the pointer specified by the position information is stored. In the Y coordinate field, the value of the Y coordinate of the position of the pointer specified by the position information is stored. Each coordinate value stored in the X coordinate field and the Y coordinate field is a relative coordinate value from the reference point on the display screen 179 (see FIG. 6) on which information is displayed on the monitor 170. Here, the reference point of the display screen 179 is the upper left corner of the display screen 179. The right direction from the reference point is the positive direction of the X axis, and the downward direction from the reference point is the positive direction of the Y axis.

  Next, the video conference screen 171 displayed on the display screen 179 of the monitor 170 of the terminal device 100 will be described with reference to FIG.

  When the video conference is started, a video conference screen 171 as shown in FIG. 6 is displayed on the display screen 179 of the monitor 170 of each terminal device 100. The video conference screen 171 is provided with an image display area 172 for displaying image data captured by the camera 150 of each terminal device 100 for each terminal device 100 that communicates in the video conference.

  In the video conference screen 171, a shared document display area 173 is provided in which image data such as a document shared between the terminal devices 100 is displayed when the video conference is performed. Further, the terminal device 100 is provided with an individual area 174 that can display data that is not shared by other terminal devices 100 (hereinafter referred to as “individual data”). In addition, a cursor image 175 by operating the mouse 130 of each terminal device 100 is displayed on the video conference screen 171.

  Next, with reference to FIG. 7, main processing executed by the terminal device 100 will be described. Here, the main process in FIG. 7 is a process executed by the CPU 101 when a video conference application is activated in the terminal device 100. When the video conference application is stopped, the main process in FIG. 7 is automatically terminated. Also, other processes executed by the video conference application are assumed to be executed by other processes, and the description thereof is omitted.

  When the main process of FIG. 7 is started, an image data display process (see FIG. 8) is started (S11). This image data display process is a process executed in a process activated from the main process. The process executing the main process becomes a parent process, and the process in which the image data display process is executed operates as a child process. Details of this image data display processing will be described later.

  Next, it is determined whether operation information has been received (S12). This operation information is information transmitted from the remote control terminal 200, and is information for specifying the position of the pointer indicated by the remote control terminal 200. When it is determined that no operation information has been received from the remote control terminal 200 (S12: NO), the process returns to S12. That is, the determination process of S12 is repeated until operation information is received.

  When it is determined that the operation information has been received (S12: YES), the position of the pointer pointed to by the remote control terminal 200 is calculated (S13). Specifically, the position (XY coordinate value) of the pointer on the plane including the display screen 179 is calculated based on the distance information and the angle information included in the received operation information. That is, triangulation based on the distance between two light emitting units (not shown) provided in the lower part of the monitor 170 of the terminal device 100 and the remote control terminal 200 and the inclination angle of the remote control terminal 200 with respect to the horizontal plane. The position of the pointer on the plane including the display screen 179 is calculated using the above principle. The position of the pointer is calculated as a relative coordinate value with the upper left of the display screen 179 as a reference point. Next, it is determined whether or not the calculated pointer position exists in the display screen 179 (S14). Specifically, it is determined whether or not the calculated position of the pointer exists within a range surrounded by the coordinate values of the four corners of the rectangular display screen 179.

  If it is determined that the calculated pointer position does not exist in the display screen 179 (S14: NO), the pointer flag is set to 1 which is ON (S16). This pointer flag is a variable for controlling the laser pointer function provided in the remote control terminal 200, and is secured in the memory area of the RAM 303 when a video conference is started. When the video conference is started, the pointer flag is initialized to 0 which is OFF.

  Next, the value of the pointer flag is transmitted to the remote control terminal 200 via the wireless communication device 109 (S18). Then, the value of the pointer flag is set to 0 which is OFF again (S19), and the process proceeds to S12.

  When it is determined that the calculated pointer position exists in the display screen 179 (S14: YES), it is determined whether or not the calculated pointer position exists on the individual data (S15). That is, it is determined whether or not the position of the pointer exists in the individual area 174. Specifically, the determination is made based on whether or not the calculated pointer position is within a range surrounded by the coordinate values of the four corners of the rectangular individual area 174. Note that the coordinate values of the four corners of the individual area 174 are managed as relative coordinate values from the reference point of the video conference screen 171. The reference point of the video conference screen 171 is the upper left corner of the video conference screen 171. The right direction from the reference point is the positive direction of the X axis, and the downward direction from the reference point is the positive direction of the Y axis.

  When it is determined that the calculated pointer position does not exist on the individual data (S15: NO), that is, when it is determined that the calculated pointer position does not exist within the individual area 174, the calculated pointer is calculated. The position information that is the position of is transmitted to the server 300 (S17). Then, the process proceeds to S18, and a pointer flag is transmitted to the remote control terminal 200. When the calculated pointer position does not exist on the individual data, the value of the pointer flag is set to 0 and transmitted to the remote control terminal 200. Hereinafter, an area within the display screen 179 and outside the individual area 174 is referred to as a “shared area”.

  If it is determined that the calculated pointer position exists on the individual data (S15: YES), that is, if it is determined that the calculated pointer position exists in the individual area 174, the process proceeds to S16. Transition.

  Next, an image display process executed by the terminal device 100 will be described with reference to FIG. Here, the image display process of FIG. 8 operates in the child process generated in S11 of the main process of FIG. It is assumed that the image display process automatically ends when the main process in FIG. 7 ends.

  When the image data display process is started, it is determined whether image data is received from the server 300 (S31). This image data is image data obtained by combining the image data captured by the camera 150 of each terminal device 100 and the cursor image 175 of each terminal device 100. Note that the image data captured by the camera 150 is combined with the image display area 172 corresponding to each terminal device 100.

  If it is determined that no image data has been received from the server 300 (S31: NO), the process proceeds to S31. That is, the determination process of S31 is performed until image data is received from the server 300.

  When it is determined that image data has been received from the server 300 (S31: YES), the received image data is displayed on the video conference screen 171 (S32). Then, the process proceeds to S31.

  Next, with reference to FIG. 9, main processing executed by the remote control terminal 200 will be described. Here, the main process in FIG. 9 is a process executed by the CPU 201 when the power is turned on in the remote control terminal 200. Note that when the power of the remote control terminal 200 is turned off, the main process in FIG. 9 is automatically terminated.

  When the main process of the remote control terminal 200 shown in FIG. 9 is started, a pointer flag reception process (see FIG. 10) is started (S41). This pointer flag reception process is a process executed by a process activated from the main process. The process executing the main process becomes the parent process, and the process executing the pointer flag reception process operates as a child process. Details of the pointer flag reception process will be described later.

  Next, an operation information transmission process (see FIG. 11) is started (S42). This operation information transmission process is a process executed by a process started from the main process. The process that is executing the main process becomes a parent process, and the process that executes the operation information transmission process operates as a child process. Details of the operation information transmission process will be described later.

  Next, the current state of the remote control terminal 200 is acquired (S43). Specifically, the measurement value of the accelerometer is acquired, and the difference between the measurement value before a predetermined time and the current measurement value is calculated. Both the measurement value before the predetermined time and the current measurement value are stored in a predetermined storage area of the RAM 203. The value is updated every predetermined time. Here, as an example, the predetermined time is 20 milliseconds.

  Next, it is determined whether or not the remote control terminal 200 is placed (S44). Specifically, it is determined whether or not there is a difference between the measured value of the acceleration sensor 204 stored in a predetermined storage area of the RAM 203 and the current measured value of the acceleration sensor 204.

  When it is determined that the remote control terminal 200 is placed (S44: YES), that is, the measurement value of the acceleration sensor 204 stored in a predetermined storage area of the RAM 203 before the predetermined time and the current acceleration sensor 204 measurement. If there is no difference from the value, the power of the laser pointer 209 of the remote control terminal 200 is turned off (S45). In the remote control terminal 200, when the laser pointer 209 is turned off, the mouse function is enabled. Then, the process proceeds to S43.

  If it is determined that the remote control terminal 200 is not placed (S44: NO), that is, the measured value of the acceleration sensor 204 stored in a predetermined storage area of the RAM 203 before the predetermined time and the current acceleration sensor 204 are stored. If there is a difference from the measured value, the process proceeds to S43.

  That is, in the main process of the remote control terminal 200 in FIG. 9, a process for determining whether or not the remote control terminal 200 is always placed is performed. When it is determined that the remote control terminal 200 is placed, the power of the laser pointer 209 is turned off. In the remote control terminal 200, when the laser pointer 209 is turned off, the mouse function is enabled.

  Next, with reference to FIG. 10, a pointer flag reception process executed by the remote control terminal 200 will be described. Here, the pointer flag reception process of FIG. 10 is started as a child process in S41 of the main process of FIG. Note that the pointer flag reception process automatically ends when the main process of the remote control terminal 200 ends.

  When the pointer flag reception process is started, it is determined whether or not a pointer flag has been received (S51). This pointer flag is a value transmitted from the terminal device 100, and is transmitted in S18 of FIG. When it is determined that the pointer flag is not received (S51: NO), the process proceeds to S51, and the determination process of S51 is performed until the pointer flag is received.

  When it is determined that the pointer flag has been received (S51: YES), it is determined whether the pointer flag received from the terminal device 100 is ON (S52). That is, it is determined whether the value of the pointer flag received from the terminal device 100 is 1. When it is determined that the pointer flag received from the terminal device 100 is ON (S52: YES), that is, when it is determined that the value of the received pointer flag is 1, the power supply of the laser pointer 209 of the remote control terminal 200 Is turned on (S53). Specifically, laser light is emitted from the laser pointer 209. In the remote control terminal 200, when the laser pointer 209 is turned on, the mouse function is disabled. Then, the process proceeds to S51.

  When it is determined that the pointer flag received from the terminal device 100 is not ON (S52: NO), that is, when it is determined that the value of the received pointer flag is not 1, the power of the laser pointer 209 of the remote control terminal 200 is turned on. Is turned off (S54). In the remote control terminal 200, when the laser pointer 209 is turned off, control for accepting an operation of the mouse function is performed, and the mouse function is enabled. Then, the process proceeds to S51.

  Next, with reference to FIG. 11, the operation information transmission process performed by the remote control terminal 200 will be described. Here, the operation information transmission process of FIG. 11 is started as a child process in S42 of the main process of FIG. It is assumed that the operation information transmission process automatically ends when the main process of the remote control terminal 200 ends.

  When the operation information transmission process is started, operation information is acquired (S61). As described above, this operation information is information including distance information and angle information, and is obtained at regular time intervals (every 20 milliseconds). Then, the acquired operation information is transmitted to the terminal device 100 (S62). Next, the process proceeds to S61, and operation information is acquired at regular intervals.

  Next, with reference to FIG. 12, an image composition process that is a process executed by the CPU 301 of the server 300 will be described. This image composition process is started from a main process (not shown) executed by the server 300. At that time, a child process is activated from the main process, and the image composition process operates in the activated child process. In addition, when the main process ends, the image composition process automatically ends. Note that other processes executed by the server 300 are operating in other processes, and a detailed description thereof is omitted.

  When the image composition process is started, image data is received from the terminal device 100 (S71). This image data is data captured by the camera 150 of each terminal device 100 and transmitted to the server 300. When image data is received from the terminal device 100, it is determined whether or not pointer position information has been received from the terminal device 100 (S72). This position information is information transmitted to the server 300 in the process of S17 of the main process (see FIG. 7) of the terminal device 100. Here, the position information is received by processing on another process operating on the server 300. The position information is stored in association with the terminal ID of the terminal device 100 that has transmitted the position information to a position information storage area (not shown) of the RAM 303. Note that the location information storage area is a shared memory area in which data can be shared between different processes.

  When it is determined that the position information is received from the terminal device 100 (S72: YES), that is, when the position information is stored in the position information storage area of the RAM 303, the stored position information is the pointer position information table 1000. (S73). Specifically, the coordinates of the position information stored in the position information storage area of the RAM 303 are set as the coordinates of the corresponding terminal ID in the pointer position information table 1000. In the case of the terminal device 100 that transmits the position information for the first time, data in which the terminal ID and the coordinates of the position information are associated is added. Further, the position information set in the pointer position information table 1000 is deleted from the position information storage area of the RAM 303.

  Next, the image data received from the terminal device 100 is combined with the image display area 172 corresponding to the terminal device 100 that is the transmission source (S74). The received image data is stored in a predetermined storage area of the RAM 303.

  When the image data is combined with the image display area 172 corresponding to the transmission source terminal device 100 in S74, the cursor image 175 is combined on the display screen 179 based on the pointer position information table 1000 (S75). Specifically, in the pointer position information table shown in FIG. 5, the cursor image 175 corresponding to the terminal A with the terminal ID is synthesized at the position of the coordinates (X1, Y1), and the cursor corresponding to the terminal ID corresponding to the terminal B. An image 175 is synthesized at the position of coordinates (X2, Y2). Then, the synthesized image data is transmitted to each terminal device 100 that is communicating in the video conference (S76), and the process proceeds to S71.

  If it is determined that position information has been received from the terminal device 100 (S72: NO), that is, if position information is not stored in the position information storage area of the RAM 303, the process proceeds to S74 without proceeding to S73. Then, the image data received from the terminal device 100 is combined with the image display area 172 corresponding to the terminal device 100 that is the transmission source.

  If the coordinates of the pointer exist outside the shared area, the terminal device 100 does not transmit pointer position information to the server 300. As a result, the pointer position information table 1000 is not updated, and the cursor image 175 is displayed on the video conference screen 171 as if it is stationary.

  As described above, in the present embodiment, terminal apparatus 100 receives operation information from remote control terminal 200. Then, the position of the pointer on the plane including the display screen 179 is calculated based on the received operation information. If the pointer position exists in the shared area, the pointer position information is transmitted to the server 300. The terminal apparatus 100 receives from the server 300 image data in which the cursor image 175 is synthesized based on the pointer position information. The received image data is displayed on the video conference screen 171 of the terminal device 100. When the position of the pointer does not exist in the shared area, a pointer flag having a value of 1 is transmitted to the remote control terminal 200. Then, in the remote control terminal 200 that has received the pointer flag, the power of the laser pointer is turned on.

  As a result, when the pointer is moved in the shared area, the cursor image 175 synthesized by the server 300 appears to have moved. If the pointer position does not exist in the shared area, the remote control terminal 200 is switched from the mouse function to the laser pointer function. Thus, the remote control terminal 200 can be used as a laser pointer by moving the pointer outside the shared area.

  Here, for example, as shown in FIG. 13, when the pointer is moved in the shared area, the cursor image 175 is displayed while moving like a locus 176. When the pointer moves into the individual area 174, the cursor image 175 is displayed as if it is still in the vicinity of the individual area 174. In the individual area 174, the cursor image 175 is not displayed, and an instruction by the laser pointer of the remote control terminal 200 is possible, and the cursor image 175 is displayed while moving like a locus 177.

  As a result, when the pointer is used outside the shared area, the cursor image 175 does not move on the display screen 179 of the other terminal device 100, so that troublesomeness due to the movement of the pointer in the other terminal device 100 can be reduced. For example, when a document or the like displayed only on its own terminal device 100 is instructed with a pointer to perform a conversation or the like, troublesomeness due to movement of the pointer in other terminal devices 100 can be reduced. Further, it is possible to point other parts than the display screen 179 with the pointer of the laser pointer, and there is no need to switch to another device and point to parts other than the display screen 179.

  Further, when the remote control terminal 200 is in a stationary state, control for preventing the remote control terminal 200 from functioning as a laser pointer is performed. As a result, the laser pointer does not function when the remote control terminal 200 is stationary, so that power consumption of the remote control terminal 200 can be reduced.

  The operation information corresponds to “specific information”, and the pointer flag corresponds to “instruction information”. The CPU 101 that performs S12: YES in FIG. 7 functions as a “specific information receiving unit”, and the processing of the CPU 101 that performs S12: YES in FIG. 7 corresponds to a “specific information receiving step”. The CPU 101 that performs S13 in FIG. 7 functions as “position calculation means”, and the processing of the CPU 101 that performs S13 in FIG. 7 corresponds to a “position calculation step”. The CPU 101 that performs S15 in FIG. 7 functions as a “first determination unit”, and the processing of the CPU 101 that performs S15 in FIG. 7 corresponds to a “first determination step”. The CPU 101 that performs S17 of FIG. 7 functions as a “position information transmission unit”, and the processing of the CPU 101 that performs S17 of FIG. 7 corresponds to a “position information transmission step”. The CPU 101 that performs S31: YES in FIG. 8 functions as an “image data receiving unit”, and the processing of the CPU 101 that performs S31: YES in FIG. 8 corresponds to an “image data receiving step”. The CPU 101 that performs S32 in FIG. 8 functions as a “display control unit”, and the processing of the CPU 101 that performs S32 in FIG. 8 corresponds to a “display control step”. The CPU 101 that performs S18 of FIG. 7 functions as “instruction information transmission means”, and the processing of the CPU 101 that performs S18 of FIG. 7 corresponds to an “instruction information transmission step”.

  The CPU 201 that performs S62 in FIG. 11 functions as “specific information transmitting unit”, and the CPU 201 that performs S51: YES in FIG. 10 functions as “instruction information receiving unit”. The CPU 201 that performs S52 of FIG. 10 functions as a “second determination unit”, and the CPU 201 that performs S54 of FIG. 10 functions as a “first control unit”. The CPU 201 that performs S53 in FIG. 10 functions as a “second control unit”.

  Further, the CPU 201 that performs S44 of FIG. 9 functions as a “third determination unit”, and the CPU 201 that performs S45 of FIG. 9 functions as a “second control unit”.

  In the embodiment described above, whether or not the remote control terminal 200 is placed is determined in S44 of the main process (see FIG. 9) of the remote control terminal 200. If it is determined that the remote control terminal 200 is placed (S44: YES), the power of the laser pointer 209 of the remote control terminal 200 is turned off (S45), but the power of the laser pointer 209 of the remote control terminal 200 is turned off. May not be turned off.

  It should be noted that the present invention is not limited to the above-described embodiment, and it goes without saying that various modifications can be made without departing from the spirit of the present invention. Hereinafter, modified examples will be described.

  In the above-described embodiment, each terminal device 100 that performs communication in a video conference transmits position information to the server 300 if the cursor position is within the shared area. And although the terminal device 100 receives and displays the image by which the cursor image 175 was synthesize | combined in the position specified by position information from the server 300, it is not limited to this. For example, the cursor image 175 may not be synthesized by the server 300. Specifically, the terminal device 100 may transmit the position information to each of the other terminal devices 100 that perform communication in the video conference. Then, the terminal device 100 that has received the position information may synthesize and display the cursor image 175 corresponding to the position specified by the position information transmitted from each terminal device 100.

  In the above-described embodiment, when the pointer is moved from the shared area of the video conference screen 171 to the outside of the shared area, the cursor image 175 looks as if the cursor image 175 is stationary near the boundary of the shared area on the video conference screen 171. However, the display form is not limited to this.

  For example, the cursor image 175 may be hidden when the pointer is moved from the shared area of the video conference screen 171 to the outside of the shared area. This will be described with reference to FIGS. Here, the processing (see FIG. 9 to FIG. 11) executed by the remote control terminal 200 is the same as that of the above-described embodiment, and therefore, detailed description thereof is omitted. Further, since the hardware configurations of the terminal device 100, the remote control terminal 200, and the server 300 are the same as those in the above-described embodiment, the description thereof is omitted.

  First, the pointer position information table 1100 of the first modification will be described with reference to FIG. The pointer position information table 1100 is created in the RAM 304 of the server 300 when a video conference is performed, as in the above-described embodiment. And when the positional information on the terminal device 100 is received, data is added or updated.

  As shown in FIG. 14, the pointer position information table 1100 includes a terminal ID field, an X coordinate field, a Y coordinate field, and a display flag field. Since the terminal ID field, the X coordinate field, and the Y coordinate field are the same as those in the above-described embodiment, the description thereof is omitted. In the display flag field, a display flag indicating whether or not the cursor image 175 is displayed on the display screen 179 is stored. When the value of this display flag is 1, it indicates that the cursor image 175 is displayed on the display screen 179. Further, when the value of the display flag is 0, it indicates that the cursor image 175 is not displayed on the display screen 179.

  Next, main processing performed in the terminal device 100 according to the first modification will be described with reference to FIG. 15 are the same as S11 to S17 of the main process (see FIG. 7) of the terminal device 100 of the above-described embodiment, and thus detailed description thereof is omitted. 15 are the same as S18 to S19 in the main process (see FIG. 7) of the terminal device 100 of the above-described embodiment, and thus detailed description thereof is omitted.

  When the main process of FIG. 15 is executed and it is determined that the calculated pointer position exists on the individual data (S105: YES), the pointer flag is set to a value of 1 which is ON (S106). Next, the non-display information is transmitted to the server 300 (S108). The non-display information is information for preventing the cursor image 175 of the terminal device 100 that has transmitted the non-display information from being displayed on the display screen 179. Then, the pointer flag is transmitted to the remote control terminal 200 (S109), and the pointer flag is set to 0 which is OFF (S110). Then, the process proceeds to S102.

  If it is determined that the calculated pointer position does not exist on the individual data (S105: NO), the position information is transmitted to the server 300 (S107), and the pointer flag is transmitted to the remote control terminal 200. (S109). Then, the value of the pointer flag is set to 0 which is OFF (S110), and the process proceeds to S102.

  Next, with reference to FIG. 16, an image composition process that is a process executed by the CPU 301 of the server 300 according to the first modification will be described. This image composition process is started from a main process (not shown) executed by the server 300 as in the above-described embodiment. At that time, a child process is activated from the main process, and the image composition process operates in the activated child process. In addition, when the main process ends, the image composition process automatically ends. Note that other processes executed by the server 300 are operating in other processes, and a detailed description thereof is omitted.

  Also, the processing in S121 to S123 in FIG. 16 is the same processing as S71 to S73 in the image composition processing (see FIG. 12) of the server 300 in the above-described embodiment, and thus detailed description thereof is omitted. Also, the processing in S127 and S129 in FIG. 16 is the same processing as S74 and S76 in the image composition processing (see FIG. 12) of the server 300 in the above-described embodiment, and thus detailed description thereof is omitted.

  When it is determined that the position information of the pointer has been received from the terminal device 100 (S122: YES), the received position information is set in the pointer position information table 1100 stored in the RAM 303. (S123). Then, the value of the display flag is set to 1 (S124). Specifically, in the pointer position information table 1100, 1 is set as the value of the display flag corresponding to the terminal ID of the terminal device 100 that transmitted the position information.

  Next, it is determined whether or not non-display information is received from the terminal device 100 (S125). This non-display information is information transmitted in S108 (see FIG. 15) of the terminal device 100. Here, the non-display information is received by processing on another process operating on the server 300. The terminal ID of the terminal device 100 that has transmitted the non-display information is stored in a transmission terminal ID storage area (not shown) of the RAM 303. The transmission terminal ID storage area is a shared memory area where data can be shared between different processes.

  When it is determined that the non-display information is received (S125: YES), that is, when the terminal ID is stored in the transmission terminal ID storage area, the display flag of the pointer position information table 1100 is set to 0 (S126). ). Specifically, in the pointer position information table 1100, the display flag corresponding to the terminal ID stored in the transmission terminal ID storage area is set to zero. When the display flag of the pointer position information table 1000 is set to 0, the terminal ID for which the display flag is set to 0 is deleted from the transmission terminal ID storage area of the RAM 303. Next, the process proceeds to S127, and the image data is combined with the image display area 172 corresponding to the terminal device 100 that is the transmission source.

  When the processing of S127 is performed, the cursor image 175 corresponding to the coordinate value corresponding to the display flag value of 1 in the pointer position information table 1100 is combined with the image data (S128). Here, for example, in the pointer position information table 1100 shown in FIG. 14, the cursor image 175 is positioned at a position where the display flag is a coordinate value corresponding to 1, the X coordinate is “X2”, and the Y coordinate is “Y2”. Synthesized. Then, the combined image data is transmitted to each terminal device 100 that is communicating in the video conference (S129), and the process proceeds to S121.

  If it is determined that non-display information has not been received (S125: NO), that is, if the terminal ID is not stored in the transmission terminal ID storage area, the process proceeds to S127, and the image data is transmitted from the transmission source ID. Are combined into an image display area 172 corresponding to the terminal device 100.

  As described above, in the first modification described above, when the position of the pointer does not exist in the shared area, the terminal device 100 transmits non-display information to the server 300. Accordingly, when the position of the pointer of the terminal device 100 does not exist in the shared area, the cursor image 175 of the terminal device 100 is not displayed on the display screen 179. As a result, it is possible to reduce the troublesomeness caused by the pointer display in the other terminal devices 100.

  The CPU 101 that performs S108 in FIG. 15 functions as a “non-display information transmitting unit”.

  In the above-described embodiment and the first modified example, if the position of the pointer exists in the individual area 174, the laser of the remote control terminal 200 corresponding to the terminal device 100 in which the position of the pointer exists in the individual area 174. The power source of the pointer 209 is turned on. In addition, for example, the video conference screen 171 may display that the laser pointer is turned on.

  Hereinafter, with reference to FIG. 17 and FIG. 18, a screen composition process executed by the server 300 of the second modified example will be described.

  First, with reference to FIG. 17, an image composition process that is a process executed by the CPU 301 of the server 300 of the second modification will be described. This image composition process is started from a main process (not shown) executed by the server 300 as in the above-described embodiment and the first modification. At that time, a child process is activated from the main process, and the image composition process operates in the activated child process. In addition, when the main process ends, the image composition process automatically ends. Note that other processes executed by the server 300 are operating in other processes, and a detailed description thereof is omitted.

  Also, the processing of S131 to S137 in FIG. 17 is the same processing as S121 to S127 of the image composition processing (see FIG. 16) of the server 300 of the first modification described above, and thus detailed description thereof is omitted. 17 is the same process as S128 to S129 of the image composition process (see FIG. 16) of the server 300 of the first modification described above, and a detailed description thereof will be omitted.

  When the image compositing process of FIG. 17 is executed and the image data is composed in the image display area 172 corresponding to the terminal device 100 that is the transmission source (S137), the value of the display flag in the pointer position information table 1100 corresponds to 0. A message indicating that the remote control terminal 200 corresponding to the terminal device 100 specified by the terminal ID has been switched to the laser pointer is combined with the image data (S138). Here, for example, if the pointer position information table 1100 is as shown in FIG. 14, the remote control terminal 200 corresponding to the terminal device 100 identified by the terminal ID “terminal A” is switched to the laser pointer. A message 178 (see FIG. 18) indicating that is displayed on the video conference screen 171. Here, the message “178” indicates that “the remote control terminal of terminal A has become a laser pointer”.

  This display flag is set in the pointer position information table 1100 with the value of the display flag set to 0 in S136 when non-display information is received from the terminal device 100.

  Next, in the pointer position information table 1100, the cursor image 175 is synthesized with the coordinate value corresponding to the display flag value of 1 (S139). Then, the combined image data is transmitted to each terminal device 100 (S140), and the process proceeds to S131.

  As described above, in the second modified example described above, when the position of the pointer does not exist in the shared area, the terminal device 100 transmits non-display information to the server 300. Then, a message 178 indicating that the remote control terminal 200 corresponding to the terminal device 100 that has transmitted the non-display information has been switched to the laser pointer is displayed on the video conference screen 171. Thereby, in the other terminal device 100, it can grasp | ascertain easily that the remote control terminal 200 was switched to the laser pointer. As a result, the user of the other terminal device 100 can recognize that the terminal device 100 corresponding to the remote control terminal 200 switched to the laser pointer is likely to have a secret meeting.

  Note that the message 178 corresponds to “information indicating that the remote control terminal has been switched to the laser pointer”.

DESCRIPTION OF SYMBOLS 1 Communication control system 2 Network 100 Terminal device 200 Remote control terminal 300 Server 101,201,301 CPU
102, 202, 302 ROM
103, 203, 303 RAM
109, 207 Wireless communication device 150 Camera 170 Monitor 171 Video conference screen 174 Individual area 175 Cursor image 178 Message 204 Acceleration sensor 205 Light receiving unit 209 Laser pointer

Claims (8)

A terminal device that is connectable to a network and receives an instruction from a remote control terminal having an instruction means capable of operating a pointer on a display screen for displaying information;
Specific information receiving means for receiving, from the remote control terminal, specific information for specifying the position of the pointer on a plane including the display screen;
A position calculating means for calculating the position of the pointer based on the specific information when the specific information is received by the specific information receiving means;
Whether or not the position of the pointer calculated by the position calculation means exists in a shared area where shared data, which is data shared with other terminal devices via the network, is displayed. First judging means for judging
When the first determination means determines that the position of the pointer exists in the shared area, the position information specifying the position of the pointer is stored as a server or other terminal connected via the network. Position information transmitting means for transmitting to the device;
When the first determination means determines that the position of the pointer does not exist within the shared area, the laser pointer is changed from a cursor instruction means capable of specifying the remote control terminal with a cursor displayed on the display screen. Instruction information transmitting means for transmitting information instructing to switch to the remote control terminal;
The pointer corresponding to the plurality of terminal devices existing in the shared area, created based on the position information transmitted from the position information transmitting means of the plurality of terminal devices connected via the network And a display control means for displaying image data including the image on the display screen. The position information transmission means transmits the position information to the server when the first determination means determines that the position of the pointer exists in the shared area,
Image data receiving means for receiving from the server the image data created based on the position information transmitted by the position information transmitting means;
The terminal device according to claim 1, wherein the display control unit displays the image data received by the image data receiving unit on the display screen.   This is information that instructs the server not to display the image of the pointer on the display screen when the first determination means determines that the position of the pointer does not exist in the shared area. The terminal device according to claim 1, further comprising non-display information transmitting means for transmitting display information.   When the non-display information is transmitted to the server by the non-display information transmitting unit, the image data receiving unit is configured such that the remote control terminal corresponding to the terminal device that transmitted the non-display information is the laser pointer. The terminal device according to claim 3, wherein the terminal device receives image data including information indicating that it has been switched to the server. A communication control system including a remote control terminal having an instruction means capable of operating a pointer on a display screen for displaying information, and a terminal device that accepts an instruction from the remote control terminal and can be connected to a network,
The terminal device
Specific information receiving means for receiving, from the remote control terminal, specific information for specifying the position of the pointer on a plane including the display screen;
A position calculating means for calculating the position of the pointer based on the specific information when the specific information is received by the specific information receiving means;
Whether or not the position of the pointer calculated by the position calculation means exists in a shared area where shared data, which is data shared with other terminal devices via the network, is displayed. First judging means for judging
When the first determination means determines that the position of the pointer exists in the shared area, the position information specifying the position of the pointer is stored as a server or other terminal connected via the network. Position information transmitting means for transmitting to the device;
The pointer corresponding to the plurality of terminal devices existing in the shared area, created based on the position information transmitted from the position information transmitting means of the plurality of terminal devices connected via the network Display control means for displaying image data including the image on the display screen;
When the first determination means determines that the position of the pointer does not exist within the shared area, the laser pointer is changed from a cursor instruction means capable of specifying the remote control terminal with a cursor displayed on the display screen. And instruction information transmitting means for transmitting information instructing to switch to the remote control terminal,
The remote control terminal is
Specific information transmitting means for transmitting the specific information to the terminal device;
Instruction information receiving means for receiving the instruction information transmitted by the instruction information transmitting means of the terminal device;
When the instruction information is received by the instruction information receiving means, second determination means for determining whether the remote control terminal functions as either the cursor instruction means or the laser pointer based on the received instruction information When,
A first control unit that performs control for causing the remote control terminal to function as the cursor instruction unit when the second determination unit determines to function as the cursor instruction unit;
A communication control system comprising: a second control unit configured to control the remote control terminal to function as the laser pointer when the second determination unit determines to function as the laser pointer. . The remote control terminal is
Third determination means for determining whether or not the remote control terminal is stationary;
And third control means for performing control so that the remote control terminal does not function as the laser pointer when the third determination means determines that the remote control terminal is in a stationary state. The communication control system according to claim 5. A communication control method processed by a terminal device that accepts an instruction from a remote control terminal having an instruction means that can be connected to a network and that can operate a pointer on a display screen that displays information,
Specific information receiving step for receiving, from the remote control terminal, specific information for specifying the position of the pointer on a plane including the display screen;
A position calculating step of calculating the position of the pointer based on the specific information when the specific information is received in the specific information receiving step;
Whether or not the position of the pointer calculated in the position calculating step exists in a shared area where shared data that is data shared with other terminal devices via the network is displayed. A first determination step for determining
In the first determination step, when it is determined that the position of the pointer exists in the shared area, the position information for specifying the position of the pointer is stored as a server or other terminal connected via the network. A position information transmission step to be transmitted to the device;
When it is determined in the first determination step that the position of the pointer does not exist in the shared area, the remote control terminal can be instructed by a cursor displayed on the display screen from a cursor indicating means capable of pointing to the laser pointer. An instruction information transmission step of transmitting information instructing to switch to the remote control terminal;
The pointers corresponding to the plurality of terminal devices existing in the shared area, created based on the location information transmitted from the location information transmission step of the plurality of terminal devices connected via the network A display control step of displaying image data including the image on the display screen.   A terminal control program that causes a computer to function as various processing means of the terminal device according to claim 1.

Images