RU2429549C1 - Method for multi-user remote control of computer for graphic applications - Google Patents

Abstract

FIELD: information technology.

SUBSTANCE: in the method for remote control of a computer, involving placing a projected image onto a screen, capturing the projected image with a video camera, creating an external cursor on the screen through projection thereof with an optical radiator, fixing the external cursor with the video camera, processing the image and generating control commands for the computer, according to the invention, employs two optical radiators with different wavelengths in the visible or infrared range, at least two external cursors are created, coordinates of at least two external cursors are determined based on analysis of images obtained on the screen, conformity of each external cursor with the internal cursor of the computer is established on the wavelength, separate queues of control commands are created for each internal cursor, the number of which is determined by the number of external cursors, the formed queues of control commands is analysed and then transformed into control action for each internal cursor.

EFFECT: broader functional capabilities for remote control of a computer owing to simultaneous operation with several radiators.

4 cl, 1 dwg

Description

The invention relates to computer technology, and in particular to methods of organizing interaction between several users and a system for presentations, computer games, simulators by means of a radiating device, such as a laser pointer.

Currently, a wide range of devices is used to work remotely with graphic applications on a computer. The most common solutions include wireless input devices - mice, trackballs, special devices with cursor buttons, devices based on inertial sensors, etc. These devices can effectively solve the task of quickly controlling a computer in graphic mode, but with their help it is almost impossible to solve more complex tasks, for example, enter handwritten text simulating the use of a pen or felt-tip pen. In addition, there is a specific disadvantage for wireless options for these devices. Given that information needs to be transmitted in real time, and the bandwidth of the radio channel is very limited, the polling frequency of wireless devices is noticeably lower than their wired counterparts, which, for example, affects the smoothness of the mouse cursor.

There are also graphic tablets, which are portable personal I / O devices and allow you to enter information in a more natural way for a person, however, when using a group of similar devices for collective work, the problem of image synchronization on all tablets arises, since in this case it also affects limited wireless bandwidth.

A known method of remote control of a computer associated with a screen for displaying an image from its video output and having an internal program cursor, comprising detecting at least one property of the external cursor and generating commands for the computer based on at least one identified property of the corresponding external cursor ; moreover, the identification of at least one property of the external cursor is carried out by determining the position of the external cursor, obtaining from the camera an image with a screen and an external cursor; processing the resulting image, which consists in comparing the new and previous frames to detect differences and filter the image, determine the brightness and color of the external cursor, determine the movement patterns of the external cursor, and generating commands for the computer consists in moving the internal cursor to the position of the external cursor (International Application No. WO 01/03106, IPC G06F 9/00, G06F 3/033, publ. 11.01.2001).

A known method of remote control of a computer, including the recognition of the coordinates of the laser spot on the background of the image of the object of the environment according to the parameters: line number of the video frame in which the center of the spot; the position of the center of the spot relative to the beginning of this line, the calculation of the coordinates of the spot from the beam on environmental objects, the recognition of the state of the control buttons, the generation of clock signals and their modulation by the pulses of the vertical synchronization of the camera, according to the information about the coordinates of the spot of the beam and the state of the control buttons depending on the mode "laser pointer" or "laser mouse" - modulate the current of a low-power laser (laser beam), the modulation frequency is ten times higher than the frame rate of the video camera (RF patent No. 2216766, IPC G06F 3/033, G09G 5/08, published on November 20, 2003, see description).

A known method of remote control of a computer is that the projected image is placed on the screen, the projected image is covered by a video camera, the coordinates of the cursor position on the screen are set using a laser beam, it is fixed with a video camera, the coordinates of the cursor position are transmitted to the command channel radiation receiver, coordinates are calculated spots of the laser beam, in accordance with which the laser beam is modulated in the visible or near infrared range (RF patent No. 2322686, IPC G06F 3/033, publ. 04/20/2008 - protot P).

Known methods for remote control of a computer realize the possibility of using a single laser emitter, because according to the algorithm for implementing the methods, when several laser dots are detected on the screen, the coordinates of the brightest point are transmitted to the computer, which automatically excludes the possibility of collective work by distinguishing user groups by the type of emitter used.

The technical problem to be solved by the claimed invention is directed is the creation of a new method for collective remote control of a computer, which makes it possible for several users to simultaneously work with graphic applications.

The stated technical problem is solved by the fact that in the method of remote control of a computer, namely, that the projected image is placed on the screen, the projected image is covered by a video camera, an external cursor is created on the screen by projecting it with an optical emitter, the external cursor is fixed by the video camera, the image is processed and control images are generated commands for the computer, according to the proposed invention, use two optical emitters with different wavelengths of the visible or infrared range, creating use at least two external cursors, determine the coordinates of at least two external cursors based on an analysis of the images received on the screen, establish the correspondence of each external cursor to the internal computer cursor along the wavelength, create separate queues of control commands for each internal cursor, the number of which is determined by the number of external cursors, analyze the formed queues of control commands and convert them into the control action of each internal cursor.

In addition, to form a queue of control commands for each internal cursor, a sequence of color spots on the screen from each optical emitter is analyzed.

In addition, a visible or near-infrared laser or LED is used as at least one optical emitter.

In addition, the computer is remotely controlled using a computer remote control system including a video camera, the output of which is connected to a computer, a projector, the information input of which is the computer video output, and at least two optical emitters with different visible or infrared wavelengths , the system is equipped with a carrier with software configured with the possibility of forming a command to control the internal cursors depending on the sequence colors of spots on the screen from optical emitters, image processing with the formation of a separate program queue of control commands for each internal cursor, depending on the color of the spot left by each of the optical emitters on the screen.

The technical result, which is achieved by implementing the entire claimed combination of features, is to provide the possibility of simultaneous work with graphic applications to multiple users.

The essence of the invention is illustrated in the drawing, which shows a diagram of a device explaining the operation of the method.

The drawing shows the following positions:

1 - computer;

2 - video camera;

3 - a projector;

4 - screen;

5 - optical emitters.

The system for multi-user remote control of a computer for graphic applications includes a computer 1, a video camera 2, the output of which is connected to a computer 1, a projector 3, the information input of which is the video output of a computer 1. The projector 3 and the video camera 2 are installed in front of the screen 4. By “screen” is meant any The surface onto which the image is projected. A multimedia projector is used as a projector. The projector 3 and the screen 4 can be structurally combined, for example, by making them in the form of a plasma or LCD panel.

The system includes at least two optical emitters 5 with different wavelengths of the visible or infrared range. In particular, the wavelengths of the emitters may differ, for example, by 40 nm. As at least one optical emitter 5, a visible or near-infrared laser or an LED is used.

The system may additionally contain at least one more video camera, and at least one video camera is equipped with a filter with predetermined color rendering parameters.

The system is equipped with a carrier with software configured to generate control commands for internal cursors depending on the sequence of color spots on the screen from optical emitters, image processing with the formation of a separate program queue of control commands for each internal cursor, depending on the color of the spots on the screen from each of optical emitters.

The proposed method is as follows.

Computer 1, video camera 2, projector 3, screen 4 are installed in the room. Video camera 2 and projector 3 are connected to computer 1 and installed in front of screen 4 so that the projected image fits entirely on screen 4, and video camera 2 captures the entire projected image. Users direct optical emitters 5 onto the screen 4.

The projected image is placed on the screen 4 and the projected image is covered by the video camera 2. On the screen 4, at least two external cursors are created by projecting them with optical emitters 5. External cursors are projected in the form of bright color spots of an arbitrary or given geometric shape, or bright points. The external cursor is fixed by video camera 2 and the image is processed. Why determine the coordinates of at least two external cursors. Analyze the image of the sequence of colored spots on the screen 4 from at least two optical emitters. Based on the analysis of the images of the sequence of colored spots or dots obtained on the screen, the correspondence of each external cursor to the internal computer cursor along the wavelength is established. Next, separate queues of control commands are formed for each internal cursor, the number of which is determined by the number of external cursors, they analyze the generated queues of control commands, convert them into the control action of each internal cursor and generate control commands for computer 1, for example, drawing on the screen in different colors, or generating events for standard input devices - keyboards, mice, etc. When implementing the method, software developed by the authors Copyright rights to which are confirmed by registration with ROSPATENT (certificate for registration of the program No. 20099616655 dated 01.12.2009).

Practical implementation of the method showed that the proposed computer control using emitters is possible both in the immediate vicinity of the screen and at a distance of up to 100 m

The proposed method is a new way of collective remote control of a computer and makes it possible for several users to work simultaneously with graphic applications.

Claims (4)

1. The method of remote control of a computer, which consists in the fact that the projected image is placed on the screen, the projected image is covered by a video camera, an external cursor on the screen is created by projecting it with an optical emitter, the external cursor is fixed by the video camera, the image is processed and control commands for the computer are generated, characterized in that at least two optical emitters with different wavelengths of the visible or infrared range are used in the method, at least two external cursors are created, determine the coordinates of at least two external cursors based on the analysis of the images received on the screen, establish the correspondence of each external cursor to the internal computer cursor along the wavelength, create separate queues of control commands for each internal cursor, the number of which is determined by the number of external cursors, analyze the generated queues control commands and convert them into the control action of each internal cursor. 2. The method according to claim 1, characterized in that for forming a queue of control commands for each internal cursor, a sequence of color spots on the screen from each optical emitter is analyzed. 3. The method according to claim 1, characterized in that as the at least one optical emitter use a laser of visible or near infrared, or LED. 4. The method according to claim 1, characterized in that the computer is remotely controlled using a computer remote control system including a video camera, the output of which is connected to a computer, a projector, the information input of which is the computer video output, and at least two optical emitter with different wavelengths of the visible or infrared range, the system is equipped with a carrier with software configured to generate control commands for internal cursors depending ing on the sequence of colored spots on the screen from the optical emitters, image processing software with the formation of a separate queue control commands for each internal cursor depending on the color spots, leaves each of the optical emitters on the screen.