CN111610868A - Mouse data processing method and system - Google Patents

Abstract

The invention provides a mouse data processing method and a mouse data processing system, relates to the technical field of electronic information, and can solve the problems that the data accuracy is low or a mouse event cannot be responded due to the problem of mouse coordinates in the process of transmitting the mouse event. The specific technical scheme is as follows: after the terminal device receives the mouse event, in order to realize that the terminal device and the server synchronously execute the mouse event, on one hand, the server receives a mouse operation instruction sent by the terminal device and executes an operation corresponding to the mouse event according to the mouse operation instruction; and on the other hand, the server sends the operation result to the terminal equipment, and after receiving the operation result, the terminal equipment draws the target mouse according to the operation result and executes the operation corresponding to the mouse event. The method is used for processing the mouse data.

Description

Mouse data processing method and system

technical field

The present disclosure relates to the field of electronic information technology, and in particular, to a mouse data processing method and system.

Background technique

With the rapid development of mouse operation technology, in order to further improve the applicable scene of the mouse, the existing technology operates the mouse to VDI (Virtual Desktop Infrastructure, ie virtual desktop infrastructure) through VDI (Virtual Desktop Infrastructure, ie virtual desktop infrastructure). In the prior art, the zero terminal sends the mouse event input by the user to the VM (Virtual Machine virtual machine), and the VM performs the operation according to the mouse event, and transmits the displayed image after the operation to the zero terminal and displays it to the user. The operation of the VM can be done through zero terminal. Among them, the mouse cursor is drawn by the zero terminal and superimposed on the display screen.

However, when drawing the mouse cursor, the coordinates of the mouse need to be obtained first. The coordinates of the mouse are divided into absolute coordinates and relative coordinates.

If the coordinates of the mouse are relative coordinates, in the VDI system, the interaction information between the VM and the zero terminal will be lost accidentally. The loss of the mouse coordinates will lead to inaccurate mouse coordinates obtained by the subsequent VM, resulting in poor user experience when operating the mouse.

If the coordinates of the mouse are absolute coordinates, in the VDI system, although the interaction information between the VM and the zero terminal is accidentally lost, the accuracy of the subsequent mouse coordinates will not be affected. The mouse coordinates reflected by the relative coordinates make the user's operation of these applications invalid under the VDI system.

SUMMARY OF THE INVENTION

Embodiments of the present disclosure provide a mouse data processing method and system, which can solve the problem of low data accuracy or failure to respond to mouse events due to mouse coordinates in the process of transmitting mouse events. The technical solution is as follows:

According to a first aspect of the embodiments of the present disclosure, a mouse data processing method is provided, which is applied to a terminal device, and the method includes:

Obtaining operation instruction information, the operation instruction information is used to instruct to perform a corresponding operation according to the target mouse event of the target mouse, the operation instruction information includes target coordinates, and the target coordinates include the target relative coordinates and the target absolute coordinates of the target mouse;

Send the operation instruction information to the server;

According to the operation instruction information, receive the operation result sent by the server;

According to the operation result and the target coordinates, the target image of the target mouse is drawn.

In one embodiment, obtaining target information in the method includes

Obtain the target mouse event, where the target mouse event includes the target relative coordinates of the target mouse;

Obtain the target absolute coordinates of the target mouse according to the relative coordinates of the target and the display information of the terminal device;

Generate the target coordinates according to the target relative coordinates and the target absolute coordinates;

The operation instruction information is generated according to the target coordinates and the target mouse event.

In one embodiment, the method further includes:

According to the target image and the operation instruction information, the target operation corresponding to the target mouse event is performed.

According to a second aspect of the embodiments of the present disclosure, a mouse data processing method is provided, applied to a server, including:

Obtaining operation instruction information, the operation instruction information is used to instruct to perform a corresponding operation according to the target mouse event of the target mouse, the operation instruction information includes target coordinates, and the target coordinates include the target relative coordinates and the target absolute coordinates of the target mouse;

According to the preset state of the target mouse, determine the target type corresponding to the target mouse, and the target type is used to indicate that the coordinates of the target mouse are relative coordinate types or absolute coordinate types;

According to the coordinates corresponding to the target type in the target coordinates, the target operation corresponding to the target mouse event is executed, and the operation result is obtained.

In one embodiment, determining the target type corresponding to the target mouse in the method includes:

When the preset state is a hidden state, it is determined that the target type of the target mouse is a relative coordinate type;

When the preset state is the display state, it is determined that the target type of the target mouse is the absolute coordinate type.

In one embodiment, obtaining the operation result in the method includes:

When the target type is a relative coordinate type, obtain hidden information, and the hidden information is used to indicate that the target mouse is hidden;

Obtain the operation result according to the hidden information.

Or, when the target type is an absolute coordinate type, obtain target data of the target mouse according to the mouse event, the target data including: a target image, a target identifier and a target map, where the target map is used to indicate the target image and the correspondence between the target identifiers;

After encoding the target data, the operation result is obtained.

In one embodiment, acquiring the target data of the target mouse in the method includes:

When acquiring the target data of the target mouse for the first time, the target data includes: a target image, a target identifier and a target map, where the target map is used to indicate the correspondence between the target image and the target identifier;

When the target data of the target mouse is acquired for the Nth time, the target data includes: a target identifier, where N is greater than 1.

According to a third aspect of the embodiments of the present disclosure, a mouse data processing system is provided, the system comprising: a server and a terminal device;

the server is connected to the terminal device;

The terminal device is used for acquiring operation instruction information, where the operation instruction information is used to instruct to perform a corresponding operation according to a target mouse event of the target mouse, the operation instruction information includes target coordinates, and the target coordinates include the target relative coordinates of the target mouse and target absolute coordinates;

Send the operation instruction information to the server;

According to the operation instruction information, receive the operation result sent by the server;

Draw the target image of the target mouse according to the operation result and the target coordinates;

The server is used to obtain operation instruction information, the operation instruction information is used to instruct to perform a corresponding operation according to the target mouse event, and the operation instruction information includes the target relative coordinates and the target absolute coordinates of the target mouse;

Determine the target coordinates corresponding to the target data according to the preset state of the target mouse, where the target coordinates include relative coordinates or absolute coordinates of the target mouse, and the preset state is determined according to the operating system;

According to the target coordinates, the operation corresponding to the mouse event is performed, and the operation result is obtained.

Send the operation result to the terminal device.

In one embodiment, the server in the system is also used to:

When the preset state is the display state, the target data of the target mouse is acquired according to the mouse event, the target data includes: a target image, a target identifier and a target map, the target map is used to indicate the target image and the target correspondence between identifiers;

After encoding the target data, an operation result is generated;

When the preset state is a hidden state, generate hidden information according to the hidden state, and the hidden information is used to instruct to hide the target mouse;

Obtain the operation result according to the hidden information.

In one embodiment, the terminal device in the system is further used to:

According to the target image and the operation instruction information, the target operation corresponding to the target mouse event is performed.

It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure.

Description of drawings

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the disclosure and together with the description serve to explain the principles of the disclosure.

1 is a flowchart of a mouse data processing method provided by an embodiment of the present disclosure;

2 is a flowchart 1 of a mouse data processing method provided by an embodiment of the present disclosure;

3 is a structural diagram of a mouse data processing system provided by an embodiment of the present disclosure;

FIG. 3 a is a structural diagram 1 of a mouse data processing system provided by an embodiment of the present disclosure.

Detailed ways

Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. Where the following description refers to the drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the illustrative examples below are not intended to represent all implementations consistent with this disclosure. Rather, they are merely examples of apparatus and methods consistent with some aspects of the present disclosure as recited in the appended claims.

Example 1

An embodiment of the present disclosure provides a mouse data processing method, which is applied to a server. As shown in FIG. 1 , the mouse data processing method includes the following steps:

101. Obtain operation instruction information.

The operation instruction information is used to instruct to perform a corresponding operation according to the target mouse event of the target mouse, and the operation instruction information includes the target relative coordinates and the target absolute coordinates of the target mouse.

The data request information is used to request to send target data corresponding to the target mouse event;

Further, the above-mentioned target mouse events may be based on continuous mouse events within a preset time period. Among them, each event is a set of relative offsets, representing the direction and length of the movement on the screen. These data, called relative coordinates, represent the offset along the x, y axis based on the current position, and a series of offsets is enough to become the mouse movement track. For example (n,-m), the calculation process is based on the current position, move n units to the right, and at the same time, move up m units, so the calculated position is the current mouse position. (n,-m) is also the relative coordinate described here.

For example, the coordinate value of the current mouse in the display screen coordinate system is (10, 100), and a mouse event (2, -3) is generated at this time, and the final position of the mouse is (12, 97).

Specifically, the absolute coordinate refers to the coordinate value of the mouse in the coordinate system of the display screen.

The above-mentioned acquisition operation instruction information may be received through a terminal device, and the terminal device may be a VM (Virtual Machine, virtual machine) that can be set on the server. For example, the user operates on the VM through the terminal device, and the VM obtains the operation instruction information and sends it to the server according to the operation.

102. Determine a target type corresponding to the target mouse according to the preset state of the target mouse.

The target type is used to indicate that the coordinates of the target mouse are relative coordinate type or absolute coordinate type;

The preset state includes a displayed state or a hidden state.

The above-mentioned preset state of the target mouse is determined by the operating system of the server, and can be obtained through an interface provided by the operating system.

Since the preset state is provided by the operating system of the server and has nothing to do with upper-layer applications, it can be compatible with various types of applications, and can also improve the user's operating experience.

In an optional embodiment, in the method provided by the present disclosure, determining the target type corresponding to the target mouse includes:

When the preset state is a hidden state, it is determined that the target type of the target mouse is a relative coordinate type;

When the preset state is the display state, it is determined that the target type of the target mouse is the absolute coordinate type.

103. Execute the target operation corresponding to the target mouse event according to the coordinates corresponding to the target type in the target coordinates, and obtain the operation result.

In an optional embodiment, executing the target operation corresponding to the target mouse event in the method provided by the present disclosure includes:

Obtain the corresponding mouse coordinate data in the target coordinates according to the target type, and input the mouse coordinate data into the operating system;

The operating system executes the target operation corresponding to the target mouse event according to the mouse coordinate data and the operation instruction information.

In the mouse display state, no matter what kind of application, the absolute coordinates can take effect; while in the mouse hidden state, the mouse position information is not important at this time, and the data reported by the operating system to the application should be the original mouse data, that is, in the present invention The relative coordinates described.

Absolute coordinates do not need to rely on the previous coordinate, so each time an absolute coordinate is sent is equivalent to a calibration, and in the case of relative coordinates, because the mouse itself does not display, there is no need for calibration.

That is, this processing method of the target mouse is decoupled from the separation of the timing of injecting different types of data from the application, and only the current mouse state of the operating system is concerned.

When the default state of the mouse is the display state, the absolute coordinates can take effect no matter what kind of application it is; and when the default state of the mouse is the hidden state, the mouse position information is not important at this time, and the data reported by the operating system to the application It should be the mouse raw data, that is, the relative coordinates described in this method.

For example, the virtual machine in the current server runs a 3D shooting game. At this time, the user will see a crosshair in the middle of the screen, and the crosshair is always in the middle of the window or screen. At this time, there is no mouse, and the movement of the screen is all based on the current screen. When the user exits or sets the game, the mouse is called up, the mouse is displayed at this time, and the operating system reports the absolute coordinates to take effect.

In an optional embodiment, after completing the target operation, the method provided by the present disclosure further includes acquiring an operation result and sending it to the terminal device, wherein acquiring the operation result includes:

When the target type is a relative coordinate type, hidden information is generated according to the hidden state, and the hidden information is used to indicate that the target mouse is hidden;

Obtain the operation result according to the hidden information;

When the target type is an absolute coordinate type, the target data of the target mouse is obtained according to the mouse event, and the target data includes: a target image, a target identifier and a target map, and the target map is used to indicate the target image and the target correspondence between identifiers;

After encoding the target data, the operation result is obtained.

Further, when the target data of the target mouse is sent, it can be determined whether the target data is acquired for the first time.

When acquiring the target data of the target mouse for the first time, the target data includes: a target image, a target identifier and a target map, where the target map is used to indicate the correspondence between the target image and the target identifier;

When the target data of the target mouse is acquired for the Nth time, the target data includes: a target identifier, where N is greater than 1.

In the mouse data processing method provided by the embodiment of the present disclosure, after the terminal device receives the mouse event, in order to keep the terminal device and the server executing the mouse event synchronously, on the one hand, the server receives the mouse operation instruction sent by the terminal device, and executes the mouse operation instruction according to the mouse operation. instruction, execute the operation corresponding to the mouse event; on the other hand, the server sends the operation result to the terminal device according to the operation result, and after receiving the operation result, the terminal device draws the target image of the target mouse according to the operation result, and executes the operation result. The action corresponding to the mouse event.

The method provided by the present disclosure ensures the synchronization between the terminal device and the server when performing operations corresponding to mouse events, and also ensures the accuracy and efficiency of mouse event execution. Specifically reflected in the following two aspects:

In the first aspect, when an operation corresponding to a mouse event is performed according to the target information, the method provided by the present disclosure determines a preset state corresponding to the mouse according to different mouse application scenarios, and the preset state of the mouse is the display state or the display state. Hide the state and determine the mouse coordinates corresponding to the state.

The mouse coordinates include absolute coordinate data or relative coordinate data. When the mouse is in the display state, no matter what kind of application, the absolute coordinates can take effect. At this time, the mouse data packet corresponding to the display state is the absolute coordinate data; while in the hidden state of the mouse, the mouse position information is not important at this time. The data reported by the operating system to the application should be the original data of the mouse, and the mouse data packet corresponding to the hidden state at this time is the relative coordinate data.

In the second aspect, when the target data is sent to the terminal device according to the target information, the method provided by the present disclosure avoids the situation that the mouse data is lost during the transmission process, and only sends the corresponding target data to the terminal device, so there is no need to The mouse position between the server and the end device is calibrated. Based on the characteristics of mouse coordinates, the efficiency of data processing is improved, and the accuracy of data processing is also improved.

Embodiment 2

An embodiment of the present disclosure provides a mouse data processing method, which is applied to a terminal device. As shown in FIG. 2 , the mouse data processing method includes the following steps:

201. Obtain operation instruction information.

The operation instruction information is used to instruct to perform a corresponding operation according to the target mouse event of the target mouse, and the operation instruction information includes target coordinates, and the target coordinates include target relative coordinates and target absolute coordinates of the target mouse;

The step of acquiring operation instruction information in the method provided by the present disclosure may include:

Obtain the target mouse event, where the target mouse event includes the target relative coordinates of the target mouse;

Obtain the target absolute coordinates of the target mouse according to the relative coordinates of the target and the display information of the terminal device, where the display information includes the display resolution;

Generate the target coordinates according to the target relative coordinates and the target absolute coordinates;

The operation instruction information is generated according to the target coordinates and the target mouse event.

202. Send the operation instruction information to the server.

In an optional embodiment, when the terminal device is a zero-terminal device, the server may be a server that deploys the zero-terminal device.

203. Receive an operation result sent by the server according to the operation instruction information.

In an optional embodiment, in the method provided by the present disclosure, an operation result sent by a server is received, and the operation result may include target data and hidden information; wherein, the hidden information is used to instruct to hide the target mouse; the target data may be It includes: a preset state, a target image, a target identifier, and a target map, where the target map is used to indicate the correspondence between the target image and the target identifier.

Further, if the received operation result is hidden information, that is, when it is clarified that the preset state of the target mouse is a hidden state, it is determined that the target image of the target mouse is not drawn.

Further, if the received target data is the target identifier, the target image corresponding to the target identifier can be found according to the target identifier and the pre-stored target mapping.

In an optional embodiment, in the method provided by the present disclosure, after the target data is received for the first time, the target image, target identifier and target mapping of the entire set of target mouse in the target data are stored, and after the second time After receiving the target data, it is only necessary to obtain the target identifier, and through the target identifier and the pre-stored target mapping, the target image of the corresponding target mouse is found, thereby improving the efficiency of data processing. Even if the mouse image in the server changes for the first time, there is no need to send the mouse image, and the identifier corresponding to the mouse image can be sent directly.

204. Draw a target image of the target mouse according to the operation result and the target coordinates.

In an optional embodiment, after drawing the target image of the target mouse, the method provided by the present disclosure sends the drawn target mouse to the display, and the display displays the target mouse.

The method provided by the present disclosure further includes: performing a target operation corresponding to the mouse event according to the target image and the operation instruction information.

In the mouse data processing method provided by the embodiment of the present disclosure, after the terminal device receives the mouse event, in order to keep the terminal device and the server executing the mouse event synchronously, on the one hand, the server receives the mouse operation instruction sent by the terminal device, and executes the mouse operation instruction according to the mouse operation. instruction, execute the operation corresponding to the mouse event; on the other hand, the server sends the operation result to the terminal device according to the operation result, and after receiving the operation result, the terminal device draws the target image of the target mouse according to the operation result, and executes the operation result. The action corresponding to the mouse event.

The method provided by the present disclosure ensures the synchronization between the terminal device and the server when performing operations corresponding to mouse events, and also ensures the accuracy and efficiency of mouse event execution. Specifically reflected in the following two aspects:

In the first aspect, when an operation corresponding to a mouse event is performed according to the target information, the method provided by the present disclosure determines a preset state corresponding to the mouse according to different mouse application scenarios, and the preset state of the mouse is the display state or the display state. Hide the state and determine the mouse coordinates corresponding to the state.

The mouse coordinates include absolute coordinate data or relative coordinate data. When the mouse is in the display state, no matter what kind of application, the absolute coordinates can take effect. At this time, the mouse data packet corresponding to the display state is the absolute coordinate data; while in the hidden state of the mouse, the mouse position information is not important at this time. The data reported by the operating system to the application should be the original data of the mouse, and the mouse data packet corresponding to the hidden state at this time is the relative coordinate data.

In the second aspect, when the target data is sent to the terminal device according to the target information, the method provided by the present disclosure avoids the situation that the mouse data is lost during the transmission process, and only sends the corresponding target data to the terminal device, so there is no need to The mouse position between the server and the end device is calibrated. Based on the characteristics of mouse coordinates, the efficiency of data processing is improved, and the accuracy of data processing is also improved.

Embodiment 3

Based on the mouse data processing method described in the above-mentioned embodiment corresponding to FIG. 1 , the following is an apparatus embodiment of the present disclosure, which can be used to execute the method embodiment of the present disclosure.

An embodiment of the present disclosure provides a mouse data processing system. As shown in FIG. 3 , the mouse data processing system 30 includes:

The server 302 is connected to the terminal device 301;

The terminal device 301 is configured to acquire operation instruction information, where the operation instruction information is used to instruct to perform a corresponding operation according to a target mouse event of the target mouse, the operation instruction information includes target coordinates, and the target coordinates include target relative coordinates of the target mouse and the absolute coordinates of the target;

Send the operation instruction information to the server 302;

According to the operation instruction information, receive the operation result sent by the server 302;

Draw the target image of the target mouse according to the operation result and the target coordinates;

The server 302 is configured to obtain operation instruction information, where the operation instruction information is used to instruct to perform a corresponding operation according to the target mouse event, and the operation instruction information includes the target relative coordinates and the target absolute coordinates of the target mouse;

Determine the target coordinates corresponding to the target data according to the preset state of the target mouse, where the target coordinates include relative coordinates or absolute coordinates of the target mouse, and the preset state is determined according to the operating system;

According to the target coordinates, the operation corresponding to the mouse event is performed, and the operation result is obtained.

The operation result is sent to the terminal device 301 .

In an optional embodiment, when the system 30 provided by the embodiment of the present disclosure is started, the terminal device 301 and the server 302 need to synchronize the initial position and state information of the mouse first. At this time, if the server 302 obtains the preset mouse state information according to the system settings as the display state, the server 302 sends the initial mouse data to the terminal device 301; if the preset mouse state information is the hidden state, the server sends the hidden state of the mouse to the terminal device 301. to the terminal device. Correspondingly, after the terminal device obtains the preset mouse state information, if the preset mouse state information is the display state, the initial absolute position is set to (0, 0), that is, the upper left corner of the display screen of the terminal device, and the The absolute position data is sent back to the server; if the initial state of the mouse is hidden, the terminal device does not process it.

Specific examples are listed here to illustrate how mouse data processing is performed between the server 302 and the terminal device 301 in the mouse data processing system, as shown in FIG. device 30103, sound decoding device 30104, mouse key encoding device 30105, USB processing device 30106, sound input device 30107, transmission control device 30108, network card 30109, mouse drawing device 30110, mouse key decoding device 30111; server 302 includes: sending device 303 And motherboard 30201, CPU30202, memory 30203, image processing device 30204, sound processing device 30205, USB device 30206, transmission control device 30207, sound input device 30208, network card 30209.

The terminal device 301 is used to process the received data. Specifically, the data sent by the network is received through the transmission control device 30108, and sent to the image decoding device 30103 and the sound decoding device 30104 respectively, and sent by the image decoding device 30103 and the sound decoding device 30104. Enter the playback control device 30102, and the playback control device 30102 decides when to send it to the display device 30101 for display or playback; the transmission control device 30108 also receives the mouse graphic data generated by the user operation, and sends it into the mouse key decoding device 30111 for decoding, Then it is sent to the mouse drawing device 30110; the mouse drawing device 30110 simultaneously receives the mouse operation data input by the USB processing device 30106.

The server 302 is used to process the image and sound data generated by the computer; the data processing process: the computer sends the generated picture and sound data to the image processing device 30204 and the sound processing device 30205 respectively for processing, and the sending device 303 passes through the image acquisition device respectively. 30301, the sound acquisition device 30302 obtains these data, respectively sends the data to the image encoding device 30305 and the sound encoding device 30306 for encoding, and then sends the encoding result to the transmission control device 30309, which decides how to send; the transmission control device 30309 simultaneously Receive the reverse control data and voice data of the user sent from the terminal device 301, and send the received data to the voice decoding device 30308 and the control decoding device 30307 for decoding, and the decoding result is sent to the voice input device of the computer system 30208 and the transmission control device 30307; the transmission control device 30309 may also receive the USB redirection data sent by the terminal device 301 and directly send it to the USB device 30206 of the system.

Step 1, the terminal device 301 acquires a target mouse event, which includes relative coordinate data, and acquires target coordinates according to the target mouse event, where the target coordinates include relative coordinate data and absolute coordinate data, wherein the absolute coordinate data is obtained through the terminal device. The display resolution and relative coordinate data of 301 are obtained.

The target mouse event may be generated after the terminal device 301 obtains the mouse operation on the user terminal device through the USB processing device 30106 in the target mouse events.

The terminal device 301 generates operation instruction information according to the target mouse event and the target coordinates. The operation instruction information is used to instruct to perform the corresponding operation according to the target mouse event

Step 2: The terminal device reports the absolute coordinate data to the mouse drawing device 30110 through the USB processing device 30106, and the mouse drawing device 30110 draws the first mouse data according to the absolute coordinate data. At the same time, the USB processing device 30106 will also send the operation instruction information to the mouse encoding device 30105. The mouse encoding device 30105 encodes and compresses the mouse data and sends it to the transmission control device 30108. The network card 30209 sends to the sending device 303 in the server 302 .

Specifically, the transmission control device 30207 in the server 302 sends the operation instruction information to the operating system of the server 302 . When acquiring the operation instruction information, the sending device 303 in the server first acquires whether the preset mouse state of the current mouse in the operating system is the displayed state or the hidden state; when the preset mouse state is the hidden state, it acquires relative coordinate data; When the mouse state is displayed, the absolute coordinate data is obtained. The control input device 30303 in the sending device 303 is equivalent to simulating a keyboard and a mouse, and can simulate a keyboard and a mouse according to the determined coordinate data.

Step 3: The server 302 performs a corresponding operation according to the operation instruction information, and acquires an operation result, where the operation result includes an image.

Specifically, when the preset mouse state is the hidden state, the sending device 303 sets the preset mouse state displayed on the server 302 to the hidden state, generates hidden information, and transmits the hidden state through the network card 30209 of the server 302 and the terminal device 301 The network card 30109 of the terminal device 301 sends it to the transmission control device 30108.

When the preset mouse state is a hidden state, the server 302 acquires a corresponding target image, where the target image may include arrow graphics, hand graphics, vertical bar graphics, and the like.

Further, when the preset mouse state is a hidden state, the server 302 can also determine whether the target data appears for the first time.

If it is the first occurrence, the sending device 303 encodes the target image corresponding to the target mouse through the image encoding device 30305, and sets the target identifier corresponding to the target image. Based on the target image and target identifier, a target map is established. The encoded target image, target identifier and target map are sent to the transmission control device 30108 of the terminal device 301 via the network card 30209 of the server 302 and the network card 30109 of the terminal device.

If it is not the first time, the sending device 303 can send the target identifier corresponding to the mouse image to the transmission control device 30108 of the terminal device 301 via the network card 30209 of the server 302 and the network card 30109 of the terminal device.

Step 4. The transmission control device 30108 receives the operation result sent by the server 302, and performs decoding processing through the mouse key decoding device 30111. The operation result may include hidden information or target data, and the target data may include: mouse preset state, Target image, target identifier and target map, mouse graphics data.

If the result of the operation after the decoding process is hidden information, the mouse drawing device 30110 is directly instructed to no longer draw the mouse.

If the operation result after the decoding process is the mouse graphic data and the identifier, the corresponding relationship between the mouse graphic and the identifier is stored, and the encoded mouse graphic data is decoded and sent to the playback control device 30102; the mouse drawing device 30110 sends the mouse The coordinates are sent to the playback control device 30102, and the playback control device 30102 displays on the display 30101 according to the image, the mouse image and the mouse coordinates.

If the operation result after the decoding process is the target identifier, the target image corresponding to the target identifier is found according to the target identifier and the pre-stored target map, and the target image is sent to the mouse drawing device 30110 . The mouse drawing device 30110 draws the target image of the target mouse according to the target data.

The mouse drawing device 30110 sends the target coordinates and target data to the display 30101, and the display 30101 displays the target mouse.

The mouse data processing system provided by the embodiment of the present disclosure includes a server and a terminal device. The terminal device obtains operation instruction information of a target mouse, and the operation instruction information includes mouse relative coordinate data and mouse absolute coordinate data. The terminal device sends the operation instruction information to the server. After the server inputs the operation instruction information into the system, it obtains the preset state of the target mouse, performs the corresponding operation according to the preset state and the operation instruction information, and obtains the operation result. After the server sends the operation result to the terminal device, the terminal device draws the target image of the target mouse and performs the corresponding operation according to the operation result and the mouse coordinate data.

Based on the mouse data processing method described in the above embodiments corresponding to FIG. 1 and FIG. 2 , an embodiment of the present disclosure further provides a computer-readable storage medium, for example, the non-transitory computer-readable storage medium may be a read-only memory ( English: Read Only Memory, ROM), random access memory (English: Random Access Memory, RAM), CD-ROM, magnetic tape, floppy disk and optical data storage device, etc. The storage medium stores computer instructions for executing the mouse data processing method described in the embodiments corresponding to FIG. 1 and FIG. 2 , and details are not described herein again.

Other embodiments of the present disclosure will readily occur to those skilled in the art upon consideration of the specification and practice of the disclosure disclosed herein. This application is intended to cover any variations, uses, or adaptations of the present disclosure that follow the general principles of the present disclosure and include common knowledge or techniques in the technical field not disclosed by the present disclosure . The specification and examples are to be regarded as exemplary only, with the true scope and spirit of the disclosure being indicated by the following claims.

Claims (10)

1. a mouse data processing method, is characterized in that, is applied to terminal equipment, and described method comprises: Obtain operation instruction information, the operation instruction information is used to instruct to perform a corresponding operation according to the target mouse event of the target mouse, the operation instruction information includes target coordinates, and the target coordinates include the target relative coordinates and target absolute coordinates of the target mouse coordinate; Send the operation instruction information to the server; According to the operation instruction information, receive the operation result sent by the server; Drawing the target image of the target mouse according to the operation result and the target coordinates. 2. The method according to claim 1, wherein the obtaining target information comprises obtaining a target mouse event, and the target mouse event includes the target relative coordinates of the target mouse; Obtain the target absolute coordinates of the target mouse according to the target relative coordinates and the display information of the terminal device; generating the target coordinates according to the target relative coordinates and the target absolute coordinates; The operation instruction information is generated according to the target coordinates and the target mouse event. 3. The method according to claim 2, wherein the method further comprises: According to the target image and the operation instruction information, a target operation corresponding to the target mouse event is performed. 4. a mouse data processing method, is characterized in that, is applied to server, described method comprises: Obtain operation instruction information, the operation instruction information is used to instruct to perform a corresponding operation according to the target mouse event of the target mouse, the operation instruction information includes target coordinates, and the target coordinates include the target relative coordinates and target absolute coordinates of the target mouse coordinate; According to the preset state of the target mouse, determine the target type corresponding to the target mouse, and the target type is used to indicate that the coordinates of the target mouse are relative coordinate types or absolute coordinate types; According to the coordinates corresponding to the target type in the target coordinates, the target operation corresponding to the target mouse event is performed, and the operation result is obtained. According to the coordinates corresponding to the target type in the target coordinates. 5. The method according to claim 1, wherein the determining the target type corresponding to the target mouse comprises: When the preset state is a hidden state, determine that the target type of the target mouse is a relative coordinate type; When the preset state is the display state, it is determined that the target type of the target mouse is an absolute coordinate type. 6. The method according to claim 1, wherein the obtaining operation result comprises: When the target type is a relative coordinate type, obtain hidden information, where the hidden information is used to indicate that the target mouse is hidden; Obtain the operation result according to the hidden information; Or, when the target type is an absolute coordinate type, acquire target data of the target mouse according to the mouse event, where the target data includes: a target image, a target identifier and a target map, where the target map is used for indicating a correspondence between the target image and the target identifier; After encoding the target data, an operation result is obtained. 7. The method according to claim 6, wherein the acquiring the target data of the target mouse comprises: When the target data of the target mouse is acquired for the first time, the target data includes: a target image, a target identifier and a target map, where the target map is used to indicate the difference between the target image and the target identifier Correspondence; When the target data of the target mouse is acquired for the Nth time, the target data includes: a target identifier, and the N is greater than 1. 8. A mouse data processing system, comprising: a server and a terminal device; the server and the terminal device are connected; The terminal device is used to obtain operation instruction information, where the operation instruction information is used to instruct to perform a corresponding operation according to a target mouse event of the target mouse, the operation instruction information includes target coordinates, and the target coordinates include the target mouse target relative coordinates and target absolute coordinates; Send the operation instruction information to the server; According to the operation instruction information, receive the operation result sent by the server; Drawing the target image of the target mouse according to the operation result and the target coordinates; The server is used to obtain operation instruction information, the operation instruction information is used to instruct to perform a corresponding operation according to a target mouse event, and the operation instruction information includes the target relative coordinates and the target absolute coordinates of the target mouse; Determine the target coordinates corresponding to the target data according to the preset state of the target mouse, where the target coordinates include relative coordinates or absolute coordinates of the target mouse, and the preset state is determined according to the operating system; According to the target coordinates, the operation corresponding to the mouse event is performed, and the operation result is obtained. Send the operation result to the terminal device. 9. The system according to claim 8, wherein the server is further configured to: When the preset state is the display state, the target data of the target mouse is acquired according to the mouse event, the target data includes: a target image, a target identifier and a target map, and the target map is used to indicate the target mouse. the correspondence between the target image and the target identifier; After encoding the target data, an operation result is generated; When the preset state is a hidden state, generating hidden information according to the hidden state, where the hidden information is used to instruct to hide the target mouse; Obtain the operation result according to the hidden information. 10. The system according to claim 8, wherein the terminal device is further configured to: According to the target image and the operation instruction information, a target operation corresponding to the target mouse event is performed.

Images