CN106506535A - An interactive system for multiple people to interact on the same screen - Google Patents

Abstract

A kind of many people include with the interactive interactive system of screen：One server and multiple terminals, server include sending module, receiver module, control module and display module；Terminal includes：Audio, video data transceiver module, control information transceiver module, the response message that is fed back from terminal according to the identification information described in the server reception, wherein, from terminal, the response message supports that the description information of type identical multi-screen interactive agreement is generated with described according in the identification information from terminal by described；Terminal sends concerned control command to server, and server completes the parsing to related protocol and generate to be suitable for the control signaling that parsed by control terminal, and control signaling is sent to by control terminal, completing to operate terminal-pair by the control of control terminal.

Description

An interactive system for multiple people to interact on the same screen

technical field

The present invention relates to the technical field of multi-screen interaction, in particular to a control and display method between multi-screen interactive devices, multi-screen interactive device and system.

Background technique

With the continuous development of Internet technology and the rapid rise of Internet TV, various terminal products have been well integrated into Internet TV and smart screens. With the development of this trend, the content sharing and interaction of Internet video and information by terminals will be realized. It is imminent. According to this status quo, multi-screen interactive technology emerged as the times require. Multi-screen interaction refers to, based on DLNA protocol or IGRS protocol, connected through WIFI and mobile network, on different multimedia terminals, such as common based on Ios, Android, Symbian, A series of operations such as transmission, analysis, display, control, etc. , can share and display content on different platform terminals at the same time, enriching users' multimedia life. The most widely used three-screen interaction is the TV screen. The three-screen interactive network protocol between the mobile phone screen and the computer screen realizes video mutual push, mobile phone analog remote control, mobile phone analog mouse control, and data sharing of three-screen terminals.

At present, multi-screen interactive devices have been widely used because they can share and display content on different platform devices at the same time, enriching users' multimedia life. The protocols supported by multi-screen interactive devices include DLNA protocol, IGRS protocol, etc. Among them, Digital Living Network Alliance (Digital Living Network Alliance, referred to as DLNA) is an internationally common multi-screen interactive protocol, which can directly perform mutual discovery, push playback and Control, this protocol is the first choice for current multi-screen interactive devices, such as XBOX, Windows7, IntelToolsforUPnP and many other software and hardware are using this protocol. Information Equipment Resource Sharing Collaboration Service (Intelligent Grouping and Resource Sharing, referred to as IGRS) is a multi-screen interactive protocol formulated by the domestic IGRS organization in line with China's domestic usage habits. It integrates some functions formulated by the DLNA protocol and provides remote multimedia file sharing and website video sharing. and other functions. At present, it has been widely used in China.

In the prior art, multi-screen interactive devices that support the same type of multi-screen interactive protocol can directly communicate and control each other. For example, a DLNA device that supports the DLNA protocol can communicate and control with other DLNA devices of the same type, and an IGRS that supports the IGRS protocol The device can communicate and control with other IGRS devices of the same type. However, multi-screen interactive devices that support different types of multi-screen interactive protocols cannot communicate and control each other. For example, DLNA devices and IGRS devices cannot directly communicate and control. This type of multi-screen interactive device is very inconvenient.

Contents of the invention

The main purpose of the present invention is to provide a control method between multi-screen interactive devices, a multi-screen interactive device and a system, aiming at realizing mutual control between multi-screen interactive devices of different types of multi-screen interactive protocols. For this reason, the technical scheme provided by the invention is as follows:

An interactive system for multi-person interaction on the same screen, characterized in that the multi-screen interactive system includes: a server and multiple terminals, the server includes a sending module for sending identification information to the terminal, the identification information includes preset The description information of the multi-screen interactive protocol is provided; the receiving module is used to receive the response information fed back by the terminal according to the identification information, wherein the response information is provided by the terminal according to the identification information of the same type as that supported by the terminal. Generation of description information of the multi-screen interactive protocol; a control module, configured to obtain the type of multi-screen interactive protocol supported by the terminal according to the response information, and send corresponding control instructions to the terminal according to the type of multi-screen interactive protocol supported by the terminal The above-mentioned terminal; the terminal includes: an audio and video data transceiver module, used to send and receive audio and video data via a first channel; a control information transceiver module, used to send and receive control information via a second channel different from the first channel; the terminal also includes an application program , establish a connection between the application program and the server-side service program; complete the communication and identification information between the server and multiple terminals through a standard communication and transmission protocol, and the identification information includes a description of a preset multi-screen interactive protocol information; the server receives the response information fed back by the slave terminal according to the identification information, wherein the response information is provided by the slave terminal according to the identification information and the same type of multi-screen interaction protocol supported by the slave terminal The description information is generated; the terminal sends the relevant control command to the server, the server completes the analysis of the relevant protocol and generates the control signaling suitable for the analysis of the controlled terminal, and sends the control signaling to the controlled terminal to complete the operation of the terminal to the controlled terminal. terminal control.

Further, the server is a Digital Living Network Alliance DLNA device or an information device resource sharing collaborative service IGRS device, the terminal is an IGRS device or a DLNA device, the first channel can be a local area network, a wireless local area network, or the mobile Internet, and the second The second channel can be LAN, WLAN, mobile Internet, bluetooth or infrared.

Further, the identification information includes a DLNA data packet and an IGRS data packet, the DLNA data packet includes a DLNA description template, and the IGRS data packet includes an IGRS description template.

Furthermore, the server installs relevant platform client software through corresponding business processing platforms and terminals to realize seamless switching of content between various terminals, data association of the same content on different terminals, and association of users’ login accounts on different terminals. The communication between terminals is carried out through the server to realize terminal-to-terminal control; the business processing platform completes the analysis and processing of signaling requests initiated by different terminals in this process, and notifies the controlled terminal to complete related operations; For the unification of login accounts, the server binds the login accounts on various terminals by establishing an associated database table, so as to realize unified login authentication; the server is composed of a data association module and a user account association module, and the data association The module completes the creation of the association relationship of index files displaying content on different application terminals, and generates new index files for use by the capability support platform; the user account association module completes the association relationship of accounts used by users to log in on different application terminals Create, so that the system can automatically identify the same user logged in on different terminals.

The present invention also provides a method for realizing multi-screen interaction, which includes the following steps:

Step 1: The server application sends data packets in broadcast mode;

Step 2: The service program on the server side listens to data packets, and distinguishes whether the received data packets are sent by the application program of the terminal;

Step 3: After the terminal logs in to the server and establishes a connection with the service program on the server, a control interface is displayed on the display screen of the client, wherein the control interface has control buttons;

Step: 4: After the terminal successfully logs in, the server actively sends the terminal list of the terminal classification where the terminal is located to each successfully logged-in terminal, and the terminal list includes at least terminal identification, terminal grouping, and terminal connection status information;

Step 5: The terminal obtains the above terminal list, performs a local direct connection test with the terminals in the list, and records the direct connection status of each terminal, and the direct connection status includes normal connection and connection failure;

Step 6: The terminal communicates with other terminals according to the directly connected state, uses the control button on the control interface on the client to input a control command, and sends the control command to the server, and all the control commands on the server The service program executes corresponding operations according to the control commands, and displays corresponding pictures on the display screen of the server.

Further, the multi-screen interaction method further includes: when the application program of the terminal is closed, sending a close command to the service program of the server; the service program of the server closes the terminal The connection between the application program and the service program on the server side; after the connection is established between the application program on the terminal and the service program on the server side, the terminal regularly sends heartbeat packets to the server side ; The server side judges whether to receive the heartbeat packet sent by the terminal regularly, and if it is not received regularly, the service program of the server side closes the application program of the client side and the described server side of the server side Connections between service programs.

A control method between multi-screen interactive devices, a multi-screen interactive device and a system proposed by the present invention send the description information of the preset multi-screen interactive protocol to the terminal through the server, and the terminal uses the same type of multi-screen interactive protocol as it supports. The description information generates response information and feeds it back to the server. The server can identify the type of multi-screen interaction protocol supported by the terminal according to the feedback information, and send corresponding control instructions to the terminal according to the type of multi-screen interaction protocol supported by the terminal. Sending different control commands according to different types of devices realizes mutual control between multi-screen interactive devices of different types of multi-screen interactive protocols, and provides convenience for users when using multi-screen interactive devices supporting different types of multi-screen interactive protocols.

Description of drawings

Fig. 1 is a connection diagram of the multi-screen interactive system of the present invention;

Fig. 2 is a schematic diagram of a terminal of the present invention logging in to a server and establishing a direct communication connection;

Fig. 3 is a schematic structural diagram of an embodiment of the control system between multi-screen interactive devices of the present invention

detailed description

The present invention is further described below in conjunction with embodiment.

Example 1

The protocol types supported by multi-screen interactive devices include DLNA, IGRS and other protocols. After comparing and analyzing the system structure and processing flow of various multi-screen interactive protocols, it is found that: multi-screen interactive devices that support the same type of multi-screen interactive protocol The control commands sent between them are the same, therefore, the multi-screen interactive devices that support the same type of multi-screen interactive protocol can recognize their own control commands, so that the multi-screen interactive devices that support the same type of multi-screen interactive protocol can communicate directly , control; while the control commands sent by multi-screen interactive devices supporting different types of multi-screen interactive protocols are different, the multi-screen interactive devices supporting different types of multi-screen interactive protocols cannot recognize their respective control commands, resulting in different Communication and control cannot be performed between multi-screen interactive devices of the screen interactive protocol type. Therefore, in the present invention, it is only necessary to first identify the types of multi-screen interactive protocols supported by the multi-screen interactive devices among the multi-screen interactive devices supporting different types of multi-screen interactive protocols, and then according to the different types of multi-screen interactive protocols supported by the multi-screen interactive devices Sending the corresponding control instructions can make the multi-screen interactive devices of different multi-screen interactive protocol types recognize the control instructions sent respectively, and realize the control between the multi-screen interactive devices of different multi-screen interactive protocol types.

As shown in the accompanying drawings 1-3, the present invention provides a multi-screen interactive system, including a server 1 and a plurality of terminals, the plurality of terminals at least include: at least one computer 2-1 to 2-n with a display screen , at least one mobile communication terminal 3-1 to 3-n with a display screen, and at least one television 4-1 to 4-n with a display screen. It is preferable to adopt a direct connection mode between each terminal of the multi-screen interactive system and the server. Preferably, said server records media resources.

An interactive system for multi-person interaction on the same screen, characterized in that the multi-screen interactive system includes: a server and multiple terminals, the server includes a sending module for sending identification information to the terminal, the identification information includes preset The description information of the multi-screen interactive protocol is provided; the receiving module is used to receive the response information fed back by the terminal according to the identification information, wherein the response information is provided by the terminal according to the identification information of the same type as that supported by the terminal. Generation of description information of the multi-screen interactive protocol; a control module, configured to obtain the type of multi-screen interactive protocol supported by the terminal according to the response information, and send corresponding control instructions to the terminal according to the type of multi-screen interactive protocol supported by the terminal The above-mentioned terminal; the terminal includes: an audio and video data transceiver module, used to send and receive audio and video data via a first channel; a control information transceiver module, used to send and receive control information via a second channel different from the first channel; the terminal also includes an application program , establish a connection between the application program and the server-side service program; complete the communication and identification information between the server and multiple terminals through a standard communication and transmission protocol, and the identification information includes a description of a preset multi-screen interactive protocol information; the server receives the response information fed back by the slave terminal according to the identification information, wherein the response information is provided by the slave terminal according to the identification information and the same type of multi-screen interaction protocol supported by the slave terminal The description information is generated; the terminal sends the relevant control command to the server, the server completes the analysis of the relevant protocol and generates the control signaling suitable for the analysis of the controlled terminal, and sends the control signaling to the controlled terminal to complete the operation of the terminal to the controlled terminal. terminal control.

Further, the server is a Digital Living Network Alliance DLNA device or an information device resource sharing collaborative service IGRS device, the terminal is an IGRS device or a DLNA device, the first channel can be a local area network, a wireless local area network, or the mobile Internet, and the second The second channel can be LAN, WLAN, mobile Internet, bluetooth or infrared.

Further, the identification information includes a DLNA data packet and an IGRS data packet, the DLNA data packet includes a DLNA description template, and the IGRS data packet includes an IGRS description template.

Furthermore, the server installs relevant platform client software through corresponding business processing platforms and terminals to realize seamless switching of content between various terminals, data association of the same content on different terminals, and association of users’ login accounts on different terminals. The communication between terminals is carried out through the server to realize terminal-to-terminal control; the business processing platform completes the analysis and processing of signaling requests initiated by different terminals in this process, and notifies the controlled terminal to complete related operations; For the unification of login accounts, the server binds the login accounts on various terminals by establishing an associated database table, so as to realize unified login authentication; the server is composed of a data association module and a user account association module, and the data association The module completes the creation of the association relationship of index files displaying content on different application terminals, and generates new index files for use by the capability support platform; the user account association module completes the association relationship of accounts used by users to log in on different application terminals Create, so that the system can automatically identify the same user logged in on different terminals.

The server first sends identification information to the terminal through Simple Service Discovery Protocol (SSDP), the identification information includes two specific types of multicast packets, DLNA data packets and IGRS data packets, wherein the DLNA data The package conforms to the protocol definition and requirements of DLNA, and the IGRS data packet conforms to the protocol definition and requirements of IGRS. And the DLNA data packet includes a DLNA description template, and the IGRS data packet includes an IGRS description template. The DLNA description template and the IGRS description template are in Extensible Markup Language (XML) format, and the DLNA description template includes server information and DLNA protocol description information; the IGRS description template includes server information and IGRS protocol description information. Wherein, the server information may include server-related information such as server name, device type, and service type. The protocol description information of DLNA and IGRS may include description information such as protocol modules and identifiers of DLNA and IGRS for reflecting the characteristics of different interactive protocols.

After receiving the two specific types of multicast packets, DLNA data packet and IGRS data packet sent by the server, the terminal first judges whether the current multi-screen interaction protocol supported by the terminal itself is the DLNA protocol or the IGRS protocol, and then tries to process the DLNA data packet. and the description template in the IGRS data packet. During the parsing process, the terminal can only parse the description template of the multi-screen interactive protocol that is the same as the type supported by the terminal itself, but cannot parse the type supported by the terminal. Description templates for different multi-screen interactive protocols. For example, if the terminal is an IGRS device and the supported multi-screen interactive protocol type is IGRS, the terminal can only parse the supported type after receiving the DLNA data packet and IGRS data packet sent by the server. The description template of the same multi-screen interaction protocol is the IGRS description template, but the DLNA description template in the DLNA data packet cannot be parsed. Further, after the terminal parses the description template of the multi-screen interactive protocol of the same type as it supports, it obtains the description information and server information of the multi-screen interactive protocol in the description template, and according to the The description information of the multi-screen interaction protocol generates response information, and the response information may include relevant description information of the multi-screen interaction protocol supported by the terminal. Then, the generated response information is fed back to the server according to the server information.

The server waits for the response information of the terminal, and judges whether the response information of the terminal is received within the preset time. A terminal that establishes a communication connection with the server and can be controlled by the server. According to the response information fed back by the terminal, the server can obtain the relevant description information of the multi-screen interactive protocol supported by the terminal, and then know the type of multi-screen interactive protocol supported by the terminal, and send a corresponding message according to the type of multi-screen interactive protocol supported by the terminal. The control instruction is sent to the terminal to realize the mutual control between the DLNA equipment and the IGRS equipment.

In one embodiment, the multi-screen interactive device is a master device, and the master device and the slave device are multi-screen interactive devices supporting different types of multi-screen interactive protocols. The multi-screen interactive device includes:

A sending module, configured to send identification information to the slave device, where the identification information includes description information of a preset multi-screen interaction protocol;

In this embodiment, firstly, the master device sends identification information including the description information of the preset multi-screen interaction protocol to the slave device, wherein the description information of the preset multi-screen interaction protocol may be the description information of all multi-screen interaction protocols, In this way, the master device can control all other slave devices of the multi-screen interactive protocol type; it can also be the description information of several multi-screen interactive protocols that the slave device needs to control. The multi-screen interactive protocol in the identification information The description information of the interaction protocol can be set in advance according to the needs of the user.

A receiving module, configured to receive response information fed back by the slave device according to the identification information, wherein the response information is provided by the slave device according to the identification information and the same type of multi-screen interaction protocol supported by the slave device generation of description information;

After sending the identification information containing the description information of the preset multi-screen interaction protocol to the slave device, the slave device can compare the multi-screen interaction protocol supported by itself with the description information containing multiple multi-screen interaction protocols in the identification information, and identify the It supports the description information of the multi-screen interactive protocol of the same type, and generates response information according to the description information of the multi-screen interactive protocol of the same type supported by itself, and feeds it back to the master device, so that the master device can know the slave through the feedback response information The type of multi-screen interaction protocol supported by the device itself. The master device receives the response information fed back from the slave device.

A control module, configured to obtain the type of multi-screen interaction protocol supported by the slave device according to the response information, and send corresponding control instructions to the slave device according to the type of multi-screen interaction protocol supported by the slave device.

Since the response information is generated by the slave device according to the same description information as the multi-screen interaction protocol type supported by itself, the master device can learn the multi-screen interaction protocol type supported by the slave device according to the response information, Then, according to the type of multi-screen interaction protocol supported by the slave device, corresponding control instructions are sent to the slave device, wherein, for slave devices supporting different types of multi-screen interaction protocols, the control instructions sent are all different, and the control instructions sent are all different. The instructions are instructions that can be recognized by slave devices supporting different types of multi-screen interaction protocols, so as to realize the control of slave devices supporting different types of multi-screen interaction protocols.

On the basis of the above system, the present invention also provides a method for realizing multi-screen interaction, which includes the following steps:

Step 1: The server application sends data packets in broadcast mode;

Step 2: The service program on the server side listens to data packets, and distinguishes whether the received data packets are sent by the application program of the terminal;

Step 3: After the terminal logs in to the server and establishes a connection with the service program on the server, a control interface is displayed on the display screen of the client, wherein the control interface has control buttons;

Step: 4: After the terminal successfully logs in, the server actively sends the terminal list of the terminal classification where the terminal is located to each successfully logged-in terminal, and the terminal list includes at least terminal identification, terminal grouping, and terminal connection status information;

Step 5: The terminal obtains the above terminal list, performs a local direct connection test with the terminals in the list, and records the direct connection status of each terminal, and the direct connection status includes normal connection and connection failure;

Step 6: The terminal communicates with other terminals according to the directly connected state, uses the control button on the control interface on the client to input a control command, and sends the control command to the server, and all the control commands on the server The service program executes corresponding operations according to the control commands, and displays corresponding pictures on the display screen of the server.

Further, said step 3 further includes:

Step 3-1: When the direct connection is normal, the terminal communicates with other terminals through the UDP protocol. When the direct connection fails, perform step 3-2:

Step 3-2: The terminal and other terminals communicate with the server through tcp, and forward the communication protocol through the server.

In one embodiment, the communication described in step 3 is screen switching communication; the screen switching communication further includes:

Step 1) The first terminal sends a screen content switching message to the second terminal;

Step 2): The second terminal stops displaying the content of its screen, performs protocol analysis according to the message of screen content switching, and obtains the video resource value sent by the first terminal according to the resolved protocol data;

Step 3): The second terminal requests the playback address of the video terminal with the optimal video bit rate from the media asset server, and opens the player to play the video content at the address.

Further, in the step 1), the method for the first terminal to send a message of screen content switching to the second terminal is:

The first terminal sends a screen content switching request to the second terminal, and the content of the request includes: the identification of the first terminal, the video resource value; or: the method for the first terminal to send a screen content switching message to the second terminal is: first The terminal directly pushes its screen content to the second terminal.

The multi-screen interaction method further includes: when the application program of the terminal is closed, sending a close command to the service program of the server; the service program of the server closes the application program of the terminal A connection with the service program on the server side; after establishing a connection between the application program on the terminal and the service program on the server side, the terminal sends a heartbeat packet to the server side at regular intervals; The server side judges whether the heartbeat packet sent by the terminal is received regularly, and if it is not received regularly, the service program on the server side closes the application program on the client side and the service program on the server side the connection between.

To sum up, the multi-screen interactive system and multi-screen interactive method of the present invention can use the application program of the client to automatically search for the server running the service program, thereby establishing a connection between the application program of the client and the service program of the server, thereby sending Control commands to realize the interaction between the client and the server. In particular, in the present invention, the hand-held smart device as the client can be used to manipulate the large-screen display device as the server to control the game, thereby realizing the interaction between the large-screen display device and the handheld smart device, and satisfying the need for family multiplayer games. The need for multiplayer participation. Those of ordinary skill in the art can understand that all or part of the processes in the methods of the above embodiments can be implemented through computer programs to instruct related hardware, and the programs can be stored in a computer-readable storage medium. During execution, it may include the processes of the embodiments of the above-mentioned methods. Wherein, the storage medium may be a magnetic disk, an optical disk, a read-only memory (Read-Only Memory, ROM) or a random access memory (Random Access Memory, RAM) and the like.

It will be apparent to those skilled in the art that the invention is not limited to the details of the above-described exemplary embodiments, but that the invention can be embodied in other specific forms without departing from the spirit or essential characteristics of the invention. Accordingly, the embodiments should be regarded in all points of view as exemplary and not restrictive, the scope of the invention being defined by the appended claims rather than the foregoing description, and it is therefore intended that the scope of the invention be defined by the appended claims rather than by the foregoing description. All changes within the meaning and range of equivalents of the elements are embraced in the present invention. Any reference sign in a claim should not be construed as limiting the claim concerned.

Claims (6)

1. An interactive system for multiple people to interact on the same screen, characterized in that the multi-screen interactive system includes: a server and a plurality of terminals, and the server includes a sending module for sending identification information to the terminal, wherein the identification information Including description information of a preset multi-screen interaction protocol; a receiving module, configured to receive response information fed back by the terminal according to the identification information, wherein the response information is provided by the terminal according to the identification information and the type supported by the terminal The description information of the same multi-screen interactive protocol is generated; the control module is used to obtain the type of multi-screen interactive protocol supported by the terminal according to the response information, and send corresponding control instructions according to the type of multi-screen interactive protocol supported by the terminal To the terminal; the terminal includes: an audio and video data transceiver module for receiving and receiving audio and video data via a first channel; a control information transceiver module for transmitting and receiving control information via a second channel different from the first channel; the terminal also includes The application program establishes a connection between the application program and the server-side service program; completes the communication and identification information between the server and multiple terminals through a standard communication and transmission protocol, and the identification information includes a preset multi-screen interactive protocol description information; the server receives the response information fed back by the slave terminal according to the identification information, wherein the response information is provided by the slave terminal according to the identification information in the same type of multi-screen support as the slave terminal The description information of the interactive protocol is generated; the terminal sends the relevant control commands to the server, the server completes the analysis of the relevant protocols and generates control signaling suitable for the controlled terminal to analyze, and sends the control signaling to the controlled terminal to complete the operation terminal. Controlled by the controlling terminal. 2. The interactive system for multi-person interaction on the same screen according to claim 1, wherein the server is a Digital Living Network Alliance DLNA device or an information device resource sharing collaborative service IGRS device, and the terminal is an IGRS device or DLNA device, the first channel may be a local area network, wireless local area network, or mobile Internet, and the second channel may be a local area network, wireless local area network, mobile Internet, Bluetooth or infrared. 3. The interactive system for multi-person interaction on the same screen according to claim 1, wherein the identification information includes a DLNA data packet and an IGRS data packet, the DLNA data packet includes a DLNA description template, and the IGRS data The package includes an IGRS description template. 4. The interactive system of multiple people interacting with the same screen according to claim 1, characterized in that, the server installs relevant platform client software through corresponding business processing platforms and terminals and realizes content between multiple terminals through terminal WEB protocols Seamless switching, data association of the same content on different terminals, association of user login accounts on different terminals, and communication between different terminals are all carried out through the server; the business processing platform completes the analysis of signaling requests initiated by different terminals in this process , process, and notify the controlled terminal to complete relevant operations; in order to realize the unification of login accounts on various terminals, the server binds the login accounts on various terminals by establishing an associated database table, so as to realize unified login authentication; The server is composed of a data association module and a user account association module. The data association module completes the establishment of the association relationship of index files displaying content on different application terminals, and generates new index files for use by the capability support platform; The user account association module completes the creation of the association relationship between the accounts used by users to log in on different application terminals, so that the system can automatically identify the same user who logs in on different terminals. 5. The method for implementing an interactive system for multi-person interaction on the same screen as claimed in claim 1, comprising the following steps: Step 1: The server application sends data packets in broadcast mode; Step 2: The service program on the server side listens to data packets, and distinguishes whether the received data packets are sent by the application program of the terminal; Step 3: After the terminal logs in to the server and establishes a connection with the service program on the server, a control interface is displayed on the display screen of the client, wherein the control interface has control buttons; Step: 4: After the terminal successfully logs in, the server actively sends the terminal list of the terminal classification where the terminal is located to each successfully logged-in terminal, and the terminal list includes at least terminal identification, terminal grouping, and terminal connection status information; Step 5: The terminal obtains the above terminal list, performs a local direct connection test with the terminals in the list, and records the direct connection status of each terminal, and the direct connection status includes normal connection and connection failure; Step 6: The terminal communicates with other terminals according to the directly connected state, uses the control button on the control interface on the client to input a control command, and sends the control command to the server, and all the control commands on the server The service program executes corresponding operations according to the control commands, and displays corresponding pictures on the display screen of the server. 6. The interactive system implementation method according to claim 5, wherein the multi-screen interactive method further comprises: when the application program of the terminal is closed, sending a close command to the service program on the server side ; The service program at the server end closes the connection between the application program at the terminal and the service program at the server end; between the application program at the terminal and the service program at the server end After the connection is established, the terminal sends a heartbeat packet to the server regularly; the server judges whether the heartbeat packet sent by the terminal is regularly received, and if it is not received regularly, the service program of the server closing the connection between the application program of the client and the service program of the server.