WO2014047935A1 - Method for implementing multimedia conference, related device and system - Google Patents

Abstract

Disclosed are a method for implementing a multimedia conference, and a related device and system. The method comprises: establishing an auxiliary stream channel with a hardware conference system; when network sharing data is received from a network conference system, converting the network sharing data into standard sharing data and sending the standard sharing data to the hardware conference system through the auxiliary stream channel, wherein the format of the standard sharing data is a video format supported by the hardware conference system; and when standard sharing data is received from the hardware conference system through the auxiliary stream channel, sending the standard sharing data to the network conference system. A conference user only needs to operate a conference terminal of the user to implement data sharing between a network conference system and a hardware conference system without causing extra operational burden to the conference user. Both the network conference system and the hardware conference system perform original operations in a conference, thereby simply and conveniently implementing a cross-system conference.

Description

 Multimedia conference implementation method, related equipment and system

 The present invention relates to the field of multimedia conferences, and in particular, to a multimedia conference implementation method, related equipment, and system. Background technique

 The current multimedia conference system includes a network conference system and a hardware conference system (such as a telepresence conference system) mainly based on an MCU (multi-control unit), and the network conference system and the hardware conference system can provide data in the system. The sharing function, that is, one party participant terminal can transmit shared data including types of document sharing data, screen sharing data, conference whiteboard sharing data, and the like to other participant terminals in the same system.

 In a hardware conferencing system, the shared data transmitted is shared data encoded in a video format. When data sharing is implemented in the hardware conference system, it is necessary to establish an auxiliary video stream channel between each participant's VP terminal (View Point Terminal, video terminal) and MCU (multi control unit), and share the data side. The VP terminal converts the VGA (Video Graphics Array) data of the computer screen into the shared data of the video format, and then sends the data to the MCU through the auxiliary stream channel between the MCU, and then the MCU and the other VP terminals. The streaming channel broadcasts the shared data to other VP terminals.

 In a network conference system, the transmitted network shared data is often not encoded in a video format, and is generally encoded in a custom non-video format. For example, for whiteboard sharing, a whiteboard operation is performed in a customized format (eg, recorded) The operating data of the laser pointer lined at a certain position). The shared data side client captures and encodes the shared data to obtain the network shared data, and broadcasts the network shared data to other clients through the web server of the web conferencing system.

 Based on the above two conference systems, if the hardware conference system and the network conference system need to be integrated, it is necessary to solve the problem of how to implement the standard shared data in the hardware conference system and the network shared data in the network conference system.

In the prior art, when the hardware conference system and the network conference system are integrated, a central control computer is separately set in the hardware conference system, and the soft client of the network conference system is installed in the central control computer and connected to the web web, and at the same time The VGA interface is connected to each VP terminal in the hardware conference system. After the conference users have reserved the conference and started the conference in both conference systems, the central control computer first joins the network conference system through the soft client of the network conference system. When a user in the hardware conference system needs to share the corresponding shared data, the user needs to open the shared data on the central control computer by using the installed soft client, and the central control computer sends the corresponding data to the server of the network conference system. The server of the network conference system forwards the corresponding data to the conference terminal of the network conference system; at the same time, the screen data of the central control computer is transmitted to the VP terminal corresponding to the user through the VGA interface, and the corresponding VP terminal converts the VGA data stream into The H.264 standard video stream is concurrently sent to the MCU of the hardware conference system, and is sent by the MCU to the VP terminal of the other hardware conference system. First, the prior art can only implement the hardware conference system to share data to the network conference system, that is, one-way sharing, and the users of the network conference system cannot share data to the hardware conference system through the conference terminal.

 Second, when the user of the hardware conference system needs to share the corresponding shared data, it needs to operate in a special central control computer, which makes the user's operation cumbersome, brings additional operational burden to the user, and has a poor conference experience. Summary of the invention

 The embodiment of the invention provides a multimedia conference implementation method, a related device and a system, and can share data between the hardware conference system and the network conference system, and avoids an additional operational burden on the user.

 In a first aspect, an embodiment of the present invention provides a multimedia conference implementation method, including: establishing an auxiliary stream channel between a hardware conference system and a hardware conference system;

 And when the network sharing data of the network conference system is received, converting the network shared data into standard shared data, and sending the standard shared data to the hardware conference system by using the auxiliary stream channel, where the standard shared data The format is a video format supported by the hardware conference system;

 And when the standard shared data of the hardware conference system is received in the auxiliary stream channel, determining that the network conference system supports the video format of the standard shared data is sent to the network conference system.

With reference to the first aspect, in a first possible implementation, the auxiliary flow channel between the establishing and the hardware conference system includes: Receiving the auxiliary stream transmission authority request to the multipoint control unit MCU of the hardware conference system when receiving the auxiliary stream authority application information of the network conference system;

 Receiving, by the multipoint control unit, the auxiliary stream address returned by the MCU in response to the auxiliary stream transmission authority request; establishing an auxiliary stream channel to the multipoint control unit MCU according to the auxiliary stream address.

 With reference to the first aspect, in a second possible implementation manner, the auxiliary flow channel between the establishing and the hardware conference system includes:

 Receiving a secondary stream address sent by the MCU of the multipoint control unit of the hardware conference system;

 Establishing an auxiliary stream channel to the multipoint control unit MCU according to the auxiliary stream address.

 With reference to the first possible implementation of the first aspect or the second possible implementation of the first aspect, in a third possible implementation, the establishing to the multiple point according to the auxiliary stream address After the auxiliary stream channel of the control unit MCU, the method further includes:

 The notification information that has been established by the auxiliary stream channel is sent to the web web server of the network conference system to notify the web web server to transmit the network share data.

 In combination with the first aspect, or the first possible implementation of the first aspect, or the second possible implementation of the first aspect, or the third possible implementation of the first aspect, in a fourth possible In an implementation manner, before the sending the standard shared data to the hardware conference system by using the pre-established auxiliary stream channel, the method further includes:

 Sending a token request to a multipoint control unit MCU of the hardware conference system to acquire a right to transmit standard shared data, and receiving a token returned by the multipoint control unit MCU in response to the token request, the token being used by the token The sender indicating the token request has the right to send standard shared data.

 With reference to the first aspect, in a fifth possible implementation, the converting the network shared data into standard shared data includes:

 Parsing the network shared data to generate an image;

 The generated image is encoded using a video format supported by the hardware conferencing system to generate the standard shared data.

 With reference to the fifth possible implementation manner of the first aspect, in a sixth possible implementation manner, the analyzing the shared data generated image of the network conference system is specifically, by using a built-in client of the network conference system Parsing the network shared data to generate an image.

In a second aspect, an embodiment of the present invention provides a multimedia conference implementation method, including: when receiving network share data sent by a conference terminal of a network conference system, to a secondary stream conversion network Transmitting the network shared data, so that the auxiliary stream switching gateway converts the network shared data into standard shared data and sends the conversion to the hardware conference system through a pre-established auxiliary stream channel with the hardware conference system Obtaining the standard shared data, where the format of the standard shared data is a video format supported by the hardware conference system;

 Receiving standard shared data of the hardware conference system to the conference terminal of the network conference system when receiving the standard shared data from the hardware conference system sent by the auxiliary stream conversion gateway, where the standard shared data of the hardware conference system is The auxiliary stream switching gateway is received from the hardware conference system through a pre-established auxiliary stream channel with the hardware conference system.

 With reference to the second aspect, in a first possible implementation manner, the establishing process of the pre-established auxiliary stream channel includes:

 Transmitting the auxiliary stream authority application information to the auxiliary stream switching gateway, so that the auxiliary stream switching gateway requests the auxiliary stream address according to the auxiliary stream authority application information to the multipoint control unit MCU in the hardware conference system, and establishes the auxiliary stream address according to the auxiliary stream address. The auxiliary stream channel of the multipoint control unit MCU;

 And receiving, by the auxiliary stream conversion gateway, notification information that has been established by the auxiliary stream channel returned by the auxiliary stream authority application information.

 With reference to the second aspect, in a second possible implementation manner, after receiving the notification information that the auxiliary stream switching gateway returns to the auxiliary stream channel returned by the auxiliary stream authority application information, the method further includes: notifying the network conference The conference terminal of the system creates a secondary stream data display window for displaying standard shared data sent by the hardware conference system.

 In a third aspect, an embodiment of the present invention provides a method for implementing a multimedia conference, including: when receiving standard shared data of a conference terminal in a hardware conference system, by using a pre-established auxiliary stream channel between the auxiliary stream and the gateway The auxiliary stream switching gateway sends the standard shared data, so that the auxiliary stream switching gateway sends the standard shared data to the network conference system;

 And transmitting the standard shared data of the auxiliary stream conversion gateway to the conference terminal in the hardware conference system when receiving the standard shared data of the auxiliary stream conversion gateway sent by the auxiliary stream channel between the auxiliary stream and the auxiliary stream conversion gateway, The standard shared data of the auxiliary stream switching gateway is obtained by converting the network shared data of the network conference system by the auxiliary stream switching gateway.

 With reference to the third aspect, in a first possible implementation manner, the auxiliary stream channel between the auxiliary stream conversion gateway and the auxiliary stream conversion gateway is pre-established, including:

Allocating a secondary stream address to the auxiliary stream switching gateway, and sending the allocated auxiliary stream address to the auxiliary stream converting a gateway, so that the auxiliary stream switching gateway establishes an auxiliary stream channel according to the auxiliary stream address.

 With reference to the first possible implementation manner of the third aspect, in a second possible implementation manner, the auxiliary stream address is allocated to the auxiliary stream switching gateway, and the auxiliary stream address is sent to the auxiliary stream Before the gateway is converted, the method further includes: receiving a secondary stream transmission permission request sent by the auxiliary stream conversion gateway;

 The allocating the secondary stream address to the auxiliary stream switching gateway, and sending the auxiliary stream address to the auxiliary stream switching gateway, includes: allocating a secondary stream to the auxiliary stream switching gateway in response to the auxiliary stream transmitting right request Addressing, and sending the auxiliary stream address to the auxiliary stream conversion gateway.

 In a fourth aspect, an embodiment of the present invention provides a secondary stream conversion gateway in a multimedia conference system, including:

 a channel establishment module, configured to establish a secondary stream channel with the hardware conference system;

 a receiving module, configured to receive network shared data of the network conference system, and configured to receive standard shared data of the hardware conference system by using the auxiliary stream channel established by the channel establishment module;

 a conversion module, configured to convert the network shared data into standard shared data when the receiving module receives the network shared data, where the format of the standard shared data is a video format supported by the hardware conference system;

 a sending module, configured to send the standard shared data converted by the conversion module to the hardware conference system by using the auxiliary stream channel established by the channel establishing module, and configured to determine, in the network conference system, the standard received by the receiving module The standard shared data is sent to the web conferencing system when the video format of the data is shared.

 With reference to the fourth aspect, in a first possible implementation manner, the channel establishing module includes: an application unit, configured to: when receiving the auxiliary stream permission application information of the network conference system, to a multipoint control unit of the hardware conference system The MCU sends a secondary stream transfer permission request;

 a receiving unit, configured to receive, by the multipoint control unit, an auxiliary stream address returned by the MCU in response to the auxiliary stream transmission authority request;

 And an establishing unit, configured to establish an auxiliary stream channel to the multi-point control unit MCU according to the auxiliary stream address received by the receiving unit.

With reference to the fourth aspect, in a second possible implementation manner, the channel establishing module includes: a receiving unit, configured to receive a secondary stream address sent by a multi-point control unit MCU of the hardware conference system; The auxiliary stream address received by the receiving unit is established to the auxiliary stream channel of the multipoint control unit MCU. With the first possible implementation of the fourth aspect, or the second possible implementation of the fourth aspect, in a third possible implementation, the sending module is further configured to send the auxiliary channel that has been established. The notification information is sent to a web server of the web conferencing system to notify the web server to transmit the network sharing data.

 With reference to the fourth aspect, or the first possible implementation manner of the fourth aspect, or the second possible implementation manner of the fourth aspect, or the third possible implementation manner of the fourth aspect, in the fourth possible In the implementation, it also includes:

 a token application module, configured to send a token request to a multipoint control unit MCU of the hardware conference system to obtain a right to send standard shared data, and receive an instruction that the multipoint control unit MCU returns in response to the token request Card, the token is used to indicate that the sender of the token request has the right to send standard shared data.

 With reference to the fourth aspect, in a fifth possible implementation, the converting module is specifically configured to parse the network shared data to generate an image, and use the video format supported by the hardware conference system to encode the generated image to generate the Standard shared data.

 With reference to the fifth possible implementation manner of the fourth aspect, in a sixth possible implementation manner, the converting module parses the shared data generated image of the network conference system, specifically by using the built-in network conference system The client parses the network shared data to generate an image.

 In a fifth aspect, the embodiment of the present invention further provides a server in a network conference system, including: a processing module, configured to: when receiving network share data sent by a conference terminal of a network conference system, to convert the gateway to the auxiliary stream Transmitting the network shared data, so that the auxiliary stream switching gateway converts the network shared data into standard shared data and sends the standard shared data to the hardware conference system through a pre-established auxiliary stream channel between the hardware conference system and the hardware conference system Converting the obtained standard shared data, where the format of the standard shared data is a video format supported by the hardware conference system;

 Receiving standard shared data of the hardware conference system from the conference terminal of the network conference system when receiving the standard shared data from the hardware conference system sent by the auxiliary stream conversion gateway, where the standard shared data of the hardware conference system is The auxiliary stream conversion gateway is received from the hardware conference system through a pre-established auxiliary stream channel between the hardware conference system.

 In combination with the fifth aspect, in the first possible implementation manner, the method further includes:

The application module is configured to send the auxiliary stream permission application information to the auxiliary stream conversion gateway, so that the auxiliary stream conversion gateway applies to the multi-point control unit MCU of the hardware conference system according to the auxiliary stream permission application information. The auxiliary stream address is used to establish a secondary stream conversion gateway to the auxiliary stream channel of the multipoint control unit MCU in the hardware conference system;

 The receiving module is configured to receive, by the auxiliary stream switching gateway, notification information that has been established by the auxiliary stream channel returned by the auxiliary stream authority application information.

 In combination with the fifth aspect, in a second possible implementation manner, the method further includes:

 The notification module is configured to: after the receiving module receives the notification information that the auxiliary stream channel has been established, notify the conference terminal of the network conference system to create a secondary stream data display window for displaying standard shared data sent by the hardware conference system.

 In a sixth aspect, the embodiment of the present invention further provides a multi-point control unit in a hardware conference system, including:

 a processing module, configured to send the standard shared data to the auxiliary stream switching gateway by using a pre-established auxiliary stream channel between the auxiliary stream switching gateway and the standard shared data of the conference terminal in the hardware conference system, to And causing the auxiliary stream conversion gateway to send the standard shared data to the network conference system; when receiving the standard shared data of the auxiliary stream conversion gateway sent through the auxiliary channel between the pre-established auxiliary stream conversion gateway, The conference terminal in the hardware conference system broadcasts the standard shared data of the auxiliary stream conversion gateway, where the standard shared data of the auxiliary stream conversion gateway is obtained by converting the network shared data of the network conference system by the auxiliary stream conversion gateway. .

 In combination with the sixth aspect, in the first possible implementation manner, the method further includes:

 And an allocation module, configured to allocate a secondary stream address to the auxiliary stream switching gateway, and send the auxiliary stream address to the auxiliary stream switching gateway to establish an auxiliary stream channel with the auxiliary stream switching gateway.

 With reference to the first possible implementation manner of the sixth aspect, in a second implementation manner, the allocating module is specifically configured to: when receiving the secondary stream transmission authority request sent by the auxiliary stream switching gateway, respond to the auxiliary stream transmission The rights request allocates a secondary stream address to the auxiliary stream switching gateway, and sends the auxiliary stream address to the auxiliary stream switching gateway.

 In a seventh aspect, the embodiment of the present invention further provides a multimedia conference implementation system, including a web server of a network conference system and at least one web conference terminal, a multipoint control unit MCU of the hardware conference system, and at least one VP terminal, and an auxiliary stream. a conversion gateway, wherein the auxiliary stream conversion gateway is connected to the web server, and the auxiliary stream conversion gateway establishes an auxiliary stream channel to the multipoint control unit MCU;

The web server, configured to receive the number of network shares sent by the at least one web conference terminal And transmitting the network shared data to the auxiliary stream switching gateway;

 The auxiliary stream switching gateway is configured to convert the network shared data into standard shared data when receiving the network shared data sent by the web server, and send the converted the obtained information to the MCU through the auxiliary stream channel. Standard shared data, the format of the standard shared data is a video format supported by the hardware conference system;

 The MCU is configured to send, to the at least one VP terminal, standard shared data converted by the auxiliary stream conversion gateway;

 The MCU is further configured to receive standard shared data sent by the at least one VP terminal, and send standard shared data of the at least one VP terminal to the auxiliary stream switching gateway;

 The auxiliary stream switching gateway is further configured to: when receiving the standard shared data sent by the MCU in the pre-established auxiliary stream channel, determine that the network conference system supports the video format of the standard shared data sent by the MCU Sending the standard shared data sent by the MCU to the web server; the web server is further configured to broadcast the standard shared data sent by the MCU to the at least one web conference terminal.

 With reference to the seventh aspect, in a first possible implementation, the auxiliary stream switching gateway is further configured to send a token request to a multipoint control unit (MCU) of the hardware conference system to obtain permission to send standard shared data, and Receiving a token returned by the multipoint control unit MCU in response to the token request, the token being used to indicate that the sender of the token request has the right to send standard shared data.

 With reference to the first possible implementation manner of the seventh aspect, in a second possible manner, the auxiliary stream switching gateway converts the network shared data into standard shared data, specifically by parsing the network shared data. And encoding, by using a video format supported by the hardware conference system, the generated image to generate the standard shared data.

 With reference to the second possible implementation manner of the seventh aspect, in a third possible implementation manner, the auxiliary stream switching gateway parses the shared data generated image of the network conference system, specifically by using the built-in network conference The client of the system parses the network shared data to generate an image.

 Embodiments of the present invention have the following beneficial effects:

The embodiment of the invention can realize the mutual sharing of data between the network conference system and the hardware conference system. Each conference user only needs to operate the conference terminal where it is located to realize the sharing of the shared data in the network conference system and the hardware conference system, and does not impose an additional operational burden on the conference user. The network conference system and the hardware conference system both perform conferences according to their original operations, and the cartridges are conveniently implemented across systems. Meeting. DRAWINGS

 1 is a schematic flowchart of a method for implementing a multimedia conference according to an embodiment of the present invention;

 2 is a schematic flow chart of a method for establishing an auxiliary stream channel according to an embodiment of the present invention;

 FIG. 3 is a schematic flowchart of another method for establishing a secondary stream channel according to an embodiment of the present invention; FIG. 4 is a schematic flowchart of another method for implementing a multimedia conference according to an embodiment of the present invention; FIG. FIG. 6 is a schematic flowchart of another specific method for implementing a multimedia conference according to an embodiment of the present invention; FIG. 7 is a schematic flowchart of still another method for implementing a multimedia conference according to an embodiment of the present invention; FIG. 8 is a schematic flowchart of still another method for implementing a multimedia conference according to an embodiment of the present invention; FIG. 9 is a schematic structural diagram of a multimedia conference implementation system according to an embodiment of the present invention;

 FIG. 10 is a schematic structural diagram of a secondary stream switching gateway in a multimedia conference system according to an embodiment of the present invention; FIG.

 11 is a schematic structural view of one of the channel establishment modules of FIG. 10;

 12 is another schematic structural diagram of the channel establishment module of FIG. 10;

 13 is a schematic structural diagram of a secondary stream conversion gateway of another multimedia conference system according to an embodiment of the present invention;

 14 is a schematic structural diagram of a server in a network conference system according to an embodiment of the present invention; and FIG. 15 is a schematic structural diagram of a multipoint control unit of a hardware conference system according to an embodiment of the present invention. detailed description

 BRIEF DESCRIPTION OF THE DRAWINGS The technical solutions in the embodiments of the present invention will be described in detail with reference to the accompanying drawings. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present invention without creative work are within the scope of the present invention.

 FIG. 1 is a schematic flowchart diagram of a method for implementing a multimedia conference according to an embodiment of the present invention. The hardware conference system in the embodiment of the present invention includes a telepresence video conference system, and the method in this embodiment includes:

S101: Establish a secondary stream channel with the hardware conference system. The secondary stream channel to the hardware conference system can be established by requesting the auxiliary stream address from the MCU of the hardware conference system, or the auxiliary stream channel of the hardware conference system can be established when receiving the auxiliary stream address directly sent by the MCU of the hardware conference system. .

 S102: Convert the network shared data into standard shared data when receiving network share data of the network conference system.

 The network shared data may be shared data encoded in a non-video format, and may be encoded in a customized non-video format. For example, for whiteboard sharing, a whiteboard operation is performed in a customized format (such as recording a laser) The operation data of the pen lined at a certain position). The format of the standard shared data is a video format supported by the hardware conference system, such as the H.264 standard video stream format.

 S103: Send the standard shared data to the hardware conference system by using the auxiliary stream channel.

S104: Send the standard shared data to the network conference system when the standard shared data of the hardware conference system is received in the auxiliary stream channel.

 Specifically, the standard shared data is sent to the network conference system when it is determined that the network conference system supports the video format of the standard shared data.

 Determining, by the network conference system, the video format of the standard shared data, specifically, determining that a video format of the standard shared data matches a video format supported by the network conference system preset, or determining The video format of the standard shared data is a video format conforming to the video codec standard (such as H.264).

 The network shared data or the standard shared data includes file sharing data, screen sharing data, meeting whiteboard sharing data, and the like. The network shared data or the standard shared data referred to in the following embodiments is the same as the content included in the network shared data or the standard shared data in this embodiment.

 In this embodiment, a corresponding auxiliary stream conversion gateway may be disposed between the hardware conference system and the network conference system, where the auxiliary stream conversion gateway is respectively connected to the MCU in the hardware conference system and the web server in the network conference system, where the auxiliary The stream conversion gateway performs the above-described S101 to S104. Of course, the S101 to S104 may also be performed by an MCU in the hardware conference system or a web server in the network conference system.

The manner in which the conference terminals in the hardware conference system, that is, the VP terminal, implements the conference connection with the MCU, and the conference connection between the web conference terminals in the network conference system and the web server are the same as the prior art. In this embodiment, The communication between the hardware conference system and the shared data of the network conference system is completed through the S101 to S104. Specifically, in the conference application section, each VP terminal in the hardware conference system sends a secondary stream request to the MCU, and the MCU sends a secondary stream address to each VP terminal in response to the auxiliary stream request, to establish a VP terminal to the MCU. a flow channel; each conference terminal in the network conference system establishes a connection to the web server; and the web server connects to the MCU through the auxiliary stream conversion gateway. The auxiliary stream switching gateway establishes an auxiliary stream channel to the MCU, so as to transmit the network shared data of the network conference system to the hardware conference system.

 When a web conference terminal in the network conference system sends the network share data, the network share data is sent to the web server, and the web server broadcasts the network share data to other web conference terminals in the network conference system, and the network is The shared data is sent to the secondary stream conversion gateway. Performing standard video stream conversion on the network shared data to obtain standard shared data, the auxiliary stream conversion gateway may convert the network shared data into a standard video stream such as H.264, and then transmit the data stream to the MCU through the auxiliary stream channel, The MCU broadcasts the converted standard shared data to each VP terminal in the hardware conference system.

 The manner in which the auxiliary stream switching gateway converts the network shared data into the standard shared data may be: parsing the network shared data to generate an image, and using the video format supported by the hardware conference system to encode the generated image to generate a standard sharing. data.

 It should be noted that after receiving the network shared data, the other web conference terminal may parse the network shared data to generate an image and display the image on the screen, specifically, through a web conference client installed on the web conference terminal. The end parses the network shared data to generate an image and displays the image on the screen.

 Specifically, the manner in which the auxiliary stream conversion gateway parses the network shared data to generate an image may be the same as the manner in which the web conference terminal parses the network shared data to generate an image. Specifically, the web of the web conference system may be built in the auxiliary stream conversion gateway. The conference client parses the network shared data to generate an image through the built-in web conference client, and encodes the image generated by the built-in web conference client into a video format supported by the hardware conference system to generate standard shared data.

 In addition, at the web conferencing terminal, a separate auxiliary stream data display window can be created to play standard shared data from the hardware conferencing system.

 The establishment of the auxiliary stream channel in the S101 is completed in the conference application phase. The manner in which the auxiliary stream switching gateway establishes the auxiliary stream channel to the MCU may be:

When receiving the auxiliary stream permission application information of the network conference system, sending it to the MCU of the hardware conference system Sending a secondary stream transmission authority request; receiving an auxiliary stream address returned by the MCU in response to the auxiliary stream transmission authority request; establishing an auxiliary stream channel to the MCU according to the auxiliary stream address;

 Or: receiving an auxiliary stream address sent by the MCU of the hardware conference system; and establishing an auxiliary stream channel to the MCU according to the auxiliary stream address. After the auxiliary stream switching gateway accesses the MCU, the MCU may directly allocate an auxiliary stream address to the auxiliary stream switching gateway and send the auxiliary stream address to the auxiliary stream switching gateway.

 In the above two manners, the secondary stream address sent by the MCU to the auxiliary stream switching gateway and the auxiliary stream address allocated by the MCU to the VP terminal are in the same address range, that is, the same address range. The VP terminal at the same location is in the same conference as the conference terminal connected to the web server currently accessed by the auxiliary stream switching gateway. The secondary stream address assigned to the gateway is in the same address domain as the secondary stream address assigned to the VP terminal, so that the network shared data sent by the web conference terminal of the network conference system can be directly transmitted to the hardware conference holding the same conference after passing through the gateway. System, the standard shared data of the hardware conference system can also be directly transmitted to the network conference system holding the same conference. The auxiliary stream address may be a certain port information of the MCU, and the VP terminal or the auxiliary stream conversion gateway may access the MCU according to the port information.

 Specifically, referring to FIG. 2, it is a schematic flowchart of a method for establishing an auxiliary stream channel according to an embodiment of the present invention. In the embodiment of the present invention, when receiving the application information of the auxiliary stream permission of the network conference system, The auxiliary stream channel of the hardware conference system, where the method specifically includes:

 S1001: When receiving the auxiliary stream permission application information of the network conference system, sending a secondary stream transmission permission request to the MCU of the hardware conference system.

 When the user who uses the network conference system wants to establish conference communication with the user of the hardware conference system, the auxiliary stream permission application information may be sent through the web conference terminal or through the web server. After receiving the auxiliary stream permission application information, the auxiliary stream switching gateway sends a request to the MCU of the hardware conference system to obtain the auxiliary stream address.

 S1002: Receive an auxiliary stream address returned by the MCU in response to the auxiliary stream transmission authority request.

 After receiving the secondary stream transfer permission request, the MCU returns the auxiliary stream address in response to the auxiliary stream transfer permission request.

 S1003: Establish an auxiliary stream channel to the MCU according to the auxiliary stream address.

 The establishment of the auxiliary stream channel can be implemented according to the prior art.

Optionally, after the auxiliary stream channel to the MCU is established, the notification message may be sent to the web server of the network conference system to notify that the auxiliary stream channel has been established, so that the web server receives and forwards the network. Share data.

 Further, please refer to FIG. 3, which is a schematic flowchart of another method for establishing an auxiliary stream channel according to an embodiment of the present invention. In the embodiment of the present invention, when an MCU of a hardware conference system allocates a secondary stream address to a VP terminal, And sending the allocated secondary stream address to the gateway to establish a gateway to the auxiliary stream channel of the hardware conference system, where the method specifically includes:

 S1011: Receive the secondary stream address sent by the MCU of the hardware conference system.

 S1012: Establish an auxiliary stream channel to the MCU according to the auxiliary stream address.

 The establishment of the auxiliary stream channel can be implemented according to the prior art.

 In this embodiment, the MCU can allocate the secondary stream address to the VP terminal of the hardware conference system, and can also allocate the secondary stream address in the same address domain to the auxiliary stream switching gateway, so as to access the auxiliary stream switching gateway. Each conference terminal and web server of the network conference system can communicate with the hardware conference system through the auxiliary stream conversion gateway.

 Alternatively, after the auxiliary stream channel to the MCU is established, the notification message may be sent to the web server of the network conference system to notify that the auxiliary stream channel has been established, so that the web server receives and forwards the network shared data.

 The embodiments of the present invention can realize mutual communication of data between the network conference system and the hardware conference system. Each conference user can share the shared data in the network conference system and the hardware conference system by simply operating the conference terminal where the conference is located, and does not impose an additional operational burden on the conference user. Both the web conferencing system and the hardware conferencing system are in accordance with their original operations, and the cross-system meeting is conveniently implemented.

 Referring to FIG. 4, it is a schematic flowchart of another method for implementing a multimedia conference according to an embodiment of the present invention. The hardware conference system in the embodiment of the present invention includes a telepresence video conference system, and the method in this embodiment specifically includes:

 S201: when receiving network share data of the network conference system, to the hardware conference system

The MCU sends a token request;

 S202: Receive a token returned by the MCU in response to the token request.

 S203: Convert the network share data of the received network conference system into standard shared data, and send the standard shared data to the hardware conference system through a pre-established auxiliary stream channel with the MCU;

In this embodiment, the network sharing data received by the network conference system needs to be sent to the hardware conference system. When sending, you need to apply for a token to get the permission to send standard shared data, and you can send standard shared data after getting the token. It should be noted that the application of the token and the time of obtaining it are short, and will not affect the transmission of the corresponding standard shared data; if the application token is unsuccessful, for example, the MCU does not return a token or the return token times out, The standard shared data of the received network conference system will be deleted or stored in the designated memory as invalid data, and will not be transmitted to the hardware conference system for broadcast to the VP terminal.

 S204: Send the standard shared data to the network conference system when the standard shared data of the hardware conference system is received in the pre-established auxiliary stream channel with the MCU.

 It should be noted that, in this embodiment, after receiving the token, performing standard video stream conversion on the network shared data received by the network conference system to obtain standard shared data, and adopting a pre-established auxiliary stream channel The standard shared data is sent to the hardware conferencing system. In other embodiments, the received network shared data may be first converted into standard shared data, that is, the data is prepared first, and then the token is applied, and after the token is received, the standard shared data that has been converted is sent.

 The embodiments of the present invention can realize mutual communication of data between the network conference system and the hardware conference system. Each conference user can share the shared data in the network conference system and the hardware conference system by simply operating the conference terminal where the conference is located, and does not impose an additional operational burden on the conference user. Both the web conferencing system and the hardware conferencing system are in accordance with their original operations, and the cross-system meeting is conveniently implemented.

 Specifically, FIG. 5 is a schematic flowchart of a method for implementing a multimedia conference according to an embodiment of the present invention. This embodiment describes a method for initiating a video conference and transmitting shared data in a network conference system. The method in this embodiment is specifically described. Includes:

 SOI: The web conference terminal sends the auxiliary stream application to the web server. When a user of the network conference system needs to establish a conference with a user of the hardware conference system, such as a telepresence video conference system, the corresponding conference application can be sent through the web conference terminal to establish a connection to the hardware conference system.

 S02: The web server forwards the auxiliary stream application to the AFGW (Auxiliary Flow Gateway). Specifically, the AFGW can embed the web conference terminal function, the data conversion function, and the embedded VP terminal function.

 S03: The AFGW sends an auxiliary stream application to the MCU.

 S04: The MCU returns an auxiliary stream address to the AFGW.

S05: The AFGW establishes an auxiliary stream channel to the MCU; and the AFGW is configured according to the auxiliary stream The address is established to the auxiliary stream channel of the MCU.

 S06: The AFGW returns the notification information that the auxiliary stream channel has been established to the web server.

 S07: The web server returns the notification information that has been established on the auxiliary stream channel to the web conference terminal, to prompt the user to enter the conference successfully.

 S08: The web conference terminal sends the network share data to the web server.

 S09: The web server sends the network shared data to the AFGW. The web server simultaneously broadcasts the network shared data to other conference terminals of the network conference system.

 S010: The AFGW sends a token request to the MCU through the auxiliary stream channel.

 SOU: The MCU returns a token to the AFGW through the auxiliary stream channel.

 The MCU may return a token to the AFGW in response to the AFGW's token request when detecting that the current hardware conference system is idle; or send the conference administrator's token transmission command to the AFGW The token is sent to the AFGW according to a preset token issuing rule, for example, when the token request of the AFGW and the token request of the VP terminal are simultaneously received, the token is preferentially sent to the AFGW.

 S012: The AFGW performs standard video stream conversion on the network shared data to obtain standard shared data. S013: Send the converted standard shared data to the MCU through the auxiliary stream channel.

 S014: The MCU broadcasts the standard shared data to the VP terminal.

 It should be noted that after the web server is added to the auxiliary stream channel of the MCU, the standard shared data of the hardware conference system can be transmitted to the web server through the auxiliary stream channel, and broadcasted by the web server to each web conference terminal.

 The embodiment of the invention can convert the network shared data in the network conference system into standard shared data suitable for the hardware conference system and send the data to the hardware conference system, thereby realizing the shared data communication between the network conference system and the hardware conference system. Moreover, each user of the network conference system can realize the sharing of the shared data from the network conference system to the hardware conference system by simply operating the conference terminal where the conference is located, and does not bring an additional operation burden to the network conference user. A cross-system meeting was achieved.

 Referring to FIG. 6, FIG. 6 is a schematic flowchart of a method for implementing a multimedia conference according to an embodiment of the present invention. This embodiment describes a method for initiating a video conference and transmitting shared data in a hardware conference system. The method in this embodiment includes:

S11: The VP terminal sends an auxiliary stream application to the MCU. Users of hardware conferencing systems need to create video At the time of the conference, the secondary stream application is sent to the MCU through the respective VP terminal.

 S12: The MCU allocates the auxiliary stream address and creates an auxiliary stream channel to the VP terminal.

 That is, the auxiliary stream channel of the VP terminal to multiple participating users is created. The MCU allocates a corresponding auxiliary stream address to each VP terminal participating in the same conference, and the auxiliary stream address allocated to each VP terminal is in the same address domain, so that the MCU broadcasts the share to the VP terminal of the same conference according to the auxiliary stream address of the VP terminal. data.

 S13: The MCU allocates a secondary stream address to the AFGW and sends the secondary stream address to the AFGW. The secondary stream address assigned by the MCU to the AFGW is also located in the address field in which the secondary stream address of the VP terminal is located.

 S14: The AFGW establishes an auxiliary stream channel to the MCU according to the auxiliary stream address.

 S15: The AFGW sends the notification information that the auxiliary stream channel has been established to the web server.

 S16: The web server sends the notification information that the auxiliary stream channel has been established to the web conference terminal. That is, the notification information that the auxiliary stream channel has been established is sent to the web conference terminal of each participant user.

 S17: The web conference terminal creates a secondary stream data display window. The auxiliary stream data display window is used to display the standard shared data sent by the hardware conference system. In the specific implementation, this step is optional, and the web conference terminal can display standard shared data in an existing video play window, for example, a commonly used video player.

 S18: The VP terminal sends standard shared data to the MCU.

 S19: The MCU sends the standard shared data to the AFGW through the auxiliary stream channel. The MCU will simultaneously broadcast the standard shared data to other VP terminals.

 S110: The AFGW sends the standard shared data to the web server.

 Sill: The web server sends the standard shared data to the web conference terminal, that is, broadcasts to each web conference terminal.

 S112: The web conference terminal displays the standard shared data in the created auxiliary stream data display window. It should be noted that after the AFGW is added to the auxiliary stream channel of the MCU, the network shared data of the web conference terminal can be transmitted to the hardware conference system in the manner described in the previous embodiment.

 The embodiment of the invention can directly send the standard shared data of the hardware conference system to the network conference system, and does not require the user to operate to the designated central control computer, thereby avoiding an additional operational burden on the user, and the hardware conference system according to itself The original operation is for meetings, and the single order facilitates cross-system meetings.

FIG. 7 is a schematic flowchart of a method for implementing a multimedia conference according to an embodiment of the present invention. In this embodiment, a method for implementing the multimedia conference is described in detail by using a network conference system, where Methods include:

 S301: Send the auxiliary stream permission application information to the auxiliary stream conversion gateway.

 Specifically, the application may be submitted by a web conference terminal or a web server in the network conference system, so that the auxiliary stream translation gateway requests the MCU in the hardware conference system to establish an auxiliary stream channel after receiving the application. The establishment of a conference connection with each web conference terminal in the web conference system and the web server can be realized by the prior art.

 S302: Receive, by the auxiliary stream switching gateway, the notification information that is established by the auxiliary stream channel returned by the auxiliary stream permission application information.

 The auxiliary stream switching gateway may complete the auxiliary stream channel of the MCU in the hardware conference system by using the method of establishing the auxiliary stream channel in the foregoing embodiments.

 In addition, after receiving the notification information that the auxiliary stream channel sent by the auxiliary stream switching gateway has been established, the notification information may be sent to all web conference terminals to notify each web conference terminal that the user of the hardware conference system can be hold a meeting. The web conferencing terminal can also create a separate auxiliary stream data display window based on the notification information to facilitate display of the standard shared data transmitted by the hardware conference terminal.

 The S301 to S302 are completed in the conference application phase. After the auxiliary stream switching gateway is added to the auxiliary stream channel of the hardware conference system, the web server in the network conference system can send the network share data of each web conference terminal to the hardware. The VP terminal of the conference system.

 S303: Send the network shared data to the auxiliary stream switching gateway when receiving the network shared data sent by the conference terminal of the conference system. And causing the auxiliary stream switching gateway to convert the network shared data into standard shared data and send the standard shared data to the hardware conferencing system through a pre-established auxiliary stream channel with the hardware conferencing system. The format of the standard shared data is a video format supported by the hardware conference system.

 When the user in the network conference system transmits the shared data including the document sharing data, the screen sharing data, the meeting whiteboard sharing data, and the like through the web conference terminal, the web conference terminal transmits the corresponding network sharing data to the web server, the web server. The data is forwarded to the auxiliary stream conversion gateway, and the auxiliary stream conversion gateway forwards the network shared data to the hardware conference system. Specifically, the auxiliary stream conversion gateway converts the network shared data into standard shared data, and then sends the data to the hardware conference. The MCU in the system is broadcast by the MCU to each VP terminal.

In addition, if the token control data transmission mode is adopted in the hardware conference system, the auxiliary stream conversion gateway also needs to apply for a token to the MCU, and after obtaining the token, convert and pass the network shared data. The auxiliary stream channel sends the converted standard shared data to the MCU.

 S304: When receiving the standard shared data from the hardware conference system sent by the auxiliary stream switching gateway, broadcast the standard shared data of the hardware conference system to the conference terminal of the conference system. The standard shared data of the hardware conference system is that the auxiliary stream conversion gateway receives the hardware conference system through a pre-established auxiliary stream channel between the hardware conference system and the hardware conference system.

 Upon receiving the standard shared data of the corresponding VP terminal in the hardware conference system sent by the auxiliary stream switching gateway, the web server broadcasts the standard shared data to each web conference terminal of the local end.

 Optionally, after the receiving, by the auxiliary stream switching gateway, the notification information that has been established by the auxiliary stream channel returned by the auxiliary stream authority application information, the method further includes: notifying the conference terminal of the network conference system to create a hardware conference for displaying The auxiliary stream data display window of the standard shared data sent by the system, after receiving the standard shared data sent by the auxiliary stream conversion gateway, the standard shared data can be displayed in the window.

 The embodiment of the invention can convert the network shared data in the network conference system into standard shared data suitable for the hardware conference system and send the data to the hardware conference system, thereby realizing the shared data communication between the network conference system and the hardware conference system. Moreover, each user of the network conference system can realize the sharing of the shared data from the network conference system to the hardware conference system by simply operating the conference terminal where the conference is located, and does not bring an additional operation burden to the network conference user. A cross-system meeting was achieved.

 FIG. 8 is a schematic flowchart of a method for implementing a multimedia conference according to an embodiment of the present invention. The method for implementing the multimedia conference is described in detail by using a hardware conference system, where the method specifically includes:

 S401: Allocating a secondary stream address to the auxiliary stream switching gateway, and sending the auxiliary stream address to the auxiliary stream switching gateway, so that the auxiliary stream switching gateway establishes an auxiliary stream channel according to the auxiliary stream address.

 The user in the hardware conference system can apply for sending a secondary stream transmission authority request to the MCU through the VP terminal to obtain a secondary stream address and establish an auxiliary stream channel to the MCU to implement standard shared data transmission and reception. After the MCU allocates the secondary stream address to the VP terminal of each conference user, it also sends the corresponding secondary stream address to the secondary stream switching gateway connected to its signal. The MCU allocates the auxiliary stream address to the VP terminal of the corresponding conference user and establishes the auxiliary stream channel, which can be implemented by using the prior art.

 In the S401, the MCU may directly allocate the auxiliary stream address to the auxiliary stream switching gateway, and send the auxiliary stream address to the auxiliary stream switching gateway; or may receive the auxiliary stream transmitting permission request sent by the auxiliary stream switching gateway, and then respond The auxiliary stream transmission authority requests to execute the S401.

Step S401 is used to establish an auxiliary stream channel in advance, after establishing the auxiliary stream channel, the network Shared data, screen sharing data, meeting whiteboard sharing data, and other types of shared data. The auxiliary stream address allocated for the VP terminal and the auxiliary stream address allocated for the auxiliary stream switching gateway are in the same address domain.

 S402: When receiving the standard shared data of the conference terminal, that is, the VP terminal in the hardware conference system, sending the standard shared data to the auxiliary stream conversion gateway by using a pre-established auxiliary stream channel between the auxiliary stream conversion gateway, So that the auxiliary stream conversion gateway sends the standard shared data to the network conference system;

 The auxiliary stream switching gateway sends the standard shared data of the conference terminal of the corresponding hardware conference system received to the web server of the network conference system, and the web server broadcasts the standard shared data to each web conference terminal. The web conferencing terminal can display the standard shared data in its established auxiliary stream data display window.

 S403: Broadcast the standard sharing of the auxiliary stream switching gateway to the conference terminal in the hardware conference system when receiving the standard shared data of the auxiliary stream switching gateway sent through the pre-established auxiliary stream channel between the auxiliary stream switching gateway Data; wherein the standard shared data of the auxiliary stream switching gateway is obtained by converting the network shared data of the network conference system by the auxiliary stream switching gateway.

 When the user in the network conference system needs to transmit the network shared data, the network sharing data is sent to the web server through the web conference terminal, and the web server sends the network shared data to the auxiliary stream conversion gateway, and the network is converted by the auxiliary stream conversion gateway. The shared data is converted to the standard shared data and then forwarded to the hardware conference system. Specifically, the auxiliary stream conversion gateway converts the network shared data into standard shared data, and then sends the data to the MCU in the hardware conference system, and the MCU broadcasts to each VP terminal. .

 In addition, if the token control transmission mode is adopted in the hardware conference system, the auxiliary stream conversion gateway needs to apply for a token to the MCU, and after obtaining the token, convert the network shared data and send the data to the MCU through the auxiliary stream channel. The converted standard shares the data.

 The embodiment of the invention can directly send the standard shared data of the hardware conference system to the network conference system, and does not require the user to operate to the designated central control computer, thereby avoiding an additional operational burden on the user, and the hardware conference system according to itself The original operation is for meetings, and the single order facilitates cross-system meetings.

The related devices and systems for implementing multimedia conferences in the embodiments of the present invention are described in detail below. FIG. 9 is a schematic structural diagram of a multimedia conference implementation system according to an embodiment of the present invention; the system in this embodiment includes: a secondary stream conversion gateway 00, a web server 11, and at least one web conference. The terminal is described by taking the web conference terminal 12 as an example. The other web conference terminals perform the same operation, and the MCU 21 and at least one VP terminal are described by taking the VP terminal 22 as an example. The other VP terminals perform the same operation.

 The web server 11 and the web conference terminal 12 are devices of the network conference system, and the MCU 21 and the VP terminal 22 are devices of the hardware conference system. The hardware conference system in the embodiment of the present invention includes a telepresence video conference system.

 The web server 11 is configured to receive network share data sent by the web conference terminal 12, and send the network share data to the auxiliary stream conversion gateway 00;

 The auxiliary stream switching gateway 00 is configured to, when receiving the network shared data sent by the web server 11, convert the network shared data into standard shared data, and send and convert the converted data to the MCU 21 through the auxiliary stream channel. The standard shares data;

 The MCU 21 is configured to send the standard shared data converted by the auxiliary stream conversion gateway 00 to the VP terminal 22;

 The MCU 21 is further configured to receive standard shared data sent by the VP terminal 22, and send the standard shared data to the auxiliary stream switching gateway 00;

 The auxiliary stream switching gateway 00 is further configured to: when receiving the standard shared data sent by the MCU 21 in the pre-established auxiliary stream channel, determining that the network conference system supports the video of the standard shared data sent by the MCU Formatting the standard shared data sent by the MCU to the web server 11;

 The web server 11 is further configured to send the standard shared data sent by the MCU to the web conference terminal 12.

 Further, the auxiliary stream switching gateway 00 is further configured to send a token request to the MCU 21 to obtain a right to send standard shared data, and receive a token returned by the MCU in response to the token request, where The token is used to indicate that the sender of the token request has permission to send standard shared data.

The auxiliary stream switching gateway 00 may send a token request to the MCU 21 after receiving the network sharing data of the web server 11, and after receiving the token returned by the MCU 21 in response to the token request, the network sharing is performed. The data conversion is sent to the MCU 21 by the standard shared data, or after receiving the network shared data of the web server 11, the network shared data is converted into standard shared data, and then the token request is sent to the MCU 21 of the hardware conference system, and is received. After the MCU 21 responds to the token returned by the token request, the standard shared data obtained by converting the network shared data is sent to MCU21.

 The manner in which the auxiliary stream switching gateway 00 converts the network shared data into standard shared data may be: parsing the network shared data to generate an image, and encoding the generated image by using a video format supported by the hardware conference system. Share data.

 It should be noted that after receiving the network shared data, the web conference terminal 12 may parse the network shared data to generate an image and display the image on the screen, specifically, through a web conference installed on the web conference terminal 12. The client parses the network shared data to generate an image and displays the image on the screen.

 Specifically, the manner in which the auxiliary stream conversion gateway 00 parses the network shared data to generate an image may be the same as the manner in which the web conference terminal 12 parses the network shared data to generate an image. Specifically, the web conference may be built in the auxiliary stream conversion gateway 00. The web conference client of the system parses the network shared data to generate an image through the built-in web conference client, and encodes the image generated by the built-in web conference client into a video format supported by the hardware conference system to generate standard shared data.

 Specifically, FIG. 10 is a schematic structural diagram of a secondary stream switching gateway in a multimedia conference system according to an embodiment of the present invention. The auxiliary stream switching gateway in the embodiment of the present invention may be a secondary stream in the foregoing system embodiment. Convert gateway 00. The auxiliary stream switching gateway includes: a channel establishing module 000, a receiving module 001, a converting module 002, and a sending module 003, where

 The channel establishment module 000 is configured to establish an auxiliary stream channel with the hardware conference system.

 The receiving module 001 is configured to receive network shared data of the network conference system, and is configured to receive standard shared data of the hardware conference system by using the auxiliary stream channel established by the channel establishment module 000;

 The conversion module 002 is configured to convert the network shared data execution standard video stream into standard shared data when the receiving module receives the network shared data, where the format of the standard shared data is supported by the hardware conference system Video format;

 The sending module 003 is configured to send the standard shared data converted by the converting module to the hardware conference system by using the auxiliary stream channel established by the channel establishing module 000, and configured to determine that the network conferencing system supports the receiving module The standard shared data is sent to the network conference system when the video format of the standard shared data is received by 001.

In this embodiment, the manner in which the conference terminals, that is, the VP terminals in the hardware conference system, implement the conference connection with the MCU, and the manner in which the web conference terminals in the network conference system implement the conference connection with the web server are the same as the prior art. The embodiment establishes module 000 through the channel, and receives module 001, The conversion module 002 and the sending module 003 complete the interworking of the shared data between the hardware conference system and the network conference system.

 When a web conference terminal in the network conference system sends network sharing data including document sharing data, screen sharing data, and conference whiteboard sharing data, the network sharing data is sent to the web server, and the web server broadcasts the network sharing data to the network. Other web conference terminals in the conference system, and send the network shared data to the gateway. The conversion module 002 can convert the network shared data into a standard video stream such as H.264, and then transmit the data to the MCU through the auxiliary stream channel, and the MCU broadcasts the converted standard shared data to each VP in the hardware conference system. terminal.

 In addition, at the web conferencing terminal, a separate auxiliary stream data display window can be created to play standard shared data from the hardware conferencing system.

 The auxiliary stream channel is completed during the conference application phase. The auxiliary stream channel may be configured to: when receiving the auxiliary stream permission application information of the web server, apply to the MCU for the auxiliary stream address (send the auxiliary stream transmission permission request), and establish the request to the MCU according to the auxiliary stream address returned by the MCU. Or the auxiliary stream address that is directly allocated to the auxiliary stream switching gateway by the MCU, and the auxiliary stream address allocated by the MCU is established to the auxiliary stream channel of the MCU.

 The embodiments of the present invention can realize mutual communication of data between the network conference system and the hardware conference system. Each conference user can share the shared data in the network conference system and the hardware conference system by simply operating the conference terminal where the conference is located, and does not impose an additional operational burden on the conference user. Both the web conferencing system and the hardware conferencing system are in accordance with their original operations, and the cross-system meeting is conveniently implemented.

 For details, please refer to FIG. 11 , which is a schematic structural diagram of a channel establishing module in FIG. 10 . The channel establishing module 000 includes:

 The application unit 0041 is configured to send a secondary stream transmission permission request to the MCU of the hardware conference system when receiving the auxiliary stream authority application information of the network conference system;

 The receiving unit 0042 is configured to receive an auxiliary stream address that is returned by the MCU in response to the auxiliary stream transmission authority request;

 The establishing unit 0043 is configured to establish an auxiliary stream channel to the MCU according to the auxiliary stream address received by the receiving unit 0042.

When the user who uses the network conference system wishes to establish conference communication with the user of the hardware conference system, the auxiliary stream authority application information may be sent through the web conference terminal or through the web server. Auxiliary flow conversion network After receiving the auxiliary stream permission application information, the device sends a request to the MCU of the hardware conference system to obtain the auxiliary stream address.

 After receiving the auxiliary stream transmission permission request, the MCU returns the auxiliary stream address to the auxiliary stream conversion gateway in response to the auxiliary stream transmission authority request.

 Optionally, after the establishing unit 0043 establishes the auxiliary stream channel to the MCU, the notification message may be sent to the web server of the network conference system to notify that the auxiliary stream channel has been established, so that the web server receives and forwards the network shared data. .

 Alternatively, the channel establishing module may also be the structure shown in FIG. 12, including:

 a receiving unit 0044, configured to receive a secondary stream address sent by the MCU of the hardware conference system, and an establishing unit 0045, configured to establish an auxiliary stream channel to the MCU according to the auxiliary stream address received by the receiving unit 0044; The secondary stream address includes an auxiliary stream address allocated by the MCU to the conference terminal of the hardware conference system.

 Alternatively, after the establishing unit 0045 establishes the auxiliary stream channel to the MCU, the notification message may be sent to the web server of the network conference system to notify that the auxiliary stream channel has been established, so that the web server receives and forwards the network share. data.

 Further, referring to FIG. 13, FIG. 13 is a schematic structural diagram of a secondary stream switching gateway in another multimedia conference system according to an embodiment of the present invention. The auxiliary stream switching gateway in the embodiment includes the foregoing embodiment in FIG. The receiving module 001, the converting module 002, the sending module 003, and the channel establishing module 000. Further, in the embodiment of the present invention, the auxiliary stream switching gateway further includes:

 a token application module 005, configured to send a token request to an MCU of the hardware conference system to obtain a right to send standard shared data, and receive a token returned by the MCU in response to the token request, where the token is used by the token The sender indicating the token request has the right to send standard shared data.

 In this embodiment, when the network sharing data is sent to the hardware conference system, the auxiliary stream switching gateway needs to apply for a token through the token application module 005 to obtain the permission to send the network shared data, and the token can be sent after the token is obtained. Network sharing data. It should be noted that the application of the token and the time of obtaining it are short, and will not affect the transmission of the corresponding network shared data; if the application token is unsuccessful, for example, the MCU does not return a token or the return token times out. The network share data of the network conference system received this time will be deleted or stored as invalid data in the designated memory, and will not be transmitted to the hardware conference system for broadcast to the VP terminal.

After obtaining the token, sending the notification information to notify the conversion module 002, by the conversion module 002 completes the conversion of the network shared data, and sends the converted standard shared data through the sending module 003. Of course, in other embodiments, the conversion of the network shared data may be completed by the conversion module 002, and then the MCU applies for a token, and after the token is obtained, the converted standard shared data is sent by the sending module 003.

 Further, after the channel establishment module 000 is established to the auxiliary stream channel of the MCU, the sending module 003 is further configured to send the notification information that has been established on the auxiliary stream channel to the web server of the network conference system to notify the web. The server transmits network share data. That is, the web server needs to be notified that the communication connection has been established with the hardware conference system, and if the channel establishment module 000 does not complete the establishment of the auxiliary stream channel to the MCU, the notification information of the connection failure may also be sent to the web server. In order to facilitate the connection of the user of the network conference system, the user can perform the reconnection operation.

 In addition, the conversion module 002 is specifically configured to parse the network shared data to generate an image, and encode the generated image by using a video format supported by the hardware conference system to generate the standard shared data. Specifically, for example, the converting The module 002 parses the shared data generation image of the network conference system, specifically, by using the built-in client of the network conference system to parse the network shared data to generate an image.

 The embodiments of the present invention can realize mutual communication of data between the network conference system and the hardware conference system. Each conference user can share the shared data in the network conference system and the hardware conference system by simply operating the conference terminal where the conference is located, and does not impose an additional operational burden on the conference user. Both the web conferencing system and the hardware conferencing system are in accordance with their original operations, and the cross-system meeting is conveniently implemented.

 Referring to FIG. 14, FIG. 14 is a schematic structural diagram of a server in a network conference system according to an embodiment of the present invention. The server in this embodiment may be the web server 11 in the foregoing system embodiment, which is described in this embodiment. The server includes:

 The processing module 111 is configured to: when receiving the network shared data sent by the conference terminal of the network conference system, send the network shared data to the auxiliary stream switching gateway, so that the auxiliary stream switching gateway shares the data with the network Converting to standard shared data and transmitting the standard shared data to the hardware conference system through a pre-established auxiliary stream channel between the hardware conference system, the format of the standard shared data being the hardware conference The video format supported by the system;

Receiving standard shared data of the hardware conference system to the conference terminal of the network conference system when receiving the standard shared data from the hardware conference system sent by the auxiliary stream conversion gateway, The standard shared data of the hardware conference system is that the auxiliary stream conversion gateway is received from the hardware conference system through a pre-established auxiliary stream channel between the hardware conference system and the hardware conference system.

 Further, referring to FIG. 14, the server in the network conference system may further include: an application module 112, configured to send, to the auxiliary stream switching gateway, the auxiliary stream permission application information, so that the auxiliary stream conversion gateway is configured according to the Applying the auxiliary stream permission application information to the MCU of the hardware conference system to apply the auxiliary stream address to establish the auxiliary stream conversion gateway to the auxiliary stream channel of the MCU in the hardware conference system;

 The receiving module 113 is configured to receive, by the auxiliary stream switching gateway, notification information that has been established by the auxiliary stream channel returned by the auxiliary stream authority application information.

 The auxiliary stream switching gateway may be the auxiliary stream switching gateway 00 in the multimedia conference system of the foregoing embodiment, and the manner of establishing the auxiliary stream channel is also the same as the manner of establishing the auxiliary stream channel by the auxiliary stream switching gateway in the multimedia conference system.

 When the user in the network conference system transmits the network shared data through the web conference terminal, the web conference terminal transmits the corresponding network share data to the web server, and the processing module 111 of the web server forwards the network share data to the auxiliary stream. The conversion gateway forwards the network shared data to the hardware conference system by the auxiliary stream conversion gateway. Specifically, the auxiliary stream conversion gateway converts the network shared data into standard shared data and sends the data to the MCU in the hardware conference system. The MCU broadcasts to each VP terminal to complete document sharing.

 In addition, if the token control transmission mode is adopted in the hardware conference system, after receiving the network shared data, the auxiliary stream conversion gateway needs to apply for a token to the MCU, and after acquiring the token, share data with the network. The conversion is performed and the converted standard shared data is sent to the MCU through the auxiliary stream channel.

 Upon receiving the standard shared data of the corresponding VP terminal in the hardware conference system sent by the auxiliary stream switching gateway, the web server broadcasts the standard shared data to each web conference terminal of the local end.

 Further, referring to FIG. 14, the server in the network conference system may further include: a notification module 114, configured to notify the conference of the network conference system after the receiving module receives the notification information that the auxiliary stream channel has been established. The terminal creates a secondary stream data display window for displaying standard shared data sent by the hardware conference system.

After receiving the notification information that the auxiliary stream channel sent by the auxiliary stream switching gateway has been established, the server in the network conference system may also send the notification information to all web conference terminals to notify each web conference terminal that the hardware can be connected to the hardware. Users of the conference system hold meetings. The web conference terminal can create a separate auxiliary stream data display window according to the notification information to facilitate display of the standard of the hardware conference terminal transmission. Enjoy the data.

 The embodiments of the present invention can realize mutual communication of data between the network conference system and the hardware conference system. Each conference user can share the shared data in the network conference system and the hardware conference system by simply operating the conference terminal where the conference is located, and does not impose an additional operational burden on the conference user. Both the web conferencing system and the hardware conferencing system are in accordance with their original operations, and the cross-system meeting is conveniently implemented.

 Referring to FIG. 15, FIG. 15 is a schematic structural diagram of a multipoint control unit in a hardware conference system according to an embodiment of the present invention. The multipoint control unit in this embodiment is the MCU 21 of the system embodiment, and the multipoint control unit includes:

 The processing module 214 is configured to send the standard sharing to the auxiliary stream switching gateway by using a pre-established auxiliary stream channel between the auxiliary stream switching gateway and the standard shared data of the conference terminal in the hardware conference system. Data, so that the auxiliary stream conversion gateway sends the standard shared data to the network conference system;

 And transmitting the standard shared data of the auxiliary stream conversion gateway to the conference terminal in the hardware conference system when receiving the standard shared data of the auxiliary stream conversion gateway sent by the auxiliary stream channel between the auxiliary stream and the auxiliary stream conversion gateway, The standard shared data of the auxiliary stream switching gateway is obtained by converting the network shared data of the network conference system by the auxiliary stream switching gateway.

 For further details, referring to FIG. 15, the multi-point control unit further includes: an allocating module 212. The allocating module 212 is configured to allocate a secondary stream address to the auxiliary stream switching gateway, and send the auxiliary stream address to the auxiliary stream switching gateway to establish a secondary circulation with the auxiliary stream switching gateway. Road.

 The user in the hardware conference system can apply for sending a secondary stream request to the MCU through the VP terminal to establish a secondary stream channel to the MCU, and implement standard data transmission and reception. After the MCU allocates the secondary stream address to the VP terminal of each conference user through the allocation module 212, the MCU also allocates the secondary stream address to the secondary stream switching gateway connected to the signal. Of course, the allocating module 212 may also allocate an auxiliary stream address to the auxiliary stream switching gateway in response to the auxiliary stream transmitting right request when receiving the auxiliary stream transmitting right request sent by the auxiliary stream switching gateway, and The secondary stream address is sent to the secondary stream switching gateway.

The embodiment of the invention can directly send the standard shared data of the hardware conference system to the network conference system, and does not require the user to operate to the designated central control computer, thereby avoiding an additional operational burden on the user, and the hardware conference system according to itself The original operation is for meetings, and the single order facilitates cross-system meetings. The embodiment of the present invention further provides a secondary stream switching gateway in another multimedia conference system, where the auxiliary stream switching gateway includes: a receiver, a transmitter, and a processor, where the processor specifically performs the following steps:

 Establish a secondary stream channel with the hardware conference system;

 Transmitting the network shared data into standard shared data when the receiver receives network share data of the network conference system, and controlling the transmitter to send the standard to the hardware conference system through the auxiliary stream channel Sharing data, the format of the standard shared data is a video format supported by the hardware conference system;

 And when the receiver receives the standard shared data of the hardware conference system in the auxiliary stream channel, determining that the network conference system supports the video format of the standard shared data, and controlling the transmitter to send the standard shared data To the web conferencing system.

 In a possible implementation manner of the present invention, the manner in which the processor establishes the auxiliary stream channel includes: controlling, when the receiver receives the auxiliary stream authority application information of the network conference system, the transmitter to the hardware conference The MCU of the system sends a secondary stream transmission permission request;

 And when the receiver receives the secondary stream address returned by the MCU in response to the auxiliary stream transmission authority request, establishing an auxiliary stream channel to the MCU according to the auxiliary stream address.

 In another possible implementation manner of the present invention, the manner in which the processor establishes the auxiliary stream channel includes: establishing, according to the auxiliary stream address, when the receiver receives the auxiliary stream address sent by the MCU of the hardware conference system To the auxiliary stream channel of the MCU.

 In still another possible implementation manner of the present invention, after performing the step of establishing an auxiliary stream channel to the MCU according to the auxiliary stream address, the processor further performs the following steps: controlling the transmitter to send a secondary device The flow channel has established notification information to the network web server of the network conference system to notify the network web server to transmit the network share data.

 In still another possible implementation manner of the present invention, before the step of transmitting the standard shared data to the hardware conference system through the pre-established auxiliary stream channel, the processor further performs the following steps: controlling the transmitter Sending a token request to an MCU of the hardware conference system to obtain a right to transmit standard shared data, and receiving, by the receiver, a token returned by the MCU in response to the token request, the token being used to indicate The sender of the token request has the right to send standard shared data.

In still another possible implementation manner of the present invention, the performing, by the processor, converting the network shared data into standard shared data includes: parsing the network shared data to generate an image; using the hardware The video format supported by the conference system encodes the generated image to generate the standard shared data.

 In another possible implementation manner of the embodiment of the present invention, the processor performs parsing the shared data generation image of the network conference system, specifically, parsing the network share by using a client of the network conference system built in The data is generated as an image.

 The embodiments of the present invention can realize mutual communication of data between the network conference system and the hardware conference system. Each conference user can share the shared data in the network conference system and the hardware conference system by simply operating the conference terminal where the conference is located, and does not impose an additional operational burden on the conference user. Both the web conferencing system and the hardware conferencing system are in accordance with their original operations, and the cross-system meeting is conveniently implemented.

 The embodiment of the present invention further provides a server in another network conference system, where the server may include a transmitter, a receiver, and a processor, where the processor performs the following steps:

 And when the receiver receives the network shared data sent by the conference terminal of the network conference system, the transmitter is controlled to send the network shared data to the auxiliary stream conversion gateway, so that the auxiliary stream conversion gateway shares the network Transmitting the data into standard shared data and transmitting the converted standard shared data to the hardware conference system through a pre-established auxiliary stream channel with the hardware conference system, where the format of the standard shared data is the hardware conference system Supported video formats;

 And when the receiver receives the standard shared data from the hardware conference system sent by the auxiliary stream switching gateway, controlling the transmitter to broadcast the standard shared data of the hardware conference system to the conference terminal of the conference system, where the hardware conference The standard shared data of the system is that the auxiliary stream conversion gateway is received from the hardware conference system through a pre-established auxiliary stream channel between the hardware conference system and the hardware conference system.

 In a possible implementation manner of the present invention, the processor performing the auxiliary stream channel between the pre-established and hardware conference system includes:

 Controlling, by the transmitter, the auxiliary stream permission application information to the auxiliary stream switching gateway, so that the auxiliary stream switching gateway requests the auxiliary stream address according to the auxiliary stream permission application request to the MCU in the hardware conference system, and establishes the auxiliary stream address according to the auxiliary stream address. An auxiliary stream channel to the MCU;

 And controlling, by the receiver, the notification information that the auxiliary stream conversion gateway has established that the auxiliary stream channel returned by the auxiliary stream permission application information is established.

In another possible implementation manner of the present invention, the processor controls the receiver to receive, after receiving the notification information that the auxiliary stream conversion gateway returns the auxiliary stream channel returned by the auxiliary stream authority application information, Perform the following steps: Inform the conference terminal of the network conference system to create a hardware conference. The auxiliary stream data display window of the standard shared data sent by the system.

 The embodiment of the invention can convert the network shared data in the network conference system into standard shared data suitable for the hardware conference system and send the data to the hardware conference system, thereby realizing the shared data communication between the network conference system and the hardware conference system. Moreover, each user of the network conference system can realize the sharing of the shared data from the network conference system to the hardware conference system by simply operating the conference terminal where the conference is located, and does not bring an additional operation burden to the network conference user. A cross-system meeting was achieved.

 The embodiment of the present invention further provides an MCU in another hardware conference system, where the MCU includes a transmitter, a receiver, and a processor, where the processor performs the following steps:

 And when the receiver receives the standard shared data of the conference terminal in the hardware conference system, sending the standard shared data to the auxiliary stream conversion gateway by using a pre-established auxiliary stream channel between the auxiliary stream conversion gateway, so that the The auxiliary stream conversion gateway sends the standard shared data to the network conference system;

 Controlling, by the receiver, the standard shared data transmitted by the auxiliary stream switching gateway sent by the auxiliary stream channel between the auxiliary stream switching gateway and the pre-established switch to the conference terminal in the hardware conference system The standard shared data, wherein the standard shared data of the auxiliary stream switching gateway is obtained by converting the network shared data of the network conference system by the auxiliary stream switching gateway.

 In a possible implementation manner of the present invention, the performing, by the processor, the auxiliary stream channel between the pre-established and auxiliary stream switching gateways includes:

 Allocating a secondary stream address to the auxiliary stream switching gateway, and controlling the transmitter to send the auxiliary stream address to the auxiliary stream switching gateway, so that the auxiliary stream switching gateway establishes auxiliary circulation according to the auxiliary stream address Road.

 In another possible implementation manner of the present invention, the processor performs to allocate a secondary stream address to the auxiliary stream switching gateway, and controls the transmitter to send the auxiliary stream address to the auxiliary stream switching gateway. Before the step of receiving, by the receiver, the auxiliary stream transfer permission request of the auxiliary stream conversion gateway, responding to the auxiliary stream transfer permission request, assigning the auxiliary stream address to the auxiliary stream conversion gateway, and controlling the The transmitter sends the secondary stream address to the secondary stream switching gateway.

 The embodiment of the invention can directly send the standard shared data of the hardware conference system to the network conference system, and does not require the user to operate to the designated central control computer, thereby avoiding an additional operational burden on the user, and the hardware conference system according to itself The original operation is for meetings, and the single order facilitates cross-system meetings.

One of ordinary skill in the art can understand all or part of the process in implementing the above embodiments. It can be accomplished by a computer program instructing associated hardware, which can be stored in a computer readable storage medium, which, when executed, can include the flow of an embodiment of the methods described above. The storage medium may be a magnetic disk, an optical disk, a read-only memory (ROM), or a random access memory (RAM).

 The above is only the preferred embodiment of the present invention, and the scope of the present invention is not limited thereto, and the equivalent changes made by the claims of the present invention are still within the scope of the present invention.

Claims

Rights request 1. A multimedia conference implementation method, characterized by including: Establish an auxiliary flow channel with the hardware conference system; When receiving network shared data from the network conference system, convert the network shared data into standard shared data, and send the standard shared data to the hardware conference system through the auxiliary stream channel, where the standard shared data The format is a video format supported by the hardware conference system; When the standard shared data of the hardware conferencing system is received in the auxiliary stream channel, it is determined that the network conferencing system supports the video format of the standard shared data and the standard shared data is sent to the network conferencing system. 2. The method of claim 1, wherein establishing the auxiliary stream channel with the hardware conference system includes: When receiving the auxiliary stream permission application information of the network conference system, send the auxiliary stream transmission permission request to the multi-point control unit MCU of the hardware conference system; Receive the auxiliary stream address returned by the multi-point control unit MCU in response to the auxiliary stream transmission permission request; establish an auxiliary stream channel to the multi-point control unit MCU according to the auxiliary stream address. 3. The method of claim 1, wherein establishing the auxiliary stream channel with the hardware conference system includes: Receive the auxiliary stream address sent by the multi-point control unit MCU of the hardware conference system; Establish an auxiliary stream channel to the multi-point control unit MCU according to the auxiliary stream address. 4. The method according to claim 2 or 3, characterized in that, after establishing the auxiliary stream channel to the multi-point control unit MCU according to the auxiliary stream address, it further includes: Send the notification information that the auxiliary stream channel has been established to the network web server of the network conference system to notify the network web server to transmit the network shared data. 5. The method according to any one of claims 1 to 4, characterized in that, before sending the standard shared data to the hardware conference system through the auxiliary stream channel, it further includes: Send a token request to the multi-point control unit MCU of the hardware conference system to obtain the authority to send standard shared data, and receive the token returned by the multi-point control unit MCU in response to the token request, where the token is used Indicates that the sender of the token request has the authority to send standard shared data. 6. The method of claim 1, wherein converting the network shared data into standard shared data includes: Analyze the network shared data to generate an image; The generated image is encoded using the video format supported by the hardware conference system to generate the standard shared data. 7. The method of claim 6, wherein the step of parsing the shared data of the network conferencing system to generate an image is to parse the network shared data to generate an image through a built-in client of the network conferencing system. . 8. A multimedia conference implementation method, characterized by including: When receiving the network shared data sent by the conference terminal of the network conferencing system, the network shared data is sent to the auxiliary stream conversion gateway, so that the auxiliary stream conversion gateway converts the network shared data into standard shared data and passes it through the pre- The established auxiliary stream channel with the hardware conference system sends the converted standard shared data to the hardware conference system, and the format of the standard shared data is a video format supported by the hardware conference system; When receiving the standard shared data from the hardware conference system sent by the auxiliary stream conversion gateway, the standard shared data of the hardware conference system is broadcast to the conference terminal of the network conference system, and the standard shared data of the hardware conference system is the The auxiliary stream conversion gateway receives the auxiliary stream from the hardware conference system through a pre-established auxiliary stream channel with the hardware conference system. 9. The method of claim 8, wherein the establishment process of the pre-established auxiliary flow channel includes: Send the auxiliary stream permission application information to the auxiliary stream conversion gateway, so that the auxiliary stream conversion gateway requests the auxiliary stream address from the multi-point control unit MCU in the hardware conference system according to the auxiliary stream permission application information and establishes the auxiliary stream address according to the auxiliary stream address. The auxiliary flow channel of the multi-point control unit MCU; Receive notification information that the auxiliary stream channel has been established returned by the auxiliary stream conversion gateway in response to the auxiliary stream permission application information. 10. The method of claim 9, wherein after receiving the notification information that the auxiliary stream channel has been established returned by the auxiliary stream conversion gateway in response to the auxiliary stream permission application information, the method further includes: notifying a network conference The conference terminal of the system creates an auxiliary stream data display window for displaying standard shared data sent by the hardware conference system. 11. A multimedia conference implementation method, characterized by including: When receiving the standard shared data of the conference terminal in the hardware conference system, the standard shared data is sent to the auxiliary stream conversion gateway through the pre-established auxiliary stream channel with the auxiliary stream conversion gateway, so that the auxiliary stream conversion gateway Send the standard shared data to the network conferencing system; When receiving the standard shared data of the auxiliary stream conversion gateway sent through the pre-established auxiliary stream channel between the auxiliary stream conversion gateway, broadcasting the standard shared data of the auxiliary stream conversion gateway to the conference terminal in the hardware conference system, Wherein, the standard shared data of the auxiliary stream conversion gateway is obtained by converting the network shared data of the network conference system by the auxiliary stream conversion gateway. 12. The method of claim 11, wherein pre-establishing an auxiliary stream channel with the auxiliary stream conversion gateway includes: Allocate a auxiliary stream address to the auxiliary stream conversion gateway, and send the auxiliary stream address to the auxiliary stream conversion gateway, so that the auxiliary stream conversion gateway establishes a auxiliary stream channel according to the auxiliary stream address. 13. The method of claim 12, characterized in that, Before allocating a auxiliary stream address to the auxiliary stream conversion gateway and sending the auxiliary stream address to the auxiliary stream conversion gateway, the method further includes: receiving a auxiliary stream transmission permission request sent by the auxiliary stream conversion gateway; Allocating a auxiliary stream address to the auxiliary stream conversion gateway, and sending the auxiliary stream address to the auxiliary stream conversion gateway, includes: allocating a auxiliary stream address to the auxiliary stream conversion gateway in response to the auxiliary stream transmission permission request, and sends the auxiliary stream address to the auxiliary stream conversion gateway. 14. A auxiliary stream conversion gateway in a multimedia conference system, which is characterized by including: The channel establishment module is used to establish the auxiliary flow channel with the hardware conference system; A receiving module, configured to receive network shared data of the network conferencing system, and used to receive standard shared data of the hardware conferencing system through the auxiliary stream channel established by the channel establishing module; A conversion module configured to convert the network shared data into standard shared data when the receiving module receives the network shared data, and the format of the standard shared data is a video format supported by the hardware conference system; A sending module, configured to send the standard shared data converted by the conversion module to the hardware conference system through the auxiliary stream channel established by the channel establishment module, and used to determine that the network conference system supports the standard received by the receiving module. The standard shared data is sent to the network conferencing system when the video format of the shared data is shared. 15. The auxiliary stream conversion gateway according to claim 14, characterized in that the channel establishment module includes: The application unit is configured to send an auxiliary stream transmission permission request to the multi-point control unit MCU of the hardware conference system when receiving the auxiliary stream permission application information of the network conference system; A receiving unit, configured to receive the auxiliary stream address returned by the multi-point control unit MCU in response to the auxiliary stream transmission permission request; An establishing unit, configured to establish an auxiliary stream channel to the multi-point control unit MCU according to the auxiliary stream address received by the receiving unit. 16. The auxiliary stream conversion gateway according to claim 14, characterized in that the channel establishment module includes: The receiving unit is used to receive the auxiliary stream address sent by the multi-point control unit MCU of the hardware conference system; the establishing unit is used to establish the auxiliary stream channel to the multi-point control unit MCU according to the auxiliary stream address received by the receiving unit. . 17. The auxiliary stream conversion gateway according to claim 15 or 16, characterized in that, The sending module is also configured to send notification information that the auxiliary stream channel has been established to the web server of the network conferencing system, so as to notify the web server to transmit network sharing data. 18. The auxiliary stream conversion gateway according to any one of claims 14 to 17, further comprising: a token application module, configured to send a token request to the multi-point control unit MCU of the hardware conference system to Obtain the authority to send standard shared data, and receive the token returned by the multi-point control unit MCU in response to the token request. The token is used to indicate that the sender of the token request has the authority to send standard shared data. . 19. The auxiliary stream conversion gateway according to claim 14, characterized in that the conversion module is specifically used to parse the network shared data to generate images, and use the video format supported by the hardware conference system to encode the generated images. Generate the standard shared data. 20. The method of claim 19, wherein the conversion module parses the shared data of the network conferencing system to generate an image specifically by parsing the network shared data through a built-in client of the network conferencing system. image. 21. A server in a network conference system, characterized by including: A processing module configured to, when receiving the network sharing data sent by the conference terminal of the network conferencing system, send the network sharing data to the auxiliary stream conversion gateway, so that the auxiliary stream conversion gateway converts the network sharing data. Sharing data for standards and sending the converted standard shared data to the hardware conference system through a pre-established auxiliary stream channel with the hardware conference system. The format of the standard shared data is that of the hardware conference system. Supported video formats; When receiving the standard shared data from the hardware conference system sent by the auxiliary stream conversion gateway, the standard shared data of the hardware conference system is broadcast to the conference terminal of the network conference system, and the standard shared data of the hardware conference system is The auxiliary stream conversion gateway receives the auxiliary stream from the hardware conference system through a pre-established auxiliary stream channel with the hardware conference system. 22. The server of claim 21, further comprising: The application module is configured to send the auxiliary stream permission application information to the auxiliary stream conversion gateway, so that the auxiliary stream conversion gateway applies for the auxiliary stream address to the multi-point control unit MCU of the hardware conference system according to the auxiliary stream permission application information to establish the auxiliary stream address. The auxiliary stream channel from the stream conversion gateway to the multi-point control unit MCU in the hardware conference system; A receiving module, configured to receive notification information that the auxiliary stream channel has been established returned by the auxiliary stream conversion gateway in response to the auxiliary stream permission application information. 23. The server according to claim 21 or 22, further comprising: The notification module is configured to notify the conference terminal of the network conferencing system to create a secondary stream data display window for displaying standard shared data sent by the hardware conference system after the receiving module receives the notification information that the secondary stream channel has been established. 24. A multi-point control unit in a hardware conference system, characterized by including: A processing module configured to, when receiving standard shared data of a conference terminal in a hardware conference system, send the standard shared data to the auxiliary stream conversion gateway through a pre-established auxiliary stream channel with the auxiliary stream conversion gateway, to causing the auxiliary stream conversion gateway to send the standard shared data to the network conferencing system; upon receiving the standard shared data of the auxiliary stream conversion gateway sent through the pre-established auxiliary stream channel between the auxiliary stream conversion gateway and the auxiliary stream conversion gateway, The conference terminal in the hardware conference system broadcasts the standard shared data of the auxiliary stream conversion gateway, wherein the standard shared data of the auxiliary stream conversion gateway is obtained by converting the network shared data of the network conferencing system by the auxiliary stream conversion gateway. . 25. The multi-point control unit as claimed in claim 24, further comprising: An allocation module, configured to allocate a auxiliary stream address to the auxiliary stream conversion gateway, and send the auxiliary stream address to the auxiliary stream conversion gateway to establish a auxiliary stream channel with the auxiliary stream conversion gateway. 26. The multi-point control unit as claimed in claim 25, characterized in that, The allocation module is specifically configured to, when receiving the auxiliary stream transmission permission request sent by the auxiliary stream conversion gateway, allocate a auxiliary stream address to the auxiliary stream conversion gateway in response to the auxiliary stream transmission permission request, and assign the auxiliary stream address to the auxiliary stream conversion gateway. Sent to the auxiliary stream conversion gateway. 27. A multimedia conference implementation system, characterized in that it includes: a web server of the network conference system and at least one web conference terminal, a multi-point control unit MCU and at least one VP terminal of the hardware conference system, and a auxiliary stream conversion gateway, where , the auxiliary stream conversion gateway is connected to the web server, and the auxiliary stream conversion gateway establishes an auxiliary stream channel to the multi-point control unit MCU; The web server is configured to receive network sharing data sent by the at least one web conference terminal, and send the network sharing data to the auxiliary stream conversion gateway; The auxiliary stream conversion gateway is configured to, when receiving network sharing data sent by the web server, convert the network sharing data into standard sharing data, and send the converted said auxiliary stream data to the MCU through the auxiliary stream channel. Standard shared data, the format of the standard shared data is a video format supported by the hardware conference system; The MCU is configured to send the standard shared data converted by the auxiliary stream conversion gateway to the at least one VP terminal; The MCU is also configured to receive the standard shared data sent by the at least one VP terminal, and send the standard shared data of the at least one VP terminal to the auxiliary stream conversion gateway; The auxiliary stream conversion gateway is also configured to determine that the network conferencing system supports the video format of the standard shared data sent by the MCU when receiving the standard shared data sent by the MCU in the pre-established auxiliary stream channel. when sending the standard shared data sent by the MCU to the web server; the web server is also configured to broadcast the standard shared data sent by the MCU to the at least one web conference terminal. 28. The system of claim 27, characterized in that, The auxiliary stream conversion gateway is also used to send a token request to the multi-point control unit MCU of the hardware conference system to obtain the permission to send standard shared data, and receive a response from the multi-point control unit MCU in response to the token request. The token is used to indicate that the sender of the token request has the authority to send standard shared data. 29. The method of claim 27, characterized in that, The auxiliary stream conversion gateway converts the network shared data into standard shared data by parsing the network shared data to generate images, and using the video format supported by the hardware conference system to encode the generated images to generate the standard shared data. data. 30. The method of claim 29, wherein the auxiliary stream conversion gateway parses the shared data of the network conferencing system to generate an image by parsing the network share through a built-in client of the network conferencing system. Data generates images.