CN116600076B - Implementation methods, devices, electronic equipment and storage media for video conferencing - Google Patents

Abstract

The invention provides a method, device, electronic equipment and storage medium for implementing video conferencing, and belongs to the technical field of image communication. The implementation method of the video conference includes: establishing a conference connection with the conference server through the second conference terminal; receiving the received video stream of the first conference terminal forwarded from the second conference terminal; wherein, the reception of the first conference terminal The video stream is obtained by the second conference terminal based on the merged video stream sent by the conference server; the merged video stream is obtained by the conference server based on the video stream received by the first conference terminal and the second conference terminal. Generated by the received video stream; display the conference screen according to the received video stream of the first conference terminal. The invention can improve the efficiency of video conferencing.

Description

Implementation methods, devices, electronic equipment and storage media for video conferencing

Technical field

Embodiments of the present invention relate to the technical field of image communication, and in particular, to a method, device, electronic device and storage medium for implementing video conferencing.

Background technique

The online video conferencing system is a multimedia conferencing platform that uses the Internet as the medium. Users can achieve face-to-face communication through the Internet regardless of time and geographical limitations. When face-to-face meetings are inconvenient, online video conferencing can provide a convenient way for multi-party communication.

When convening a large-scale online video conference with many members, if all participants join the conference through their own devices, it will occupy the network resources of the office network and also put a greater load on the video conference server.

Contents of the invention

Embodiments of the present invention provide a video conference implementation method, device, electronic equipment and storage medium, which can improve conference participation efficiency and save conference resources.

In order to solve the above technical problems, the present invention is implemented as follows:

In a first aspect, an embodiment of the present invention provides a method for implementing a video conference, which is applied to a first conference terminal and includes:

Establish a conference connection with the conference server through the second conference terminal;

Receive the received video stream of the first conference terminal forwarded from the second conference terminal; wherein the received video stream of the first conference terminal is obtained by the second conference terminal according to the merged video stream sent by the conference server; The merged video stream is generated by the conference server based on the received video stream of the first conference terminal and the received video stream of the second conference terminal;

Display a conference screen according to the received video stream of the first conference terminal.

Optionally, video conferencing implementation methods also include:

The sending video stream of the first conference terminal is sent to the second conference terminal, so that the second conference terminal can forward the sending video stream of the first conference terminal to the conference server.

Optionally, video conferencing implementation methods also include:

Obtain conference operation information generated by user operations;

Generate a video stream sent by the first conference terminal according to the conference operation information.

Optionally, establishing a conference connection with the conference server through the second conference terminal also includes:

Obtain membership authentication information based on user input operations;

Send the conference joining authentication information to the second conference terminal;

The conference connection is established according to the authentication passing information returned by the second conference terminal based on the conference joining authentication information.

Optionally, displaying a conference screen according to the received video stream of the first conference terminal includes:

Combining the member avatars corresponding to the first conference terminal and the member avatars corresponding to the second conference terminal to form a group image;

Generate a conference member display area in the conference screen based on the grouped image;

The conference screen is displayed according to the conference member display area.

In a second aspect, an embodiment of the present invention further provides a method for implementing a video conference, which is applied to a second conference terminal, including:

Receive the conference joining authentication information sent by the first conference terminal;

Send the conference joining authentication information to the conference server, so that the conference server authenticates the first conference terminal according to the conference joining authentication information;

Establish a conference connection with the first conference terminal according to the authentication passing information returned by the conference server to verify the conference joining authentication information;

Receive the merged video stream sent by the conference server through the conference connection; wherein the merged video stream is generated by the conference server based on the received video stream of the first conference terminal and the received video stream of the second conference terminal. ;

According to the merged video stream, a received video stream of the first conference terminal is obtained; the first conference terminal is one of at least one conference terminal connected to the second conference terminal;

The received video stream of the first conference terminal is sent to the first conference terminal, so that the first conference terminal can display the conference screen according to the received video stream of the first conference terminal.

Optionally, video conferencing implementation methods also include:

Obtain the received video stream of the second conference terminal according to the combined video stream;

A conference screen is displayed according to the received video stream of the second conference terminal.

Optionally, displaying a conference screen according to the received video stream of the second conference terminal includes:

In the participant display area of the conference screen, an avatar display frame of at least one participant group is displayed; wherein the group image of the at least one participant group includes a group image of the participant group of the second conference terminal ;

The group image of the participating group of the second conference terminal is generated based on the avatar information of the second conference terminal and the avatar information of at least one conference terminal connected to the second conference terminal.

Optionally, video conferencing implementation methods also include:

Receive the video stream sent by the first conference terminal;

According to the conference authentication information, the video stream sent by the first conference terminal is sent to the conference server.

Optionally, sending the received video stream of the first conference terminal to the first conference terminal includes:

When the status of the conference connection is connected, send the received video stream of the first conference terminal to the first conference terminal through the conference connection;

When the status of the conference connection is not connected, the received video stream of the first conference terminal is cached; when the status of the conference connection is converted from not connected to connected, the cached video stream is cached. The received video stream of the first conference terminal is sent to the first conference terminal through the conference connection.

In a third aspect, embodiments of the present invention also provide a method for implementing video conferencing, which is applied to the conference server and includes:

Receive the conference joining authentication information of the first conference terminal sent by the second conference terminal;

The first conference terminal is verified according to the conference authentication information. If the verification passes, authentication passing information is returned to the second conference terminal, so that the second conference terminal can pass the authentication according to the verification. The information establishes a conference connection with the first conference terminal;

Receive the sent video stream of the first conference terminal forwarded by the second conference terminal;

Generate a receiving video stream of the first conference terminal according to the sending video stream of the first conference terminal;

Generate a merged video stream according to the received video stream of the first conference terminal;

Send the merged video stream to a second conference terminal that maintains a conference connection with the first conference terminal, so that the second conference terminal can send the first conference to the first conference terminal according to the merged video stream. The terminal receives the video stream.

Optionally, generating a combined video stream based on the received video stream of the first conference terminal includes:

The combined video stream is generated based on the received video stream of the first conference terminal, the received video stream of the second conference terminal, and the received video streams of other conference terminals connected to the second conference terminal.

In a fourth aspect, embodiments of the present invention also provide a device for implementing video conferencing, which is applied to the first conference terminal and includes:

The connection module is used to establish a conference connection with the conference server through the second conference terminal;

A receiving module configured to receive the received video stream of the first conference terminal forwarded from the second conference terminal; wherein the received video stream of the first conference terminal is the combined video stream sent by the second conference terminal according to the conference server. Obtained from a video stream; the merged video stream is generated by the conference server based on the received video stream of the first conference terminal and the received video stream of the second conference terminal;

The display module is configured to display the conference screen according to the received video stream of the first conference terminal.

In a fifth aspect, embodiments of the present invention further provide a device for implementing a video conference, which is applied to a second conference terminal and includes:

The voucher receiving module is used to receive the conference authentication information sent by the first conference terminal;

A first sending module, configured to send the conference joining authentication information to the conference server, so that the conference server authenticates the first conference terminal according to the conference joining authentication information;

A conference connection module, configured to establish a conference connection with the first conference terminal according to the authentication passing information returned by the conference server to verify the conference joining authentication information;

A receiving module configured to receive a merged video stream sent by the conference server through the conference connection; wherein the merged video stream is a video stream received by the conference server based on the received video stream of the first conference terminal and the received video of the second conference terminal. Stream generated;

A merged video stream processing module, configured to obtain a received video stream of a first conference terminal according to the merged video stream; the first conference terminal is one of at least one conference terminal connected to the second conference terminal;

The second sending module is configured to send the received video stream of the first conference terminal to the first conference terminal, so that the first conference terminal can display the conference in the display area according to the received video stream of the first conference terminal. picture.

In the sixth aspect, embodiments of the present invention provide a device for implementing video conferencing, which is applied to the conference server and includes:

The first receiving module is configured to receive the conference joining authentication information of the first conference terminal sent by the second conference terminal;

A verification module configured to verify the first conference terminal according to the conference authentication information, and if the verification passes, return authentication passing information to the second conference terminal, so that the second conference terminal Able to establish a conference connection with the first conference terminal based on the authentication pass information;

a second receiving module, configured to receive the transmitted video stream of the first conference terminal forwarded by the second conference terminal;

A first generating module configured to generate a receiving video stream of the first conference terminal based on the sending video stream of the first conference terminal;

A second generation module, configured to generate a merged video stream according to the received video stream of the first conference terminal;

A sending module configured to send the merged video stream to a second conference terminal that maintains a conference connection with the first conference terminal, so that the second conference terminal can send the merged video stream to the first conference terminal according to the merged video stream. The first conference terminal receives a video stream.

In the seventh aspect, embodiments of the present invention also provide a video conferencing implementation system, which includes a video conferencing implementation device applied to a first conference terminal, a video conferencing implementation device applied to a second conference terminal, and a video conferencing implementation device applied to a conference server. A device for implementing a video conference on the terminal; wherein, the device for implementing a video conference applied to the first conference terminal is used to execute a method for implementing a video conference applied to the first conference terminal; the device for implementing a video conference applied to the second conference terminal is used The device is used to implement the video conferencing implementation method applied to the second conference terminal; the video conferencing implementation device applied to the conference server is used to implement the video conferencing implementation method applied to the conference server.

In an eighth aspect, embodiments of the present invention further provide an electronic device, including: a processor, a memory, and a program stored on the memory and executable on the processor. When the program is executed by the processor Implement the steps of the method provided in the first, second or third aspect above.

In a ninth aspect, embodiments of the present invention further provide a computer-readable storage medium. The computer-readable storage medium stores a computer program. When the computer program is executed by a processor, the above-mentioned first aspect, second aspect, or Steps of the third aspect method.

In the embodiment of the present invention, the first conference terminal can join the video conference through the second conference terminal and receive the received video stream of the first conference terminal for generating the conference screen. According to the received video stream of the first conference terminal, in the first The conference terminal displays the conference screen, so that the first conference terminal can indirectly obtain the conference screen during the conference through the second conference terminal, participate in the video conference, reduce the number of conference terminals directly connected to the conference server, reduce the load on the conference server, and save the network Meeting resources for video conferencing.

Description of drawings

Various other advantages and benefits will become apparent to those of ordinary skill in the art upon reading the following detailed description of the preferred embodiments. The drawings are for the purpose of illustrating preferred embodiments only and are not to be construed as limiting the invention. Also throughout the drawings, the same reference characters are used to designate the same components. In the attached picture:

Figure 1 is a schematic flowchart of a video conferencing implementation method provided by an embodiment of the present invention;

Figure 2 is a schematic diagram of the connection between the conference terminal and the conference server provided by the embodiment of the present invention;

Figure 3 is a schematic diagram of a conference screen according to an embodiment of the present invention;

Figure 4 is a schematic diagram of a conference architecture according to an embodiment of the present invention;

Figure 5 is a schematic diagram of another conference screen according to the embodiment of the present invention;

Figure 6 is a schematic diagram of another conference architecture according to an embodiment of the present invention;

Figure 7 is a schematic structural diagram of a device for implementing video conferencing according to an embodiment of the present invention;

Figure 8 is a schematic connection diagram of a device for implementing video conferencing according to an example of the present invention;

Fig. 9 is a schematic diagram of signaling interaction of a device for implementing video conferencing according to an example of the present invention;

Figure 10 is a schematic structural diagram of an electronic device provided by an embodiment of the present invention.

Detailed ways

The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without making creative efforts fall within the scope of protection of the present invention.

The term "comprising" and any variations thereof in the description and claims of the present invention are intended to cover non-exclusive inclusion, for example, a process, method, system, product or equipment that includes a series of steps or units and is not necessarily limited to clear may include other steps or elements not expressly listed or inherent to the process, method, product or apparatus. In addition, the use of "and/or" in the description and claims indicates at least one of the connected objects, such as A and/or B, indicating that there are three situations including A alone, B alone, and both A and B.

In the embodiments of the present invention, words such as “exemplary” or “for example” are used to represent examples, illustrations or explanations. Any embodiment or design described as "exemplary" or "such as" in the embodiments of the invention is not to be construed as preferred or advantageous over other embodiments or designs. Rather, use of the words "exemplary" or "such as" is intended to present the concept in a concrete manner.

The technology described herein is not limited to Long Time Evolution (LTE)/LTE-Advanced (LTE-A) systems, and can also be used in various wireless communication systems, such as Code Division Multiple Access (CodeDivision Multiple Access). Access, CDMA), Time Division Multiple Access (Time Division Multiple Access, TDMA), Frequency Division Multiple Access (Frequency Division Multiple Access, FDMA), Orthogonal Frequency Division Multiple Access (OFDMA), Single Carrier Frequency Division Multiple Access Address (Single-carrier Frequency-Division Multiple Access, SC-FDMA) and other systems.

In the embodiment of the present invention, the relationship between the first conference terminal, the second conference terminal and the conference server may include: the first conference terminal and other conference terminals access the conference server through the second conference terminal and join the video conference. The network video conference in the embodiment of the present invention is a video conference implemented through the network.

Figure 1 is an exemplary video conference implementation method provided by an embodiment of the present invention, applied to a first conference terminal, and includes steps S11-S13. The first conference terminal may be a mobile terminal, such as a mobile phone, a handheld computer, a tablet computer, a notebook computer, a wearable smart device, etc., or it may be a fixed user terminal, such as a dedicated conference equipment, a desktop computer, etc. The second conference terminal may be a dedicated network video conferencing device, or a user terminal capable of participating in network video conferencing.

Step S11: Establish a conference connection with the conference server through the second conference terminal.

In this embodiment, the first conference terminal joins the online video conference through the conference server. The first conference terminal and the second conference terminal can be the same type of terminal or different types of terminals. The second conference terminal can directly join the network video conference by establishing a conference connection with the conference server, or can also communicate with the conference server through other conference terminals. The client indirectly establishes a conference connection and joins the online video conference.

Step S12: Receive the received video stream of the first conference terminal forwarded from the second conference terminal; wherein the received video stream of the first conference terminal is obtained by the second conference terminal based on the merged video stream sent by the conference server. ; The merged video stream is generated by the conference server based on the received video stream of the first conference terminal and the received video stream of the second conference terminal.

In this embodiment, the video stream received by the first conference terminal is a video stream used to generate a conference picture of the first conference terminal, and may be a separate video stream or a video stream included in an audio-video composite stream.

The received video stream forwarded by the second conference terminal can be a video stream sent from the conference server and relayed by the second conference terminal, or it can be a video stream sent from other participating conference terminals and relayed by the second conference terminal. flow. The conference server may send the combined video stream to the second conference terminal through at least one conference terminal, or may directly send the combined video stream to the second conference terminal.

The combined video stream received by the second conference terminal includes at least the received video stream of the second conference terminal, that is, the video stream used to generate the conference picture of the second conference terminal, and the received video stream of the first conference terminal. In the case where the conference terminal connected to the conference server through the second conference terminal only includes the first conference terminal, the combined video stream received by the second conference terminal includes the video stream used to generate the conference picture on the second conference terminal. , and a video stream used to generate a conference picture on the first conference terminal.

In this embodiment, the first conference terminal establishes a conference connection with the conference server through the second conference terminal to join the video conference. That is, the first conference terminal indirectly communicates with the conference server by connecting to the second conference terminal. Establish a connection to join an online video conference. The first conference terminal and the second conference terminal are connected in a manner that may include connection through a local area network, connection through the Internet, connection through Bluetooth, connection through hardware, etc.

In one implementation, the first conference terminal and the second conference terminal are connected through a local area network, Bluetooth or hardware, so that the physical location relationship of different conference terminals can be known through the connection relationship between the conference terminals, for example, the first A conference terminal and a second conference terminal may be located in the same conference room, so that the first conference terminal can connect to the second conference terminal through short-range communication, and then join the conference through the second conference terminal.

In another implementation, as shown in FIG. 2 , there may also be a third conference terminal 23 that indirectly joins the network video conference through the first conference terminal 21 and the second conference terminal 22 . Among them, the first conference terminal 21 is connected to the second conference terminal 22, the second conference terminal 22 is connected to the conference server 24 to join the network video conference, and the first conference terminal 21 is indirectly connected to the conference server 24 through the second conference terminal 22. to join an online video conference.

In the case of multiple conference terminals including the first conference terminal connected to the conference server through the second conference terminal, the combined video stream received by the second conference terminal may also include other than the first conference terminal. In addition, other conference terminals that join the online video conference through the second conference terminal receive video streams.

In one implementation, the first conference terminal is a user terminal with a display, and the second conference terminal is any one of a dedicated conference device or a user terminal. In the case where other conference terminals indirectly connect to the conference server through the first conference terminal to join the video conference, the first conference terminal may also be a dedicated conference device.

Step S13: Display the conference screen according to the received video stream of the first conference terminal.

In this embodiment, the first conference terminal runs an application program for participating in an online video conference, or runs a tool for participating in an online video conference through a web page. Therefore, the window for displaying the conference screen runs on the first conference terminal. After receiving the received video stream from the first terminal, the data of the video stream can be parsed, and the conference picture can be rendered in a window for displaying the conference picture.

Through the embodiment of the present invention, the first conference terminal can receive the received video stream of the first conference terminal used to generate the conference screen through the second conference terminal, and display the conference on the first conference terminal according to the received video stream of the first conference terminal. screen, so that the first conference terminal can indirectly obtain the conference screen during the meeting through the second conference terminal and participate in the video conference, reducing the number of conference terminals directly connected to the conference server, reducing the load on the conference server, and saving network video conference time. resource.

In one implementation, the method for implementing video conferencing also includes:

The sending video stream of the first conference terminal is sent to the second conference terminal, so that the second conference terminal can forward the sending video stream of the first conference terminal to the conference server.

In a specific implementation manner, the video stream sent by the first conference terminal to the second conference terminal may only include audio information and/or default display information of the first conference terminal. For example, if the first conference terminal does not turn on the camera, the video data of the first conference terminal cannot be obtained. On other conference terminals, the first conference terminal displays the default avatar screen accordingly. Then the video stream sent by the first conference terminal includes data corresponding to the default avatar screen.

In another specific implementation, the video stream sent by the first conference terminal to the second conference terminal may include all the video streams generated by the first conference terminal during the process of participating in the video conference that need to be processed by the conference server. received data. For example, the user operates the first conference terminal to generate message information, sign-in information, hand-raising information, etc. in response to the conference speech.

In a specific implementation manner, the video conference access method also includes:

The conference joining authentication information of the first conference terminal is sent to the second conference terminal, so that the second conference terminal can forward the video stream sent by the first conference terminal according to the conference joining authentication information.

When the first conference terminal connects with the second conference terminal to join the conference, the first conference terminal sends the conference voucher to the second conference terminal. The second conference terminal can save the conference voucher of the first conference terminal and forward it to the first conference terminal later. When sending a video stream, the conference credentials of the first conference terminal can be attached, so that after receiving the video stream sent by the first conference terminal, the conference server can recognize that the sender is the first conference terminal.

In the case where multiple conference terminals join the conference through the second conference terminal, the second conference terminal may carry the conference joining authentication information of each corresponding conference terminal when forwarding and sending the video stream.

In one implementation, the video conference access method further includes:

Obtain conference operation information generated by user operations;

Generate a video stream sent by the first conference terminal according to the conference operation information.

In this embodiment, the conference operation information generated by user operations may include information generated by operations on tools such as buttons and input boxes on the conference interface. For example, when a user clicks the hand-raising button or sign-in button on the conference interface, meeting operation information indicating hand-raising or sign-in is generated. For another example, the user inputs a conference speech through the input box, and conference operation information containing the speech content is generated.

In a specific implementation, generating a video stream sent by the first conference terminal according to the conference operation information may include generating a video stream based on video screen information captured by the first conference terminal and instructions generated by the first conference terminal. The first conference terminal sends a video stream.

In one implementation, establishing a conference connection with the conference server through the second conference terminal includes:

Obtain membership authentication information based on user input operations;

Send the conference joining authentication information to the second conference terminal;

The conference connection is established according to the authentication passing information returned by the second conference terminal based on the conference joining authentication information. Wherein, the conference connection is used to transmit the sending video stream of the first conference terminal and the receiving video stream of the first conference terminal.

In this embodiment, the user's input operation may include the user inputting the conference number to join the conference. If a password is required, the user's input operation may also include the user inputting the conference password.

Obtaining the membership authentication information based on the user's input operation may include: generating the user's membership authentication information based on the conference number input by the user and the account information used by the user to log in to the conference. Or it may include: generating the user's conference joining authentication information based on the conference number, conference joining password and user's account information for logging in to the conference entered by the user.

After the first conference terminal sends the conference joining authentication information to the second conference terminal, the second conference terminal can forward the conference joining authentication information of the first conference terminal to the conference server, and the conference server side authenticates the joining of the first conference terminal. The information is authenticated, and after the authentication is passed, the authentication passing information is returned to the second conference terminal, so that the first conference terminal and the second conference terminal establish a conference connection. When the second conference terminal establishes a conference connection with the conference server, The first conference terminal indirectly establishes a conference connection with the conference server through the second conference terminal and joins the network video conference.

After the conference terminal that joins the online video conference through the second conference terminal sends the conference membership authentication information to the second conference terminal, the second conference terminal stores the conference membership authentication information of each conference terminal, and after receiving the video stream sent by each conference terminal, The corresponding conference joining authentication information is forwarded to the conference server together with the sending video stream, so that the conference server can determine the sender of the sending video stream based on the conference joining authentication information.

In one implementation, displaying a conference screen according to the received video stream of the first conference terminal includes:

Display the member avatar corresponding to the first conference terminal and the member avatar corresponding to the second conference terminal in combination to form a group image;

Generate a conference member display area in the conference screen based on the grouped image;

A conference screen is displayed according to the conference member display area.

In this embodiment, the conference terminal that joins the online video conference through the second conference terminal can display the same group as the second conference terminal. In the same way, other conference terminals used to forward the video streams sent and received by the conference terminal are also displayed in the same group on the conference screen as the conference terminal responsible for the transfer.

As shown in Figure 3, the conference screen includes a member display area 32 and a conference content display area 31. The conference content display area 31 can be used to display the video screen shot by the conference terminal corresponding to the speaker (i.e., the host) of the conference, and the member display area 32 can be used to display the avatar information corresponding to each participating member or the personal information of each participating member. Video footage captured by the conference terminal. Referring to the embodiment shown in Figure 3, participating users include user A-user K. Among them, the conference terminals of users A and B directly join the online video conference, the conference terminals of user D join the online video conference through the conference terminal of user C, and the conference terminals of users E, user F, and user G join the conference equipment in conference room A. To join the online video conference, User H, User I, User J, and User K join the online video conference through the conference equipment in conference room B. Therefore, users C and D belong to one group, users E, user F, and user G belong to another group, and users H, user I, user J, and user K belong to yet another group. In the member display area 32 of the conference screen, each conference terminal that directly joins the online video conference corresponds to an avatar display box 33. Users C and D are simultaneously displayed in the avatar display box 33 corresponding to user C. Users E, user F, and user G are simultaneously displayed in the avatar display box 33 corresponding to the conference equipment in conference room A. Users H, user I, user J, User K is also displayed in the avatar display frame 33 corresponding to the conference equipment in conference room B.

In this embodiment, by displaying all the participating members in groups, each participating member can intuitively view the grouping status of the participating members from the conference screen, and then indirectly know the distance between the physical locations of the participating members. relation.

An embodiment of the present invention also provides a method for implementing a video conference, which is applied to the second conference terminal, including:

Receive the conference joining authentication information sent by the first conference terminal;

Send the conference joining authentication information to the conference server, so that the conference server authenticates the first conference terminal according to the conference joining authentication information;

Establish a conference connection with the first conference terminal according to the authentication passing information returned by the conference server to verify the conference joining authentication information;

Receive the merged video stream sent by the conference server through the conference connection; wherein the merged video stream is generated by the conference server based on the received video stream of the first conference terminal and the received video stream of the second conference terminal;

According to the merged video stream, a received video stream of the first conference terminal is obtained; the first conference terminal is one of at least one conference terminal connected to the second conference terminal;

The received video stream of the first conference terminal is sent to the first conference terminal, so that the first conference terminal can display the conference screen according to the received video stream of the first conference terminal.

In this embodiment, the receiving video stream of the first conference terminal and the receiving video stream of the second conference terminal are both generated based on the sending video stream of the conference terminal received by the conference server at the previous moment.

In this embodiment, the second conference terminal can forward the received video stream of the first conference terminal that joins the video conference indirectly through the second conference terminal, so that the first conference terminal can obtain the video stream during the conference through the second conference terminal, as shown Meeting screen.

In one implementation, the method for implementing video conferencing also includes:

Obtain the received video stream of the second conference terminal according to the combined video stream;

A conference screen is displayed according to the received video stream of the second conference terminal.

In this embodiment, the conference screen generation method on the second conference terminal may be consistent with that of the first conference terminal.

In one implementation, displaying a conference screen based on the received video stream of the second conference terminal includes:

In the participant display area of the conference screen, an avatar display frame of at least one participant group is displayed; wherein the group image of the at least one participant group includes a group image of the participant group of the second conference terminal ;

The group image of the participating group of the second conference terminal is generated based on the avatar information of the second conference terminal and the avatar information of at least one conference terminal connected to the second conference terminal.

In the embodiment of the present invention, the group image of the participating group includes the avatar of each member included in the participating group. A thumbnail display is generated based on the avatar information of each member, and is displayed in the avatar display box as the group avatar of the participating group. middle. The thumbnail display may include a set number of reduced member avatars. Upon receiving the user's click operation information on the thumbnail display, the thumbnail display is expanded to present the avatars of all members included in the participating group. list.

In one implementation, the method for implementing video conferencing also includes:

Receive the conference joining authentication information sent by the first conference terminal;

Send the conference joining authentication information to the conference server, so that the conference server authenticates the first conference terminal according to the conference joining authentication information;

According to the authentication passing information of the conference joining authentication information verified by the conference server, a conference connection with the first conference terminal is established; the conference connection with the first conference terminal is used to transmit the first The video stream received by the conference terminal.

In this embodiment, the conference joining authentication information can be generated based on the account information corresponding to the first conference terminal and the conference number input by the user of the first conference terminal. In the case where a password is set, the conference joining authentication information is also based on the first conference terminal. The password entered by the user is generated. The second conference terminal saves the conference joining authentication information, or saves at least part of the conference joining authentication information. After receiving the merged video stream, it matches the conference joining authentication information with the identity information in the merged video stream to identify the received video belonging to the first conference terminal. stream and forwarded to the first conference terminal. After receiving the video stream sent by the first conference terminal, the video stream sent by the first conference terminal is combined with the conference joining authentication information of the first conference terminal, and the joining authentication information is used to identify the identity information of the video stream sent by the first conference terminal, Then forwarded to the conference server.

In a specific implementation manner, the second conference terminal can enable the relay information sending function, so that other terminals connected to the second conference terminal through Bluetooth, wireless network, wired network, etc. can detect the second conference terminal and communicate with the second conference terminal through the second conference terminal. The conference terminal joins the online video conference.

In one implementation, the method for implementing video conferencing also includes:

Receive the video stream sent by the first conference terminal;

The sending video stream is sent to the conference server according to the conference joining authentication information.

In this embodiment, the video stream sent by the first conference terminal is a video stream sent by the first conference terminal. At the same time, the video streams sent by other conference terminals are video streams sent by the corresponding other conference terminals.

In one implementation, sending the received video stream of the first conference terminal to the first conference terminal includes:

When the status of the conference connection is connected, send the received video stream of the first conference terminal to the first conference terminal through the conference connection;

When the status of the conference connection is not connected, the received video stream of the first conference terminal is cached; when the status of the conference connection is converted from not connected to connected, the cached video stream is cached. The received video stream of the first conference terminal is sent to the first conference terminal through the conference connection.

In the embodiment of the present invention, when the conference connection is stably maintained, the received video stream of the first conference terminal is directly sent to the first conference terminal. When the conference connection is unstable and disconnected, the received video stream of the first conference terminal is cached. When the conference connection is reconnected, the cached video stream is sent to the first conference terminal, thereby reducing information leakage. .

An embodiment of the present invention also provides a video conference implementation method, which is applied to the conference server and includes:

Receive the conference joining authentication information of the first conference terminal sent by the second conference terminal;

The first conference terminal is verified according to the conference authentication information. If the verification passes, authentication passing information is returned to the second conference terminal, so that the second conference terminal can pass the authentication according to the verification. The information establishes a conference connection with the first conference terminal;

Receive the video stream sent by the first conference terminal forwarded by the second conference terminal; the first conference terminal establishes a conference connection with the conference server through the second conference terminal to join the video conference;

Generate a received video stream of the first conference terminal based on the sending video stream of the first conference terminal; generate a merged video stream based on the received video stream of the first conference terminal;

Send the merged video stream to a second conference terminal that maintains a conference connection with the first conference terminal, so that the second conference terminal can send the first conference to the first conference terminal according to the merged video stream. The terminal receives the video stream.

In the embodiment of the present invention, the second conference terminal receives the video stream sent by the first conference terminal, and forwards the video stream sent by the first conference terminal according to the membership authentication information or other identity information of the first conference terminal. Specifically, it may be that the second conference terminal sends a video stream to the first conference terminal. The conference joining authentication information or other identity information of one conference terminal is attached to the video stream sent by the first conference terminal and sent to the conference server.

The conference server can perform information processing based on the sending video stream of the first conference terminal and the sending video streams of other conference terminals, and generate the receiving video stream of the first conference terminal for displaying the conference screen on the first conference terminal, thereby according to the first conference terminal. When a conference terminal receives a video stream, the first conference terminal can present the status of each participating terminal.

Generating a combined video stream based on the received video stream of the first conference terminal may include: based on the received video stream of the first conference terminal and the received video streams of other conference terminals joining the network video conference through the second conference terminal, and The second conference terminal receives the video stream and generates a combined video stream sent to the second conference terminal.

In the embodiment of the present invention, after the combined video stream is sent to the second conference terminal that maintains a conference connection with the first conference terminal, the second conference terminal can obtain the received video stream of the first conference terminal based on the combined video stream, and forward the received video stream of the first conference terminal to the first conference terminal.

In one implementation, the method for implementing video conferencing also includes:

Receive the conference joining authentication information of the first conference terminal sent by the second conference terminal;

The first conference terminal is verified according to the conference authentication information. If the verification passes, authentication passing information is returned to the second conference terminal, so that the second conference terminal can pass the authentication according to the verification. The information establishes a conference connection with the first conference terminal.

In the embodiment of the present invention, when the conference server passes the verification of other conference terminals that join the network video conference through the second conference terminal, the authentication pass information is sent to the second conference terminal, and then the second conference terminal passes the authentication Information to establish conference connections with other conference terminals respectively.

In one implementation, generating a merged video stream based on the received video stream of the first conference terminal includes:

The combined video stream is generated based on the received video stream of the first conference terminal, the received video stream of the second conference terminal, and the received video streams of other conference terminals connected to the second conference terminal.

In the embodiment of the present invention, by merging the video streams and sending the received video streams of multiple conference terminals, the number of data transmission paths can be saved, and the data of multiple received video streams can be transmitted through the conference connection between the second conference terminal and the conference server. After receiving the merged video stream, the second conference terminal splits and parses the received video streams of different conference terminals from the merged video stream, and displays the conference picture on the second conference terminal according to the received video stream of the second conference terminal, except for the second conference terminal. The video streams received by other conference terminals other than the second conference terminal are correspondingly sent to the other conference terminals.

Through the above embodiments of the present invention, multiple terminals can be indirectly connected to the conference server through a conference terminal connected to the conference server, and join the network video conference, thereby realizing access to the remote video conference through the same terminal, and at the same time, all corresponding participants can be recorded. Meeting information is used for check-in and statistics.

If a client of the network video conferencing product only allows one user to join the conference, as shown in Figure 4, each user 41 is connected to the conference server 42 through the base station or switch through the corresponding conference terminal, that is, multiple conference terminals are directly connected to the conference server. 42, which is the video conferencing server in Figure 4. Multiple participating users must use the conference terminal used in the conference room to participate in the conference, and the conference screen is as shown in Figure 5. The participating users cannot identify the identity of each other participating user in the conference, especially when passing through the conference room. Users participating in online video conferences with conference equipment are independent of each other. The conference screen shown in Figure 5 is relatively simple and cannot intuitively represent the actual participation in the conference, and cannot reflect the participation of each user in the conference room. If you need to identify other participating users, you may need to use facial recognition and other technical support, which is not very accurate and easy to miss.

In an example scenario, when a company or organization holds a large-scale meeting that requires all members to participate as shown in Figure 4, if all employees join the meeting as participants through their respective terminal devices, the office network will be occupied. Network resources will also put a heavy load on the conference server. Users who participate in meetings in the conference room through special conference equipment cannot be directly counted, and external sign-in software must be used. Even if a proxy server is used, it only acts as a network layer proxy and does not reduce the server load and network bandwidth usage; on the contrary, it increases proxy nodes and increases network overhead and costs.

In one example of the present invention, the basic topology of the connection between the conference server and each conference terminal is shown in Figure 6. User C and user D, who are seated adjacent to each other in the same office location, can connect to the same PC through mobile phone plug-ins. (Personal Computer, personal computer) client (or other mobile phone client), and users in the conference room can connect to the dedicated conference equipment of the conference room through their respective mobile phones, and join the conference through the conference terminal in the conference room. As a result, the conference server can authenticate users C, D, E, F, and G respectively and create sessions, while users C, D, E, F, and G can perform basic video conferencing operations through their respective mobile phones, such as raising hands, Speech etc.

Conference terminals that indirectly access the conference through other conference terminals will be grouped according to their participation in the conference, and the grouping status will be displayed on the conference screen. As shown in Figure 3, through the conference screen displayed on the conference terminal, participating users can intuitively View the current participation status of all users, and learn how and where users participate in meetings by grouping. When the mobile phone is used as the first conference terminal and the PC is used as the second conference terminal, the mobile phone can establish a wireless connection with the PC through Bluetooth, wifi and other technologies, and connect to the computer participating in the video conference. The computer terminal and conference server participating in the video conference authenticate the mobile phone. After the mobile phone is authenticated, users of the mobile phone can perform basic operations through the terminal, such as signing in, raising hands, speaking, etc.

After the first conference terminal joins the online video conference through the second conference terminal, the user can perform basic conference operations such as raising hands and signing in through the first conference terminal. The conference server can also identify the user's identity through the first conference terminal. Similarly, conference room terminals can also join the conference through the solution described in this proposal, and all users who join the conference can perform basic conference operations. In this way, compared with meeting members joining the meeting individually, the use of office network resources and server resources for holding meetings can be greatly saved, and it can also ensure that each participating member can maximize the use of video conference-related functions.

An embodiment of the present invention also provides a device for implementing video conferencing. The structure is shown in Figure 7. It is applied to the first conference terminal and includes:

The connection module 71 is used to establish a conference connection with the conference server through the second conference terminal;

The receiving module 72 is configured to receive the received video stream of the first conference terminal forwarded from the second conference terminal; wherein the received video stream of the first conference terminal is the video stream sent by the second conference terminal according to the conference server. Obtained by merging video streams; the merged video stream is generated by the conference server based on the received video stream of the first conference terminal and the received video stream of the second conference terminal;

The display module 73 is configured to display the conference screen according to the received video stream of the first conference terminal.

In one implementation, the device for implementing video conferencing further includes:

A sending module, configured to send the sending video stream of the first conference terminal to the second conference terminal, so that the second conference terminal can forward the sending video stream of the first conference terminal to the conference server.

In one implementation, the device for implementing video conferencing further includes:

The operation information acquisition module is used to obtain the conference operation information generated by user operations;

A sending video stream generating module, configured to generate a sending video stream of the first conference terminal according to the conference operation information.

In one embodiment, the connection module includes:

The input operation analysis unit is used to obtain membership authentication information based on the user's input operation;

A credential information sending unit, configured to send the conference joining authentication information to the second conference terminal;

An authentication unit, configured to establish the conference connection according to the authentication passing information returned by the second conference terminal based on the conference joining authentication information.

In one implementation, the display module includes:

A grouping avatar unit, configured to combine and display the member avatars corresponding to the first conference terminal and the member avatars corresponding to the second conference terminal to form a group image;

A conference member display area unit, configured to generate a conference member display area in the conference screen based on the grouped image;

A picture unit is used to display the conference picture according to the conference member display area.

An embodiment of the present invention also provides a device for implementing a video conference, which is applied to the second conference terminal and includes:

The voucher receiving module is used to receive the conference authentication information sent by the first conference terminal;

The first sending module is configured to send the conference joining authentication information to the conference server, so that the conference server authenticates the first conference terminal according to the conference joining authentication information;

A conference connection module, configured to establish a conference connection with the first conference terminal according to the authentication passing information returned by the conference server to verify the conference joining authentication information;

A receiving module configured to receive a merged video stream sent by the conference server through the conference connection; wherein the merged video stream is a video stream received by the conference server based on the received video stream of the first conference terminal and the received video of the second conference terminal. Stream generated;

A merged video stream processing module, configured to obtain a received video stream of a first conference terminal according to the merged video stream; the first conference terminal is one of at least one conference terminal connected to the second conference terminal;

The second sending module is configured to send the received video stream of the first conference terminal to the first conference terminal, so that the first conference terminal can display the conference in the display area according to the received video stream of the first conference terminal. picture.

In one implementation, the device for implementing video conferencing further includes:

A receiving video stream obtaining module, configured to obtain the receiving video stream of the second conference terminal according to the combined video stream;

The display module is configured to display the conference screen according to the received video stream of the second conference terminal.

In one implementation, the display module includes:

The avatar display frame unit is used to display the avatar display frame of at least one participant group in the participant display area of the conference screen; wherein the group image of the at least one participant group includes the second conference terminal Group images of participant groups;

The group image of the participating group of the second conference terminal is generated based on the avatar information of the second conference terminal and the avatar information of at least one conference terminal connected to the second conference terminal.

In one implementation, the device for implementing video conferencing further includes:

The first terminal sends a video stream receiving module, configured to receive the sent video stream of the first conference terminal;

The first terminal sends a video stream sending module, configured to send the sending video stream to the conference server according to the conference joining authentication information.

In one implementation, the first terminal sends a video stream sending module including:

A first sending unit configured to send the received video stream of the first conference terminal to the first conference terminal through the conference connection when the status of the conference connection is connected;

The second sending unit is configured to cache the received video stream of the first conference terminal when the status of the conference connection is not connected; when the status of the conference connection is converted from not connected to connected If there is a connection, the buffered received video stream of the first conference terminal is sent to the first conference terminal through the conference connection.

Embodiments of the present invention also provide a device for implementing video conferencing, which is applied to the conference server and includes:

A first receiving module configured to receive the conference joining authentication information of the first conference terminal sent by the second conference terminal;

A verification module configured to verify the first conference terminal according to the conference authentication information, and if the verification passes, return authentication passing information to the second conference terminal, so that the second conference terminal Able to establish a conference connection with the first conference terminal based on the authentication pass information;

a second receiving module, configured to receive the transmitted video stream of the first conference terminal forwarded by the second conference terminal;

A first generating module configured to generate a receiving video stream of the first conference terminal based on the sending video stream of the first conference terminal;

A second generation module, configured to generate a merged video stream according to the received video stream of the first conference terminal;

A sending module configured to send the merged video stream to a second conference terminal that maintains a conference connection with the first conference terminal, so that the second conference terminal can send the merged video stream to the first conference terminal according to the merged video stream. The first conference terminal receives a video stream.

In one implementation, the second generation module is also used to:

The combined video stream is generated based on the received video stream of the first conference terminal, the received video stream of the second conference terminal, and the received video streams of other conference terminals connected to the second conference terminal.

In an example of the present invention, the first conference terminal is a mobile phone, and the second conference terminal is a PC. As shown in Figure 8, a mobile phone plug-in 81 is configured on the mobile phone, and the mobile phone plug-in 81 is applied to the first conference terminal. The function of the video conferencing device. The PC side is configured with a PC side plug-in 82, and the PC side plug-in 82 implements the function of a video conference implementation device applied to the second conference terminal. The conference server is configured with a dedicated interface 83 for the video conference server, which is used to implement the functions of the video conference implementation device applied to the conference server.

The mobile phone plug-in 81 includes an authentication controller, a connection controller, a receiver, and a transponder.

Among them, the authentication controller is used to obtain the user's login information and send the conference authentication information to the video conference dedicated interface to apply for a voucher when the mobile client has logged in to the user's conference account. If you are not logged in to the user conference account or are offline, you can use the user conference account and password to connect to the PC plug-in and then call the video conference dedicated interface to send the conference authentication information to obtain the voucher. The functions implemented by the authentication controller include the functions of the credential information sending module in the previous embodiment.

The connection controller is used to create a connection between the mobile phone plug-in and the PC plug-in, and maintain the connection status. If there is a disconnection, it can automatically reconnect. The functions implemented by the connection controller include the connection modules and the functions of the connection modules in the previous embodiments.

The receiver is used to receive conference control operations from the mobile video conferencing client and also receive callback information from the PC plug-in. The functions implemented by the receiver include the functions of the operation information acquisition module of the previous embodiment.

When the mobile phone plug-in has obtained the credentials, the forwarder forwards the conference control operations of the mobile video conferencing client (such as raising hands, signing in and other user operations) to the PC plug-in; it can also forward the PC plug-in to the mobile video conferencing client. callback information. The functions implemented by the forwarder include the functions of sending video stream generation module and sending module.

The PC plug-in 82 connected to the mobile phone includes a credential manager, a connection manager, a receiver and a forwarder.

The credential manager is used to manage the corresponding management of credentials, sessions, and connections obtained by the mobile plug-in, and to identify the identity of the currently connected mobile plug-in. The functions implemented by the credential manager include the functions of the first sending module and the conference connection module in the previous embodiment.

The connection manager is used to manage all connections connected to the current PC-side plug-in. The corresponding connections are obtained through this component before the information is forwarded and processed by the receiver. The functions implemented by the connection manager include the functions of the merged video stream processing module, the first terminal sent video stream receiving module, and the first terminal sent video stream sending module in the aforementioned embodiments.

The receiver is used to receive operations such as login and conference control of the mobile phone plug-in, and can also receive information returned by the video conferencing dedicated interface. The functions implemented by the receiver include the functions of the receiving module and the function of the voucher receiving module in the aforementioned embodiments.

The forwarder is used to forward information from the mobile phone plug-in, calling the video conferencing server dedicated interface to implement operations such as login and conference control; it can also forward the information returned by the video conferencing dedicated interface to the mobile phone plug-in. The functions implemented by the repeater include the functions of the second sending module in the previous embodiment.

Through the above PC-side plug-in, one or more connected mobile terminals can be managed, and the data streams of multiple users can be merged and processed at the same time, so that multiple mobile terminals can share a PC-side video conferencing connection for video conferencing and upload it in real time. Participating user information and connection status of each mobile phone; the mobile phone plug-in can control the conference through the video conference connection shared on the PC.

The dedicated interface 83 of the video conferencing server includes a voucher generator, a receiver, and a forwarder.

The credential generator is used to generate and manage user login credential information. At the same time, the participant information of each client node is saved for use in client group view generation. The functions implemented by the voucher generator include the functions of the first receiving module and the verification module in the aforementioned embodiment.

The receiver is used to receive the request data of the PC-side plug-in and receive the operation results returned by the existing interface of the video conference. The functions implemented by the receiver include the functions of the second receiving module in the previous embodiment.

The forwarder is used to forward the control information of the PC-side plug-in to the existing interface of the video conference, and can also forward the operation results returned by the existing interface of the video conference to the PC client. The functions implemented by the repeater include the functions of the sending module in the previous embodiment.

Through the above dedicated interface of the video conferencing server, the mobile phone user information and conference control information forwarded by the PC plug-in are received; user information is sent to the client, and the video conferencing client can be used to achieve the technical effect of generating group views on other user clients. ;Forwarding the conference control information to the video conference server can realize the conference control function.

At the same time, the conference server is also provided with a video conference existing interface 84, which is used to authenticate the dedicated services of the video conference server and establish a secure connection.

The conference server is also provided with a video conference view window module, which is used to use the user connection client node status saved on the conference server so that each conference terminal can generate a corresponding user group view. Through the adjusted video conferencing client plug-in, it receives the participating user information issued by the dedicated interface of the video conferencing server and groups them according to the shared connection status of the PC. At the same time, a group view is generated on the client, which can realize group display on the client. The technical effect of the PC-side plug-in sharing connection of all users participating in the meeting.

It should be noted that the above components take into account machine performance and user experience, distinguishing between receivers and transponders for asynchronous interaction. If performance is not a concern, the two components can also be combined into one component.

Based on the structural diagram shown in Figure 8, the signaling interaction process between the mobile phone end, PC end, and conference server end in an example of the present invention is shown in Figure 9.

Referring to Figure 9, the video conferencing mobile phone plug-in joins the conference through the video conferencing PC client/conference terminal plug-in. First, identity authentication is required. Before multiple video conferencing mobile plug-ins (using different user accounts) connect to the PC client/conference terminal through a mobile device, they must first directly request the video conferencing server through the mobile device to obtain user identity credentials. Different users obtain The user identity credentials are not the same.

If the video conferencing mobile plug-in successfully obtains the user identity credentials, the plug-in needs to carry this credential when connecting to the PC client/conference terminal plug-in. The PC client/conference terminal plug-in obtains the membership authentication information based on this credential and sends the membership authentication information (i.e. the credentials shown in Figure 9) are sent to the video conferencing server for identity authentication.

After the video conferencing server-side dedicated interface is verified, the PC client/conference terminal plug-in will create a session connection for the video conferencing mobile plug-in, and cache the user's login information based on the session message or session information that creates the session connection. Membership certification information. If multiple mobile phone plug-ins are connected to the PC client/conference terminal plug-in, multiple session connections will be created to cache the conference authentication information of different devices.

The video conferencing mobile phone sends a conference control request to the PC client/conference terminal through the mobile phone plug-in. The PC client/conference terminal first finds the credentials corresponding to the device, and then the PC client/conference terminal passes the corresponding credentials of the device, that is The operation ID (Identification) in Figure 9 encapsulates the conference control instructions and sends the encapsulated data to the server.

After receiving the data, the server side can unblock the data and obtain the real device information that sent the request and the corresponding conference control instruction information. After the server side verifies that it is correct, it will execute the corresponding conference control instruction.

After the server executes the relevant conference control instructions, it sends the execution results to the connected PC client/conference terminal plug-in through a dedicated interface. The PC client/conference terminal determines whether the device connection that previously sent the conference control instructions is valid, and if so, forwards it. If the session information containing the conference control instructions is in the process of connecting to the port, the session information (that is, the session message) is cached until the device reconnects and then sent.

The server can also proactively send messages to the PC client/conference terminal plug-in through a dedicated interface. For example, the PC client/conference terminal plug-in receives the message and then forwards the message to each validly connected mobile device; if the message is sent individually; To send, the server needs to attach the connection information of the corresponding mobile device through a dedicated interface. After receiving the message, the PC client/conference terminal plug-in forwards the message to the corresponding mobile device.

Referring to Figure 10, an embodiment of the present invention also provides an electronic device 100, including a processor 101, a memory 102, and a computer program stored in the memory 102 and executable on the processor 101. The computer program is processed by the processor. When 101 is executed, each process of the above video conference implementation method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, no details will be described here.

Embodiments of the present invention also provide a computer-readable storage medium. A computer program is stored on the computer-readable storage medium. When the computer program is executed by a processor, the various processes of the above video conference implementation method embodiments are implemented, and can To achieve the same technical effect, to avoid repetition, we will not repeat them here. Wherein, the computer-readable storage medium is such as read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disk or optical disk, etc.

It should be noted that, in this document, the terms "comprising", "comprises" or any other variations thereof are intended to cover a non-exclusive inclusion, such that a process, method, article or device that includes a series of elements not only includes those elements, It also includes other elements not expressly listed or inherent in the process, method, article or apparatus. Without further limitation, an element defined by the statement "comprises a..." does not exclude the presence of additional identical elements in a process, method, article or apparatus that includes that element.

Through the above description of the embodiments, those skilled in the art can clearly understand that the methods of the above embodiments can be implemented by means of software plus the necessary general hardware platform. Of course, it can also be implemented by hardware, but in many cases the former is better. implementation. Based on this understanding, the technical solution of the present invention can be embodied in the form of a software product in essence or that contributes to the existing technology. The computer software product is stored in a storage medium (such as ROM/RAM, disk, CD), including several instructions to cause a terminal (which can be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) to execute the methods described in various embodiments of the present invention.

The embodiments of the present invention have been described above in conjunction with the accompanying drawings. However, the present invention is not limited to the above-mentioned specific implementations. The above-mentioned specific implementations are only illustrative and not restrictive. Those of ordinary skill in the art will Under the inspiration of the present invention, many forms can be made without departing from the spirit of the present invention and the scope protected by the claims, all of which fall within the protection of the present invention.

Claims (18)

1. A method for implementing video conferencing, which is characterized in that it is applied to the first conference terminal and includes: Establish a conference connection with the conference server through the second conference terminal; Receive the received video stream of the first conference terminal forwarded by the second conference terminal; wherein the received video stream of the first conference terminal is obtained by the second conference terminal according to the merged video stream sent by the conference server; The merged video stream is generated by the conference server based on the received video stream of the first conference terminal and the received video stream of the second conference terminal; Display the conference screen according to the received video stream of the first conference terminal; Among them, the second conference terminal saves the conference joining authentication information, or saves at least part of the conference joining authentication information. After receiving the merged video stream, it matches the joining authentication information with the identity information in the merged video stream to identify the person belonging to the first conference terminal. Receive the video stream and forward it to the first conference terminal; as well as After receiving the video stream sent by the first conference terminal, the video stream sent by the first conference terminal is combined with the conference joining authentication information of the first conference terminal, and the joining authentication information is used to identify the identity information of the video stream sent by the first conference terminal, Then forwarded to the conference server. 2. The method according to claim 1, characterized in that, the method further comprises: The sending video stream of the first conference terminal is sent to the second conference terminal, so that the second conference terminal can forward the sending video stream of the first conference terminal to the conference server. 3. The method according to claim 2, characterized in that, the method further comprises: Obtain conference operation information generated by user operations; Generate a video stream sent by the first conference terminal according to the conference operation information. 4. The method according to any one of claims 1-3, wherein establishing a conference connection with the conference server through the second conference terminal includes: Obtain membership authentication information based on user input operations; Send the conference joining authentication information to the second conference terminal; The conference connection is established according to the authentication passing information returned by the second conference terminal based on the conference joining authentication information. 5. The method according to claim 1, characterized in that displaying the conference screen according to the received video stream of the first conference terminal includes: Combining the member avatars corresponding to the first conference terminal and the member avatars corresponding to the second conference terminal to form a group image; Generate a conference member display area in the conference screen based on the grouped image; The conference screen is displayed according to the conference member display area. 6. A video conference implementation method, characterized in that it is applied to the second conference terminal and includes: Receive the conference joining authentication information sent by the first conference terminal; Send the conference joining authentication information to the conference server, so that the conference server authenticates the first conference terminal according to the conference joining authentication information; Establish a conference connection with the first conference terminal according to the authentication passing information returned by the conference server to verify the conference joining authentication information; Receive the merged video stream sent by the conference server through the conference connection; wherein the merged video stream is the video stream received by the conference server based on the video stream received by the first conference terminal and the video stream received by the second conference terminal. Generated; According to the merged video stream, a received video stream of the first conference terminal is obtained; the first conference terminal is one of at least one conference terminal connected to the second conference terminal; Send the received video stream of the first conference terminal to the first conference terminal, so that the first conference terminal can display the conference screen according to the received video stream of the first conference terminal; Among them, the second conference terminal saves the conference joining authentication information, or saves at least part of the conference joining authentication information. After receiving the merged video stream, it matches the joining authentication information with the identity information in the merged video stream to identify the person belonging to the first conference terminal. Receive the video stream and forward it to the first conference terminal; as well as After receiving the video stream sent by the first conference terminal, the video stream sent by the first conference terminal is combined with the conference joining authentication information of the first conference terminal, and the joining authentication information is used to identify the identity information of the video stream sent by the first conference terminal, Then forwarded to the conference server. 7. The method according to claim 6, characterized in that the method further comprises: Obtain the received video stream of the second conference terminal according to the combined video stream; A conference screen is displayed according to the received video stream of the second conference terminal. 8. The method according to claim 6, characterized in that displaying the conference screen according to the received video stream of the second conference terminal includes: In the participant display area of the conference screen, an avatar display frame of at least one participant group is displayed; wherein the group image of the at least one participant group includes a group image of the participant group of the second conference terminal ; The group image of the participating group of the second conference terminal is generated based on the member avatar corresponding to the second conference terminal and the member avatar corresponding to at least one conference terminal connected to the second conference terminal. 9. The method according to claim 8, characterized in that the method further comprises: Receive the video stream sent by the first conference terminal; According to the conference authentication information, the video stream sent by the first conference terminal is sent to the conference server. 10. The method according to claim 6, wherein said sending the received video stream of the first conference terminal to the first conference terminal includes: When the status of the conference connection is connected, send the received video stream of the first conference terminal to the first conference terminal through the conference connection; When the status of the conference connection is not connected, cache the received video stream of the first conference terminal; When the status of the conference connection is converted from unconnected to connected, the buffered received video stream of the first conference terminal is sent to the first conference terminal through the conference connection. 11. A video conference implementation method, characterized in that it is applied to the conference server and includes: Receive the conference joining authentication information of the first conference terminal sent by the second conference terminal; The first conference terminal is verified according to the conference authentication information. If the verification passes, authentication passing information is returned to the second conference terminal, so that the second conference terminal can pass the authentication according to the verification. The information establishes a conference connection with the first conference terminal; Receive the sent video stream of the first conference terminal forwarded by the second conference terminal; Generate a receiving video stream of the first conference terminal according to the sending video stream of the first conference terminal; Generate a merged video stream according to the received video stream of the first conference terminal; Send the merged video stream to a second conference terminal that maintains a conference connection with the first conference terminal, so that the second conference terminal can send the first conference to the first conference terminal according to the merged video stream. Terminal receiving video stream; Among them, the second conference terminal saves the conference joining authentication information, or saves at least part of the conference joining authentication information. After receiving the merged video stream, it matches the joining authentication information with the identity information in the merged video stream to identify the person belonging to the first conference terminal. Receive the video stream and forward it to the first conference terminal; as well as After receiving the video stream sent by the first conference terminal, the video stream sent by the first conference terminal is combined with the conference joining authentication information of the first conference terminal, and the joining authentication information is used to identify the identity information of the video stream sent by the first conference terminal, Then forwarded to the conference server. 12. The method according to claim 11, characterized in that generating a merged video stream according to the received video stream of the first conference terminal includes: The combined video stream is generated based on the received video stream of the first conference terminal, the received video stream of the second conference terminal, and the received video streams of other conference terminals connected to the second conference terminal. 13. A video conference implementation device, characterized in that it is applied to the first conference terminal and includes: The connection module is used to establish a conference connection with the conference server through the second conference terminal; A receiving module configured to receive the received video stream of the first conference terminal forwarded from the second conference terminal; wherein the received video stream of the first conference terminal is the combined video stream sent by the second conference terminal according to the conference server. Obtained from a video stream; the merged video stream is generated by the conference server based on the received video stream of the first conference terminal and the received video stream of the second conference terminal; A display module configured to display the conference screen according to the received video stream of the first conference terminal; Among them, the second conference terminal saves the conference joining authentication information, or saves at least part of the conference joining authentication information. After receiving the merged video stream, it matches the joining authentication information with the identity information in the merged video stream to identify the person belonging to the first conference terminal. Receive the video stream and forward it to the first conference terminal; as well as After receiving the video stream sent by the first conference terminal, the video stream sent by the first conference terminal is combined with the conference joining authentication information of the first conference terminal, and the joining authentication information is used to identify the identity information of the video stream sent by the first conference terminal, Then forwarded to the conference server. 14. A device for implementing video conferencing, characterized in that it is applied to a second conference terminal and includes: The voucher receiving module is used to receive the conference authentication information sent by the first conference terminal; The first sending module is configured to send the conference joining authentication information to the conference server, so that the conference server authenticates the first conference terminal according to the conference joining authentication information; A conference connection module, configured to establish a conference connection with the first conference terminal according to the authentication passing information returned by the conference server to verify the conference joining authentication information; A receiving module configured to receive the combined video stream sent by the conference server through the conference connection; wherein the combined video stream is the video stream received by the conference server based on the video stream received by the first conference terminal and the second conference terminal. Generated by receiving video stream; A merged video stream processing module, configured to obtain a received video stream of a first conference terminal according to the merged video stream; the first conference terminal is one of at least one conference terminal connected to the second conference terminal; The second sending module is configured to send the received video stream of the first conference terminal to the first conference terminal, so that the first conference terminal can display the conference in the display area according to the received video stream of the first conference terminal. picture; Among them, the second conference terminal saves the conference joining authentication information, or saves at least part of the conference joining authentication information. After receiving the merged video stream, it matches the joining authentication information with the identity information in the merged video stream to identify the person belonging to the first conference terminal. Receive the video stream and forward it to the first conference terminal; as well as After receiving the video stream sent by the first conference terminal, the video stream sent by the first conference terminal is combined with the conference joining authentication information of the first conference terminal, and the joining authentication information is used to identify the identity information of the video stream sent by the first conference terminal, Then forwarded to the conference server. 15. A video conference implementation device, characterized in that it is applied to the conference server and includes: The first receiving module is configured to receive the conference joining authentication information of the first conference terminal sent by the second conference terminal; A verification module configured to verify the first conference terminal according to the conference authentication information, and if the verification passes, return authentication passing information to the second conference terminal, so that the second conference terminal Able to establish a conference connection with the first conference terminal based on the authentication pass information; a second receiving module, configured to receive the transmitted video stream of the first conference terminal forwarded by the second conference terminal; A first generating module configured to generate a receiving video stream of the first conference terminal based on the sending video stream of the first conference terminal; A second generation module, configured to generate a merged video stream according to the received video stream of the first conference terminal; A sending module configured to send the merged video stream to a second conference terminal that maintains a conference connection with the first conference terminal, so that the second conference terminal can send the merged video stream to the first conference terminal according to the merged video stream. The video stream received by the first conference terminal; Among them, the second conference terminal saves the conference joining authentication information, or saves at least part of the conference joining authentication information. After receiving the merged video stream, it matches the joining authentication information with the identity information in the merged video stream to identify the person belonging to the first conference terminal. Receive the video stream and forward it to the first conference terminal; as well as After receiving the video stream sent by the first conference terminal, the video stream sent by the first conference terminal is combined with the conference joining authentication information of the first conference terminal, and the joining authentication information is used to identify the identity information of the video stream sent by the first conference terminal, Then forwarded to the conference server. 16. A video conferencing implementation system, characterized in that it includes a video conferencing implementation device applied to a first conference terminal, a video conferencing implementation device applied to a second conference terminal, and a video conferencing implementation device applied to a conference server. Device; wherein, the device for realizing video conferencing applied to the first conference terminal is used to perform the method described in any one of claims 1-5; the device used for realizing video conferencing applied to the second conference terminal is used to perform the claim The method described in any one of claims 6-10; the device for implementing video conferencing applied to the conference server is used to execute the method described in claims 11 or 12. 17. An electronic device, characterized in that it includes: a processor, a memory, and a program stored on the memory and executable on the processor. When the program is executed by the processor, the claims are implemented The steps of the method according to any one of claims 1 to 5, or when the program is executed by the processor, the steps of the method according to any one of claims 6 to 10 are implemented, or the program is When executed by the processor, the steps of the method according to claim 11 or 12 are implemented. 18. A computer-readable storage medium, characterized in that a computer program is stored on the computer-readable storage medium, and when the computer program is executed by a processor, the method of any one of claims 1 to 5 is implemented. The steps of the method; or, when the computer program is executed by the processor, the steps of the method according to any one of claims 6-10 are implemented; or, when the computer program is executed by the processor, the method of claim 11 or Steps of the method described in 12.