WO2017181508A1 - Multimedia meeting control method and server - Google Patents

Abstract

Disclosed is a multimedia meeting control method comprising the following steps: upon receiving a speaking command transmitted by a conference control terminal, a server determines according to the speaking command a corresponding speaker seat and location information corresponding to the speaker seat; the server adjusts, according to the determined location information, a camera to record a video of the speaker seat; and the server transmits to a display screen the video of the speaker seat and displays the same. Also disclosed is a multimedia conference server implementing automatic alignment of a camera to a speaker in a multimedia conference system. Video of the speaker is automatically displayed on a display screen to enable a chairperson seat user to trigger, by means of the conference control terminal, a speaking command to indicate an active speaker. As a result, a video of the corresponding speaker is displayed on the display screen in a meeting room, significantly enhancing a meeting function and increasing user experience.

Description

 Multimedia conference control method and server

Technical field

The present invention relates to the field of multimedia conferences, and in particular, to a multimedia conference control method and a server.

Background technique

With the popularization and development of multimedia technology, visual information technology such as video conferencing and distance learning has been widely used in the conference room field. Multimedia conference rooms are rapidly adopted for their functional diversity (such as on-site conferences, academic reports, training and teaching). popular. The multimedia conference system refers to the integration of sound, light, electrical equipment and software that are interrelated with the conference. In the multimedia conference room, whether it is for reporting, summarizing, reporting, introducing products, etc., the use of computer interactive operation of pictures, texts, sounds, shadows, paintings, fully mobilized the participants' sensory perception, greatly improving the effectiveness of the meeting. Multimedia is increasingly showing its advantages in the office field. However, in the existing multimedia conference system, the cameras of the venue are mostly fixed, and it is impossible to track the video of the speaker, which greatly reduces the user experience.

Therefore, in the multimedia conference system, the camera cannot track the problem of shooting the speaker video, and the problem in this aspect needs to be solved by the inventor.

The above content is only used to assist in understanding the technical solutions of the present invention, and does not constitute an admission that the above is prior art.

Summary of the invention

The main object of the present invention is to solve the problem that the camera cannot track the video of the speaker in the multimedia conference system.

To achieve the above objective, the present invention provides a multimedia conference control method, where the multimedia conference control method includes the following steps:

When receiving the speaking instruction sent by the conference control terminal, the server determines, according to the speaking instruction, the orientation information corresponding to the corresponding speaking seat and the speaking seat;

The server adjusts a camera shooting speaker video according to the determined orientation information;

The server sends the speaker video to a display screen for display.

Optionally, before the step of determining, by the server according to the speaking instruction, the step of determining the orientation information corresponding to the speaker and the speaker according to the speaking instruction, the server further includes:

The server displays a preset agent list by using the conference control terminal, so that the user determines the speaker based on the agent list and triggers a corresponding speaking instruction;

The server receives a speaking instruction sent by the conference control terminal.

Optionally, before the step of the server displaying the preset agent list by the conference control terminal for the user to determine the speaker based on the agent list and triggering the corresponding speaking instruction, the method further includes:

Receiving, by the server, a setting instruction sent by the conference control terminal, receiving, by the user, the agent list input by the conference control terminal and the orientation information corresponding to each agent;

The server saves the received agent list and the orientation information corresponding to each agent.

Optionally, after the step of the server sending the video to the display screen for display, the method further includes:

The server receives video data of each of the sub-sites through a network connection;

The server performs jigsaw processing on the video data of each of the sub-sites to obtain a puzzle video;

The server sends the puzzle video to a display for display.

Optionally, before the step of determining, by the server according to the speaking instruction, the step of determining the orientation information corresponding to the speaker and the speaker according to the speaking instruction, the server further includes:

The server displays a preset agent list by using the conference control terminal, so that the user determines the speaker based on the agent list and triggers a corresponding speaking instruction;

The server receives a speaking instruction sent by the conference control terminal.

Optionally, before the step of the server displaying the preset agent list by the conference control terminal for the user to determine the speaker based on the agent list and triggering the corresponding speaking instruction, the method further includes:

Receiving, by the server, a setting instruction sent by the conference control terminal, receiving, by the user, the agent list input by the conference control terminal and the orientation information corresponding to each agent;

The server saves the received agent list and the orientation information corresponding to each agent.

Optionally, the step of the server receiving the video data of each of the sub-sites through the network connection includes:

The server detects the network bandwidth of the network connection in real time when receiving the video data of the conference site through the network connection;

The server determines a video bit rate and a video resolution corresponding to the changed network bandwidth when detecting that the network bandwidth changes;

The server switches to the determined video bit rate and video resolution to continue receiving video data.

Optionally, before the step of determining, by the server according to the speaking instruction, the step of determining the orientation information corresponding to the speaker and the speaker according to the speaking instruction, the server further includes:

The server displays a preset agent list by using the conference control terminal, so that the user determines the speaker based on the agent list and triggers a corresponding speaking instruction;

The server receives a speaking instruction sent by the conference control terminal.

Optionally, before the step of the server displaying the preset agent list by the conference control terminal for the user to determine the speaker based on the agent list and triggering the corresponding speaking instruction, the method further includes:

Receiving, by the server, a setting instruction sent by the conference control terminal, receiving, by the user, the agent list input by the conference control terminal and the orientation information corresponding to each agent;

The server saves the received agent list and the orientation information corresponding to each agent.

In addition, to achieve the above object, the present invention further provides a multimedia conference server, where the multimedia conference server includes:

The receiving module is configured to: when receiving the speaking instruction sent by the conference control terminal, determine, according to the speaking instruction, the orientation information corresponding to the corresponding speaking seat and the speaking seat;

a control module, configured to adjust a camera shooting speaker video according to the determined orientation information;

a sending module, configured to send the speaker video to a display screen for display.

Optionally, the multimedia conference server further includes a display module;

The display module is configured to display a preset agent list by using the conference control terminal, so that the user determines a speaker based on the agent list and triggers a corresponding speaking instruction;

The receiving module is further configured to receive a speaking instruction sent by the conference control terminal.

Optionally, the multimedia conference server further includes a storage module;

The receiving module is further configured to: when receiving the setting instruction sent by the conference control terminal, receive the agent list input by the user based on the conference control terminal and the orientation information corresponding to each agent;

The storage module is configured to save the received agent list and the orientation information corresponding to each agent.

Optionally, the multimedia conference server further includes a multimedia module;

The receiving module is further configured to receive video data of each of the sub-sites through a network connection;

The multimedia module is configured to perform jigsaw processing on video data of each of the sub-sites to obtain a puzzle video;

The sending module is further configured to send the puzzle video to a display screen for display.

Optionally, the multimedia conference server further includes a display module;

The display module is configured to display a preset agent list by using the conference control terminal, so that the user determines a speaker based on the agent list and triggers a corresponding speaking instruction;

The receiving module is further configured to receive a speaking instruction sent by the conference control terminal.

Optionally, the multimedia conference server further includes a storage module;

The receiving module is further configured to: when receiving the setting instruction sent by the conference control terminal, receive the agent list input by the user based on the conference control terminal and the orientation information corresponding to each agent;

The storage module is configured to save the received agent list and the orientation information corresponding to each agent.

Optionally, the receiving module includes a detecting unit, a determining unit, and a switching unit;

The detecting unit is configured to detect a network bandwidth of the network connection in real time when receiving video data of a sub-site through a network connection;

The determining unit is configured to determine a video bit rate and a video resolution corresponding to the changed network bandwidth when detecting that the network bandwidth changes;

The switching unit is configured to switch to the determined video bit rate and video resolution to continue receiving video data.

Optionally, the multimedia conference server further includes a display module;

The display module is configured to display a preset agent list by using the conference control terminal, so that the user determines a speaker based on the agent list and triggers a corresponding speaking instruction;

The receiving module is further configured to receive a speaking instruction sent by the conference control terminal.

Optionally, the multimedia conference server further includes a storage module;

The receiving module is further configured to: when receiving the setting instruction sent by the conference control terminal, receive the agent list input by the user based on the conference control terminal and the orientation information corresponding to each agent;

The storage module is configured to save the received agent list and the orientation information corresponding to each agent.

The invention receives the speaking instruction sent by the user based on the conference control terminal by the server, and controls the camera to aim at the corresponding orientation according to the speaking instruction, so as to realize the automatic positioning of the camera in the multimedia conference system, the speaker video It is automatically displayed on the display screen, so that the chairman station can trigger the speaking command to indicate who is speaking through the conference terminal. The corresponding speaker video is displayed on the display screen of the conference site, which greatly improves the conference effect and improves the user experience.

DRAWINGS

1 is a hardware architecture diagram of a multimedia conference system implementing various embodiments of the present invention;

2 is a schematic flowchart of a first embodiment of a multimedia conference control method according to the present invention;

3 is a schematic flowchart of a second embodiment of a multimedia conference control method according to the present invention;

4 is a schematic flowchart diagram of a third embodiment of a multimedia conference control method according to the present invention;

FIG. 5 is a schematic flowchart diagram of a fourth embodiment of a multimedia conference control method according to the present invention; FIG.

6 is a schematic diagram of an effect of an embodiment of an agent list displayed by a conference control terminal according to the present invention;

7 is a schematic diagram of functional modules of a first embodiment of a multimedia conference server according to the present invention;

8 is a schematic diagram of functional modules of a second embodiment of a multimedia conference server according to the present invention;

9 is a schematic diagram of functional modules of a third embodiment of a multimedia conference server according to the present invention;

FIG. 10 is a schematic diagram of functional modules of a fourth embodiment of a multimedia conference server according to the present invention.

The implementation, functional features, and advantages of the present invention will be further described in conjunction with the embodiments.

detailed description

It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

A multimedia conference system implementing various embodiments of the present invention will now be described with reference to the accompanying drawings. FIG. 1 is a hardware architecture diagram of a multimedia conference system implementing various embodiments of the present invention. The multimedia conference system may include a server 100, a conference control terminal 200, and external devices such as a camera 301, a microphone 302, a display screen 303, an audio 304, and the like.

The conference control terminal 200 is configured to generate a corresponding instruction according to a command input by the host user and send it to the server 100 to control various operations of the conference service. The conference control terminal 200 can be a terminal of a mobile phone, a smart phone, a notebook computer, a PAD (tablet computer), a desktop computer, or the like.

The camera 301 and the microphone 302 are used to collect audio and video data. The display screen 303 and the audio 304 device are configured to output audio and video processed by the multimedia device 102.

The server 100 may include a multimedia device 102, a softswitch device 103, a resource access device 104, a controller 101, and the like. FIG. 1 illustrates a server 100 having various devices, but it should be understood that implementation is not required. All the devices shown. More or fewer devices can be implemented instead. The control signaling between the devices in the server 100 can be implemented through the SIP protocol, and the multimedia data passes the RTP protocol (Real-time). Transport Protocol, real-time transport protocol) bearer transmission. The softswitch device 103 is configured to control the registration of the various resources (such as camera resources, display resources, microphone resources, etc.) of the terminal 200 and the conference room, call routing, and the like. The controller 101 is used for control and management of conference services. The multimedia device 102 is used for processing audio and video, such as audio mixing, video puzzles, and the like. The resource access device 104 is configured to access a display 303, a camera 301, a microphone 302, an audio 304, and the like in the conference room.

Based on the hardware architecture of the multimedia conference system described above, the present invention provides a multimedia conference control method.

Referring to FIG. 2, FIG. 2 is a schematic flowchart diagram of a first embodiment of a multimedia conference control method according to the present invention.

In this embodiment, the multimedia conference control method includes:

Step S10: When receiving the speaking instruction sent by the conference control terminal, the server determines, according to the speaking instruction, the orientation information corresponding to the corresponding speaking seat and the speaking seat;

The host user may trigger a speaking instruction for instructing the corresponding speaker to speak by the conference control terminal, and the conference control terminal sends the speaking instruction to the server, and when the server receives the speaking instruction, according to the The speaking instruction determines the orientation information corresponding to the corresponding speaker and the speaker to control the camera to align the corresponding orientation to perform the shooting of the speaker video.

The conference control terminal may add the agent information corresponding to the speaker as the speaker information to the speaking instruction, and when receiving the speaking instruction, the server determines the corresponding speaker information according to the speaking instruction. And querying the orientation information corresponding to the speaker locally saved by the server according to the speaker information, so as to adjust the camera to shoot the video according to the orientation information.

The server can communicate with the conference control terminal through a SIP protocol. The speaking instruction may be transmitted between the server and the conference control terminal in a format of an INFO message.

Step S20, the server adjusts a camera shooting speaker video according to the determined orientation information;

The server adjusts, according to the determined orientation information, that the corresponding camera is aligned with the speaker to perform the shooting of the video of the speaker. The orientation information may include a preset shooting angle for the server to adjust a corresponding camera angle according to the shooting angle to align the speaker. Further, the camera may be a single one or a plurality of cameras. When there are a plurality of cameras for capturing the video of the speaker seat, the orientation information of each camera is respectively set corresponding to the same agent, and the server is configured according to each camera. The corresponding orientation information controls the angle adjustment of each camera.

Further, the server may further determine the corresponding speaker information when receiving the speaking instruction of the conference control terminal, and control to open the microphone device corresponding to the speaker to collect the speaker audio data, and collect the speaker's data. After the audio data is transmitted, it is mixed by the media server in the server and sent to the audio device for output.

Step S30, the server sends the video of the speaker to a display screen for display.

The server can send the video of the speaker shot by the camera to the display screen for display by using the RTP protocol. Further, the conference control terminal may further add, to the speaking instruction, a control command for displaying a video of the speaker selected by the host user, and the server determines, according to the speaking instruction, whether to send the corresponding video of the speaker. Displaying to the display screen, if yes, the server sends the video of the speaker to the display screen for display; if not, deleting the video of the speaker.

The server can be connected to the display through a VGA/HDMI/DVI/SDI interface.

In this embodiment, the server receives the speaking instruction sent by the user based on the conference control terminal, and controls the camera to align the corresponding orientation according to the speaking instruction to perform the shooting of the speaker video, thereby realizing the automatic alignment of the camera in the multimedia conference system. The video is automatically displayed on the display screen, so that the chairman station can trigger the speaking command to indicate who is speaking through the conference terminal. The corresponding speaker video is displayed on the display screen of the conference site, which greatly improves the conference effect and improves the user experience.

Referring to FIG. 3, FIG. 3 is a schematic flowchart diagram of a second embodiment of a multimedia conference control method according to the present invention. Based on the first embodiment of the foregoing multimedia conference control method, after the step S30, the method further includes:

Step S40, the server receives video data of each of the sub-sites through a network connection;

The server can receive video data of each sub-site through the RTP protocol. The server may connect to a remote conference site server or a SIP conference terminal of the conference site through the network to receive video data of each of the conference sites.

Step S50, the server performs the puzzle processing on the video data of each of the sub-sites to obtain a puzzle video;

The server can implement the puzzle processing of the video data of each of the sub-sites through the multimedia device in the server to obtain a puzzle video containing the video of each of the sub-sites. The server can perform puzzle processing in various ways, for example, 1+1 (1 main conference video + 1 sub-site video), 4 sub-screen, 6-screen, 1+4 (1 main conference video + 4) Video of the sub-site), 1+5 (1 main venue video + 5 sub-site videos), 9-screen and so on.

Step S60, the server sends the puzzle video to a display screen for display.

The server sends the puzzle video to a display for display. Further, the display screen accessed by the resource access device of the server may be a single display screen or multiple display screens. For example, when multiple screens are accessed, the One display is used to display the puzzle video of all the venues, the second display is used to display the speaker video, and the third display is used to display documents such as PPT.

In this embodiment, the video data of each sub-site is received by the server, and the jigsaw video is displayed according to the video data, and the video of each sub-site is displayed, which improves the conference effect and improves the user experience.

Referring to FIG. 4, FIG. 4 is a schematic flowchart diagram of a third embodiment of a multimedia conference control method according to the present invention. Based on the second embodiment of the foregoing multimedia conference control method, the step S40 includes:

Step S41, the server detects the network bandwidth of the network connection in real time when receiving the video data of the conference site through the network connection;

Step S42, the server determines a video bit rate and a video resolution corresponding to the changed network bandwidth when detecting that the network bandwidth changes.

In step S43, the server switches to the determined video bit rate and video resolution to continue receiving video data.

The server detects the network bandwidth of the network connection in real time during the process of receiving the video data of the sub-site through the network connection; when detecting the change of the network bandwidth, the server determines the video code corresponding to the changed network bandwidth. Rate and video resolution; the server switches to the determined video bit rate and video resolution to continue receiving video data. For example, the server receives the video data of the conference site according to the code rate of 2000 kbps, detects that the network bandwidth changes, and the changed network bandwidth conforms to the 800 kbps code rate, and the server switches to the 800 kbps code rate to continue receiving the current location. Video data.

In this embodiment, the resolution and the code rate of the video are adjusted according to the network bandwidth, which avoids problems such as video jamming and flower screen caused by network deterioration during the conference, and can automatically adjust the video resolution and code rate to adapt to the network bandwidth when the network is deteriorated. , to achieve the best video effects under the current network bandwidth conditions, improve the user experience.

Referring to FIG. 5, FIG. 5 is a schematic flowchart diagram of a fourth embodiment of a multimedia conference control method according to the present invention. Based on the first embodiment of the foregoing multimedia conference control method, before the step S10, the method further includes:

In step S11, the server displays a preset agent list through the conference control terminal, so that the user determines the speaker based on the agent list and triggers a corresponding speaking instruction;

Step S12: The server receives the speaking instruction sent by the conference control terminal.

The server displays a preset agent list through the conference control terminal, so that the user determines the speaker based on the agent list and triggers a corresponding speaking instruction, and the server receives the statement sent by the conference control terminal to The speaking instruction performs a corresponding operation.

The agent list may be stored in the server, and when the server receives a display instruction triggered by the conference terminal, the server sends the agent list to the conference terminal for display. The conference control terminal may trigger a corresponding speaking instruction to indicate that the participant in the agent speaks when detecting the click operation of the host user based on the agent list. Specifically, referring to FIG. 6, FIG. 6 is a schematic diagram of an effect of an embodiment of a seat list displayed by a conference control terminal according to the present invention.

Further, before the step S11, the server may further receive, according to the setting instruction sent by the conference control terminal, the agent list input by the user based on the conference terminal and the orientation information corresponding to each agent; the server The received seat list and the orientation information corresponding to each seat are saved.

In this embodiment, the conference control terminal triggers the corresponding speaking instruction, and receives the speaking instruction sent by the conference control terminal through the server, and controls the camera to align the corresponding orientation according to the speaking instruction to perform the shooting of the speaker video, thereby realizing the automatic camera pair in the multimedia conference system. The prospective spokesperson and the spokesperson video are automatically displayed on the display screen, so that the podium user can trigger the speaking command to indicate who is speaking through the conference control terminal, and the corresponding speaker video is displayed on the display screen of the conference site, which greatly improves the conference effect. , improved user experience.

The execution bodies of the multimedia conference control methods of the foregoing first to fourth embodiments may each be a multimedia conference system or a server disposed in the multimedia conference system. Further, the multimedia conference control method may be implemented by a client control program installed in the multimedia conference system or the multimedia conference server.

The invention further provides a multimedia conference server.

Referring to FIG. 7, FIG. 7 is a schematic diagram of functional modules of a first embodiment of a multimedia conference server according to the present invention.

In this embodiment, the multimedia conference server includes: a receiving module 10, a control module 20, and a sending module 30.

The receiving module 10 is configured to, according to the speaking instruction, determine the orientation information corresponding to the speaking seat and the speaking seat according to the speaking instruction when receiving the speaking instruction sent by the conference controlling terminal;

The host user may trigger a speaking instruction for instructing the corresponding speaker to speak by the conference control terminal, and the conference control terminal sends the speaking instruction to the server, and when the server receives the speaking instruction, according to the The speaking instruction determines the orientation information corresponding to the corresponding speaker and the speaker to control the camera to align the corresponding orientation to perform the shooting of the speaker video.

The conference control terminal may add the agent information corresponding to the speaker as the speaker information to the speaking instruction, and when receiving the speaking instruction, the server determines the corresponding speaker information according to the speaking instruction. And querying the orientation information corresponding to the speaker locally saved by the server according to the speaker information, so as to adjust the camera to shoot the video according to the orientation information.

The server can communicate with the conference control terminal through a SIP protocol. The speaking instruction may be transmitted between the server and the conference control terminal in a format of an INFO message.

The control module 20 is configured to adjust a camera shooting speaker video according to the determined orientation information;

The server adjusts, according to the determined orientation information, that the corresponding camera is aligned with the speaker to perform the shooting of the video of the speaker. The orientation information may include a preset shooting angle for the server to adjust a corresponding camera angle according to the shooting angle to align the speaker. Further, the camera may be a single one or a plurality of cameras. When there are a plurality of cameras for capturing the video of the speaker seat, the orientation information of each camera is respectively set corresponding to the same agent, and the server is configured according to each camera. The corresponding orientation information controls the angle adjustment of each camera.

Further, the server may further determine the corresponding speaker information when receiving the speaking instruction of the conference control terminal, and control to open the microphone device corresponding to the speaker to collect the speaker audio data, and collect the speaker's data. After the audio data is transmitted, it is mixed by the media server in the server and sent to the audio device for output.

The sending module 30 is configured to send the video of the speaker to a display screen for display.

The server can send the video of the speaker shot by the camera to the display screen for display by using the RTP protocol. Further, the conference control terminal may further add, to the speaking instruction, a control command for displaying a video of the speaker selected by the host user, and the server determines, according to the speaking instruction, whether to send the corresponding video of the speaker. Displaying to the display screen, if yes, the server sends the video of the speaker to the display screen for display; if not, deleting the video of the speaker.

The server can be connected to the display through a VGA/HDMI/DVI/SDI interface.

In this embodiment, the server receives the speaking instruction sent by the user based on the conference control terminal, and controls the camera to align the corresponding orientation according to the speaking instruction to perform the shooting of the speaker video, thereby realizing the automatic alignment of the camera in the multimedia conference system. The video is automatically displayed on the display screen, so that the chairman station can trigger the speaking command to indicate who is speaking through the conference terminal. The corresponding speaker video is displayed on the display screen of the conference site, which greatly improves the conference effect and improves the user experience.

Referring to Figure 8, Figure 8 is a schematic diagram of functional modules of a second embodiment of the apparatus of the present invention. Based on the first embodiment of the multimedia conference server, the multimedia conference server further includes a multimedia module 40.

The receiving module 10 is further configured to receive video data of each of the sub-sites through a network connection;

The server can receive video data of each sub-site through the RTP protocol. The server may connect to a remote conference site server or a SIP conference terminal of the conference site through the network to receive video data of each of the conference sites.

The multimedia module 40 is configured to perform puzzle processing on video data of each of the sub-sites to obtain a puzzle video;

The server can implement the puzzle processing of the video data of each of the sub-sites through the multimedia device in the server to obtain a puzzle video containing the video of each of the sub-sites. The server can perform puzzle processing in various ways, for example, 1+1 (1 main conference video + 1 sub-site video), 4 sub-screen, 6-screen, 1+4 (1 main conference video + 4) Video of the sub-site), 1+5 (1 main venue video + 5 sub-site videos), 9-screen and so on.

The sending module 30 is further configured to send the puzzle video to a display screen for display.

The server sends the puzzle video to a display for display. Further, the display screen accessed by the resource access device of the server may be a single display screen or multiple display screens. For example, when multiple screens are accessed, the One display is used to display the puzzle video of all the venues, the second display is used to display the speaker video, and the third display is used to display documents such as PPT.

In this embodiment, the video data of each sub-site is received by the server, and the jigsaw video is displayed according to the video data, and the video of each sub-site is displayed, which improves the conference effect and improves the user experience.

Referring to FIG. 9, FIG. 9 is a schematic diagram of functional modules of a third embodiment of the apparatus of the present invention. The receiving module 10 includes a detecting unit 11, a determining unit 12, and a switching unit 13 based on the second embodiment of the multimedia conference server.

The detecting unit 11 is configured to detect a network bandwidth of the network connection in real time when receiving video data of a sub-site through a network connection;

The determining unit 12 is configured to determine a video bit rate and a video resolution corresponding to the changed network bandwidth when detecting that the network bandwidth changes;

The switching unit 13 is configured to switch to the determined video bit rate and video resolution to continue receiving video data.

The server detects the network bandwidth of the network connection in real time during the process of receiving the video data of the sub-site through the network connection; when detecting the change of the network bandwidth, the server determines the video code corresponding to the changed network bandwidth. Rate and video resolution; the server switches to the determined video bit rate and video resolution to continue receiving video data. For example, the server receives the video data of the conference site according to the code rate of 2000 kbps, detects that the network bandwidth changes, and the changed network bandwidth conforms to the 800 kbps code rate, and the server switches to the 800 kbps code rate to continue receiving the current location. Video data.

In this embodiment, the resolution and the code rate of the video are adjusted according to the network bandwidth, which avoids problems such as video jamming and flower screen caused by network deterioration during the conference, and can automatically adjust the video resolution and code rate to adapt to the network bandwidth when the network is deteriorated. , to achieve the best video effects under the current network bandwidth conditions, improve the user experience.

Referring to FIG. 10, FIG. 10 is a schematic diagram of functional modules of a fourth embodiment of the apparatus of the present invention. The multimedia conference server further includes a display module 50, based on the first embodiment of the multimedia conference server;

The display module 50 is configured to display a preset agent list by using the conference control terminal, so that the user determines a speaker based on the agent list and triggers a corresponding speaking instruction;

The receiving module 10 is further configured to receive a speaking instruction sent by the conference control terminal.

The server displays a preset agent list through the conference control terminal, so that the user determines the speaker based on the agent list and triggers a corresponding speaking instruction, and the server receives the statement sent by the conference control terminal to The speaking instruction performs a corresponding operation.

The agent list may be stored in the server, and when the server receives a display instruction triggered by the conference terminal, the server sends the agent list to the conference terminal for display. The conference control terminal may trigger a corresponding speaking instruction to indicate that the participant in the agent speaks when detecting the click operation of the host user based on the agent list. Specifically, referring to FIG. 6, FIG. 6 is a schematic diagram of an effect of an embodiment of a seat list displayed by a conference control terminal according to the present invention.

Further, the multimedia conference server further includes a storage module, and the receiving module is further configured to: when receiving the setting instruction sent by the conference control terminal, receive a seat list and each agent input by the user based on the conference control terminal Corresponding orientation information; the storage module is configured to save the received agent list and the orientation information corresponding to each agent.

In this embodiment, the conference control terminal triggers the corresponding speaking instruction, and receives the speaking instruction sent by the conference control terminal through the server, and controls the camera to align the corresponding orientation according to the speaking instruction to perform the shooting of the speaker video, thereby realizing the automatic camera pair in the multimedia conference system. The prospective spokesperson and the spokesperson video are automatically displayed on the display screen, so that the podium user can trigger the speaking command to indicate who is speaking through the conference control terminal, and the corresponding speaker video is displayed on the display screen of the conference site, which greatly improves the conference effect. , improved user experience.

It is to be understood that the term "comprises", "comprising", or any other variants thereof, is intended to encompass a non-exclusive inclusion, such that a process, method, article, or device comprising a series of elements includes those elements. It also includes other elements that are not explicitly listed, or elements that are inherent to such a process, method, article, or device. An element that is defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device that comprises the element.

The serial numbers of the embodiments of the present invention are merely for the description, and do not represent the advantages and disadvantages of the embodiments.

Through the description of the above embodiments, those skilled in the art can clearly understand that the foregoing embodiment method can be implemented by means of software plus a necessary general hardware platform, and of course, can also be through hardware, but in many cases, the former is better. Implementation. Based on such understanding, the technical solution of the present invention, which is essential or contributes to the prior art, may be embodied in the form of a software product stored in a storage medium (such as ROM/RAM, disk, The optical disc includes a number of instructions for causing a terminal device (which may be a cell phone, a computer, a server, an air conditioner, or a network device, etc.) to perform the methods described in various embodiments of the present invention.

The above are only the preferred embodiments of the present invention, and are not intended to limit the scope of the invention, and the equivalent structure or equivalent process transformations made by the description of the present invention and the drawings are directly or indirectly applied to other related technical fields. The same is included in the scope of patent protection of the present invention.

Claims (18)

 A multimedia conference control method, characterized in that the multimedia conference control method comprises the following steps: When receiving the speaking instruction sent by the conference control terminal, the server determines, according to the speaking instruction, the orientation information corresponding to the corresponding speaking seat and the speaking seat; The server adjusts a camera shooting speaker video according to the determined orientation information; The server sends the speaker video to a display screen for display. The multimedia conference control method according to claim 1, wherein when the server receives the speaking instruction of the conference control terminal, the server determines, according to the speaking instruction, the orientation information corresponding to the speaking seat and the speaking seat. Before the step, it also includes: The server displays a preset agent list by using the conference control terminal, so that the user determines the speaker based on the agent list and triggers a corresponding speaking instruction; The server receives a speaking instruction sent by the conference control terminal. The multimedia conference control method according to claim 2, wherein the server displays a preset agent list through the conference control terminal, so that the user determines the speaker based on the agent list and triggers a corresponding speaking instruction. Before the step, it also includes: Receiving, by the server, a setting instruction sent by the conference control terminal, receiving, by the user, the agent list input by the conference control terminal and the orientation information corresponding to each agent; The server saves the received agent list and the orientation information corresponding to each agent. The multimedia conference control method according to claim 1, wherein after the step of the server transmitting the video to the display screen for display, the method further includes: The server receives video data of each of the sub-sites through a network connection; The server performs jigsaw processing on the video data of each of the sub-sites to obtain a puzzle video; The server sends the puzzle video to a display for display. The multimedia conference control method according to claim 4, wherein, when receiving the speaking instruction of the conference controlling terminal, the server determines, according to the speaking instruction, the orientation information corresponding to the speaking seat and the speaking seat. Before the step, it also includes: The server displays a preset agent list by using the conference control terminal, so that the user determines the speaker based on the agent list and triggers a corresponding speaking instruction; The server receives a speaking instruction sent by the conference control terminal. The multimedia conference control method according to claim 5, wherein the server displays a preset agent list through the conference control terminal, so that the user determines the speaker based on the agent list and triggers a corresponding speaking instruction. Before the step, it also includes: Receiving, by the server, a setting instruction sent by the conference control terminal, receiving, by the user, the agent list input by the conference control terminal and the orientation information corresponding to each agent; The server saves the received agent list and the orientation information corresponding to each agent. The multimedia conference control method according to claim 4, wherein the step of the server receiving the video data of each of the sub-sites through the network connection comprises: The server detects the network bandwidth of the network connection in real time when receiving the video data of the conference site through the network connection; The server determines a video bit rate and a video resolution corresponding to the changed network bandwidth when detecting that the network bandwidth changes; The server switches to the determined video bit rate and video resolution to continue receiving video data. The multimedia conference control method according to claim 7, wherein the server determines, according to the speaking instruction, the orientation information corresponding to the speaking seat and the speaking seat when receiving the speaking instruction of the conference controlling terminal. Before the step, it also includes: The server displays a preset agent list by using the conference control terminal, so that the user determines the speaker based on the agent list and triggers a corresponding speaking instruction; The server receives a speaking instruction sent by the conference control terminal. The multimedia conference control method according to claim 8, wherein the server displays a preset agent list through the conference control terminal, so that the user determines the speaker based on the agent list and triggers a corresponding speaking instruction. Before the step, it also includes: Receiving, by the server, a setting instruction sent by the conference control terminal, receiving, by the user, the agent list input by the conference control terminal and the orientation information corresponding to each agent; The server saves the received agent list and the orientation information corresponding to each agent. A multimedia conference server, characterized in that the multimedia conference server comprises: The receiving module is configured to: when receiving the speaking instruction sent by the conference control terminal, determine, according to the speaking instruction, the orientation information corresponding to the corresponding speaking seat and the speaking seat; a control module, configured to adjust a camera shooting speaker video according to the determined orientation information; a sending module, configured to send the speaker video to a display screen for display. The multimedia conference server according to claim 10, wherein the multimedia conference server further comprises a display module; The display module is configured to display a preset agent list by using the conference control terminal, so that the user determines a speaker based on the agent list and triggers a corresponding speaking instruction; The receiving module is further configured to receive a speaking instruction sent by the conference control terminal. The multimedia conference server according to claim 11, wherein the multimedia conference server further comprises a storage module; The receiving module is further configured to: when receiving the setting instruction sent by the conference control terminal, receive the agent list input by the user based on the conference control terminal and the orientation information corresponding to each agent; The storage module is configured to save the received agent list and the orientation information corresponding to each agent. The multimedia conference server according to claim 10, wherein the multimedia conference server further comprises a multimedia module; The receiving module is further configured to receive video data of each of the sub-sites through a network connection; The multimedia module is configured to perform jigsaw processing on video data of each of the sub-sites to obtain a puzzle video; The sending module is further configured to send the puzzle video to a display screen for display. The multimedia conference server according to claim 13, wherein the multimedia conference server further comprises a display module; The display module is configured to display a preset agent list by using the conference control terminal, so that the user determines a speaker based on the agent list and triggers a corresponding speaking instruction; The receiving module is further configured to receive a speaking instruction sent by the conference control terminal. The multimedia conference server according to claim 14, wherein the multimedia conference server further comprises a storage module; The receiving module is further configured to: when receiving the setting instruction sent by the conference control terminal, receive the agent list input by the user based on the conference control terminal and the orientation information corresponding to each agent; The storage module is configured to save the received agent list and the orientation information corresponding to each agent. The multimedia conference server according to claim 13, wherein the receiving module comprises a detecting unit, a determining unit and a switching unit; The detecting unit is configured to detect a network bandwidth of the network connection in real time when receiving video data of a sub-site through a network connection; The determining unit is configured to determine a video bit rate and a video resolution corresponding to the changed network bandwidth when detecting that the network bandwidth changes; The switching unit is configured to switch to the determined video bit rate and video resolution to continue receiving video data. The multimedia conference server according to claim 16, wherein the multimedia conference server further comprises a display module; The display module is configured to display a preset agent list by using the conference control terminal, so that the user determines a speaker based on the agent list and triggers a corresponding speaking instruction; The receiving module is further configured to receive a speaking instruction sent by the conference control terminal. The multimedia conference server according to claim 17, wherein the multimedia conference server further comprises a storage module; The receiving module is further configured to: when receiving the setting instruction sent by the conference control terminal, receive the agent list input by the user based on the conference control terminal and the orientation information corresponding to each agent; The storage module is configured to save the received agent list and the orientation information corresponding to each agent.