CN1620135A - Conference television system and method of realizing maintaining business in said system - Google Patents

Abstract

A method for realizing business maintenance in a video conferencing system, said system comprising a communication network, a video conference device connected to the communication network and a network status monitoring subsystem, the method steps are: A. start network status monitoring after the conference is held Subsystem; B. The network status monitoring subsystem monitors the communication network in the video conferencing system; C. The network status monitoring subsystem decides whether to enable the abnormal situation processing module according to the detection results, that is, if an abnormal situation is detected in the communication network occurs, then enable the abnormal situation processing module, if no abnormal situation is detected in the communication network, then do not do any processing, and return to step B. The invention also provides a corresponding video conference system.

Description

Video conference system and method for realizing business maintenance in the system

technical field

The invention relates to the technical field of multimedia communication, in particular to a video conference system and a method for realizing service maintenance in the system.

Background technique

Because conference TV can enable remote users to realize "face-to-face" communication through the communication network, it greatly increases the effect of conference participation and shortens the distance between participants, and thus is more and more widely used.

A general video conference system consists of a multipoint control unit (MCU), a terminal and a communication network, where the communication network can be any digital network, such as existing ISDN, DDN, IP, etc. As a real-time interactive application, video conferencing has relatively high requirements on the performance and quality of the network (such as ISDN bit error rate and slip code; IP packet loss rate, delay and jitter, etc.). However, in the existing video conferencing system, the video conferencing equipment (MCU and terminal) on the user side has poor ability to adapt to the network, especially when the communication network has abnormal conditions such as code slippage, packet loss, and delay at the same time. , communication stability and video and audio quality will deteriorate, and even the meeting cannot be carried out normally and smoothly.

It can be seen that how to design a videoconferencing system so that the conference can still run stably and normally under multiple abnormal conditions at the same time is a problem that needs to be solved in the industry.

Contents of the invention

The invention provides a video conference system and a method for realizing service maintenance in the system, so as to solve the problem that the existing video conference system cannot hold a meeting stably and normally when multiple abnormal situations occur at the same time.

In order to solve the above problems, the present invention provides the following technical solutions:

A method for realizing service maintenance in a video conferencing system, said system comprising a communication network, a video conference device connected to the communication network and a network status monitoring subsystem, the method being specifically: A, starting network status monitoring after the conference is held Subsystem; B. The network status monitoring subsystem monitors the communication network in the video conferencing system; C. The network status monitoring subsystem decides whether to enable the abnormal situation processing module according to the detection results, that is, if an abnormal situation is detected in the communication network occurs, then enable the abnormal situation processing module, if no abnormal situation is detected in the communication network, then do not do any processing, and return to step B.

Described C step is specifically:

If a bit error occurs, enable the anti-error module to reduce the impact of the bit error and recover from the bit error state as quickly as possible;

If there is network packet loss, enable the anti-packet loss module to reduce the impact of packet loss and recover from the packet loss state as quickly as possible;

If there is network jitter, enable the anti-jitter module to eliminate the influence of network jitter as much as possible and provide a stable video and audio stream output;

If there is a line slip code, enable the slip code adjustment module so that the application is not interrupted;

Enable disconnection recall module if a call is disconnected on a channel or channels;

If the line is unavailable or the quality is degraded, enable the automatic reduction module to appropriately reduce the call connection rate or adaptively reduce the application rate during the application process;

If there is a large bit error or line interruption on the line where the voice channel is located, then enable the voice channel automatic switching module to change the voice transmission channel to other normal available line channels;

If the switching device of the access point of the video conferencing equipment does not support the call of the data bearer or there is no data bearer route available in the call network, enable the data/voice call hybrid module so as to use the voice bearer to make the call.

A video conference equipment system, including a communication network, a multipoint control unit (MCU) and a terminal connected to the communication network, the system also includes:

Network status monitoring subsystem;

The automatic speed reduction module is connected with the network monitoring subsystem, and automatically reduces the call connection rate or application rate under the control of the network monitoring subsystem;

The disconnection recall module is connected with the network monitoring subsystem and the automatic speed reduction module, and under the control of the network monitoring subsystem, re-calls and connects the line that has been hung up or adopts automatic speed reduction to adapt to the applicable rate;

The anti-packet loss module is connected with the network monitoring subsystem, reduces the impact of packet loss and recovers from the packet loss state under the control of the network monitoring subsystem;

An anti-jitter module, connected to the network monitoring subsystem, eliminates the influence of the jitter generated by the network under the control of the network monitoring subsystem;

The sliding code adjustment module is connected with the network monitoring subsystem, and calibrates or recalculates the relative delay between channels under the control of the network monitoring subsystem;

An anti-error module, connected to the network monitoring subsystem, reduces the impact of bit errors and recovers from the error state under the control of the network monitoring subsystem;

The voice channel dynamic switching module is connected with the network monitoring subsystem, and under the control of the network monitoring subsystem, the voice channel on the line with larger error code or interruption will be switched to other normal line channels;

The data/voice call mixing module is connected with the network monitoring subsystem, and under the control of the network monitoring subsystem, when the data bearer call fails, the voice bearer is used to make a call.

The present invention has the characteristics of improving connection rate, quick recovery in case of abnormality, uninterrupted application, etc., and thus can ensure normal operation of video conference application when network performance and quality are degraded, unstable, malfunctioned or originally bad.

Description of drawings

Fig. 1 is a structural diagram of the video conferencing system of the present invention;

Fig. 2 is a connection relationship diagram between the network status monitoring subsystem and each module;

Fig. 3 is a flowchart of the present invention.

Detailed ways

Referring to Figure 1, the video conference system includes a communication network, a multipoint control unit (MCU), an MCU management console and a terminal. MCU and terminal constitute video conference equipment. The system also includes a network status monitoring subsystem and multiple modules connected to the system (not shown in FIG. 1 , please refer to FIG. 2 ). Users can hold meetings through the management station/terminal, and the MUC and the terminal can send and receive audio and video media streams through the communication network.

As shown in Figure 2, the network status monitoring subsystem is connected with an anti-error module, an anti-packet loss module, an anti-jitter module, a sliding code adjustment module, a disconnection recall module, an automatic speed reduction module, a voice channel dynamic switching module and a data /Voice call mixing module. When the network status monitoring subsystem detects that the network performance and quality are degraded, unstable or malfunctioning, it will notify the corresponding module, and the module will process it to achieve service lock, that is, not interrupt the application. The detailed description of each module is as follows:

Anti-error code module: When the data is modified or lost during transmission due to network reasons, such as line interference, network slip code, network congestion, network equipment failure, etc., it will appear to the user-side equipment conference TV equipment Bit error, at this time, due to the error and lack of data, the quality and effect of video and audio will drop rapidly. In order to provide users with acceptable video and audio effects as much as possible in the event of bit errors, the anti-error bit module can use codec methods such as data redundancy, error detection/correction, and application for refresh frames to reduce bit errors as much as possible impact and recover from bit error conditions as quickly as possible.

Anti-packet loss module: In the application mode of H.323, when data packets are lost during transmission due to network reasons (such as network congestion, insufficient bandwidth resources, etc.), the lack of data will cause video conferencing equipment to Audio quality and effects degrade rapidly. In order to provide users with the most acceptable video and audio effects in the case of packet loss, the video conferencing equipment can use codec methods such as data redundancy, application for refresh frames, and packet loss compensation to minimize the impact of packet loss and Recover from packet loss as quickly as possible.

Anti-jitter module: In the application mode of H.323, when the data packet is delayed during transmission due to network reasons (such as network congestion, insufficient bandwidth resources, etc.), and the delay time is not equal, resulting in The rate of the received video and audio bit stream is sometimes fast and sometimes slow, and the time synchronization relationship between video and audio is also destroyed. In this case, the video and audio quality and effect of the conference TV will decline rapidly, even making it unbearable for users. In order to overcome this situation and shield the network jitter, conference TV equipment can use methods such as caching data, automatic supplementation, and predictive packet fetching to eliminate the influence of network jitter as much as possible and provide a stable video and audio stream output.

Slip code adjustment module: For video conference equipment that uses multiple channels to bundle and access the network, the routes that each channel passes through the network may be different. When the data transmission delay of one or more channels on the route changes At this time, the relative delay between channels will change accordingly, resulting in data errors from the perspective of multiple channels as a whole. If the video conferencing equipment does not do any processing, it will cause video and audio data errors and the sound and images will not be available. At this time, the sliding code adjustment method can be used, that is, to send certain regular test data on each channel, and to calibrate or recalculate the relative delay between channels to ensure that the application is not interrupted at this time.

Disconnection recall module: For video conference equipment that uses multiple channels to bundle and access the network, if the call on one channel or multiple channels is disconnected (there may be many reasons for the call to be hung up: for example, the network device is too loaded , in order to ensure the purpose of other important communication, actively disconnect part of the communication route or hang up the call due to various situations such as the abnormality of the video conference equipment itself), although there are many reasons, there are only two types: recoverable and irreversible Recoverable, for the recoverable situation, the conference TV equipment will re-call the lines that these calls have been hung up to keep the application rate as constant as possible; and for the unrecoverable situation, it will adopt the method of automatic speed reduction to Realize self-adaptation to the application rate to ensure that the application will not be interrupted under these two abnormal conditions.

Automatic speed reduction module: When the line is unavailable or the quality drops, the application speed will be automatically reduced, which can be divided into the following two situations:

(1) During the calling process of establishing a connection between conference TV equipment, if the applied application rate exceeds the current upper limit capability of the line, such as in the ISDN mode, one or more channels cannot be connected or cannot be used after the call is connected, resulting in failure to reach Application rate requirements, or other restrictions, such as IP mode, gatekeeper (Gatekeeper) or other H.323 equipment limit the call can not meet the application rate requirements), then reduce the connection rate of the call, automatically Adapt to reduce the rate of this application to an appropriate level to improve the success rate of the call connection, and try our best to establish a call connection in this case to ensure the normal development of subsequent video conference applications.

(2) When the connection between conference TV equipment has been established and the application is in progress, due to various reasons, some channel calls are disconnected and cannot be recovered (for example, in ISDN mode, one or more channel calls are disconnected and cannot be restored). Recall is successful) or the network cannot provide corresponding services (for example, in IP mode, the application rate exceeds the capacity of the line bandwidth), then the application rate is adaptively reduced during the application process to ensure that the ongoing application is not interrupted at this time.

Voice channel dynamic switching module: In the application mode of H.320, when the line where the voice channel is located has a large error code or the line is interrupted, the voice channel will be switched to other normal available line channels, so that the voice channel is not interrupted, so as to Ensure that users can continue to communicate by voice when the network is abnormal.

Data/voice call mixing module: When the conference TV equipment is used through the ISDN network, it is necessary to establish a call connection first, and then perform interactive applications of data, voice and images on this connection. Under normal circumstances, the video conference equipment should use the ISDN data bearer capability to make a call, but when the access point switching device of the conference TV equipment does not support the call of the data bearer or there is no available data bearer route in the call network (this is due to ISDN Some devices in the network do not support the data bearer service or are not configured with the data bearer service but are only configured with the voice bearer service), and the call cannot be connected. At this time, you can use the voice bearer to make a call attempt when the data bearer call fails, so as to improve the success rate of the call, and try your best to establish a call connection in this case, so as to ensure the normal development of subsequent videoconferencing applications.

The method for realizing business maintenance in the video conference system provided by the present invention, its main implementation process is: A, start the network status monitoring subsystem after the meeting is held; B, the network status monitoring subsystem monitors the communication network in the video conference system Monitoring; C. The network status monitoring subsystem decides whether to enable the abnormal situation processing module according to the detection results, that is: if an abnormal situation is detected in the communication network, the abnormal situation processing module is enabled; if no abnormal situation is detected in the communication network appears, then do not do any processing, return to step B.

Please refer to FIG. 3 below to describe the specific implementation process of service retention.

Step 10: The network state monitoring subsystem detects the state of the communication network.

Step 20: If it is detected that data is lost during transmission, that is, a code error occurs on the user-side conference TV equipment, notify the anti-error code module to perform anti-error code operations, that is, use data redundancy, error detection/correction, apply for refresh frames or / and other codecs to reduce the impact of bit errors and recover from bit errors as quickly as possible.

Step 30: If it is detected that the data packet loss causes the video and audio quality and effect of the video conferencing equipment to decline rapidly, that is, the video and audio quality and effect of the video conference equipment decline rapidly, then notify the anti-packet loss module to perform anti-packet loss operations, that is, use data Redundancy, application refresh frame, packet loss compensation, or other codec methods reduce the impact of packet loss and recover from packet loss as quickly as possible.

Step 40: If it is detected that the data packet is delayed and the delay time is not equal, then notify the anti-jitter module to perform anti-jitter operation, that is, use cache data, automatic supplement, predictive packet fetching or other methods to eliminate the jitter generated by the network as much as possible Effect, providing a smooth video and audio stream output.

Step 50: If it is detected that the data transmission delay of one or more channels of the video conferencing equipment connected to the network using multiple channel bundles changes on the route, notify the sliding code adjustment module to adjust the sliding code, that is, use the sliding code adjustment module to adjust the sliding code. The code adjustment method is to send certain regular test data on each channel, and to calibrate or recalculate the relative delay between each channel so that the application will not be interrupted.

Step 60: If it is detected that the call disconnection on one channel or multiple channels of the video conferencing equipment connected to the network by bundling multiple channels is detected, the disconnection recall module is notified, and the recoverable call is implemented by re-calling The application rate is kept as constant as possible, and for unrecoverable calls, the method of automatic rate reduction is adopted to realize the self-adaptation to the application rate.

Step 70: If it is detected that the applied application rate exceeds the current line upper limit capability or is limited during the call establishment of the connection between the video conference equipment, or the channel call is disconnected and unrecoverable between the connected TV equipment Or the network cannot provide the corresponding service, then notify the automatic speed reduction module to reduce the speed of the call connection, or adaptively reduce the application speed during the application process.

Step 80: If it is detected that a large bit error occurs on the line where the voice channel is located or the line is interrupted, notify the voice channel dynamic switching module to switch the voice channel to other normally available line channels.

Step 90: If it is detected that the switching equipment of the access point of the video conferencing equipment does not support the call of the data bearer or there is no available data bearer route in the call network, notify the data/voice call mixing module to use the voice when the data bearer call fails The bearer makes a call attempt to improve the call success rate.

Claims (7)

1, a kind of method that in TV conference system, realizes professional maintenance, described system comprises communication network, video conferencing equipment that is connected with communication network and network state monitoring subsystem is characterized in that this method is:

A, hold the back in meeting and start the network state monitoring subsystem;

B, network state monitoring subsystem are monitored the communication network in the TV conference system;

C, network state monitoring subsystem determine whether to enable the abnormal conditions processing module according to testing result, if that is: detect and have abnormal conditions to occur in the communication network, then enable the abnormal conditions processing module, there are not abnormal conditions to occur in the communication network if detect, then do not do any processing, return the B step.

2, the method for claim 1 is characterized in that: described step C specifically comprises:

If error code is then enabled anti-error code module, with the influence that reduces error code with from the error code state, recover as quickly as possible;

If Network Packet Loss is then enabled anti-packet loss module, with the influence that reduces packet loss with from the packet loss state, recover as quickly as possible;

If the anti-jitter module is then enabled in network jitter,, provide video/audio code stream output stably to eliminate the influence of the shake that network produces as far as possible;

If the circuit slip is then enabled the slip adjusting module, do not interrupt so that use;

If the calling on a passage or a plurality of passage disconnects, then enable the disconnection recalling module;

If circuit is unavailable or quality descends, then enable automatic reduction module, call out the speed of connection or carry out self adaptation reduction application rate in the process with suitable reduction in application;

If big error code or line interruption appear in voice channel place circuit, then enable voice channel automatic switchover module, with the voice transfer channel change to other line channel good for use;

If video conferencing equipment access point switching equipment is not supported no data available carrying route in the calling of Data-carrying or this time call network, then enable data/voice and call out the hybrid junction module, so that use voice bearer to call out.

3, method as claimed in claim 2 is characterized in that, enables anti-error code module and is meant that this module adopts data redundancy, error detection/correction, application refresh frame or other decoding methods to handle and looks audio medium stream.

4, method as claimed in claim 2 is characterized in that, enables anti-packet loss module and is meant that adopting data redundancy, application refresh frame, Discarded Packets compensation or other decoding methods to handle by this module looks audio medium stream.

5, method as claimed in claim 2 is characterized in that, enable the anti-jitter module be meant by this module adopt data cached, replenish or measure in advance the bag method automatically and handle and look audio medium stream.

6, method as claimed in claim 2, it is characterized in that, enable the disconnection recalling module and be meant that this module realizes that for recovering to call out to adopt to exhale again to lead to application rate remains unchanged as far as possible, for expendable calling, then take the method for automatic reduction of speed to realize to using the self adaptation of speed.

7, a kind of video conferencing device systems, the video conferencing equipment that comprises communication network, constitutes by multipoint control unit (MCU) and terminal; It is characterized in that this system also comprises:

The network state monitoring subsystem, this subsystem is connected with communication network;

Automatically the reduction of speed module is connected with described network monitor subsystem, reduces automatically under the control of network monitor subsystem and calls out speed or the application rate that connects;

The disconnection recalling module is connected with automatic reduction of speed module with described network monitor subsystem, under the control of network monitor subsystem, calls out again and is communicated with the circuit of having been hung up or takes automatic reduction of speed to use speed to adapt to;

Anti-packet loss module is connected with described network monitor subsystem, reduces the influence of packet loss and from the packet loss recovering state under the control of network monitor subsystem;

The anti-jitter module is connected with described network monitor subsystem, eliminates the influence of the shake of network generation under the control of network monitor subsystem;

The slip adjusting module is connected with described network monitor subsystem, calibrates or recomputate interchannel relative time delay under the control of network monitor subsystem;

Anti-error code module is connected with described network monitor subsystem, in the influence of the control decline low bit error of network monitor subsystem with from the error code recovering state;

The dynamic handover module of voice channel is connected with described network monitor subsystem, switches on other normal line channels at the voice channel that will occur under the control of network monitor subsystem on big error code or the disrupted circuit;

Data/voice is called out the hybrid junction module, is connected with described network monitor subsystem, under the control of network monitor subsystem, uses voice bearer to call out when the Data-carrying call failure.

Images