The transmission method of audio-video code stream in the multimedia videoconference system
Technical field
The present invention relates to the multimedia videoconference system, the transmission method of audio-video code stream in the particularly a kind of multimedia videoconference system, this method can be applicable to band-limited network condition, is the otherwise effective technique solution that is provided at the bandwidth bottleneck problem.
Background technology
The multimedia videoconference system couples together a plurality of multimedia videoconference terminals that are positioned at the strange land by IP network, at multipoint control unit (Multi-point Control Unit, MCU) under the control, allow the participant carry out two-way communication, strengthen the sense of reality, validity and interactivity that people exchange in the strange land with multimedia modes such as image, voice-and-datas.
Multimedia videoconference system requirements information issue end is distributed to all participant terminals with video information; Simultaneously, information issue end can be monitored at any time according to demand and watch each or a plurality of participant terminal, and promptly main control end can make participant terminal loopback video information flow to information issue end as requested.
Traditional video conferencing system, the method that adopts is as shown in Figure 1: under the finite bandwidth condition, information issue end (main control end) must send video information to MCU and handles in the video conferencing system, by MCU video information is sent to other nodes (participant terminal) again.There is the increase of two shortcoming: a. along with video conference participant terminal in such method, and the bandwidth requirement of MCU network node increases thereupon, has brought serious bandwidth pressure to MCU; B. along with the increase of video conference participant terminal, the requirement of the disposal ability of MCU is also increased thereupon, bring the pressure of serious disposal ability to MCU.Finally, MCU becomes the bottleneck of whole system.
Summary of the invention
The present invention is directed to the defective or the deficiency that exist in the prior art, the transmission method of audio-video code stream in a kind of multimedia videoconference system is provided, this method can be applicable to band-limited network condition, is the otherwise effective technique solution that is proposed at the bandwidth bottleneck problem.By further perfect, can solve the problem that in band-limited conventional video conference system, effectively realizes the content distribution, eliminate bottleneck problem.
Technical conceive of the present invention is, MCU is freed from the processing of frequent audio/video information code stream with transmitting, make MCU only be responsible for the transmit status monitor command, and participate in directly carrying out between the node of video conference the transmission of audio/video information code stream at needs, described direct transmission can be adopted star-like transmission structure, tree type transmission structure or chain type transmission structure, thereby improves under the finite bandwidth network condition the limited problem of bandwidth, disposal ability of a plurality of recievers of message publisher in the video conference effectively.
Technical scheme of the present invention is as follows:
The transmission method of audio-video code stream in the multimedia videoconference system is characterized in that: described audio-video code stream is directly transmitted comprising between each participant node of information releasing node, and MCU only is responsible for the transmit status monitor command.
Described direct transmission comprises that step is as follows: step 1, determine main control end and information releasing node; Step 2, the output bandwidth that detects each the participant node that comprises information releasing node is the out-degree size; Step 3 is issued the out-degree size of end node and is formed hierarchical transmission structure by MCU according to the out-degree size combining information of participant node.
Also comprise step 4, the input bandwidth that detects information releasing node is the in-degree size, determines the participant node number of loopback audio-video code stream to information releasing node according to this in-degree size, and it is mutual to select to carry out audio frequency and video for main control end.
Described main control end is arranged on information releasing node.
Described hierarchical transmission structure is meant that when the out-degree of information releasing node was counted sum more than or equal to the participant node, audio-video code stream all transferred to each participant node from information releasing node, promptly forms star-like transmission structure.
Described hierarchical transmission structure is meant, when the out-degree of information releasing node is counted sum less than the participant node, determine that according to the out-degree of participant node size it receives the priority of audio-video code stream, the big more participant node of out-degree promptly forms tree type transmission structure the closer to information releasing node.
Described hierarchical transmission structure is meant, when the out-degree of each the participant node that comprises information releasing node is 1, from information releasing node, the participant node is connected successively, promptly forms the chain type transmission structure.
Technique effect of the present invention is as follows:
Because the transmission method of audio-video code stream in the multimedia videoconference of the present invention system, with the processing of MCU from frequent audio/video information code stream, free in the forwarding, MCU only is responsible for the transmit status monitor command, and participate in carrying out between the node of video conference the transmission of direct audio/video information code stream at needs, compared with prior art, this just makes MCU no longer become the bottleneck of whole system.
Form hierarchical transmission structure owing to issue the out-degree size of end node according to the out-degree size combining information of participant node by MCU, this just can according to circumstances fully be applicable to band-limited network condition, realizes the transmission of audio-video code stream both fast and sound.
Owing to determine the participant node number of loopback audio-video code stream to information releasing node according to the in-degree of information releasing node size, this just can realize both fast and sound audio-video code stream alternately.
Because hierarchical transmission structure, can adopt star-like transmission structure, tree type transmission structure or chain type transmission structure, and the corresponding algorithm that carries out direct audio-video code stream exchange between the node that participates in video conference with optimum way that makes proposed, this just can realize in the band-limited video conferencing system participating in, and the mode with optimum realizes directly carrying out between the node issue of audio/video information code stream and loopback between the node of video conference, MCU only needs sending controling instruction, thereby has well solved the problem that relates to bandwidth bottleneck that exists in the existing video conference.
Description of drawings
Fig. 1 is the transmission structure schematic diagram of audio-video code stream in the multimedia videoconference system in the prior art.
Fig. 2 is the transmission structure schematic diagram of audio-video code stream in first kind of multimedia videoconference system of the present invention.
Fig. 3 is the transmission structure schematic diagram of audio-video code stream in second kind of multimedia videoconference system of the present invention.
Fig. 4 is the transmission structure schematic diagram of audio-video code stream in the third multimedia videoconference system of the present invention.
Fig. 5 is the transmission structure schematic diagram of audio-video code stream in the 4th kind of multimedia videoconference system of the present invention.
Fig. 6 is the transmission structure schematic diagram of audio-video code stream in the 5th kind of multimedia videoconference system of the present invention.
Fig. 7 is the transmission structure schematic diagram of audio-video code stream in the 6th kind of multimedia videoconference system of the present invention.
Description of reference numerals is as follows:
T1 is an information issue end, T2, T3 ... Tn represents participant terminal or participant node respectively, and MCU is a multipoint control unit;
A is an information releasing node, and B, C, D, E, F represent the participant node respectively;
Arrow line is represented the transmission direction of audio-video code stream.
Embodiment
The present invention is described in further detail below in conjunction with accompanying drawing.
Transmission structure as Fig. 2 audio-video code stream to the shown in Figure 7 multimedia videoconference of the present invention system, audio-video code stream is directly transmitted comprising between each participant node of information releasing node, MCU only is responsible for the transmit status monitor command, makes MCU no longer become the bottleneck of whole system.
The transmission structure of audio-video code stream can be learnt from first kind of multimedia videoconference system of the present invention shown in Figure 2, and this scheme needs information issue to hold the node A among the i.e. figure to have enough big output bandwidth (out-degree).Therefore, though the liberation that MCU such as Fig. 2 is represented of this scheme come out, fundamentally do not solve the bottleneck problem that finite bandwidth brings, and only be bottleneck problem MCU, transferred to information issue end (T1 among the figure).
The transmission structure of audio-video code stream can be learnt from second kind of multimedia videoconference system of the present invention shown in Figure 3, and this scheme is for carrying out the general version of direct audio-video code stream exchange algorithm with optimum way between the node that may have feasible participation video conference.Algorithm wherein may further comprise the steps:
1. determine the main control end (being information issue end) in the video conference.
2. detect the output bandwidth (out-degree) of all nodes that participate in video conference and the input bandwidth (in-degree) of main control end.
3. organize the transmission structure (as shown in Figure 3) of the audio/video information code stream between the node that participates in video conference: a. to make main control end in the video conference as tree root with tree according to above-mentioned information by MCU; B. with its maximum out-degree distributing information, the node that out-degree is big more, the code stream of receiving information more earlier (if the identical situation of out-degree is determined successively with the sequencing that detects), further downward again distributing information code stream, that is: the node that out-degree is big more is the closer to tree root.
4. according to the in-degree of master control end, MCU is responsible for the instruction according to main control end, arranges the node loopback audio/video information code stream of response, realizes the mutual of main control end and each video node.
Method of the present invention can realize in the band-limited video conferencing system participating in that the mode with optimum realizes directly carrying out between the node issue of audio/video information code stream and loopback between the node of video conference, MCU only needs sending controling instruction, thereby has well solved the bottleneck problem that exists in the video conference.
The transmission structure of audio-video code stream can be learnt from the third multimedia videoconference system of the present invention shown in Figure 4, the situation of this scheme for need to carry out video conference between six nodes such as A, B, C, D, E and F.In order to solve the problem that in band-limited conventional video conference system, effectively realizes the content distribution, eliminate bottleneck problem, determine the relevant parameter of each node earlier, be listed as follows:
| Node | Out-degree | In-degree | Whether master control |
| A | 3 | 2 | Be |
| B | 2 | 3 | Not |
| C | 3 | 1 | Not |
| D | 1 | 1 | Not |
| E | 2 | 3 | Not |
| F | 1 | 1 | Not |
Whether MCU detect participates in the out-degree, in-degree of each node of video conference and is information such as main control end, and the algorithm in rapidly according to the present invention is determined the transmission structure of audio/video information code stream between each node, this transmission structure tree type transmission structure as shown in Figure 4.
Simultaneously, main control end can send loopback and instruct to MCU according to its in-degree condition, in the issue video information, carries out video interactive with node.On Fig. 4 basis,, then only the direct loopback of the video information of node D and E need be got final product to A, as shown in Figure 5 if main control end A requires to carry out video interactive with node D and E.The contact of loopback information can switch at any time, switches the loopback instruction that sends to MCU according to main control end.
When the out-degree of the node in participating in video conference all was 1, the transmission structure between the node of the algorithm formation of the present invention's proposition had just become the transmission structure of chain type so, as shown in Figure 6.
When the out-degree of the main controlled node that participates in video conference more than or equal to the node number of participating in video conference, the transmission structure between the node that forms of the algorithm that proposes of the present invention has just become star-like transmission structure so, as shown in Figure 7.
Should be pointed out that the above embodiment can make those skilled in the art more fully understand the present invention, but do not limit the present invention in any way.Therefore, although this specification has been described in detail the present invention with reference to drawings and Examples,, it will be appreciated by those skilled in the art that still and can make amendment or be equal to replacement the present invention; And all do not break away from the technical scheme and the improvement thereof of the spirit and scope of the present invention, and it all should be encompassed in the middle of the protection range of patent of the present invention.