WO2019184262A1 - Multi-type media data network address translation traversing method, terminal and system - Google Patents

Abstract

Disclosed by the present invention are a multi-type media data network address translation (NAT) traversing method, a terminal and a system, one specific implementation of the method comprises: two terminals located at a private network using an NAT device establish a two-way data transmission channel, and the two-way data transmission channel comprises two one-way data transmission channels, and each one-way data transmission channel is a peer-to-peer one-way data transmission channel or a Relay transmit one-way data transmission channel; and the two terminals add data type identification information in the data packet header, and transmit various types of media data using the two-way data transmission channel. The implementation optimizes the NAT traversing process, and may reduce the interaction of signaling negotiation during NAT traversing, improve the efficiency and success rate of NAT traversing, and speed up the first frame display of a video call.

Description

Multi-type media data network address translation traversing method, terminal and system Technical field

The present invention relates to the field of network technology. More specifically, it relates to a multi-type media data network address translation traversal method, terminal and system.

Background technique

NAT (Network Address Translation) is a technique for rewriting a source IP address or/and a destination IP address when an IP packet passes through a router or firewall. This technique is commonly used in private networks that have multiple hosts but access the Internet through only one public IP address.

NAT traversal is a communication method widely used in the field of P2P (Point to Point). During the video conference, NAT traversal also plays a vital role in the communication between internal and external networks. NAT traversal of signaling, multimedia data, etc. may exist between platform servers, between participating terminals, and between platform servers and participating terminals. In the process of P2P audio and video calls, since both terminals of the call are located behind the NAT for the public network, it is also necessary to implement audio and video calls through NAT traversal.

There are 4 different types of NAT: Full Cone, Address Restricted Cone, Port Restricted Cone, and Symmetric, where Full Cone, Address Restricted The three types of Cone and Port Restricted Cone are collectively referred to as Cone NAT. Usually, for Symmetric NAT, it is considered that it is impossible to achieve traversal, and conical NAT can achieve traversal.

Currently, the more mature NAT traversal is the ICE (Interactive Connectivity Establishment) framework (rfc5245). The ICE framework implements NAT traversal based on two protocols: STUN (Simple Traversal of UDP over NATs, NAT UDP Simple Traversal) (rtc5389) and TURN (Traversal Using Relay NAT), by relay (relay mode, relay mode, relay) Forwarding is relay forwarding, relay server is Relay server) traversing NAT) (rtc5766). As shown in Figure 1, the general flow of NAT traversal in ICE P2P audio and video calls is as follows:

(1) Terminal A collects all IP addresses and finds an address in which traffic can be received from the STUN server and the TURN server;

(2) Terminal A sends an address list to the STUN server, and then sends startup information to the terminal B according to the sorted address list, in order to implement communication between the nodes;

(3) Terminal B sends a STUN request to each address in the startup information;

(4) Terminal A sends the reply message of the first received STUN request to the terminal B;

(5) After receiving the STUN reply, the terminal B finds out the addresses that can be communicated between the terminal A and the terminal B;

(6) performing further inter-terminal communication by using the address with the highest ranked sequence in the address list;

(7) The data transmission channel is successfully established, and media data transmission is started.

Taking P2P audio and video calls as an example, there are four types of media data, namely audio, video, rtp, and rtcp, which need to be transmitted. In the ICE mode, a data transmission channel needs to be established for each type of media data, so a complete The ICE negotiation process repeats the above steps four times. Therefore, there are too many process interactions in the ICE mode, a standard P2P audio and video call, and a complete ICE negotiation process. Both parties need to exchange 80 signalings. The excessive signaling interaction will reduce the success rate of media connection, especially in the In the case of a weak network. In addition, NAT is time-sensitive and will change the public address or port mapped on the NAT after a period of time. In order to ensure that the media of the terminals of the two parties can be connected normally, the solution of the ICE method is to do re-ice, that is, to re-execute the complete ICE negotiation process, which is time consuming and complicated.

Therefore, it is desirable to provide a process optimized multi-type media data network address translation traversal method, terminal and system.

Summary of the invention

In view of this, an object of the present invention is to provide a process optimized multi-type media data network address translation traversal method, terminal and system.

In order to achieve the above object, the present invention adopts the following technical solutions:

A first aspect of the present invention provides a multi-type media data network address translation traversal method, including:

The two terminals in the private network using the network address translation device establish a two-way data transmission channel, where the two-way data transmission channel includes two unidirectional data transmission channels, and each unidirectional data transmission channel is a point-to-point unidirectional data transmission channel or Relay forwarding one-way data transmission channel;

The two terminals add data type identification information in the packet header, and use the bidirectional data transmission channel to transmit various types of media data.

Preferably, the establishing the bidirectional data transmission channel between the terminals further comprises:

The two terminals respectively obtain the private network address and the public network address of the other party;

The two terminals respectively send a binding message to the other party and the relay server, and establish a point-to-point one-way data transmission channel or a relay forwarding one-way data transmission channel of the party to the other party according to the timing of receiving the binding response message.

Preferably, the obtaining, by the two terminals respectively, the private network address and the public network address of the other party further includes:

The first terminal of the two terminals obtains the public network address of the first terminal from the relay server, and sends the request information of the private network address and the public network address of the first terminal to the second terminal by using the signaling server;

The second terminal obtains the public network address of the second terminal from the relay server, and sends a request response message carrying the second terminal private network address and the public network address to the first terminal by using the signaling server.

Preferably, the method further includes: when the terminal detects that the public network address of the other party changes, the terminal checks the legality of the user ID of the other party, and if the validity check passes, updates the public network address of the other party.

A second aspect of the present invention provides a multi-type media data network address translation traversing terminal, comprising a memory, a processor, and a computer program stored on the memory and operable on the processor, the processor implementing the program The multi-type media data network address translation traversal method provided by the first aspect of the present invention.

A third aspect of the present invention provides a multi-type media data network address translation traversal system, including two terminals in a private network using a network address translation device, and the two-way data transmission channel established by the two terminals includes two singles. To the data transmission channel, each unidirectional data transmission channel is a point-to-point unidirectional data transmission channel or a relay-forward unidirectional data transmission channel; the two terminals add data type identification information in the data packet header, and use the two-way data The transmission channel transmits various types of media data.

Preferably, the system further includes a relay server; the two terminals respectively acquire a private network address and a public network address of the other party; the two terminals respectively send binding messages to the other party and the relay server, and are tied according to the received The timing of the response message establishes a point-to-point one-way data transmission channel or a relay-forward one-way data transmission channel of the party to the other party.

Preferably, the system further includes a signaling server; the first terminal of the two terminals acquires a public network address of the first terminal from the relay server, and sends a private network address of the first terminal to the second terminal by using the signaling server The request information of the public network address is obtained by the second terminal, and the second terminal obtains the public network address of the second terminal from the relay server, and sends the request response information that carries the private network address and the public network address of the second terminal to the first terminal by using the signaling server.

Preferably, the two terminals check the validity of the user ID of the other party when the public network address of the other party changes, and update the public network address of the other party if the validity check is passed.

The beneficial effects of the present invention are as follows:

The technical solution of the invention optimizes the flow of NAT traversal, greatly reduces the interaction of signaling negotiation in NAT traversal, improves the efficiency and success rate of NAT traversal, and speeds up the display of the first frame of the video call. Further, in the case that the terminal changes the public network address, the present invention can realize seamless seamless connection of the media efficiently and quickly.

DRAWINGS

The specific embodiments of the present invention are further described in detail below with reference to the accompanying drawings;

FIG. 1 shows a schematic diagram of network address translation traversal in the ICE mode.

FIG. 2 is a flowchart of a multi-type media data network address translation traversal method according to an embodiment of the present invention.

FIG. 3 is a schematic diagram of a multi-type media data network address translation traversing terminal according to an embodiment of the present invention.

FIG. 4 is a signaling flowchart of a multi-type media data network address translation traversal system according to an embodiment of the present invention.

detailed description

The present invention will be more clearly described, and the present invention will be further described below in conjunction with the preferred embodiments and the accompanying drawings. Similar components in the drawings are denoted by the same reference numerals. It should be understood by those skilled in the art that the following detailed description is intended to be illustrative and not restrictive.

As shown in FIG. 2, an embodiment of the present invention provides a multi-type media data NAT traversal method, including:

Two terminals in the private network using the NAT device establish a two-way data transmission channel, and the two-way data transmission channel includes two one-way data transmission channels, and each one-way data transmission channel is a point-to-point one-way data transmission channel or a relay forwarding one-way. The data transmission channel, that is, the two unidirectional data transmission channels are point-to-point unidirectional data transmission channels, or the two unidirectional data transmission channels are Relay forwarding unidirectional data transmission channels, or one is a point-to-point unidirectional data transmission channel. The other is Relay forwarding a one-way data transmission channel;

The two terminals add data type identification information in the data packet header, and use the two-way data transmission channel to transmit various types of media data, that is, each one-way data transmission channel in the two-way data transmission channel serves as a composite channel for transmission. Different types of multiple media data.

The multi-type media data NAT traversal method provided in this embodiment optimizes the flow of NAT traversal. Due to the adoption of the composite channel, the interaction of signaling negotiation in NAT traversal is greatly reduced, and the efficiency and success rate of NAT traversal are improved. Since the two unidirectional data transmission channels in the two-way data transmission channel between the two terminals can be different, the two terminals respectively select a unidirectional data transmission channel in a high-efficiency manner, thereby speeding up the display of the first frame of the video call. .

In a specific implementation, the method for establishing a bidirectional data transmission channel between the terminals in this embodiment is specifically: the two terminals respectively obtain the private network address and the public network address of the other party; the two terminals respectively send bindings to the other party and the Relay server. The message is established according to the timing of receiving the binding response message, and the peer-to-peer one-way data transmission channel or the relay forwarding one-way data transmission channel is established. In this way, the two terminals can respectively select a one-way data transmission channel with a high time efficiency, which speeds up the display of the first frame of the video call.

In a specific implementation, the method for the two terminals to obtain the private network address and the public network address of the other party in this embodiment is specifically as follows:

The first terminal of the two terminals obtains the public network address of the first terminal from the relay server, and sends the request information carrying the private network address and the public network address of the first terminal to the second terminal by using the signaling server;

The second terminal obtains the public network address of the second terminal from the Relay server, and sends a request response message carrying the second terminal private network address and the public network address to the first terminal by using the signaling server.

It can be seen that the Relay server in this embodiment integrates the functions of the STUN server and the TURN server in the ICE mode. In addition, those skilled in the art can understand that each terminal has been registered in the signaling server in advance, and the signaling server can be connected to each terminal. Both the signaling server and the relay server are located on the public network.

In a specific implementation, the multi-type media data NAT traversal method provided in this embodiment further includes: when the terminal detects that the public network address of the other party changes, the terminal checks the legality of the user ID of the other party, and if the legality verification passes, updates the other party. Public network address. In this way, in the case that the terminal changes the public network address, the seamless connection of the media can be realized efficiently and quickly.

Another embodiment of the present invention provides a multi-type media data network address translation traversing terminal, including a memory, a processor, and a computer program stored on the memory and operable on the processor, the processor implementing the program Multi-type media data network address translation traversal method.

As shown in FIG. 3, the multi-type media data network address translation traversal terminal provided by this embodiment is a computer system, which includes a central processing unit (CPU), which can be based on a program stored in a read only memory (ROM). Either a program loaded into a random access memory (RAM) from a storage portion performs various appropriate actions and processes. In the RAM, various programs and data required for the operation of the computer system are also stored. The CPU, ROM, and RAM are connected by this bus. An input/input (I/O) interface is also connected to the bus.

The following components are connected to the I/O interface: an input portion including a keyboard, a mouse, and the like; an output portion including a liquid crystal display (LCD) or the like, a speaker, etc.; a storage portion including a hard disk or the like; and a network including a LAN card, a modem, and the like The communication part of the interface card. The communication section performs communication processing via a network such as the Internet. The drive is also connected to the I/O interface as needed. A removable medium such as a magnetic disk, an optical disk, a magneto-optical disk, a semiconductor memory or the like is mounted on the drive as needed so that a computer program read therefrom is installed into the storage portion as needed.

In particular, with the present embodiment, the process described above in the flowcharts can be implemented as a computer software program. For example, the present embodiment includes a computer program product comprising a computer program tangibly embodied on a computer readable medium, the computer program comprising program code for executing the method illustrated in the flowchart. In such an embodiment, the computer program can be downloaded and installed from the network via a communication portion, and/or installed from a removable medium.

The flowchart and schematic diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of the systems, methods, and computer program products of the present embodiments. In this regard, each block in the flowchart or diagram may represent a module, a program segment, or a portion of code that includes one or more of the Execute the instruction. It should also be noted that in some alternative implementations, the functions noted in the blocks may also occur in a different order than that illustrated in the drawings. For example, two successively represented blocks may in fact be executed substantially in parallel, and they may sometimes be executed in the reverse order, depending upon the functionality involved. It is also noted that each block of the schematic and/or flow diagrams, as well as combinations of blocks in the schematic and/or flowcharts, can be implemented in a dedicated hardware-based system that performs the specified functions or operations. Or it can be implemented by a combination of dedicated hardware and computer instructions.

The units described in this embodiment may be implemented by software or by hardware. The described unit may also be provided in the processor, for example, as a processor packet data transmission channel establishing unit and a data packet encapsulating unit. The names of these units do not in any way constitute a limitation on the unit itself. For example, the packet encapsulation unit may also be described as a "data type identification information adding unit".

In another aspect, the embodiment further provides a non-volatile computer storage medium, which may be a non-volatile computer storage medium included in the foregoing terminal in the foregoing embodiment, It may be a non-volatile computer storage medium that exists alone and is not assembled into the terminal. The above non-volatile computer storage medium stores one or more programs, when the one or more programs are executed by one terminal, causing the terminal to establish a two-way with another terminal in the private network using the network address translation device a data transmission channel, the two-way data transmission channel includes two unidirectional data transmission channels, and each unidirectional data transmission channel is a point-to-point unidirectional data transmission channel or a relay-forward unidirectional data transmission channel;

Data type identification information is added to the packet header, and various types of media data are transmitted using a bidirectional data transmission channel.

Another embodiment of the present invention provides a multi-type media data NAT traversal system. As shown in FIG. 4, the signaling flow of the multi-type media data NAT traversal system provided in this embodiment is as follows:

Assuming that the scenario is that the terminal A and the terminal B are to perform P2P audio and video calls, the four types of media data of audio, video, rtp, and rtcp need to be transmitted. The Relay server in this embodiment integrates the functions of the STUN server and the TURN server in the ICE mode. In addition, each terminal has been registered in the signaling server in advance, and the signaling server can be connected to each terminal. Both the signaling server and the relay server are located in the public network, and the terminal A and the terminal B are respectively connected to the public network through NAT devices (such as a NAT router or a NAT firewall, not shown in FIG. 4) used by the private network.

The specific signaling process is as follows:

The terminal A sends a request for obtaining a public network address to the relay server of the public network, and the relay server returns the public network address of the terminal A (the terminal A can also obtain its own public network port), and the terminal A obtains its own private network address (the terminal A also Get your own private network port);

The terminal A sends the request information of the private network address and the public network address of the terminal A to the terminal B through the signaling server. For example, the terminal A sends the private network address and the public network address of the terminal A and the terminal B to the signaling server. The request information of the user ID, the signaling server forwards the request information to the terminal B according to the user ID of the terminal B;

After receiving the request information, the terminal B sends a request for obtaining a public network address to the relay server of the public network, and the relay server returns the public network address of the terminal B (the terminal B can also obtain its own public network port), and the terminal B obtains its own Private network address (terminal B can also obtain its own private network port);

The terminal B sends the request response information carrying the private network address and the public network address of the terminal B to the terminal A through the signaling server;

The terminal A starts to send a binding message (bind) to the relay server and the terminal B to perform media channel negotiation in parallel. After receiving the binding message, the relay server and the terminal B respond to the binding response message (bind response) to the terminal A; At the same time, the terminal B also sends a binding message (bind) to the relay server and the terminal A for media channel negotiation. After receiving the binding message, the relay server and the terminal A respond to the binding response message (bind response) to the terminal B;

After receiving the bind response of the terminal B, the terminal A confirms the real public network address of the terminal B through reverse analysis. For the case where terminal A receives the bind response, there are several ways to deal with it:

If terminal A only receives the bind response of terminal B, terminal A establishes a point-to-point one-way data transmission channel from terminal A to terminal B, and terminal A starts to send media data to the public network address of terminal B (if terminal A and terminal B appear) In a special case in a private network, terminal A can send media data to the private network address of terminal B);

If the terminal A only receives the bind response of the relay server, the terminal A establishes the relay of the terminal A to the terminal B to forward the unidirectional data transmission channel, and the terminal A starts to send the media data to the relay server, and the relay server performs the relay forwarding to the terminal B.

If the terminal A receives the bind response of the terminal B and the relay server, the terminal A sets the point-to-point one-way data transmission channel of the terminal A to the terminal B according to the received chronological order. If the bind re-sponse of the relay server arrives first, the terminal A establishes the relay of the terminal A to the terminal B to forward the unidirectional data transmission channel, and then the terminal A starts to send the media data to the terminal B or the relay server, which has the advantage of letting the terminal B as early as possible. Receive media data, speed up the first frame display, and achieve second opening;

The process of the terminal B processing the received bind response is the same as that of the terminal A. Thus, the terminal A and the terminal B respectively establish a unidirectional data transmission channel of the terminal A to the terminal B and a unidirectional data transmission channel of the terminal B to the terminal A, The bidirectional data transmission channel between terminal A and terminal B is established.

The media data is transmitted using a composite channel, and the terminal A and the terminal B add data type identification information in the data packet header to distinguish different types of data such as audio, video, rtp, and rtcp. Different from the standard process of ICE, different channels are established for each of the four media types to negotiate, and the signaling interaction is reduced to 16. This can greatly reduce the negotiation time and improve the efficiency and success rate of NAT traversal.

If the public network address or port of the terminal A is changed during the negotiation and the call, the terminal B can verify the validity of the channel id and update the public network address corresponding to the terminal A.

In the process of negotiation and media transmission, if terminal A or terminal B detects that the public network address of the other party has changed, terminal A or terminal B checks the legality of the user ID of the other party, and if the validity check is passed, Update the public network address of the other party and send it directly to the public address of the updated party when you continue to send media data. Both terminal A and terminal B can know the user ID of the other party. The ICE standard process will do re-ice for this situation and renegotiate the media channel. In contrast, this embodiment can implement seamless media connection efficiently and quickly.

In the description of the present invention, it is to be noted that the orientation or positional relationship of the terms "upper", "lower" and the like is based on the orientation or positional relationship shown in the drawings, and is merely for convenience of description of the present invention and simplified description. Instead of indicating or implying that the device or component referred to must have a particular orientation, constructed and operated in a particular orientation, it is not to be construed as limiting the invention. Unless specifically stated and limited, the terms "mounted," "connected," and "connected" are used in a broad sense, and may be, for example, a fixed connection, a detachable connection, or an integral connection; it may be a mechanical connection, It can also be an electrical connection; it can be directly connected, or it can be connected indirectly through an intermediate medium, which can be the internal connection of two components. For those skilled in the art, the specific meanings of the above terms in the present invention can be understood on a case-by-case basis.

It should also be noted that in the description of the present invention, relational terms such as first and second, etc. are used merely to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply these There is any such actual relationship or order between entities or operations. Furthermore, the term "comprises" or "comprises" or "comprises" or any other variations thereof is intended to encompass a non-exclusive inclusion, such that a process, method, article, or device that comprises a plurality of elements includes not only those elements but also Other elements, or elements that are inherent to such a process, method, item, or device. An element that is defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device that comprises the element.

It is apparent that the above-described embodiments of the present invention are merely illustrative of the present invention and are not intended to limit the embodiments of the present invention. For those skilled in the art, the above description may also be made. It is to be understood that various changes and modifications may be made without departing from the spirit and scope of the invention.

Claims (9)

A multi-type media data network address translation traversal method, comprising: The two terminals in the private network using the network address translation device establish a two-way data transmission channel, where the two-way data transmission channel includes two unidirectional data transmission channels, and each unidirectional data transmission channel is a point-to-point unidirectional data transmission channel or Relay forwarding one-way data transmission channel; The two terminals add data type identification information in the packet header, and use the bidirectional data transmission channel to transmit various types of media data. The multi-type media data network address translation traversal method according to claim 1, wherein the establishing the bidirectional data transmission channel between the terminals further comprises: The two terminals respectively obtain the private network address and the public network address of the other party; The two terminals respectively send a binding message to the other party and the relay server, and establish a point-to-point one-way data transmission channel or a relay forwarding one-way data transmission channel of the party to the other party according to the timing of receiving the binding response message. The multi-type media data network address translation traversal method according to claim 2, wherein the obtaining, by the two terminals respectively, the private network address and the public network address of the other party further comprises: The first terminal of the two terminals obtains the public network address of the first terminal from the relay server, and sends the request information of the private network address and the public network address of the first terminal to the second terminal by using the signaling server; The second terminal obtains the public network address of the second terminal from the relay server, and sends a request response message carrying the second terminal private network address and the public network address to the first terminal by using the signaling server. The multi-type media data network address translation traversal method according to claim 1, wherein the method further comprises: when the terminal detects that the public network address of the other party changes, performing legality verification on the user ID of the other party, if legality When the verification is passed, the public network address of the other party is updated. A multi-type media data network address translation traversing terminal, comprising a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein the processor executes the program as claimed The method of any of 1-4. A multi-type media data network address translation traversal system, comprising: two terminals in a private network using a network address translation device, wherein the two-way data transmission channel established by the two terminals includes two unidirectional data transmissions Channel, each unidirectional data transmission channel is a point-to-point unidirectional data transmission channel or a relay-forward unidirectional data transmission channel; the two terminals add data type identification information in the data packet header, and use the two-way data transmission channel to transmit Various types of media data. The system of claim 6, wherein the system further comprises a relay server; The terminal sends a binding message to the peer and the relay server respectively, and establishes a point-to-point one-way data transmission channel or a relay-forward one-way data transmission channel of the party to the other party according to the timing of receiving the binding response message. The system of claim 7, wherein the system further comprises a signaling server; And sending, by the signaling server, request information that carries the private address of the first terminal and the public network address to the second terminal; the second terminal acquires the public network address of the second terminal from the relay server, and sends the information to the first terminal by using the signaling server. Request response information of the second terminal private network address and public network address. The multi-type media data network address translation traversal system according to claim 8, wherein the two terminals detect the legality of the user ID of the other party when the public network address of the other party is changed, if the legality is correct The verification will update the public network address of the other party.

Images