[go: up one dir, main page]

CN117499258B - Service data network transmission management method and DPU - Google Patents

Service data network transmission management method and DPU Download PDF

Info

Publication number
CN117499258B
CN117499258B CN202311559165.8A CN202311559165A CN117499258B CN 117499258 B CN117499258 B CN 117499258B CN 202311559165 A CN202311559165 A CN 202311559165A CN 117499258 B CN117499258 B CN 117499258B
Authority
CN
China
Prior art keywords
data
data packet
service
network
service type
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202311559165.8A
Other languages
Chinese (zh)
Other versions
CN117499258A (en
Inventor
黄云鹏
黄明亮
鄢贵海
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Yusur Technology Co ltd
Original Assignee
Yusur Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Yusur Technology Co ltd filed Critical Yusur Technology Co ltd
Priority to CN202311559165.8A priority Critical patent/CN117499258B/en
Publication of CN117499258A publication Critical patent/CN117499258A/en
Application granted granted Critical
Publication of CN117499258B publication Critical patent/CN117499258B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/50Network service management, e.g. ensuring proper service fulfilment according to agreements
    • H04L41/5003Managing SLA; Interaction between SLA and QoS
    • H04L41/5019Ensuring fulfilment of SLA
    • H04L41/5025Ensuring fulfilment of SLA by proactively reacting to service quality change, e.g. by reconfiguration after service quality degradation or upgrade
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/08Configuration management of networks or network elements
    • H04L41/0896Bandwidth or capacity management, i.e. automatically increasing or decreasing capacities
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L41/00Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
    • H04L41/50Network service management, e.g. ensuring proper service fulfilment according to agreements
    • H04L41/5003Managing SLA; Interaction between SLA and QoS
    • H04L41/5019Ensuring fulfilment of SLA
    • H04L41/5022Ensuring fulfilment of SLA by giving priorities, e.g. assigning classes of service
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/02Capturing of monitoring data
    • H04L43/026Capturing of monitoring data using flow identification
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L43/00Arrangements for monitoring or testing data switching networks
    • H04L43/08Monitoring or testing based on specific metrics, e.g. QoS, energy consumption or environmental parameters

Landscapes

  • Engineering & Computer Science (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Quality & Reliability (AREA)
  • Environmental & Geological Engineering (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)

Abstract

The application provides a service data network transmission management method and a DPU (data processing unit), wherein the method is executed in the DPU and comprises the steps of searching respective QoS (quality of service) strategy data of each data packet in comparison relation data between a current QoS strategy and the service type according to the service type of each data packet to be transmitted in a network, respectively outputting each data packet to a target network for transmission based on the respective QoS strategy data of each data packet, monitoring the real-time state of the target network and each data packet, and judging whether to dynamically adjust the QoS strategy data of the data packet according to a corresponding monitoring result. The application can realize the accurate identification of different service flows and QoS strategy distribution so as to provide high-quality network service, and can improve the flexibility of service data network transmission management, thereby being applicable to various and high-variability service flow transmission scenes.

Description

Service data network transmission management method and DPU
Technical Field
The present application relates to the field of traffic management technologies, and in particular, to a service data network transmission management method and a DPU.
Background
In network communications, quality of service QoS (Quality of Service) refers to classifying and managing different types of network traffic to ensure reliability of network services, reasonable utilization of bandwidth, and stability of quality. Currently, traffic management in a data center is an important task. To ensure quality of network service (QoS), data centers need to ensure priority and bandwidth for different traffic flows.
Currently, CPU-based traffic management schemes typically use static QoS policies to manage traffic. However, CPU-based traffic management schemes cannot effectively and accurately distinguish and optimize various traffic flows. And when processing highly variable and diverse traffic flows, the static QoS policy lacks flexibility and adaptability, and cannot adapt to the changes of different traffic types and network conditions quickly, which may cause the problems of performance degradation and QoS non-assurance. In addition, when the conventional flow management scheme based on the CPU processes high-speed flow of a large-scale data center, the calculation and processing capacity of the CPU are limited, so that the real-time processing requirement on a large number of data packets cannot be met, and delay increase and throughput decrease are caused.
That is, the CPU-based traffic management scheme has the disadvantages of insufficient flexibility, inability to accommodate diverse traffic flows, inability to handle highly variable traffic and performance bottlenecks using static QoS policies. These drawbacks limit the precise management and optimization of different traffic types and network conditions, resulting in performance and QoS instability.
Disclosure of Invention
In view of this, embodiments of the present application provide a service data network transmission management method and a DPU to obviate or mitigate one or more disadvantages in the prior art.
An aspect of the present application provides a traffic data network transmission management method, performed in a DPU, the traffic data network transmission management method including:
According to the service type of each data packet to be transmitted by the network, searching the QoS strategy data of each data packet in the comparison relation data between the current QoS strategy and the service type, and outputting each data packet to a target network for transmission based on the QoS strategy data of each data packet;
and monitoring the real-time state of the target network and each data packet, and judging whether to dynamically adjust QoS strategy data of the data packet according to a corresponding monitoring result.
In some embodiments of the present application, before searching for QoS policy data of each data packet in the comparison relationship data between the current QoS policy and the service type according to the service type to which each data packet to be transmitted in the network belongs, the method further includes:
receiving a data packet to be transmitted by a network;
Analyzing the data packet to obtain header information of the data packet;
Based on a preset service type identification mode, identifying and obtaining the service type of the data packet according to the head information of the data packet.
In some embodiments of the present application, the service type identification manner includes feature matching, machine learning or deep packet inspection;
Correspondingly, the identifying, based on the preset service type identifying manner, the service type to which the data packet belongs according to the header information of the data packet includes:
If the service type identification mode is the characteristic matching, extracting service characteristics from the header information of the data packet, and searching the service type of the data packet in comparison relation data between the preset service characteristics and the service types based on the service characteristics;
If the service type identification mode is the machine learning mode, inputting the head information of the data packet into a preset machine learning model for identifying the service type, so that the service type identification model correspondingly outputs the service type to which the data packet belongs;
and if the service type identification mode is the deep data packet detection, performing the deep data packet detection on the head information of the data packet to identify the service type to which the data packet belongs.
In some embodiments of the present application, before searching for QoS policy data of each data packet in the comparison relationship data between the current QoS policy and the service type according to the service type to which each data packet to be transmitted in the network belongs, the method further includes:
receiving control relation data between a preset QoS strategy and a service type and storing the control relation data to a local;
correspondingly, the service data network transmission management method further comprises the following steps:
And self-adaptively adjusting the control relation data between the QoS strategy and the service type according to the network state of the target network, and/or adjusting the control relation data between the QoS strategy and the service type based on the user-defined QoS strategy data if the user-defined QoS strategy data is received.
In some embodiments of the application, the QoS policy data includes priority and bandwidth allocation weights;
Correspondingly, according to the service type to which each data packet to be transmitted by the network belongs, respectively searching the QoS policy data of each data packet in the comparison relationship data between the current QoS policy and the service type, and respectively outputting each data packet to a target network for transmission based on the QoS policy data of each data packet, including:
According to the service type of each data packet to be transmitted by the network, searching the corresponding priority and bandwidth allocation weight of each data packet in the comparison relation data between the current QoS strategy and the service type;
Sequencing the data packets according to the order of the priority from high to low;
The current bandwidth resources of the target network are respectively distributed to the data packets according to the bandwidth distribution weights of the data packets;
and outputting the sequenced data packets to the target network in sequence for transmission based on the bandwidth resources corresponding to the data packets.
In some embodiments of the present application, the priorities include a high priority, a medium priority and a low priority, wherein the medium priority includes a plurality of medium priorities, each of which includes a plurality of sub-priorities;
Correspondingly, the sorting the data packets according to the order of the priority from high to low includes:
And respectively placing the data packets into the queues corresponding to the high priority, the medium priority and the low priority according to the priorities corresponding to the data packets, wherein the data packets placed into the queues corresponding to the medium priority are ordered according to the order of the sub-priorities from high to low.
In some embodiments of the present application, the allocating current bandwidth resources of the target network to each data packet according to the bandwidth allocation weight of each data packet includes:
Acquiring the current total bandwidth resource of the target network;
And dividing the percentages of the total bandwidth resources according to the respective bandwidth allocation weights of the data packets, and allocating the current bandwidth resources of the target network to the data packets based on the corresponding percentage division results.
In some embodiments of the present application, the outputting, based on the bandwidth resources corresponding to each of the data packets, the ordered data packets to the target network for transmission includes:
And based on the bandwidth resources corresponding to the data packets, sequentially outputting the data packets in the queues corresponding to the high priority, the medium priority and the low priority to the target network in a first-in first-out mode for transmission.
In some embodiments of the present application, the performing real-time status monitoring on the target network and each data packet, and determining whether to dynamically adjust QoS policy data of the data packet according to a corresponding monitoring result includes:
The target network and each data packet are monitored in real time, and whether the data packet in any queue exceeds a preset quantity threshold value, whether the current network state of the target network meets preset congestion conditions or whether broadband resources of any data packet are smaller than a preset resource threshold value corresponding to the data packet or not is judged according to a corresponding monitoring result;
If the data packets in any queue exceed the preset quantity threshold, extracting the data packets from the queue, and modifying the priority corresponding to the extracted data packets so that the data packets with the modified priorities are added into the corresponding queues again;
If the current network state of the target network meets a preset congestion condition, dynamically adjusting the priority and broadband allocation weight of the data packet which is not output to the target network, and/or sending a network congestion prompt message to a sending end of the data packet which is not output to the target network;
and if any broadband resource of the data packet is smaller than the preset resource threshold corresponding to the data packet, dynamically adjusting the broadband allocation weight of the data packet so as to reallocate the broadband resource of the data packet.
Another aspect of the present application provides a DPU, in which a service data network transmission management module is disposed;
the service data network transmission management module is used for the service data network transmission management method;
The service data network transmission management module is in communication connection with the data center so as to acquire a data packet currently sent to the data center from the data center.
The application provides a business data network transmission management method, which is executed in a DPU, and according to the business type of each data packet to be transmitted in a network, the QoS strategy data of each data packet is searched in the comparison relation data between the current QoS strategy and the business type, and the data packets are respectively output to a target network for transmission based on the QoS strategy data of each data packet, the real-time state monitoring is carried out on the target network and each data packet, and whether the QoS strategy data of the data packet is dynamically adjusted is judged according to the corresponding monitoring result. The application can improve the QoS capability of the data center by introducing the DPU, can realize the accurate identification of different service flows and QoS strategy distribution so as to provide high-quality network service, can improve the flexibility of service data network transmission management by carrying out real-time state monitoring and dynamic adjustment on the QoS strategy through the target network and each data packet, and can be further suitable for various and high-variability service flow transmission scenes.
Additional advantages, objects, and features of the application will be set forth in part in the description which follows and in part will become apparent to those having ordinary skill in the art upon examination of the following or may be learned from practice of the application. The objectives and other advantages of the application may be realized and attained by the structure particularly pointed out in the written description and drawings.
It will be appreciated by those skilled in the art that the objects and advantages that can be achieved with the present application are not limited to the above-described specific ones, and that the above and other objects that can be achieved with the present application will be more clearly understood from the following detailed description.
Drawings
The accompanying drawings, which are included to provide a further understanding of the application and are incorporated in and constitute a part of this specification, illustrate and together with the description serve to explain the application. The components in the figures are not necessarily to scale, emphasis instead being placed upon illustrating the principles of the application. Corresponding parts in the drawings may be exaggerated, i.e. made larger relative to other parts in an exemplary device actually manufactured according to the present application, for convenience in showing and describing some parts of the present application. In the drawings:
fig. 1 is a schematic flow chart of a first method for managing transmission of a service data network according to an embodiment of the present application.
Fig. 2 is a schematic diagram of a second flow of a method for traffic data network transmission management according to an embodiment of the present application.
Fig. 3 is a third flowchart of a method for traffic data network transmission management according to an embodiment of the present application.
Fig. 4 is a schematic diagram of execution logic of a method for implementing a QoS policy based on a DPU in an application example of the present application.
Fig. 5 is a schematic structural diagram of a traffic data network transmission management module according to an embodiment of the present application.
Detailed Description
The present application will be described in further detail with reference to the following embodiments and the accompanying drawings, in order to make the objects, technical solutions and advantages of the present application more apparent. The exemplary embodiments of the present application and the descriptions thereof are used herein to explain the present application, but are not intended to limit the application.
It should be noted here that, in order to avoid obscuring the present application due to unnecessary details, only structures and/or processing steps closely related to the solution according to the present application are shown in the drawings, while other details not greatly related to the present application are omitted.
It should be emphasized that the term "comprises/comprising" when used herein is taken to specify the presence of stated features, elements, steps or components, but does not preclude the presence or addition of one or more other features, elements, steps or components.
It is also noted herein that the term "coupled" may refer to not only a direct connection, but also an indirect connection in which an intermediate is present, unless otherwise specified.
Hereinafter, embodiments of the present application will be described with reference to the accompanying drawings. In the drawings, the same reference numerals represent the same or similar components, or the same or similar steps.
Conventional CPU-based traffic management schemes use static QoS policies with the following drawbacks:
1. The flexibility is lacking, the static QoS strategy is predefined and fixed in design, and cannot be dynamically adjusted according to the real-time network condition and service requirement. This results in an inability to quickly adapt and adjust QoS policies in the face of different traffic types and network traffic variations, resulting in reduced performance and no QoS guarantees.
2. Static QoS policies are typically based on generalized assumptions and rules that cannot accommodate diverse traffic flows, failing to adequately account for and cope with differences and special needs between different traffic types. Due to the diversity of traffic flows, static QoS policies may not provide personalized optimization and service guarantees for each traffic type.
3. And cannot handle highly variable traffic, static QoS policies cannot respond to rapid changes and fluctuations in network traffic in time. When faced with bursty high traffic or congestion conditions, static QoS policies cannot adjust priority and bandwidth allocation in real-time, resulting in performance degradation and QoS instability.
4. Performance bottleneck-since the CPU-based traffic management scheme is limited by the computing and processing capabilities of the CPU, it is not possible to meet the real-time processing requirements of high-speed traffic in a large-scale data center. This leads to problems of increased delay, reduced throughput and performance bottlenecks.
Therefore, in order to solve the above-mentioned problems, the present application introduces a Data Processing Unit (DPU) as a key technology for traffic management, and embodiments of the present application provide a traffic data network transmission management method, a traffic data network transmission management module for executing the traffic data network transmission management method, and a DPU including the traffic data network transmission management module, which can implement accurate identification and QoS policy allocation for different traffic flows, so as to provide high-quality network services, and improve flexibility of traffic data network transmission management, so that the present application is applicable to traffic flow transmission scenarios with diversity and high variability.
The following examples are provided to illustrate the invention in more detail.
Based on this, an embodiment of the present application provides a service data network transmission management method that may be implemented in a DPU, referring to fig. 1, where the service data network transmission management method specifically includes the following contents:
Step 100, according to the service type of each data packet to be transmitted by the network, searching the QoS strategy data of each data packet in the comparison relation data between the current QoS strategy and the service type, and outputting each data packet to the target network for transmission based on the QoS strategy data of each data packet.
In one or more embodiments of the present application, DPU (Data Processing Unit) is a data processing unit, i.e., a dedicated hardware accelerator, with high performance and low latency characteristics, capable of efficiently handling and managing different types of traffic. The DPU has the advantage of high parallel processing capacity and special hardware acceleration, and can realize efficient flow identification, classification and processing. Compared with the traditional CPU-based scheme, the DPU can capture and analyze the header information of the data packet more quickly, and accurately judge the service type through the feature extraction and matching algorithm. Meanwhile, the DPU has parallel processing capability, and can process a plurality of data packets simultaneously, so that the processing efficiency is improved.
In addition, the DPU has flexibility and programmability, and can define and adjust QoS strategies according to specific requirements of a data center. By predefining and storing QoS policies of different traffic types, the DPU can select and apply corresponding policies according to the traffic types of the data packets. Meanwhile, the DPU supports dynamic adjustment, and timely adjustment of priority and bandwidth allocation can be carried out according to real-time network states and service flow conditions so as to ensure execution of QoS policies and optimization of network performance.
In step 100, the DPU acquires data packets sent to the data center, where the data packets may be multiple data packets acquired by the DPU at the same time, or may be acquired individually in real time, and may be specifically set according to the actual application situation. It is understood that the data packet may refer to a compressed packet of service data.
In one or more embodiments of the present application, the collation relation data between QoS policies and traffic types refers to data for storing correspondence relations between respective QoS policy data and respective traffic types.
The QoS policy data may include at least one of policy data such as priority, bandwidth allocation weight, delay requirement, and packet loss rate requirement.
And 200, monitoring the real-time state of the target network and each data packet, and judging whether to dynamically adjust QoS strategy data of the data packet according to a corresponding monitoring result.
In step 200, the DPU needs to dynamically monitor the network state and the traffic conditions. The DPU can adjust the priority and bandwidth allocation in due time according to the real-time network condition and service requirement. For example, the bandwidth occupation ratio of different service types is adjusted according to the network load condition and the priority of the service types.
As can be seen from the above description, the service data network transmission management method provided by the embodiment of the application can improve the QoS capability of the data center by introducing the DPU, can realize the accurate identification of different service flows and the QoS policy allocation to provide high-quality network service, can improve the flexibility of service data network transmission management by performing real-time state monitoring and dynamic adjustment of QoS policies through the target network and each data packet, and can be further suitable for various and highly-variable service flow transmission scenes.
In order to further improve the effectiveness and reliability of acquiring the service types to which each data packet belongs, in the service data network transmission management method provided by the embodiment of the present application, referring to fig. 2, before step 100 in the service data network transmission management method, the following contents are specifically included:
and 010, receiving the data packet to be transmitted by the network.
In step 010, once the packet arrives at the data center, the DPU will acquire the packet to begin the identification and classification operations.
And step 020, analyzing the data packet to obtain header information of the data packet.
In step 020, the DPU captures and parses header information of the packet, which may include source address, destination address, transport protocol type, packet size, request header, etc.
Step 030, based on a preset service type identification mode, identifying and obtaining the service type of the data packet according to the header information of the data packet.
In step 030, by analyzing this information, the DPU can determine the traffic type to which the packet belongs. For example, some specific source and destination addresses may be associated with a specific service, or some specific transport protocol may be used for a certain service, even the size of the data packet and the request header may imply the type of service.
That is, the embodiment of the application can utilize a DPU supported data packet capturing and analyzing library, and use a DPDK (DATA PLANE Development Kit) library to achieve capturing and analyzing of the data packet. All available ethernet devices are then started, packets are then received from these devices, and header information of these packets is parsed out. And finally, adding a code of the user to identify and classify the data packet according to the analyzed header information. The DPU outputs the classification result, which may be a marked traffic type or other form of representation.
In order to further improve accuracy, efficiency and effectiveness of identifying the service type to which the data packet belongs according to the header information of the data packet, in the service data network transmission management method provided by the embodiment of the present application, the service type identification mode includes feature matching, machine learning or deep data packet detection, referring to fig. 3, step 030 in the service data network transmission management method specifically includes the following contents:
Step 031, if the service type identification mode is the feature matching, extracting service features from the header information of the data packet, and searching the service type to which the data packet belongs in the comparison relation data between the preset service features and the service types based on the service features.
Specifically, the DPU may extract features related to the service type, i.e., service features, by analyzing header information obtained by parsing. For example, specific identifiers in the source and destination addresses may be extracted to determine whether to associate with a particular service, whether the transport protocol type matches a known service protocol may be checked, and the service type may be inferred from the size of the data packet and the request header information.
The DPU then matches the extracted features with predefined traffic features. The predefined traffic characteristics may include a mapping table of source and destination addresses, known traffic protocols and related characteristics, association rules of traffic types with packet sizes and request headers, etc.
In order to further improve the degree of automation and intelligence of identifying the service type to which the data packet belongs according to the header information of the data packet, referring to fig. 3, step 030 in the service data network transmission management method may further include the following:
Step 032, if the service type identification mode is the machine learning mode, inputting the head information of the data packet into a preset machine learning model for identifying the service type, so that the service type identification model correspondingly outputs the service type to which the data packet belongs.
In particular, by training the model, the DPU is enabled to automatically learn and identify traffic types based on the characteristics of the data packets without requiring predefined mappings or rules. The method can provide more accurate and adaptive traffic classification and adapt to the continuously changing service types and traffic patterns. The machine learning model for identifying the service type can select a classification model such as a decision tree model, a support vector machine model, a logistic regression model and the like.
In order to further improve accuracy of identifying the service type to which the data packet belongs according to the header information of the data packet, referring to fig. 3, step 030 in the service data network transmission management method may further include the following:
Step 033, if the service type identification mode is the deep packet detection, performing the deep packet detection on the header information of the data packet to identify the service type to which the data packet belongs.
Specifically, deep learning and deep packet inspection techniques are employed to perform deep analysis of the content of the packets to identify and classify traffic. Through deep data packet detection, the DPU can acquire more detail information, and the accuracy of identification and classification is improved.
Deep packet inspection, among other things, is a technique for inspecting and analyzing the contents of packets in real time as they flow through a network, thereby enabling real-time analysis and decision making. It is used for a variety of purposes including security, traffic management, data leakage, policy violations, malware, and quality of service. Deep packet inspection allows packet data to be checked at the application layer of the network, rather than just header information, which provides more information about the packet content. It involves looking at the actual payload or content of the data packet, including the data being transmitted and the application that generated it.
In order to further improve the efficiency, flexibility and reliability of searching the QoS policy data of each data packet in the comparison relationship data between the current QoS policy and the service type, referring to fig. 2 or fig. 3, the following are specifically included before step 100 in the service data network transmission management method:
And 040, receiving the control relation data between the preset QoS strategy and the service type and storing the control relation data to the local.
Specifically, qoS policies are predefined and stored in the DPU. Each traffic type corresponds to one or more QoS policies. These policies may be set according to the nature of the traffic type and the requirements of the data center. For example, for traffic requiring low latency, its priority may be set higher, and for traffic for large data transfers, its bandwidth usage weight may be set higher. When the DPU identifies and classifies a data packet, a corresponding QoS policy is selected and applied according to the traffic type of the data packet.
In the DPU, qoS policies of different traffic types are predefined and stored. Each traffic type corresponds to one or more QoS policies. QoS policies may include, but are not limited to, priority settings, bandwidth allocation, delay requirements, packet loss rate requirements, and the like. These policies are set according to the nature of the traffic type and the requirements of the data center.
Correspondingly, in order to further improve the flexibility and the applicability of the service data network transmission management, a step 050 is specifically included before the step 100 or after the step 100 in the service data network transmission management method, referring to fig. 2 or fig. 3, taking the step 050 performed before the step 100 as an example, the step 050 specifically includes the following contents:
And 050, adaptively adjusting the comparison relation data between the QoS strategy and the service type according to the network state of the target network, and/or adjusting the comparison relation data between the QoS strategy and the service type based on the user-defined QoS strategy data if the user-defined QoS strategy data is received.
Specifically, by adopting the self-adaptive QoS strategy setting method, qoS parameters can be adjusted according to the real-time network state and service requirements. By monitoring network load, delay, bandwidth utilization, etc., the DPU can dynamically adjust priority and bandwidth allocation to accommodate different network environments and traffic demands.
And meanwhile, the user can be allowed to customize the QoS strategy according to the self requirement. The DPU provides a user interface or configuration interface to enable a user to flexibly set parameters such as priority, bandwidth allocation, delay requirements, etc. The method can meet the personalized requirements of different users or businesses.
In order to further improve the efficiency, flexibility and reliability of service data network transmission management, in the service data network transmission management method provided by the embodiment of the present application, the QoS policy data may at least include priority and bandwidth allocation weight, and correspondingly, referring to fig. 2, step 100 in the service data network transmission management method specifically includes the following contents:
Step 110, according to the service type of each data packet to be transmitted by the network, searching the corresponding priority and bandwidth allocation weight of each data packet in the comparison relation data between the current QoS strategy and the service type.
Specifically, when the DPU identifies and classifies a packet, the service type to which the packet belongs is first determined according to the traffic identification and classification scheme described above. For example, if feature matching is successful, the data packet may be marked as a particular traffic type, such as a video stream, an audio stream, a Web request, and so on.
When the DPU identifies and classifies the data packet, the service type of the data packet is determined according to the traffic identification and classification method. The DPU then selects the corresponding QoS policies based on the traffic type of the data packet. Which QoS policy to choose may be determined based on predefined mappings or rules. For example, the matching may be performed by a mapping table of traffic types and QoS policies, or it may be determined which QoS policy needs to be applied according to characteristics of the traffic types. So that the DPU may subsequently apply the selected QoS policy to the data packets or related traffic. Depending on the QoS policy selected, the DPU may adjust the priority of the packets, bandwidth allocation weights, or other relevant parameters.
To distinguish between different types of network traffic, qoS introduces some classification labels, of which EF, AF and BE are the three most common labels.
EF (Expedited Forwarding) is a high priority label, mainly used for network traffic with very high real-time performance, such as VoIP (Voice over IP) and video communication. The EF marks indicate that the packet has the highest priority, the transmission speed should be as fast as possible, and the delay and jitter should be small to ensure real-time and stability.
AF (Assured Forwarding) is a medium priority label, mainly for network traffic that requires a certain priority but does not require strict guarantees, such as network games, file transfer, etc. The AF flag classifies the packet with 4 different priorities, each with 3 different subclasses for a total of 12 priorities. Specifically, the 4 performance categories in the AF flag are AF1, AF2, AF3, and AF4, respectively.
BE (Best Effort) is a low priority tag that is primarily used for non-real time data streams such as e-mail, file downloads, etc. The BE flag indicates that the packet has no special priority handling requirements, the network switch will handle other priority packets, and the BE flag packet will handle lower priority.
In a word, three marks of EF, AF and BE are used for classifying the priorities of different types of network traffic so as to ensure that various types of data can BE reasonably processed and guaranteed during transmission.
For each service type, the corresponding bandwidth allocation weight can be calculated according to the priority and the weight calculation formula.
EF (Expedited Forwarding) since EF is a high priority traffic type, its weight can be set to the highest value, e.g. 1.0.
AF (Assured Forwarding) according to the 4 performance classes of AF (AF 1, AF2, AF3 and AF 4), each class has 3 different subclasses, totaling 12 priorities. Each sub-class is assigned an appropriate weight, e.g., 0.8, 0.6, 0.4, etc., according to traffic and performance requirements.
BE (Best Effort) since BE is a low priority traffic type, its weight can BE set to a minimum value, e.g. 0.2.
And 120, sequencing the data packets according to the order of the priority from high to low.
Specifically, the DPU may prioritize packets according to a priority rule defined in a QoS policy, and order packets with high priority in front.
And step 130, respectively distributing the current bandwidth resources of the target network to each data packet according to the bandwidth distribution weight of each data packet.
In particular, the DPU may assign weights based on bandwidth, and assign available bandwidth to each traffic flow in a weighted proportion. Bandwidth allocation may be performed using weighted fair Queuing (WEIGHTED FAIR Queuing) or other suitable algorithm.
Weighted fair Queuing (WEIGHTED FAIR Queuing) allocates a corresponding bandwidth to each traffic type according to the weight proportion. For example, if EF weights 1.0, AF weights 0.8, BE weights 0.2, then EF traffic will get 50% bandwidth, AF traffic will get 40% bandwidth, BE traffic will get 10% bandwidth.
And 140, outputting the sequenced data packets to the target network in sequence for transmission based on the bandwidth resources corresponding to the data packets.
Specifically, the DPU manages and transmits traffic according to the QoS policy setting may be in such a way that the DPU processes data packets according to the set priority order and allocates an appropriate bandwidth to each traffic according to the priority and bandwidth allocation result.
That is, the DPU processes the packets in the order of priority and transmits the packets in accordance with the bandwidth allocation result. Wherein high priority data packets are preferentially processed and transmitted, and each service flow occupies a corresponding proportion of bandwidth for transmission according to its bandwidth allocation weight.
In steps 110 to 140, the DPU performs priority adjustment and bandwidth allocation according to the QoS policy corresponding to each packet. Specifically, the DPU first prioritizes the packets. High priority packets are prioritized and sent. At the same time, the DPU also controls the bandwidth usage of each traffic flow. This is typically achieved by means of weights, the bandwidth usage weight of each traffic flow determining the proportion of its available bandwidth. In this process, the DPU needs to dynamically monitor the network status and traffic conditions in order to make timely adjustments to the priority and bandwidth allocation, i.e., the content of step 200 described above.
In order to further improve the efficiency, flexibility and reliability of service data network transmission, in the method for managing service data network transmission provided by the embodiment of the present application, the priorities include a high priority EF, a medium priority AF and a low priority BE, which are divided from high to low, wherein the medium priority AF includes a plurality of medium priorities, such as AF1, AF2, AF3 and AF4, which are divided from high to low, and each of the medium priorities includes a plurality of sub-priorities, which are divided from high to low, and correspondingly, referring to fig. 3, step 120 in the method for managing service data network transmission specifically includes:
and 121, respectively placing the data packets into the queues corresponding to the high priority, the medium priority and the low priority according to the priorities corresponding to the data packets, wherein the data packets placed into the queues corresponding to the medium priority are ordered according to the order of the sub-priorities from high to low.
For example, queuing algorithms are employed for different kinds of traffic for priority scheduling of three different traffic (EF, AF, BE):
A) Three queues are defined, namely an EF queue, an AF queue and a BE queue, wherein the AF queue comprises an AF1 queue to an AF4 queue and is used for storing data packets with corresponding priorities.
B) And (3) the data packets enter the queues, namely, the data packets are placed into the corresponding queues according to the marks of the data packets. The EF marked data packet is placed in an EF queue, the AF marked data packet is placed in an AF queue, and the BE marked data packet is placed in a BE queue.
The queuing algorithm can reasonably schedule and process different types of services according to the priority of the data packet, ensure the instantaneity and stability of the EF data packet, provide a certain priority service of the AF data packet and process the low priority requirement of the BE data packet. The algorithm can be adjusted and optimized according to specific requirements to meet the priority requirements of different services and the change of network conditions.
In order to further improve the efficiency, flexibility and reliability of service data network transmission, in the method for managing service data network transmission provided in the embodiment of the present application, referring to fig. 3, step 130 in the method for managing service data network transmission specifically includes the following contents:
step 131, obtaining the current total bandwidth resource of the target network.
And 132, dividing the total bandwidth resources according to the respective bandwidth allocation weights of the data packets, and allocating the current bandwidth resources of the target network to the data packets based on the corresponding percentage division results.
Specifically, the pseudo code corresponding to step 132 is shown in Table 1.
TABLE 1
In the above pseudo code, a coefficient variable is added for adjusting the proportion of the weights. This coefficient can be set according to the actual requirements to achieve a more flexible bandwidth allocation.
In table 1, ef_weight represents the expedited forwarding queue weight, indicating that the packet has the highest priority and needs to be transmitted quickly. AF stands for guaranteed forwarding queue, representing medium priority packets for network traffic that requires a certain priority but does not require strict guarantees. There are 4 queues in the AF queue, wherein AF1_weight indicates that there is a guaranteed forwarding queue 1 weight, AF2_weight indicates that there is a guaranteed forwarding queue 2 weight, AF3_weight indicates that there is a guaranteed forwarding queue 3 weight, and AF4_weight indicates that there is a guaranteed forwarding queue 4 weight.
BE is a best effort queue representing low priority packets, primarily for non-real time data flows. Be_weight indicates best effort queue weights. The BE queue is AF n_weight, which is derived from the AF queue value, where n ranges from 1 to 4.
Total_Bandwidth represents the Total Bandwidth, which represents the Total transmission capacity of the entire network or a particular portion. This is calculated from the actual situation and is related to the performance of the device after leaving the factory.
Coefficient is a constant coefficient used to adjust the weight of computing the bandwidth of each class of service. By adjusting this coefficient, the bandwidth allocation ratio of each service class can be affected.
EF_bandwidth represents an expedited forwarding queue bandwidth value, AF1_bandwidth represents a guaranteed forwarding queue 1 bandwidth value, AF2_bandwidth represents a guaranteed forwarding queue 2 bandwidth value, AF3_bandwidth represents a guaranteed forwarding queue 3 bandwidth value, AF4_bandwidth represents a guaranteed forwarding queue 4 bandwidth value, and BE_bandwidth represents a best effort queue bandwidth value.
In order to further improve the efficiency, flexibility and reliability of service data network transmission, in the method for managing service data network transmission provided in the embodiment of the present application, referring to fig. 3, step 140 in the method for managing service data network transmission specifically includes the following contents:
And 141, sequentially outputting the data packets in the queues corresponding to the high priority, the medium priority and the low priority to the target network in a first-in first-out mode based on the bandwidth resources corresponding to the data packets respectively for transmission.
In one example, the specific process of processing the data packets in a prioritized order may be to fetch a data packet from the EF queue for processing and transmission. If the EF queue is empty, a data packet is fetched from the AF queue for processing and transmission. If the AF queue is also empty, a packet is fetched from the BE queue for processing and transmission.
Wherein, the data packets are processed in a first-in first-out (FIFO) mode in each queue. I.e., in each queue, packets that first enter the queue are processed and transmitted first.
In order to further improve the efficiency, flexibility and reliability of service data network transmission, in the method for managing service data network transmission provided in the embodiment of the present application, referring to fig. 2 or fig. 3, step 200 in the method for managing service data network transmission specifically includes the following contents:
Step 210, monitoring the target network and each data packet in real time, and judging whether the data packet in any queue exceeds a preset quantity threshold value, whether the current network state of the target network meets a preset congestion condition or whether broadband resources of any data packet are smaller than a preset resource threshold value corresponding to the data packet according to a corresponding monitoring result.
Step 220, if the data packet in any queue exceeds the preset number threshold, extracting the data packet from the queue, and modifying the priority corresponding to the extracted data packet to make the data packet with the modified priority be added into the corresponding queue again.
Step 230, if the current network state of the target network meets the preset congestion condition, dynamically adjusting the priority and broadband allocation weight of the data packet which is not currently output to the target network, and/or sending a network congestion prompting message to the sending end of the data packet which is not currently output to the target network.
Step 240, if any broadband resource of the data packet is smaller than the preset resource threshold corresponding to the data packet, dynamically adjusting the broadband allocation weight of the data packet to reallocate the broadband resource of the data packet.
Specifically, the DPU dynamically monitors the network state and the condition of traffic flows. The DPU can adjust the priority and bandwidth allocation in due time according to the real-time network condition and service requirement. For example, if the network is congested or some traffic requires more bandwidth, the DPU may recalculate the weights and perform bandwidth reassignment.
That is, the priority scheduling policy may be dynamically adjusted based on real-time network conditions and traffic demands. For example, if there are too many packets in the EF queue, the weight of the priority schedule may be adjusted so that the packets in the EF queue can be processed and transmitted more quickly. The number of data packets and the network condition of each queue are monitored in real time. According to the monitoring result, feedback information can be provided to the sending end, for example, a congestion signal is sent to the sending end through a congestion control mechanism, so as to control the sending rate of the data packet.
Meanwhile, the DPU has the capability of fault recovery and exception handling. When a fault or abnormal situation occurs, such as a network interruption or packet loss situation, the DPU may take corresponding measures, such as retransmitting the lost data packet, adjusting priority or bandwidth allocation, etc., so as to ensure continuity and reliability of the service.
In order to further explain the service data network transmission management method provided by the embodiment, the application also provides an application example of the QoS strategy implementation method based on the DPU, which can guarantee the priority and the bandwidth of different service flows. Specifically, the DPU will first identify and classify incoming traffic and then set priority and allocate bandwidth according to preset QoS policies. And finally, the DPU transmits and manages the service traffic according to the adjusted priority and bandwidth.
Referring to fig. 4, after capturing a data packet from a data stream, a dpu sequentially performs header information analysis, feature extraction, feature matching and service type judgment, then performs service type matching according to the obtained service type, performs network state and service flow monitoring in real time in the process, then selects a QoS policy selection corresponding to the service type according to the service type in a policy repository formed in advance based on a defined policy rule and RBAC admission according to the service type, distinguishes a service policy execution point, then performs data packet priority adjustment according to a data packet classification model, then adds the data packet into each queue (e.g., EF queue, AF1 queue, AF2 queue and BE queue) in a QoS policy queue according to priority, performs bandwidth allocation weight calculation, bandwidth allocation and data packet processing and transmission according to priority, and performs fault recovery and exception handling when a fault is detected.
The specific application example of the DPU-based QoS strategy implementation method comprises the following contents:
(1) Based on the result of priority and bandwidth allocation, the DPU performs transmission and management of traffic. Specifically, the data packets are sent sequentially by priority. Each service flow also occupies a corresponding proportion of the bandwidth according to its bandwidth usage weight. Throughout the process, the DPU needs to keep monitoring of network status and traffic flows to ensure proper enforcement of QoS policies and to respond quickly to any bursty network conditions.
(2) And receiving and sequencing the data packets, namely receiving the data packets by the DPU and sequencing the data packets according to the priority. The high priority packets are ranked in front and the low priority packets are ranked in rear.
(3) Bandwidth allocation weight calculation the DPU calculates the bandwidth allocation weight for each traffic flow according to the bandwidth allocation rules defined in the QoS policy. These weights determine the proportion of each traffic flow that occupies the available bandwidth.
(4) And the DPU transmits the data packets according to the priority order and manages the bandwidth use according to the bandwidth allocation weight. High priority packets are sent preferentially, while each traffic occupies a corresponding proportion of the bandwidth according to its bandwidth allocation weight. This ensures that higher priority traffic gets more bandwidth resources.
(5) Network status and traffic monitoring-DPU continuously monitors the status of network status and traffic. By monitoring indexes such as network delay, bandwidth utilization rate and the like in real time and analyzing service flow, the DPU can know actual conditions and service demands of the network.
(6) QoS policy enforcement and response-the DPU ensures proper enforcement of QoS policies and responds quickly to any bursty network conditions. If network congestion or other abnormal conditions occur, the DPU can dynamically adjust priority and bandwidth allocation according to the network state and traffic flow conditions monitored in real time so as to maintain QoS performance.
Fault recovery and exception handling DPU has fault recovery and exception handling capabilities. When a fault or abnormal situation occurs, such as a network interruption or packet loss situation, the DPU may take corresponding measures, such as retransmitting the lost data packet, adjusting priority or bandwidth allocation, etc., so as to ensure continuity and reliability of the service.
The flow describes the DPU-based prioritization and bandwidth allocation implementation steps including packet reception, qoS policy selection, packet prioritization, bandwidth allocation weight calculation, bandwidth allocation, monitoring and adjustment, and packet processing and transmission.
In summary, the DPU-based traffic management scheme has significant advantages over conventional CPU-based schemes, including high performance, low latency, high parallel processing capability, flexibility, and programmability. By introducing the DPU, the QoS capability of the data center can be improved, and the accurate identification, priority adjustment and bandwidth allocation of different service flows can be realized so as to provide high-quality network service.
That is, the service data network transmission management method provided by the embodiment of the application adopts queuing algorithms and priority scheduling mechanisms aiming at different service priorities by designing a traffic identification and classification method based on a DPU, setting and implementation modes of a QoS strategy, operation of priority adjustment and bandwidth allocation, transmission and management modes of service traffic and queuing algorithms and priority scheduling. By defining different queues and processing the data packets according to the priority order, effective management and scheduling of EF, AF and BE services are realized. The core innovation in this section includes the definition of queues and the mechanism by which packets enter the queues, as well as the flow of scheduling packets according to priority.
By using the technical scheme of the application, the service flow of the data center can be more effectively managed, and the service quality of different services is ensured. Meanwhile, the flow management scheme based on the DPU can more flexibly cope with the change of the service flow, so that the overall performance and efficiency of the data center are improved.
The present application also provides a service data network transmission management module for executing all or part of the service data network transmission management method, referring to fig. 5, the service data network transmission management module provided in the DPU specifically includes the following contents:
The QoS policy obtaining module 10 is configured to search, according to a service type to which each data packet to be transmitted in the network belongs, qoS policy data of each data packet in comparison relationship data between a current QoS policy and the service type, and output each data packet to a target network for transmission based on the QoS policy data of each data packet;
And the QoS policy dynamic adjustment module 20 is used for monitoring the real-time state of the target network and each data packet, and judging whether to dynamically adjust the QoS policy data of the data packet according to the corresponding monitoring result. .
The embodiment of the service data network transmission management module provided by the application can be specifically used for executing the processing flow of the embodiment of the service data network transmission management method in the embodiment, and the functions of the processing flow are not repeated herein, and can be referred to the detailed description of the embodiment of the service data network transmission management method.
The part of the service data network transmission management module for carrying out service data network transmission management can be completed in the client device. Specifically, the selection may be made according to the processing capability of the client device, and restrictions of the use scenario of the user. The application is not limited in this regard. If all operations are performed in the client device, the client device may further include a processor for performing specific processing of traffic data network transmission management.
The client device may have a communication module (i.e. a communication unit) and may be connected to a remote server in a communication manner, so as to implement data transmission with the server. The server may include a server on the side of the task scheduling center, and in other implementations may include a server of an intermediate platform, such as a server of a third party server platform having a communication link with the task scheduling center server. The server may include a single computer device, a server cluster formed by a plurality of servers, or a server structure of a distributed device.
Any suitable network protocol may be used between the server and the client device, including those not yet developed on the filing date of the present application. The network protocols may include, for example, TCP/IP protocol, UDP/IP protocol, HTTP protocol, HTTPS protocol, etc. Of course, the network protocol may also include, for example, RPC protocol (Remote Procedure Call Protocol ), REST protocol (Representational STATE TRANSFER) or the like used above the above-described protocol.
As can be seen from the above description, the service data network transmission management module provided in the embodiment of the present application can improve QoS capability of a data center by introducing a DPU, and can realize accurate identification of different service flows and QoS policy allocation to provide high-quality network services, and can improve flexibility of service data network transmission management by performing real-time status monitoring and dynamic adjustment of QoS policies through a target network and each data packet, and thus can be suitable for various and highly-variable service flow transmission scenarios.
The embodiment of the application also provides a DPU, which can comprise a service data network transmission management module;
The service data network transmission management module is configured to execute the service data network transmission management method provided in the foregoing embodiment;
The service data network transmission management module is in communication connection with the data center, and can be arranged in the data center to acquire a data packet currently sent to the data center from the data center.
The embodiment of the application also provides a computer readable storage medium, on which a computer program is stored, which when being executed by a processor, implements the steps of the foregoing service data network transmission management method. The computer readable storage medium may be a tangible storage medium such as Random Access Memory (RAM), memory, read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, floppy disks, hard disk, a removable memory disk, a CD-ROM, or any other form of storage medium known in the art.
Those of ordinary skill in the art will appreciate that the various illustrative components, systems, and methods described in connection with the embodiments disclosed herein can be implemented as hardware, software, or a combination of both. The particular implementation is hardware or software dependent on the specific application of the solution and the design constraints. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application. When implemented in hardware, it may be, for example, an electronic circuit, an Application Specific Integrated Circuit (ASIC), suitable firmware, a plug-in, a function card, or the like. When implemented in software, the elements of the application are the programs or code segments used to perform the required tasks. The program or code segments may be stored in a machine readable medium or transmitted over transmission media or communication links by a data signal carried in a carrier wave.
It should be understood that the application is not limited to the particular arrangements and instrumentality described above and shown in the drawings. For the sake of brevity, a detailed description of known methods is omitted here. In the above embodiments, several specific steps are described and shown as examples. The method processes of the present application are not limited to the specific steps described and shown, but various changes, modifications and additions, or the order between steps may be made by those skilled in the art after appreciating the spirit of the present application.
In this disclosure, features that are described and/or illustrated with respect to one embodiment may be used in the same way or in a similar way in one or more other embodiments and/or in combination with or instead of the features of the other embodiments.
The above description is only of the preferred embodiments of the present application and is not intended to limit the present application, and various modifications and variations can be made to the embodiments of the present application by those skilled in the art. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the protection scope of the present application.

Claims (7)

1.一种业务数据网络传输管理方法,其特征在于,在DPU中执行,所述业务数据网络传输管理方法包括:1. A service data network transmission management method, characterized in that it is executed in a DPU, and the service data network transmission management method comprises: 接收待进行网络传输的数据包;receiving data packets to be transmitted over the network; 对所述数据包进行解析以得到所述数据包的头部信息;Parsing the data packet to obtain header information of the data packet; 基于预设的业务类型识别方式,根据所述数据包的头部信息识别得到所述数据包所属的业务类型;所述业务类型识别方式包括:特征匹配、机器学习或深度数据包检测;Based on a preset service type identification method, the service type to which the data packet belongs is identified according to the header information of the data packet; the service type identification method includes: feature matching, machine learning or deep data packet detection; 相对应的,所述基于预设的业务类型识别方式,根据所述数据包的头部信息识别得到所述数据包所属的业务类型,包括:Correspondingly, the method of identifying the service type based on the preset service type, identifying the service type to which the data packet belongs according to the header information of the data packet, includes: 若所述业务类型识别方式为所述特征匹配,则自所述数据包的头部信息中提取业务特征,并基于该业务特征,在预设的业务特征与业务类型之间的对照关系数据中查找所述数据包所属的业务类型;If the service type identification method is the feature matching, extracting the service feature from the header information of the data packet, and based on the service feature, searching the service type to which the data packet belongs in the comparison relationship data between the preset service feature and the service type; 若所述业务类型识别方式为所述机器学习,则将所述数据包的头部信息输入预设的用于识别业务类型的机器学习模型中,以使该业务类型识别模型对应输出所述数据包所属的业务类型;If the service type identification method is the machine learning, the header information of the data packet is input into a preset machine learning model for identifying the service type, so that the service type identification model outputs the service type to which the data packet belongs correspondingly; 若所述业务类型识别方式为所述深度数据包检测,则对所述数据包的头部信息进行深度数据包检测以识别得到所述数据包所属的业务类型;If the service type identification method is the deep data packet inspection, performing deep data packet inspection on the header information of the data packet to identify the service type to which the data packet belongs; 根据目标网络的网络状态自适应调整QoS策略与业务类型之间的对照关系数据;Adaptively adjust the comparison relationship data between QoS strategy and service type according to the network status of the target network; 根据待进行网络传输的各个数据包各自所属的业务类型,在当前的QoS策略与业务类型之间的对照关系数据中分别查找各个所述数据包各自的QoS策略数据,并基于各个所述数据包各自的QoS策略数据将各个所述数据包分别输出至目标网络中以进行传输;According to the service type of each data packet to be transmitted on the network, the QoS policy data of each data packet is searched in the comparison relationship data between the current QoS policy and the service type, and each data packet is output to the target network for transmission based on the QoS policy data of each data packet; 对所述目标网络及各个所述数据包进行实时状态监测,并根据对应的监测结果判定是否对所述数据包的QoS策略数据进行动态调整;Performing real-time status monitoring on the target network and each of the data packets, and determining whether to dynamically adjust the QoS policy data of the data packets according to the corresponding monitoring results; 所述对所述目标网络及各个所述数据包进行实时状态监测,并根据对应的监测结果判定是否对所述数据包的QoS策略数据进行动态调整,包括:The real-time status monitoring of the target network and each of the data packets, and determining whether to dynamically adjust the QoS policy data of the data packets according to the corresponding monitoring results, includes: 对所述目标网络及各个所述数据包进行实时状态监测,并根据对应的监测结果判断任一队列中的数据包是否超过预设数量阈值、所述目标网络当前的网络状态是否满足预设的拥塞条件或者当前是否存在任一所述数据包的宽带资源小于该数据包对应的预设资源阈值;Performing real-time status monitoring on the target network and each of the data packets, and judging whether the data packets in any queue exceed a preset number threshold, whether the current network status of the target network meets a preset congestion condition, or whether the broadband resource of any of the data packets is less than a preset resource threshold corresponding to the data packet according to the corresponding monitoring results; 若任一队列中的数据包超过预设数量阈值,则自该队列中提取数据包,并修改提取的数据包对应的优先级以使优先级被修改后的该数据包重新加入对应的队列中;If the number of packets in any queue exceeds a preset threshold, a packet is extracted from the queue, and the priority corresponding to the extracted packet is modified so that the packet with the modified priority is re-added to the corresponding queue; 若所述目标网络当前的网络状态满足预设的拥塞条件,则对当前尚未输出至所述目标网络的数据包的优先级和宽带分配权重进行动态调整,和/或,向当前尚未输出至所述目标网络的数据包的发送端发送网络拥堵提示消息;If the current network status of the target network meets the preset congestion condition, the priority and bandwidth allocation weight of the data packet that has not yet been output to the target network are dynamically adjusted, and/or a network congestion prompt message is sent to the sender of the data packet that has not yet been output to the target network; 若当前存在任一所述数据包的宽带资源小于该数据包对应的预设资源阈值,则对该数据包的宽带分配权重进行动态调整以重新分配该数据包的宽带资源。If the bandwidth resource of any of the data packets currently exists and is less than the preset resource threshold corresponding to the data packet, the bandwidth allocation weight of the data packet is dynamically adjusted to reallocate the bandwidth resource of the data packet. 2.根据权利要求1所述的业务数据网络传输管理方法,其特征在于,在所述根据待进行网络传输的各个数据包各自所属的业务类型,在当前的QoS策略与业务类型之间的对照关系数据中分别查找各个所述数据包各自的QoS策略数据之前,还包括:2. The method for managing network transmission of service data according to claim 1, characterized in that before searching for the QoS policy data of each data packet in the comparison relationship data between the current QoS policy and the service type according to the service type of each data packet to be transmitted over the network, the method further comprises: 接收预设的QoS策略与业务类型之间的对照关系数据并存储至本地;Receive the comparison relationship data between the preset QoS policy and the service type and store it locally; 若接收到用户自定义QoS策略数据,则基于该用户自定义QoS策略数据调整所述QoS策略与业务类型之间的对照关系数据。If user-defined QoS policy data is received, the mapping relationship data between the QoS policy and the service type is adjusted based on the user-defined QoS policy data. 3.根据权利要求1所述的业务数据网络传输管理方法,其特征在于,所述QoS策略数据包括:优先级和带宽分配权重;3. The service data network transmission management method according to claim 1, characterized in that the QoS policy data includes: priority and bandwidth allocation weight; 相对应的,所述根据待进行网络传输的各个数据包各自所属的业务类型,在当前的QoS策略与业务类型之间的对照关系数据中分别查找各个所述数据包各自的QoS策略数据,并基于各个所述数据包各自的QoS策略数据将各个所述数据包分别输出至目标网络中以进行传输,包括:Correspondingly, according to the service type to which each data packet to be transmitted on the network belongs, searching for the QoS policy data of each data packet in the comparison relationship data between the current QoS policy and the service type, and outputting each data packet to the target network for transmission based on the QoS policy data of each data packet, including: 根据待进行网络传输的各个数据包各自所属的业务类型,在当前的QoS策略与业务类型之间的对照关系数据中分别查找各个所述数据包各自对应的优先级和带宽分配权重;According to the service type of each data packet to be transmitted on the network, the priority and bandwidth allocation weight corresponding to each data packet are respectively searched in the comparison relationship data between the current QoS policy and the service type; 按照优先级由高至低的顺序对各个所述数据包进行排序;Sorting each of the data packets in descending order of priority; 以及,根据各个所述数据包各自的带宽分配权重分别为各个所述数据包分配目标网络当前的带宽资源;And, allocating the current bandwidth resources of the target network to each of the data packets according to the bandwidth allocation weight of each of the data packets; 基于各个所述数据包各自对应的带宽资源,将排序后的各个所述数据包按序输出至所述目标网络进行传输。Based on the bandwidth resources corresponding to each of the data packets, the sorted data packets are output to the target network in sequence for transmission. 4.根据权利要求3所述的业务数据网络传输管理方法,其特征在于,所述优先级包括:由高至低划分的高优先级、中等优先级和低优先级,其中,所述中等优先级包含有由高至低划分的多个中间优先级,每个所述中间优先级包含有由高至低划分的多个子优先级;4. The business data network transmission management method according to claim 3 is characterized in that the priority includes: a high priority, a medium priority and a low priority divided from high to low, wherein the medium priority includes a plurality of intermediate priorities divided from high to low, and each of the intermediate priorities includes a plurality of sub-priorities divided from high to low; 相对应的,所述按照优先级由高至低的顺序对各个所述数据包进行排序,包括:Correspondingly, the data packets are sorted in descending order of priority, including: 根据各个所述数据包各自对应的优先级,将各个所述数据包分别放入所述高优先级、各个所述中等优先级以及所述低优先级各自对应的队列中,其中,放入每个所述中等优先级对应的队列中的数据包按照所属的所述子优先级由高至低的顺序排序。According to the priorities corresponding to each of the data packets, each of the data packets is placed in a queue corresponding to the high priority, each of the medium priority and the low priority, respectively, wherein the data packets placed in the queue corresponding to each of the medium priority are sorted in descending order according to the sub-priority to which they belong. 5.根据权利要求3所述的业务数据网络传输管理方法,其特征在于,所述根据各个所述数据包各自的带宽分配权重分别为各个所述数据包分配目标网络当前的带宽资源,包括:5. The business data network transmission management method according to claim 3 is characterized in that the method of allocating the current bandwidth resources of the target network to each of the data packets according to the bandwidth allocation weight of each of the data packets comprises: 获取所述目标网络当前的总带宽资源;Obtaining the current total bandwidth resources of the target network; 根据各个所述数据包各自的带宽分配权重将所述总带宽资源的进行百分比划分,并基于对应的百分比划分结果为各个所述数据包分配所述目标网络当前的带宽资源。The total bandwidth resources are divided into percentages according to the bandwidth allocation weights of the respective data packets, and the current bandwidth resources of the target network are allocated to the respective data packets based on the corresponding percentage division results. 6.根据权利要求4所述的业务数据网络传输管理方法,其特征在于,所述基于各个所述数据包各自对应的带宽资源,将排序后的各个所述数据包按序输出至所述目标网络进行传输,包括:6. The method for managing network transmission of service data according to claim 4, characterized in that the step of outputting the sorted data packets in sequence to the target network for transmission based on the bandwidth resources corresponding to the data packets comprises: 基于各个所述数据包各自对应的带宽资源,以先进先出的方式将所述高优先级、各个所述中等优先级以及所述低优先级各自对应的队列中的数据包依次输出至所述目标网络进行传输。Based on the bandwidth resources corresponding to each of the data packets, the data packets in the queues corresponding to the high priority, each of the medium priority and the low priority are output to the target network in sequence for transmission in a first-in-first-out manner. 7.一种DPU,其特征在于,所述DPU中设有业务数据网络传输管理模块;7. A DPU, characterized in that a service data network transmission management module is provided in the DPU; 所述业务数据网络传输管理模块用于执行权利要求1至6任一项所述的业务数据网络传输管理方法;The service data network transmission management module is used to execute the service data network transmission management method according to any one of claims 1 to 6; 所述业务数据网络传输管理模块与数据中心之间通信连接,以自所述数据中心获取当前发送至所述数据中心的数据包。The business data network transmission management module is communicatively connected with the data center to obtain data packets currently sent to the data center from the data center.
CN202311559165.8A 2023-11-21 2023-11-21 Service data network transmission management method and DPU Active CN117499258B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202311559165.8A CN117499258B (en) 2023-11-21 2023-11-21 Service data network transmission management method and DPU

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202311559165.8A CN117499258B (en) 2023-11-21 2023-11-21 Service data network transmission management method and DPU

Publications (2)

Publication Number Publication Date
CN117499258A CN117499258A (en) 2024-02-02
CN117499258B true CN117499258B (en) 2025-05-06

Family

ID=89676283

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202311559165.8A Active CN117499258B (en) 2023-11-21 2023-11-21 Service data network transmission management method and DPU

Country Status (1)

Country Link
CN (1) CN117499258B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118803060A (en) * 2024-03-12 2024-10-18 中国移动通信集团福建有限公司 Business processing method, device, electronic device and storage medium
CN117978756A (en) * 2024-04-01 2024-05-03 天津大学 Data transmission method, data transmission device and resource mining system
CN118802987B (en) * 2024-09-13 2025-01-10 辛巴网络科技(南京)有限公司 Flow control method of Internet of vehicles flow platform
CN119094463A (en) * 2024-10-29 2024-12-06 深圳市丰润达科技有限公司 Storm control method based on application identification

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110958185A (en) * 2019-11-27 2020-04-03 新华三半导体技术有限公司 QoS configuration method and device based on service
CN115150278A (en) * 2021-03-29 2022-10-04 迈络思科技有限公司 Using a Data Processing Unit (DPU) as a preprocessor for Graphics Processing Unit (GPU) based machine learning

Family Cites Families (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8259566B2 (en) * 2005-09-20 2012-09-04 Qualcomm Incorporated Adaptive quality of service policy for dynamic networks
US9991932B2 (en) * 2016-02-29 2018-06-05 Arris Enterprises Llc MoCA network system for multiple dwelling units
US11784944B2 (en) * 2022-01-11 2023-10-10 International Business Machines Corporation Dynamic bandwidth allocation in cloud network switches based on traffic demand prediction
CN116962258A (en) * 2023-07-05 2023-10-27 北京达佳互联信息技术有限公司 Bandwidth detection method, device, system, equipment and storage medium

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110958185A (en) * 2019-11-27 2020-04-03 新华三半导体技术有限公司 QoS configuration method and device based on service
CN115150278A (en) * 2021-03-29 2022-10-04 迈络思科技有限公司 Using a Data Processing Unit (DPU) as a preprocessor for Graphics Processing Unit (GPU) based machine learning

Also Published As

Publication number Publication date
CN117499258A (en) 2024-02-02

Similar Documents

Publication Publication Date Title
CN117499258B (en) Service data network transmission management method and DPU
US9225659B2 (en) Method and apparatus for scheduling a heterogeneous communication flow
EP3955550B1 (en) Flow-based management of shared buffer resources
CA2635969C (en) Systems and methods for improved network based content inspection
CN108353029B (en) Method and system for managing data traffic in a computing network
CN118474039A (en) A TSN network medium system for precise flow control
US7089294B1 (en) Methods, systems and computer program products for server based type of service classification of a communication request
WO2020087523A1 (en) Network communication method and apparatus, and electronic device
Abdollahi et al. Flow-aware forwarding in SDN datacenters using a knapsack-PSO-based solution
US20210135998A1 (en) Quality of service in virtual service networks
CN101473631A (en) Systems and methods for protocol filtering for quality of service
CN118102318A (en) Data transmission system based on 5G technology
US7418001B2 (en) Router for scheduling packet and method therefor
US11153221B2 (en) Methods, systems, and devices for classifying layer 4-level data from data queues
CN114079638A (en) Data transmission method, device and storage medium for multi-protocol hybrid network
CN111314236A (en) Message forwarding method and device
Imputato et al. Design and implementation of the traffic control module in ns-3
EP1817875B1 (en) Terminal of portable internet system and method of transmitting uplink data in terminal
US20070130367A1 (en) Inbound connection prioritization
US10439947B2 (en) Method and apparatus for providing deadline-based segmentation for video traffic
US10862820B2 (en) Method for prioritizing network packets at high bandwidth speeds
JP2006525704A (en) Frame classification method by priority
KR20060090497A (en) Dynamic Queue Management Method for Stable Packet Forwarding and Components of Network Processor
CN111970149A (en) Shared bandwidth realizing method based on hardware firewall QOS
CN110636013B (en) Dynamic scheduling method and device for message queue

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant