CN117609115A - A method and system for lightweight virtualization based on RDMA technology - Google Patents

Abstract

The present invention provides a method and system for realizing lightweight virtualization based on RDMA technology. The method includes: establishing a connection between an RDMA device based on RDMA technology and the host side; and allocating a RDMA device interface; the RDMA device interface receives the virtualization configuration from the host-side driver; wherein the virtualization configuration includes the queue priority configuration; each RDMA device interface configures the queue in the RDMA device based on the received virtualization configuration. Management; the container or virtual machine uses the MMIO register to map to the RDMA device, so that the container or virtual machine can access the RDMA device based on the RDMA device interface and implement virtualization based on RDMA technology. The invention can simplify the complexity of the system, save the occupation of memory space and configuration space, and reduce the cost.

Description

A method and system for lightweight virtualization based on RDMA technology

Technical field

The present invention relates to the technical field of RDMA device virtualization I/O, and in particular to a method and system for realizing lightweight virtualization based on RDMA technology.

Background technique

In the process of data packet processing, traditional TCP/IP technology has to go through the operating system and other software layers, which requires a large amount of server resources and memory bus bandwidth. Data travels back and forth between system memory, processor cache and network controller cache. Copy movement places a heavy burden on the server's CPU and memory. In particular, the serious "mismatch" between network bandwidth, processor speed and memory bandwidth further aggravates the network delay effect.

The principle of RDMA technology is to use the low-latency features provided by stack bypass and zero-copy technology to reduce CPU usage, reduce memory bandwidth bottlenecks, and provide higher bandwidth utilization. RDMA technology has the advantages of low latency, high throughput, high efficiency, and occupies very little CPU resources. RDMA technology provides an I/O-based channel that allows an application to directly read and write remote virtual memory through an RDMA device.

Hardware-based RDMA virtualization I/O technology currently mainly uses the SR-IOV standard of PCIe. The SR-IOV standard allows a physical function (Physical Funciton, referred to as PF) to create multiple virtual functions (Virtual Function, referred to as VF). Virtual Function It can be transparently transmitted to a virtual machine (VM for short), so that multiple virtual machines can share the same physical network card. Based on the content of the SR-IOV standard, the new device is created to allow virtual machines to be connected directly to I/O devices, bypassing the hypervisor and virtual switch layers, which can bring low latency and close to cables. speed. A single I/O resource can be shared by multiple virtual machines. A shared device will provide dedicated resources and also use shared common resources. This way, each virtual machine has access to unique resources. Therefore, a PCIe device with the SR-IOV standard enabled and appropriate hardware and operating system support can appear as multiple separate physical devices, each with its own PCIe configuration space. Compared with IO simulation virtualization, virtualization based on the SR-IOV standard reduces I/O latency and CPU utilization. Data does not need to be forwarded through the host, so SR-IOV improves I/O performance and data security. sex.

However, the RDMA virtualized I/O technology based on the SR-IOV standard has some shortcomings: the SR-IOV standard virtualizes the VF device (Visual Function) through hardware, which occupies an independent configuration space, and the memory mapped I/O space (MMIO ), each virtual device has an independent interrupt vector configuration, which causes the system to occupy more memory space and configuration space resources, increasing system complexity and high implementation costs.

Contents of the invention

In view of this, embodiments of the present invention provide a method and system for implementing lightweight virtualization based on RDMA technology to eliminate or improve one or more defects existing in the existing technology.

One aspect of the present invention provides a method for implementing lightweight virtualization based on RDMA technology. The method includes the following steps:

The RDMA device based on RDMA technology establishes a connection with the host side; //PCIe, server

For each container or virtual machine created on the host side, an RDMA device interface is allocated; among them, the host-side operating system creates multiple containers or virtual machines based on the virtualization function, and the RDMA device interface contains MMIO registers in units of physical pages. ;

The RDMA device interface receives the virtualization configuration from the host-side driver; wherein the virtualization configuration includes queue priority configuration;

Each RDMA device interface manages the queue in the RDMA device based on the received virtualization configuration;

The container or virtual machine uses the MMIO register to map to the RDMA device, so that the container or virtual machine can access the RDMA device based on the RDMA device interface and implement virtualization based on RDMA technology.

In some embodiments of the present invention, the type of RDMA device includes an RDMA network card and a DPU accelerator card that supports RDMA functions.

In some embodiments of the present invention, the method further includes: in each container or virtual machine created on the host side, using virtualization device operating software to manage the RDMA device interface and the host-side driver to virtualize the RDMA device as a pair A virtual RDMA device that serves each container or virtual machine separately.

In some embodiments of the present invention, the step of using the virtualization device operating software to manage the RDMA device interface and the host-side driver includes: on the host side, the virtualization device operating software sends a configuration instruction to the host-side driver, so that The host-side driver generates virtualization configurations for each RDMA device interface and sends them to the RDMA device.

In some embodiments of the present invention, the step of using the virtualization device operating software to manage the RDMA device interface and the host-side driver also includes: the virtualization device operating software manages the resources on the RDMA side by mapping the physical page where the RDMA device interface is located. , thus abstracting an RDMA device for each container or virtual machine.

In some embodiments of the present invention, the virtualization configuration also includes multiple types of scheduling configuration, virtual device configuration, software interface configuration, flow control configuration, MAC address configuration and routing configuration.

In some embodiments of the present invention, the container and the virtual machine include a virtual memory area for storing transceiver data and a queue pair for transceiver data, and each RDMA device interface in the RDMA device manages the queue using For sending and receiving data, direct access to remote virtual memory is realized based on virtual memory area, queue pair and completion queue.

In some embodiments of the present invention, in the step of each RDMA device interface managing the queue in the RDMA device based on the received virtualization configuration, the method further includes: each container or virtual machine passes an independent Configure the RDMA device interface and configure the queue to be exclusive or shared.

Another aspect of the present invention provides a system for implementing lightweight virtualization based on RDMA technology, including a processor and a memory. Computer instructions are stored in the memory. The processor is used to execute the computer instructions stored in the memory. When the computer instructions are When the processor is executed, the system implements the steps of the method described in any one of the above embodiments.

Another aspect of the present invention provides a computer-readable storage medium on which a computer program is stored. When the program is executed by a processor, the steps of the method described in any one of the above embodiments are implemented.

The method and system for realizing lightweight virtualization based on RDMA technology proposed by the present invention can use RDMA devices based on RDMA technology to assist in building a virtualized I/O processing environment and reduce the pressure on the host side. On the one hand, through the host side The operating system driver uniformly configures RDMA devices. On the other hand, independent access is achieved through the RDMA device interface allocated separately for each container or virtual machine, thereby simplifying the complexity of the system, saving memory space and configuration space, reducing costs, and The load pressure of the host-side CPU.

Additional advantages, objects, and features of the invention will be set forth in part in the description which follows, and in part will become apparent to those skilled in the art upon examination of the following, or may be learned by practice of the invention. The objectives and other advantages of the invention may be realized and attained by the structure particularly pointed out in the specification and drawings.

Those skilled in the art will understand that the objectives and advantages that can be achieved with the present invention are not limited to the specific description above, and the above and other objectives that can be achieved with the present invention will be more clearly understood from the following detailed description.

Description of drawings

The drawings described here are used to provide a further understanding of the present invention, constitute a part of this application, and do not constitute a limitation of the present invention. In the attached picture:

Figure 1 is a flow chart of a method for implementing lightweight virtualization based on RDMA technology in an embodiment of the present invention.

Figure 2 is a schematic structural diagram of a system for implementing lightweight virtualization based on RDMA technology in an embodiment of the present invention.

Figure 3 is a schematic structural diagram of a system for implementing virtualized I/O based on RDMA devices in an embodiment of the present invention.

Figure 4 is a diagram showing the RDMA network card virtualization configuration relationship in an embodiment of the present invention.

Detailed ways

In order to make the purpose, technical solutions and advantages of the present invention more clear, the present invention will be further described in detail below in conjunction with the embodiments and drawings. Here, the illustrative embodiments of the present invention and their descriptions are used to explain the present invention, but are not used to limit the present invention.

Here, it should also be noted that, in order to avoid obscuring the present invention with unnecessary details, only the structures and/or processing steps closely related to the solution according to the present invention are shown in the drawings, and the details related to them are omitted. Other details are less relevant to the invention.

It should be emphasized that the term "comprising" when used herein refers to the presence of features, elements, steps or components but does not exclude the presence or addition of one or more other features, elements, steps or components.

Here, it should also be noted that, unless otherwise specified, the term "connection" in this article may not only refer to a direct connection, but may also refer to an indirect connection with an intermediate.

Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. In the drawings, the same reference numerals represent the same or similar components, or the same or similar steps.

In order to provide a new virtualization technology solution based on the existing technology, so as to occupy as little as possible host-side CPU resources and memory resources, and flexibly perform IO virtualization. The present invention proposes a method for realizing lightweight virtualization based on RDMA technology. The present invention aims to provide a new solution, which occupies less CPU resources and memory resources, and provides a flexible IO virtualization solution. The present invention can reduce hardware complexity, reduce development and use costs, and has greater Good scalability and flexible configuration features can meet the flexible and changing needs of customers. Compared with the SR-IOV technical specifications, the lightweight virtualized IO implementation based on RDMA occupies less memory resources, simplifies the hardware implementation complexity, and eliminates the problems caused by using the same RDMA device at the same time when SR-IOV manages and configures VF. Impact: The present invention occupies less resources, simplifies design complexity, is flexibly configured, and is suitable for flexible and changeable user needs.

Among them, Remote Direct Memory Access (RDMA) technology was developed to solve the delay of server-side data processing in network transmission. RDMA technology transfers data directly into the computer's storage area through the network, quickly moving data from one system to the remote system memory without causing any impact on the operating system. It can save computer CPU computing resources and reduce power consumption. RDMA technology eliminates the CPU overhead of external memory copying and context switching, and can greatly improve application system performance. RDMA technology is a technology that bypasses the kernel of the remote host operating system to access data in its memory. RDMA technology can directly transfer data from the memory of one computer to another without the intervention of the operating systems of both parties, so it can achieve low-latency network communication. Virtual Machine (VMs for short) is a virtual environment designed to simulate a complete physical computer system in order to run different operating systems and applications. Containers (Containers) technology is a technology that packages applications and their dependencies together and runs in an isolated environment. Container technology is similar to virtual machine technology, but it uses the virtualization capabilities of the operating system to create containers instead of creating complete virtual machines. This makes containers more lightweight, more efficient, and easier to deploy and manage. The concept of containers began with UNIX chroot in 1979. It is a command line tool for system calls on a UNIX operating system. It is used to change the root directory of a process and its sub-processes to the file system. A new location so that these processes can only access this directory. The idea of this feature is to provide each process with independent disk space. Later in 1982, it was added to the BSD system (a branch of the UNIX operating system).

The Single Root I/O Virtualization (SR-IOV) standard used in the existing technology is an extended standard of the PCIe specification launched by the PCI-SIG organization, with the purpose of providing A standard specification that provides independent memory space, interrupts and DMA data streams for virtual machines. The SR-IOV standard defines a standard mechanism for PCIe device virtualization technology. It is a technical implementation of I/O virtualization and is used to divide a physical PCIe device into multiple virtual PCIe devices. Each virtual PCIe device It has PCIe configuration space and provides services to virtual machines just like physical PCIe devices. Multiple virtual PCIe devices can be transparently transmitted to one or more virtual machines to achieve the purpose of dividing physical PCIe devices and sharing PCIe devices in virtual machines. , device segmentation is implemented by hardware, with independent memory space, interrupts, and DMA data streams, so the virtual machine can obtain I/O performance comparable to the native machine's performance. The SR-IOV standard allows a single PCIe device to be virtualized into multiple PCIe devices. Each virtual PCIe device has its own PCIe configuration space and provides services to upper-layer software just like a physical PCIe device. Among them, PF (Physical Function) is the complete capability of the SR-IOV device, with independent PCI device ID, address space and interrupts. PF is responsible for managing the creation and deletion of VF (Visual Function), as well as the communication between VFs. communication. VF is part of PF and has the same functions as PF, but has limited resources. VF can be allocated to virtual machines or containers. Problems that still exist in the SR-IOV standard include: (1) VF devices virtualized through hardware based on the SR-IOV standard have independent configuration space and PCIe BAR space, which will occupy more memory space resources. With the linear growth Due to hardware resource requirements, the expansion of virtual VF devices is limited. (2) Based on the SR-IOV standard, the hardware virtual VF device is created and deleted. Its creation and deletion will affect other VF devices on the same physical card. The configuration strategy needs to be determined during the system deployment stage. The adjustment flexibility is not enough. In actual use, , user needs change at any time, and cannot meet users' flexible application scenarios.

Figure 1 is a flow chart of a method for implementing lightweight virtualization based on RDMA technology in an embodiment of the present invention. The method includes the following steps:

Step S110: The RDMA device based on RDMA technology establishes a connection with the host side.

In the specific implementation process, the RDMA device can use a DPU (Data Processing Unit) device that supports RDMA technology. The host side can be the server side. The RDMA device can be used to share the CPU processing pressure of the server side through virtualization technology. Generally, DPU devices that support RDMA technology can be connected to the host side through the PCIe interface.

Step S120: For each container or virtual machine created on the host side, allocate an RDMA device interface; wherein, the host side operating system creates multiple containers or virtual machines based on the virtualization function, and the RDMA device interface contains physical pages as units. MMIO register (Memory Mapped IO).

Among them, the RDMA device interface (dev interface) is located in the BAR space (Base Address Register) of the RDMA device. The base address register exists in the configuration space and is used to determine the size of the memory space required by different containers or virtual machines. And mapped to the function memory space to provide the base address. The base address register can be mapped to memory space or IO space.

Step S130: The RDMA device interface receives the virtualization configuration from the host-side driver; wherein the virtualization configuration includes queue priority configuration.

Step S140: Each RDMA device interface manages the queue in the RDMA device based on the received virtualization configuration.

In the specific implementation process, the queues managed by the RDMA device interface in the RDMA device include completion queues, and queue pairs in the virtual machine or container. The queue pair (Queue Pair, QP) consists of the send queue (Send Queue, SQ) and the receiving queue. It consists of a queue (Receive Queue, RQ). Based on queue pairs and completion queues, virtualized I/O based on RDMA technology can be implemented, thereby reducing the CPU load pressure on the host side.

Step S150: The container or virtual machine uses the MMIO register to map to the RDMA device, so that the container or virtual machine can access the RDMA device based on the RDMA device interface and implement virtualization based on RDMA technology.

By utilizing the method and system proposed by the present invention to realize lightweight virtualization based on RDMA technology, RDMA devices based on RDMA technology can be used to assist in building a virtualized I/O processing environment and reduce the pressure on the host side. On the one hand, through the host On the one hand, the operating system driver uniformly configures RDMA devices. On the other hand, independent access is achieved through the RDMA device interface allocated separately for each container or virtual machine, thus simplifying the complexity of the system, saving memory space and configuration space, and reducing costs. Reduce the load pressure on the host side CPU.

In some embodiments of the present invention, the type of RDMA device includes an RDMA network card and a DPU accelerator card that supports RDMA functions. RDMA devices refer to devices that support the RDMA protocol. The RDMA protocol is a high-performance network protocol that allows two systems to directly access each other's memory without the involvement of the CPU. RDMA devices include the following categories: (1) RDMA network card, a network interface card that supports the RDMA protocol, has an independent DMA controller and can directly access the memory. (2) RDMA storage device has a high-performance network interface and can communicate directly with the RDMA network card. (3) RDMA switch, which can connect RDMA devices to form an RDMA network. (4) DPU accelerator card that supports RDMA function. The above types of RDMA devices are only examples. In fact, any RDMA device that can be loaded on the host side that supports the RDMA protocol can apply this solution through certain pre-settings.

Adopting this embodiment of the invention expands the application scope of this solution. Compared with the existing SR-IOV standard, the RDMA device can reduce the pressure on the host-side CPU, and the computational complexity of this solution is also significantly lower than that based on SR-IOV. Standard virtualization solution.

In some embodiments of the present invention, the method further includes: using virtualization device operating software to manage the RDMA device interface and host-side driver in each container or virtual machine created on the host side, so as to virtualize the RDMA device to each container or virtual machine. Virtual RDMA devices that provide services to each container or virtual machine respectively. During the specific implementation process, the virtualization device operating software can be referred to as VDEV. VDEV is a software program installed in a virtual machine environment. It can configure the host-side driver based on VDEV, so that the host-side driver can configure the RDMA device. , and at the same time, based on VDEV, you can also access the RDMA device interface corresponding to each container or virtual machine, thereby accessing the RDMA device.

Using the embodiments of the invention, RDMA devices can be intuitively set up and accessed to the RDMA device interface in a container or virtual machine environment, and then I/O tasks in the container or virtual machine environment can be implemented through the RDMA device, such as when the host side is a server. Data packet forwarding and other tasks.

Further, in some embodiments of the present invention, the step of using the virtualization device operating software to manage the RDMA device interface and the host-side driver includes: on the host side, the virtualization device operating software sends a configuration instruction to the host-side driver, This enables the host-side driver to generate virtualization configurations for each RDMA device interface and send them to the RDMA device. Specifically, multiple virtualization device operating software VDEVs can communicate with each other to access and share the resources of the RDMA device. The sharing method can be achieved by setting the queue to be shared or exclusive.

In some embodiments of the present invention, the step of using the virtualization device operating software to manage the RDMA device interface and the host-side driver also includes: the virtualization device operating software manages the resources on the RDMA side by mapping the physical page where the RDMA device interface is located, This abstracts an RDMA device for each container or virtual machine.

In some embodiments of the present invention, the virtualization configuration also includes multiple types of scheduling configuration, virtual device configuration, software interface configuration, flow control configuration, MAC address configuration and routing configuration. Wherein, the virtual device configuration is set based on the RDMA standard, the flow control configuration, MAC address configuration and routing configuration are configured based on the network transmission situation on the host side (or server side), and the software interface configuration refers to RDMA device interface settings. The host-side driver can configure the RDMA device interface, traffic management and queue priority in the BAR space by configuring the RDMA device. The queue includes the completion queue (Completion Queue, CQ) in the RDMA device.

Using the embodiments of the invention, the RDMA device can be comprehensively configured, thereby realizing virtualized I/O based on the RDMA device, reducing the pressure on the server side, and reducing system complexity compared with the existing SR-IOV standard.

In some embodiments of the present invention, the container and the virtual machine include a virtual memory area for storing transceiver data and a queue pair for transceiver data, and each RDMA device interface in the RDMA device manages a completion queue for Send and receive data, and realize direct access to remote virtual memory based on virtual memory area, queue pair and completion queue.

The RDMA standard proposes a queue-based RDMA transmission method, and this solution will not be described in detail here.

In some embodiments of the present invention, in the step of each RDMA device interface managing the queue in the RDMA device based on the received virtualization configuration, the method further includes: each container or virtual machine configures RDMA device interface, configure the queue as exclusive or shared.

By adopting this embodiment of the invention, compared with the existing SR-IOV standard, the efficiency and flexibility of queue-based I/O processing can be improved.

Figure 2 is a schematic structural diagram of a system for implementing lightweight virtualization based on RDMA technology in an embodiment of the present invention. The system consists of a container (or virtual machine), a host and an RDMA device. The host-side driver implements operations such as configuration of RDMA devices, management configuration, traffic configuration and priority configuration of the RDMA device interface (RDMA dev interface). Containers (or virtual machines) can directly access RDMA devices through the RDMA device interface to achieve the same I/O performance as virtualization solutions based on the SR-IOV standard. The RDMA device interface is similar to the virtual function (VF) in the SR-IOV standard. The RDMA device interface contains MMIO registers in units of physical pages. When the container (or virtual machine) is mapped, it is mapped in the form of physical pages. In order to achieve memory isolation and ensure data security. Based on the host driver (Host driver), RDMA device interface configuration, traffic management configuration, queue priority management, etc. can be implemented. The RDMA device interface is a piece of physical memory, which also defines many functional registers, which will not be discussed in this plan.

The virtual monitor shown in Figure 2 is a software program that can virtualize a physical machine into multiple virtual machines, each running its own operating system and applications. The functions of VMM include creating, running and managing virtual machines. Creating a virtual machine includes allocating resources to the virtual machine, such as CPU, memory, storage and network. Running a virtual machine includes providing a running environment for the virtual machine and managing the virtual machine. Machines include starting, stopping, restarting and migrating virtual machines.

Figure 3 is a schematic structural diagram of a system that implements virtualized I/O based on RDMA devices in an embodiment of the present invention. The VDEV in Figure 3 is the operating software located in the container (or virtual machine) for managing resources and is the mapping RDMA Generated from the physical page where the device interface is located, VDEV can be equivalent to an RDMA device. It can be equivalent to an RDMA device by creating queue pairs/context/completion queue. The RDMA device interface is the manager that maintains the queuepairs/context/completion queue resources between hardware and software. The RDMA device interface can achieve shared configuration by managing the queues in the RDMA device. Among them, VDEV (Visual DEVICE) is the abbreviation of virtual device. It is a logical concept in virtualization software and is used to represent the storage device of a virtual machine. A VDEV can be composed of multiple physical storage devices, or one physical storage device can contain multiple VDEVs. Each VDEV is a logical storage device used to store virtual machines.

In addition, Figure 3 shows the management domain PD (Physical Disk, also known as physical disk). The PD number is physically unique and can be logically repeated. PD is the basis for virtual machine storage. The operating system and data of the virtual machine are both Stored on PD. Queue pairs (QP) are resources for I/O communication. Different numbers of queue pairs can be configured in each domain. The RDMA device interface can flexibly configure queue pair resources according to user needs. MR (Memory Region), translated in Chinese as RDMA memory area, refers to an area planned in the memory by the RDMA software layer to store transmitted and received data. In the IB (InfiniBand) protocol, after users apply for a memory area for storing data, they need to register MR by calling the API provided by the IB framework so that the RDMA network card can access this memory area. The host driver (Host driver) is opposite to the virtual machine driver. It can manage and configure the dev interface, traffic, and queue priority. At the same time, the virtual machine can access the host driver through VDEV and configure the RDMA device through the host driver to achieve System flexibility.

By introducing VDEV into a container or virtual machine, users can directly map device segmentation resources and independently operate and control device segmentation resources, which can effectively improve IO performance and data security. Among them, VDEV is a virtual device in the ZFS file system and consists of a set of physical disks. VDEV can be used to create RAID arrays, mirrors or simple logical volumes.

Figure 4 is an RDMA network card virtualization configuration relationship diagram in an embodiment of the present invention. Figure 4 illustrates the resources that the RDMA device can configure through the VDEV in Figure 3. The RDMA device can provide a set of high-performance networks between computers. Communication hardware resources. This hardware resource can be divided through configuration and provided to multiple containers (or virtual machines). The network card hardware design needs to provide resource configuration, MAC address configuration, routing configuration, and the network card can virtualize multiple different network cards. Resources, each network card resource configures the user's private MAC address and routing configuration. Traffic configuration, queue priority configuration, configure traffic and priority queues for different users. Virtual device configuration, software interface configuration, configure interfaces and resources for virtual machines and containers, and virtual machines have exclusive access to resources. Through scheduling configuration, the task scheduling process in the I/O process can be set to relieve the I/O pressure on the host side.

The method and system for realizing lightweight virtualization based on RDMA technology proposed by the present invention can use RDMA devices based on RDMA technology to assist in building a virtualized I/O processing environment and reduce the pressure on the host side. On the one hand, through the host side The operating system driver uniformly configures RDMA devices. On the other hand, independent access is achieved through the RDMA device interface allocated separately for each container or virtual machine, thereby simplifying the complexity of the system, saving memory space and configuration space, reducing costs, and The load pressure of the host-side CPU.

Compared with the problems existing in the SR-IOV standard that require independent configuration space, memory mapped I/O space (MMIO), and each virtual device has an independent interrupt vector configuration, the present invention can reduce the need for memory space and configuration. Space requirements, unified configuration of RDMA devices through the host-side operating system driver can reduce the complexity of the system, save the occupation of memory space and configuration space, reduce costs, and reduce the load pressure on the host-side CPU

Specifically, DPU devices that support RDMA can be connected to the host side (server) through the PCIe interface. The combination of DPU and RDMA can exert a synergistic effect and improve the overall performance of the data center. For example, the DPU can be used to accelerate RDMA transmission and reduce the load on the host-side CPU, and RDMA can reduce the load on the DPU.

The virtualization implementation method proposed by the present invention can flexibly configure the host-side driver through VDEV, thereby configuring the entire RDMA device through the host-side driver. During the process of configuring the RDMA device, the RDMA device interfaces for different containers or virtual machines can be adjusted respectively. Users using the same RDMA device do not affect each other, so that in actual use, the configuration of the RDMA device interface can be flexibly adjusted as user needs change to meet the user's changing application scenarios (memory isolation can be achieved through mapping in the form of physical pages).

Corresponding to the above method, the present invention also provides a system for realizing lightweight virtualization based on RDMA technology. The system includes a computer device, the computer device includes a processor and a memory, and computer instructions are stored in the memory. The processor is configured to execute computer instructions stored in the memory. When the computer instructions are executed by the processor, the system implements the steps of the foregoing method.

Embodiments of the present invention also provide a computer-readable storage medium on which a computer program is stored. When the computer program is executed by a processor, the steps of the method as described above are implemented. The computer readable storage medium may be a tangible storage medium such as random access memory (RAM), memory, read only memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, register, floppy disk, hard disk, removable storage disk, CD-ROM, or any other form of storage medium known in the art.

Those of ordinary skill in the art should understand that each exemplary component, system and method described in conjunction with the embodiments disclosed herein can be implemented in hardware, software or a combination of both. Whether it is implemented in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each specific application, but such implementations should not be considered to be beyond the scope of the present invention. When implemented in hardware, it may be, for example, an electronic circuit, an application specific integrated circuit (ASIC), appropriate firmware, a plug-in, a function card, or the like. When implemented in software, elements of the invention are programs or code segments used to perform the required tasks. The program or code segments may be stored in a machine-readable medium or transmitted over a transmission medium or communications link via a data signal carried in a carrier wave.

It is to be understood that this invention is not limited to the specific arrangements and processes described above and illustrated in the drawings. For the sake of brevity, detailed descriptions of known methods are omitted here. In the above embodiments, several specific steps are described and shown as examples. However, the method process of the present invention is not limited to the specific steps described and shown. Those skilled in the art can make various changes, modifications and additions, or change the order between steps after understanding the spirit of the present invention.

In the present invention, features described and/or illustrated with respect to one embodiment may be used in the same or in a similar manner in one or more other embodiments and/or may be combined with or substituted for features of other embodiments. Features of Embodiments.

The above descriptions are only preferred embodiments of the present invention and are not intended to limit the present invention. For those skilled in the art, various modifications and changes may be made to the embodiments of the present invention. Any modifications, equivalent substitutions, improvements, etc. made within the spirit and principles of the present invention shall be included in the protection scope of the present invention.

Claims (10)

1. A method for implementing lightweight virtualization based on RDMA technology, the method comprising the steps of:

establishing connection between an RDMA device and a host based on RDMA technology;

for each container or virtual machine created at the host side, assigning an RDMA device interface; the host side operating system creates a plurality of containers or virtual machines based on the virtualization function, and the RDMA equipment interface comprises MMIO registers taking physical pages as units;

the RDMA device interface receives a virtualization configuration from a host side driver; wherein the virtualization configuration comprises a queue priority configuration;

each RDMA device interface managing queues in RDMA devices based on the received virtualization configuration;

the container or virtual machine maps to the RDMA device using the MMIO register to enable the container or virtual machine to access the RDMA device based on the RDMA device interface to implement virtualization based on RDMA technology.

2. The method of claim 1, wherein the types of RDMA devices include an RDMA network card and an RDMA-capable DPU acceleration card.

3. The method according to claim 1, characterized in that the method further comprises:

in each container or virtual machine created at the host side, the RDMA device interface and host side driver are managed using virtualization device operating software to virtualize the RDMA device as a virtual RDMA device that services each container or virtual machine separately.

4. The method of claim 3, wherein managing RDMA device interfaces and host side drivers using virtualization device operating software comprises:

on the host side, the virtualization device operating software sends configuration instructions to the host side driver, causing the host side driver to generate and send virtualization configurations for the respective RDMA device interfaces to the RDMA devices.

5. The method of claim 3, wherein managing RDMA device interfaces and host side drivers using virtualization device operating software further comprises:

the virtualization device operating software manages the RDMA side resources by mapping the physical pages where the RDMA device interfaces are located, thereby abstracting one RDMA device for each container or virtual machine.

6. The method of any of claims 1-5, wherein the virtualization configuration further comprises a plurality of scheduling configurations, virtual device configurations, software interface configurations, flow control configurations, MAC address configurations, and routing configurations.

7. The method of claim 1, wherein a virtual memory region for storing transceiving data and a queue pair for transceiving data are contained in the container and virtual machine, wherein each RDMA device interface in the RDMA device manages a completion queue for transceiving data, and wherein direct access to the remote virtual memory is achieved based on the virtual memory region, the queue pair, and the completion queue.

8. The method of claim 1, wherein in the step of each RDMA device interface managing queues in an RDMA device based on the received virtualization configuration, the method further comprises:

each container or virtual machine configures the queue to be exclusive or shared through an independently configured RDMA device interface.

9. A system for implementing lightweight virtualization based on RDMA technology, comprising a processor and a memory, wherein the memory has stored therein computer instructions for executing the computer instructions stored in the memory, which system implements the steps of the method according to any of claims 1 to 8 when the computer instructions are executed by the processor.

10. A computer readable storage medium, on which a computer program is stored, characterized in that the program, when being executed by a processor, implements the steps of the method according to any one of claims 1 to 8.