WO2016015443A1 - Method, physical host and system for live migration of virtual machine - Google Patents

Abstract

Embodiments of the present invention provide a method, a physical host and a system for live migration of a virtual machine, relating to the field of communications, for solving the problem existing in the prior art that live migration of a virtual machine can not be implemented in the mode of HBA/HCA directly accessing virtual machine. The method particularly comprises: interacting with a transaction sender to make the transaction sender pause sending transactional data; copying the data in a host adapter to an emulated host adapter; removing the binding between the virtual machine and the host adapter and binding the virtual machine to the emulated host adapter; and migrating the data corresponding to the virtual machine and the data corresponding to the emulated host adapter to a second physical host. The present invention is used for live migration of a virtual machine.

Description

Method, physical host and system for virtual machine hot migration

This application claims the priority of the Chinese patent application filed on July 31, 2014, the Chinese Patent Office, the application number is 201410373167.2, and the invention name is "a virtual machine thermal migration method, physical host and system". The citations are incorporated herein by reference.

Technical field

The present invention relates to the field of communications, and in particular, to a method, a physical host, and a system for virtual machine hot migration.

Background technique

Computer virtualization technology is the current hot spot, and the virtual migration technology of virtual machine is a hot spot in virtualization technology. It can be said that the hot migration technology of virtual machine has become a test indicator to measure the advantages and disadvantages of computer virtualization technology. The so-called virtual machine hot migration refers to the migration of the running virtual machine from the source physical host to the destination physical host while ensuring the normal operation of the service on the virtual machine.

A typical virtual machine application architecture that is commonly used today is a physical host that has a virtual machine manager (VMM) that manages virtual machine functions. Specifically, one or more virtual machines are managed by the VMM. The operating system OS and various applications can be run on a virtual machine. The hardware of a general physical host mainly includes: a part of hardware (such as CPU, memory, hard disk, etc.) that is strongly related to running a virtual machine, and a part of which is not directly used to run a virtual machine, but is used to perform some specific services, and the functions are relatively independent. Hardware (for example, Ethernet network card and host adapter). The host adapter usually includes a single physical input SR-IOV (Single Root I/O Virtualization HBA/HCA standard implementation of a physical function PF and one or more virtual functions (VF), one of which The virtual function can be directly connected to a virtual machine corresponding to it.

When the host adapter in the virtual machine application architecture is a Host Bus Adaptor (HBA)/Host Channel Adaptor (HCA), for the virtual machine running in the above architecture, In the HBA/HCA pass-through virtual machine mode, the virtual machine hot migration of the Small Computer System Interface (SCSI) service is not supported, that is, since the session control of the protocol stack is implemented by the HBA/HCA hardware, The session of the protocol stack cannot be migrated with the virtual machine. At the same time, SCSI has a very low tolerance for packet loss. Therefore, the continuous loss of the session context of the protocol stack saved on the HBA/HCA causes the interruption of the upper layer service and the virtual machine. The hot migration is unsuccessful, so virtual machine hot migration is not possible in the HBA/HCA pass-through virtual machine mode.

In response to the above problem, the prior art allocates an emulated Ethernet network card device (Ethernet Network Interface Card) capable of running the virtual machine to the virtual machine running on the HBA/HCA of the source physical host through the multi-path technology, that is, through the hypervisor. (Eth NIC for short), when the virtual machine is hot migration, the source physical host can disconnect the HBA/HCA from the virtual machine, bind the virtual machine to the created emulation Eth NIC, and then pass The simulation path between the virtual machine and the simulated Eth NIC migrates the stored service data in the virtual machine to the destination physical host.

However, the inventor found that in the above-mentioned virtual machine migration process, since the source physical host is still unable to migrate the session connection context of the protocol stack saved on the HBA/HCA, the storage is lost in the HBA/HCA when the virtual machine is migrated. The session context in the network, which in turn causes the virtual machine to fail to complete the hot migration.

Summary of the invention

The embodiments of the present invention provide a method, a physical host, and a system for virtual machine hot migration, which are used to solve the problem that the hot migration of the virtual machine cannot be implemented in the HBA/HCA through virtual machine mode in the prior art.

In order to achieve the above object, embodiments of the present invention adopt the following technical solutions:

In a first aspect, an embodiment of the present invention provides a virtual machine hot migration method, where the first physical host includes a host and a host adapter connected to the host, where the host adapter is a match. A single input and output virtualized SR-IOV standard hardware device, including one or more physical functions PF and one or more virtual functions VF; the host runs a virtual machine and a virtual machine manager VMM, in the virtual machine Running with a guest operating system, the guest operating system passes the match The pass-through technology of the SR-IOV standard directly accesses the VF;

The VMM also includes an emulated host adapter implemented in software, the method comprising:

Interacting with the service sender, causing the service sender to suspend the transmission of the service data;

Copying data from the host adapter into the emulated host adapter;

Unbinding the virtual machine and the host adapter, and binding the virtual machine to the emulation host adapter;

The data corresponding to the virtual machine and the data corresponding to the emulated host adapter are migrated to the second physical host.

In a first possible implementation manner of the first aspect, the data corresponding to the virtual machine includes data corresponding to the device simulated by the virtual machine and running data information; the data corresponding to the simulated host adapter includes the Simulate the data of the host adapter itself and the data run by the emulation adapter.

With reference to the first aspect, or the first possible implementation manner of the first aspect, in a second possible implementation, the host adapter includes an Internet Small Computer System Interface (ISCSI) HBA, and the interaction with the service sender enables The service sender suspends the transmission of service data including:

Transmitting, by the service sender, the transmission control protocol TCP packet information with the window field being 0, so that the service sender pauses the transmission of the service data; wherein the TCP packet information of the window domain is 0 is used to indicate the service transmission. The party implements the suspension of the transmission of the service data within a preset time period.

With reference to the first aspect, or the first possible implementation manner of the first aspect, in a third possible implementation, the host adapter includes a Fibre Channel FC/Ethernet Fibre Channel FCoE HBA or an infinite bandwidth IB/RoCE HCA, The interaction with the service sender, so that the service sender pauses the transmission of the service data, specifically includes:

The sender of the service stops sending the credit response frame, so that the service sender pauses the transmission of the service data.

With reference to the first aspect, or any one of the first to the third possible implementation manners of the first aspect, in a fourth possible implementation, the method further includes:

Obtaining data corresponding to the emulated host adapter of the second physical host and data corresponding to the virtual machine;

Copying data corresponding to the emulated host adapter of the second physical host to the host adapter of the first physical host, and generating a corresponding new virtual machine according to the acquired data corresponding to the virtual machine, The new virtual machine is bound to the emulated host adapter of the second physical host.

In a second aspect, an embodiment of the present invention provides a first physical host, where the first physical host includes a host and a host adapter connected to the host, and the host adapter is a single input and output virtualized SR- A hardware device of the IOV standard, comprising one or more physical functions PF and one or more virtual functions VF; the host running a virtual machine and a virtual machine manager VMM, wherein the virtual machine runs a guest operating system, The guest operating system directly accesses the VF through a pass-through technology conforming to the SR-IOV standard;

The VMM further includes an emulated host adapter implemented in software; the host includes:

An interaction module, configured to interact with a service sender, so that the service sender pauses the transmission of the service data;

a copy module, configured to copy data in the host adapter into the emulated host adapter;

a binding module, configured to release a binding between the virtual machine and the host adapter, and bind the virtual machine to the emulation host adapter;

And a migration module, configured to migrate data corresponding to the virtual machine and data corresponding to the emulated host adapter to the second physical host.

In a first possible implementation manner of the second aspect, the data corresponding to the virtual machine includes data corresponding to the device simulated by the virtual machine and running data information; and the data corresponding to the simulated host adapter includes the Simulate the data of the host adapter itself and the data run by the emulation adapter.

With reference to the second aspect, or the first possible implementation manner of the second aspect, in a second possible implementation manner, the host adapter includes an Internet small computer system The interface ISCSI HBA, the interaction module is specifically configured to: continuously send, to the service sender, a transmission control protocol TCP packet information with a window domain of 0, so that the service sender pauses the transmission of the service data; wherein the window domain is 0. The TCP packet information is used to instruct the service sender to implement the transmission suspension of the service data within a preset time period.

With reference to the second aspect, or the first possible implementation manner of the second aspect, in a third possible implementation, the host adapter includes a Fibre Channel FC/Ethernet Fibre Channel FCoE HBA or an infinite bandwidth IB/RoCE HCA, The interaction module is specifically configured to stop sending a credit response frame to the service sender, so that the service sender pauses the transmission of the service data.

With reference to the second aspect, or any one of the first to the third possible implementation manners of the second aspect, in the fourth possible implementation, the first physical host further includes:

An acquiring module, configured to acquire data corresponding to the emulated host adapter of the second physical host and data corresponding to the virtual machine;

The copying module is further configured to copy data corresponding to the emulated host adapter of the second physical host to a host adapter of the first physical host;

The binding unit is further configured to generate a corresponding new virtual machine according to the acquired data corresponding to the virtual machine, and bind the new virtual machine to an emulation host adapter of the second physical host.

In a third aspect, a first physical host is provided, where the first physical host includes a memory, a processor, a host adapter inserted in the first physical host card slot, and an Ethernet network card, where:

The host adapter is configured to interact with a service sender, so that the service sender pauses the transmission of the service data.

The processor is configured to copy data in the host adapter into the emulation host adapter; unbind the virtual machine from the host adapter, and connect the virtual machine to the emulation host The adapter performs binding; the data corresponding to the virtual machine and the data corresponding to the emulated host adapter are migrated to the second physical host.

In a first possible implementation manner of the third aspect, the host adapter includes a host bus adapter HBA or a host channel adapter HCA; the data corresponding to the virtual machine includes data corresponding to the device simulated by the virtual machine and running data information; and the data corresponding to the simulated host adapter includes the emulation host adapter itself Data and data run by the emulation adapter.

According to a first possible implementation manner of the third aspect, in a second possible implementation manner of the third aspect, when the host adapter includes an Internet small computer system interface ISCSI HBA, the host adapter is specifically used to Transmitting, by the service sender, the transmission control protocol TCP packet information with the window field being 0, so that the service sender pauses the transmission of the service data; wherein the TCP packet information of the window domain is 0 is used to indicate the service transmission. The party implements the suspension of the transmission of the service data within a preset time period.

According to a first possible implementation of the first aspect, in a third possible implementation of the first aspect, when the host adapter comprises a Fibre Channel FC/Ethernet Fibre Channel FCoE HBA or an infinite bandwidth IB/RoCE HCA Time,

The host adapter is specifically configured to stop sending a credit response frame to the service sender, so that the service sender pauses the transmission of the service data.

With reference to the first aspect, or any one of the first to third possible implementation manners of the first aspect, in a fourth possible implementation manner of the first aspect, when the first physical host receives And the processor is further configured to: acquire the emulation host adapter of the second physical host, when the data corresponding to the emulated host adapter of the second physical host and the data corresponding to the virtual machine are sent by the second physical host Corresponding data and data corresponding to the virtual machine; copying data corresponding to the emulated host adapter of the second physical host to the host adapter of the first physical host, and generating corresponding new data according to the data corresponding to the virtual machine The virtual machine binds the new virtual machine to the emulated host adapter of the second physical host.

The method, device and system for virtual machine hot migration provided by the embodiment of the present invention, because the data in the host adapter is copied to the emulation host adapter, and the data corresponding to the virtual machine and the emulated host adapter are subsequently copied to the destination physical host. Therefore, there is no data loss in the process, so that the existing business can be uninterrupted. Implement hot migration of virtual machines in the HBA/HCA pass-through virtual machine mode.

DRAWINGS

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings used in the embodiments or the description of the prior art will be briefly described below. Obviously, the drawings in the following description are only It is a certain embodiment of the present invention, and other drawings can be obtained from those skilled in the art without any creative work.

1 is a schematic diagram of an application architecture of a virtual machine according to an embodiment of the present invention;

FIG. 2 is a schematic flowchart diagram of a method for virtual machine hot migration according to an embodiment of the present invention;

3 is a schematic flowchart of another method for hot migration of a virtual machine according to an embodiment of the present invention;

FIG. 4 is a schematic flowchart diagram of still another method for virtual machine hot migration according to an embodiment of the present invention; FIG.

FIG. 5 is a schematic structural diagram of a first physical host according to an embodiment of the present invention;

FIG. 6 is a schematic structural diagram of another first physical host according to an embodiment of the present invention;

FIG. 7 is a schematic structural diagram of a virtual machine hot migration system according to an embodiment of the present invention.

detailed description

The technical solutions in the embodiments of the present invention are clearly and completely described in the following with reference to the accompanying drawings in the embodiments of the present invention. It is obvious that the described embodiments are only a part of the embodiments of the present invention, but not all embodiments. All other embodiments obtained by those skilled in the art based on the embodiments of the present invention without creative efforts are within the scope of the present invention.

The virtual machine application architecture applied in the embodiment of the present invention may be as shown in FIG. 1 . The virtual machine application architecture, that is, the VMM 11 having the function of managing virtual machines is installed on a physical host 1 in advance (in some other virtual machine application scenarios). Medium, with a similar function The meta is also known as the hypervisor, and then the VMM manages one or more virtual machines (such as virtual machines 1-n in Figure 1), each of which can run the operating system OS and various applications. In this embodiment, the physical host 1 includes a part of hardware (for example, the Ethernet network card 12 and the host adapter 13) that is not directly used to run the virtual machine but performs some specific services and is relatively independent in function; For these relatively independent hardware, the hardware implementation can be based on the same hardware system (such as using the same PCB, the same processor to implement the network card 12 and the host adapter 13), or can also be based on different hardware systems (such as network cards) A single PCB and a separate processor are used, and the host adapter 13 uses another PCB separately and another separate processor).

The application architecture of the above-mentioned virtual machine and the specific implementation method of the virtual machine performing the through-operation of the virtual function in the host adapter based on the SR-IOV are all the prior art, which is not specifically described in the embodiment of the present invention.

When the host adapter in the virtual machine application architecture is an HBA/HCA, the virtual machine running in the above architecture may lose the session connection context saved in the HBA/HCA during the hot migration. The interruption of the upper layer service is that the session of the protocol stack (that is, the sum of the protocols in the network) is saved in the HBA/HCA, and the virtual machine guest operating system corresponding to the virtual machine cannot obtain the above session. The HBA/HCA configured on the source physical host and the destination physical host must be identical. The hardware parameters and slots of the HBA/HCA configured on the source physical host and the destination physical host must be the same. For example, when the HBA/HCA in the physical host adopts a single input and output virtualized HBA/HCA SR-IOV mode, the serial numbers of the VFs of the source physical host and the destination physical host must be the same, for example, when the VF 5 is on the source physical host. When the virtual machine is used, VF 5 on the destination physical host must be in the idle state at the same time, so that VF 5 can be called when the virtual machine migrates from the source physical host to the destination physical host. In addition, when the virtual network application architecture includes a common network card, the ordinary network card only performs the task of sending and receiving network packets in the physical host, and the session context is maintained by the virtual machine guest operating system, and can be migrated with the virtual machine. However, because the HBA/HCA uninstalls the protocol stack, the session context cannot be migrated with the virtual machine, causing the interruption of the upper layer service. Therefore, the HBA/HCA is directly virtual In the mode of the machine, the virtual machine hot migration of the Small Computer System Interface (SCSI) service is not supported.

To solve the above problem, an embodiment of the present invention provides a new method, device, and system for virtual machine hot migration.

Embodiment 1

Referring to FIG. 2, a first embodiment of the present invention provides a virtual machine hot migration method for migrating services in a virtual machine in a first physical host to a virtual machine of a second physical host. In the embodiment of the present invention, an emulation host adapter is implemented in software in the VMM to simulate a real hardware host adapter. The emulation host adapter may be pre-configured in the VMM or may be created by the VMM of the first physical host according to the hardware parameters of the host adapter in the first physical host, that is, the first physical host will be configured. Generating an emulated host adapter having the same descriptor information as the descriptor format and the control register stored in the host adapter according to the hardware parameters of the internal host adapter, the emulated host adapter using the same driver as the host adapter, and the After the emulation host adapter is loaded, it can provide the normal operating environment for the virtual machine just like the host adapter. The specific creation process is a technology well known to those skilled in the art, and is not described in detail herein.

In the embodiment of the present invention, the emulation host adapter can be regarded as a software module added by the VMM to the prior art. For convenience of description, the embodiment of the present invention does not strictly describe each module except the emulation host adapter in the VMM. Unless otherwise specified, when it comes to the interaction between other modules and the emulated host adapter, VMM is used in place to replace other modules. For example, "the operation of the emulation host adapter by the VMM" can be understood as "the operation of the emulation host adapter by one or more other modules in the VMM", and those skilled in the art can understand that there will be a software module correspondingly. To perform an A operation on the emulated host adapter.

Based on the foregoing application scenario, the method for providing a virtual machine hot migration according to the embodiment of the present invention includes the following steps:

101. Interact with the service sender, so that the service sender pauses the transmission of the service data.

The service sender here may be a second physical host that is connected to the first physical host through the network for service communication, for example, another server connected through Ethernet, or a terminal device. Here, the service data transmission is suspended mainly by the service sender, so that no subsequent service data is lost due to the migration of the virtual machine.

Specifically, when the first physical host interacts with the service sender, different interaction methods may be used according to different protocols. For example, when the communication is performed based on the transmission control protocol TCP, the virtual machine of the first physical host may be used. The VM responds to the peer by continuously sending a TCP acknowledgement message whose window field is 0 through the host adapter, so that the peer end suspends the transmission of the service data;

Alternatively, when the InfiniBand protocol is used, the VM in the first physical host may stop sending the credit response frame, and may also cause the peer to suspend data transmission;

Alternatively, when other protocols are used, similar methods may be used based on other protocols to cause the peer to suspend sending data.

102. Copy the data in the host adapter to the emulated host adapter.

Specifically, the replication can be completed by the VMM in the first physical host. For example, the VMM can read the data in the host adapter through the interface provided by the host adapter, and then copy the read data to the emulated host adapter.

The data in the host adapter includes the receiving/transmitting queue of the host adapter and various hardware state information (such as session connection context information of the protocol stack).

103. Unbind the virtual machine from the host adapter and bind the virtual machine to the emulated host adapter.

Specifically, the VMM completes the unbinding and rebinding. Wherein, "binding" is a term well known to those skilled in the art, and can be understood as associating one device with another device; otherwise, "unbinding" is to cancel the association between the two. In the embodiment of the present invention, the original virtual machine is "bound" with the host adapter, and the service from the virtual machine is sent to other devices through the host adapter that is "bound" with it. Through the unbinding of this step and binding with the emulated host adapter, the virtual machine is unassociated from the host adapter and associated with the emulated host adapter, so that subsequent services from the virtual machine no longer communicate with the host adapter. And communicate with the emulated host adapter Letter so that no data is lost.

After unbinding and rebinding, the first physical host removes the VF in the host adapter assigned to the virtual machine, and allocates the same VF in the emulated host adapter to the virtual machine. At this time, the virtual machine's IO (input) The /output) channel is the emulation channel between the emulated host adapter and the virtual machine.

It should be noted that, because it is completed by the VMM, it is possible to make the virtual machine not perceive the change, that is, the host adapter "seeing" in the virtual machine does not change with respect to the virtual machine, and the virtual The operation of the machine to the host adapter does not change.

104. The data corresponding to the virtual machine and the data corresponding to the emulation host adapter are migrated to the second physical host.

Specifically, the VMM completes the migration of data corresponding to the virtual machine and the self-defense host adapter. The data corresponding to the virtual machine includes data corresponding to the virtual machine simulated device (such as simulated CPU, memory, hard disk, various peripherals, etc.) and running data information;

Similarly, the data corresponding to the emulated host adapter includes the emulation host adapter data of the device itself and the data that the emulation adapter runs (such as data copied from the host adapter).

The migration of the two parts of data is the migration of software-level data. The migration method is a technology well known to those skilled in the art. The specific process may include: first migrating a part of data to a second physical host, and then comparing the first physical host. The difference between the data and the data in the second physical host, thereby updating the data in the second physical host; continuously iterating through the above method, and finally, when the difference is as small as a predetermined value, stopping the virtual machine, and migrating the data that needs to be updated last. Go to the second physical host. During this migration process, the virtual machine needs to be stopped for a very short time, and the user is basically not aware of it, so that "hot migration" can be achieved.

After the migration is completed, the second physical host may restart the virtual machine and emulate the host adapter according to the migrated data, and notify the service sender to resend the service data to the second physical host, so that the second physical host may follow New business deal with.

In this embodiment, when the second physical host receives the data corresponding to the emulated host adapter sent by the first physical host, if the second physical host includes the host adapter (based on hardware), the second physical host receives The data corresponding to the emulated host adapter of the first physical host is completely copied to the host adapter of the first physical host, and the corresponding virtual machine is bound to perform the service; if the second physical host does not include the host adapter, Then, the VMM of the second physical host runs the emulated host adapter through software according to the received data, and performs with the virtual machine.

Similarly, the first physical host can also serve as the destination host, and the second physical host serves as the source host. In this case, the embodiment of the present invention further includes the following steps:

105. Acquire data corresponding to the emulation host adapter of the second physical host and data corresponding to the virtual machine, and copy data corresponding to the emulated host adapter of the second physical host to the host adapter of the first physical host, and according to the received virtual The corresponding data of the machine generates a corresponding new virtual machine, and the newly generated virtual machine is bound to the emulation host adapter.

Exemplarily, if the first physical host includes a host adapter, the virtual machine manager of the first physical host starts a replication function of the host adapter of the first physical host, thereby emulating the host adapter of the second physical host The corresponding data is completely copied to the host adapter of the first physical host. However, if the host adapter is not included in the first physical host, the VMM of the first physical host directly runs the emulated host adapter of the second physical host.

It should be noted that the host adapter or the emulated host adapter in the first physical host needs to perform a copy operation, that is, when the information is migrated, it needs to interact with the service sender. For example, when the emulation host adapter needs to send data in the host adapter stored in the emulated host adapter to the second physical host, the emulated host adapter running in the VMM of the first physical host needs to be performed by the VMM and the service sender. Interaction.

In the virtual machine hot migration method provided by the embodiment of the present invention, since the data in the host adapter is copied to the emulation host adapter, and the virtual machine and the emulation are subsequently The data corresponding to the real host adapter is copied to the destination physical host. Therefore, no data is lost in the process, so that the virtual machine can be hot in the HBA/HCA pass-through virtual machine mode without interruption of the existing service. migrate.

Embodiment 2

The second embodiment of the present invention provides another method for hot migration of a virtual machine. In this embodiment, based on steps 101 to 105 provided in the first embodiment, when the host adapter is an Internet small computer system interface ISCSI HBA, the steps are as follows. 101 is replaced with step 101a, or, when the host adapter is a Fibre Channel FC/Ethernet Fibre Channel FCoE HBA or an infinite bandwidth IB/RoCE HCA, step 101 is replaced with step 101b.

As shown in FIG. 3, when step 101 is replaced with step 101a, the method includes the following steps:

101a. Continuously send a transmission control protocol TCP packet information with a window domain of 0 to the service sender.

Specifically, the virtual machine of the first physical host can continuously send a TCP acknowledgement message with a window field of 0 through the host adapter to respond to the peer end by continuously sending a TCP acknowledgement message whose window field is 0, so that the peer end Suspend the transmission of business data. The TCP message information of the window domain of 0 is communicated according to the transmission control protocol TCP, and is used to indicate that the service sender implements the transmission suspension of the service data within a preset time period. Exemplarily, after receiving the TCP packet information of the window domain 0, the service sender knows that the window domain in the first physical host is 0 (that is, there is no buffer in the first physical host), The TCP message should be sent and a pause of about 2 seconds is generated.

As shown in FIG. 4, when step 101 is replaced with step 101b, the method includes the following steps:

101b. Stop sending a credit response frame to the service sender.

Specifically, the first physical host is based on the InfiniBand protocol, so that the virtual machine in the first physical host stops sending the credit response frame, so that the service sender does not receive the indication of the credit response frame, and the service sender pauses the data. send.

Exemplarily, the embodiment corresponding to FIG. 3 is applied to a specific virtual machine. Use the architecture to specify.

Specifically, referring to the virtual machine application architecture diagram shown in FIG. 1, the VMM in the source physical host allocates a hardware VMM to the virtual machine to allocate a VF of the hardware HBA to the virtual machine, and the virtual machine recognizes the hardware HBA VF. The VF driver (ie, the emulated HBA driver) is loaded, so that the hardware HBA VF becomes an input/output channel of the virtual machine SCSI Small Computer System Interface (SCSI) operation. Specifically, in the foregoing network environment, the specific steps of performing hot migration from the source physical host to the destination physical host are as follows: First, the source physical host is based on the host in the first physical host through the VMM in the host. The hardware parameters of the adapter are created, and an emulated HBA with the same hardware parameters as the hardware HBA of the source physical host is created on the source physical host. The VMM virtual machine manager in the source physical host continuously sends the transmission control protocol TCP packet information of the window domain 0 to the service sender of the virtual machine through the hardware HBA, so that the service sender knows the first physical host. After the window field is 0 (that is, there is no buffer in the first physical host), the TCP message information is responded, thereby generating a transmission pause of about 2 seconds, so that the VMM will be the data in the hardware HBA on the source physical host. Completely copied to the emulated HBA. After the VMM in the source physical host completely copies the data in the hardware HBA to the emulation HBA, the hardware HBA VF allocated to the virtual machine is removed, and the emulation HBA is allocated to the virtual machine so that the input/output of the virtual machine can be Take the simulation channel corresponding to the simulated HBA, so that the virtual machine can run normally on the simulated HBA. Then, the corresponding data of the emulated HBA stored on the source physical host emulates the host adapter data of the device itself and the data of the emulation adapter running (such as data copied from the host adapter) and the device simulated by the virtual machine (eg, The corresponding data and the running data information of the simulated CPU, memory, hard disk, various peripherals, etc. are copied to the destination physical host. Finally, the VMM in the destination physical host reassigns the migrated virtual machine to the same hardware HBA VF as the source physical host, and removes the simulated HBA so that the virtual machine's input/output goes to the hardware channel of the destination physical host. In addition, when there is a hardware HBA VF available in the destination physical host, the VMM in the destination physical host continuously sends the simulated HBA of the destination physical host to the service sender (for example, the source physical host). The transmission control protocol TCP packet information of the window field is 0, so that the peer end stops transmitting data, and then the corresponding data of the emulation HBA is completely copied to the VF of the hardware HBA of the destination physical host. Of course, if the destination physical host When there is no hardware HBA VF available, the target physical host will run the simulated HBA directly through the VMM.

In the virtual machine hot migration method provided by the embodiment of the present invention, since the data in the host adapter is copied to the emulation host adapter, and the data corresponding to the virtual machine and the emulation host adapter is subsequently copied to the destination physical host, In the process, there is no data loss, so that the hot migration of the virtual machine can be realized in the HBA/HCA through virtual machine mode without interruption of the existing service.

Embodiment 3

A third embodiment of the present invention provides a first physical host, where the first physical host includes a host and a host adapter connected to the host, and the host adapter is a hardware device conforming to a single input and output virtualized SR-IOV standard. Include one or more physical functions PF and one or more virtual functions VF; the host runs a virtual machine and a virtual machine manager VMM running a guest operating system, the guest operating system conforms to the SR-IOV standard The direct pass technology directly accesses the VF; at the same time, the above VMM also includes an emulated host adapter implemented in software. As shown in FIG. 5, the host 3 further includes: an interaction module 31, a replication module 32, a binding module 33, and a migration module 34, where:

The interaction module 31 is configured to interact with the service sender, so that the service sender pauses the transmission of the service data.

The copy module 32 is configured to copy data in the host adapter into the emulated host adapter.

The binding module 33 is configured to release the binding between the virtual machine and the host adapter, and bind the virtual machine to the emulated host adapter.

The migration module 34 is configured to migrate data corresponding to the virtual machine and data corresponding to the emulated host adapter to the second physical host.

The host adapter includes a host bus adapter HBA and a host channel adapter HCA; and the data corresponding to the virtual machine includes a virtual machine simulated device. The corresponding data and the running data information; the data corresponding to the emulated host adapter includes the data of the emulated host adapter itself and the data of the emulation adapter running.

Optionally, when the host adapter includes the Internet small computer system interface ISCSI HBA, the interaction module 31 is specifically configured to: continuously send the transmission control protocol TCP packet information with the window domain 0 to the service sender, so that the service sender is suspended. The sending of the service data, wherein the TCP message information of the window field is 0 is used to indicate that the service sender performs the transmission suspension of the service data within a preset time period.

Optionally, when the foregoing host adapter includes a Fibre Channel FC/Ethernet Fibre Channel FCoE HBA or an infinite bandwidth IB/RoCE HCA, the interaction module 31 is specifically configured to: stop transmitting a credit response frame to the service sender, so that the service sender Suspend the transmission of business data.

Optionally, when the first physical host receives the data corresponding to the simulated host adapter of the second physical host sent by the second physical host and the data corresponding to the virtual machine:

As shown in FIG. 5, the first physical host further includes: an obtaining module 35, where:

The obtaining module 35 is configured to acquire data corresponding to the emulated host adapter of the second physical host and data corresponding to the virtual machine.

The copying module 32 is further configured to copy data corresponding to the emulated host adapter of the second physical host to the host adapter of the first physical host.

The binding unit 33 is further configured to generate a corresponding new virtual machine according to the data corresponding to the virtual machine, and bind the new virtual machine to the emulation host adapter of the second physical host.

The first physical host provided by the embodiment of the present invention copies the data in the host adapter to the emulated host adapter, and then copies the data corresponding to the virtual machine and the emulated host adapter to the destination physical host. Therefore, in the process, There is no data loss, so that the virtual machine can be hot-migrated in the HBA/HCA pass-through virtual machine mode without interrupting the existing services.

Embodiment 4

The fourth embodiment of the present invention shown in FIG. 6 provides a schematic structural diagram of another first physical host. The first physical host 4 can be a server or a terminal device. The first A physical host includes a memory 41, a processor 42, a host adapter 43 inserted in the physical host card slot, and an Ethernet network card 44. The various components described above are coupled together by a bus system. The bus may be an Industry Standard Architecture (ISA) bus, a Peripheral Component (PCI) bus, or an Extended Industry Standard Architecture (EISA) bus. The bus can be divided into an address bus, a data bus, a control bus, and the like. For ease of representation, only one thick line is shown in Figure 6, but it does not mean that there is only one bus or one type of bus. among them:

The above-mentioned memory 41 may be any available medium that can be accessed by a computer, including but not limited to: read only memory (ROM), random access memory (RAM), or disk storage. A storage medium familiar to the art, such as flash memory, programmable read only memory or electrically erasable programmable memory, registers, and the like. The storage device is used to provide instruction and data information to the processor, and the processor is connected through a bus.

The foregoing memory 41 stores: an operating system, an application, a VMM for managing virtual machine functions, an operating system for running the virtual machine, and various applications in the virtual machine, and program code for implementing the embodiment of the present invention. . among them,

The host adapter 43 described above is a hardware device conforming to a single input/output virtualized SR-IOV standard, and includes one or more physical functions PF and one or more virtual function VFs.

The processor 42 performs processing and transfer of messages between the devices by reading the information stored in the memory 41.

Specifically, the host adapter 43 is configured to interact with the service sender, so that the service sender pauses the transmission of the service data.

a processor 42 for copying data in the host adapter into the emulation host adapter; and for unbinding the virtual machine from the host adapter, and binding the virtual machine to the emulated host adapter; The data corresponding to the virtual machine and the data corresponding to the emulated host adapter are migrated to the second physical host.

Wherein, the above host adapter 43 includes a host bus adapter HBA and a host The channel adapter HCA; and the data corresponding to the virtual machine includes the data corresponding to the device simulated by the virtual machine and the running data information; the data corresponding to the simulated host adapter includes the data of the simulated host adapter itself and the data of the simulation adapter running.

Optionally, when the host adapter 43 includes the Internet small computer system interface ISCSI HBA, the host adapter 43 is specifically configured to: continuously send the transmission control protocol TCP packet information of the window domain to 0 to the service sender, so that the service sender The transmission of the service data is suspended; wherein the TCP message information of the window field is 0, which is used to indicate that the service sender performs the transmission suspension of the service data within a preset time period.

Optionally, when the host adapter 43 includes a Fibre Channel FC/Ethernet Fibre Channel FCoE HBA or an Infinite Bandwidth IB/RoCE HCA, the host adapter 43 is specifically configured to: stop transmitting a credit response frame to the service sender, so that the service is sent. The party suspends the transmission of business data.

Optionally, when the first physical host receives the data corresponding to the simulated host adapter of the second physical host sent by the second physical host and the data corresponding to the virtual machine, the processor 42 is further configured to acquire the second Corresponding data of the simulated host adapter of the physical host and data corresponding to the virtual machine; and data for copying the emulated host adapter of the second physical host to the host adapter of the first physical host, and according to the The data corresponding to the virtual machine generates a corresponding new virtual machine, and the new virtual machine is bound to the emulated host adapter of the second physical host.

The first physical host provided by the embodiment of the present invention copies the data in the host adapter to the emulated host adapter, and then copies the data corresponding to the virtual machine and the emulated host adapter to the destination physical host. Therefore, in the process, There is no data loss, so that the virtual machine can be hot-migrated in the HBA/HCA pass-through virtual machine mode without interrupting the existing services.

Embodiment 5

A fifth embodiment of the present invention provides a virtual machine hot migration system. As shown in FIG. 7, the virtual machine hot migration system 5 includes a first physical host 51 and a second physical host 52, wherein the first physical host 51 is 2, 3, 4, 5, and 6 correspond to the first physical host shown in the embodiment.

The first physical host 51 is configured to interact with the service sender, so that the service sender pauses the transmission of the service data; copies the data in the host adapter to the emulation host adapter; and removes the binding between the virtual machine and the host adapter, and The virtual machine is bound to the emulation host adapter; the data corresponding to the virtual machine and the data corresponding to the emulated host adapter are migrated to the second physical host 52.

The host adapter includes a host bus adapter HBA and a host channel adapter HCA; and the data corresponding to the virtual machine includes data corresponding to the device simulated by the virtual machine and running data information; and the data corresponding to the simulated host adapter includes the simulation host. The data of the adapter itself and the data that the emulation adapter runs.

Optionally, when the foregoing host adapter includes an Internet small computer system interface ISCSI HBA, the first physical host 51 is specifically configured to: continuously send, to the service sender, a transmission control protocol TCP packet information with a window domain of 0, so that the service is sent. The party temporarily suspends the transmission of the service data; wherein the TCP message information of the window field is 0, which is used to indicate that the service sender implements the suspension of the service data within the preset time period.

Optionally, when the foregoing host adapter includes a Fibre Channel FC/Ethernet Fibre Channel FCoE HBA or an Infinite Bandwidth IB/RoCE HCA, the first physical host 51 is specifically configured to: stop transmitting a credit response frame to the service sender, so that the service is The sender suspends the transmission of business data.

The second physical host 52 is configured to obtain data corresponding to the emulated host adapter of the first physical host, and copy the data corresponding to the emulated host adapter of the first physical host to the host adapter of the second physical host.

The virtual machine hot migration system provided by the embodiment of the present invention copies the data in the host adapter to the emulated host adapter, and then copies the data corresponding to the virtual machine and the emulated host adapter to the destination physical host. Therefore, in this process, There is no data loss in the middle, so that the hot migration of the virtual machine can be realized in the HBA/HCA through virtual machine mode without interruption of the existing service.

It will be clearly understood by those skilled in the art that for the convenience and brevity of the description, only the division of each functional module described above is exemplified. In practical applications, the above function assignment can be completed by different functional modules as needed. Internal junction of the device The structure is divided into different functional modules to complete all or part of the functions described above. For the specific working process of the system, the device and the unit described above, reference may be made to the corresponding process in the foregoing method embodiments, and details are not described herein again.

In the several embodiments provided by the present application, it should be understood that the disclosed system, apparatus, and method may be implemented in other manners. For example, the device embodiments described above are merely illustrative. For example, the division of the modules or units is only a logical function division. In actual implementation, there may be another division manner, for example, multiple units or components may be used. Combinations can be integrated into another system, or some features can be ignored or not executed. In addition, the mutual coupling or direct coupling or communication connection shown or discussed may be an indirect coupling or communication connection through some interface, device or unit, and may be in an electrical, mechanical or other form.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist physically separately, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or in the form of a software functional unit.

All or part of the steps of implementing the above method embodiments may be performed by hardware related to the program instructions. The foregoing program may be stored in a computer readable storage medium, and when executed, the steps including the foregoing method embodiments are performed; The foregoing storage medium includes: a U disk, a mobile hard disk, a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, and the like, which can store program codes.

The above embodiments are only used to explain the technical solutions of the present application, and are not limited thereto; although the present application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that they can still The technical solutions described in the embodiments are modified, or the equivalents of the technical features are replaced by the equivalents. The modifications and substitutions of the embodiments do not depart from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims (10)

A virtual machine hot migration method is used for a first physical host, the first physical host includes a host and a host adapter connected to the host, and the host adapter is a single input and output virtualized SR-IOV standard Hardware device, comprising one or more physical functions PF and one or more virtual functions VF; the host running a virtual machine and a virtual machine manager VMM, wherein the virtual machine runs a guest operating system, the customer operation The system directly accesses the VF through a pass-through technology conforming to the SR-IOV standard; The VMM further includes an emulation host adapter implemented by software, and the method includes: Interacting with the service sender, causing the service sender to suspend the transmission of the service data; Copying data from the host adapter into the emulated host adapter; Unbinding the virtual machine and the host adapter, and binding the virtual machine to the emulation host adapter; The data corresponding to the virtual machine and the data corresponding to the emulated host adapter are migrated to the second physical host. The method according to claim 1, wherein the data corresponding to the virtual machine comprises data corresponding to the device simulated by the virtual machine and data information of the operation; and the data corresponding to the simulated host adapter includes the simulation The data of the host adapter itself and the data run by the emulation adapter. The method according to claim 1 or 2, wherein the host adapter comprises an Internet Small Computer System Interface (ISCSI) HBA, and the interaction with the service sender causes the service sender to suspend the transmission of the service data, including: Transmitting, by the service sender, the transmission control protocol TCP packet information with the window field being 0, so that the service sender pauses the transmission of the service data; wherein the TCP packet information of the window domain is 0 is used to indicate the service transmission. The party implements the suspension of the transmission of the service data within a preset time period. The method according to claim 1 or 2, wherein the host adapter comprises a Fibre Channel FC/Ethernet Fibre Channel FCoE HBA or an infinite bandwidth IB/RoCE HCA, the interaction with the service sender, so that the service is sent Suspended business The delivery of data includes: The sender of the service stops sending the credit response frame, so that the service sender pauses the transmission of the service data. The method according to any one of claims 1 to 4, further comprising: Obtaining data corresponding to the emulated host adapter of the second physical host and data corresponding to the virtual machine; Copying data corresponding to the emulated host adapter of the second physical host to the host adapter of the first physical host, and generating a corresponding new virtual machine according to the acquired data corresponding to the virtual machine, The new virtual machine is bound to the emulated host adapter of the second physical host. A first physical host, the first physical host includes a host and a host adapter connected to the host, the host adapter being a hardware device conforming to a single input and output virtualized SR-IOV standard, including one or more Physical function PF and one or more virtual functions VF; the host runs a virtual machine and a virtual machine manager VMM, wherein the virtual machine runs a guest operating system, and the guest operating system passes the SR-IOV standard Direct access technology directly accesses the VF; The VMM further includes an emulated host adapter implemented by software; the host includes: An interaction module, configured to interact with a service sender, so that the service sender pauses the transmission of the service data; a copy module, configured to copy data in the host adapter into the emulated host adapter; a binding module, configured to release a binding between the virtual machine and the host adapter, and bind the virtual machine to the emulation host adapter; And a migration module, configured to migrate data corresponding to the virtual machine and data corresponding to the emulated host adapter to the second physical host. The first physical host according to claim 6, wherein the data corresponding to the virtual machine includes data corresponding to the device simulated by the virtual machine and running The data corresponding to the emulated host adapter includes data of the emulated host adapter itself and data of the emulation adapter running. The first physical host according to claim 6 or 7, wherein the host adapter comprises an Internet Small Computer System Interface (ISCSI) HBA, and the interaction module is specifically configured to: continuously send a window domain to the service sender The transmission control protocol TCP message information of 0 causes the service sender to suspend the transmission of the service data; wherein the TCP message information in which the window field is 0 is used to instruct the service sender to implement the service data in a preset time period. The transmission within is paused. The first physical host according to claim 6 or 7, wherein the host adapter comprises a Fibre Channel FC/Ethernet Fibre Channel FCoE HBA or an infinite bandwidth IB/RoCE HCA, and the interaction module is specifically configured to: The service sender stops sending the credit response frame, so that the service sender pauses the transmission of the service data. The first physical host according to any one of claims 6 to 9, wherein the first physical host further comprises: An acquiring module, configured to acquire data corresponding to the emulated host adapter of the second physical host and data corresponding to the virtual machine; The copying module is further configured to copy data corresponding to the emulated host adapter of the second physical host to a host adapter of the first physical host; The binding unit is further configured to generate a corresponding new virtual machine according to the acquired data corresponding to the virtual machine, and bind the new virtual machine to an emulation host adapter of the second physical host.

Images