[go: up one dir, main page]

WO2025123783A1 - Procédé de gestion et de commande de disque en nuage, système de gestion et de commande de disque en nuage, et dispositif électronique et support de stockage - Google Patents

Procédé de gestion et de commande de disque en nuage, système de gestion et de commande de disque en nuage, et dispositif électronique et support de stockage Download PDF

Info

Publication number
WO2025123783A1
WO2025123783A1 PCT/CN2024/114916 CN2024114916W WO2025123783A1 WO 2025123783 A1 WO2025123783 A1 WO 2025123783A1 CN 2024114916 W CN2024114916 W CN 2024114916W WO 2025123783 A1 WO2025123783 A1 WO 2025123783A1
Authority
WO
WIPO (PCT)
Prior art keywords
cloud disk
target
cluster
storage
management
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
PCT/CN2024/114916
Other languages
English (en)
Chinese (zh)
Inventor
张烁
吴东
佟光勋
张小路
吴均平
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba Cloud Computing Ltd
Original Assignee
Alibaba Cloud Computing Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba Cloud Computing Ltd filed Critical Alibaba Cloud Computing Ltd
Publication of WO2025123783A1 publication Critical patent/WO2025123783A1/fr
Pending legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/182—Distributed file systems
    • G06F16/1824—Distributed file systems implemented using Network-attached Storage [NAS] architecture
    • G06F16/183—Provision of network file services by network file servers, e.g. by using NFS, CIFS

Definitions

  • the present disclosure relates to the field of distributed storage technology, and in particular to a cloud disk management method, system, electronic device and storage medium.
  • Block storage system is a low-latency, persistent and highly reliable block-level random distributed storage system.
  • data is divided into blocks, and each block is operated as an independent hard disk.
  • This method provides high performance and flexibility, and is particularly suitable for processing large amounts of data, such as databases and large-scale virtual machine environments.
  • cloud disk provides users with block storage services at the data block level. It virtualizes the storage space of physical hard disks and provides it to users through the network. Users can use cloud disks like local hard disks to read and write data. Therefore, in the block storage system, it is very important to achieve efficient management and control of cloud disks and reduce the fault domain of block storage systems.
  • the embodiments of the present disclosure provide a cloud disk management method, system, electronic device and storage medium to alleviate or solve one or more technical problems existing in the prior art.
  • an embodiment of the present disclosure provides a cloud disk management and control method, comprising: obtaining cloud disk identification information of a target cloud disk; the cloud disk identification information is used to identify the target cloud disk and a target storage management and control node and a target cluster corresponding to the target cloud disk; the target cluster comprises a plurality of storage management and control nodes, the plurality of storage management and control nodes including the target storage management and control node; the target storage management and control node is used to create the target cloud disk on at least one storage service node of the target cluster and generate the cloud disk identification information; and the target cluster, the target storage management and control node and the target cloud disk are determined according to the cloud disk identification information.
  • an embodiment of the present disclosure provides a cloud disk management and control method, comprising: in response to a cloud disk creation request, creating a target cloud disk on at least one storage service node of a target cluster; the target cluster comprises multiple storage management and control nodes, the multiple storage management and control nodes include the target storage management and control node; generating cloud disk identification information of the target cloud disk; the cloud disk identification information is used to identify the target cloud disk, the target storage management and control node and the target cluster.
  • an embodiment of the present disclosure provides a cloud disk management and control system, including: a cluster management and control node, used to execute the method provided by the embodiment of the first aspect of the present disclosure; at least one cluster, the cluster including multiple storage management and control nodes and multiple storage service nodes, the storage management and control node is used to execute the method provided by the embodiment of the second aspect of the present disclosure.
  • an embodiment of the present disclosure provides an electronic device, including a memory, a processor, and a computer program stored in the memory, wherein the processor implements the method provided in any embodiment of the present disclosure when executing the computer program.
  • an embodiment of the present disclosure provides a computer-readable storage medium, in which a computer program is stored.
  • the computer program is executed by a processor, the method provided by any embodiment of the present disclosure is implemented.
  • an embodiment of the present disclosure provides a computer program product, including a computer program, which implements the method provided by any embodiment of the present disclosure when executed by a processor.
  • the storage management and control nodes in a storage cluster are horizontally expanded, that is, a storage cluster includes multiple storage management and control nodes, and each storage management and control node is responsible for the management and control of several groups of cloud disks (for example, a collection of multiple cloud disks).
  • each storage management and control node works at the same time, avoiding the waste of resources caused by a one-master and multiple-standby architecture, improving resource utilization, and supporting large-scale clusters; on the other hand, when a storage management and control node fails, only a part of the cloud disks in the storage cluster are affected, so the explosion radius is much smaller than the explosion radius of the centralized BM architecture.
  • an effective cluster resource scheduling solution can be provided so that cloud disk scheduling is not affected by architecture updates.
  • FIG1 shows an architecture diagram of a cloud disk management and control system provided in the related art
  • FIG2 shows an architecture diagram of a cloud disk management and control system provided by an embodiment of the present disclosure
  • FIG3 shows an application example diagram of cloud disk scheduling provided by an embodiment of the present disclosure
  • FIG4 shows another application example diagram of cloud disk scheduling provided by an embodiment of the present disclosure
  • FIG5 is a flow chart of a cloud disk management and control method provided by an embodiment of the present disclosure.
  • FIG6 shows a flow chart of a cloud disk management and control method provided by an embodiment of the present disclosure
  • FIG. 7 shows a block diagram of an electronic device provided by an embodiment of the present disclosure.
  • Block Storage System A low-latency, persistent, and highly reliable block-level random storage system that divides data into blocks, each of which operates as an independent hard drive. This means that users can freely create their own file systems on these blocks, thereby better controlling the data environment, which is particularly suitable for processing large amounts of data, such as databases and large-scale virtual machine environments.
  • Cloud Disk Based on the distributed storage architecture, it provides block storage services at the data block level.
  • the data of the cloud disk is persistently stored in the distributed storage system on the backend, and the downtime of any node on the computing end will not affect the cloud disk.
  • Explosion radius represents the size of the fault domain, that is, the impact area when a node fails. The smaller the explosion radius, the smaller the fault domain; the larger the explosion radius, the larger the fault domain.
  • Internet Data Center is a facility for storing, managing and distributing large amounts of data. It provides a range of services including server hosting, network connection, data storage and backup, and security management.
  • Availability Zone represents a physical location that has its own power supply, network connection, and security facilities. There may be one or more availability zones in the same geographic region. Each availability zone is independent of each other and isolated from other availability zones to prevent other availability zones from being affected when a problem occurs in one availability zone. For example, if an availability zone has problems due to power failure, network outage, or natural disaster, other availability zones can continue to operate normally. In a cloud computing environment, an availability zone contains one or more Internet Data Centers (IDCs).
  • IDCs Internet Data Centers
  • Virtual block device A virtualized storage device that simulates the functions of a physical hard drive, allowing a virtual machine to access storage space just like a physical hard drive, thereby reading or writing data in a cloud disk.
  • Garbage Collection An automatic memory management technology.
  • the garbage collector automatically reclaims the memory space occupied by these objects for reuse.
  • the GC task refers to the regular cleaning of useless data blocks or objects to free up storage space and improve resource utilization.
  • the architecture of this centralized management method is relatively simple.
  • the client obtains the location of the segment through the BM, and then can read and write data on the corresponding BS.
  • the centralized BM is responsible for the management, scheduling, and operation and maintenance of the entire storage cluster. It can work more efficiently when there are fewer cloud disks in a single cluster, a limited number of segments, and a small cluster size.
  • a single cluster is expected to support more segments and cloud disks in the future. If it is to support 10 million segments in the future, a single BM will need to provide 360G memory. Obviously, the existing servers cannot support this requirement.
  • FIG2 shows an architecture diagram of a cloud disk management system 200 according to an implementation of the embodiment of the present disclosure.
  • the cloud disk management system 200 includes a cluster management node 201 and one or more clusters 202 .
  • the cluster management node 201 is a service node that manages each cluster 202.
  • the cluster management node 201 may be a resource management node RM.
  • the cluster management node 201 that manages each storage cluster decides one of the clusters 202 as a target cluster.
  • Cluster 202 is a storage cluster.
  • the storage management and control node can be a block storage backend control node (BM), as shown in FIG2 , and the multiple storage management and control nodes are, for example, BM1, BM2, BM3, and BM4.
  • the storage service node can be a block storage backend service node (BS), as shown in FIG2 , and the multiple storage service nodes are, for example, BS1, BS2, BS3, BS4, BS5, BS6, BS7, and BS8.
  • BS block storage backend service node
  • the embodiments of the present disclosure do not specifically limit the number of clusters 202, and the number of storage management and control nodes and storage service nodes deployed in each cluster.
  • Each storage management and control node is used to manage multiple cloud disk sets (partitions).
  • BM1 can manage cloud disk set 1 and cloud disk set 8 (for cloud disk set list 1)
  • BM2 can manage cloud disk set 2 and cloud disk set 3 (for cloud disk set list 2)
  • BM3 can manage cloud disk set 4 and cloud disk set 6 (for cloud disk set list 3)
  • BM4 can manage cloud disk set 5 and cloud disk set 7 (for cloud disk set list 4).
  • multiple storage management and control nodes have a one-to-one mapping relationship with multiple cloud disk set lists (partition lists), that is, cloud disk sets and storage management and control nodes have a mapping relationship.
  • a cloud disk set is a logical concept, which is a collection of a batch of cloud disks.
  • a cloud disk can only belong to one cloud disk set. After the cloud disk set is created, it needs to be loaded by the corresponding storage management node before it can provide corresponding services.
  • cloud disk sets partitions
  • the storage control node controls its corresponding cloud disk collection, including but not limited to: creating cloud disks and generating corresponding cloud disk identification information (Volume ID) for the created cloud disks; mounting cloud disks (opening disks), deleting cloud disks, and scheduling cloud disks based on the cloud disk identification information.
  • creating cloud disks and generating corresponding cloud disk identification information Volume ID
  • mounting cloud disks opening disks
  • deleting cloud disks and scheduling cloud disks based on the cloud disk identification information.
  • the cloud disk identification information includes a cluster ID, a cloud disk set ID, and a cloud disk ID (the location of the cloud disk on the cloud disk set).
  • the location of the cloud disk on the cloud disk set can be represented by a cloud disk number or a cloud disk random number.
  • each cloud disk in the cloud disk set has a unique cloud disk number or a unique cloud disk random number.
  • the cloud disk identification information may also include a reserved field (or preset field), which may identify a reserved function or preset function or other information of the cloud disk.
  • CM central control node
  • its deployment may also include a central control node (Central Master, CM), which is responsible for bypass control work from the global perspective of the cluster 202, including: managing the online and offline of BM in the cluster 202; managing the online and offline of BS in the cluster 202; allocating and creating cloud disk collections, creating and configuring corresponding resources for them, etc.
  • Central Master CM
  • the cloud disk management and control system 200 may also include a client 203, which may be deployed in a computing cluster, and obtain cloud disk identification information by interacting with the cluster management and control node 201, and then access the corresponding cloud disk based on the cloud disk identification information, such as mounting a cloud disk.
  • the client 203 may interact with the storage management and control node through an application program interface (Application Programming Interface, API), obtain information about the storage service node where the Segment is located, and then read and write data on the storage service node.
  • API Application Programming Interface
  • the following describes an application example of a dynamic disk creation process of a cloud disk management and control system 200 based on an embodiment of the present disclosure in conjunction with FIG. 2.
  • the disk creation process mainly includes:
  • Cluster management node 201 selects one of the multiple storage management nodes in cluster 201 as the target storage
  • the selection strategy for the control node e.g. BM1
  • Cluster management node 201 sends a cloud disk creation request to BM1;
  • BM1 may be configured with a proxy or management component (proxy), and the proxy of BM1 selects one of multiple cloud disk sets as a target cloud disk set (for example, cloud disk set 8);
  • proxy proxy or management component
  • BM1 completes the creation of the target cloud disk, generates the cloud disk identification information (Volume ID) of the target cloud disk, and returns the disk creation success information and the cloud disk identification information of the target cloud disk to the cluster management and control node 201 through the original path.
  • the following describes an application example of a dynamic disk opening process of a cloud disk management and control system 200 based on an embodiment of the present disclosure in conjunction with FIG. 2.
  • the disk opening process mainly includes:
  • the client 203 queries the cluster management and control node 201 for information about the target cluster, cloud disk identification information of the target cloud disk, and information about the target storage management and control node through the device identification information (DEVID) of the virtual block device;
  • DEVID device identification information
  • the cluster management and control node 201 parses the corresponding cloud disk identification information (Volume ID) based on the device identification information provided by the client 203, and obtains the cluster identification (Cluster ID), cloud disk collection identification (Partition ID) and cloud disk identification (the location of the cloud disk on the cloud disk collection) by parsing the Volume ID. Then, based on the mapping relationship between the cloud disk collection and the storage management and control node, the storage management and control node (for example, BM1) corresponding to the cloud disk collection identification (Partition ID) is determined as the target storage management and control node;
  • BM1 cloud disk collection identification
  • the cluster management node 201 returns the cluster identifier (e.g., cluster name) of the target cluster, the Internet Protocol (IP) address of BM1, and the Volume ID to the client 203;
  • the cluster identifier e.g., cluster name
  • IP Internet Protocol
  • Client 203 sends a cloud disk mount request for the target cloud disk to BM1 based on BM1's IP address;
  • BM1 responds to the cloud disk mount request and mounts the target cloud disk.
  • the cloud disk scheduling process mainly includes:
  • Each BM in the cluster obtains the traffic information of each BS in the cluster.
  • the acquisition method can be that each BS in the cluster sends a heartbeat to the central control node (CM) to report its own traffic information; the acquisition method can also be that each BM in the cluster sends a slow heartbeat to each BS in the cluster, so that each BM can obtain the traffic information of each BS.
  • the slow heartbeat is sent once every 10 seconds, for example;
  • Each BM performs cloud disk scheduling in turn according to a preset order.
  • BM1, BM2, BM3 and BM4 perform cloud disk scheduling in turn, including traffic balancing scheduling (dynamic or static), so as to schedule cloud disk segments of the cloud disk to multiple storage service nodes.
  • CM is used to control each BM to perform cloud disk scheduling in turn according to a preset order and perform certain interference from the global perspective of the cluster according to the global coordination mechanism. If CM fails, each BM will continue to perform cloud disk scheduling in turn.
  • the cloud disk scheduling process mainly includes:
  • Each BS in the cluster is divided into multiple groups, forming storage service node groups.
  • Each BM corresponds to each storage service node group one by one.
  • the BM has jurisdiction over the corresponding storage service node group, including initiating downtime operations on the BS of the storage service node group.
  • BS1 and BS2 form group 1
  • BM1 corresponds to group 1 and has jurisdiction over BS1 and BS2
  • BS3 and BS4 form Group 2
  • BM2 corresponds to Group 2 and has jurisdiction over BS3 and BS4
  • BS5 and BS6 form Group 3
  • BM3 corresponds to Group 3 and has jurisdiction over BS5 and BS6
  • BS7 and BS8 form Group 4
  • BM4 corresponds to Group 4 and has jurisdiction over BS7 and BS8;
  • the BM sends a fast heartbeat to the corresponding BS, such as once every 200 milliseconds, to obtain the operating status information of the corresponding BS for fault diagnosis (downtime diagnosis) of the BS;
  • the BM determines that there is a faulty BS in the group, that is, there is a downtime BS, it will perform a downtime operation on the BS. For example, if BM1 determines that BS2 in group 1 is downtime, BM1 will perform a downtime operation on the BS to implement downtime scheduling (also called fault scheduling or abnormal scheduling).
  • downtime scheduling also called fault scheduling or abnormal scheduling
  • each BM reports a heartbeat to the RM and reports its own operating status information, that is, it is determined that the BM is not faulty; the cluster granularity information setting is reported by a BM in the cluster (for example, BM1 by default).
  • the central management and control node reports a heartbeat to each BM, obtains the operating status information of each BM, such as whether it is faulty, and obtains the load status of each cloud disk set on the BM.
  • the cloud disk management and control system of the embodiment of the present disclosure provides a cloud disk management and control solution based on distributed storage management and control nodes, which horizontally expands the storage management and control nodes in a storage cluster, that is, a storage cluster includes multiple storage management and control nodes, and each storage management and control node is responsible for the management and control of several cloud disk sets.
  • each storage management and control node works at the same time, avoiding the waste of resources caused by the one-master-multiple-standby architecture and improving resource utilization; on the other hand, when a storage management and control node fails, other storage management and control nodes take over the cloud disk set it is responsible for.
  • the explosion radius is much smaller than the explosion radius of the centralized BM architecture; on the other hand, it can support large-scale clusters.
  • the solution of the embodiment of the present disclosure can support larger clusters of 200 or even 1,000 units; on the other hand, the embodiment of the present disclosure also provides an effective cluster resource scheduling solution for the cloud disk management and control architecture of the distributed storage management and control nodes, so that the cloud disk scheduling is not affected by the architecture update.
  • the above application scenarios provided in the embodiments of the present disclosure are for ease of understanding, and the embodiments of the present disclosure do not specifically limit the application scenarios of the technical solution.
  • the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data for analysis, stored data, displayed data, etc.) involved in the present disclosure are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data need to comply with the relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to select or edit authorization or rejection.
  • FIG5 shows a flow chart of a cloud disk management method according to an embodiment of the present disclosure.
  • the cloud disk management method can be applied to a cluster management node.
  • the cloud disk management method includes:
  • Step S501 Obtain the cloud disk identification information of the target cloud disk; the cloud disk identification information is used to identify the target cloud disk and the target storage management and control node and target cluster corresponding to the target cloud disk; the target cluster includes multiple storage management and control nodes, multiple storage management nodes, and multiple storage management nodes.
  • the control nodes include a target storage control node; the target storage control node is used to create a target cloud disk on at least one storage service node of the target cluster and generate cloud disk identification information.
  • each storage management and control node is used to manage multiple cloud disk sets (partitions), and the cloud disk identification information includes cluster identification, partition identification and cloud disk identification; among them, the cluster identification of the target cloud disk is used to determine the target cluster; the partition identification of the target cloud disk is used to identify the target partition to which the target cloud disk belongs, so as to determine the storage management and control node corresponding to the target partition as the target storage management and control node based on the mapping relationship between the partition and the storage management and control node; the cloud disk identification of the target cloud disk is used to determine the position of the target cloud disk on the target partition.
  • the storage management node in a storage cluster is horizontally expanded, that is, a storage cluster includes multiple storage management nodes, and each storage management node is responsible for the management of several groups of cloud disks (for example, a collection of multiple cloud disks).
  • each storage management node works at the same time, avoiding the waste of resources caused by the one-master-multiple-standby architecture, improving resource utilization, and supporting large-scale clusters; on the other hand, in the event of a failure of a storage management node, only a part of the cloud disks in the storage cluster are affected, so the explosion radius is much smaller than the explosion radius of the centralized BM (one-master-multiple-standby) architecture.
  • multiple storage management and control nodes take turns to execute cloud disk scheduling in a preset order.
  • the method executed by the target storage management and control node in the embodiment of the present disclosure may also include: obtaining traffic information of each storage service node in the target cluster; in response to it being the turn of the target storage management and control node to execute cloud disk scheduling, scheduling at least one cloud disk corresponding to the target storage management and control node based on the traffic information of each storage service node.
  • each storage control node in the target cluster obtains the traffic information of each storage service node in the target cluster.
  • the acquisition method may be that each storage service node in the target cluster sends a heartbeat to the central control node (CM) to report its own traffic information; the acquisition method may also be that each storage control node in the target cluster sends a slow heartbeat to each storage service node in the target cluster, so that the target storage control node can obtain the traffic information of each storage service node in the target cluster.
  • each storage control node performs cloud disk scheduling in turn according to a preset order. When it is the turn of the target storage control node to perform cloud disk scheduling, the target storage control node can perform cloud disk scheduling on each part it ion under its control, including dynamic traffic balancing scheduling or static traffic balancing scheduling.
  • each storage service node of the target cluster is divided into multiple storage service node groups, and multiple storage management and control nodes correspond one-to-one to multiple storage service node groups.
  • the method performed by the target storage management and control node in the disclosed embodiment may also include: based on the operation status information of each storage service node in the storage service node group corresponding to the target storage management and control node, judging whether there is a faulty storage service node in the storage service node group corresponding to the target storage management and control node; in response to the existence of a faulty storage service node, performing a downtime operation on the faulty storage service node.
  • the method executed by the target storage control node in the embodiment of the present disclosure may further include: in response to a failed storage control node in the target cluster, controlling each cloud disk corresponding to the failed storage control node. That is, when a storage control node fails, other storage control nodes take over the cloud disks for which they are responsible.
  • an effective cluster resource scheduling solution can be provided for the cloud disk management and control architecture of the distributed storage management and control node, so that the cloud disk scheduling is not affected by the architecture update.
  • the embodiment of the present disclosure provides a cloud disk management and control device, which is applied to a cluster management and control node and may include: a cloud disk identification information acquisition module, used to obtain cloud disk identification information of a target cloud disk; the cloud disk identification information is used to identify the target cloud disk and the target storage management and control node and target cluster corresponding to the target cloud disk; the target cluster includes multiple storage management and control nodes, and the multiple storage management and control nodes include the target storage management and control node; the target storage management and control node is used to create the target cloud disk on at least one storage service node of the target cluster and generate the cloud disk identification information; a target storage management and control node determination module, Used to determine the target cluster, the target storage management and control node and the target cloud disk according to the cloud disk identification information.
  • a cloud disk identification information acquisition module used to obtain cloud disk identification information of a target cloud disk
  • the cloud disk identification information is used to identify the target cloud disk and the target storage management and control node and target cluster corresponding to the target cloud disk
  • each storage management and control node is used to manage multiple cloud disk sets
  • the cloud disk identification information includes a cloud disk identification, a cloud disk set identification and a cluster identification.
  • the target storage management and control node determination module is specifically used to: use the cluster identification, cloud disk set identification and cloud disk identification of the target cloud disk to respectively determine the target cluster, the target cloud disk set to which the target cloud disk belongs, and the position of the target cloud disk on the target cloud disk set; based on the mapping relationship between the cloud disk set and the storage management and control node, determine the storage management and control node corresponding to the target cloud disk set as the target storage management and control node.
  • the device may also include: a target storage management and control node selection module, used to select the target storage management and control node from the multiple storage management and control nodes; a cloud disk creation request sending module, used to send a cloud disk creation request to the target storage management and control node, so that the target storage management and control node creates the target cloud disk on the at least one storage service node and generates the cloud disk identification information; a cloud disk identification information receiving module, used to receive the cloud disk identification information returned by the target storage management and control node.
  • a target storage management and control node selection module used to select the target storage management and control node from the multiple storage management and control nodes
  • a cloud disk creation request sending module used to send a cloud disk creation request to the target storage management and control node, so that the target storage management and control node creates the target cloud disk on the at least one storage service node and generates the cloud disk identification information
  • a cloud disk identification information receiving module used to receive the cloud disk identification information returned by the target storage management and control node.
  • the embodiment of the present disclosure provides a cloud disk management and control device, which is applied to a target storage management and control node and may include: a target cloud disk creation module, used to create a target cloud disk on at least one storage service node of a target cluster in response to a cloud disk creation request; the target cluster includes multiple storage management and control nodes, and the multiple storage management and control nodes include the target storage management and control node; a cloud disk identification information generation module, used to generate cloud disk identification information of the target cloud disk; the cloud disk identification information is used to identify the target cloud disk, the target storage management and control node and the target cluster.
  • a target cloud disk creation module used to create a target cloud disk on at least one storage service node of a target cluster in response to a cloud disk creation request
  • the target cluster includes multiple storage management and control nodes, and the multiple storage management and control nodes include the target storage management and control node
  • a cloud disk identification information generation module used to generate cloud disk identification information of the target cloud disk
  • the cloud disk identification information is used
  • each storage management and control node is used to manage multiple cloud disk collections
  • the cloud disk identification information includes a cluster identification, a cloud disk collection identification and a cloud disk identification; wherein the cluster identification of the target cloud disk is used to determine the target cluster; the cloud disk collection identification of the target cloud disk is used to identify the target cloud disk collection to which the target cloud disk belongs, so as to determine the storage management and control node corresponding to the target cloud disk collection as the target storage management and control node based on the mapping relationship between the cloud disk collection and the storage management and control node; the cloud disk identification of the target cloud disk is used to determine the position of the target cloud disk on the target cloud disk collection.
  • the target cloud disk creation module is specifically used to: determine the target cloud disk set from multiple cloud disk sets corresponding to the target storage management and control node based on a preset load strategy; select the target cloud disk from the target cloud disk set, and create the target cloud disk on the at least one storage service node.
  • the device may further include a mounting module, configured to mount the target cloud disk in response to a cloud disk mounting request for the target cloud disk.
  • the multiple storage management and control nodes perform cloud disk scheduling in turn according to a preset order.
  • the device may also include: a traffic information acquisition module, used to obtain the traffic information of each storage service node in the target cluster; a scheduling module, used to schedule at least one cloud disk corresponding to the target storage management and control node based on the traffic information of each storage service node in response to the target storage management and control node's turn to perform cloud disk scheduling.
  • each storage service node of the target cluster is divided into a plurality of storage service node groups, and the plurality of storage management and control nodes correspond one-to-one to the plurality of storage service node groups.
  • the device may further include: a judgment module, Used to determine whether there is a faulty storage service node in the storage service node group corresponding to the target storage management and control node based on the operating status information of each storage service node in the storage service node group corresponding to the target storage management and control node; a downtime operation module is used to perform a downtime operation on the faulty storage service node in response to the existence of the faulty storage service node.
  • the device further includes a fault management and control module for managing each cloud disk corresponding to the faulty storage management and control node in response to the presence of a faulty storage management and control node in the target cluster.
  • each module in each device of the embodiment of the present disclosure can be referred to the corresponding description in the above method, and have corresponding beneficial effects, which will not be repeated here.
  • FIG7 is a block diagram of an electronic device for implementing an embodiment of the present disclosure.
  • the electronic device includes: a memory 701 and a processor 702, wherein the memory 701 stores a computer program that can be run on the processor 702. When the processor 702 executes the computer program, the method in the above embodiment is implemented.
  • the number of the memory 701 and the processor 702 can be one or more.
  • the electronic device also includes: a communication interface 703, which is used to communicate with external devices and perform data exchange transmission.
  • the bus can be an Industry Standard Architecture (ISA) bus, a Peripheral Component Interconnect (PCI) bus or an Extended Industry Standard Architecture (EISA) bus.
  • ISA Industry Standard Architecture
  • PCI Peripheral Component Interconnect
  • EISA Extended Industry Standard Architecture
  • the bus can be divided into an address bus, a data bus, a control bus, etc. For ease of representation, only one thick line is used in FIG. 7, but it does not mean that there is only one bus or one type of bus.
  • the memory 701, the processor 702 and the communication interface 703 are integrated on a chip, the memory 701, the processor 702 and the communication interface 703 can communicate with each other through an internal interface.
  • An embodiment of the present disclosure provides a computer-readable storage medium storing a computer program, which implements the method provided in any embodiment of the present disclosure when the program is executed by a processor.
  • An embodiment of the present disclosure provides a computer program product, including a computer program.
  • the computer program is executed by a processor, the method provided in any embodiment of the present disclosure is implemented.
  • An embodiment of the present disclosure also provides a chip, which includes a processor for calling and executing instructions stored in the memory from the memory, so that a communication device equipped with the chip executes a method provided by any embodiment of the present disclosure.
  • An embodiment of the present disclosure also provides a chip, including: an input interface, an output interface, a processor and a memory, wherein the input interface, the output interface, the processor and the memory are connected via an internal connection path, and the processor is used to execute the code in the memory.
  • the processor is used to execute the method provided in any embodiment of the application.
  • the processor may be a central processing unit (CPU), or other general-purpose processors, digital signal processors (DSP), application-specific integrated circuits (ASIC), field programmable gate arrays (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components, etc.
  • a general-purpose processor may be a microprocessor or any conventional processor, etc. It is worth noting that Specifically, the processor may be a processor supporting Advanced RISC Machines (ARM) architecture.
  • ARM Advanced RISC Machines
  • the above-mentioned memory may include a read-only memory and a random access memory, and may also include a non-volatile random access memory.
  • the memory may be a volatile memory or a non-volatile memory, or may include both volatile and non-volatile memories.
  • the non-volatile memory may include a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory.
  • the volatile memory may include a random access memory (RAM), which is used as an external cache. By way of exemplary but not limiting description, many forms of RAM are available.
  • SRAM Static RAM
  • DRAM Dynamic Random Access Memory
  • SDRAM Synchronous DRAM
  • DDR SDRAM Double Data Rate SDRAM
  • ESDRAM Enhanced SDRAM
  • SLDRAM Sync Link DRAM
  • DRRAM Direct Rambus RAM
  • the computer program product includes one or more computer instructions.
  • the computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device.
  • the computer instructions can be stored in a computer-readable storage medium, or transmitted from one computer-readable storage medium to another computer-readable storage medium.
  • the user information including but not limited to user device information, user personal information, user operation information, etc.
  • data including but not limited to data used for processing, data for analysis, data for storage, data for display, etc.
  • user information and data are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant information and data must comply with relevant laws, regulations and standards of relevant countries and regions, and provide corresponding operation entrances for users to choose to authorize or refuse.
  • first and second are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of technical features indicated.
  • a feature defined as “first” or “second” may explicitly or implicitly include at least one of the features.
  • the meaning of “plurality” is two or more, unless otherwise clearly and specifically defined.
  • Any process or method description described in the flowchart or otherwise herein can be understood to represent a module, segment or portion of code including one or more executable instructions for implementing the steps of a specific logical function or process. And the scope of the preferred embodiments of the present disclosure includes other implementations, in which the functions may not be performed in the order shown or discussed, including in a substantially simultaneous manner or in a reverse order according to the functions involved.
  • the logic and/or steps represented in the flowchart or otherwise described herein, for example, can be considered as an ordered list of executable instructions for implementing logical functions, and can be specifically implemented in any computer-readable medium for use by an instruction execution system, device or apparatus (such as a computer-based system, a system including a processor, or other system that can fetch instructions from an instruction execution system, device or apparatus and execute instructions), or used in combination with these instruction execution systems, devices or apparatuses.
  • each functional unit in each embodiment of the present disclosure may be integrated into a processing module, or each unit may exist physically separately, or two or more units may be integrated into one module.
  • the above-mentioned integrated module may be implemented in the form of hardware or in the form of a software functional module. If the above-mentioned integrated module is implemented in the form of a software functional module and sold or used as an independent product, it may also be stored in a computer-readable storage medium.
  • the storage medium may be a read-only memory, a disk or an optical disk, etc.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

L'invention concerne un procédé de gestion et de commande de disque en nuage, un système de gestion et de commande de disque en nuage, ainsi qu'un dispositif électronique et un support de stockage, qui se rapportent au domaine technique du stockage distribué. Le procédé consiste à : acquérir des informations d'identification de disque en nuage d'un disque en nuage cible, les informations d'identification de disque en nuage servant à identifier le disque en nuage cible et un maître de stockage cible et un groupe cible qui correspondent au disque en nuage cible, le groupe cible comprenant une pluralité de maîtres de stockage, la pluralité de maîtres de stockage comprenant le maître de stockage cible, et le maître de stockage cible étant utilisé pour créer le disque en nuage cible sur au moins un serveur de stockage du groupe cible et générer les informations d'identification de disque en nuage ; et déterminer le groupe cible, le maître de stockage cible et le disque en nuage cible d'après les informations d'identification de disque en nuage. Au moyen du procédé, le taux d'utilisation de ressources peut être amélioré, et un groupe à grande échelle est pris en charge.
PCT/CN2024/114916 2023-12-12 2024-08-27 Procédé de gestion et de commande de disque en nuage, système de gestion et de commande de disque en nuage, et dispositif électronique et support de stockage Pending WO2025123783A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202311713410.6 2023-12-12
CN202311713410.6A CN117714476A (zh) 2023-12-12 2023-12-12 云盘管控方法、系统、电子设备及存储介质

Publications (1)

Publication Number Publication Date
WO2025123783A1 true WO2025123783A1 (fr) 2025-06-19

Family

ID=90152757

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2024/114916 Pending WO2025123783A1 (fr) 2023-12-12 2024-08-27 Procédé de gestion et de commande de disque en nuage, système de gestion et de commande de disque en nuage, et dispositif électronique et support de stockage

Country Status (2)

Country Link
CN (1) CN117714476A (fr)
WO (1) WO2025123783A1 (fr)

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN117714476A (zh) * 2023-12-12 2024-03-15 阿里云计算有限公司 云盘管控方法、系统、电子设备及存储介质

Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108241469A (zh) * 2016-12-27 2018-07-03 北京金山云网络技术有限公司 一种数据存储方法、装置及系统
CN110708345A (zh) * 2018-07-09 2020-01-17 阿里巴巴集团控股有限公司 云盘升级方法、调度方法及云主机、调度装置和系统
WO2020088340A1 (fr) * 2018-11-01 2020-05-07 阿里巴巴集团控股有限公司 Procédé et système pour fournir un service infonuagique
CN113282564A (zh) * 2021-07-24 2021-08-20 阿里云计算有限公司 数据存储方法、系统、节点和存储介质
CN114697331A (zh) * 2022-03-29 2022-07-01 浪潮云信息技术股份公司 一种云盘挂载数量调度方法、系统、装置及存储介质
CN115168287A (zh) * 2022-06-17 2022-10-11 阿里巴巴（中国）有限公司 数据处理方法以及装置
CN115827148A (zh) * 2022-08-25 2023-03-21 杭州海康威视系统技术有限公司 一种资源管理方法、装置、电子设备及存储介质
CN115883662A (zh) * 2022-11-29 2023-03-31 阿里巴巴（中国）有限公司 存储系统及其调度方法、装置、计算机设备和存储介质
CN116436934A (zh) * 2023-04-10 2023-07-14 阿里巴巴（中国）有限公司 云盘调度方法、系统、电子设备及存储介质
CN117714476A (zh) * 2023-12-12 2024-03-15 阿里云计算有限公司 云盘管控方法、系统、电子设备及存储介质

Patent Citations (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108241469A (zh) * 2016-12-27 2018-07-03 北京金山云网络技术有限公司 一种数据存储方法、装置及系统
CN110708345A (zh) * 2018-07-09 2020-01-17 阿里巴巴集团控股有限公司 云盘升级方法、调度方法及云主机、调度装置和系统
WO2020088340A1 (fr) * 2018-11-01 2020-05-07 阿里巴巴集团控股有限公司 Procédé et système pour fournir un service infonuagique
CN113282564A (zh) * 2021-07-24 2021-08-20 阿里云计算有限公司 数据存储方法、系统、节点和存储介质
CN114697331A (zh) * 2022-03-29 2022-07-01 浪潮云信息技术股份公司 一种云盘挂载数量调度方法、系统、装置及存储介质
CN115168287A (zh) * 2022-06-17 2022-10-11 阿里巴巴（中国）有限公司 数据处理方法以及装置
CN115827148A (zh) * 2022-08-25 2023-03-21 杭州海康威视系统技术有限公司 一种资源管理方法、装置、电子设备及存储介质
CN115883662A (zh) * 2022-11-29 2023-03-31 阿里巴巴（中国）有限公司 存储系统及其调度方法、装置、计算机设备和存储介质
CN116436934A (zh) * 2023-04-10 2023-07-14 阿里巴巴（中国）有限公司 云盘调度方法、系统、电子设备及存储介质
CN117714476A (zh) * 2023-12-12 2024-03-15 阿里云计算有限公司 云盘管控方法、系统、电子设备及存储介质

Also Published As

Publication number Publication date
CN117714476A (zh) 2024-03-15

Similar Documents

Publication Publication Date Title
US11226847B2 (en) Implementing an application manifest in a node-specific manner using an intent-based orchestrator
US10642694B2 (en) Monitoring containers in a distributed computing system
US8386540B1 (en) Scalable relational database service
US6249883B1 (en) System and method for monitoring domain controllers
EP3811597A1 (fr) Services informatiques redondants dans une zone, utilisant de multiples services locaux dans des systèmes informatiques distribués
US20190138405A1 (en) Data Loading Method and Apparatus
US12038879B2 (en) Read and write access to data replicas stored in multiple data centers
JP2019101703A (ja) 記憶システム及び制御ソフトウェア配置方法
WO2019119212A1 (fr) Procédé et dispositif d'identification d'état sous-optimal d'osd, et système de stockage de données
CN106446159B (zh) 一种存储文件的方法、第一虚拟机及名称节点
CN111158949A (zh) 容灾架构的配置方法、切换方法及装置、设备和存储介质
CN113961312A (zh) 目标服务的部署方法、装置和电子设备
US20200125452A1 (en) Systems and methods for cross-regional back up of distributed databases on a cloud service
JP2019191951A (ja) 情報処理システム及びボリューム割当て方法
US8031637B2 (en) Ineligible group member status
CN112363820A (zh) 基于异构硬件的统一资源池化容器调度引擎及其调度方法
WO2025123783A1 (fr) Procédé de gestion et de commande de disque en nuage, système de gestion et de commande de disque en nuage, et dispositif électronique et support de stockage
WO2023029485A1 (fr) Procédé et appareil de traitement de données, dispositif informatique, et support de stockage lisible par ordinateur
CN103500126B (zh) 一种云计算平台的自动化容错配置方法
CN107943615B (zh) 基于分布式集群的数据处理方法与系统
CN103067418A (zh) 一种元数据重建方法、设备及系统
CN111800511B (zh) 同步登录态的处理方法、系统、设备及可读存储介质
US20240028611A1 (en) Granular Replica Healing for Distributed Databases
CN112685130A (zh) 分布式存储环境下的虚拟机备份方法、装置和存储介质
CN114490186B (zh) 数据备份规则分配方法、节点、系统及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24902209

Country of ref document: EP

Kind code of ref document: A1