CN116055307B - Large-scale storage cluster deployment grouping method and device - Google Patents
Large-scale storage cluster deployment grouping method and device Download PDFInfo
- Publication number
- CN116055307B CN116055307B CN202211355996.9A CN202211355996A CN116055307B CN 116055307 B CN116055307 B CN 116055307B CN 202211355996 A CN202211355996 A CN 202211355996A CN 116055307 B CN116055307 B CN 116055307B
- Authority
- CN
- China
- Prior art keywords
- grouping
- node
- nodes
- management service
- group
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0893—Assignment of logical groups to network elements
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L41/00—Arrangements for maintenance, administration or management of data switching networks, e.g. of packet switching networks
- H04L41/08—Configuration management of networks or network elements
- H04L41/0876—Aspects of the degree of configuration automation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/01—Protocols
- H04L67/10—Protocols in which an application is distributed across nodes in the network
- H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L67/00—Network arrangements or protocols for supporting network services or applications
- H04L67/2866—Architectures; Arrangements
- H04L67/30—Profiles
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
- Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management
Landscapes
- Engineering & Computer Science (AREA)
- Computer Networks & Wireless Communication (AREA)
- Signal Processing (AREA)
- Automation & Control Theory (AREA)
- Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
- Data Exchanges In Wide-Area Networks (AREA)
Abstract
本发明涉及集群部署技术领域，提供一种大规模存储集群部署分组方法和装置，用于解决大规模集群部署效率低下和用户体验差的问题，本发明的大规模存储集群部署分组方法，包括：解析用户所选择的管理节点和存储节点信息，初始化一个分组序列，将管理节点加入分组序列的队首，按IP顺序将存储节点依次加入至所述分组序列；设定分组节点上限值，比较分组序列中剩余待分组节点的数量与分组节点上限值，根据比较结果对分组序列中剩余待分组节点进行分组，将各分组中的节点加入统一管理服务；更新分布式配置文件中的分组信。本发明可以提升集群部署效率，保证各分组在故障场景下能够对外提供服务，提升运维效率。
The present invention relates to the technical field of cluster deployment, and provides a large-scale storage cluster deployment grouping method and device, which are used to solve the problems of low efficiency of large-scale cluster deployment and poor user experience. The large-scale storage cluster deployment grouping method of the present invention includes: parsing the management node and storage node information selected by the user, initializing a grouping sequence, adding the management node to the head of the grouping sequence, and adding the storage nodes to the grouping sequence in sequence according to the IP order; setting the grouping node upper limit value, comparing the number of remaining nodes to be grouped in the grouping sequence with the grouping node upper limit value, grouping the remaining nodes to be grouped in the grouping sequence according to the comparison result, adding the nodes in each group to the unified management service; updating the group information in the distributed configuration file. The present invention can improve the cluster deployment efficiency, ensure that each group can provide services to the outside in a fault scenario, and improve the operation and maintenance efficiency.
Description
Technical Field
The invention relates to the technical field of cluster deployment, in particular to a method and a device for deploying and grouping large-scale storage clusters.
Background
In a storage cluster, nodes are divided into management nodes and storage nodes according to node purposes. The management node bears the management and control task of the whole cluster, and needs to acquire the states of each hard disk pool, each node and each disk in the cluster in real time, sense the overall operation situation of the cluster and perform corresponding processing. As the scale of the storage cluster is larger and larger, the network pressure and the service pressure of the management and control node are greatly increased, and the response speed is greatly influenced, so that the system becomes a bottleneck in a large-scale scene.
Aiming at a large-scale deployment scene of the storage cluster, in order to lighten the pressure of the management nodes, the whole cluster can be divided into a plurality of sub-clusters to be managed by adopting a multi-sub-cluster mode, each sub-cluster is provided with a plurality of sub-management nodes respectively and is responsible for the management and control tasks of the sub-clusters, and the pressure of the main management nodes is further shared to the sub-management nodes on each sub-cluster, so that the pressure of the main management nodes is lightened. The method has the advantages that the whole cluster is divided into a plurality of sub-clusters to be managed by adopting a multi-sub-cluster mode, the problem of single node performance under a large-scale scene can be solved, but in practical application, the method has the following defects that 1, the creation of the sub-clusters needs user intervention, each sub-cluster needs a user to plan the nodes contained in the sub-clusters, the deployment efficiency is low under the large-scale scene, 2, the high reliability of the sub-management nodes under the fault scene needs to be ensured by introducing an additional high-availability mechanism, for example, the mode of virtual IP (Internet protocol) is adopted, the complexity of cluster operation and deployment configuration is obviously increased by the user allocation, 3, the sub-management nodes need to perform node role migration when the sub-management nodes bear the management task of the sub-clusters, the capacity shrinking process under the scene is complex, and the user intervention is required to specify a new sub-management node, and the user experience is influenced.
Therefore, how to provide a method for improving deployment efficiency and user experience of a large-scale storage cluster becomes a technical problem to be solved.
Disclosure of Invention
In view of this, the invention mainly solves the problems of low deployment efficiency and poor user experience of large-scale clusters, and provides an automatic grouping method of large-scale storage clusters, which releases users from heavy deployment flows.
In one aspect, the present invention provides a method for deploying and grouping a large-scale storage cluster, including:
analyzing the information of the management node and the storage node selected by a user, initializing a grouping sequence, adding the management node into the queue head of the grouping sequence, and sequentially adding the storage node into the grouping sequence according to the IP sequence;
Setting an upper limit value of a grouping node, comparing the number of the remaining nodes to be grouped in the grouping sequence with the upper limit value of the grouping node, grouping the remaining nodes to be grouped in the grouping sequence according to a comparison result, and adding the nodes in each grouping into a unified management service;
the grouping information in the distributed configuration file is updated.
Further, the method for deploying and grouping the large-scale storage clusters of the invention groups the rest nodes to be grouped in the grouping sequence according to the comparison result, and comprises the following steps:
if the number of the remaining nodes to be grouped in the grouping sequence is not less than the upper limit value of the grouping nodes, sequentially selecting the nodes in the grouping sequence according to the upper limit value of the grouping nodes to form a new group, adding one to the number of the group, adding all the nodes in the new group to unified management service, continuously comparing the number of the remaining nodes to be grouped in the grouping sequence with the upper limit value of the grouping nodes, and grouping the remaining nodes to be grouped in the grouping sequence according to the comparison result;
If the number of the remaining nodes to be grouped in the grouping sequence is smaller than the upper limit value, forming a new group by the remaining nodes to be grouped in the grouping sequence, adding one to the number of the group, and adding all the nodes in the new group into unified management service.
Further, the method for deploying the grouping of the large-scale storage clusters comprises the steps that when the management node needs to acquire data of each node, the management node establishes communication with the unified management service and sends request data to the unified management service, the unified management service routes the request data to a certain storage node of the grouping, and the storage node collects information of all nodes of the grouping.
Further, the method for deploying the grouping of the large-scale storage clusters comprises the steps of adding the nodes in each grouping into the unified management service, and when the management node needs each node to execute the service, establishing communication with the unified management service and sending request data to the unified management service, wherein the unified management service routes the request data to a certain storage node of the grouping, and the storage node distributes configuration instructions.
Furthermore, the method for deploying the grouping of the large-scale storage clusters comprises the steps that when a certain node is abnormal, the unified management service automatically discovers the abnormality and removes the node from a unified management service list, and request data cannot be routed to the fault node.
On the other hand, the invention also provides a large-scale storage cluster deployment grouping device, which comprises:
The system comprises a packet sequence construction module, a packet sequence analysis module and a storage module, wherein the packet sequence construction module is used for analyzing the information of a management node and a storage node selected by a user, initializing a packet sequence, adding the management node into the queue head of the packet sequence, and sequentially adding the storage node into the packet sequence according to an IP sequence;
The grouping module is used for setting an upper limit value of the grouping nodes, comparing the number of the remaining nodes to be grouped in the grouping sequence with the upper limit value of the grouping nodes, grouping the remaining nodes to be grouped in the grouping sequence according to a comparison result, and adding the nodes in each grouping into the unified management service module;
The unified management service module is used for establishing communication with the management node, receiving request data sent by the management node, routing the request data to a certain storage node of the packet, and collecting information of all nodes of the packet or distributing configuration instructions through the storage node;
and the updating module is used for updating the grouping information in the distributed configuration file.
Further, the invention relates to a grouping module in a large-scale storage cluster deployment grouping device, which is specifically used for:
Setting an upper limit value of a grouping node, comparing the number of the remaining nodes to be grouped in the grouping sequence with the upper limit value of the grouping node, if the number of the remaining nodes to be grouped in the grouping sequence is not smaller than the upper limit value of the grouping node, sequentially selecting the nodes in the grouping sequence according to the upper limit value of the grouping node to form a new group, adding one to the number of the group, adding all the nodes in the new group into a unified management service module, continuously comparing the number of the remaining nodes to be grouped in the grouping sequence with the upper limit value of the grouping node, and grouping the remaining nodes to be grouped in the grouping sequence according to a comparison result;
If the number of the remaining nodes to be grouped in the grouping sequence is smaller than the upper limit value, forming a new group by the remaining nodes to be grouped in the grouping sequence, adding one to the number of the group, and adding all the nodes in the new group into the unified management service module.
Further, the large-scale storage cluster deployment grouping device of the invention establishes communication with the unified management service module and sends request data to the unified management service module when the management node needs to acquire the data of each node, the unified management service module routes the request data to a certain storage node of the group, and the storage node collects the information of all nodes of the group.
Further, the large-scale storage cluster deployment grouping device of the invention establishes communication with the unified management service module and sends request data to the unified management service module when the management node needs each node to execute service, and the unified management service module routes the request data to a certain storage node of the grouping, and the storage node distributes configuration instructions.
Furthermore, according to the large-scale storage cluster deployment grouping device, when a certain node is abnormal, the unified management service module automatically discovers the abnormality and removes the node from the unified management service list, and request data cannot be routed to the fault node.
The method and the device for deploying and grouping the large-scale storage clusters have the following beneficial effects:
1. by the automatic grouping strategy, the user is prevented from dividing and configuring the clusters, so that the operation of the user under the large-scale clusters is simpler, and the deployment efficiency is improved.
2. Through the management and control strategy of the management service, the fact that each group can provide service outwards under the fault scene is guaranteed, the management and control strategy is configured without user intervention, operation is more convenient, and meanwhile operation and maintenance efficiency is improved.
Drawings
In order to more clearly illustrate the technical solutions of the embodiments of the present invention, the drawings that are needed in the embodiments will be briefly described below, and it is obvious that the drawings in the following description are only some embodiments of the present invention, and that other drawings can be obtained according to these drawings without inventive effort for a person skilled in the art.
FIG. 1 is a schematic diagram of a mass storage cluster according to the present invention.
Fig. 2 is a flowchart of a method for deploying mass storage cluster grouping according to an exemplary first embodiment of the invention.
FIG. 3 is a block diagram of a mass storage cluster deployment grouping apparatus according to a third exemplary embodiment of the present invention
Detailed Description
Embodiments of the present invention will be described in detail below with reference to the accompanying drawings.
It is noted that the following embodiments and features of the embodiments may be combined with each other without conflict, and that all other embodiments obtained by persons of ordinary skill in the art without creative efforts based on the embodiments in the present disclosure are within the scope of protection of the present disclosure.
It is noted that various aspects of the embodiments are described below within the scope of the following claims. It should be apparent that the aspects described herein may be embodied in a wide variety of forms and that any specific structure and/or function described herein is merely illustrative. Based on the present disclosure, one skilled in the art will appreciate that one aspect described herein may be implemented independently of any other aspect, and that two or more of these aspects may be combined in various ways. For example, an apparatus may be implemented and/or a method practiced using any number of the aspects set forth herein. In addition, such apparatus may be implemented and/or such methods practiced using other structure and/or functionality in addition to one or more of the aspects set forth herein.
The technical principle of the invention is as follows:
As shown in fig. 1, the large-scale cluster is composed of a management node group and storage nodes, and the management node group is configured into a master-slave mode. The invention automatically groups the large-scale clusters, wherein the main group comprises a management node group and unified management and control service formed by all storage nodes, and the auxiliary group comprises the unified management and control service formed by all storage nodes of the main group. The management node group only carries out communication and business interaction with the unified management service of each group, the whole pressure is greatly reduced, and the original requirement of reducing the pressure of the management node can be met.
The invention solves the problem of low deployment efficiency caused by the need of user intervention for cluster division and repeated subset group deployment. The user needs to conduct sub-cluster planning on the page by the aid of a common strategy, select nodes to join different sub-clusters, and configure sub-management nodes of the sub-clusters, so that complexity of configuration flow is brought, deployment time is increased, and user experience is affected. In order to solve the problem, the invention divides the whole cluster into a plurality of groups according to the number of the cluster nodes and the setting of the group upper limit value, the number of the nodes in each group is not more than the set group upper limit value, and the rest nodes after grouping are automatically grouped into a group.
The invention adds the nodes in each group into the unified management and control service to perform unified management, when the management node needs to acquire the data of each node or needs each node to execute service, the management node only needs to communicate with the unified management service, the unified management service routes the request data to a certain storage node of the group, and the storage node is responsible for collecting the information or distributing configuration instructions of all the nodes of the group. In this way, each group does not need to introduce an extra high availability mechanism, when a certain node is abnormal, the unified management service automatically discovers the abnormality, removes the node from the unified management service list, and the request data will not be routed to the fault node.
Aiming at a large-scale scene, the node joining cluster needs to specify the joining sub-cluster, so that a user is required to plan, and the configuration is complex. In the capacity-shrinking scene, if the management node of the sub-cluster is deleted, another node is added as a new management node to ensure high availability, thereby bringing complexity of operation and maintenance. In the invention, as all the nodes added into the unified management service are indiscriminate, the nodes are deleted only by removing the nodes from the unified management service, and the method is simple and efficient.
Fig. 2 is a flowchart of a method for deploying a mass storage cluster grouping according to an exemplary first embodiment of the invention, as shown in fig. 2, the method of the present embodiment comprises:
analyzing the information of the management node and the storage node selected by a user, initializing a grouping sequence, adding the management node into the queue head of the grouping sequence, and sequentially adding the storage node into the grouping sequence according to the IP sequence;
Setting an upper limit value of a grouping node, comparing the number of the remaining nodes to be grouped in the grouping sequence with the upper limit value of the grouping node, grouping the remaining nodes to be grouped in the grouping sequence according to a comparison result, and adding the nodes in each grouping into a unified management service;
the grouping information in the distributed configuration file is updated.
In the method of the embodiment, grouping the remaining nodes to be grouped in the grouping sequence according to the comparison result includes:
if the number of the remaining nodes to be grouped in the grouping sequence is not less than the upper limit value of the grouping nodes, sequentially selecting the nodes in the grouping sequence according to the upper limit value of the grouping nodes to form a new group, adding one to the number of the group, adding all the nodes in the new group to unified management service, continuously comparing the number of the remaining nodes to be grouped in the grouping sequence with the upper limit value of the grouping nodes, and grouping the remaining nodes to be grouped in the grouping sequence according to the comparison result;
If the number of the remaining nodes to be grouped in the grouping sequence is smaller than the upper limit value, forming a new group by the remaining nodes to be grouped in the grouping sequence, adding one to the number of the group, and adding all the nodes in the new group into unified management service.
An exemplary second embodiment of the present invention provides a method for deploying a large-scale storage cluster into a group, where the method in the embodiment is a preferred embodiment of the method shown in fig. 2, and includes:
when the management node needs to acquire the data of each node, establishing communication with the unified management service and sending request data to the unified management service, wherein the unified management service routes the request data to a certain storage node of the group, and the storage node collects the information of all the nodes of the group;
When the management node needs each node to execute the service, the unified management service routes the request data to a certain storage node of the packet by establishing communication with the unified management service and sending the request data to the unified management service, and the storage node distributes the configuration instruction;
When a node is abnormal, the unified management service automatically discovers the abnormality, removes the node from the unified management service list, and requests data are not routed to the failed node.
Fig. 3 is a schematic diagram of a mass storage cluster deployment packet device according to a third exemplary embodiment of the present invention, and as shown in fig. 3, the device of this embodiment includes:
The system comprises a packet sequence construction module, a packet sequence analysis module and a storage module, wherein the packet sequence construction module is used for analyzing the information of a management node and a storage node selected by a user, initializing a packet sequence, adding the management node into the queue head of the packet sequence, and sequentially adding the storage node into the packet sequence according to an IP sequence;
The grouping module is used for setting an upper limit value of the grouping nodes, comparing the number of the remaining nodes to be grouped in the grouping sequence with the upper limit value of the grouping nodes, grouping the remaining nodes to be grouped in the grouping sequence according to a comparison result, and adding the nodes in each grouping into the unified management service module;
The unified management service module is used for establishing communication with the management node, receiving request data sent by the management node, routing the request data to a certain storage node of the packet, and collecting information of all nodes of the packet or distributing configuration instructions through the storage node;
and the updating module is used for updating the grouping information in the distributed configuration file.
In practical application, the grouping module of the device of this embodiment is specifically configured to:
Setting an upper limit value of a grouping node, comparing the number of the remaining nodes to be grouped in the grouping sequence with the upper limit value of the grouping node, if the number of the remaining nodes to be grouped in the grouping sequence is not smaller than the upper limit value of the grouping node, sequentially selecting the nodes in the grouping sequence according to the upper limit value of the grouping node to form a new group, adding one to the number of the group, adding all the nodes in the new group into a unified management service module, continuously comparing the number of the remaining nodes to be grouped in the grouping sequence with the upper limit value of the grouping node, and grouping the remaining nodes to be grouped in the grouping sequence according to a comparison result;
If the number of the remaining nodes to be grouped in the grouping sequence is smaller than the upper limit value, forming a new group by the remaining nodes to be grouped in the grouping sequence, adding one to the number of the group, and adding all the nodes in the new group into the unified management service module.
When the management node needs to acquire the data of each node, the unified management service module routes the request data to a certain storage node of the packet by establishing communication with the unified management service module and sending the request data to the unified management service module, and the storage node collects the information of all the nodes of the packet.
When the management node needs each node to execute the service, the unified management service module routes the request data to a certain storage node of the packet by establishing communication with the unified management service module and sending the request data to the unified management service module, and the storage node distributes the configuration instruction.
When a node is abnormal, the unified management service module automatically discovers the abnormality and removes the node from the unified management service list, so that the request data cannot be routed to the fault node.
The foregoing is merely illustrative of the present invention, and the present invention is not limited thereto, and any changes or substitutions easily contemplated by those skilled in the art within the scope of the present invention should be included in the present invention. Therefore, the protection scope of the invention is subject to the protection scope of the claims.
Claims (10)
1. A method for mass storage cluster deployment grouping, the method comprising:
analyzing the information of the management node and the storage node selected by a user, initializing a grouping sequence, adding the management node into the queue head of the grouping sequence, and sequentially adding the storage node into the grouping sequence according to the IP sequence;
setting an upper limit value of a grouping node, comparing the number of the remaining nodes to be grouped in the grouping sequence with the upper limit value of the grouping node, grouping the remaining nodes to be grouped in the grouping sequence according to a comparison result, wherein a main group comprises a unified management service consisting of a management node group and all storage nodes, and a slave group comprises the unified management service consisting of all the storage nodes of the group;
The unified management service is used for establishing communication with the management node, receiving request data sent by the management node, routing the request data to a certain storage node of the packet, and collecting information of all nodes of the packet or distributing configuration instructions through the storage node;
the grouping information in the distributed configuration file is updated.
2. The method for deploying and grouping large-scale storage clusters according to claim 1, wherein grouping remaining nodes to be grouped in the grouping sequence according to the comparison result comprises:
if the number of the remaining nodes to be grouped in the grouping sequence is not less than the upper limit value of the grouping nodes, sequentially selecting the nodes in the grouping sequence according to the upper limit value of the grouping nodes to form a new group, adding one to the number of the group, adding all the nodes in the new group to unified management service, continuously comparing the number of the remaining nodes to be grouped in the grouping sequence with the upper limit value of the grouping nodes, and grouping the remaining nodes to be grouped in the grouping sequence according to the comparison result;
If the number of the remaining nodes to be grouped in the grouping sequence is smaller than the upper limit value, forming a new group by the remaining nodes to be grouped in the grouping sequence, adding one to the number of the group, and adding all the nodes in the new group into unified management service.
3. The method of claim 1, wherein adding nodes in each group to a unified management service includes, when a management node needs to obtain data of each node, establishing communication with the unified management service and sending request data to the unified management service, the unified management service routing the request data to a storage node of the group, and collecting information of all nodes of the group by the storage node.
4. The method for deploying a group of mass storage clusters according to claim 1 wherein the nodes in each group are added to a unified management service, further comprising when the management node needs each node to perform a service, the unified management service routing the requested data to a storage node of the group by establishing communication with the unified management service and sending the requested data to the unified management service, and distributing configuration instructions by the storage node.
5. The method of claim 1, wherein adding nodes in each group to the unified management service further comprises automatically discovering an exception by the unified management service when the exception occurs in a node, and removing the node from the unified management service list, wherein the request data is not routed to the failed node.
6. A mass storage cluster deployment grouping apparatus, the mass storage cluster grouping apparatus comprising:
The system comprises a packet sequence construction module, a packet sequence analysis module and a storage module, wherein the packet sequence construction module is used for analyzing the information of a management node and a storage node selected by a user, initializing a packet sequence, adding the management node into the queue head of the packet sequence, and sequentially adding the storage node into the packet sequence according to an IP sequence;
The grouping module is used for setting an upper limit value of the grouping nodes, comparing the number of the remaining nodes to be grouped in the grouping sequence with the upper limit value of the grouping nodes, grouping the remaining nodes to be grouped in the grouping sequence according to a comparison result, wherein a main group comprises a unified management service consisting of a management node group and all storage nodes, and a slave group comprises the unified management service consisting of all the storage nodes of the group;
The unified management service module is used for establishing communication with the management node, receiving request data sent by the management node, routing the request data to a certain storage node of the packet, and collecting information of all nodes of the packet or distributing configuration instructions through the storage node;
and the updating module is used for updating the grouping information in the distributed configuration file.
7. The mass storage cluster deployment grouping apparatus of claim 6, wherein the grouping module is specifically configured to:
Setting an upper limit value of a grouping node, comparing the number of the remaining nodes to be grouped in the grouping sequence with the upper limit value of the grouping node, if the number of the remaining nodes to be grouped in the grouping sequence is not smaller than the upper limit value of the grouping node, sequentially selecting the nodes in the grouping sequence according to the upper limit value of the grouping node to form a new group, adding one to the number of the group, adding all the nodes in the new group into a unified management service module, continuously comparing the number of the remaining nodes to be grouped in the grouping sequence with the upper limit value of the grouping node, and grouping the remaining nodes to be grouped in the grouping sequence according to a comparison result;
If the number of the remaining nodes to be grouped in the grouping sequence is smaller than the upper limit value, forming a new group by the remaining nodes to be grouped in the grouping sequence, adding one to the number of the group, and adding all the nodes in the new group into the unified management service module.
8. The mass storage cluster deployment grouping apparatus of claim 6 wherein when a management node needs to obtain data for each node, the unified management service module routes the requested data to a storage node of the group by establishing communication with the unified management service module and sending the requested data to the unified management service module, which gathers information for all nodes of the group.
9. The mass storage cluster deployment package of claim 6 wherein when a management node requires each node to perform a service, the unified management service module routes the requested data to a storage node of the package by establishing communication with the unified management service module and sending the requested data to the unified management service module, which distributes the configuration instructions by the storage node.
10. The mass storage cluster deployment grouping apparatus of claim 6 wherein when an anomaly occurs in a node, the unified management service module automatically discovers the anomaly and removes the node from the unified management service list, and request data will not be routed to the failed node.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211355996.9A CN116055307B (en) | 2022-11-01 | 2022-11-01 | Large-scale storage cluster deployment grouping method and device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211355996.9A CN116055307B (en) | 2022-11-01 | 2022-11-01 | Large-scale storage cluster deployment grouping method and device |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN116055307A CN116055307A (en) | 2023-05-02 |
| CN116055307B true CN116055307B (en) | 2024-12-03 |
Family
ID=86112139
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211355996.9A Active CN116055307B (en) | 2022-11-01 | 2022-11-01 | Large-scale storage cluster deployment grouping method and device |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116055307B (en) |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN118175182A (en) * | 2024-03-07 | 2024-06-11 | 广州芯德通信科技股份有限公司 | An intelligent method and system for managing terminal device connections based on intermediary services |
Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112751926A (en) * | 2020-12-29 | 2021-05-04 | 北京浪潮数据技术有限公司 | Method, system and related device for managing working nodes in cluster |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113852473A (en) * | 2021-08-20 | 2021-12-28 | 济南浪潮数据技术有限公司 | A cluster deployment method, device and storage medium |
| CN113868335A (en) * | 2021-09-15 | 2021-12-31 | 威讯柏睿数据科技(北京)有限公司 | Method and equipment for expanding distributed clusters of memory database |
-
2022
- 2022-11-01 CN CN202211355996.9A patent/CN116055307B/en active Active
Patent Citations (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112751926A (en) * | 2020-12-29 | 2021-05-04 | 北京浪潮数据技术有限公司 | Method, system and related device for managing working nodes in cluster |
Also Published As
| Publication number | Publication date |
|---|---|
| CN116055307A (en) | 2023-05-02 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Oktian et al. | Distributed SDN controller system: A survey on design choice | |
| CN104734878B (en) | The method and system of software definition networking disaster recovery | |
| KR101159377B1 (en) | High performance computing system and method | |
| US10050862B2 (en) | Distributed application framework that uses network and application awareness for placing data | |
| Das et al. | FT-SDN: a fault-tolerant distributed architecture for software defined network | |
| JP6835444B2 (en) | Software-defined data center and service cluster scheduling method and traffic monitoring method for that purpose | |
| WO2022252496A1 (en) | Software-defined cloud-side collaborative network energy consumption optimisation method and system | |
| US9288555B2 (en) | Data center network architecture | |
| CN1321373C (en) | Extensible computing system | |
| CN104025513B (en) | Apparatus and method for the control level in data center network | |
| CN111165019B (en) | Controller in access network | |
| CN112882790A (en) | Cloud edge cooperative management method based on distributed cloud platform | |
| KR20140066781A (en) | Chassis controllers for converting universal flows | |
| KR20070006906A (en) | System and Method for Topology-Aware Task Scheduling and Backfilling in HPC Environment | |
| Duan et al. | Cost efficient and performance guaranteed virtual network embedding in multicast fat-tree DCNs | |
| Xie et al. | Validation of distributed SDN control plane under uncertain failures | |
| CN110971872B (en) | Video image information acquisition method based on distributed cluster | |
| CN113709220A (en) | High-availability realization method and system of virtual load balancer and electronic equipment | |
| Aly | Generic controller adaptive load balancing (GCALB) for SDN networks | |
| CN116055307B (en) | Large-scale storage cluster deployment grouping method and device | |
| JP7678892B2 (en) | Geographically Distributed Hybrid Cloud Clusters | |
| Chekired et al. | HybCon: A scalable SDN-based distributed cloud architecture for 5G networks | |
| CN111600953B (en) | Method for realizing distributed deployment based on honeypot system | |
| WO2022016969A1 (en) | Data processing method and device | |
| Ranchal et al. | RADical Strategies for engineering web-scale cloud solutions |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information |
Country or region after: China Address after: No. N3013, 3rd Floor, R&D Building N, Artificial Intelligence Science and Technology Park, Wuhan Economic and Technological Development Zone, Wuhan City, Hubei Province, 430058 Applicant after: Zhongdian Cloud Computing Technology Co.,Ltd. Address before: 430058 No. n3013, 3rd floor, R & D building, building n, Artificial Intelligence Science Park, economic and Technological Development Zone, Caidian District, Wuhan City, Hubei Province Applicant before: CLP cloud Digital Intelligence Technology Co.,Ltd. Country or region before: China |
|
| CB02 | Change of applicant information | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| PE01 | Entry into force of the registration of the contract for pledge of patent right |
Denomination of invention: A method and device for grouping large-scale storage cluster deployment Granted publication date: 20241203 Pledgee: China Construction Bank Corporation Wuhan Economic and Technological Development Zone Branch Pledgor: Zhongdian Cloud Computing Technology Co.,Ltd. Registration number: Y2025980024887 |
|
| PE01 | Entry into force of the registration of the contract for pledge of patent right |