[go: up one dir, main page]

CN116775278A - Cloud disk data processing method and device and cloud disk data processing system - Google Patents

Cloud disk data processing method and device and cloud disk data processing system Download PDF

Info

Publication number
CN116775278A
CN116775278A CN202310591678.0A CN202310591678A CN116775278A CN 116775278 A CN116775278 A CN 116775278A CN 202310591678 A CN202310591678 A CN 202310591678A CN 116775278 A CN116775278 A CN 116775278A
Authority
CN
China
Prior art keywords
target data
storage node
data processing
requirement
load
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202310591678.0A
Other languages
Chinese (zh)
Inventor
廖武钧
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Alibaba China Co Ltd
Original Assignee
Alibaba China Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Alibaba China Co Ltd filed Critical Alibaba China Co Ltd
Priority to CN202310591678.0A priority Critical patent/CN116775278A/en
Publication of CN116775278A publication Critical patent/CN116775278A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F9/00Arrangements for program control, e.g. control units
    • G06F9/06Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
    • G06F9/46Multiprogramming arrangements
    • G06F9/50Allocation of resources, e.g. of the central processing unit [CPU]
    • G06F9/5083Techniques for rebalancing the load in a distributed system
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F21/00Security arrangements for protecting computers, components thereof, programs or data against unauthorised activity
    • G06F21/60Protecting data
    • G06F21/602Providing cryptographic facilities or services
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0602Interfaces specially adapted for storage systems specifically adapted to achieve a particular effect
    • G06F3/0614Improving the reliability of storage systems
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0628Interfaces specially adapted for storage systems making use of a particular technique
    • G06F3/0629Configuration or reconfiguration of storage systems
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F3/00Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
    • G06F3/06Digital input from, or digital output to, record carriers, e.g. RAID, emulated record carriers or networked record carriers
    • G06F3/0601Interfaces specially adapted for storage systems
    • G06F3/0668Interfaces specially adapted for storage systems adopting a particular infrastructure
    • G06F3/067Distributed or networked storage systems, e.g. storage area networks [SAN], network attached storage [NAS]

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Human Computer Interaction (AREA)
  • Software Systems (AREA)
  • Health & Medical Sciences (AREA)
  • Bioethics (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Hardware Design (AREA)
  • Computer Security & Cryptography (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)
  • Storage Device Security (AREA)

Abstract

The embodiment of the specification provides a cloud disk data processing method and device and a cloud disk data processing system, wherein the cloud disk data processing method comprises the following steps: determining a first storage node corresponding to a target data processing requirement, wherein the first storage node is a storage node in a cloud disk for storing data corresponding to the target data processing requirement; selecting a second storage node with load meeting the target data processing requirement from a plurality of storage nodes of the cloud disk under the condition that the load of the first storage node does not meet the target data processing requirement; and sending the target data processing requirement to the second storage node. And judging whether each storage node meets the target data processing requirement or not through the load of each storage node, further determining whether a second storage node with the load meeting the target data processing requirement is needed, and processing target data by the second storage node based on the target data processing requirement to realize load sharing of the first storage node.

Description

Cloud disk data processing method and device and cloud disk data processing system
Technical Field
The embodiment of the specification relates to the technical field of computers, in particular to a cloud disk data processing method.
Background
In practical application, users often store data through a storage system, and in order to ensure the security of the stored data, some processes are performed on the data in the storage system. Such as encryption when writing data and decryption when reading data.
The data processing process is often accompanied by a data storage or data reading process, and the data processing operation outside the data storage and the data reading process requires a larger computational power requirement on the server, with the same data amount, and the computational power of the data processing operation outside the data storage and the data reading process may be three to five times that of the processing data storage or the data reading process, so that the computational power load of the data processing operation outside the data storage and the data reading process on the server is several times that of the processing power load of the processing operation outside the data storage and the data reading process on the ordinary data storage or the data reading process, and thus the load of the server may be overhigh.
Therefore, a method is needed to solve the above technical problems.
Disclosure of Invention
In view of this, the embodiments of the present disclosure provide a cloud disk data processing method. One or more embodiments of the present specification relate to a cloud disk data processing apparatus, a cloud disk data processing system, a computing device, a computer readable storage medium, and a computer program, which solve the technical drawbacks existing in the prior art.
According to a first aspect of embodiments of the present disclosure, there is provided a cloud disk data processing method, including: determining a first storage node corresponding to a target data processing requirement, wherein the first storage node is a storage node in a cloud disk for storing data corresponding to the target data processing requirement; selecting a second storage node with load meeting the target data processing requirement from a plurality of storage nodes of the cloud disk under the condition that the load of the first storage node does not meet the target data processing requirement; and sending the target data processing requirement to the second storage node.
According to a second aspect of embodiments of the present specification, there is provided a cloud disk data processing apparatus, including: the determining module is configured to determine a first storage node corresponding to a target data processing requirement, wherein the first storage node is a storage node in a cloud disk for storing data corresponding to the target data processing requirement; the selecting module is configured to select a second storage node with load meeting the target data processing requirement from a plurality of storage nodes of the cloud disk under the condition that the load of the first storage node does not meet the target data processing requirement; and a sending module configured to send the target data processing requirement to the second storage node.
According to a third aspect of embodiments of the present disclosure, there is provided a cloud disk data processing method, including: receiving a target data processing requirement sent by a computing node, wherein the target data processing requirement is sent to a second storage node after the computing node selects the second storage node with load meeting the target data processing requirement from a plurality of storage nodes of a cloud disk; processing the target data based on the target data processing requirement; and sending the processing result of the target data to the computing node.
According to a fourth aspect of embodiments of the present specification, there is provided a cloud disk data processing apparatus, including: the receiving module is configured to receive target data processing requirements sent by a computing node, wherein the target data processing requirements are sent to a second storage node after the computing node selects the second storage node with load meeting the target data processing requirements from a plurality of storage nodes of a cloud disk; a processing module configured to process target data based on the target data processing requirements; and the result sending module is configured to send the processing result of the target data to the computing node.
According to a fifth aspect of embodiments of the present disclosure, there is provided a cloud disk data processing system, including a computing node to which the above-described cloud disk data processing method is applied, and a plurality of storage nodes to which the above-described cloud disk data processing method is applied.
According to a sixth aspect of embodiments of the present specification, there is provided a computing device comprising: a memory and a processor; the memory is configured to store computer executable instructions, and the processor is configured to execute the computer executable instructions, where the computer executable instructions when executed by the processor implement the steps of the cloud disk data processing method described above.
According to a seventh aspect of embodiments of the present specification, there is provided a computer-readable storage medium storing computer-executable instructions which, when executed by a processor, implement the steps of the cloud disk data processing method described above.
According to an eighth aspect of embodiments of the present specification, there is provided a computer program, wherein the computer program, when executed in a computer, causes the computer to perform the steps of the cloud disk data processing method described above.
According to the embodiment of the specification, whether each storage node meets the target data processing requirement is judged according to the load of each storage node in the cloud disk, so that whether a second storage node with the load meeting the target data processing requirement is needed to be selected from a plurality of storage nodes of the cloud disk is further determined, the second storage node processes target data based on the target data processing requirement, load sharing of the first storage node is achieved, and the operation efficiency of the first storage node is improved.
Drawings
Fig. 1 is an application scenario schematic diagram of a cloud disk data processing method according to an embodiment of the present disclosure;
fig. 2 is a flowchart of a cloud disk data processing method according to an embodiment of the present disclosure;
FIG. 3 is a schematic flow interaction diagram of a target data read request according to one embodiment of the present disclosure;
FIG. 4 is a schematic flow interaction diagram of a target data write request provided by one embodiment of the present disclosure;
FIG. 5 is a flowchart of a processing procedure of a cloud disk data processing method according to an embodiment of the present disclosure;
FIG. 6 is a flowchart of a processing procedure of another cloud disk data processing method according to an embodiment of the present disclosure;
fig. 7 is a schematic structural diagram of a cloud disk data processing apparatus according to an embodiment of the present disclosure;
FIG. 8 is a flowchart of another method for processing cloud disk data according to an embodiment of the present disclosure;
fig. 9 is a schematic structural diagram of another cloud disk data processing apparatus according to an embodiment of the present disclosure;
FIG. 10 is a block diagram of a cloud disk data processing system according to one embodiment of the present disclosure;
FIG. 11 is a block diagram of a computing device provided in one embodiment of the present description.
Detailed Description
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present description. This description may be embodied in many other forms than described herein and similarly generalized by those skilled in the art to whom this disclosure pertains without departing from the spirit of the disclosure and, therefore, this disclosure is not limited by the specific implementations disclosed below.
The terminology used in the one or more embodiments of the specification is for the purpose of describing particular embodiments only and is not intended to be limiting of the one or more embodiments of the specification. As used in this specification, one or more embodiments and the appended claims, the singular forms "a," "an," and "the" are intended to include the plural forms as well, unless the context clearly indicates otherwise. It should also be understood that the term "and/or" as used in one or more embodiments of the present specification refers to and encompasses any or all possible combinations of one or more of the associated listed items.
It should be understood that, although the terms first, second, etc. may be used in one or more embodiments of this specification to describe various information, these information should not be limited by these terms. These terms are only used to distinguish one type of information from another. For example, a first may also be referred to as a second, and similarly, a second may also be referred to as a first, without departing from the scope of one or more embodiments of the present description. The word "if" as used herein may be interpreted as "at … …" or "at … …" or "responsive to a determination", depending on the context.
Furthermore, it should be noted that, user information (including, but not limited to, user equipment information, user personal information, etc.) and data (including, but not limited to, data for analysis, stored data, presented data, etc.) according to one or more embodiments of the present disclosure are information and data authorized by a user or sufficiently authorized by each party, and the collection, use, and processing of relevant data is required to comply with relevant laws and regulations and standards of relevant countries and regions, and is provided with corresponding operation entries for the user to select authorization or denial.
First, terms related to one or more embodiments of the present specification will be explained.
Cloud server: and the server is provided by a cloud host manufacturer and is produced based on a cloud computing technology, so that a user can operate and manage in a remote login mode. The use mode of the system is the same as that of a common remote physical server.
Cloud disk: cloud disk instances built on top of the distributed storage system. The cloud server can be used as a computer disk for reading and writing.
Encryption cloud disk: and encrypting the data and storing the data in the cloud disk. A user reads and writes a cloud disk in the system, encrypts and decrypts a read-write request by using a secret key in a storage system, the encrypted data is really stored in a physical disk, and the decrypted plaintext data is read by the user.
With the rapid development of science and technology, in practical application, a large amount of data is generated in various application fields, some data are useless data, data cleaning is needed after generation, some data are available data, and the data are needed to be stored after generation so as to realize the utilization of the data in the future. In practice, in order to ensure the security of data storage and data reading, users often encrypt and decrypt the data through encryption and decryption means, so as to prevent data leakage in the process of data storage or data reading.
In practical applications, when a user stores or reads and writes data to be encrypted, the data is often stored through the encrypted cloud disk, and after the data is stored, the data is read from the encrypted cloud disk. The resource calculation force required by the encryption and decryption process is several times of that of the common read-write process, so that the load of a storage node for storing data is overhigh due to encryption and decryption storage.
In this specification, a cloud disk data processing method is provided, and one or more embodiments of the present specification relate to a cloud disk data processing apparatus, a cloud disk data processing system, a computing device, and a computer readable storage medium, which are described in detail in the following embodiments.
Referring to fig. 1, fig. 1 shows an application scenario schematic diagram of a cloud disk data processing method according to an embodiment of the present disclosure. In fig. 1, when a user needs to perform data processing, a corresponding target data processing request can be sent to a computing node through a client, and the computing node provides data processing service for the user. Taking a cloud storage application scenario as an example, in the cloud storage scenario, a user performs data storage by writing data into a cloud disk or performs data reading from the cloud disk.
The cloud disk is a virtual storage device at a data block level provided for the cloud, and the bottom layer of the cloud disk may be a physical block storage device such as a magnetic disk. Just like a disk, a user can partition, format, create a file system and the like on a cloud disk mounted on a cloud server, and perform persistent storage on the data. The cloud server may be a distributed server cluster including a plurality of servers, or may be a single server. The services provided by the cloud server may include: cloud services, cloud databases, cloud computing, cloud functions, cloud storage, web services, cloud communications, middleware services, domain name services, security services, content distribution networks (ContentDeliveryNetwork, CDN), basic cloud computing services such as big data and artificial intelligence platforms, and the like. And the computing node can be used for running the application and performing data computation. In practical application, the service provided by the computing node is presented to the user, namely, the result calculated by the computing node. For a storage system, a compute node may be considered a front-end application. For example, applications running on the compute node may include data reads, data encryption and decryption operations, and so on.
The client may be a browser, APP (Application), web Application, light Application (also called applet, a lightweight Application), cloud Application, or the like, and the client may be based on an SDK (software development kit) of a corresponding service provided by the service, such as WebRTC-based development acquisition, or the like. The client may be deployed in an electronic device, need to run depending on the device or some application in the device, etc. The electronic device may for example have a display screen and support information browsing etc. as may be a personal mobile terminal such as a mobile phone, tablet computer, personal computer etc.
As shown in fig. 1, after receiving the target data processing request, the computing node generates a target data processing requirement corresponding to the target data processing request, determines a first storage node for storing target data according to the target data processing requirement, determines a load of the first storage node, further determines a second storage node meeting the target data processing requirement in a plurality of storage nodes of the cloud disk under the condition that the load of the first storage node does not meet the target data processing requirement, and further, the computing node can send the target data processing requirement to the second storage node, so that the second storage node processes the target data according to the target data processing requirement, feeds back a processing result corresponding to the target data processing requirement to the computing node, and based on the processing result, the computing node can send the corresponding processing result to the client according to the target data processing requirement sent by the client.
A storage node is a storage device in a storage cluster that is used to store a block of data. For example, in practical applications, the storage node may be represented as a virtual logical device based on a physical hard disk, and may have a file system, and may perform data operations such as creation, deletion, modification, copying, and/or movement. The plurality of storage nodes in the present specification may form a storage cluster, which is represented as a storage system, such as a distributed storage system, that provides storage services using storage spaces of the plurality of storage nodes. The particular implementation of the storage clusters is not limited. For example, the storage cluster may provide an access interface and a management interface for a storage pool, and an application may access and utilize the hard disk of each storage node through the access interface, so as to fully play the performance and the hard disk utilization of the storage node. Data is stored and read from a plurality of storage nodes according to a certain rule so as to obtain higher concurrent access performance.
According to the cloud disk data processing method provided by the specification, whether the load of the first storage node meets the target data processing requirement is judged, and the target data processing requirement is sent to the second storage node for processing under the condition that the first storage node does not meet the target data processing requirement, so that the load pressure of the first storage node is reduced.
Referring to fig. 2, fig. 2 shows a flowchart of a cloud disk data processing method according to an embodiment of the present disclosure, which specifically includes the following steps.
Step 202: and determining a first storage node corresponding to the target data processing requirement, wherein the first storage node is a storage node in a cloud disk for storing data corresponding to the target data processing requirement.
In practical applications, whether data is read or written, a storage node corresponding to the data to be read or written needs to be determined first, and after the corresponding storage node is determined, a read operation or a write operation is performed based on the corresponding storage node, but in the process of performing the read operation and the write operation, other operations are often required to be performed, for example, the data to be read is encrypted data, and in the process of performing the read operation, the encrypted data needs to be read and then decrypted; for example, to provide security of data writing, the written data needs to be encrypted, and then the written data needs to be encrypted before being written, and then the writing operation is performed; for another example, after the data is written, in order to improve the storage security of the written data, the written data is often copied to realize data backup of the read-write data.
The operation performed in the process of performing the read operation or the write operation often requires higher operation resource calculation power than the operation resource calculation power of the common read operation or the write operation, so that the load of the storage node is too high, and the operation speed is reduced.
Based on this, in an embodiment provided in the present disclosure, a corresponding first storage node may be determined according to a target data processing requirement, and then, according to a load condition of the first storage node, the target data processing requirement is processed and distributed correspondingly, so as to reduce a load of the first storage node and improve an operation speed of the first storage node.
The target data processing requirement is a processing requirement for corresponding processing of target data, and the target data processing requirement can be an encryption requirement for encrypting the target data, a decryption requirement for decrypting the target data, a copying requirement for copying the target data, and the like.
The first storage node is a storage node used for storing target data in a plurality of storage nodes of the cloud disk; accordingly, the target data is determined data to be processed, for example, data of 100 th to 200 th bytes of the file a needs to be read, and data of 100 th to 200 th bytes of the file a is the target data.
The cloud disk data processing method is applied to the computing nodes. Specifically, after the target data processing requirement for the target data is obtained, a first storage node corresponding to the target data processing requirement can be determined among a plurality of storage nodes of the cloud disk according to the target data processing requirement.
For example, taking a cloud disk as an example for encrypting the cloud disk, after obtaining the decryption requirement for the file a, the storage node for storing the file a may be determined to be the storage node 1 according to the decryption requirement for the file a.
Further, in practical application, the storage space of each storage node in the cloud disk is limited, and then the same data may be stored in different storage nodes, so that the first storage node corresponding to the target data processing requirement can be determined through the offset address of the target data.
For example, the available storage space of each storage node in the cloud disk is 10GB, and the size of the file a is 20GB, so that the file a may be correspondingly stored on two storage nodes. Further, for example, it is required to read file data of 1000 th byte of the file a, where the file a is stored in the storage node 1 and the storage node 2, it may be determined that the storage node corresponding to the target data processing requirement is the storage node 1.
In order to detect the load condition of each storage node, after determining the first storage node corresponding to the target data processing requirement, the load of the first storage node may be determined, so as to determine whether the first storage node may execute the data processing task corresponding to the target data processing requirement.
In one embodiment provided in the present specification, the target data processing requirement includes a target data encryption requirement;
after determining the first storage node corresponding to the target data processing requirement, the method further comprises:
acquiring a load reported by the first storage node;
and determining whether the load of the first storage node meets the target data encryption requirement or not based on the load reported by the first storage node.
The target data encryption requirement refers to an encryption requirement for encrypting the target data.
Specifically, after determining the first storage node corresponding to the target data encryption requirement, the load reported by the first storage node may be obtained, and whether the load of the first storage node meets the target data encryption requirement is determined according to the load of the first storage node, that is, whether the first storage node may perform encryption processing on the target data based on the target data encryption request is determined according to the load of the first storage node.
For example, after determining that the storage node corresponding to the encryption requirement of the file a is the storage node 1, obtaining the CPU utilization of the storage node 1 reported by the storage node 1 as 80%, where the load of the storage node 1 is considered to be higher, the data processing task of continuing to encrypt the file a is not satisfied, that is, the storage node 1 does not satisfy the encryption requirement of the file a.
The load of the first storage node is obtained, and whether the first storage node can execute the subsequent data processing task aiming at the target data processing requirement or not is judged based on the load of the first storage node, so that the subsequent storage node which can execute the data processing task corresponding to the target data processing requirement is determined according to the load of the first storage node, and the load of the first storage node is not excessively high under the condition that the target data processing task corresponding to the target data processing requirement can not be interrupted.
Step 204: and under the condition that the load of the first storage node does not meet the target data processing requirement, selecting a second storage node with the load meeting the target data processing requirement from a plurality of storage nodes of the cloud disk.
In practical applications, a storage node may need to perform multiple processing tasks simultaneously, which may result in a higher load of the storage node, and if other tasks are performed again, the load of the storage node may be further increased, and the operation rate of the storage node may be reduced.
Based on the above, the load of the storage node can be determined to determine whether the load of the storage node meets the target data processing requirement, and if the load of the storage node is higher, other storage nodes can be selected to process the target data processing requirement.
For example, after receiving the target data writing request, the computing node writes the target data into the corresponding storage node based on the target data writing request, and further, in order to ensure the security of target data storage, the computing node needs to copy the target data to store the target data into the corresponding copy storage node, but if detecting that the load of the storage node is higher, the computing node may send the target data copy requirement to other storage nodes, and copy the target data by the other storage nodes and store the target data into the copy storage node, thereby reducing the load and the operating pressure of the storage node.
For example, taking an encryption cloud disk as an example, after receiving a target data writing request, a computing node determines that a target data processing requirement is a target data encryption requirement based on the target data writing request, and when detecting that a load of a storage node corresponding to target data is higher, the computing node can send the target data encryption requirement to other storage nodes to execute a data encryption task corresponding to the target data encryption requirement, and after target data encryption is completed, store encrypted data corresponding to the target data to the storage node corresponding to the target data.
For another example, taking an encrypted cloud disk as an example, after receiving the target data reading request, the computing node determines that the target data processing requirement is the target data decryption requirement based on the target data reading request, and when detecting that the load of the storage node corresponding to the target data is higher, the computing node can send the target data decryption requirement to other storage nodes to execute the data decryption task corresponding to the target data decryption requirement, and after the target data decryption is completed, the computing node can obtain the decrypted data corresponding to the target data.
The second storage node is a storage node of which the load meets the target data processing requirement among a plurality of storage nodes of the cloud disk.
Specifically, after determining the first storage node corresponding to the target data processing requirement, determining whether the load of the first storage node meets the target data processing requirement, that is, determining whether the load of the first storage node meets an execution condition capable of executing the target data processing requirement, and if the load of the first storage node does not meet the target data processing requirement, selecting a storage node with the load meeting the target data processing requirement from a plurality of storage nodes of the cloud disk, that is, a second storage node.
Further, whether the load of the storage node meets the target data processing requirement is determined, the load threshold of the storage node can be set according to the actual application condition, if the load of the storage node reaches the load threshold, the load of the storage node is considered to be higher and does not meet the target data processing requirement, and if the load of the storage node does not reach the load threshold, the load of the storage node is considered to meet the target data processing requirement.
For example, the CPU utilization threshold of each storage node may be set to 80%, and if it is detected that the CPU utilization of the storage node reaches 80%, this indicates that the load of the storage node is high, and the load of the storage node does not meet the target data processing requirement.
For convenience of understanding, the cloud disk data processing method provided in the present specification is explained below by taking the target data decryption requirement and the target data encryption requirement as examples.
In one embodiment provided in the present specification, the target data processing requirement includes a target data decryption requirement;
the method further comprises the steps of:
acquiring encrypted data corresponding to the target data decryption requirement from the first storage node;
transmitting the encrypted data to the second storage node;
After sending the encrypted data to the second storage node, the method further comprises:
and obtaining decryption data corresponding to the encryption data and returned by the second storage node.
In practical application, if a read request of target data is received, the normal processing flow is to perform normal reading on the target data first, and then perform decryption operation on the read target data. Therefore, in the case where the target data processing requirement is determined to be the target data decryption requirement, it is also necessary to read the target data from the first storage node before selecting the second storage node from the plurality of storage nodes of the cloud disk.
The target data decryption requirement refers to a decryption requirement for decrypting the target data.
Specifically, after the computing node determines the first storage node corresponding to the target data decryption requirement, the encrypted data corresponding to the target data decryption requirement may be directly read from the first storage node, where the encrypted data acquired from the first storage node may be decrypted or may not be decrypted, and further, the computing node may identify the encrypted data to determine whether the encrypted data has been decrypted, determine whether the load of the first storage node meets the target data decryption requirement according to the identification result, and if it is determined that the load of the first storage node does not meet the target data decryption requirement, select a second storage node with the load meeting the target data decryption requirement in each storage node to decrypt the encrypted data. That is, under the condition that the load of the first storage node does not meet the target data decryption requirement, the first storage node directly obtains the encrypted data without performing decryption operation on the encrypted data after reading the encrypted data corresponding to the target data decryption requirement.
For example, the computing node determines that the first storage node corresponding to the decryption requirement of the target data a is the storage node 1, reads the target data a from the storage node 1, and then reads the target data a as encrypted data, and further, the computing node may identify that the load of the storage node 1 does not meet the decryption requirement of the data a, and may not perform the decryption operation on the target data a in the storage node 1, and may perform the decryption operation on the data a by selecting a second storage node with the load meeting the decryption requirement of the data a from the storage nodes.
After the first storage node is determined not to meet the target data decryption requirement, a second storage node with a load meeting the target data decryption requirement needs to be further determined so as to continue to execute the decryption operation on the encrypted data, and a data reading result corresponding to the encrypted data is obtained.
After determining the second storage node of the target data decryption requirement, the target data decryption requirement can be sent to the second storage node, and based on the target data decryption requirement, the target data processing requirement is sent to the second storage node, namely the target data decryption requirement and the encrypted data acquired from the first storage node are sent to the second storage node.
According to the load of a plurality of storage nodes in the cloud disk, determining a second storage node meeting the target data decryption requirement can be determined according to the load of each storage node in the cloud disk. For example, if the preset load threshold is 80%, any one of the storage nodes with a load less than 80% may be selected as the second storage node, or the storage nodes may be sorted from high to low, and the storage node with a load less than 80% and the lowest load may be selected as the second storage node.
Specifically, after the target data decryption requirement and the encrypted data are sent to the second storage node, the second storage node performs decryption operation on the target data based on the target data decryption requirement, so that the computing node can obtain the decrypted data corresponding to the encrypted data after sending the target data decryption requirement and the encrypted data to the second storage node.
Along the above example, after determining that the storage node 1 does not meet the decryption requirement on the target data a, determining that the second storage node capable of performing the decryption operation on the target data a is the storage node 2, and sending the decryption requirement on the target data a and the target data a to the storage node 2, so that the computing node can obtain the decryption data of the target data a returned by the storage node 2.
Whether the first storage node meets the target data processing requirement or not is determined through the load of the first storage node, if not, the target data processing requirement is sent to the storage node meeting the target data processing requirement for execution, smooth execution of the target data processing requirement can be guaranteed, the load of the first storage node can be shared, and the running speed of the first storage node is improved.
In a specific embodiment provided in the present disclosure, in a case where the load of the first storage node does not meet the target data processing requirement, selecting, from a plurality of storage nodes of the cloud disk, a second storage node whose load meets the target data processing requirement includes:
transmitting the target data decryption requirement to the first storage node;
acquiring a processing result corresponding to the encrypted data returned by the first storage node;
judging whether the encrypted data is decrypted or not based on the processing result;
under the condition that the encrypted data is not decrypted, determining that the load of the first storage node does not meet the target data decryption requirement;
and selecting a second storage node with load meeting the target data decryption requirement from the plurality of storage nodes based on the loads of the plurality of storage nodes in the cloud disk.
Specifically, after receiving a target data reading request, sending a target data decryption requirement corresponding to the target data reading request to a first storage node, obtaining a processing result of the first storage node on encrypted data, further determining whether the encrypted data is decrypted according to the processing result, if not, indicating that the load of the first storage node is higher, and not meeting the target data decryption requirement, so that the decryption process on the encrypted data is continuously executed, selecting a storage node with a load meeting the target data decryption requirement from a plurality of storage nodes of the cloud disk according to the load of each storage node, and decrypting the encrypted data to obtain the encrypted data corresponding to the encrypted data.
According to the cloud disk data processing method, whether each storage node meets the target data processing requirement can be judged according to the load of each storage node in the cloud disk, so that whether a second storage node with the load meeting the target data processing requirement needs to be selected from a plurality of storage nodes of the cloud disk is further determined, the load of the first storage node is shared by the second storage node, and the load of the first storage node is reduced.
Step 206: and sending the target data processing requirement to the second storage node.
After determining that the load meets the second storage node of the target data processing requirement, the target data processing requirement can be sent to the second storage node, so that the second storage node can correspondingly process the target data based on the target data processing requirement.
In the process of writing data, in order to ensure the data order, the organization structure of the data is not destroyed, and different data can correspond to different storage nodes, so that when a computing node receives a target data writing request, the target data needs to be written into the corresponding storage nodes.
In one embodiment provided in the present specification, the target data processing requirement includes a target data encryption requirement;
after sending the target data processing requirement to the second storage node, the method further comprises:
acquiring encrypted data returned by the second storage node aiming at the target data encryption requirement;
writing the encrypted data to the first storage node;
and acquiring write feedback information returned by the first storage node for the encrypted data.
The writing feedback information refers to a target data writing request or feedback information corresponding to a target data encryption requirement, and the writing feedback information can be specifically target data writing success, target data writing failure, target data encryption success, target data encryption failure and the like.
Specifically, after the target data encryption requirement is sent to the second storage node, the second storage node is used for carrying out encryption operation on the target data based on the target data encryption requirement, so that encrypted data corresponding to the target data encryption requirement sent by the second storage node can be obtained, the encrypted data is written into the first storage node, and writing feedback information, sent by the first storage node, for the encrypted data is obtained.
For example, if the target data B needs to be written into the storage node 1, the target data processing requirement is the encryption requirement of the target data B, and if the storage node 1 is determined by the load of the storage node 1 to not meet the encryption requirement of the target data B, the second storage node of the target data B is determined to be the storage node 2 among the plurality of storage nodes of the cloud disk. After determining that the second storage node corresponding to the target data B is the storage node 2, sending the encryption requirement of the target data B to the storage node 2, performing encryption operation on the target data B by the storage node 2, further obtaining the encryption data of the target data B returned by the storage node 2, writing the encryption data of the target data B into the storage node 1, and obtaining writing feedback information that the encryption data of the target data B sent by the storage node 1 is successfully written.
For the target data writing request, the computing node can directly acquire the target data and does not need to acquire the target data from a certain storage node of the cloud disk, so that for the writing efficiency of the target data, before the target data is written, the load of the first storage node can be judged in advance to acquire whether the target data processing requirement is required to be sent to the first storage node for corresponding processing.
In a specific embodiment provided in the present disclosure, the encrypted data is carried in an encrypted data message, where the encrypted data message carries a load reported by the second storage node, the write feedback information is carried in a write feedback information message, and the write feedback information message carries a load reported by the first storage node;
after obtaining the encrypted data returned by the second storage node for the target data encryption requirement, the method further includes:
acquiring and recording the load reported by the second storage node from the encrypted data message;
after writing the encrypted data to the first storage node, the method further comprises:
and acquiring and recording the load reported by the first storage node from the writing feedback information message.
Specifically, when the second storage node returns the encrypted data to the computing node, the load of the second storage node is reported to the computing node, and the load of the second storage node and the encrypted data are carried in the encrypted data message and returned to the computing node. After obtaining the encrypted data message returned by the second storage node aiming at the target data encryption requirement, the computing node can obtain the load reported by the second storage node from the encrypted data message; correspondingly, when the first storage node returns the writing feedback information to the computing node, the load of the first storage node is reported to the computing node, and the load of the first storage node and the writing feedback information are carried in the writing feedback information message and returned to the computing node. After the computing node writes the encrypted data into the first storage node, the computing node can acquire a writing feedback information message returned by the first storage node, can acquire the load reported by the first storage node from the writing feedback information message, and records the load reported by the second storage node and the first storage node so as to realize that after receiving a target data writing request, the computing node can judge the load of the storage node based on the load reported by the storage node so as to determine whether the storage node meets the target data encryption requirement.
The acquisition of the load of the storage node is not limited to the load reporting method described above. Other methods may be used, for example, a central control node is set to perform timing statistics on the load of each storage node, and after the statistics is completed, the load statistics result of each storage node is sent to the calculation node.
In one embodiment provided in the present specification, the target data processing requirement includes a target data encryption requirement;
the method further comprises the steps of:
judging whether the load of the first storage node meets the target data encryption requirement or not;
and sending the target data encryption requirement to the first storage node under the condition that the load of the first storage node meets the target data encryption requirement.
As described above, after the encrypted data is written into the first storage node by the computing node, the load reported by the first storage node is also obtained, on this basis, in order to improve the efficiency of data writing, the load of the current first storage node may be determined according to the load reported by the first storage node when the data writing is completed last time, so as to determine whether the load of the first storage node meets the target data encryption requirement, if the load of the first storage node meets the target data encryption requirement, the target data encryption requirement is sent to the first storage node, and the target data is encrypted and written by the first storage node.
For example, when the computing node receives the target data writing request, it may determine that the target data processing requirement corresponding to the target data writing request is a target data encryption requirement, the computing node determines that a first storage node corresponding to the target data encryption requirement is a storage node 2 in each storage node of the cloud disk, and obtains a load reported by the storage node 2 when the data writing is completed last time, for example, the reported load is 50% of CPU usage, and further determines that the load of the storage node 2 meets the target data encryption requirement, and sends the target data encryption requirement to the storage node 2, so that the storage node 2 encrypts the target data, and writes the encrypted data to the storage node 2.
The load of each storage node is obtained so as to realize the detection of the load of each storage node, and the calculation node is also beneficial to determining whether each storage node meets the target data processing requirement according to the load of each storage node.
In a specific embodiment provided in the present specification, before determining the first storage node corresponding to the target data processing requirement, the method further includes:
receiving a target data reading request sent by a virtual machine;
Determining a target data processing requirement as a target data decryption requirement based on the target data reading request;
after sending the target data processing requirement to the second storage node, the method further comprises:
obtaining decryption data returned by the second storage node aiming at the target data decryption requirement;
and returning the decrypted data to the virtual machine for the target data reading request.
Specifically, in a scenario of encrypting cloud disk data processing, receiving a target data reading request sent by a virtual machine, determining that a target data processing requirement is a target data decryption requirement based on the target data reading request, determining a first storage node corresponding to the target data decryption requirement, selecting a storage node with a load meeting the target data decryption requirement from a plurality of storage nodes of the encrypted cloud disk as a second storage node with the target data decryption requirement when the load of the first storage node does not meet the target data decryption requirement, sending the target data decryption requirement to the second storage node, acquiring decryption data corresponding to the target data decryption requirement, and finally, sending the decryption data to the virtual machine according to the target data reading request.
Further, referring to fig. 3, fig. 3 is a schematic flow interaction diagram of a target data read request according to an embodiment of the present disclosure. The method specifically comprises the following steps:
step 302: and receiving a target data reading request, and determining a target data processing requirement as a target data decryption requirement based on the target data reading request.
Step 304: the target data decryption requirements are sent to the storage node 1.
Step 306: the encrypted data is read from the storage node 1.
Step 308: and judging whether the load of the storage node 1 meets the target data decryption requirement, if not, executing step 310, and if so, executing step 320.
Step 310: and acquiring the encrypted data.
Step 312: the target data decryption requirements and the encrypted data are sent to the storage node 2.
Step 314: the storage node 2 performs a decryption operation on the encrypted data.
Step 316: and obtaining decryption data corresponding to the encryption data returned by the storage node 2.
Step 318: and feeding the decrypted data back to the target terminal.
Step 320: the storage node 1 performs a decryption operation on the encrypted data.
Step 322: and obtaining the decryption data corresponding to the encryption data returned by the storage node 1, and jumping to step 318.
In a specific embodiment provided in the present specification, before determining the first storage node corresponding to the target data processing requirement, the method further includes:
receiving a target data writing request sent by a virtual machine;
determining the target data processing requirement as a target data encryption requirement based on the target data writing request;
after sending the target data processing requirement to the second storage node, the method further comprises:
acquiring encrypted data returned by the second storage node aiming at the target data encryption requirement;
writing the encrypted data to the first storage node;
acquiring write feedback information returned by the first storage node for the encrypted data;
and returning the writing feedback information to the virtual machine aiming at the target data writing request.
Specifically, in a scenario of encrypting cloud disk data processing, a target data writing request sent by a virtual machine is received, a target data processing requirement can be determined to be a target data encrypting requirement based on the target data writing request, a first storage node corresponding to the target data encrypting requirement is determined, under the condition that the load of the first storage node does not meet the target data encrypting requirement, a storage node with the load meeting the target data encrypting requirement is selected from a plurality of storage nodes of an encrypting cloud disk, the storage node is used as a second storage node of the target data encrypting requirement, the target data encrypting requirement is sent to the second storage node, encrypted data returned by the second storage node is obtained, the encrypted data is written to the first storage node, writing feedback information corresponding to the target data encrypting requirement by the first storage node is obtained, and finally, the writing feedback information is sent to the virtual machine according to the target data writing request.
Further, referring to fig. 4, fig. 4 is a schematic flow interaction diagram of a target data write request according to an embodiment of the present disclosure. The method specifically comprises the following steps:
step 402: and receiving a target data writing request, and determining a target data processing requirement as a target data encryption requirement based on the target data writing request.
Step 404: judging whether the load of the storage node 2 meets the target data encryption requirement, if not, executing step 406, and if so, executing step 420.
Step 406: the target data encryption requirement is sent to the storage node 1.
Step 408: the storage node 1 performs an encryption operation on the target data.
Step 410: encrypted data is acquired.
Step 412: the encrypted data is sent to the storage node 2.
Step 414: the storage node 2 writes the encrypted data.
Step 416: and acquiring the write feedback information returned by the storage node 2.
Step 418: and feeding back the writing feedback information to a target terminal.
Step 420: the target data encryption requirement is sent to the storage node 2.
Step 422: the storage node 2 performs encryption operation on the target data, and jumps to step 416 after writing the encrypted data.
Judging whether each storage node meets target data processing requirements according to the load of each storage node in the cloud disk, further determining whether a second storage node with the load meeting the target data processing requirements is needed to be selected from a plurality of storage nodes of the cloud disk, and processing target data by the second storage node based on the target data processing requirements, so that load sharing of the first storage node is realized, and the operation efficiency of the first storage node is improved.
The cloud disk data processing method provided by the specification comprises the following steps: determining a first storage node corresponding to a target data processing requirement, wherein the first storage node is a storage node in a cloud disk for storing data corresponding to the target data processing requirement; selecting a second storage node with load meeting the target data processing requirement from a plurality of storage nodes of the cloud disk under the condition that the load of the first storage node does not meet the target data processing requirement; and sending the target data processing requirement to the second storage node.
According to the embodiment of the specification, the encryption and decryption operation of the encrypted cloud disk and the common data read-write flow are decoupled, and the encryption and decryption operation is distributed according to the load of the storage nodes, so that the load capacity of each storage node in the encrypted cloud disk is balanced, and the local storage node load in the cloud disk is avoided being too high.
The following describes, with reference to fig. 5, an example of application of the cloud disk data processing method provided in the present specification to a encrypted cloud disk scene, where the cloud disk data processing method is further described. Fig. 5 shows a process flow chart of a cloud disk data processing method according to an embodiment of the present disclosure, which specifically includes the following steps.
Step 502: a target data read request is received.
Step 504: and determining the target data processing requirement as a target data decryption requirement based on the target data reading request.
Step 506: and determining a first storage node corresponding to the target data decryption requirement, and sending the target data decryption requirement to the first storage node.
Step 508: and reading the encrypted data corresponding to the target data decryption requirement from the first storage node.
Step 510: and acquiring the load reported by the first storage node, and determining whether the load of the first storage node meets the target data decryption requirement.
Step 512: and under the condition that the load of the first storage node does not meet the target data decryption requirement, acquiring the encrypted data, and selecting a second storage node with the load meeting the target data decryption requirement from a plurality of storage nodes of a cloud disk.
Step 514: and sending the target data decryption requirement and the encrypted data to the second storage node.
Step 516: and obtaining decryption data corresponding to the encryption data returned by the second storage node.
According to the embodiment of the specification, whether each storage node meets the target data decryption requirement is judged according to the load of each storage node in the cloud disk, so that whether a second storage node with the load meeting the target data decryption requirement needs to be selected from a plurality of storage nodes of the cloud disk is further determined, load sharing of the first storage node is realized, and the operation efficiency of the first storage node is improved.
The following describes, with reference to fig. 6, an example of application of the cloud disk data processing method provided in the present specification to a encrypted cloud disk scene, where the cloud disk data processing method is further described. Fig. 6 is a flowchart of a processing procedure of another cloud disk data processing method according to an embodiment of the present disclosure, which specifically includes the following steps.
Step 602: a target data write request is received.
Step 604: and determining the target data processing requirement as a target data encryption requirement based on the target data writing request.
Step 606: and determining a first storage node corresponding to the target data encryption requirement.
Step 608: and acquiring the load reported by the first storage node, and determining whether the load of the first storage node meets the target data encryption requirement.
Step 610: and under the condition that the load of the first storage node does not meet the target data encryption requirement, selecting a second storage node with the load meeting the target data encryption requirement from a plurality of storage nodes of a cloud disk.
Step 612: and sending the target data encryption requirement to the second storage node.
Step 614: and acquiring the encrypted data returned by the second storage node aiming at the target data encryption requirement.
Step 616: writing the encrypted data to the first storage node.
Step 618: and acquiring write feedback information returned by the first storage node for the encrypted data.
According to the embodiment of the specification, whether each storage node meets the target data encryption requirement is judged according to the load of each storage node in the cloud disk, so that whether a second storage node with the load meeting the target data encryption requirement needs to be selected from a plurality of storage nodes of the cloud disk is further determined, load sharing of the first storage node is achieved, and the operation efficiency of the first storage node is improved.
Corresponding to the method embodiment, the present disclosure further provides an embodiment of a cloud disk data processing device, and fig. 7 shows a schematic structural diagram of the cloud disk data processing device according to one embodiment of the present disclosure. As shown in fig. 7, the apparatus includes:
a determining module 702, configured to determine a first storage node corresponding to a target data processing requirement, where the first storage node is a storage node in a cloud disk for storing data corresponding to the target data processing requirement;
a selection module 704 configured to select, in a case where the load of the first storage node does not meet the target data processing requirement, a second storage node whose load meets the target data processing requirement from a plurality of storage nodes of the cloud disk;
a sending module 706 is configured to send the target data processing requirement to the second storage node.
Optionally, the apparatus further includes:
the first request receiving module is configured to receive a target data reading request sent by the virtual machine;
a first demand determination module configured to determine, based on the target data read request, a target data processing demand as a target data decryption demand;
Optionally, the apparatus further includes:
the first data acquisition module is configured to acquire decryption data returned by the second storage node aiming at the target data decryption requirement;
and the data return module is configured to return the decrypted data to the virtual machine for the target data reading request.
Optionally, the apparatus further includes:
the second request receiving module is configured to receive a target data writing request sent by the virtual machine;
a second requirement determination module configured to determine, based on the target data write request, that the target data processing requirement is a target data encryption requirement;
optionally, the apparatus further includes:
the second data acquisition module is configured to acquire encrypted data returned by the second storage node aiming at the target data encryption requirement;
a data writing module configured to write the encrypted data to the first storage node;
the feedback information acquisition module is configured to acquire writing feedback information returned by the first storage node for the encrypted data;
and the feedback information return module is configured to return the writing feedback information to the virtual machine aiming at the target data writing request.
Optionally, the target data processing requirement includes a target data decryption requirement;
the apparatus further comprises:
the third data acquisition module is configured to acquire encrypted data corresponding to the target data decryption requirement from the first storage node;
a data transmission module configured to transmit the encrypted data to the second storage node;
optionally, the apparatus further includes:
and the fourth data acquisition module is configured to acquire decryption data corresponding to the encryption data returned by the second storage node.
Optionally, the selecting module 704 is further configured to:
transmitting the target data decryption requirement to the first storage node;
acquiring a processing result corresponding to the encrypted data returned by the first storage node;
judging whether the encrypted data is decrypted or not based on the processing result;
under the condition that the encrypted data is not decrypted, determining that the load of the first storage node does not meet the target data decryption requirement;
and selecting a second storage node with load meeting the target data decryption requirement from the plurality of storage nodes based on the loads of the plurality of storage nodes in the cloud disk.
Optionally, the encrypted data is carried in an encrypted data message, the encrypted data message carries a load reported by the second storage node, the write-in feedback information is carried in a write-in feedback information message, and the write-in feedback information message carries a load reported by the first storage node;
the apparatus further comprises:
the first load recording module is configured to acquire and record the load reported by the second storage node from the encrypted data message;
the apparatus further comprises:
and the second load recording module is configured to acquire and record the load reported by the first storage node from the writing feedback information message.
Optionally, the target data processing requirement includes a target data encryption requirement;
the apparatus further comprises:
the load judging module is configured to judge whether the load of the first storage node meets the target data encryption requirement or not;
and the demand sending module is configured to send the target data encryption demand to the first storage node in the condition that the load of the first storage node meets the target data encryption demand.
The cloud disk data processing device provided in the present specification includes: the determining module is configured to determine a first storage node corresponding to a target data processing requirement, wherein the first storage node is a storage node in a cloud disk for storing data corresponding to the target data processing requirement; the selecting module is configured to select a second storage node with load meeting the target data processing requirement from a plurality of storage nodes of the cloud disk under the condition that the load of the first storage node does not meet the target data processing requirement; and a sending module configured to send the target data processing requirement to the second storage node.
According to the embodiment of the specification, the encryption and decryption operation of the encrypted cloud disk and the common data read-write flow are decoupled, and the encryption and decryption operation is distributed according to the load of the storage nodes, so that the load capacity of each storage node in the encrypted cloud disk is balanced, and the local storage node load in the cloud disk is avoided being too high.
The foregoing is a schematic scheme of a cloud disk data processing apparatus of this embodiment. It should be noted that, the technical solution of the cloud disk data processing apparatus and the technical solution of the cloud disk data processing method belong to the same concept, and details of the technical solution of the cloud disk data processing apparatus, which are not described in detail, can be referred to the description of the technical solution of the cloud disk data processing method.
Referring to fig. 8, fig. 8 shows a flowchart of another cloud disk data processing method according to an embodiment of the present disclosure, which specifically includes the following steps.
Step 802: and receiving target data processing requirements sent by the computing node.
The target data processing requirement is sent to a second storage node after the computing node selects the second storage node with the load meeting the target data processing requirement from a plurality of storage nodes of a cloud disk.
Step 804: and processing the target data based on the target data processing requirement.
Step 806: and sending the processing result of the target data to the computing node.
Specifically, the cloud disk data processing method is applied to the second storage node. The second storage node receives the target data processing requirement sent by the computing node, and performs corresponding processing on the target data according to the target data processing requirement, for example, the second storage node may perform decryption operation on the target data based on the target data decryption requirement when the received target data processing requirement is the target data encryption requirement, and the second storage node may perform encryption operation on the target data based on the target data encryption requirement when the received target data processing requirement is the target data encryption requirement. And after the target data is processed, sending the processing result of the target data to the computing node.
According to the embodiment of the specification, the encryption and decryption operation of the encrypted cloud disk and the common data read-write flow are decoupled, and the encryption and decryption operation is distributed according to the load of the storage nodes, so that the load capacity of each storage node in the encrypted cloud disk is balanced, and the local storage node load in the cloud disk is avoided being too high.
Corresponding to the method embodiment, the present disclosure further provides an embodiment of a cloud disk data processing apparatus, and fig. 9 shows a schematic structural diagram of another cloud disk data processing apparatus provided in one embodiment of the present disclosure. As shown in fig. 9, the apparatus includes:
a receiving module 902, configured to receive a target data processing requirement sent by a computing node, where the target data processing requirement is sent to a second storage node after the computing node selects the second storage node whose load meets the target data processing requirement from a plurality of storage nodes of a cloud disk;
a processing module 904 configured to process the target data based on the target data processing requirements;
a result sending module 906 configured to send a processing result of the target data to the computing node.
According to the embodiment of the specification, the encryption and decryption operation of the encrypted cloud disk and the common data read-write flow are decoupled, and the encryption and decryption operation is distributed according to the load of the storage nodes, so that the load capacity of each storage node in the encrypted cloud disk is balanced, and the local storage node load in the cloud disk is avoided being too high.
The above is another schematic scheme of the cloud disk data processing apparatus of the present embodiment. It should be noted that, the technical solution of the cloud disk data processing apparatus and the technical solution of the cloud disk data processing method belong to the same concept, and details of the technical solution of the cloud disk data processing apparatus, which are not described in detail, can be referred to the description of the technical solution of the cloud disk data processing method.
With reference to fig. 10, fig. 10 illustrates an architecture diagram of a cloud disk data processing system according to an embodiment of the present disclosure. As shown in fig. 10, the cloud disk data processing system provided in the present specification includes a computing node, and a plurality of storage nodes. Specifically, after receiving a target data processing requirement, a computing node determines a storage node corresponding to the target data processing requirement, determines a first storage node for storing target data based on the target data processing requirement, and determines whether the load of the first storage node meets the target data processing requirement based on the load of the first storage node. Under the condition that the first storage node does not meet the target data processing requirement, selecting a second storage node with load meeting the target data processing requirement from a plurality of storage nodes of the cloud disk data processing system, sending the target data processing requirement to the second storage node, and after receiving the target data processing requirement sent by the computing node, the second storage node can perform corresponding processing on target data based on the target data processing requirement, and further feed back a processing result corresponding to the target data processing requirement to the computing node.
According to the embodiment of the specification, the encryption and decryption operation of the encrypted cloud disk and the common data read-write flow are decoupled, and the encryption and decryption operation is distributed according to the load of the storage nodes, so that the load capacity of each storage node in the encrypted cloud disk is balanced, and the local storage node load in the cloud disk is avoided being too high.
Fig. 11 illustrates a block diagram of a computing device 1100 provided according to one embodiment of the present description. The components of computing device 1100 include, but are not limited to, a memory 1110 and a processor 1120. Processor 1120 is coupled to memory 1110 via bus 1130, and database 1150 is used to hold data.
The computing device 1100 also includes an access device 1140, the access device 1140 enabling the computing device 1100 to communicate via one or more networks 1160. Examples of such networks include a public switched telephone Network (PSTN, publicSwitchedTelephone Network), a local area Network (LAN, localAreaNetwork), a wide area Network (WAN, wideAreaNetwork), a personal area Network (PAN, personalAreaNetwork), or a combination of communication networks such as the internet. The Access device 1140 may include one or more of any type of Network interface, wired or wireless, such as a Network interface card (NIC, networkinterface controller), such as an IEEE802.11 wireless local area Network (WLAN, wirelessLocalArea Network) wireless interface, a worldwide interoperability for microwave Access (Wi-MAX, worldwideInteroperabilityforMicrowave Access) interface, an ethernet interface, a universal serial bus (USB, universalSerialBus) interface, a cellular Network interface, a bluetooth interface, a near-field communication (NFC, nearFieldCommunication).
In one embodiment of the present description, the above components of computing device 1100, as well as other components not shown in FIG. 11, may also be connected to each other, such as by a bus. It should be understood that the block diagram of the computing device illustrated in FIG. 11 is for exemplary purposes only and is not intended to limit the scope of the present description. Those skilled in the art may add or replace other components as desired.
Computing device 1100 may be any type of stationary or mobile computing device, including a mobile computer or mobile computing device (e.g., tablet, personal digital assistant, laptop, notebook, netbook, etc.), mobile phone (e.g., smart phone), wearable computing device (e.g., smart watch, smart glasses, etc.), or other type of mobile device, or a stationary computing device such as a desktop computer or personal computer (PC, personalComputer). Computing device 1100 may also be a mobile or stationary server.
The processor 1120 is configured to execute computer-executable instructions that, when executed by the processor, implement the steps of the cloud disk data processing method described above.
The foregoing is a schematic illustration of a computing device of this embodiment. It should be noted that, the technical solution of the computing device and the technical solution of the cloud disk data processing method belong to the same concept, and details of the technical solution of the computing device, which are not described in detail, can be referred to the description of the technical solution of the cloud disk data processing method.
An embodiment of the present disclosure further provides a computer-readable storage medium storing computer-executable instructions that, when executed by a processor, implement the steps of the cloud disk data processing method described above.
The above is an exemplary version of a computer-readable storage medium of the present embodiment. It should be noted that, the technical solution of the storage medium and the technical solution of the cloud disk data processing method belong to the same concept, and details of the technical solution of the storage medium which are not described in detail can be referred to the description of the technical solution of the cloud disk data processing method.
An embodiment of the present disclosure further provides a computer program, where the computer program when executed in a computer causes the computer to execute the steps of the cloud disk data processing method described above.
The above is an exemplary version of a computer program of the present embodiment. It should be noted that, the technical solution of the computer program and the technical solution of the cloud disk data processing method belong to the same concept, and details of the technical solution of the computer program, which are not described in detail, can be referred to the description of the technical solution of the cloud disk data processing method.
The foregoing describes specific embodiments of the present disclosure. Other embodiments are within the scope of the following claims. In some cases, the actions or steps recited in the claims can be performed in a different order than in the embodiments and still achieve desirable results. In addition, the processes depicted in the accompanying figures do not necessarily require the particular order shown, or sequential order, to achieve desirable results. In some embodiments, multitasking and parallel processing are also possible or may be advantageous.
The computer instructions include computer program code that may be in source code form, object code form, executable file or some intermediate form, etc. The computer readable medium may include: any entity or device capable of carrying the computer program code, a recording medium, a U disk, a removable hard disk, a magnetic disk, an optical disk, a computer memory, a Read-only memory (ROM), a random access memory (RAM, randomAccessMemory), an electrical carrier signal, a telecommunication signal, a software distribution medium, and so forth. It should be noted that the content of the computer readable medium can be increased or decreased appropriately according to the requirements of the patent practice, for example, in some areas, according to the patent practice, the computer readable medium does not include an electric carrier signal and a telecommunication signal.
It should be noted that, for simplicity of description, the foregoing method embodiments are all expressed as a series of combinations of actions, but it should be understood by those skilled in the art that the embodiments are not limited by the order of actions described, as some steps may be performed in other order or simultaneously according to the embodiments of the present disclosure. Further, those skilled in the art will appreciate that the embodiments described in the specification are all preferred embodiments, and that the acts and modules referred to are not necessarily all required for the embodiments described in the specification.
In the foregoing embodiments, the descriptions of the embodiments are emphasized, and for parts of one embodiment that are not described in detail, reference may be made to the related descriptions of other embodiments.
The preferred embodiments of the present specification disclosed above are merely used to help clarify the present specification. Alternative embodiments are not intended to be exhaustive or to limit the invention to the precise form disclosed. Obviously, many modifications and variations are possible in light of the teaching of the embodiments. The embodiments were chosen and described in order to best explain the principles of the embodiments and the practical application, to thereby enable others skilled in the art to best understand and utilize the invention. This specification is to be limited only by the claims and the full scope and equivalents thereof.

Claims (12)

1. A cloud disk data processing method comprises the following steps:
determining a first storage node corresponding to a target data processing requirement, wherein the first storage node is a storage node in a cloud disk for storing data corresponding to the target data processing requirement;
selecting a second storage node with load meeting the target data processing requirement from a plurality of storage nodes of the cloud disk under the condition that the load of the first storage node does not meet the target data processing requirement;
and sending the target data processing requirement to the second storage node.
2. The method of claim 1, prior to determining the first storage node corresponding to the target data processing requirement, the method further comprising:
receiving a target data reading request sent by a virtual machine;
determining a target data processing requirement as a target data decryption requirement based on the target data reading request;
after sending the target data processing requirement to the second storage node, the method further comprises:
obtaining decryption data returned by the second storage node aiming at the target data decryption requirement;
and returning the decrypted data to the virtual machine for the target data reading request.
3. The method of claim 1, prior to determining the first storage node corresponding to the target data processing requirement, the method further comprising:
receiving a target data writing request sent by a virtual machine;
determining the target data processing requirement as a target data encryption requirement based on the target data writing request;
after sending the target data processing requirement to the second storage node, the method further comprises:
acquiring encrypted data returned by the second storage node aiming at the target data encryption requirement;
writing the encrypted data to the first storage node;
acquiring write feedback information returned by the first storage node for the encrypted data;
and returning the writing feedback information to the virtual machine aiming at the target data writing request.
4. The method of claim 1 or 2, the target data processing requirements comprising target data decryption requirements;
the method further comprises the steps of:
acquiring encrypted data corresponding to the target data decryption requirement from the first storage node;
transmitting the encrypted data to the second storage node;
after sending the encrypted data to the second storage node, the method further comprises:
And obtaining decryption data corresponding to the encryption data and returned by the second storage node.
5. The method of claim 4, in the event that the load of the first storage node does not meet the target data processing requirement, selecting a second storage node from a plurality of storage nodes of the cloud disk whose load meets the target data processing requirement, comprising:
transmitting the target data decryption requirement to the first storage node;
acquiring a processing result corresponding to the encrypted data returned by the first storage node;
judging whether the encrypted data is decrypted or not based on the processing result;
under the condition that the encrypted data is not decrypted, determining that the load of the first storage node does not meet the target data decryption requirement;
and selecting a second storage node with load meeting the target data decryption requirement from the plurality of storage nodes based on the loads of the plurality of storage nodes in the cloud disk.
6. The method of claim 3, wherein the encrypted data is carried in an encrypted data message, the encrypted data message carries a load reported by the second storage node, the write feedback information is carried in a write feedback information message, and the write feedback information message carries a load reported by the first storage node;
After obtaining the encrypted data returned by the second storage node for the target data encryption requirement, the method further includes:
acquiring and recording the load reported by the second storage node from the encrypted data message;
after writing the encrypted data to the first storage node, the method further comprises:
and acquiring and recording the load reported by the first storage node from the writing feedback information message.
7. A method according to claim 1 or 3, the target data processing requirements comprising target data encryption requirements;
the method further comprises the steps of:
judging whether the load of the first storage node meets the target data encryption requirement or not;
and sending the target data encryption requirement to the first storage node under the condition that the load of the first storage node meets the target data encryption requirement.
8. A cloud disk data processing apparatus, comprising:
the determining module is configured to determine a first storage node corresponding to a target data processing requirement, wherein the first storage node is a storage node in a cloud disk for storing data corresponding to the target data processing requirement;
the selecting module is configured to select a second storage node with load meeting the target data processing requirement from a plurality of storage nodes of the cloud disk under the condition that the load of the first storage node does not meet the target data processing requirement;
And a sending module configured to send the target data processing requirement to the second storage node.
9. A cloud disk data processing method comprises the following steps:
receiving a target data processing requirement sent by a computing node, wherein the target data processing requirement is sent to a second storage node after the computing node selects the second storage node with load meeting the target data processing requirement from a plurality of storage nodes of a cloud disk;
processing the target data based on the target data processing requirement;
and sending the processing result of the target data to the computing node.
10. A cloud disk data processing system comprising a computing node to which the cloud disk data processing method according to any one of claims 1 to 7 is applied, and a plurality of storage nodes to which the cloud disk data processing method according to claim 9 is applied.
11. A computing device, comprising:
a memory and a processor;
the memory is configured to store computer executable instructions, and the processor is configured to execute the computer executable instructions, which when executed by the processor, implement the steps of the cloud disk data processing method according to any of claims 1 to 7 or 9.
12. A computer readable storage medium storing computer executable instructions which when executed by a processor implement the steps of the cloud disk data processing method of any of claims 1-7 or 9.
CN202310591678.0A 2023-05-22 2023-05-22 Cloud disk data processing method and device and cloud disk data processing system Pending CN116775278A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202310591678.0A CN116775278A (en) 2023-05-22 2023-05-22 Cloud disk data processing method and device and cloud disk data processing system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202310591678.0A CN116775278A (en) 2023-05-22 2023-05-22 Cloud disk data processing method and device and cloud disk data processing system

Publications (1)

Publication Number Publication Date
CN116775278A true CN116775278A (en) 2023-09-19

Family

ID=87986990

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202310591678.0A Pending CN116775278A (en) 2023-05-22 2023-05-22 Cloud disk data processing method and device and cloud disk data processing system

Country Status (1)

Country Link
CN (1) CN116775278A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118153075A (en) * 2024-03-22 2024-06-07 北京昌东科技有限公司 Data storage encryption method and device and electronic equipment

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN118153075A (en) * 2024-03-22 2024-06-07 北京昌东科技有限公司 Data storage encryption method and device and electronic equipment
CN118153075B (en) * 2024-03-22 2025-03-04 北京昌东科技有限公司 Data storage encryption method, device and electronic equipment

Similar Documents

Publication Publication Date Title
US9405757B2 (en) File storage system, apparatus, and file access method
CN113726875B (en) Transaction processing method and device based on blockchain all-in-one machine
US10623186B1 (en) Authenticated encryption with multiple contexts
CN111427860B (en) Distributed storage system and data processing method thereof
CN113296737B (en) Random number generation system, method and device and cloud server
CN109347839B (en) Centralized password management method and device, electronic equipment and computer storage medium
CN106201783B (en) A kind of data reconstruction method and device
CN111064804B (en) Network access method and device
US20130097430A1 (en) Encrypting data and characterization data that describes valid contents of a column
JP2014036335A (en) Job processing system, information processing system, job processing method, information processing method, and program
US11770458B1 (en) Systems for exchanging data using intermediate devices
CN114218540A (en) Project access method and device
CN116383870A (en) Cloud disk management method and system
CN118677950A (en) Migration method, device and equipment of data transmission task and storage medium
CN116775278A (en) Cloud disk data processing method and device and cloud disk data processing system
WO2025082483A1 (en) Data encryption method, data decryption method, data encryption and decryption system, electronic device, and medium
Merdassi et al. Surveying and analyzing security issues in mobile cloud computing
JP6309432B2 (en) Secret calculation system and method, management server and program
US11095683B1 (en) Systems and methods for delegating endpoint security operations to a nearby computing device
US7483537B2 (en) Selecting cached RSA keys in response to RSA key requests
CN113300833B (en) Key management method and device
CN113297587B (en) Data storage method and system
CN113840013A (en) Document system for hierarchical management
US20140196036A1 (en) Tracing operations in a cloud system
HK40057904A (en) Key management method and device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination