[go: up one dir, main page]

WO2020237849A1 - Procédé de lecture-écriture d'aperçu pour dispositif de bloc de réseau, appareil, dispositif et support de stockage - Google Patents

Procédé de lecture-écriture d'aperçu pour dispositif de bloc de réseau, appareil, dispositif et support de stockage Download PDF

Info

Publication number
WO2020237849A1
WO2020237849A1 PCT/CN2019/101713 CN2019101713W WO2020237849A1 WO 2020237849 A1 WO2020237849 A1 WO 2020237849A1 CN 2019101713 W CN2019101713 W CN 2019101713W WO 2020237849 A1 WO2020237849 A1 WO 2020237849A1
Authority
WO
WIPO (PCT)
Prior art keywords
snapshot
read
write
request
network block
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/CN2019/101713
Other languages
English (en)
Chinese (zh)
Inventor
王新
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Ping An Technology Shenzhen Co Ltd
Original Assignee
Ping An Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Ping An Technology Shenzhen Co Ltd filed Critical Ping An Technology Shenzhen Co Ltd
Publication of WO2020237849A1 publication Critical patent/WO2020237849A1/fr
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/11—File system administration, e.g. details of archiving or snapshots
    • G06F16/128—Details of file system snapshots on the file-level, e.g. snapshot creation, administration, deletion
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/17—Details of further file system functions
    • G06F16/172—Caching, prefetching or hoarding of files
    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/10—File systems; File servers
    • G06F16/18—File system types
    • G06F16/182—Distributed file systems
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00—Network arrangements or protocols for supporting network services or applications
    • H04L67/01—Protocols
    • H04L67/10—Protocols in which an application is distributed across nodes in the network
    • H04L67/1097—Protocols in which an application is distributed across nodes in the network for distributed storage of data in networks, e.g. transport arrangements for network file system [NFS], storage area networks [SAN] or network attached storage [NAS]
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Definitions

  • This application relates to the field of computer technology, and in particular to a method, device, device, and storage medium for reading and writing snapshots of network block devices.
  • Ceph distributed system includes Ceph clients and Ceph clusters.
  • Ceph clients include network block devices (network block device), the network block device is referred to as nbd device, and the nbd device is a block device widely used by the Linux system of the Ceph client.
  • the Ceph client can select a created nbd device locally, and use the preset nbd
  • the protocol connects the rbd device of the Ceph cluster.
  • the rbd device can be understood as a storage device in the Ceph cluster.
  • the read and write on the Ceph client nbd device needs to be converted to Ceph
  • the read and write of the rbd device in the cluster after the read and write of the rbd device in the Ceph cluster is completed, the read and write content of the rbd device is obtained and returned to the Ceph client nbd device to complete the read and write to the Ceph client nbd device.
  • the snapshot file system or the snapshot database system is in the Ceph cluster It is a read-only attribute, and it is difficult to meet the needs of creating a writable snapshot file system for nbd devices or a writable snapshot database system.
  • the main purpose of this application is to provide a method, device, device, and storage medium for reading and writing snapshots of network block devices, which aims to solve the problem of creating a writable snapshot file system of nbd devices or a writable snapshot database system in the prior art.
  • this application provides a network block device snapshot read and write method.
  • the network block device snapshot read and write method is applied to a Ceph client in a Ceph distributed system.
  • the Ceph distributed system also includes a Ceph cluster.
  • the network block device snapshot read-write method includes:
  • the Ceph client When the Ceph client detects a read and write snapshot request for the snapshot database of the network block device, it sends the read and write snapshot request to the Ceph cluster based on the rbd-nbd process corresponding to the network block device to obtain all The snapshot data fed back by the Ceph cluster in response to the read-write snapshot request;
  • the type of the read-write snapshot request is a write request type, perform a write operation in the rbd-nbd process according to the write type to obtain write data;
  • the write data and the snapshot data are fed back to the network block device to start the snapshot database in the network block device.
  • performing a write operation in the rbd-nbd process according to the write type to obtain write data includes:
  • the type of the read-write snapshot request is the type of the write request, determining whether the cache in the rbd-nbd process is empty;
  • the cache in the rbd-nbd process is not empty, acquire the first key value carried in the write request, where the first key value includes write position and write length information;
  • the first key value is less than or equal to the second key value, a new cache entry is added to the cache, and the requested content of the write request is stored in the new cache entry.
  • step of judging whether the cache in the rbd-nbd process is empty includes:
  • the request content of the write request is stored in the initial entry in the rbd-nbd process.
  • step of comparing the first key value with the second key value in the cached entry in the cache includes:
  • the request content of the write request corresponding to the first key value and the request content corresponding to the second key are merged and stored.
  • the method includes:
  • the snapshot data fed back by the Ceph cluster in response to the read-write snapshot request is fed back to the network block device to start the snapshot database in the network block device.
  • the step of feeding back the snapshot data fed back by the Ceph cluster for the read-write snapshot request to the network block device includes:
  • the type of the read-write snapshot request is a read type, determining whether the cache in the rbd-nbd process is empty;
  • the snapshot data and the read data fed back by the Ceph cluster for the read-write snapshot request are fed back to the network block device.
  • This application also provides a network block device snapshot reading and writing device, the network block device snapshot reading and writing device is applied to a Ceph client in a Ceph distributed system, the Ceph distributed system also includes a Ceph cluster, and the network block
  • the device snapshot reading and writing device includes:
  • the detection module is used to send the read and write snapshot request to the Ceph based on the rbd-nbd process corresponding to the network block device when the Ceph client detects a read and write snapshot request to the snapshot database of the network block device Cluster to obtain the snapshot data fed back by the Ceph cluster in response to the read-write snapshot request;
  • An obtaining module used to obtain the type of the read-write snapshot request
  • a write module configured to perform a write operation in the rbd-nbd process according to the write type when the type of the read-write snapshot request is a write request type to obtain write data;
  • the feedback module is used to feed back the write data and the snapshot data to the network block device to start the snapshot database in the network block device.
  • the writing module includes:
  • the first determining unit is configured to determine whether the cache in the rbd-nbd process is empty if the type of the read-write snapshot request is the type of the write request;
  • the first obtaining unit is configured to obtain a first key value carried in the write request if the cache in the rbd-nbd process is not empty, wherein the first key value includes a write position and a write length information;
  • a comparison unit configured to compare the first key value with the second key value in the cached entry in the cache
  • the adding unit is configured to add a new cache entry in the cache if the first key value is less than or equal to the second key value, and store the requested content of the write request in the new cache entry.
  • the writing module includes:
  • a creation unit configured to create an initial entry in the cache if the cache in the rbd-nbd process is empty;
  • the first storage unit is configured to store the request content of the write request in the initial entry in the rbd-nbd process.
  • the writing module further includes:
  • the second storage unit is configured to merge and merge the request content of the write request corresponding to the first key value and the request content corresponding to the second key if the first key value is greater than the second key value storage.
  • the apparatus for reading and writing a snapshot of a network block device further includes:
  • the startup module is used to feed back the snapshot data fed back by the Ceph cluster in response to the read-write snapshot request to the network block device if the type of the read-write snapshot request is a read type, so as to start the network block device Snapshot database in.
  • the startup module includes:
  • the second determining unit is configured to determine whether the cache in the rbd-nbd process is empty if the type of the read-write snapshot request is a read type
  • the second obtaining unit is configured to obtain the target read key value carried in the read request if the cache in the rbd-nbd process is not empty, and obtain the target read key value from the cache according to the target read key value. Read data of the read request;
  • the feedback unit is configured to feed back the snapshot data and the read data fed back by the Ceph cluster for the read-write snapshot request to the network block device.
  • this application also provides a network block device snapshot read-write device
  • the network block device snapshot read-write device includes: a memory, a processor, a communication bus, and a network block device stored on the memory Readable instructions for snapshot read and write methods
  • the communication bus is used to realize the communication connection between the processor and the memory
  • the processor is configured to execute the readable instructions of the network block device snapshot read and write method to implement the following steps:
  • the Ceph client When the Ceph client detects a read and write snapshot request for the snapshot database of the network block device, it sends the read and write snapshot request to the Ceph cluster based on the rbd-nbd process corresponding to the network block device to obtain all The snapshot data fed back by the Ceph cluster in response to the read-write snapshot request;
  • the type of the read-write snapshot request is a write request type, perform a write operation in the rbd-nbd process according to the write type to obtain write data;
  • the write data and the snapshot data are fed back to the network block device to start the snapshot database in the network block device.
  • the present application also provides a storage medium that stores one or more readable instructions, and the one or more readable instructions can be executed by one or more processors to Used for:
  • the Ceph client When the Ceph client detects a read and write snapshot request for the snapshot database of the network block device, it sends the read and write snapshot request to the Ceph cluster based on the rbd-nbd process corresponding to the network block device to obtain all The snapshot data fed back by the Ceph cluster in response to the read-write snapshot request;
  • the type of the read-write snapshot request is a write request type, perform a write operation in the rbd-nbd process according to the write type to obtain write data;
  • the write data and the snapshot data are fed back to the network block device to start the snapshot database in the network block device.
  • This application sends the read and write snapshot request to the Ceph cluster based on the rbd-nbd process corresponding to the network block device when the Ceph client detects the read and write snapshot request to the snapshot database of the network block device,
  • the corresponding snapshot data is obtained from the Ceph cluster, and then the type of the read-write snapshot request is obtained. If the type of the read-write snapshot request is the write type, the write The write content in the request is designed to be carried out and cached in the rbd-nbd process, so that the nbd device can detect the snapshot data and the write data corresponding to the write request, so that the nbd device can be processed based on the snapshot data and the write data corresponding to the write request.
  • a writable snapshot file system or a writable snapshot database system, thus solves the technical problem of creating a writable snapshot file system of an nbd device or a writable snapshot database system in the prior art.
  • FIG. 1 is a schematic flowchart of a first embodiment of a method for reading and writing a snapshot of a network block device according to the application;
  • FIG. 2 is a schematic flowchart of a second embodiment of a method for reading and writing a snapshot of a network block device according to the application;
  • FIG. 3 is a schematic diagram of the device structure of the hardware operating environment involved in the method of the embodiment of the present application.
  • This application provides a method for reading and writing a snapshot of a network block device.
  • the method for reading and writing a snapshot of the network block device is applied to a Ceph distributed system
  • the Ceph distributed system also includes a Ceph cluster
  • the network block device snapshot read-write method includes:
  • Step S10 when the Ceph client detects a read and write snapshot request to the snapshot database of the network block device, it sends the read and write snapshot request to the Ceph cluster based on the rbd-nbd process corresponding to the network block device, To obtain the snapshot data fed back by the Ceph cluster in response to the read-write snapshot request;
  • Step S20 acquiring the type of the read-write snapshot request
  • Step S30 if the type of the read-write snapshot request is a write request type, perform a write operation in the rbd-nbd process according to the write type to obtain write data;
  • Step S40 feeding back the write data and the snapshot data to the network block device to activate the snapshot database in the network block device.
  • Step S10 when the Ceph client detects a read and write snapshot request to the snapshot database of the network block device, it sends the read and write snapshot request to the Ceph cluster based on the rbd-nbd process corresponding to the network block device, To obtain the snapshot data fed back by the Ceph cluster in response to the read-write snapshot request;
  • the Ceph distributed system includes a Ceph client, and the Ceph distributed system also includes a Ceph cluster.
  • the data content in the Ceph cluster is mapped to the Ceph client.
  • the network driver is mapped to the local, that is, the Ceph client.
  • the rbd-nbd process needs to be artificially triggered by the Ceph client first Among them, the two ends of the rbd-nbd process connection are the Ceph client and the Ceph cluster respectively.
  • Triggering the rbd-nbd process manually is to manually select the Ceph cluster and the local disk on the Ceph client by the user. After the selection is completed, the rbd-nbd process is created by clicking and other operations. After the rbd-nbd process is determined to be created, the nbd device is created in the local disk of the Ceph client based on the rbd-nbd process. After the nbd device is created , The user can read or write the data of the Ceph cluster to the local nbd device to complete the reading and writing of the local nbd device. In other words, the read and write on the Ceph client nbd device needs to be converted.
  • the read and write content of the rbd device is obtained and returned to the Ceph client nbd device to complete the read and write to the Ceph client nbd device .
  • the Ceph cluster can be regarded as a network neighbor device. If you want to read the data content of the network neighbor device locally, you need to first determine the network neighbor device address and local disk by the user. After the device address and the local disk, the rbd-nbd process is then triggered. According to the rbd-nbd process, the nbd device is created in the local disk, and based on the rbd-nbd process, the corresponding content is obtained from the network neighbor, and the corresponding The content is stored in the nbd device to determine the completion of the reading and writing of the nbd device.
  • the Ceph client detects a read-write snapshot request to the snapshot database of the network block device
  • the read-write snapshot request is sent based on the rbd-nbd process corresponding to the network block device
  • the driver corresponding to the network block device will obtain the read-write snapshot request, Then forward the read-write snapshot request to the socket structure in the Ceph client.
  • the socket structure connects the rbd-nbd process and the nbd device.
  • the rbd-nbd process obtains the read-write snapshot request from the socket structure, and then reads and writes The snapshot request is sent to the Ceph cluster. After receiving the read-write snapshot request, the Ceph cluster will return the snapshot data based on the read request in the read-write snapshot request. It should be noted that in this embodiment, one end of the rbd-nbd process It is the snapshot volume of the rbd device of the Ceph cluster, that is, because one end of the rbd-nbd process is the snapshot volume of the rbd device of the Ceph cluster, the technical problem in this application will exist.
  • Ceph cluster After the Ceph cluster receives the read-write snapshot request, it will return the snapshot data based on the read request in the read-write snapshot request.
  • the process includes: Ceph cluster parses the read request content of the read-write snapshot request, and returns the snapshot data according to the read request content It should be noted that the Ceph cluster returns the snapshot data based on the content of the read request, which belongs to the prior art and does not make a specific description.
  • Step S20 acquiring the type of the read-write snapshot request
  • the type of the read-write snapshot request is determined.
  • the purpose of determining the type of the read-write snapshot request is to determine whether a write operation is required.
  • the type of the read-write snapshot request is a write type, a write operation is required.
  • Step S30 if the type of the read-write snapshot request is a write request type, perform a write operation in the rbd-nbd process according to the write type to obtain write data;
  • the write operation is designed in the rbd-nbd process to complete the read-write snapshot request Write request, that is, in this embodiment, as long as it is determined that the type of the read-write snapshot request is a write request type, a temporary cache is opened in the local rbd-nbd process to perform a write operation to obtain write data.
  • performing a write operation in the rbd-nbd process according to the write type to obtain write data includes:
  • Step S31 if the type of the read-write snapshot request is the type of the write request, determine whether the cache in the rbd-nbd process is empty;
  • the cache in the rbd-nbd process may have previously written data. For example, after a previous write operation to the nbd device, it is found that there is an error in the content of the write operation, and a new write operation is required. At this time, The previously written data of the erroneous write operation exists in the rbd-nbd process, and it is necessary to determine whether the cache in the rbd-nbd process is empty when the re-write operation is correspondingly performed.
  • Step S32 if the cache in the rbd-nbd process is not empty, obtain a first key value carried in the write request, where the first key value includes write position and write length information;
  • the first key value and the write content carried in the write request are acquired, where the first key value It includes writing position and writing length information, and the writing content also includes data to be written.
  • Step S33 comparing the first key value with the second key value in the cached entry in the cache
  • the first key value is compared with the second key value in the cached entry in the cache, and the write position in the first key value is compared with the second key value.
  • the writing position in the key value is compared. If the writing position in the first key value is different from the writing position or the writing length in the second key value, then no subsequent writing content comparison is performed. If the first key value is compared
  • the write position in is the same as the write position or the write length in the second key value, then the write content in the write request is compared with the write content in the corresponding second key value.
  • Step S34 If the first key value is less than or equal to the second key value, a new cache entry is added to the cache, and the requested content of the write request is stored in the new cache entry.
  • the first key value is less than or equal to the second key value, and if the first key value is less than or equal to the second key value Key value, a new cache entry is added to the cache, and the requested content of the write request is stored in the new cache entry.
  • step of judging whether the cache in the rbd-nbd process is empty includes:
  • Step S35 if the cache in the rbd-nbd process is empty, an initial entry will be created in the cache;
  • Step S36 Store the request content of the write request in the initial entry in the rbd-nbd process.
  • Step S40 feeding back the write data and the snapshot data to the network block device to activate the snapshot database in the network block device.
  • the network block device After obtaining the write data and the snapshot data, the write data and the snapshot data are fed back to the network block device, the network block device detects the write data and the snapshot data corresponding to the write request, and performs the The snapshot data in the network block device is started, that is, when the write data corresponding to the write request is detected in the nbd device, the snapshot database can be started.
  • This application sends the read and write snapshot request to the Ceph cluster based on the rbd-nbd process corresponding to the network block device when the Ceph client detects the read and write snapshot request to the snapshot database of the network block device,
  • the corresponding snapshot data is obtained from the Ceph cluster, and then the type of the read-write snapshot request is obtained. If the type of the read-write snapshot request is the write type, the write The write content in the request is designed to be carried out and cached in the rbd-nbd process, so that the nbd device can detect the snapshot data and the write data corresponding to the write request, so that the nbd device can be processed based on the snapshot data and the write data corresponding to the write request.
  • a writable snapshot file system or a writable snapshot database system, thus solves the technical problem of creating a writable snapshot file system of an nbd device or a writable snapshot database system in the prior art.
  • the present application provides another embodiment of a method for reading and writing a snapshot of a network block device.
  • the first key value is compared with the second key value in the cached entry in the cache. After the steps include:
  • Step S37 If the first key value is greater than the second key value, the request content of the write request corresponding to the first key value and the request content corresponding to the second key are combined and stored.
  • Merged storage refers to writing and storing different parts of the writing content corresponding to the first key value and the writing content corresponding to the second key value, and removing the wrong content in the writing content corresponding to the second key value. The same part of the writing content corresponding to the key value and the writing content corresponding to the second key value is not processed.
  • the request content of the write request corresponding to the first key value and the request content corresponding to the second key are combined and stored. Determine the correctness of the write operation.
  • this application provides another embodiment of a method for reading and writing a snapshot of a network block device.
  • the step of obtaining the type of the read and write snapshot request includes:
  • Step A1 If the type of the read-write snapshot request is the read type, the snapshot data fed back by the Ceph cluster for the read-write snapshot request is fed back to the network block device to start the network block device Snapshot the database.
  • the snapshot data fed back by the Ceph cluster for the read-write snapshot request is fed back to the network block device to start the network block
  • the snapshot database in the device, that is, for the read request, the snapshot data can be returned directly.
  • the step of feeding back the snapshot data fed back by the Ceph cluster for the read-write snapshot request to the network block device includes:
  • Step B1 if the type of the read-write snapshot request is a read type, it is determined whether the cache in the rbd-nbd process is empty;
  • the purpose of determining whether the cache in the rbd-nbd process is empty is to: Determine whether the nbd device corresponding to the degree request has corresponding read data in the rbd-nbd process before.
  • Step B2 If the cache in the rbd-nbd process is not empty, obtain the target read key value carried in the read request, and obtain the read request of the read request from the cache according to the target read key value. data;
  • the cache in the rbd-nbd process is not empty, the corresponding read data is obtained. Specifically, the target read key value carried in the read request is obtained from the cache according to the target read key value. Read the requested read data,
  • Step B3 feeding back the snapshot data and the read data fed back by the Ceph cluster for the read-write snapshot request to the network block device.
  • the snapshot data fed back by the Ceph cluster for the read-write snapshot request and the read data are fed back to the network block device.
  • the method further includes:
  • the snapshot data fed back by the Ceph cluster for the read-write snapshot request can be fed back to the network block device.
  • the type of the read-write snapshot request is the read type, it is determined whether the cache in the rbd-nbd process is empty; if the cache in the rbd-nbd process is not empty, then obtain The target read key value carried in the read request, the read data of the read request is obtained from the cache according to the target read key value; the snapshot data fed back by the Ceph cluster for the read and write snapshot request is compared with The read data is fed back to the network block device, and a read request to nbd is implemented in this embodiment.
  • FIG. 3 is a schematic diagram of the device structure of the hardware operating environment involved in the solution of the embodiment of the present application.
  • the snapshot reading and writing device of the network block device in the embodiment of this application can be a PC, a smart phone, a tablet computer, an e-book reader, MP3 (Moving Picture Experts Group Audio Layer III, moving picture experts compress standard audio layer 3) player, MP4 (Moving Picture Experts) Group Audio Layer IV, dynamic image experts compress standard audio layer 3) Players, portable computers and other terminal equipment.
  • the network block device snapshot read-write device may include a processor 1001, such as a CPU, a memory 1005, and a communication bus 1002.
  • the communication bus 1002 is used to implement connection and communication between the processor 1001 and the memory 1005.
  • the memory 1005 can be a high-speed RAM memory or a stable memory (non-volatile memory), such as disk storage.
  • the memory 1005 may also be a storage device independent of the foregoing processor 1001.
  • the network block device snapshot read-write device may also include a target user interface, network interface, camera, RF (Radio Frequency (radio frequency) circuits, sensors, audio circuits, WiFi modules, etc.
  • the target user interface may include a display screen (Display) and an input unit such as a keyboard (Keyboard), and the optional target user interface may also include a standard wired interface and a wireless interface.
  • the optional network interface can include standard wired interface and wireless interface (such as WI-FI interface).
  • network block device snapshot read-write device structure shown in FIG. 3 does not constitute a limitation on the network block device snapshot read-write device, and may include more or less components than shown in the figure, or a combination Certain components, or different component arrangements.
  • the memory 1005 as a computer storage medium may include an operating system, a network communication module, and readable instructions for a network block device snapshot reading and writing method.
  • the operating system is a readable instruction for managing and controlling the hardware and software resources of the network block device snapshot reading and writing device, and supports the operation of the network block device snapshot reading and writing method readable instructions and other software and/or readable instructions.
  • the network communication module is used to implement communication between various components in the memory 1005, and to communicate with other hardware and software in the network block device snapshot read-write device.
  • the processor 1001 is configured to execute the readable instructions of the network block device snapshot reading and writing method stored in the memory 1005 to implement the network block device snapshot reading described above. Write method steps.
  • the specific implementation of the network block device snapshot read-write device of this application is basically the same as the foregoing embodiments of the network block device snapshot read-write method, and will not be repeated here.
  • This application also provides a network block device snapshot reading and writing device, the network block device snapshot reading and writing device is applied to a Ceph client in a Ceph distributed system, the Ceph distributed system also includes a Ceph cluster, and the network block
  • the device snapshot reading and writing device includes:
  • the detection module is used to send the read and write snapshot request to the Ceph based on the rbd-nbd process corresponding to the network block device when the Ceph client detects a read and write snapshot request to the snapshot database of the network block device Cluster to obtain the snapshot data fed back by the Ceph cluster in response to the read-write snapshot request;
  • An obtaining module used to obtain the type of the read-write snapshot request
  • a write module configured to perform a write operation in the rbd-nbd process according to the write type when the type of the read-write snapshot request is a write request type to obtain write data;
  • the feedback module is used to feed back the write data and the snapshot data to the network block device to start the snapshot database in the network block device.
  • the specific implementation of the network block device snapshot reading and writing apparatus of the present application is basically the same as the foregoing embodiments of the network block device snapshot reading and writing method, and will not be repeated here.
  • the present application provides a storage medium, the storage medium may be a non-volatile readable storage medium, the storage medium stores one or more readable instructions, the one or more readable instructions may also be One or more processors are executed to implement the steps of the network block device snapshot reading and writing method described above.
  • the specific implementation of the storage medium of the present application is basically the same as the foregoing embodiments of the network block device snapshot reading and writing method, and will not be repeated here.

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Databases & Information Systems (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Signal Processing (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

La présente invention concerne un procédé de lecture-écriture d'aperçu pour un dispositif de bloc de réseau, un appareil, un dispositif et un support de stockage. Le procédé comprend les étapes suivantes : lorsqu'un client Ceph détecte qu'une base de données d'aperçus d'un dispositif de bloc de réseau a reçu une demande de lecture-écriture d'aperçu, envoyer, sur la base d'un processus rbd-nbd correspondant au dispositif de bloc de réseau, la demande de lecture-écriture d'aperçu à une grappe Ceph de façon à acquérir des données d'aperçu renvoyées par la grappe Ceph en réponse à la demande de lecture-écriture d'aperçu ; acquérir le type de demande de lecture-écriture d'aperçu ; si le type de demande de lecture-écriture d'aperçu est l'écriture, effectuer une opération d'écriture dans le processus rbd-nbd selon le type d'écriture, de façon à acquérir des données écrites ; et renvoyer les données écrites et les données d'aperçu au dispositif de bloc de réseau de façon à démarrer la base de données d'aperçus dans le dispositif de bloc de réseau. La présente invention vise à résoudre le problème technique de l'état de la technique au moyen d'un système distribué, et dans lequel la création d'un système de fichiers d'aperçu inscriptible ou d'un système de base de données d'aperçus inscriptible d'un dispositif nbd est difficile.
PCT/CN2019/101713 2019-05-31 2019-08-21 Procédé de lecture-écriture d'aperçu pour dispositif de bloc de réseau, appareil, dispositif et support de stockage Ceased WO2020237849A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910480680.4 2019-05-31
CN201910480680.4A CN110321321B (zh) 2019-05-31 2019-05-31 网络块设备快照读写方法、装置、设备及存储介质

Publications (1)

Publication Number Publication Date
WO2020237849A1 true WO2020237849A1 (fr) 2020-12-03

Family

ID=68119584

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/101713 Ceased WO2020237849A1 (fr) 2019-05-31 2019-08-21 Procédé de lecture-écriture d'aperçu pour dispositif de bloc de réseau, appareil, dispositif et support de stockage

Country Status (2)

Country Link
CN (1) CN110321321B (fr)
WO (1) WO2020237849A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113779083A (zh) * 2021-01-29 2021-12-10 北京京东拓先科技有限公司 数据处理方法、装置、服务器以及存储介质
CN114040346A (zh) * 2021-09-22 2022-02-11 福建省新天地信勘测有限公司 一种基于5g网络的档案数字化信息管理系统
CN119473151A (zh) * 2024-11-07 2025-02-18 华东计算技术研究所（中国电子科技集团公司第三十二研究所） 一种基于持久内存的Ceph缓存系统性能优化方法

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111143183A (zh) * 2019-12-27 2020-05-12 紫光云(南京)数字技术有限公司 一种基于librbd库测试rbd上传速度的方法
CN115291998B (zh) * 2022-07-20 2025-08-12 天翼云科技有限公司 一种rbd-nbd映射方法及装置

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110313973A1 (en) * 2010-06-19 2011-12-22 Srivas Mandayam C Map-Reduce Ready Distributed File System
CN107291883A (zh) * 2017-06-20 2017-10-24 郑州云海信息技术有限公司 一种分布式存储系统的快照方法及装置
CN109033328A (zh) * 2018-07-19 2018-12-18 郑州云海信息技术有限公司 一种访问请求处理方法、装置、设备及可读存储介质
CN109814946A (zh) * 2018-12-29 2019-05-28 创新科存储技术（深圳）有限公司 一种在XenServer中实现分布式存储的方法和装置

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7617292B2 (en) * 2001-06-05 2009-11-10 Silicon Graphics International Multi-class heterogeneous clients in a clustered filesystem
US7774568B2 (en) * 2007-08-13 2010-08-10 Novell, Inc. Clustered snapshots in networks
CN108460045B (zh) * 2017-02-21 2022-11-18 中兴通讯股份有限公司 一种快照的处理方法及分布式块存储系统

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110313973A1 (en) * 2010-06-19 2011-12-22 Srivas Mandayam C Map-Reduce Ready Distributed File System
CN107291883A (zh) * 2017-06-20 2017-10-24 郑州云海信息技术有限公司 一种分布式存储系统的快照方法及装置
CN109033328A (zh) * 2018-07-19 2018-12-18 郑州云海信息技术有限公司 一种访问请求处理方法、装置、设备及可读存储介质
CN109814946A (zh) * 2018-12-29 2019-05-28 创新科存储技术（深圳）有限公司 一种在XenServer中实现分布式存储的方法和装置

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
WANG, PENGJIE ET AL.: "Non-official translation: A Continuous Data Protection Method for Ceph Distributed Block Storage", NETWORK SECURITY TECHNOLOGY & APPLICATION, 15 February 2017 (2017-02-15), DOI: 20200106095737A *

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113779083A (zh) * 2021-01-29 2021-12-10 北京京东拓先科技有限公司 数据处理方法、装置、服务器以及存储介质
CN114040346A (zh) * 2021-09-22 2022-02-11 福建省新天地信勘测有限公司 一种基于5g网络的档案数字化信息管理系统
CN114040346B (zh) * 2021-09-22 2024-02-06 福建省新天地信勘测有限公司 一种基于5g网络的档案数字化信息管理系统与管理方法
CN119473151A (zh) * 2024-11-07 2025-02-18 华东计算技术研究所（中国电子科技集团公司第三十二研究所） 一种基于持久内存的Ceph缓存系统性能优化方法

Also Published As

Publication number Publication date
CN110321321A (zh) 2019-10-11
CN110321321B (zh) 2023-06-23

Similar Documents

Publication Publication Date Title
WO2020237849A1 (fr) Procédé de lecture-écriture d'aperçu pour dispositif de bloc de réseau, appareil, dispositif et support de stockage
WO2020224246A1 (fr) Procédé et appareil de gestion de données fondée sur une chaîne de blocs, dispositif et support d'informations
WO2018103315A1 (fr) Procédé de traitement de données de surveillance, appareil, serveur et équipement de stockage
WO2020125251A1 (fr) Procédé d'apprentissage de paramètres de modèle basé sur un apprentissage fédéré, dispositif, appareil et support
WO2020237859A1 (fr) Procédé de migration de données employant un dispositif nbd, appareil, dispositif et support de stockage
WO2021072881A1 (fr) Procédé, appareil et dispositif de traitement de demande fondée sur un stockage d'objet, et support de stockage
WO2020253135A1 (fr) Procédé et dispositif d'analyse automatique, équipement utilisateur et support de stockage
WO2018076841A1 (fr) Procédé de partage de données, appareil, support de stockage, et serveur
WO2017157146A1 (fr) Procédé et appareil de recommandation personnalisée basée sur un portrait d'utilisateur, serveur et support d'informations
WO2014189275A1 (fr) Appareil et méthode de reconnaissance de dispositif externe dans un système de communication
WO2018120681A1 (fr) Procédé, dispositif et système de synchronisation de données, serveur de traitement de données et support de stockage
WO2021051492A1 (fr) Procédé, appareil et dispositif de communication de nœud de service de base de données, et support d'informations informatique
WO2021027134A1 (fr) Procédé, appareil et dispositif de stockage de données et support d'enregistrement informatique
WO2016183721A1 (fr) Procédé, appareil et dispositif de mise à niveau pour dispositif terminal
WO2018201774A1 (fr) Procédé d'approbation de données, appareil, dispositif et support de stockage pouvant être lu par un ordinateur
WO2016101441A1 (fr) Procédé et système de synchronisation de fichier
WO2020199599A1 (fr) Procédé et appareil de présentation d'informations de file d'attente de travaux, et dispositif informatique et support d'informations
WO2020077832A1 (fr) Procédé, appareil et dispositif d'accès à un bureau dans le nuage et support de stockage
WO2015180434A1 (fr) Procédé de gestion de données, nœud et système pour grappe de bases de données
WO2018120680A1 (fr) Système de sauvegarde de disque virtuel, procédé, appareil, hôte de service et support d'enregistrement
WO2017206879A1 (fr) Procédé et appareil de traitement de programme d'application de terminal mobile, support de stockage, et dispositif électronique
WO2021012487A1 (fr) Procédé de synchronisation d'informations intersystème, dispositif utilisateur, support de stockage, et appareil
WO2020062554A1 (fr) Procédé de lecture des données pour la mémoire, appareil d'affichage et support d'enregistrement lisible par ordinateur
WO2018076890A1 (fr) Procédé de sauvegarde de données, dispositif, support d'informations, serveur et système
WO2012022215A1 (fr) Procédé, dispositif et système d'interaction permettant un message interactif sur internet

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19931185

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19931185

Country of ref document: EP

Kind code of ref document: A1