WO2017118171A1 - Data migration method and apparatus - Google Patents

Abstract

Disclosed are a data migration method and apparatus, which relate to the technical field of computer applications, and are applied to a computing device in a data storage system. The data storage system comprises a computing device and a plurality of storage devices. The method comprises: receiving a data query request sent by a client; sending a data acquisition request to a storage device according to the data query request; receiving result data fed back by the storage device according to the data acquisition request, and forwarding the result data to the client; analysing the result data according to a pre-set data analysis algorithm, and obtaining hotspot data from the result data; and sending a data migration instruction to the storage device according to the obtained hotspot data, so that the storage device performs data migration according to the data migration instruction. By adopting the solution provided in the embodiments of the present application to perform data migration, the data access speed is effectively improved.

Description

Data migration method and device

The present application claims priority to Chinese Patent Application, filed on Jan. 7,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,,

Technical field

The present application relates to the field of computer application technologies, and in particular, to a data migration method and apparatus.

Background technique

In recent years, with the rapid development of computer technology, cloud computing technology has been developed by express delivery. The application of cloud computing technology for data processing involves data storage issues, and based on this, the concept of cloud storage is extended. Specifically, cloud storage refers to a large number of different types of storage devices in a network working together through application software through functions such as cluster application, network technology, or distributed file system. A system that provides data storage and business access functions together.

It can be seen from the above that multiple storage devices may be involved in cloud storage. When storing data in multiple storage devices, the storage device usually analyzes the stored data, taking into account factors such as the importance of the data, the retention time of the data, the capacity of the storage device, and the performance of the storage device. The hotspot data is outputted, and data is migrated to the determined hotspot data, so that the hotspot data is located in the same storage device, thereby improving the access speed of the data.

However, although the data migration can be implemented by applying the above manner, the factors considered in determining the hotspot data in the above manner are only the characteristics of the data itself and the characteristics of the storage device itself, and the user's demand for the data is not considered, so the determined There may be errors in the hotspot data, which may result in an inefficient increase in data access speed after data migration.

Summary of the invention

The embodiment of the present application discloses a data migration method and device to effectively improve data access speed.

To achieve the above objective, the embodiment of the present application discloses a data migration method, which is applied to a computing device in a data storage system, where the data storage system includes: a computing device and multiple storage devices, and the method includes:

Receiving a data query request sent by the client;

Sending a data obtaining request to the storage device according to the data query request;

Receiving, by the storage device, result data of the request feedback according to the data, and forwarding the result data to the client;

Performing analysis on the result data according to a preset data analysis algorithm, and obtaining hotspot data from the result data;

Sending a data migration instruction to the storage device according to the obtained hotspot data, so that the storage device performs data migration according to the data migration instruction, where the data migration instruction is for migrating hotspot data to for storage The instruction of the storage device of the hot data.

In a specific implementation manner of the present application, the analyzing the result data according to a preset data analysis algorithm, and obtaining hotspot data from the result data, includes:

Obtaining data in the result data that is not marked as hotspot data;

The obtained data is analyzed, and hotspot data is determined from the obtained data.

In a specific implementation manner of the present application, the analyzing the obtained data, and determining hotspot data from the obtained data, includes:

Determining structured data of the obtained data according to a preset data structuring algorithm;

Obtaining a search frequency of the determined structured data according to a preset frequency record table, wherein the preset frequency record table is used to record a search frequency of each structured data;

The hotspot data is determined from the obtained data according to the obtained search frequency.

In a specific implementation manner of the present application, the sending the data migration instruction to the storage device according to the obtained hotspot data includes:

Obtaining a load status of the storage device;

Determining a destination migration address of the obtained hotspot data according to the obtained load status and data attributes of the obtained hot spot data;

Generating a data migration instruction according to the destination migration address and the obtained hot spot data;

Sending the data migration instruction to the storage device.

In a specific implementation of the present application, the data storage system includes: a high speed storage device and a low speed storage device, wherein the high speed storage device is a storage device whose data processing speed is greater than a preset processing speed threshold, The low speed storage device is a storage device whose data processing speed is less than or equal to a preset processing speed threshold;

And obtaining the data that is not marked as hotspot data in the result data, including:

Determining data stored in the low speed storage device in the result data;

Obtaining data not marked as hotspot data from data stored in the low speed storage device;

Determining, according to the obtained load status and the data attribute of the obtained hot spot data, a destination migration address of the obtained hot spot data, including:

The destination migration address of the obtained hotspot data for the high speed storage device is determined according to the load status of the high speed storage device and the data attribute of the obtained hot spot data.

In a specific implementation manner of the application, the data migration method further includes:

Receiving, by the storage device, feedback information for the data migration instruction, where the feedback information includes a destination migration address of the data migrated by the storage device according to the data migration instruction;

Updating the load status of the locally recorded storage device according to the destination migration address included in the feedback information.

To achieve the above objective, the embodiment of the present application discloses a data migration apparatus, which is applied to a computing device in a data storage system, where the data storage system includes: a computing device and a plurality of storage devices, and the device includes:

The query request receiving module is configured to receive a data query request sent by the client;

Obtaining a request sending module, configured to send a data obtaining request to the storage device according to the data query request;

a result data receiving module, configured to receive result data of the storage device according to the data obtaining request feedback, and forward the result data to the client;

a hotspot data obtaining module, configured to analyze the result data according to a preset data analysis algorithm, and obtain hotspot data from the result data;

a data migration instruction sending module, configured to send a data migration instruction to the storage device according to the obtained hotspot data, so that the storage device performs data migration according to the data migration instruction, where the data migration instruction is used for An instruction to migrate hotspot data to a storage device that stores hotspot data.

In a specific implementation manner of the application, the hotspot data obtaining module includes:

a non-hotspot data obtaining sub-module for obtaining unmarked hotspot data in the result data The data;

The hotspot data determining submodule is configured to analyze the obtained data and determine hotspot data from the obtained data.

In a specific implementation manner of the application, the hotspot data determining submodule includes:

a structured data determining unit, configured to determine structured data of the obtained data according to a preset data structuring algorithm;

a search frequency obtaining unit, configured to obtain a search frequency of the determined structured data according to a preset frequency record table, wherein the preset frequency record table is used to record each structured data search Frequency;

The hotspot data determining unit is configured to determine hotspot data from the obtained data according to the obtained search frequency.

In a specific implementation manner of the application, the data migration instruction sending module includes:

a load status obtaining submodule, configured to obtain a load status of the storage device;

a migration address determining submodule, configured to determine a destination migration address of the obtained hotspot data according to the obtained load status and data attributes of the obtained hotspot data;

a migration instruction generation submodule, configured to generate a data migration instruction according to the destination migration address and the obtained hotspot data;

And a migration instruction sending submodule, configured to send the data migration instruction to the storage device.

In a specific implementation of the present application, the data storage system includes: a high speed storage device and a low speed storage device, wherein the high speed storage device is a storage device whose data processing speed is greater than a preset processing speed threshold, The low speed storage device is a storage device whose data processing speed is less than or equal to a preset processing speed threshold;

The non-hotspot data obtaining submodule includes:

a storage data determining unit, configured to determine data stored in the low-speed storage device in the result data;

a non-hotspot data obtaining unit, configured to obtain data that is not marked as hotspot data from data stored in the low-speed storage device;

The migration address determining sub-module is specifically configured to determine, according to the load status of the high-speed storage device and the data attribute of the obtained hot-spot data, the purpose of the obtained hot-spot data for the high-speed storage device Move the address.

In a specific implementation manner of the application, the data migration apparatus further includes:

a feedback information receiving module, configured to receive feedback information sent by the storage device for the data migration instruction, where the feedback information includes a destination migration address of the data migrated by the storage device according to the data migration instruction;

And a load status update module, configured to update a load status of the locally recorded storage device according to the destination migration address included in the feedback information.

To achieve the above objective, the embodiment of the present application discloses a computing device in a data storage system, where the data storage system includes: a computing device and a plurality of storage devices, where the computing device includes:

a processor, a memory, a communication interface, and a bus;

The processor, the memory, and the communication interface are connected by the bus and complete communication with each other;

The memory stores executable program code;

The processor, by reading the executable program code stored in the memory, runs a program corresponding to the executable program code for executing the data migration method provided by the embodiment of the present application.

In order to achieve the above objective, the embodiment of the present application discloses an application program, which is used to execute the data migration method provided by the embodiment of the present application at runtime.

To achieve the above objective, the embodiment of the present application discloses a storage medium, where the storage medium is used to store an application, and the application is used to execute the data migration method provided by the embodiment of the present application.

It can be seen from the above that, in the solution provided by the embodiment of the present application, after receiving the data query request sent by the client, the computing device sends a data obtaining request to the storage device according to the data query request, and the storage device obtains the result data according to the data obtaining request and provides feedback. The computing device sends the result data to the client, analyzes the result data, obtains hotspot data therefrom, and then sends a data migration instruction to the storage device according to the obtained hotspot data, and the storage device according to the data migration instruction Perform data migration. Compared with the prior art, the computing device in the solution provided by the embodiment of the present application determines the hotspot data according to the data corresponding to the data query request sent by the client, that is, the hotspot data is generated from the data that the client really needs. Therefore, the probability that the obtained hotspot data is really hot data is high, so that after the data migration, the probability that the data stored in the storage device for storing the hotspot data is true hot data is high, and the client needs to query. Hot The probability of the point data is high, so that the solution provided by the embodiment of the present application can improve the data access speed.

DRAWINGS

In order to more clearly illustrate the embodiments of the present application and the technical solutions of the prior art, the following description of the embodiments and the drawings used in the prior art will be briefly introduced. Obviously, the drawings in the following description are only Some embodiments of the application may also be used to obtain other figures from those of ordinary skill in the art without departing from the scope of the invention.

FIG. 1 is a schematic diagram of a signaling process of a data migration method according to an embodiment of the present application;

2 is a schematic flowchart of a first data migration method according to an embodiment of the present application;

3 is a schematic flowchart of a second data migration method according to an embodiment of the present application;

4 is a schematic flowchart of a third data migration method according to an embodiment of the present application;

FIG. 5 is a schematic structural diagram of a first data migration apparatus according to an embodiment of the present application;

FIG. 6 is a schematic structural diagram of a second data migration apparatus according to an embodiment of the present disclosure;

FIG. 7 is a schematic structural diagram of a third data migration apparatus according to an embodiment of the present application.

detailed description

In order to make the objects, technical solutions, and advantages of the present application more comprehensible, the present application will be further described in detail below with reference to the accompanying drawings. It is apparent that the described embodiments are only a part of the embodiments of the present application, and not all of them. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments of the present application without departing from the inventive scope are the scope of the present application.

The embodiment of the present application provides a data migration method and device. The foregoing data migration method is generally introduced in conjunction with the signaling flow diagram of the data migration method provided in FIG. 1 .

The data migration method provided by the embodiment of the present application is applied to a computing device in a data storage system, where the data storage system includes a computing device and a plurality of data storage devices, wherein the computing device is mainly used to request a data storage device according to a data query of the client. Obtaining the result data for the data query request, and analyzing the result data to determine the data to be migrated, the migration policy, and the like; the storage device is mainly used to store the data, and the migration data, the migration policy, and the like determined by the computing device. Data migration, specifically, the data stored in the storage device may be collected by an external device such as an IPC (Industrial Personal Computer), a card slot, and sent to the storage. The data in the device may also be data obtained by the operation and maintenance personnel and stored in the storage device, which is not limited in this application.

Specifically, the client sends a data query request to the computing device (S101), and after receiving the data query request, the computing device sends a data obtaining request to the storage device according to the data query request (S102), and the storage device obtains the request according to the data obtaining request. Data (S103), and the result data is sent to the computing device (S104). After receiving the result data, the computing device sends the result data to the client on the one hand (S105), and analyzes the result data on the one hand to obtain Hotspot data (S106), and after obtaining the hotspot data, sending a data migration instruction to the storage device according to the obtained hotspot data (S107), after the storage device receives the data migration instruction, performing data migration according to the data migration instruction (S108) ).

The data migration method provided by the present application is described in detail below through specific embodiments.

FIG. 2 is a schematic flowchart of a data migration method according to an embodiment of the present disclosure. The method is applied to a computing device in a data storage system, where the data storage system includes: a computing device and multiple storage devices.

Specifically, the foregoing data migration method includes:

S201: Receive a data query request sent by the client.

The foregoing data query request may include: an identifier of the data to be queried, a type of the data to be queried, and the like, and the present application does not limit the specific content of the information included in the data query request.

S202: Send a data obtaining request to the storage device according to the data query request.

The data to be queried is stored in the storage device, and after receiving the data query request, the computing device generates a data obtaining request according to the data query request, and sends the data obtaining request to the storage device, so that the storage device queries the data according to the data query request. Perform data query.

It should be noted that the storage device involved in this step may be one storage device in the foregoing data storage system, or may be multiple storage devices in the data storage system, or even all storage devices.

In a specific implementation manner of the present application, the storage device may store the storage location information of each data, for example, in which storage device the data is stored, so that the computing device may first respond to the data query request. The data query request is analyzed according to local storage The storage location information of each data determines a storage location of each to-be-queried data included in the data query request, and then, a data acquisition request is sent to the storage device in a targeted manner according to the determined storage location.

In another specific implementation manner of the present application, the storage location information of each data may not be stored in the computing device, so that after receiving the data query request, the computing device may send data to each storage device according to the data query request. The request, and then the storage device receives the data obtaining request and then parses the data obtaining request to obtain the corresponding data.

In another specific implementation manner of the present application, in a case that the storage location information of each data is not stored in the computing device, after receiving the data query request, the computing device may also have a management function only in the storage device according to the data query request. A storage device sends a data obtaining request, and the storage device having the management function receives the data obtaining request, parses the data, and sends the data to the corresponding storage device for query according to the parsing result, and obtains a corresponding result. data.

S203: The receiving storage device obtains result data of the request feedback according to the data, and forwards the result data to the client.

S204: Perform analysis on the result data according to a preset data analysis algorithm, and obtain hotspot data from the result data.

Specifically, the hotspot data can be understood as data whose access frequency is greater than a preset frequency threshold, data whose data update speed is greater than a preset update speed threshold, data whose importance level is greater than a preset level threshold for the user, and the like. Just use the above as an example to illustrate that the specific expression of hotspot data in practical applications is not limited to this.

It can be understood that the above result data may include data that has been determined as hotspot data, and may also include data that has not been determined as hotspot data. From the perspective of speeding up data processing, only the data that is not determined as hotspot data may be checked. Whether the hotspot data is stored in the data, and the data that has been determined as the hotspot data may not be repeatedly determined. Based on this, in an optional implementation manner of the present application, the result data is analyzed according to a preset data analysis algorithm. When the hotspot data is obtained from the result data, the data that is not marked as the hotspot data in the result data may be obtained first, and then the obtained data is analyzed, and the hotspot data is determined from the obtained data.

Specifically, when the obtained data is analyzed, and the hotspot data is determined from the obtained data, the structured data of the obtained data may be determined according to a preset data structure algorithm, and then According to the preset frequency record table, the search frequency of the determined structured data is obtained, and the hot spot data is determined from the obtained data according to the obtained search frequency.

The preset frequency record table is used to record the search frequency of each structured data.

Specifically, in the case that the obtained data is unstructured data stream data, the stream data may be processed by the cloud summary technology to obtain structured data. Of course, the foregoing preset data structure algorithm is not limited to the cloud summary technology, and is not limited in this application.

In the actual application, the data is searched and the like. The above search operation can be simply understood as the search operation of the structured data by the server through the cloud search technology. In addition, the server can record each structured data based on the above search operation. Search frequency, the search frequency can reflect the heat of the data to a certain extent. It can be understood that the higher the search frequency, the higher the heat of the data, the lower the search frequency, and the lower the heat of the data.

Of course, on the other hand, data that has been determined as hotspot data may become non-hotspot data as the actual application environment changes. In addition, from the perspective of balancing the load status of each storage device, It is necessary to perform data migration on data that has been determined to be hot data according to the current situation, and the hot data can also be obtained for all data in the result data.

In addition, the foregoing preset data analysis algorithm may be different according to the specific application environment of the embodiment.

For example, the data stored in the storage device is the intersection traffic flow information, and the preset data analysis algorithm may be to analyze the traffic flow of each intersection, and determine the traffic flow data corresponding to the intersection whose traffic flow is greater than the preset threshold as the hot data. Algorithm

For example, if the data stored in the storage device is video information, the preset data analysis algorithm may be an algorithm for analyzing the number of times of playing each video, and determining a video whose playing times are greater than a preset threshold as hotspot data.

S205: Send a data migration instruction to the storage device according to the obtained hotspot data, so that the storage device performs data migration according to the data migration instruction.

It can be understood that the data access frequency of the hotspot data is higher than that of the non-hotspot data, and the hotspot data is only a part of the data stored by the storage device. Therefore, in actual applications, the hotspot data is stored to a storage device dedicated to storing hotspot data. In the data query, the query speed can be speeded up and the query time can be saved.

It is worth mentioning that the above data migration instruction is an instruction for migrating hotspot data to a storage device for storing hotspot data.

It can be known from the description of S204 that in the actual application, there may be a case where the hotspot data has been determined to be non-hotspot data, and the data that has been determined as the hotspot data also needs to be migrated. Therefore, in this case, In a specific implementation manner of the application, the data migration instruction may be an instruction for migrating non-hotspot data from a storage device for storing hotspot data to a storage device for storing non-hotspot data, or may also be An instruction to migrate hotspot data from one storage device for storing hotspot data to another storage device for storing hotspot data.

Specifically, the data migration instruction includes information about the obtained hot spot data, for example, the data identifier of the obtained hot spot data, the data size of the obtained hot spot data, and the like, and may also include the obtained The destination address of the hotspot data.

Certainly, the foregoing data migration instruction may not include the destination migration address of the obtained hotspot data. In this case, the computing device may send the data migration instruction to the storage device having the management function in the storage device, and then have the management function. The storage device determines the destination migration address of the obtained hotspot data.

It can be seen that, in the solution provided by the embodiment, after receiving the data query request sent by the client, the computing device sends a data obtaining request to the storage device according to the data query request, and the storage device obtains the result data according to the data obtaining request and feeds back to the data. a computing device, the computing device sends the result data to the client, analyzes the result data, obtains hotspot data therefrom, and then sends a data migration instruction to the storage device according to the obtained hotspot data, and the storage device performs the data migration instruction according to the data migration instruction. data migration. Compared with the prior art, the computing device in the solution provided by the embodiment determines the hotspot data according to the data corresponding to the data query request sent by the client, that is, the hotspot data is generated from the data that the client really needs. Therefore, the probability that the obtained hotspot data is really hot data is high, so that after the data migration, the probability that the data stored in the storage device for storing the hotspot data is true hot data is high, and the client needs to query the hotspot. The probability of data is high, so the application of the solution provided in this embodiment can improve the data access speed.

It can be known from the foregoing description that the destination migration address of the obtained hotspot data may be determined by the computing device, or may be determined by the storage device, and the following is obtained through a specific implementation manner. The destination migration address of the obtained hotspot data is described by the computing device.

In a specific implementation manner of the present application, referring to FIG. 3, a schematic flowchart of a second data migration method is provided. Compared with the foregoing embodiment, in this embodiment,

And analyzing the result data according to a preset data analysis algorithm, and obtaining hotspot data from the result data (S204), including:

S204A: Obtain data in the result data that is not marked as hotspot data.

It can be understood by those skilled in the art that the storage device can be divided into: a high speed storage device and a low speed storage device, wherein the high speed storage device is a storage device whose data processing speed is greater than a preset processing speed threshold, and the low speed storage device is data. A storage device whose processing speed is less than or equal to the preset processing speed threshold. Therefore, it can be considered that the processing capability of the high-speed storage device is strong, and the access frequency of the hot-spot data is high, and the access degree of the hot-spot data may also be high, so For the response speed of the hotspot data, the hotspot data may be optionally stored in the high speed storage device; from the foregoing description, it can be known that the processing capability of the low speed storage device is weak, the access frequency of the non-hotspot data is low, and the non-hotspot data is non-hot data. Access concurrency is generally not high, so from the perspective of saving computing resources and operation and maintenance costs, optional non-hotspot data can be stored in low-speed storage devices.

Therefore, in an optional implementation manner of the present application, when data that is not marked as hotspot data in the result data is obtained, the data stored in the low-speed storage device in the result data may be determined first, and then stored in the low-speed storage. Data that is not marked as hotspot data is obtained from the data in the device.

In addition, in an optional implementation manner of the present application, when the storage device obtains data and performs storage, the obtained data may be first stored in the low-speed storage device, and then the data is determined as hot data in a subsequent application process. This data is then migrated to the high-speed storage device.

S204B: Analyze the obtained data, and determine hotspot data from the obtained data.

Sending a data migration instruction to the storage device according to the obtained hot spot data (S205), including:

S205A: Obtain the load status of the storage device.

Specifically, the computing device may store the load status of each storage device and the data type of the data stored by each storage device. For example, a storage device is a storage device for storing hotspot data, and a storage device is used for storage. A storage device that charges hot data, etc., so that the process of frequently requesting the load state of the storage device during the running process can be omitted. To ensure that the load state error of the storage device stored in the computing device is small, the computing device needs to follow the running process. Certain rules Update the storage device load status stored in it.

The load status of each storage device may not be stored in the computing device, but the load status of each storage device may be requested when referring to the load status of each storage device, so that a relatively accurate load status of the storage device can be obtained.

S205B: Determine a destination migration address of the obtained hotspot data according to the obtained load status and data attributes of the obtained hot spot data.

The above data attributes may be the size of the data, the type of the data, the creation time of the data, and the like, which are not limited in this application.

In the optional embodiment mentioned in the foregoing S204A, if the hotspot data is obtained according to the data stored in the low-speed storage device, determining the obtained hotspot data according to the obtained load state and the data attribute of the obtained hotspot data. When the destination address is migrated, the destination migration address of the obtained hotspot data for the high-speed storage device may be determined according to the load status of the high-speed storage device and the data attribute of the obtained hotspot data.

S205C: Generate a data migration instruction according to the destination migration address and the obtained hotspot data.

The data migration instruction includes the destination migration address and the obtained hotspot data, so that the storage device can start data migration without determining the destination migration address of the obtained hot data after receiving the data migration instruction.

It should be noted that the hotspot data obtained may be multiple hotspot data, and the destination migration address corresponding to the hotspot data may also be multiple destination migration addresses, so when generating the data migration instruction, the address may be migrated for each destination. Generate a data migration instruction.

S205D: Send a data migration instruction to the storage device.

It can be seen from the above that, in the solution provided by the embodiment, the computing device determines the destination migration address of the obtained hotspot data, so that when the computing device sends the data migration instruction to the storage device, since the destination migration address is determined, Targeted data migration instructions are sent to the storage device.

In another specific implementation manner of the present application, referring to FIG. 4, a schematic flowchart of a third data migration method is provided. Compared with the foregoing embodiment, in the embodiment, the data migration method further includes:

S206: Receive feedback information sent by the storage device for the data migration instruction.

The feedback information includes a destination migration address of the data migrated by the storage device according to the data migration instruction.

Specifically, the feedback information may also include information such as an identifier, a size, a type, and the like of the migrated data, which is not limited in this application.

S207: Update the load status of the locally recorded storage device according to the destination migration address included in the feedback information.

In the solution provided by the embodiment, after the storage device completes the data migration operation for the data migration instruction, the data migration information is fed back to the computing device, and the computing device updates the storage device load state recorded therein according to the information fed back by the storage device, which is helpful. In order to ensure the accuracy of the load status of the storage device recorded therein, it is helpful to determine the destination migration address of the hot data in the subsequent data migration process.

Corresponding to the above data migration method, the embodiment of the present application further provides a data migration device.

FIG. 5 is a schematic structural diagram of a first data migration apparatus according to an embodiment of the present application. The apparatus is applied to a computing device in a data storage system, where the data storage system includes: a computing device and multiple storage devices.

Specifically, the foregoing data migration device includes:

The query request receiving module 501 is configured to receive a data query request sent by the client;

Obtaining a request sending module 502, configured to send a data obtaining request to the storage device according to the data query request;

a result data receiving module 503, configured to receive result data of the storage device according to the data obtaining request feedback, and forward the result data to the client;

The hotspot data obtaining module 504 is configured to analyze the result data according to a preset data analysis algorithm, and obtain hotspot data from the result data;

The data migration instruction sending module 505 is configured to send a data migration instruction to the storage device according to the obtained hotspot data, so that the storage device performs data migration according to the data migration instruction, where the data migration instruction is used An instruction to migrate hotspot data to a storage device for storing hotspot data.

Specifically, the hotspot data obtaining module 504 can include:

a non-hotspot data obtaining submodule, configured to obtain data in the result data that is not marked as hotspot data;

The hotspot data determining submodule is configured to analyze the obtained data and determine hotspot data from the obtained data.

Specifically, the hotspot data determining submodule may include:

a structured data determining unit, configured to determine structured data of the obtained data according to a preset data structuring algorithm;

a search frequency obtaining unit, configured to obtain a search frequency of the determined structured data according to a preset frequency record table, wherein the preset frequency record table is used to record each structured data search Frequency;

The hotspot data determining unit is configured to determine hotspot data from the obtained data according to the obtained search frequency.

It can be seen that, in the solution provided by the embodiment, after receiving the data query request sent by the client, the computing device sends a data obtaining request to the storage device according to the data query request, and the storage device obtains the result data according to the data obtaining request and feeds back to the data. a computing device, the computing device sends the result data to the client, analyzes the result data, obtains hotspot data therefrom, and then sends a data migration instruction to the storage device according to the obtained hotspot data, and the storage device performs the data migration instruction according to the data migration instruction. data migration. Compared with the prior art, the computing device in the solution provided by the embodiment determines the hotspot data according to the data corresponding to the data query request sent by the client, that is, the hotspot data is generated from the data that the client really needs. Therefore, the probability that the obtained hotspot data is really hot data is high, so that after the data migration, the probability that the data stored in the storage device for storing the hotspot data is true hot data is high, and the client needs to query the hotspot. The probability of data is high, so the application of the solution provided in this embodiment can improve the data access speed.

In a specific implementation manner of the present application, referring to FIG. 6, a schematic structural diagram of a second data migration apparatus is provided. Compared with the foregoing embodiment, in this embodiment,

The hotspot data obtaining module 504 includes:

The non-hotspot data obtaining sub-module 5041 is configured to obtain that the result data is not marked as a hot spot Data of data;

a hotspot data determining sub-module 5042, configured to analyze the obtained data, and determine hotspot data from the obtained data;

The data migration instruction sending module 505 includes:

a load status obtaining submodule 5051, configured to obtain a load status of the storage device;

The migration address determining sub-module 5052 is configured to determine a destination migration address of the obtained hotspot data according to the obtained load status and data attributes of the obtained hotspot data;

a migration instruction generation submodule 5053, configured to generate a data migration instruction according to the destination migration address and the obtained hotspot data;

The migration instruction sending submodule 5054 is configured to send the data migration instruction to the storage device.

Optionally, the data storage system includes: a high speed storage device and a low speed storage device, wherein the high speed storage device is a storage device whose data processing speed is greater than a preset processing speed threshold, and the low speed storage device is a data processing speed. a storage device that is less than or equal to a preset processing speed threshold;

The non-hotspot data obtaining submodule includes:

a storage data determining unit, configured to determine data stored in the low-speed storage device in the result data;

a non-hotspot data obtaining unit, configured to obtain data that is not marked as hotspot data from data stored in the low-speed storage device;

The migration address determining sub-module is specifically configured to determine, according to a load status of the high-speed storage device and a data attribute of the obtained hot-spot data, a destination migration address of the obtained hot-spot data for the high-speed storage device.

It can be seen from the above that, in the solution provided by the embodiment, the computing device determines the destination migration address of the obtained hotspot data, so that when the computing device sends the data migration instruction to the storage device, since the destination migration address is determined, Targeted data migration instructions are sent to the storage device.

In another specific implementation manner of the present application, referring to FIG. 7, a schematic structural diagram of a third data migration apparatus is provided. Compared with the foregoing embodiment, the data migration apparatus further includes:

The feedback information receiving module 506 is configured to receive the data migration sent by the storage device The feedback information of the instruction, where the feedback information includes a destination migration address of the data migrated by the storage device according to the data migration instruction;

The load status update module 507 is configured to update the load status of the locally recorded storage device according to the destination migration address included in the feedback information.

In the solution provided by the embodiment, after the storage device completes the data migration operation for the data migration instruction, the data migration information is fed back to the computing device, and the computing device updates the storage device load state recorded therein according to the information fed back by the storage device, which is helpful. In order to ensure the accuracy of the load status of the storage device recorded therein, it is helpful to determine the destination migration address of the hot data in the subsequent data migration process.

In addition, the embodiment of the present application further provides a computing device in a data storage system, where the data storage system includes: a computing device and multiple storage devices, the computing device includes:

a processor, a memory, a communication interface, and a bus;

The processor, the memory, and the communication interface are connected by the bus and complete communication with each other;

The memory stores executable program code;

The processor runs a program corresponding to the executable program code by reading executable program code stored in the memory for:

Receiving a data query request sent by the client;

Sending a data obtaining request to the storage device according to the data query request;

Receiving, by the storage device, result data of the request feedback according to the data, and forwarding the result data to the client;

Performing analysis on the result data according to a preset data analysis algorithm, and obtaining hotspot data from the result data;

Sending a data migration instruction to the storage device according to the obtained hotspot data, so that the storage device performs data migration according to the data migration instruction, where the data migration instruction is for migrating hotspot data to for storage The instruction of the storage device of the hot data.

The computing device exists in a variety of forms including, but not limited to:

(1) Mobile communication devices: These devices are characterized by mobile communication functions and are mainly aimed at providing voice and data communication. Such terminals include: smartphones (eg iPhone), multimedia Mobile phones, functional phones, and low-end phones.

(2) Ultra-mobile personal computer equipment: This type of equipment belongs to the category of personal computers, has computing and processing functions, and generally has mobile Internet access. Such terminals include: PDAs, MIDs, and UMPC devices, such as the iPad.

(3) Portable entertainment devices: These devices can display and play multimedia content. Such devices include: audio, video players (such as iPod), handheld game consoles, e-books, and smart toys and portable car navigation devices.

(4) Server: A device that provides computing services. The server consists of a processor, a hard disk, a memory, a system bus, etc. The server is similar to a general-purpose computer architecture, but because of the need to provide highly reliable services, processing power and stability High reliability in terms of reliability, security, scalability, and manageability.

(5) Other electronic devices with data interaction functions.

It can be seen from the above that, in the solution provided by the embodiment of the present application, after receiving the data query request sent by the client, the computing device sends a data obtaining request to the storage device according to the data query request, and the storage device obtains the result data according to the data obtaining request and provides feedback. The computing device sends the result data to the client, analyzes the result data, obtains hotspot data therefrom, and then sends a data migration instruction to the storage device according to the obtained hotspot data, and the storage device according to the data migration instruction Perform data migration. Compared with the prior art, the computing device in the solution provided by the embodiment of the present application determines the hotspot data according to the data corresponding to the data query request sent by the client, that is, the hotspot data is generated from the data that the client really needs. Therefore, the probability that the obtained hotspot data is really hot data is high, so that after the data migration, the probability that the data stored in the storage device for storing the hotspot data is true hot data is high, and the client needs to query. The probability of the hotspot data is high. Therefore, the computing device provided by the embodiment of the present application can improve the data access speed.

The embodiment of the present application further provides an application program, which is used to execute the data migration method provided by the embodiment of the present application at runtime. Among them, the data migration method includes:

Receiving a data query request sent by the client;

Sending a data obtaining request to the storage device according to the data query request;

Receiving, by the storage device, result data of the request feedback according to the data, and sending the result data to the guest The terminal forwards the result data;

Performing analysis on the result data according to a preset data analysis algorithm, and obtaining hotspot data from the result data;

Sending a data migration instruction to the storage device according to the obtained hotspot data, so that the storage device performs data migration according to the data migration instruction, where the data migration instruction is for migrating hotspot data to for storage The instruction of the storage device of the hot data.

It can be seen from the above that, in the solution provided by the embodiment of the present application, after the application program receives the data query request sent by the client, the data request is sent to the storage device according to the data query request, and the storage device obtains the result data according to the data obtaining request. And feeding back to the application, the application sends the result data to the client, analyzes the result data, obtains hotspot data therefrom, and then sends a data migration instruction to the storage device according to the obtained hotspot data, and the storage device is configured according to the This data migration instruction performs data migration. Compared with the prior art, in the solution provided by the embodiment of the present application, the foregoing application determines the hotspot data according to the data corresponding to the data query request sent by the client, that is, the hotspot data is from the data that the client really needs. The generated hotspot data has a high probability of being hot data, so that after the data migration, the data stored in the storage device for storing the hotspot data has a high probability of being true hotspot data, and the client needs The probability of querying the hotspot data is high. Therefore, the solution provided by the embodiment of the present application can improve the data access speed.

The embodiment of the present application further provides a storage medium for storing an application, and the application is used to execute the data migration method provided by the embodiment of the present application. Among them, the data migration method includes:

Receiving a data query request sent by the client;

Sending a data obtaining request to the storage device according to the data query request;

Receiving, by the storage device, result data of the request feedback according to the data, and forwarding the result data to the client;

Performing analysis on the result data according to a preset data analysis algorithm, and obtaining hotspot data from the result data;

Sending a data migration instruction to the storage device according to the obtained hotspot data, so that the storage device performs data migration according to the data migration instruction, where the data migration instruction is for migrating hotspot data to for storage The instruction of the storage device of the hot data.

It can be seen that, in the solution provided by the embodiment of the present application, after receiving the data query request sent by the client, the application stored in the storage medium sends a data obtaining request to the storage device according to the data query request, and the storage device is configured according to the data. Obtaining the request to obtain the result data and feeding back to the application, the application sends the result data to the client, analyzes the result data, obtains hotspot data therefrom, and then sends the data migration to the storage device according to the obtained hotspot data. The storage device performs data migration according to the data migration instruction. Compared with the prior art, in the solution provided by the embodiment of the present application, the foregoing application determines the hotspot data according to the data corresponding to the data query request sent by the client, that is, the hotspot data is from the data that the client really needs. The generated hotspot data has a high probability of being hot data, so that after the data migration, the data stored in the storage device for storing the hotspot data has a high probability of being true hotspot data, and the client needs The probability of querying the hotspot data is high. Therefore, the solution provided by the embodiment of the present application can improve the data access speed.

For the device, the computing device, the application, and the storage medium embodiment, since it is basically similar to the method embodiment, the description is relatively simple, and the relevant parts can be referred to the description of the method embodiment.

It should be noted that, in this context, relational terms such as first and second are used merely to distinguish one entity or operation from another entity or operation, and do not necessarily require or imply such entities or operations. There is any such actual relationship or order between them. Furthermore, the term "comprises" or "comprises" or "comprises" or any other variations thereof is intended to encompass a non-exclusive inclusion, such that a process, method, article, or device that comprises a plurality of elements includes not only those elements but also Other elements, or elements that are inherent to such a process, method, item, or device. An element that is defined by the phrase "comprising a ..." does not exclude the presence of additional equivalent elements in the process, method, item, or device that comprises the element.

One of ordinary skill in the art can understand that all or part of the steps in implementing the above method embodiments can be completed by a program to instruct related hardware, and the program can be stored in a computer readable storage medium, which is referred to herein. Storage media such as ROM/RAM, disk, CD, etc.

The above description is only an optional embodiment of the present application, and is not intended to limit the present application. Any modifications, equivalent substitutions, improvements, etc., which are made within the spirit and principles of the present application, should be included in the present application. Within the scope of protection.

Claims (15)

A data migration method, which is applied to a computing device in a data storage system, wherein the data storage system comprises: a computing device and a plurality of storage devices, the method comprising: Receiving a data query request sent by the client; Sending a data obtaining request to the storage device according to the data query request; Receiving, by the storage device, result data of the request feedback according to the data, and forwarding the result data to the client; Performing analysis on the result data according to a preset data analysis algorithm, and obtaining hotspot data from the result data; Sending a data migration instruction to the storage device according to the obtained hotspot data, so that the storage device performs data migration according to the data migration instruction, where the data migration instruction is for migrating hotspot data to for storage The instruction of the storage device of the hot data. The method according to claim 1, wherein the analyzing the result data according to a preset data analysis algorithm, and obtaining hotspot data from the result data, comprising: Obtaining data in the result data that is not marked as hotspot data; The obtained data is analyzed, and hotspot data is determined from the obtained data. The method according to claim 2, wherein the analyzing the obtained data and determining hotspot data from the obtained data comprises: Determining structured data of the obtained data according to a preset data structuring algorithm; Obtaining a search frequency of the determined structured data according to a preset frequency record table, wherein the preset frequency record table is used to record a search frequency of each structured data; The hotspot data is determined from the obtained data according to the obtained search frequency. The method according to claim 2 or 3, wherein the sending the data migration instruction to the storage device according to the obtained hotspot data comprises: Obtaining a load status of the storage device; Determining a destination migration address of the obtained hotspot data according to the obtained load status and data attributes of the obtained hot spot data; Generating a data migration instruction according to the destination migration address and the obtained hot spot data; Sending the data migration instruction to the storage device. The method of claim 4, wherein the data storage system comprises: a high speed storage device and a low speed storage device, wherein the high speed storage device is a storage device whose data processing speed is greater than a preset processing speed threshold. The low speed storage device is a storage device whose data processing speed is less than or equal to a preset processing speed threshold; And obtaining the data that is not marked as hotspot data in the result data, including: Determining data stored in the low speed storage device in the result data; Obtaining data not marked as hotspot data from data stored in the low speed storage device; Determining, according to the obtained load status and the data attribute of the obtained hot spot data, a destination migration address of the obtained hot spot data, including: The destination migration address of the obtained hotspot data for the high speed storage device is determined according to the load status of the high speed storage device and the data attribute of the obtained hot spot data. The method according to claim 1 or 2, wherein the method further comprises: Receiving, by the storage device, feedback information for the data migration instruction, where the feedback information includes a destination migration address of the data migrated by the storage device according to the data migration instruction; Updating the load status of the locally recorded storage device according to the destination migration address included in the feedback information. A data migration device, characterized by being applied to a computing device in a data storage system, wherein the data storage system comprises: a computing device and a plurality of storage devices, the device comprising: The query request receiving module is configured to receive a data query request sent by the client; Obtaining a request sending module, configured to send a data obtaining request to the storage device according to the data query request; a result data receiving module, configured to receive result data of the storage device according to the data obtaining request feedback, and forward the result data to the client; a hotspot data obtaining module, configured to analyze the result data according to a preset data analysis algorithm, and obtain hotspot data from the result data; a data migration instruction sending module, configured to send a data migration instruction to the storage device according to the obtained hotspot data, so that the storage device performs data migration according to the data migration instruction, where the data migration instruction is used for Migrate hotspot data to storage for storing hotspot data Instructions for the device. The device according to claim 7, wherein the hotspot data obtaining module comprises: a non-hotspot data obtaining submodule, configured to obtain data in the result data that is not marked as hotspot data; The hotspot data determining submodule is configured to analyze the obtained data and determine hotspot data from the obtained data. The apparatus according to claim 8, wherein the hotspot data determining submodule comprises: a structured data determining unit, configured to determine structured data of the obtained data according to a preset data structuring algorithm; a search frequency obtaining unit, configured to obtain a search frequency of the determined structured data according to a preset frequency record table, wherein the preset frequency record table is used to record each structured data search Frequency; The hotspot data determining unit is configured to determine hotspot data from the obtained data according to the obtained search frequency. The device according to claim 8 or 9, wherein the data migration instruction sending module comprises: a load status obtaining submodule, configured to obtain a load status of the storage device; a migration address determining submodule, configured to determine a destination migration address of the obtained hotspot data according to the obtained load status and data attributes of the obtained hotspot data; a migration instruction generation submodule, configured to generate a data migration instruction according to the destination migration address and the obtained hotspot data; And a migration instruction sending submodule, configured to send the data migration instruction to the storage device. The device according to claim 10, wherein the data storage system comprises: a high speed storage device and a low speed storage device, wherein the high speed storage device is a storage device whose data processing speed is greater than a preset processing speed threshold. The low speed storage device is a storage device whose data processing speed is less than or equal to a preset processing speed threshold; The non-hotspot data obtaining submodule includes: a storage data determining unit, configured to determine data stored in the low-speed storage device in the result data; a non-hotspot data obtaining unit, configured to obtain data that is not marked as hotspot data from data stored in the low-speed storage device; The migration address determining sub-module is specifically configured to determine, according to a load status of the high-speed storage device and a data attribute of the obtained hot-spot data, a destination migration address of the obtained hot-spot data for the high-speed storage device. The device according to claim 7 or 8, wherein the device further comprises: a feedback information receiving module, configured to receive feedback information sent by the storage device for the data migration instruction, where the feedback information includes a destination migration address of the data migrated by the storage device according to the data migration instruction; And a load status update module, configured to update a load status of the locally recorded storage device according to the destination migration address included in the feedback information. A computing device in a data storage system, the data storage system comprising: a computing device and a plurality of storage devices, the computing device comprising: a processor, a memory, a communication interface, and a bus; The processor, the memory, and the communication interface are connected by the bus and complete communication with each other; The memory stores executable program code; The processor runs a program corresponding to the executable program code by reading executable program code stored in the memory for performing the data migration method of any one of claims 1-6. An application, the application being operative to perform the data migration method of any one of claims 1-6 at runtime. A storage medium for storing an application for performing the data migration method according to any one of claims 1-6.

Images