CN115757026A - Storage performance monitoring method and device for distributed message service platform - Google Patents
Storage performance monitoring method and device for distributed message service platform Download PDFInfo
- Publication number
- CN115757026A CN115757026A CN202211429067.8A CN202211429067A CN115757026A CN 115757026 A CN115757026 A CN 115757026A CN 202211429067 A CN202211429067 A CN 202211429067A CN 115757026 A CN115757026 A CN 115757026A
- Authority
- CN
- China
- Prior art keywords
- information
- disk
- use state
- stored data
- disk use
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 44
- 238000012544 monitoring process Methods 0.000 title claims abstract description 32
- 230000000007 visual effect Effects 0.000 claims abstract description 11
- 230000008859 change Effects 0.000 claims description 100
- 238000004590 computer program Methods 0.000 claims description 20
- 238000005516 engineering process Methods 0.000 abstract description 2
- 238000010586 diagram Methods 0.000 description 14
- 230000015654 memory Effects 0.000 description 10
- 238000004891 communication Methods 0.000 description 8
- 230000006870 function Effects 0.000 description 6
- 238000012545 processing Methods 0.000 description 6
- 238000005457 optimization Methods 0.000 description 4
- 230000008569 process Effects 0.000 description 4
- 230000000694 effects Effects 0.000 description 3
- 230000003287 optical effect Effects 0.000 description 3
- 230000005540 biological transmission Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012806 monitoring device Methods 0.000 description 2
- 230000000246 remedial effect Effects 0.000 description 2
- 238000010276 construction Methods 0.000 description 1
- 238000004880 explosion Methods 0.000 description 1
- 239000000835 fiber Substances 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000004806 packaging method and process Methods 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 239000000758 substrate Substances 0.000 description 1
- 238000011144 upstream manufacturing Methods 0.000 description 1
Images
Landscapes
- Debugging And Monitoring (AREA)
Abstract
The disclosure provides a storage performance monitoring method, a device, equipment and a storage medium of a distributed message service platform, which can be applied to the field of big data and the field of financial technology. The method comprises the following steps: acquiring first disk use state information and first storage data volume information of a target node at the current moment, and second disk use state information and second storage data volume information of the target node at the historical moment; under the condition that the first stored data volume information and the second stored data volume information meet a first preset condition, generating prediction information of the use state of the disk according to the first stored data volume information, the use state information of the second disk and the second stored data volume information; and displaying the first disk use state information through a visual interface under the condition that the first disk use state information and the disk use state prediction information meet a second preset condition.
Description
Technical Field
The present disclosure relates to the field of big data and financial technologies, and in particular, to a method, an apparatus, a device, a medium, and a program product for monitoring storage performance of a distributed message service platform.
Background
With the increasing data volume, the kafka server with high-performance message sending and high-performance message consuming is used as an important component of a distributed message service platform, and provides technical capability support of asynchronous processing between internal and external application systems and inside the application systems.
In the related art, the stored data of the kafka server are generally monitored in real time, and a warning is given in time when the amount of the stored data exceeds a threshold value. In the process of implementing the inventive concept of the present disclosure, the inventor finds that in the case of data explosion in the kafka server, even if relevant personnel receive the early warning information, the relevant personnel do not have enough time to adopt corresponding remedial measures, and the risk of system failure is caused.
Disclosure of Invention
In view of the foregoing, the present disclosure provides a storage performance monitoring method, apparatus, device, medium, and program product for a distributed message service platform.
According to a first aspect of the present disclosure, a storage performance monitoring method for a distributed message service platform is provided, including: acquiring first disk use state information and first storage data volume information of a target node at the current moment, and second disk use state information and second storage data volume information of the target node at a historical moment; generating disk usage state prediction information based on the first stored data amount information, the second disk usage state information, and the second stored data amount information when the first stored data amount information and the second stored data amount information satisfy a first preset condition; and displaying the first disk use state information through a visual interface under the condition that the first disk use state information and the predicted information of the disk use state meet a second preset condition.
According to an embodiment of the present disclosure, the generating of the prediction information of the disk usage state based on the first stored data amount information, the second disk usage state information, and the second stored data amount information when the first stored data amount information and the second stored data amount information satisfy a first preset condition includes: determining the variation of the stored data amount according to the difference between the first stored data amount information and the second stored data amount information; determining a change trend of the stored data amount according to a ratio of the first stored data amount information to the second stored data amount information when the variation is larger than a preset threshold; and generating the prediction information of the disk use state according to the change trend of the stored data amount and the second disk use state information.
According to an embodiment of the present disclosure, the method for monitoring storage performance of the distributed message service platform further includes: storing the first disk use state information and the IP address of the target node; monitoring the use state information of a third disk of the target node in a target moment; under the condition that the third disk use state information is larger than the disk use state prediction information at the target moment, acquiring first disk use state time sequence information of the target node in a target period and second disk use state time sequence information of the target node in a history period; wherein the target period represents a time period between the current time and the target time, and the history period represents a time period between the history time and the current time; and sending warning information to a client under the condition that the first disk use state time sequence information and the second disk use state time sequence information meet a third preset condition.
According to an embodiment of the present disclosure, the sending warning information to the client when the first disk usage state timing information and the second disk usage state timing information satisfy a third preset condition includes: generating first disk use state change trend information of the target node in a target period according to the first disk use state time sequence information; generating second disk use state change trend information of the target node in a history period according to the second disk use state time sequence information; and sending warning information to the client under the condition that the first disk use state change trend information and the second disk use state change trend information are both increasing.
According to an embodiment of the present disclosure, the generating the first disk usage state change trend information of the target node in the target period according to the first disk usage state timing information includes: determining the change trend of the disk use state at the (i-1) th moment according to the disk use state information at the (i-1) th moment and the disk use state information at the (i) th moment; and generating the first disk use state change trend information according to the average value of the change trends of the disk use states at all the moments in the target period, wherein i is more than or equal to 1 and less than or equal to m, and both i and m are positive integers.
According to an embodiment of the present disclosure, the generating the second disk usage state change trend information of the target node in the history period according to the second disk usage state timing information includes: determining the change trend of the disk use state at the j-1 th moment according to the disk use state information at the j-1 th moment and the disk use state information at the j-1 th moment; and generating the second disk use state change trend information according to the average value of the change trends of the disk use states at all the moments in the history period, wherein j is greater than or equal to 1 and is less than or equal to n, and j and n are positive integers.
A second aspect of the present disclosure provides a storage performance monitoring apparatus for a distributed message service platform, including: the first acquisition module is used for acquiring first disk use state information and first storage data volume information of a target node at the current moment, and second disk use state information and second storage data volume information of the target node at the history moment; a generating module, configured to generate prediction information of a disk usage state according to the first stored data amount information, the second disk usage state information, and the second stored data amount information when the first stored data amount information and the second stored data amount information satisfy a first preset condition; and the display module is used for displaying the first disk use state information through a visual interface under the condition that the first disk use state information and the predicted information of the disk use state meet a second preset condition.
A third aspect of the present disclosure provides an electronic device, comprising: one or more processors; memory for storing one or more programs, wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to perform the above-described method.
A fourth aspect of the present disclosure also provides a computer-readable storage medium having stored thereon executable instructions that, when executed by a processor, cause the processor to perform the above-described method.
A fifth aspect of the disclosure also provides a computer program product comprising a computer program which, when executed by a processor, implements the above method.
According to the storage performance monitoring method, device, equipment, medium and program product of the distributed message service platform, the change trend of the storage data volume from the historical time to the current time can be determined by acquiring the disk use state information and the storage data volume information of the target node at the current time and the historical time, then the prediction information capable of predicting the disk use state is generated under the condition that the storage data volume information at the historical time and the current time meets a first preset condition, then the disk use state can be predicted through the prediction information, the disk use state at the current time is determined to need attention under the condition that the disk use state information and the prediction information at the current time meet a second preset condition, and then the first disk use state information is displayed through a visual interface to give an early warning, so that the system fault caused by the rapid increase of the storage data volume is avoided. Because the disk use state information is related to the stored data volume information, and the disk use state information is predicted, the problem that the disk use state cannot be predicted through the change trend of the stored data volume is at least partially solved, the disk use state information is displayed in time under the condition of data surge so as to give an early warning, related personnel can take optimization adjustment measures on the disk conveniently, and the technical effect that the system is prevented from generating faults is achieved.
Drawings
The foregoing and other objects, features and advantages of the disclosure will be apparent from the following description of embodiments of the disclosure, which proceeds with reference to the accompanying drawings, in which:
FIG. 1 schematically illustrates an application scenario diagram of a storage performance monitoring method, apparatus, device, medium and program product according to an embodiment of the disclosure;
FIG. 2 schematically illustrates a flow diagram of a storage performance monitoring method according to an embodiment of the disclosure;
FIG. 3 is a schematic diagram illustrating first disk usage state information according to an embodiment of the disclosure;
FIG. 4 schematically illustrates a flow chart for generating forecast information for disk usage status, in accordance with an embodiment of the present disclosure;
fig. 5 schematically shows a flow chart for sending alert information to a client according to an embodiment of the present disclosure;
FIG. 6 schematically illustrates a block diagram of a storage performance monitoring apparatus according to an embodiment of the present disclosure; and
FIG. 7 schematically illustrates a block diagram of an electronic device suitable for implementing a storage performance monitoring method according to an embodiment of the disclosure.
Detailed Description
Hereinafter, embodiments of the present disclosure will be described with reference to the accompanying drawings. It should be understood that these descriptions are illustrative only and are not intended to limit the scope of the present disclosure. In the following detailed description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the embodiments of the disclosure. It may be evident, however, that one or more embodiments may be practiced without these specific details. Moreover, in the following description, descriptions of well-known structures and techniques are omitted so as to not unnecessarily obscure the concepts of the present disclosure.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the disclosure. The terms "comprises," "comprising," and the like, as used herein, specify the presence of stated features, steps, operations, and/or components, but do not preclude the presence or addition of one or more other features, steps, operations, or components.
All terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs, unless otherwise defined. It is noted that the terms used herein are to be interpreted as having a meaning that is consistent with the context of this specification and are not to be interpreted in an idealized or overly formal sense.
Where a convention analogous to "at least one of A, B, and C, etc." is used, in general such a construction is intended in the sense one having skill in the art would understand the convention (e.g., "a system having at least one of A, B, and C" would include but not be limited to systems that have A alone, B alone, C alone, A and B together, A and C together, B and C together, and/or A, B, and C together, etc.).
In the technical scheme of the present disclosure, the processes of collecting, storing, using, processing, transmitting, providing, disclosing and applying the related data (such as but not limited to personal information of the user) are all in accordance with the regulations of the related laws and regulations, and necessary security measures are taken without breaking the customs of the public order.
In the related art, messages are sent and consumed by a kafka full-scale server of a distributed message service platform, but the inventor finds that in the prior art, the disk use state of the server in a future time period is difficult to predict by storing data quantity in the current kafka server.
Based on this, the inventor assumes that the disk usage rate in the disk usage state information increases in the same proportion, and by associating the disk usage state with the stored data volume and further combining the change trend of the stored data volume with the disk usage state at the historical time, the disk usage state at the current time can be predicted, and further, the situation that remedial measures cannot be taken on the disk in time under the condition that the stored data volume is increased drastically can be avoided.
In view of this, an embodiment of the present disclosure provides a storage performance monitoring method, including:
acquiring first disk use state information and first storage data volume information of a target node at the current moment, and second disk use state information and second storage data volume information of the target node at the historical moment;
under the condition that the first storage data volume information and the second storage data volume information meet a first preset condition, generating prediction information of the use state of the disk according to the first storage data volume information, the use state information of the second disk and the second storage data volume information; and
and displaying the first disk use state information through a visual interface under the condition that the first disk use state information and the disk use state prediction information meet a second preset condition.
Fig. 1 schematically illustrates an application scenario diagram of a storage performance monitoring method, apparatus, device, medium, and program product according to embodiments of the disclosure.
As shown in fig. 1, the application scenario 100 according to this embodiment may include a first terminal device 101, a second terminal device 102, a third terminal device 103, a network 104, and a server 105. The network 104 is used to provide a medium for communication links between the first terminal device 101, the second terminal device 102, the third terminal device 103 and the server 105. Network 104 may include various connection types, such as wired, wireless communication links, or fiber optic cables, among others.
The user may interact with the server 105 via the network 104 using at least one of the first terminal device 101, the second terminal device 102, the third terminal device 103, to receive or send messages or the like. Various communication client applications, such as a shopping application, a web browser application, a search application, an instant messaging tool, a mailbox client, social platform software, etc. (for example only), may be installed on the first terminal device 101, the second terminal device 102, and the third terminal device 103.
The first terminal device 101, the second terminal device 102, and the third terminal device 103 may be various electronic devices having a display screen and supporting web browsing, including but not limited to a smart phone, a tablet computer, a laptop portable computer, a desktop computer, and the like.
The server 105 may be a server that provides various services, such as a background management server that provides support for websites browsed by the user using the first terminal device 101, the second terminal device 102, and the third terminal device 103 (for example only). The backend management server may analyze and process the received data such as the user request, and feed back a processing result (for example, a web page, information, or data obtained or generated according to the user request) to the terminal device.
It should be noted that the storage performance monitoring method provided by the embodiment of the present disclosure may be generally executed by the server 105. Accordingly, the storage performance monitoring apparatus provided by the embodiment of the present disclosure may be generally disposed in the server 105. The storage performance monitoring method provided by the embodiment of the present disclosure may also be executed by a server or a server cluster that is different from the server 105 and is capable of communicating with the first terminal device 101, the second terminal device 102, the third terminal device 103 and/or the server 105. Correspondingly, the storage performance monitoring apparatus provided in the embodiment of the present disclosure may also be disposed in a server or a server cluster that is different from the server 105 and is capable of communicating with the first terminal device 101, the second terminal device 102, the third terminal device 103 and/or the server 105.
It should be understood that the number of terminal devices, networks, and servers in fig. 1 is merely illustrative. There may be any number of terminal devices, networks, and servers, as desired for an implementation.
The storage performance monitoring method of the disclosed embodiment will be described in detail below with reference to fig. 2 to 7 based on the scenario described in fig. 1.
FIG. 2 schematically shows a flow diagram of a storage performance monitoring method according to an embodiment of the disclosure.
As shown in fig. 2, the storage performance monitoring of this embodiment includes operations S210 to S230.
In operation S210, first disk usage state information and first stored data amount information of the target node at the current time, and second disk usage state information and second stored data amount information of the target node at the historical time are obtained.
According to the embodiment of the disclosure, for example, the target node may be any one of the kafka servers in the distributed message service platform, and the disk usage state information may characterize the disk usage state information of the kafka server, and may include a disk usage rate. The stored data volume information may include the data volume of data sent by an upstream node of the kafka server to the kafka server.
According to the embodiment of the present disclosure, for example, the first disk usage state information and the first storage data amount information of the kafka server at the current time and the second disk usage state information and the second storage data amount information of the kafka server at the historical time may be acquired by sending an instruction. The period of difference between the current time and the historical time may be 7 days.
In operation S220, in the case that the first stored data amount information and the second stored data amount information satisfy the first preset condition, prediction information of the disk use state is generated according to the first stored data amount information, the second disk use state information, and the second stored data amount information.
According to an embodiment of the present disclosure, the first preset condition may be a preset condition to be satisfied by a trend of change between the first stored data amount information and the second stored data amount information.
In operation S230, the first disk usage state information is displayed through the visual interface when the first disk usage state information and the predicted information of the disk usage state satisfy a second preset condition.
According to the embodiment of the disclosure, the generated disk use state information can be compared with the first disk use state information, and the first disk use state information can be displayed through the visual interface under the condition that the comparison result meets the second preset condition, so that the condition of the disk use state of the node can be focused in advance, and measures such as capacity expansion can be taken on the disk use state of the node in time.
According to an embodiment of the present disclosure, for example, the first disk usage state information may include a current disk usage rate at a current time, the prediction information of the disk usage state may include a predicted disk usage rate, and the second preset condition may be that the predicted disk usage rate is smaller than the current disk usage rate.
Fig. 3 schematically shows a schematic diagram showing first disk usage state information according to an embodiment of the present disclosure.
As shown in fig. 3, the first disk usage status information shown may include IP information, file system information, configuration information, cluster information, capacity information, usage information, and disk usage. For example, the capacity information of the disk corresponding to the IP information 155.25.51 may be 165656K, the usage information may be 96080K, and the disk usage rate may be 58.0%. The capacity information of the disk corresponding to the IP information 126.36.52 may be 69871K, the usage information may be 174678K, and the usage rate of the disk may be 25.0%. The capacity information of the disk corresponding to the IP information 137.47.53 may be 156498K, the usage information may be 104853K, and the usage rate of the disk may be 67%.
According to the embodiment of the disclosure, the change trend of the storage data volume from the history time to the current time can be determined by acquiring the disk use state information and the storage data volume information of the target node at the current time and the history time, and then the prediction information capable of predicting the disk use state is generated under the condition that the storage data volume information of the history time and the current time meets a first preset condition, so that the disk use state can be predicted through the prediction information, the disk use state at the current time is determined to need attention under the condition that the disk use state information and the prediction information at the current time meet a second preset condition, and then the first disk use state information is displayed through the visual interface to perform early warning, so that the system fault caused by the increase of the storage data volume is avoided. Because the disk use state information is related to the stored data volume information, and the disk use state information is predicted, the problem that the disk use state cannot be predicted through the change trend of the stored data volume is at least partially solved, the disk use state information is displayed in time under the condition of data surge so as to give an early warning, related personnel can take optimization adjustment measures on the disk conveniently, and the technical effect that the system is prevented from generating faults is achieved.
FIG. 4 schematically shows a flowchart for generating forecast information of disk usage status according to an embodiment of the present disclosure.
As shown in fig. 4, the generation of the prediction information of the disk use state of this embodiment includes operations S410 to S430.
In operation S410, a variation amount of the storage data amount is determined according to a difference between the first storage data amount information and the second storage data amount information.
According to the embodiment of the present disclosure, for example, the first stored data amount information may be represented as t1, and since the time length of the difference between the current time and the historical time may be 7 days, the second stored data amount information may be represented as t7, and the variation between the stored data amounts of the first stored data amount information and the second stored data amount information may be obtained by calculating t1 to t 7.
In operation S420, in the case where the variation amount is greater than the preset threshold, a variation tendency of the storage data amount is determined according to a ratio of the first storage data amount information and the second storage data amount information.
According to the embodiment of the present disclosure, for example, the preset threshold may be a preset increase threshold from the first stored data amount information to the second stored data amount information, the preset threshold may be set to 1000, and when t1-t7 > 1000, that is, the stored data amount from t7 to t1 increases more than the preset increase, the change trend of the stored data amount may be predicted.
According to the embodiment of the present disclosure, the trend of change in the amount of stored data can be determined by calculating t1/t7, for example.
In operation S430, prediction information of the disk use state is generated according to the change trend of the amount of stored data and the second disk use state information.
According to the embodiment of the disclosure, the information of the trend of the disk use state change from the historical time to the target time can be determined according to the change trend of the stored data volume and the second disk use state information, and the prediction information of the disk use state can be generated based on the information of the trend of the disk use state change from the historical time to the target time. Since the stored data volume is associated with the disk use information, the prediction information can be generated by combining the variation trend of the stored data volume information with the disk use state at the previous time, and the prediction information can be used for predicting the disk use state information at the current time.
According to the embodiment of the present disclosure, for example, assuming that the disk usage rates increase in the same proportion, the second disk usage state information at the history time is represented as d7, and in combination with the change trend of the stored data amount, information of the change trend of the disk usage state from the history time to the target time can be obtained, and since it is assumed that the stored data amount of the disk increases in the same proportion, and further it can be assumed that the change trend of the disk usage rate is the same as the change trend of the predicted disk usage rate, prediction information of the disk usage state can be generated, the prediction information including the predicted disk usage rate d0, where d0= t1/t7 d7.
According to the embodiment of the present disclosure, for example, the first disk usage state information may be represented as d1, and in a case where d0 < d1, the disk usage rate at the future time may be considered to be smaller than the disk usage rate at the current time, and thus the disk usage rate at the future time may be considered to have a possibility that it is difficult to satisfy the amount of stored data, and a growing trend of the disk usage rate needs to be concerned.
According to the embodiment of the disclosure, the variation of the stored data volume is determined according to the difference between the first stored data volume information and the second stored data volume information, when the variation is larger than the preset threshold, the variation of the stored data is determined to be concerned, then the variation trend of the stored data volume is determined according to the ratio of the first stored data volume information and the second stored data volume information, after the variation trend is determined, the prediction information for predicting the disk use state at the future time can be generated according to the variation trend and the second disk use state information, because the variation trend is determined according to the stored data volume information at the current time and the stored data volume information at the historical time, the prediction information of the disk use state at the current time can be generated according to the variation trend and the disk use state information at the historical time, the disk use state at the current time can be predicted through the prediction information, and early warning can be performed under the condition of data surge, so that relevant personnel can take optimization adjustment measures on the disk, and the technical effect of avoiding system failure is achieved. .
Fig. 5 schematically shows a flow chart for sending alert information to a client according to an embodiment of the present disclosure.
As shown in fig. 5, the sending of the alert information to the client according to this embodiment includes operations S510 to S540.
In operation S510, first disk usage state information and an IP address of a target node are stored.
In operation S520, third disk usage status information of the target node within the target time is monitored.
In operation S530, in a case that the third disk usage state information is greater than the disk usage state prediction information at the target time, acquiring first disk usage state timing information of the target node in the target period and second disk usage state timing information of the target node in the history period; the target period represents a time period between the current time and the target time, and the history period represents a time period between the history time and the current time.
According to an embodiment of the present disclosure, the first disk usage state timing information may be disk usage state information recorded at each preset time in a target period; the second disk use state timing information may be disk use state information recorded at every preset time within the history period.
According to the embodiment of the present disclosure, for example, the monitored third disk usage state information may be compared with the disk usage state prediction information at the target time, and the possibility that the third disk usage state information satisfies the storage data amount requirement may be determined.
In operation S540, in a case that the first disk usage state timing information and the second disk usage state timing information satisfy a third preset condition, sending warning information to the client.
According to the embodiment of the present disclosure, for example, the condition that the first disk usage state timing information and the second disk usage state timing information satisfy the third preset condition may be determined according to the change presented by the disk usage state information included in the first disk usage state timing information and the change presented by the disk usage state information included in the second disk usage state timing information.
According to the embodiment of the disclosure, by storing the first disk use state information and the IP address of the target node, and monitoring the third disk use state information of the target node in the target time, the generated disk use state prediction information can be compared with the third disk use state information, under the condition that the third disk use state information is greater than the disk use state prediction information at the target time, the third disk use state information can be considered to be difficult to meet the storage requirement of the data amount stored at the target time, the first disk use state time sequence information of the target node in the target period and the second disk use state time sequence information of the target node in the historical period can be obtained, under the condition that the first disk use state time sequence information and the second disk use state time sequence information meet a third preset condition, it is determined that the disk use state information needs to be warned to the client, and warning information is sent to the client, so that the disk use state is timely displayed, and the early warning of the disk use state can be timely realized under the condition that data is increased rapidly, so that relevant personnel can take optimization adjustment measures and avoid the failure of the disk system.
According to the embodiment of the present disclosure, when the first disk usage state timing information and the second disk usage state timing information satisfy a third preset condition, sending warning information to the client includes:
generating first disk use state change trend information of a target node in a target period according to the first disk use state time sequence information;
generating second disk use state change trend information of the target node in a history period according to the second disk use state time sequence information;
and sending warning information to the client under the condition that the first disk use state change trend information and the second disk use state change trend information are both increasing.
According to the embodiment of the present disclosure, for example, in a case where the disk usage state information included in the first disk usage state timing information increases from 50% to 51%, it is considered that the first disk usage state change tendency information is increasing, and in a case where the disk usage state information included in the second disk usage state timing information increases from 27% to 28%, it is considered that the second disk usage state change tendency information is increasing, and then warning information may be sent to the client.
According to the embodiment of the disclosure, the change trend information of the use state of the first disk of the target node in the target period is generated according to the time sequence information of the use state of the first disk, the change trend information of the use state of the second disk of the target node in the historical period is generated according to the time sequence information of the use state of the second disk, the future use state condition of the disk can be determined according to the generated change trend information of the use state of the disk, and the warning information is sent to the client under the condition that the change trend information of the use state of the first disk and the change trend information of the use state of the second disk are both positive.
According to an embodiment of the present disclosure, the generating of the first disk usage state change trend information of the target node in the target period according to the first disk usage state timing information includes:
determining the change trend of the disk use state at the ith-1 moment according to the disk use state information at the ith-1 moment and the disk use state information at the ith moment;
and generating first disk use state change trend information according to the average value of the change trends of the disk use states at all the moments in the target period, wherein i is greater than or equal to 1 and less than or equal to m, and both i and m are positive integers.
According to the embodiment of the disclosure, for example, if the disk use state information at the i-1 st time is 50%, and the disk use state at the i-1 st time is 51%, it may be determined that the trend of change in the disk use state at the i-1 st time is increasing.
According to the embodiment of the present disclosure, for example, the target period includes the i-2 th time, the i-1 th time and the i-th time, the disk usage state information at the i-2 th time is 49%, the disk usage state information at the i-1 th time is 50%, the trend of change in the disk usage states from the i-2 th time to the i-1 th time is 1%, the disk usage state at the i-th time is 51%, the trend of change in the disk usage states from the i-1 th time to the i-th time is 1%, the average value of the trends of change in the disk usage states at all times in the target period can be determined to be (1% + 1%)/2 =1%, and the first disk usage state change trend information can be generated based on the average value of the trends of change in the disk usage states at all times in the target period. The first disk usage state change tendency information may indicate a disk usage state change tendency from positive and negative of an average value of the change tendencies of the disk usage states at all times in the target period, for example: when the average value of the variation trend of the disk use state is positive, the disk use rate of the server is increased. When the average value of the variation trend of the disk use state is negative, the disk use rate of the server is increased negatively. When the average value of the variation trend of the disk use state is zero, the fluctuation of the disk use rate of the server is shown, but the disk use rate does not have obvious increase trend.
According to the embodiment of the disclosure, the change trend of the disk use state at the (i-1) th moment is determined according to the disk use state information at the (i-1) th moment and the disk use state information at the (i) th moment, and then the first disk use state change trend information is generated according to the average value of the change trends of the disk use states at all moments in a target period.
According to an embodiment of the present disclosure, the generating the second disk usage state change trend information of the target node in the history period according to the second disk usage state timing information includes:
determining the change trend of the disk use state at the j-1 th moment according to the disk use state information at the j-1 th moment and the disk use state information at the j-1 th moment;
and generating the change trend information of the use state of the second disk according to the average value of the change trends of the use states of the disks at all times in the history period, wherein j is more than or equal to 1 and less than or equal to n, and j and n are positive integers.
According to the embodiment of the disclosure, for example, if the disk use state information at the j-1 th time is 27% and the disk use state at the j-1 th time is 28%, it may be determined that the trend of change in the disk use state at the j-1 th time is increasing.
According to the embodiment of the present disclosure, for example, the history cycle includes the j-2 th time, the j-1 th time and the j-2 th time, the disk usage state information at the j-2 th time is 26%, the disk usage state information at the j-1 th time is 27%, the trend of the change in the disk usage state from the j-2 th time to the j-1 th time is 1%, the disk usage state at the i-th time is 28%, the trend of the change in the disk usage state from the j-1 th time to the j-1 th time is 1%, the average value of the trends of the change in the disk usage states at all times in the history cycle can be determined to be (1% + 1%)/2 =1%, and the first disk usage state change trend information can be generated based on the average value of the trends of the change in the disk usage state at all times in the history cycle.
According to the embodiment of the disclosure, the change trend of the disk use state at the j-1 th moment is determined according to the disk use state information at the j-1 th moment and the disk use state information at the j-1 th moment, and then the second disk use state change trend information is generated according to the average value of the change trends of the disk use states at all the moments in the history period.
Based on the storage performance monitoring method of the distributed message service platform, the disclosure also provides a storage performance monitoring device of the distributed message service platform. The apparatus will be described in detail below with reference to fig. 6.
Fig. 6 schematically shows a block diagram of a storage performance monitoring apparatus according to an embodiment of the present disclosure.
As shown in fig. 6, the storage performance monitoring apparatus 600 of this embodiment includes a first obtaining module 610, a generating module 620, and a presenting module 630.
The first obtaining module 610 is configured to obtain first disk usage state information and first storage data volume information of the target node at the current time, and second disk usage state information and second storage data volume information of the target node at the historical time. In an embodiment, the first obtaining module 610 may be configured to perform the operation S210 described above, which is not described herein again.
The generating module 620 is configured to generate prediction information of the disk usage state according to the first stored data amount information, the second disk usage state information, and the second stored data amount information when the first stored data amount information and the second stored data amount information satisfy a first preset condition. In an embodiment, the generating module 620 may be configured to perform the operation S220 described above, which is not described herein again.
The displaying module 630 is configured to display the first disk usage state information through a visual interface when the first disk usage state information and the predicted information of the disk usage state satisfy a second preset condition. In an embodiment, the presentation module 630 may be configured to perform the operation S230 described above, which is not described herein again.
According to an embodiment of the present disclosure, the generation module includes a first determination submodule, a second determination submodule, and a first generation submodule. The first determining submodule is used for determining the change amount of the storage data volume according to the difference between the first storage data volume information and the second storage data volume information; the second determining submodule is used for determining the change trend of the stored data volume according to the ratio of the first stored data volume information and the second stored data volume information under the condition that the change quantity is larger than a preset threshold value; and the first generation submodule is used for generating the prediction information of the use state of the magnetic disk according to the change trend of the stored data volume and the use state information of the second magnetic disk.
According to the embodiment of the disclosure, the storage performance monitoring device further comprises a storage module, a detection module, a second acquisition module and a sending module. The storage module is used for storing the first disk use state information and the IP address of the target node; the detection module is used for monitoring the use state information of the third disk of the target node in the target moment; the second obtaining module is used for obtaining the time sequence information of the first disk use state of the target node in the target period and the time sequence information of the second disk use state of the target node in the history period under the condition that the third disk use state information is larger than the disk use state prediction information at the target moment; the target period represents a time period between the current time and the target time, and the historical period represents a time period between the historical time and the current time; and the sending module is used for sending warning information to the client under the condition that the time sequence information of the use state of the first disk and the time sequence information of the use state of the second disk meet a third preset condition.
According to an embodiment of the present disclosure, the transmission module includes a second generation submodule, a third generation submodule, and a transmission submodule. The second generation submodule is used for generating first disk use state change trend information of the target node in a target period according to the first disk use state time sequence information; the third generation submodule is used for generating second disk use state change trend information of the target node in a history period according to the second disk use state time sequence information; and the sending submodule is used for sending warning information to the client under the condition that the first disk use state change trend information and the second disk use state change trend information are both increasing.
According to an embodiment of the present disclosure, the second generation submodule includes a first determination unit and a first generation unit. The first determining unit is used for determining the change trend of the disk use state at the ith-1 moment according to the disk use state information at the ith-1 moment and the disk use state information at the ith moment; and the first generation unit is used for generating first disk use state change trend information according to the average value of the change trends of the disk use states at all times in the target period, wherein i is more than or equal to 1 and less than or equal to m, and both i and m are positive integers.
According to an embodiment of the present disclosure, the third generation submodule includes a second determination unit and a second generation unit. The second determining unit is used for determining the change trend of the disk use state at the j-1 th moment according to the disk use state information at the j-1 th moment and the disk use state information at the j-1 th moment; and the second generation unit is used for generating second disk use state change trend information according to the average value of the change trends of the disk use states at all times in the history period, wherein j is more than or equal to 1 and less than or equal to n, and j and n are positive integers.
According to an embodiment of the present disclosure, any multiple of the first obtaining module 610, the generating module 620, and the presenting module 630 may be combined and implemented in one module, or any one of the modules may be split into multiple modules. Alternatively, at least part of the functionality of one or more of these modules may be combined with at least part of the functionality of other modules and implemented in one module. According to an embodiment of the present disclosure, at least one of the first obtaining module 610, the generating module 620, and the presenting module 630 may be implemented at least partially as a hardware circuit, such as a Field Programmable Gate Array (FPGA), a Programmable Logic Array (PLA), a system on a chip, a system on a substrate, a system on a package, an Application Specific Integrated Circuit (ASIC), or may be implemented by any other reasonable manner of integrating or packaging a circuit, such as hardware or firmware, or implemented by any one of three implementations of software, hardware, and firmware, or any suitable combination of any of them. Alternatively, at least one of the first obtaining module 610, the generating module 620 and the presenting module 630 may be at least partially implemented as a computer program module, which, when executed, may perform a corresponding function.
FIG. 7 schematically illustrates a block diagram of an electronic device suitable for implementing a storage performance monitoring apparatus method according to an embodiment of the disclosure.
As shown in fig. 7, an electronic device 700 according to an embodiment of the present disclosure includes a processor 701, which can perform various appropriate actions and processes according to a program stored in a Read Only Memory (ROM) 702 or a program loaded from a storage section 708 into a Random Access Memory (RAM) 703. The processor 701 may include, for example, a general purpose microprocessor (e.g., a CPU), an instruction set processor and/or associated chipset, and/or a special purpose microprocessor (e.g., an Application Specific Integrated Circuit (ASIC)), among others. The processor 701 may also include on-board memory for caching purposes. The processor 701 may comprise a single processing unit or a plurality of processing units for performing the different actions of the method flows according to embodiments of the present disclosure.
In the RAM 703, various programs and data necessary for the operation of the electronic apparatus 700 are stored. The processor 701, the ROM 702, and the RAM 703 are connected to each other by a bus 704. The processor 701 performs various operations of the method flows according to the embodiments of the present disclosure by executing programs in the ROM 702 and/or the RAM 703. It is noted that the programs may also be stored in one or more memories other than the ROM 702 and RAM 703. The processor 701 may also perform various operations according to the method flows of the embodiments of the present disclosure by executing programs stored in the one or more memories.
The present disclosure also provides a computer-readable storage medium, which may be contained in the apparatus/device/system described in the above embodiments; or may exist separately and not be assembled into the device/apparatus/system. The computer readable storage medium carries one or more programs which, when executed, implement the method according to an embodiment of the disclosure.
According to embodiments of the present disclosure, the computer-readable storage medium may be a non-volatile computer-readable storage medium, which may include, for example but is not limited to: a portable computer diskette, a hard disk, a Random Access Memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), a portable compact disc read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the foregoing. In the present disclosure, a computer readable storage medium may be any tangible medium that can contain, or store a program for use by or in connection with an instruction execution system, apparatus, or device. For example, according to embodiments of the present disclosure, a computer-readable storage medium may include the ROM 702 and/or RAM 703 and/or one or more memories other than the ROM 702 and RAM 703 described above.
Embodiments of the present disclosure also include a computer program product comprising a computer program containing program code for performing the method illustrated by the flow chart. The program code is for causing a computer system to implement the item recommendation method provided by the embodiments of the present disclosure when the computer program product is run in the computer system.
The computer program performs the above-described functions defined in the system/apparatus of the embodiments of the present disclosure when executed by the processor 701. The above described systems, devices, modules, units, etc. may be implemented by computer program modules according to embodiments of the present disclosure.
In one embodiment, the computer program may be hosted on a tangible storage medium such as an optical storage device, a magnetic storage device, or the like. In another embodiment, the computer program may also be transmitted in the form of a signal over a network medium, distributed, and downloaded and installed via the communication section 709, and/or installed from the removable medium 711. The computer program containing program code may be transmitted using any suitable network medium, including but not limited to: wireless, wired, etc., or any suitable combination of the foregoing.
In such an embodiment, the computer program can be downloaded and installed from a network through the communication section 709, and/or installed from the removable medium 711. The computer program, when executed by the processor 701, performs the above-described functions defined in the system of the embodiment of the present disclosure. The above described systems, devices, apparatuses, modules, units, etc. may be implemented by computer program modules according to embodiments of the present disclosure.
In accordance with embodiments of the present disclosure, program code for executing computer programs provided by embodiments of the present disclosure may be written in any combination of one or more programming languages, and in particular, these computer programs may be implemented using high level procedural and/or object oriented programming languages, and/or assembly/machine languages. The programming language includes, but is not limited to, programming languages such as Java, C + +, python, the "C" language, or the like. The program code may execute entirely on the user's computing device, partly on the user's device, partly on a remote computing device, or entirely on the remote computing device or server. In situations involving remote computing devices, the remote computing devices may be connected to the user computing device through any kind of network, including a Local Area Network (LAN) or a Wide Area Network (WAN), or may be connected to external computing devices (e.g., through the internet using an internet service provider).
The flowchart and block diagrams in the figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams or flowchart illustration, and combinations of blocks in the block diagrams or flowchart illustration, can be implemented by special purpose hardware-based systems which perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
It will be appreciated by a person skilled in the art that various combinations or/and combinations of features recited in the various embodiments of the disclosure and/or in the claims may be made, even if such combinations or combinations are not explicitly recited in the disclosure. In particular, various combinations and/or combinations of the features recited in the various embodiments and/or claims of the present disclosure may be made without departing from the spirit or teaching of the present disclosure. All such combinations and/or associations are within the scope of the present disclosure.
The embodiments of the present disclosure have been described above. However, these examples are for illustrative purposes only and are not intended to limit the scope of the present disclosure. Although the embodiments are described separately above, this does not mean that the measures in the embodiments cannot be used in advantageous combination. The scope of the disclosure is defined by the appended claims and equivalents thereof. Various alternatives and modifications can be devised by those skilled in the art without departing from the scope of the present disclosure, and such alternatives and modifications are intended to be within the scope of the present disclosure.
Claims (10)
1. A storage performance monitoring method of a distributed message service platform comprises the following steps:
acquiring first disk use state information and first storage data volume information of a target node at the current moment, and second disk use state information and second storage data volume information of the target node at the historical moment;
generating prediction information of the use state of the disk according to the first stored data volume information, the use state information of the second disk and the second stored data volume information under the condition that the first stored data volume information and the second stored data volume information meet a first preset condition; and
and displaying the first disk use state information through a visual interface under the condition that the first disk use state information and the predicted information of the disk use state meet a second preset condition.
2. The method of claim 1, wherein the generating of the predicted information of the disk usage state according to the first stored data amount information, the second disk usage state information and the second stored data amount information in the case that the first stored data amount information and the second stored data amount information satisfy a first preset condition comprises:
determining the variation of the stored data volume according to the difference between the first stored data volume information and the second stored data volume information;
determining the change trend of the stored data volume according to the ratio of the first stored data volume information and the second stored data volume information under the condition that the variation is larger than a preset threshold;
and generating the prediction information of the disk use state according to the change trend of the stored data volume and the second disk use state information.
3. The method of claim 1, further comprising:
storing the first disk use state information and the IP address of the target node;
monitoring the use state information of a third disk of the target node in a target moment;
under the condition that the third disk use state information is larger than the disk use state prediction information at the target moment, acquiring first disk use state time sequence information of the target node in a target period and second disk use state time sequence information of the target node in a history period; wherein the target period represents a time period between the current time and the target time, and the history period represents a time period between the history time and the current time;
and sending warning information to a client under the condition that the first disk use state time sequence information and the second disk use state time sequence information meet a third preset condition.
4. The method of claim 3, wherein the sending, to the client, the warning information in the case that the first disk usage state timing information and the second disk usage state timing information satisfy a third preset condition includes:
generating first disk use state change trend information of the target node in a target period according to the first disk use state time sequence information;
generating second disk use state change trend information of the target node in a history period according to the second disk use state time sequence information;
and sending warning information to a client under the condition that the first disk use state change trend information and the second disk use state change trend information are both increasing.
5. The method of claim 4, wherein the first disk usage state timing information includes disk usage state information at m times, and the generating first disk usage state change trend information of the target node in a target period according to the first disk usage state timing information includes:
determining the change trend of the disk use state at the ith-1 moment according to the disk use state information at the ith-1 moment and the disk use state information at the ith moment;
and generating the first disk use state change trend information according to the average value of the change trends of the disk use states at all the moments in the target period, wherein i is greater than or equal to 1 and is less than or equal to m, and both i and m are positive integers.
6. The method of claim 5, wherein the second disk usage state timing information includes disk usage state information at n times, and the generating second disk usage state change trend information of the target node in a history period according to the second disk usage state timing information includes:
determining the change trend of the disk use state at the j-1 moment according to the disk use state information at the j-1 moment and the disk use state information at the j-1 moment;
and generating the change trend information of the use state of the second disk according to the average value of the change trends of the use states of the disks at all times in the history period, wherein j is more than or equal to 1 and is less than or equal to n, and j and n are positive integers.
7. A storage performance monitoring apparatus of a distributed message service platform, comprising:
the system comprises a first acquisition module, a second acquisition module and a first storage module, wherein the first acquisition module is used for acquiring first disk use state information and first storage data volume information of a target node at the current moment, and second disk use state information and second storage data volume information of the target node at the historical moment;
a generating module, configured to generate prediction information of a disk usage state according to the first stored data amount information, the second disk usage state information, and the second stored data amount information when the first stored data amount information and the second stored data amount information satisfy a first preset condition; and
and the display module is used for displaying the first disk use state information through a visual interface under the condition that the first disk use state information and the predicted information of the disk use state meet a second preset condition.
8. An electronic device, comprising:
one or more processors;
a storage device for storing one or more programs,
wherein the one or more programs, when executed by the one or more processors, cause the one or more processors to perform the method recited in any of claims 1-6.
9. A computer readable storage medium having stored thereon executable instructions which, when executed by a processor, cause the processor to perform the method according to any one of claims 1 to 6.
10. A computer program product comprising a computer program which, when executed by a processor, implements the method according to any one of claims 1 to 6.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211429067.8A CN115757026A (en) | 2022-11-15 | 2022-11-15 | Storage performance monitoring method and device for distributed message service platform |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211429067.8A CN115757026A (en) | 2022-11-15 | 2022-11-15 | Storage performance monitoring method and device for distributed message service platform |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN115757026A true CN115757026A (en) | 2023-03-07 |
Family
ID=85371764
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211429067.8A Pending CN115757026A (en) | 2022-11-15 | 2022-11-15 | Storage performance monitoring method and device for distributed message service platform |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN115757026A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116737795A (en) * | 2023-06-12 | 2023-09-12 | 中国建设银行股份有限公司 | Information generation method, device, equipment and storage medium |
| CN119166399A (en) * | 2024-08-28 | 2024-12-20 | 扬州工业职业技术学院 | A method for fault judgment based on computer hard disk status indicators |
| CN119718192A (en) * | 2024-12-04 | 2025-03-28 | 中国工商银行股份有限公司 | Storage node operation trend prediction method, storage node operation trend prediction device, storage node operation trend prediction medium and program product |
-
2022
- 2022-11-15 CN CN202211429067.8A patent/CN115757026A/en active Pending
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116737795A (en) * | 2023-06-12 | 2023-09-12 | 中国建设银行股份有限公司 | Information generation method, device, equipment and storage medium |
| CN119166399A (en) * | 2024-08-28 | 2024-12-20 | 扬州工业职业技术学院 | A method for fault judgment based on computer hard disk status indicators |
| CN119718192A (en) * | 2024-12-04 | 2025-03-28 | 中国工商银行股份有限公司 | Storage node operation trend prediction method, storage node operation trend prediction device, storage node operation trend prediction medium and program product |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN115757026A (en) | Storage performance monitoring method and device for distributed message service platform | |
| CN113411400B (en) | Information calling method and device, electronic equipment and readable storage medium | |
| CN110704771B (en) | Page abnormality monitoring method, system, device, electronic equipment and readable medium | |
| CN114844810B (en) | Heartbeat data processing method, device, equipment and medium | |
| CN114710397B (en) | Service link fault root cause positioning method and device, electronic equipment and medium | |
| CN114500318B (en) | Batch operation monitoring method, device, equipment and medium | |
| CN114218283A (en) | Abnormality detection method, apparatus, device, and medium | |
| CN116775307A (en) | Service processing method, device, equipment and storage medium | |
| CN116701129A (en) | Alarm information processing method, device, equipment and storage medium | |
| CN115801764B (en) | File transmission method, device, equipment and storage medium | |
| CN115118574A (en) | A data processing method, device and storage medium | |
| CN113794719A (en) | Network abnormal traffic analysis method and device based on Elasticissearch technology and electronic equipment | |
| CN116450465B (en) | Data processing method, device, equipment and medium | |
| CN114996119B (en) | Fault diagnosis method, fault diagnosis device, electronic device and storage medium | |
| CN117130812A (en) | System fault detection method, apparatus, device, medium and program product | |
| CN114328096A (en) | Index monitoring method, device, equipment and medium | |
| CN114356713A (en) | Thread pool monitoring method and device, electronic equipment and storage medium | |
| CN115187364A (en) | Method and device for monitoring margin risk in bank distributed scenario | |
| CN114676020A (en) | Performance monitoring method and device of cache system, electronic equipment and storage medium | |
| CN114328151A (en) | Operation and maintenance event relation mining method, device, equipment and medium | |
| CN114024867A (en) | Network anomaly detection method and device | |
| CN115312208B (en) | Method, device, equipment and medium for displaying treatment data | |
| CN115499292B (en) | Alarm method, device, equipment and storage medium | |
| CN114268558B (en) | Method, device, equipment and medium for generating monitoring graph | |
| CN114240381B (en) | Emergency management methods, devices, equipment, media and program products |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |