CN116668273A - Data cascade channel detection method and system - Google Patents

Abstract

The embodiment of the disclosure discloses a data cascade channel detection method and system. The method comprises the following steps: judging whether the cascade service of the stage is normal or not, if not, outputting first abnormal information, if so, judging whether the cascade related component of the stage is normal or not, if not, outputting second abnormal information, if so, judging whether the addresses of opposite ends are consistent or not, if not, outputting third abnormal information, if so, judging whether the addresses of the opposite ends are connectivity or not, if not, outputting fourth abnormal information, if so, judging whether the sent message has a receipt or not, if not, outputting fifth abnormal information, and if so, outputting channel unblocked information; the opposite terminal address is a configured upper IP address; the method adopts the data cascade channel detection function, and the problems in each link can be intuitively reflected through the detection function when the data is cascade or the channel has problems, so that the problem is positioned more quickly and accurately, and the user experience is better.

Description

Data cascade channel detection method and system

technical field

The present disclosure relates to the field of computer technology, in particular to a data cascade channel detection method and system.

Background technique

With the rapid development of the information age, the amount of data has increased sharply, and there are more and more branch data in various enterprises. Data cascading and data aggregation are becoming more and more important. However, there are various unsuccessful problems in data cascading. This leads to the failure of data synchronization, as well as the difficulty of troubleshooting for software implementers and users, and the complicated process.

The existing technology only considers the problems of each link of the detection itself. When a cascading relationship is formed, the specific source of the problem cannot be known. When a problem occurs, the operator needs to sort out the process from the beginning and compare the detailed node information. It may be possible to find out the cause of the problem, and it is impossible to quickly identify and locate the source of the problem, resulting in a long cycle and a waste of manpower and material resources.

Contents of the invention

In view of this, the embodiments of the present disclosure provide a data cascading channel detection method and system, which can test possible problems in each link of data cascading, and quickly identify and locate the source of the problem in the cascading channel.

In a first aspect, an embodiment of the present disclosure provides a data cascade channel detection method, including the following steps:

Determine whether the cascade service at the current level is normal, if not, output the first abnormal information,

If yes, judge whether the cascaded related components of this level are normal, if not, output the second abnormal information,

If yes, judge whether the peer address is consistent, if not, output the third abnormal information,

If so, judge whether the peer address is connected, if not, output the fourth abnormal information,

If so, judge whether the sent message has a receipt, if not, output the fifth abnormal information,

If so, output channel unblocked information;

The peer address is a configured upper-level IP address.

Optionally, the judging whether the cascade service at the current level is normal, if not, outputting the first abnormal information, including:

Judging whether the service interface can be called normally by calling the RPC interface, if not, then judging that the cascaded service at this level is abnormal;

The first abnormal information is that the service interface cannot be called normally.

Optionally, the judging whether the cascading related components of the current level are normal, if not, outputting the second abnormal information, including:

Determine whether the database query statement can be executed normally, if not, output the database exception information,

If yes, judge whether the message middleware can interact, if not, output message middleware exception information,

If yes, judge whether the file upload/storage service is normal, and if not, output storage service exception information.

Optionally, the judging whether the address of the opposite end is consistent, if not, outputting the third abnormal information, including:

Obtain the real-time communication address based on the established cascading relationship;

Judging whether the real-time communication address is consistent with the stored address of the current level, if not, outputting abnormal information that the address of the opposite end is inconsistent.

Optionally, the judging whether the peer address is connected, if not, outputting the fourth abnormal information, including:

Determine whether the peer address has established a SOCKET connection, and if not, output the exception information that the peer address does not have connectivity.

Optionally, the judging whether the sent message has a receipt, if not, outputting fifth abnormal information, including:

Send test data to the address of the peer message queue to determine whether a receipt is received, and if not, output the exception information that the cascading channel is not unblocked.

Optionally, it also includes: when the output information is abnormal information, a real-time alarm is issued.

In the second aspect, the embodiment of the present disclosure also provides a data cascade channel detection system, including:

The first judging module is configured to judge whether the cascade service at the current level is normal, and if not, output the first abnormal information;

The second judging module is configured to judge whether the relevant components of the cascading at the current level are normal if the cascading service at the current level is normal, and output second abnormal information if not;

The third judging module is configured to judge whether the address of the opposite end is consistent if the cascaded related components of the current level are normal, and if not, output the third abnormal information;

The fourth judging module is configured to judge whether the peer address is connected if the peer address is consistent, and if not, output fourth abnormal information;

The fifth judging module is configured to judge whether the sent message has a receipt if the peer address has connectivity, and if not, output fifth abnormal information;

The sixth judging module is configured to output channel unblocked information if the sent message has a receipt.

In the third aspect, the embodiment of the present disclosure also provides an electronic device, which adopts the following technical solution:

The electronic equipment includes:

at least one processor; and,

a memory communicatively coupled to the at least one processor; wherein,

The memory stores instructions that can be executed by the at least one processor, and the instructions are executed by the at least one processor, so that the at least one processor can perform any of the data cascading channel detection described above method.

In a fourth aspect, an embodiment of the present disclosure further provides a computer-readable storage medium, where the computer-readable storage medium stores computer instructions, and the computer instructions are used to cause a computer to execute any one of the data cascading channel detection methods described above.

The method disclosed in this application progresses layer by layer through the five aspects of whether the cascading service at the current level is normal, whether the relevant components of the cascading at the current level are normal, whether the peer address is consistent, whether the peer address is connectable, and whether the sent message is a receipt. Analysis, using the data cascading channel detection function, when the data cascades or the channel has problems, the detection function can intuitively reflect the problems in each link, and the problem location is faster and more accurate, and the user experience is better.

The above description is only an overview of the technical solution of the present disclosure. In order to better understand the technical means of the present disclosure, it can be implemented according to the contents of the specification, and in order to make the above and other purposes, features and advantages of the present disclosure more obvious and understandable , the following preferred embodiments are specifically cited below, and are described in detail as follows in conjunction with the accompanying drawings.

Description of drawings

In order to more clearly illustrate the technical solutions of the embodiments of the present disclosure, the following will briefly introduce the accompanying drawings required in the embodiments. Obviously, the accompanying drawings in the following description are only some embodiments of the present disclosure. Those of ordinary skill in the art can also obtain other drawings based on these drawings without any creative effort.

Fig. 1 is a schematic flowchart of a specific embodiment of the data cascading channel detection method provided in the application.

FIG. 2 is a schematic diagram of a specific embodiment of performing data cascading channel detection at different levels provided by the present application.

Fig. 3 is a functional block diagram of a data cascade channel detection system provided by an embodiment of the present disclosure.

Fig. 4 is a functional block diagram of an electronic device provided by an embodiment of the present disclosure.

Detailed ways

Embodiments of the present disclosure will be described in detail below in conjunction with the accompanying drawings.

It should be clear that the implementation of the present disclosure will be described below through specific examples, and those skilled in the art can easily understand other advantages and effects of the present disclosure from the content disclosed in this specification. Apparently, the described embodiments are only some of the embodiments of the present disclosure, not all of them. The present disclosure can also be implemented or applied through different specific implementation modes, and various modifications or changes can be made to the details in this specification based on different viewpoints and applications without departing from the spirit of the present disclosure. It should be noted that, in the case of no conflict, the following embodiments and features in the embodiments can be combined with each other. Based on the embodiments in the present disclosure, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present disclosure.

It is noted that the following describes various aspects of the embodiments that are within the scope of the appended claims. It should be apparent that the aspects described herein may be embodied in a wide variety of forms and that any specific structure and/or function described herein is illustrative only. Based on the present disclosure one skilled in the art should appreciate that an aspect described herein may be implemented independently of any other aspects and that two or more of these aspects may be combined in various ways. For example, any number of aspects set forth herein can be used to implement an apparatus and/or practice a method. In addition, such an apparatus may be implemented and/or such a method practiced using other structure and/or functionality than one or more of the aspects set forth herein.

It should also be noted that the diagrams provided in the following embodiments are only schematically illustrating the basic ideas of the present disclosure, and only the components related to the present disclosure are shown in the drawings rather than the number, shape and shape of the components in actual implementation. Dimensional drawing, the type, quantity and proportion of each component can be changed arbitrarily during actual implementation, and the component layout type may also be more complicated.

Additionally, in the following description, specific details are provided to facilitate a thorough understanding of examples. However, it will be understood by those skilled in the art that the described aspects may be practiced without these specific details.

Referring to Fig. 1, the first aspect of the present application discloses a data cascading channel detection method, which specifically includes the following steps:

S100, judging whether the cascade service at the current level is normal, if not, outputting the first abnormal information,

S200, if yes, judge whether the cascaded related components of the current level are normal, if not, output the second abnormal information,

S300, if yes, judge whether the address of the opposite end is consistent, if not, output the third abnormal information,

S400, if yes, judge whether the peer address is connected, if not, output the fourth abnormal information,

S500, if yes, judge whether the sent message has a receipt, if not, output the fifth abnormal information,

If so, output channel unblocked information;

Wherein, the peer address is the configured upper-level IP address.

In this embodiment, judging whether the cascading service at the current level is normal includes: calling through the RPC interface to determine whether the service interface can be called normally; call normally.

Specifically, detecting whether the cascade service at the current level is normal refers to detecting whether the service of the data sender is normal, that is, detecting whether the process of the sender service exists. Therefore, it is judged whether the service interface can be called normally by calling the RPC interface. If it can be called normally, It means that the service is normal. If it cannot be called normally, it means that the service is abnormal.

In this embodiment, judging whether the cascaded related components of the current level are normal includes: judging whether the database query statement can be executed normally, and if not, outputting database exception information;

If yes, judge whether the message middleware can interact, if not, output message middleware exception information;

If yes, judge whether the file upload/storage service is normal, and if not, output storage service exception information.

Specifically, detecting whether the cascading-related components at this level are normal refers to detecting the data sender service (data cascading service) and data cascading-related components, that is, components that need to be configured for data cascading services, such as databases, message middleware, and fastdfs And so on is normal.

Among them, the judgment of the database query statement refers to judging whether the database uses query sql; the message middleware judges whether it is normal by address connectivity and sending messages; fastdfs judges whether it is normal by simulating data file upload or download, and records each The state of a component that provides evidence for problems throughout the link.

It should be noted that there is no mandatory order for the judgment of database query statements, message middleware, and file upload/storage services. As long as these three are all normal, it will be judged that the cascading related components of the current level are normal. If any item is abnormal, the relevant components of the cascade at this level are judged to be abnormal.

In this embodiment, judging whether the peer address is consistent includes: obtaining the real-time communication address based on the established cascading relationship; then judging whether the real-time communication address is consistent with the stored address of the current level, if not, outputting the peer address is inconsistent exception information.

Among them, the address of the current level is the address stored in the current level when the cascading relationship is established; the real-time communication address refers to the address of the other party sent back through the http request at that time.

Further, the cascading relationship includes the platform IP address.

In this embodiment, judging whether the peer address has connectivity includes: judging whether the peer address has established a SOCKET connection, if not, then outputting the abnormal information that the peer address does not have connectivity, that is, in this step, for judging Can the agreement be passed.

Wherein, the establishment of the SOCKET connection may adopt the TCP protocol.

In this embodiment, judging whether the sent message has a receipt includes: sending test data to the address of the peer message queue, judging whether a receipt is received, if not, outputting the abnormal information that the cascading channel is not unblocked, that is, passing through this step Execution is to determine whether the sender can receive feedback information, that is, whether the established connection can be connected.

Among them, the test data can be created by oneself or automatically generated according to preset instructions; the sent test data will automatically generate a string.

Preferably, the message queue is ActiveMQ or Kafka.

In this embodiment, the method further includes: when the output information is abnormal information, performing a real-time alarm, so as to inform relevant personnel of a specific abnormal source and remind relevant personnel to perform real-time maintenance.

Referring to Figure 2, the solution provided by this application is a method for detecting whether the data cascading channel is normal, involving different levels and upper and lower data nodes. In this embodiment, the current level and the upper level are taken as examples for illustration .

Configure the address of the peer end of the relationship, which is the upper-level IP address to be configured, and is preferably manually input in this embodiment.

Detect whether the data sender service (that is, the data cascading service) is normal.

Detect whether the data sender service (data cascade service) and data cascade related components (database, message middleware, fastdfs, etc.) are normal, and record the status and exception description of each component.

Detect the consistency between the addresses stored at this level and those obtained in real time, and record the results and exception descriptions.

Detect whether the peer address can be connected, and record the result and exception description.

Send test data to the peer address, and record whether the receipt status is received. If a receipt is received, it means that the overall cascade channel is unblocked and the process ends.

The existing technology only considers the problem of each link of the detection itself, and does not form a problem in a closed-loop link from the data sender to the data receiver and then the receipt. This detection method wants to judge when there is a cascading relationship between the upper and lower levels It can be used when it can communicate with each other or when there is a cascading relationship that cannot be used for data synchronization, and it can display the problems existing in each link when a problem occurs, and then the software implementer or developer can quickly solve the problem.

The method disclosed in this application progresses layer by layer through the five aspects of whether the cascading service at the current level is normal, whether the relevant components of the cascading at the current level are normal, whether the peer address is consistent, whether the peer address is connectable, and whether the sent message is a receipt. Analysis, using the data cascading channel detection function, when the data cascades or the channel has problems, the detection function can intuitively reflect the problems in each link, and the problem location is faster and more accurate, and the user experience is better.

Furthermore, the entire detection method disclosed in this application can be integrated into a program, that is, cascaded services, and the page can only provide one operation entry, which calls the cascaded service interface through the RPC interface call, inside the interface Implement the inspection process.

Referring to Fig. 3, the second aspect of the present application discloses a data cascade channel detection system, including:

The first judging module is configured to judge whether the cascade service at the current level is normal, and if not, output the first abnormal information;

The second judging module is configured to judge whether the relevant components of the cascading at the current level are normal if the cascading service at the current level is normal, and if not, output the second abnormal information;

The third judging module is configured to judge whether the address of the opposite end is consistent if the cascaded related components of the current level are normal, and if not, output the third abnormal information;

The fourth judging module is configured to judge whether the peer address is connected if the peer address is consistent, and if not, output the fourth abnormal information;

The fifth judging module is configured to judge whether the sent message has a receipt if the peer address has connectivity, and if not, output the fifth abnormal information;

The sixth judging module is configured to output channel unblocked information if there is a receipt for the sent message.

An electronic device according to an embodiment of the present disclosure includes a memory and a processor. The memory is used to store non-transitory computer readable instructions. Specifically, the memory may include one or more computer program products, which may include various forms of computer-readable storage media, such as volatile memory and/or non-volatile memory. The volatile memory may include, for example, random access memory (RAM) and/or cache memory (cache). The non-volatile memory may include, for example, a read-only memory (ROM), a hard disk, a flash memory, and the like.

The processor may be a central processing unit (CPU) or other form of processing unit having data processing capabilities and/or instruction execution capabilities, and may control other components in the electronic device to perform desired functions. In one embodiment of the present disclosure, the processor is configured to execute the computer-readable instructions stored in the memory, so that the electronic device executes all or part of the steps of the aforementioned data cascading channel detection method in each embodiment of the present disclosure.

Those skilled in the art should understand that in order to solve the technical problem of how to obtain a good user experience effect, this embodiment may also include known structures such as communication buses and interfaces, and these known structures should also be included in the protection scope of the present disclosure within.

FIG. 4 is a schematic structural diagram of an electronic device provided by an embodiment of the present disclosure. It shows a schematic structural diagram of an electronic device suitable for implementing the embodiments of the present disclosure. The electronic device shown in FIG. 4 is only an example, and should not limit the functions and application scope of the embodiments of the present disclosure.

As shown in FIG. 4, an electronic device may include a processing device (such as a central processing unit, a graphics processing unit, etc.), which may be stored in a read-only memory (ROM) or loaded into a random access memory (RAM) Various appropriate actions and processing are performed by the programs in the program. In RAM, various programs and data necessary for the operation of electronic equipment are also stored. The processing means, ROM, and RAM are connected to each other via a bus. Input/output (I/O) interfaces are also connected to the bus.

Generally, the following devices can be connected to the I/O interface: input devices including, for example, sensors or visual information collection devices, etc.; output devices, including, for example, display screens; storage devices including, for example, tapes, hard disks, etc.; and communication means. The communication means may allow the electronic device to perform wireless or wired communication with other devices, such as edge computing devices, to exchange data. While FIG. 4 shows an electronic device having various means, it should be understood that implementing or having all of the means shown is not a requirement. More or fewer means may alternatively be implemented or provided.

In particular, according to an embodiment of the present disclosure, the processes described above with reference to the flowcharts can be implemented as computer software programs. For example, embodiments of the present disclosure include a computer program product, which includes a computer program carried on a non-transitory computer readable medium, where the computer program includes program code for executing the method shown in the flowchart. In such an embodiment, the computer program may be downloaded and installed from a network via communication means, or installed from a storage means, or installed from a ROM. When the computer program is executed by the processing device, all or part of the steps of the data cascade channel detection method in the embodiments of the present disclosure are executed.

For detailed descriptions of this embodiment, reference may be made to corresponding descriptions in the preceding embodiments, and details are not repeated here.

A computer-readable storage medium according to an embodiment of the present disclosure has non-transitory computer-readable instructions stored thereon. When the non-transitory computer-readable instructions are executed by the processor, all or part of the steps of the foregoing data cascading channel detection methods in the various embodiments of the present disclosure are executed.

The above-mentioned computer-readable storage media include but are not limited to: optical storage media (such as: CD-ROM and DVD), magneto-optical storage media (such as: MO), magnetic storage media (such as: magnetic tape or mobile hard disk), with built-in Media that rewrites nonvolatile memory (eg: memory card) and media with built-in ROM (eg: ROM cartridge).

For detailed descriptions of this embodiment, reference may be made to corresponding descriptions in the preceding embodiments, and details are not repeated here.

The basic principles of the present disclosure have been described above in conjunction with specific embodiments, but it should be pointed out that the advantages, advantages, effects, etc. mentioned in the present disclosure are only examples rather than limitations, and these advantages, advantages, effects, etc. Various embodiments of the present disclosure must have. In addition, the specific details disclosed above are only for the purpose of illustration and understanding, rather than limitation, and the above details do not limit the present disclosure to be implemented by using the above specific details.

In this disclosure, relational terms such as first and second, etc. are only used to distinguish one entity or operation from another entity or operation, without necessarily requiring or implying any relationship between these entities or operations. An actual relationship or sequence, the block diagrams of devices, devices, devices, and systems involved in the present disclosure are only illustrative examples and are not intended to require or imply that they must be connected, arranged, and configured in the manner shown in the block diagrams. As will be appreciated by those skilled in the art, these devices, devices, devices, systems may be connected, arranged, configured in any manner. Words such as "including", "comprising", "having" and the like are open-ended words meaning "including but not limited to" and may be used interchangeably therewith. As used herein, the words "or" and "and" refer to the word "and/or" and are used interchangeably therewith, unless the context clearly dictates otherwise. As used herein, the word "such as" refers to the phrase "such as but not limited to" and can be used interchangeably therewith.

Additionally, as used herein, the use of "or" in a listing of items beginning with "at least one" indicates separate listings, such that for example a listing of "at least one of A, B, or C" means A or B or C, or AB or AC or BC, or ABC (ie A and B and C). Furthermore, the word "exemplary" does not mean that the described examples are preferred or better than other examples.

It should also be pointed out that in the systems and methods of the present disclosure, each component or each step can be decomposed and/or reassembled. These decompositions and/or recombinations should be considered equivalents of the present disclosure.

Various changes, substitutions and alterations to the technology described herein can be made without departing from the teaching of the technology as defined by the appended claims. Furthermore, the scope of the claims of the present disclosure is not limited to the specific aspects of the process, machine, manufacture, composition of matter, means, methods and acts described above. Any process, machine, manufacture, composition of matter, means, method or act, currently existing or later developed, which performs substantially the same function or achieves substantially the same result as the corresponding aspect described herein may be utilized. Accordingly, the appended claims include within their scope such processes, machines, manufacture, compositions of matter, means, methods, or acts.

The above description of the disclosed aspects is provided to enable any person skilled in the art to make or use the present disclosure. Various modifications to these aspects will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other aspects without departing from the scope of the present disclosure. Thus, the present disclosure is not intended to be limited to the aspects shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

The foregoing description has been presented for purposes of illustration and description. Furthermore, this description is not intended to limit the disclosed embodiments to the forms disclosed herein. Although a number of example aspects and embodiments have been discussed above, those skilled in the art will recognize certain variations, modifications, changes, additions and sub-combinations thereof.

Claims (10)

1. The data cascade channel detection method is characterized by comprising the following steps of:

judging whether the cascade service of the stage is normal or not, if not, outputting first abnormal information,

if yes, judging whether the cascade related component of the stage is normal, if not, outputting second abnormal information,

if yes, judging whether the addresses of the opposite ends are consistent, if not, outputting third abnormal information,

if yes, judging whether the opposite terminal address is connectivity, if not, outputting fourth abnormal information,

if yes, judging whether the sent message has a receipt, if not, outputting fifth abnormal information,

if yes, outputting channel unblocked information;

and the opposite terminal address is a configured upper-level IP address.

2. The method for detecting a data cascade channel according to claim 1, wherein the determining whether the cascade service of the present stage is normal or not, if not, outputting the first abnormal information, comprises:

judging whether a service interface can be normally called or not through the RPC interface call, if not, judging that the cascade service of the stage is abnormal;

the first abnormal information is that the service interface cannot be normally called.

3. The method for detecting a data cascade channel according to claim 1, wherein the determining whether the cascade related component of the present stage is normal or not, if not, outputting the second abnormal information, comprises:

judging whether the database query statement can be normally executed, if not, outputting the abnormal information of the database,

if so, judging whether the message middleware can interact, if not, outputting message middleware abnormality information,

if yes, judging whether the file uploading/storing service is normal, and if not, outputting abnormal information of the storing service.

4. The method for detecting a data cascade channel according to claim 1, wherein the determining whether the addresses of the opposite ends are identical, if not, outputting third abnormality information, comprises:

acquiring a real-time communication address based on the established cascade relation;

and judging whether the real-time communication address is consistent with the stored current-stage address, and if not, outputting abnormal information of inconsistent opposite-end addresses.

5. The method for detecting a data cascade channel according to claim 1, wherein the determining whether the peer address is connectable or not, and if not, outputting fourth abnormality information, comprises:

judging whether the opposite terminal address establishes SOCKET connection, if not, outputting abnormal information that the opposite terminal address does not have connectivity.

6. The method for detecting a data cascade channel according to claim 1, wherein the determining whether the transmitted message has a receipt, and if not, outputting fifth abnormality information, comprises:

and sending test data to the address of the opposite-end message queue, judging whether receipt is received, and if not, outputting abnormal information that the cascade channel is not smooth.

7. The method for detecting a data cascade channel according to claim 1, further comprising: and when the output information is abnormal information, carrying out real-time warning.

8. A data concatenation channel detection system, comprising:

the first judging module is configured to judge whether the cascade service of the stage is normal or not, and if not, the first judging module outputs first abnormal information;

the second judging module is configured to judge whether the cascade related component of the present stage is normal if the cascade service of the present stage is normal, and if not, output second abnormal information;

the third judging module is configured to judge whether the opposite terminal addresses are consistent if the cascade related components of the stage are normal, and if not, output third abnormal information;

a fourth judging module configured to judge whether the opposite terminal address is connectivity if the opposite terminal address is consistent, and if not, output fourth abnormal information;

a fifth judging module configured to judge whether the sent message has a receipt if the opposite terminal address has connectivity, and if not, output fifth abnormal information;

and the sixth judging module is configured to output channel unblocked information if the sent message has a receipt.

9. An electronic device, the electronic device comprising:

at least one processor; the method comprises the steps of,

a memory communicatively coupled to the at least one processor; wherein,,

the memory stores instructions executable by the at least one processor to enable the at least one processor to perform the data concatenation channel detection method according to any one of claims 1 to 7.

10. A computer readable storage medium storing computer instructions for causing a computer to perform the data concatenation channel detection method according to any one of claims 1 to 7.