TWM606413U - Batch data processing and monitoring device - Google Patents

Abstract

In order to quickly and effectively find out which piece of data caused the abnormality and its abnormal content when an abnormality occurs when processing a large amount of data, a batch data processing and monitoring device is provided. The batch data processing and monitoring device includes a process control module, a batch operation module, and a batch analysis module. The above-mentioned process control module includes an icon scheduling unit and a background scheduling unit. The above icon scheduling unit is used to arrange batch processing icons and output XML files. The above background scheduling unit is used to schedule the corresponding batch processing program in the background of the Windows operating system based on the XML file. The batch operation module described above executes batch processing programs for processing data according to the XML file and outputs corresponding log files respectively. The above-mentioned batch analysis module outputs an abnormal notification when the log file meets the abnormal standard.

Description

Batch data processing and monitoring device

The model relates to a batch data processing device, in particular to a device that can schedule batch processing flow in a background program, and can also automatically monitor abnormal conditions during batch processing.

In the information age, computers often need to process large amounts of data. In the process of processing these large amounts of data, there may be abnormal situations. However, when an abnormal situation occurs, it is difficult to find out which processing data caused the abnormal situation in the large amount of processing data, and it will consume a lot of time and manpower to find the abnormal processing data. Even after finding out the processing data of the abnormality, it is still not known what the abnormality happened. Therefore, how to quickly and effectively find out which piece of data caused the abnormality and its abnormal content has become a problem to be solved in the field.

In order to solve the above problems, a batch data processing and monitoring device has been developed to process a large amount of to-be-processed data in batch processing programs, wherein the above batch processing programs can respectively correspond to the batch processing icons. Therefore, the operator can quickly arrange and combine the batch processing programs that need to be performed through the above batch processing icon, so as to quickly perform batch processing on the processed data.

In addition, each batch processing program will record and output a log file (that is, a LOG file) after completing the corresponding processing content for the processing data. In particular, each log file contains the response code processed by each batch processing program. Through the above log files, you can quickly know the processing status of each batch processing program when processing data.

Even when it is known that the processing has abnormal conditions based on the response code, the abnormal notification can be output in time to notify each operator, and the abnormal notification can also be aggregated into an analysis report. In addition, each operator can also know the latest processing situation at any time without waiting for an exception notification.

Specifically, an embodiment of the present invention provides a batch data processing and monitoring device. The above batch data processing and monitoring device can be installed on a computer and supports a Windows operating system. In addition, the aforementioned batch data processing and monitoring device includes a database, a process control module, a batch operation module, a batch monitoring module, and a batch analysis module.

The above database is used to store processing data and batch processing programs.

The above-mentioned process control module is used to communicate with the database to receive batch processing programs. Wherein, the above-mentioned process control module includes: a display unit, an icon scheduling unit, a background scheduling unit, and an interactive detection service unit.

The above-mentioned display unit is used to display batch processing icons, wherein the batch processing icons can be respectively corresponding to batch processing programs.

The above icon scheduling unit is used to communicate with the display list to arrange batch processing icons, save and output XML files.

The above-mentioned background scheduling unit is used to communicate with the icon scheduling unit to receive the XML file, and schedule the corresponding batch processing program according to the batch processing icon in the background of the Windows operating system.

The above interactive detection service unit is used to communicate with the background scheduling unit for confirmation to activate the scheduled batch processing program.

The above batch operation module is used to communicate with the database to receive processing data and batch processing programs, and to communicate with the process control module to receive XML files. The batch operation module executes the batch processing program for the processing data according to the XML file, and respectively outputs the log file of the corresponding batch processing program to the process control module. The above-mentioned log file is used to reflect the corresponding processing conditions of the batch processing programs, and is a data format supported by the process control module.

The above-mentioned batch monitoring module is used to communicate with the process control module to receive the log file, and according to the content of the log file, output the corresponding processing status of each batch processing program in time.

The above-mentioned batch analysis module is used to communicate with the process control module to receive the log file, and when the content of the log file meets the abnormal standard, an abnormal notification is output.

According to an embodiment, each log file includes the response code of each of the batch processing programs, wherein the response code is a number, English, symbol, or any combination thereof.

According to another embodiment, the above-mentioned batch analysis module further aggregates abnormal notifications to output analysis reports.

Based on the above embodiments of the present invention, the following effects can be further claimed:

(1) Since the batch processing flow is graphically converted into batch processing icons, unfamiliar operators can quickly execute the batch processing flow by simply arranging and combining the batch processing icons. At the same time, operators who are already familiar with the batch processing icons can also operate batch data processing more intuitively and quickly to perform each batch data processing more efficiently.

(2) Among them, the log files corresponding to each batch processing program can quickly and timely grasp the processing status of each batch processing program during batch processing of each processing data.

(3) At the same time, through the above log files, it is also possible to quickly find the abnormal batch processing program, and to know the abnormal situation in time, and notify each operator accordingly.

(4) In addition, each batch processing program is performed in the background of the window operating system, so the operating speed of the window operating system itself or other operating programs will not be affected during the execution of the batch processing program.

In view of the above-mentioned problems to be overcome, a batch data processing and monitoring device has been developed to perform batch processing for a large amount of processed data with a batch processing program. The above batch processing programs can be respectively corresponding to the batch processing icons, so that each operator only needs to simply arrange and combine the above batch processing icons, and after confirmation, they can quickly execute the corresponding batch processing for the processing data Batch processing of the program.

After completing the execution of the corresponding batch processing program, the corresponding batch processing program will record and output a log file (that is, LOG file), where the log file contains the corresponding response code. Through the above log files, you can quickly know the processing status of each batch processing program when processing data. In addition, it is possible to further notify each operator by outputting an abnormal notification in time when it is known that an abnormal situation has occurred in the processing, and even the abnormal notification can be aggregated into an analysis report. At the same time, each operator can also learn the latest processing status at any time, such as by logging in to the device or corresponding web page, without waiting for the abnormal notification.

Specifically, please refer to FIG. 1, which is a schematic diagram of a batch data processing and monitoring device according to an embodiment of the present invention. An embodiment of the present invention provides a batch data processing and monitoring device 100, which can be installed in a notebook computer, a desktop computer, a tablet computer, or other digital electronic devices that can support a Windows operating system (ie, Windows operating system) in.

The aforementioned batch data processing and monitoring device 100 includes: a database 110, a process control module 120, a batch operation module 130, a batch monitoring module 140, and a batch analysis module 150.

Regarding the aforementioned database 110, further description is as follows.

The aforementioned database 110 is used to store processing data and batch processing programs. The above batch processing program can perform multiple sets of different processing contents for the same or different processing data at the same time point, or perform multiple sets of different processing contents for the same or different processing data but in chronological order. The processing data may include various formats supported by the batch processing program and corresponding content.

For example, taking different processing data (that is, batch processing data) as an example, when the batch processing program wants to check accounts, it must check the bank transfer data and bank transfer data, so the first batch The processing program performs account verification for bank transfer data, and uses the second batch of processing program to perform transfer amount verification for bank transfer data, and the processing data can include basic account data, transfer out and transfer amount data, etc. Relevant information.

The above-mentioned process control module 120 is further described as follows.

The above-mentioned process control module 120 is used to communicate with the database 110 to receive batch processing programs. The process control module 120 includes a display unit 121, an icon scheduling unit 122, a background scheduling unit 123, and an interactive detection service unit 124.

The above-mentioned display unit 121 is further described as follows.

The above-mentioned display unit 121 is used to display batch processing icons through (for example, a screen), wherein each batch processing icon can be respectively corresponding to each batch processing program. For example, batch processing icon A can correspond to batch processing program A to perform processing content corresponding to batch processing program A (for example, check of bank transfer data); and batch processing icon B can correspond to batch Sub-processing program B to perform processing content corresponding to batch processing program B (for example, verification of bank transfer data).

The above-mentioned illustrated scheduling unit 122 is further described as follows.

The above-mentioned icon scheduling unit 122 is used to communicate with the display unit 121 to provide each operator 200 with receiving each batch processing icon, so as to arrange and combine the batch processing icons according to the sequence of the desired batch processing . In other words, each operator 200 can input batch scheduling instructions for the icon scheduling unit 122 through each batch processing icon. The icon scheduling unit 122 then stores the arranged and combined batch processing icons, and outputs an XML file corresponding to the arranged and combined batch processing icons (that is, extensible markup language, abbreviated as extensible markup language). As XML). Among them, the XML file refers to a file format that is written in an internationally accepted markup language and can be understood by computers and supported and processed between computers.

The above background scheduling unit 123 is further described as follows.

The aforementioned background scheduling unit 123 is used to communicate with the illustrated scheduling unit 122 to receive the XML file. The background scheduling unit 123 can schedule the batch processing program corresponding to each grouped batch processing icon in the background of the Windows operating system according to the grouped batch processing icons in the XML file for Subsequently, in the background of the Windows operating system, the above-mentioned processing data is processed in batches according to the batch processing program.

The above-mentioned interactive detection service unit 124 is further described as follows.

The above-mentioned interactive detection service unit 124 is used to communicate with the background scheduling unit 123, for example, through the window screen of the display screen (such as a screen) to display reminder messages for each operator 200 to perform the scheduled batch processing program Manual confirmation, to allow the scheduled batch processing programs to be activated. That is, each operator 200 can input the batch scheduling command again through the interactive detection service unit 124 for the scheduled icon scheduling unit 122 to confirm and start the batch processing operation.

The above-mentioned batch operation module 130 is further described as follows.

After the batch operation module 130 has confirmed the batch processing program by each operator 200, it needs to activate the scheduled batch processing programs. That is, the aforementioned batch operation module 130 is used to communicate with the database 110 to receive processing data and batch processing programs, and to communicate with the process control module 120 to receive XML files. The batch operation module 130 executes the scheduled batch processing program for the processing data according to the XML file. The batch operation module 130 outputs corresponding log files for each batch processing program (for example, output to the process control module 120) during or after the execution of each batch processing program.

Among them, the log file (ie, logfile, LOG file for short) refers to a file used to record events that occur in the running operating system or other software, and is a data format supported by the process control module 120. According to an embodiment, each log file includes a response code corresponding to each batch of processing programs executed, and each response code is a number, English, symbol, or any combination thereof. For example, the response code can be any number from 000-999, or can be any combination of X000-X999, Y000-Y999 and/or Z000-Z999.

Among them, the processing status can be known through the response codes in the above log files. For example, if the response code starts with X, it can represent "pending", and it can notify each operator of the 200 "pending" message content in time. For another example, the beginning of Y can represent "processing", and the beginning of Z can represent "abnormality occurred during processing" and other message content. Among them, if the response code is for example Z0001, it can represent "insufficient data", Z0002 can represent "data blank", and Z0003 can represent "abnormal processing time", etc. And so on, so I won't repeat it here.

Regarding the batch monitoring module 140 described above, further description is as follows.

The batch monitoring module 140 is used to communicate with the process control module 120 to receive the log file returned by the batch operation module 130. The batch monitoring module 140 can convert the log file into identifiable message content, and use the display device (such as a screen) or other devices (such as email or mobile phone text) to output the processing corresponding to the batch processing program in a timely manner Circumstances, notify each operator 200 in time. As mentioned before, I will not repeat it here.

The above-mentioned batch analysis module 150 is further described as follows.

The batch analysis module 150 is used to communicate with the process control module 120 to receive the log file returned by the batch operation module 130. The batch analysis module 150 outputs an abnormal notification when the log file meets the abnormal standard. For example, the beginning of the response code with Z can represent "an exception occurred during processing", and the exception criterion can be "whether the response code begins with Z"; therefore, for example, the response code in the log file starts with Z, such as Z0001, it can be output The corresponding abnormal notification "Insufficient data" will notify each operator 200. And so on, so I won't repeat it here.

According to another embodiment, the batch analysis module 150 further aggregates abnormal notifications to correspond to each batch processing program or to integrate the corresponding batch processing programs to output an analysis report. For example, for the abnormal notification A1 generated by the batch processing program A, an analysis report corresponding to the batch processing program A can be output. Or for example, for the abnormal notification A1 generated by the batch processing program A, and the abnormal notification B1 and B2 generated by the batch processing program B, the analysis report corresponding to the batch processing program A and B (including the abnormal notification A1, B1 and B2). And so on, so I won't repeat it here.

FIG. 2 is a flowchart of a batch data processing and monitoring method according to an embodiment of the present invention. In addition to the aforementioned batch data processing and monitoring device 100, a batch data processing and monitoring method 300 is further provided, which is described as follows.

In step 310 in Figure 2, read the batch processing icons, and arrange and combine the batch processing icons arbitrarily. Then, after finishing the arrangement and combination of batch processing icons, save and output the XML file. As the details are as mentioned before, I will not repeat them here.

Then, in step 320, the XML file is received, and the batch processing program corresponding to the batch processing icon is scheduled in the background of the Windows operating system according to the arranged batch processing icons in the XML file. As the details are as mentioned before, I will not repeat them here.

Then, in step 330, confirm through each operator 300 to subsequently activate the scheduled batch processing program. As the details are as mentioned before, I will not repeat them here.

Then, in step 340, for processing data, execute the scheduled batch processing program in the background of the Windows operating system. As the details are as mentioned before, I will not repeat them here.

Then, in step 350, after the batch processing program is executed, the log file corresponding to each batch processing program is output. Among them, the log file includes response codes, and each response code is a number, English, symbol, or any combination thereof. As the details are as mentioned before, I will not repeat them here.

Then, in step 360, the log file of each batch processing program is received, and the processing status corresponding to each batch processing program is output according to the log file. As the details are as mentioned before, I will not repeat them here.

Then, in step 380, it is determined whether there are other scheduled batch processing programs. When it is judged that there are other scheduled batch processing programs, return to step 340 until all scheduled batch processing programs are completed. Conversely, when it is determined that there are no other scheduled batch processing programs, the batch data processing and monitoring method 300 is ended. As the details are as mentioned before, I will not repeat them here.

At the same time, in step 370, it is confirmed whether the log file of each batch processing program meets the abnormal standard. When the log file meets the abnormality standard, in step 371, a corresponding abnormality notification is output to notify each operator 200. Conversely, when the log file does not meet the abnormality standard, it is also determined in step 380 whether there are other scheduled batch processing programs. As the details are as mentioned before, I will not repeat them here.

Integrating the above batch data processing and monitoring devices, and batch data processing and monitoring methods, you can quickly arrange and combine batch processing programs that you want to execute in the background of the Windows operating system through the batch processing icons, and During or after the execution of the specified batch processing program, the log file containing the processing status will be returned. Then, through the log file, you can quickly determine the processing status of each batch processing program; when it is determined that there is an abnormal situation, it will quickly and timely issue an abnormal notification to remind each operator of the execution of each batch processing program During the process, an abnormal situation has occurred.

In this way, there is no need to find out which piece of processing data has an execution abnormality in a large amount of processing data, and the specific abnormality content can be learned directly through the log file or the response code therein. Therefore, it is no longer necessary to spend a lot of time and manpower to find out the abnormal processing data and its corresponding location.

In addition, because the scheduled batch processing program is executed through the background of the window operating system, the execution of each batch processing program will not affect other operations of the original window operating system. In addition, due to the introduction of a highly user-friendly and easy-to-operate scheduling interface, operators can quickly execute batch processing programs for large amounts of processing data only by arranging and combining simple and intuitive batch processing icons. .

The present model is disclosed in the preferred embodiments in this text. However, anyone familiar with the technical field should understand that the above-mentioned embodiments are only used to describe the present model and are not intended to limit the scope of the patent rights claimed by the present model. Any changes or substitutions equivalent or equivalent to the above-mentioned embodiments should be interpreted as being covered by the spirit or scope of the present invention. Therefore, the scope of protection of this new model shall be subject to the scope of the following patent applications.

100: Batch data processing and monitoring device 110: database 120: Process control module 121: display unit 122: Graphical scheduling unit 123: background scheduling unit 124: Interactive Detection Service Unit 130: Batch operation module 140: Batch monitoring module 150: Batch analysis module 200: Operator 300: Batch data processing and monitoring methods 310-380, 371: steps

In order to make the above and other objectives, features, advantages and embodiments of the present invention more comprehensible, the description of the attached drawings is as follows: FIG. 1 is a schematic diagram of a batch data processing and monitoring device according to an embodiment of the present invention. FIG. 2 is a flowchart of a batch data processing and monitoring method according to an embodiment of the present invention.

100: Batch data processing and monitoring device

110: database

120: Process control module

121: display unit

122: Graphical scheduling unit

123: background scheduling unit

124: Interactive Detection Service Unit

130: Batch operation module

140: Batch monitoring module

150: Batch analysis module

200: Operator

Claims (3)

A batch data processing and monitoring device installed in a computer and supporting a Windows operating system. The batch data processing and monitoring device includes: A database, storing multiple processing data and multiple batch processing programs; A process control module, communicatively connected to the database to receive the batch processing programs, the process control module includes: A display unit, displaying a plurality of batch processing icons, wherein the batch processing icons correspond to the batch processing programs; An icon scheduling unit, communicatively connected to the display unit to arrange the batch processing icons, and store and output an XML file; A background scheduling unit, which is communicatively connected to the icon scheduling unit to receive the XML file, and schedules the corresponding batch processing programs according to the batch processing icons in the background of the Windows operating system; and An interactive detection service unit, communicatively connected to the background scheduling unit for confirmation to activate the scheduled batch processing programs; A batch operation module, communicatively connected to the database to receive the processing data and the batch processing programs, communicatively connected to the process control module to receive the XML file, and based on the XML file for the processing The data executes the batch processing programs, and outputs a plurality of log files corresponding to the batch processing programs to the process control module. The log files are used to reflect the corresponding processing conditions of the batch processing programs. And it is the data format supported by the process control module; A batch monitoring module, which is communicatively connected to the process control module to receive the log files, and output the corresponding processing conditions of the batch processing programs in a timely manner according to the content of the log files; and A batch analysis module is communicatively connected to the process control module to receive the log files, and when the content of the log files meets an abnormal standard, output an abnormal notification. According to the batch data processing and monitoring device of claim 1, each of the log files includes a response code of each of the batch processing programs, and the response code is a number, English, symbol, or any combination thereof. The batch data processing and monitoring device according to claim 1 or 2, wherein the batch analysis module further aggregates the abnormal notification to output an analysis report.

Images