CN116016601A - Situation awareness equipment-based operation data acquisition method, equipment and medium - Google Patents
Situation awareness equipment-based operation data acquisition method, equipment and medium Download PDFInfo
- Publication number
- CN116016601A CN116016601A CN202211732538.2A CN202211732538A CN116016601A CN 116016601 A CN116016601 A CN 116016601A CN 202211732538 A CN202211732538 A CN 202211732538A CN 116016601 A CN116016601 A CN 116016601A
- Authority
- CN
- China
- Prior art keywords
- operation data
- data
- data collection
- collection
- alarm
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000000034 method Methods 0.000 title claims abstract description 37
- 238000013480 data collection Methods 0.000 claims abstract description 104
- 238000012545 processing Methods 0.000 claims abstract description 25
- 238000004590 computer program Methods 0.000 claims description 9
- 230000007423 decrease Effects 0.000 claims description 6
- 238000010586 diagram Methods 0.000 description 7
- 238000012986 modification Methods 0.000 description 4
- 230000004048 modification Effects 0.000 description 4
- 238000004891 communication Methods 0.000 description 3
- 238000005516 engineering process Methods 0.000 description 3
- 230000006870 function Effects 0.000 description 3
- 230000008569 process Effects 0.000 description 3
- 238000004458 analytical method Methods 0.000 description 2
- 230000009467 reduction Effects 0.000 description 2
- 238000003491 array Methods 0.000 description 1
- 238000013473 artificial intelligence Methods 0.000 description 1
- 238000004422 calculation algorithm Methods 0.000 description 1
- 230000008878 coupling Effects 0.000 description 1
- 238000010168 coupling process Methods 0.000 description 1
- 238000005859 coupling reaction Methods 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 238000001514 detection method Methods 0.000 description 1
- 238000011156 evaluation Methods 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 238000005457 optimization Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 230000001360 synchronised effect Effects 0.000 description 1
- 238000012546 transfer Methods 0.000 description 1
- 230000001960 triggered effect Effects 0.000 description 1
Images
Classifications
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02P—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN THE PRODUCTION OR PROCESSING OF GOODS
- Y02P90/00—Enabling technologies with a potential contribution to greenhouse gas [GHG] emissions mitigation
- Y02P90/02—Total factory control, e.g. smart factories, flexible manufacturing systems [FMS] or integrated manufacturing systems [IMS]
Landscapes
- Testing And Monitoring For Control Systems (AREA)
Abstract
本申请涉及一种基于态势感知设备运行数据采集方法、设备及介质,包括以下步骤:S101、基于厂站侧设备的运行数据采集需求,预设运行数据采集参数,其中,所述运行数据采集参数包括但不限于为:地域、集团、IP列表、设备类型、采集频率、时间区间、运行数据种类;S102、基于预设的所述运行数据采集参数,生成运行数据采集脚本的启动命令;S103、将所述运行数据采集脚本上传到所述厂站侧设备;S104、根据所述启动命令远程启动所述运行数据采集脚本,所述运行数据采集脚本根据接收的命令对所述厂站侧设备的运行数据进行采集。通过将运行数据采集上报服务与应用软件解耦,扩大了运行数据采集目标设备的范围。
The present application relates to a method, device, and medium for collecting operation data of equipment based on situational awareness, including the following steps: S101, based on the operation data collection requirements of the plant side equipment, preset operation data collection parameters, wherein the operation data collection parameters Including but not limited to: region, group, IP list, device type, collection frequency, time interval, and type of operation data; S102, based on the preset operation data collection parameters, generate a startup command for the operation data collection script; S103, Upload the operation data collection script to the plant side equipment; S104, remotely start the operation data collection script according to the startup command, and the operation data collection script performs the processing of the plant side equipment according to the received command Run data collection. By decoupling the operation data collection and reporting service from the application software, the range of target equipment for operation data collection is expanded.
Description
技术领域technical field
本申请涉及工控安全技术领域,特别是涉及一种基于态势感知设备运行数据采集方法、设备及介质。The present application relates to the technical field of industrial control security, in particular to a method, device and medium for collecting operation data of equipment based on situational awareness.
背景技术Background technique
能源工业互联网平台安全态势感知(下简称“态势感知”)是能源工业互联网平台的重要组成部分,是由国家部委和各能源集团共同参与建设的安全态势感知平台,实现能源工业互联网各类网络安全的态势感知和溯源取证。安全态势感知厂站侧平台(下简称“厂站侧平台”)是指部署在各能源集团厂站的网络安全综合检测系统,由数据采集装置、厂级分析平台等专用设备以及防火墙、交换机、加密机等通用设备共同组成。Security Situation Awareness of the Energy Industry Internet Platform (hereinafter referred to as "Situation Awareness") is an important part of the Energy Industry Internet Platform. Situational awareness and traceability forensics. The security situation awareness plant-side platform (hereinafter referred to as the "plant-side platform") refers to the network security comprehensive detection system deployed in the plants of various energy groups. It consists of special equipment such as data acquisition devices, plant-level analysis platforms, firewalls, switches, Common devices such as encryption machines are jointly composed.
厂站侧平台承载着厂站网络数据采集、网络安全态势分析的重要作用,厂站侧平台设备的运行情况直接影响态势感知的决策有效性。因此需要对厂站侧平台设备的运行状态数据进行采集分析,能够分析厂站侧平台设备运行情况,使设备的软件和硬件时刻能够保持在最优的工作状态下,稳定、准确地分析并上报数据。当前厂站侧设备通过主动采集、定时上报的方式采集部分运行数据,对于像交换机、防火墙、加密机等通用设备,通常支持通过syslog的方式上报指定性能数据,对于数据采集装置、厂级分析平台等专用设备,则通常安装数据采集服务及定时上报服务,经由定时上报服务将运行数据同步到中心侧平台,再由态势感知中心侧平台应用对各类运行数据进行解析和展示。The station-side platform plays an important role in collecting station network data and analyzing the network security situation. The operation of the station-side platform equipment directly affects the effectiveness of situational awareness decision-making. Therefore, it is necessary to collect and analyze the operating status data of the platform equipment on the plant side, to be able to analyze the operating conditions of the platform equipment on the plant side, so that the software and hardware of the equipment can be kept in the optimal working state at all times, and analyzed and reported stably and accurately data. At present, the equipment on the factory station side collects some operating data through active collection and regular reporting. For general equipment such as switches, firewalls, and encryption machines, it usually supports reporting specified performance data through syslog. For data collection devices and factory-level analysis platforms For special equipment such as special equipment, data collection services and regular reporting services are usually installed. Through the regular reporting service, the operating data is synchronized to the center-side platform, and then the application of the situational awareness center-side platform analyzes and displays various operating data.
而在现有技术中,运行状态数据是由态势感知厂站侧平台设备通过数据接口或syslog主动上报的,上报后的数据由态势感知中心侧平台处理并展示,但是运行状态数据采集上报功能集成在态势感知系统厂站侧设备的应用软件中,与应用软件耦合度过高,不利于运行状态数据采集能力的修改和扩展。In the existing technology, the operating status data is actively reported by the situation awareness plant side platform equipment through the data interface or syslog, and the reported data is processed and displayed by the situation awareness center side platform, but the operation status data collection and reporting function is integrated In the application software of the plant side equipment of the situation awareness system, the coupling with the application software is too high, which is not conducive to the modification and expansion of the operation status data collection capability.
发明内容Contents of the invention
本申请提供了一种基于态势感知设备运行数据采集方法、设备及介质,通过将运行数据采集上报服务与应用软件解耦,扩大了运行数据采集目标设备的范围。The present application provides a method, device, and medium for collecting operation data of equipment based on situational awareness. By decoupling the operation data collection and reporting service from the application software, the range of target equipment for operation data collection is expanded.
第一方面,本申请提供了一种基于态势感知设备运行数据采集方法,包括以下步骤:S101、基于厂站侧设备的运行数据采集需求,预设运行数据采集参数,其中,所述运行数据采集参数包括但不限于为:地域、集团、IP列表、设备类型、采集频率、时间区间、运行数据种类;S102、基于预设的所述运行数据采集参数,生成运行数据采集脚本的启动命令;S103、将所述运行数据采集脚本上传到所述厂站侧设备;S104、根据所述启动命令远程启动所述运行数据采集脚本,所述运行数据采集脚本根据接收的命令对所述厂站侧设备的运行数据进行采集。In the first aspect, the present application provides a method for collecting operation data of equipment based on situational awareness, including the following steps: S101. Based on the operation data collection requirements of the plant side equipment, preset operation data collection parameters, wherein the operation data collection The parameters include but are not limited to: region, group, IP list, device type, collection frequency, time interval, and type of operation data; S102, based on the preset operation data collection parameters, generate a startup command for the operation data collection script; S103 . Upload the operation data collection script to the plant side equipment; S104. Remotely start the operation data collection script according to the startup command, and the operation data collection script performs the operation on the plant side equipment according to the received command The operating data is collected.
优选的是,还包括以下步骤:S105、所述运行数据采集脚本根据所述运行数据采集参数中的采集频率将采集结果上传到中心侧平台的数据处理模块;S106、所述数据处理模块根据采集结果按照运行数据告警规则生成告警信息;其中所述运行数据告警规则包括运行数据告警阈值规则和运行数据告警趋势规则,所述运行数据告警阈值规则包括但不限于为:运行数据的运行值高于预设值n次或者低于预设值n次;所述运行数据告警趋势规则包括但不限于为:运行数据的运行值连续n次增长或者连续n次降低或者增长率高于预设值或者降低率低于预设值。Preferably, the following steps are also included: S105, the operation data collection script uploads the collection results to the data processing module of the center side platform according to the collection frequency in the operation data collection parameters; S106, the data processing module according to the collection frequency As a result, alarm information is generated according to the operation data alarm rules; wherein the operation data alarm rules include operation data alarm threshold rules and operation data alarm trend rules, and the operation data alarm threshold rules include but are not limited to: the operation value of the operation data is higher than The preset value is n times or lower than the preset value for n times; the operation data alarm trend rule includes but is not limited to: the operation value of the operation data increases for n consecutive times or decreases for n consecutive times or the growth rate is higher than the preset value or The reduction rate is lower than the preset value.
优选的是,还包括以下步骤:S107、所述数据处理模块根据采集结果生成运行趋势图。Preferably, the following step is further included: S107, the data processing module generates an operation trend graph according to the collection result.
优选的是,还包括以下步骤:S108、所述数据处理模块将生成的所述告警信息推送至中心侧平台的告警发送模块以及将生成的所述运行趋势图推送至中心侧平台的报告展示模块,所述告警发送模块发送告警信息,所述报告展示模块通过网页展示所述厂站侧设备的运行趋势图。Preferably, the following steps are also included: S108, the data processing module pushes the generated alarm information to the alarm sending module of the central platform and pushes the generated operation trend graph to the report display module of the central platform , the alarm sending module sends alarm information, and the report display module displays the operation trend graph of the plant side equipment through a web page.
优选的是,若采集结果满足所述运行数据告警阈值规则或者所述运行数据告警趋势规则,则还生成JSON数据;其中所述JSON数据的属性包括但不限于为:告警设备IP、告警规则类型、告警详情。Preferably, if the collection result satisfies the operation data alarm threshold rule or the operation data alarm trend rule, JSON data is also generated; wherein the attributes of the JSON data include but are not limited to: alarm device IP, alarm rule type , Alarm details.
优选的是,所述告警发送模块若收到所述JSON数据,则通过包括但不限于以电子邮件、短信息微信方式发送通知。Preferably, if the alarm sending module receives the JSON data, it will send a notification by means including but not limited to email or short message WeChat.
优选的是,所述步骤S102,包括:S1021、确定采集范围,若为地域或集团,则在厂站信息数据库中检索出所有所述厂站侧设备的IP,并根据待监控所述厂站侧设备的类型确定具体设备IP;若为所述厂站侧设备的IP列表,则将其存储到本地IP列表文件下以提供查询;S1022、根据所述运行数据采集参数中的采集频率、时间区间、运行数据种类拼接启动命令。Preferably, the step S102 includes: S1021. Determine the collection range. If it is a region or a group, retrieve the IPs of all the plant side equipment in the plant information database, and according to the site to be monitored The type of the side equipment determines the specific equipment IP; if it is the IP list of the plant side equipment, it is stored under the local IP list file to provide inquiries; S1022, according to the collection frequency and time in the operation data collection parameters Interval and running data type stitching start command.
优选的是,所述步骤S103,包括:通过中心侧平台的任务调度模块读取所述本地IP列表文件,遍历其中的IP,并将所述运行数据采集脚本传输到对应IP的所述厂站侧设备的指定目录下。Preferably, the step S103 includes: reading the local IP list file through the task scheduling module of the central platform, traversing the IPs therein, and transmitting the running data collection script to the factory station corresponding to the IP In the specified directory of the side device.
第二方面,本申请还提供了一种计算机设备,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其特征在于,所述处理器执行所述计算机程序时实现上述所述方法的步骤。In a second aspect, the present application also provides a computer device, including a memory, a processor, and a computer program stored on the memory and operable on the processor, wherein, when the processor executes the computer program, the The steps of the method described above.
第三方面,提供了一种计算机可读存储介质,其上存储有计算机程序,计算机程序被处理器执行时实现上述所述方法的步骤。In a third aspect, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the steps of the above-mentioned method are implemented.
本申请至少具有以下优点:This application has at least the following advantages:
第一方面,通过将一个独立的运行数据采集脚本传输到厂站侧设备,通过预设的运行数据采集参数,生成运行数据采集脚本的启动命令,远程启动厂站侧设备上的运行数据采集脚本,运行数据采集脚本可以利用操作系统自带的命令、环境等,实现对应运行数据的采集,而无需将采集功能集成在厂站侧设备的应用软件中;因此通过将运行数据采集上报服务与应用软件解耦,扩大了运行数据采集目标设备的范围,并且能够实现上报需求的客制化,实现运行数据采集种类和逻辑的灵活扩展;In the first aspect, by transmitting an independent running data collection script to the plant-side equipment, through the preset running data collection parameters, a start command of the running data collection script is generated, and the running data collection script on the plant-side equipment is remotely started , the running data collection script can use the commands and environment that come with the operating system to realize the collection of corresponding running data without integrating the collection function into the application software of the plant side equipment; therefore, by reporting the running data collection to the service and application Software decoupling expands the range of operating data acquisition target devices, and enables customization of reporting requirements, enabling flexible expansion of operating data collection types and logic;
第二方面,根据运行数据的阈值及趋势告警规则,将运行数据采集上报服务与应用软件解耦,确保正确评估出系统能力,及时识别出设备的弱点、指明调优方向、找出软件中存在的问题以及验证稳定性和可靠性。In the second aspect, according to the operating data threshold and trend alarm rules, the operating data collection and reporting service is decoupled from the application software to ensure the correct evaluation of system capabilities, timely identification of equipment weaknesses, indicating the direction of optimization, and finding out the existence of problems in the software. issues and verify stability and reliability.
附图说明Description of drawings
图1为一个实施例中显示一种基于态势感知设备运行数据采集方法的应用环境图;FIG. 1 is an application environment diagram showing a method for collecting data based on situational awareness equipment operation in an embodiment;
图2为一个实施例中显示一种基于态势感知设备运行数据采集方法的流程示意图;FIG. 2 is a schematic flow diagram showing a method for collecting operation data based on a situational awareness device in an embodiment;
图3为一个实施例中显示步骤S102中生成运行数据采集脚本的启动命令的流程示意图;Fig. 3 is a schematic flow diagram showing the startup command for generating and running the data collection script in step S102 in one embodiment;
图4为一个实施例中显示厂站侧设备运行时的内存用量的趋势图;Fig. 4 is a trend diagram showing the memory usage of the plant side equipment in operation in one embodiment;
图5为一个实施例中显示厂站侧设备运行时的CPC使用率的趋势图;Fig. 5 is a trend diagram showing the CPC usage rate when the station side equipment is running in one embodiment;
图6为一个实施例中计算机设备的示意性结构图。Fig. 6 is a schematic block diagram of a computer device in one embodiment.
具体实施方式Detailed ways
应该指出,以下详细说明都是例示性的,旨在对本申请提供进一步的说明。除非另有指明,本文使用的所有技术和科学术语具有与本申请所属技术领域的普通技术人员通常理解的相同含义。It should be pointed out that the following detailed description is exemplary and intended to provide further explanation to the present application. Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this application belongs.
需要注意的是,这里所使用的术语仅是为了描述具体实施方式,而非意图限制根据本申请的示例性实施方式。如在这里所使用的,除非上下文另外明确指出,否则单数形式也意图包括复数形式,此外,还应当理解的是,当在本说明书中使用属于“包含”和/或“包括”时,其指明存在特征、步骤、操作、器件、组件和/或它们的组合。It should be noted that the terminology used here is only for describing specific implementations, and is not intended to limit the exemplary implementations according to the present application. As used herein, unless the context clearly indicates otherwise, the singular form is also intended to include the plural form. In addition, it should also be understood that when the terms "comprising" and/or "comprising" are used in this specification, it indicates There are features, steps, operations, means, components and/or combinations thereof.
为使本申请实施例的目的、技术方案和优点更加清楚,下面将结合附图对本申请的各实施例进行详细的阐述。然而,本领域的普通技术人员可以理解,在本申请各实施例中,为了使读者更好地理解本申请而提出了许多技术细节。但是,即使没有这些技术细节和基于以下各实施例的种种变化和修改,也可以实现本申请所要求保护的技术方案。以下各个实施例的划分是为了描述方便,不应对本申请的具体实现方式构成任何限定,各个实施例在不矛盾的前提下可以相互结合,相互引用。In order to make the purpose, technical solutions and advantages of the embodiments of the present application clearer, the embodiments of the present application will be described in detail below with reference to the accompanying drawings. However, those of ordinary skill in the art can understand that in each embodiment of the application, many technical details are provided for readers to better understand the application. However, even without these technical details and various changes and modifications based on the following embodiments, the technical solutions claimed in this application can also be realized. The division of the following embodiments is for the convenience of description, and should not constitute any limitation to the specific implementation of the present application. The embodiments can be combined and referred to each other on the premise of no contradiction.
为了方便理解,首先对本申请所适用的系统进行描述。本申请提供的一种基于态势感知设备运行数据采集方法,可以应用于如图1所示的系统架构中。该系统包括:用户空间文件服务器103和终端设备101,终端设备101通过网络与用户空间文件服务器103通过网络进行通信。其中,用户空间文件服务器103可以是一个基于NFSv3\v4协议的文件服务器,运行在Linux坏境下,而NFS(网络文件系统)是文件系统之上的一个网络抽象,可允许运行于终端设备101的远程客户端以与本地文件系统相类似的方式,通过网络进行访问。终端设备101可以但不限于是各种个人计算机、笔记本电脑、智能手机、平板电脑等,用户空间文件服务器103可以用独立的服务器或者是多个服务器组成的服务器集群来实现。For ease of understanding, the system to which this application applies is described first. A method for collecting operation data of equipment based on situational awareness provided by the present application can be applied to the system architecture shown in FIG. 1 . The system includes: a user
图2为本申请实施例提供的一种基于态势感知设备运行数据采集方法的流程示意图,该方法可以由如图1所示系统中的用户空间文件服务器执行。如图2所示,该方法可以包括以下步骤:FIG. 2 is a schematic flowchart of a method for collecting operation data based on situational awareness devices provided by an embodiment of the present application. The method can be executed by a user space file server in the system shown in FIG. 1 . As shown in Figure 2, the method may include the following steps:
S101、基于厂站侧设备的运行数据采集需求,预设运行数据采集参数,其中,所述运行数据采集参数包括但不限于为:地域、集团、IP列表、设备类型、采集频率、时间区间、运行数据种类;S101. Based on the operation data collection requirements of the plant side equipment, preset operation data collection parameters, wherein the operation data collection parameters include but not limited to: region, group, IP list, equipment type, collection frequency, time interval, Types of operating data;
S102、基于预设的所述运行数据采集参数,生成运行数据采集脚本的启动命令;S102. Based on the preset operation data collection parameters, generate a startup command for the operation data collection script;
S103、将所述运行数据采集脚本上传到所述厂站侧设备;S103. Upload the running data collection script to the plant side equipment;
S104、根据所述启动命令远程启动所述运行数据采集脚本,所述运行数据采集脚本根据接收的命令对所述厂站侧设备的运行数据进行采集。S104. Remotely start the operation data collection script according to the startup command, and the operation data collection script collects the operation data of the plant side equipment according to the received command.
本实施例中根据厂站侧设备的运行数据采集需求,可以提前预设运行数据采集参数,而预设的运行数据采集参数包括了地域、集团、IP列表、设备类型、采集频率、时间区间、运行数据种类等等,而根据预设的这些运行数据采集参数能够生成运行数据采集脚本的启动命令,因此通过将一个独立的采集脚本传输到厂站侧设备,再远程启动厂站侧设备上的运行数据采集脚本,运行数据采集脚本可以利用操作系统自带的命令、环境等,实现对应运行数据的采集,而无需将采集功能集成在厂站侧设备的应用软件中,从而实现了运行数据采集上报服务与应用软件解耦,扩大了运行数据采集目标设备的范围,由此该采集方法可以实现上报需求的客制化,实现运行数据采集种类和逻辑的灵活扩展。In this embodiment, according to the operation data collection requirements of the plant side equipment, the operation data collection parameters can be preset in advance, and the preset operation data collection parameters include region, group, IP list, equipment type, collection frequency, time interval, Types of running data, etc., and according to these preset running data collection parameters, the startup command of the running data collection script can be generated, so by transmitting an independent collection script to the plant side equipment, and then remotely start the plant side equipment Run the data collection script, and the running data collection script can use the commands and environment that come with the operating system to realize the collection of corresponding running data without integrating the collection function into the application software of the plant side equipment, thus realizing the running data collection The reporting service is decoupled from the application software, which expands the range of target equipment for operating data collection, so that the collection method can realize the customization of reporting requirements, and realize the flexible expansion of the types and logic of operating data collection.
下面对每个步骤具体展开详细说明:The following is a detailed description of each step:
如图2所示,S101、基于厂站侧设备的运行数据采集需求,预设运行数据采集参数,其中,运行数据采集参数包括但不限于为:地域、集团、IP列表、设备类型、采集频率、时间区间、运行数据种类;As shown in Figure 2, S101, based on the operation data collection requirements of the plant side equipment, preset operation data collection parameters, wherein the operation data collection parameters include but are not limited to: region, group, IP list, equipment type, collection frequency , time interval, type of operation data;
在本实施例中,需要说明的是,当前厂站侧设备的运行数据可以包含设备运行时的硬件性能数据,如CPU、内存、磁盘占用率等;还可以包含操作系统和业务应用运行状态数据,如文件索引节点占用率、数据库连接数、数据处理吞吐量、应用服务运行状态等。因此本申请实施例中用户可以基于厂站侧设备的运行数据采集需求,预设运行数据采集参数,其中运行数据采集参数包括但不限于为:地域、集团、IP列表、设备类型、采集频率、时间区间、运行数据种类等等,如当预设了采集频率后,厂站侧平台中的数据采集装置就会按照预设的采集频率对厂站侧设备进行运行数据的采集并且及时上报。In this embodiment, it should be noted that the operating data of the current plant side equipment may include hardware performance data when the equipment is running, such as CPU, memory, disk occupancy, etc.; it may also include operating system and business application operating status data , such as file index node occupancy, number of database connections, data processing throughput, application service running status, etc. Therefore, in the embodiment of this application, the user can preset the operation data collection parameters based on the operation data collection requirements of the plant side equipment, where the operation data collection parameters include but are not limited to: region, group, IP list, equipment type, collection frequency, Time interval, type of operation data, etc. For example, when the collection frequency is preset, the data acquisition device in the station side platform will collect the operation data of the station side equipment according to the preset collection frequency and report it in time.
如图2所示,S102、基于预设的运行数据采集参数,生成运行数据采集脚本的启动命令;As shown in Fig. 2, S102, based on the preset operation data collection parameters, generate a startup command for the operation data collection script;
在本实施例中,需要说明的是,中心侧平台中的任务调度模块用于生成运行数据采集脚本的启动命令,任务调度模块基于用户预设的运行数据采集参数来生成运行数据采集脚本的启动命令。In this embodiment, it should be noted that the task scheduling module in the center-side platform is used to generate the startup command of the running data collection script, and the task scheduling module generates the startup command of the running data collection script based on the running data collection parameters preset by the user. Order.
任务调度模块在收到预设的运行数据采集参数后,生成启动命令的步骤如下:After the task scheduling module receives the preset operation data collection parameters, the steps to generate the start command are as follows:
如图3所示,S1021、确定采集范围,若为地域或集团,则在厂站信息数据库中检索出所有厂站侧设备的IP,并根据待监控厂站侧设备的类型确定具体设备IP;若为厂站侧设备的IP列表,则将其存储到本地IP列表文件下以提供查询。As shown in Figure 3, S1021, determine the collection range, if it is a region or a group, then retrieve the IPs of all plant side equipment in the plant information database, and determine the specific device IP according to the type of plant side equipment to be monitored; If it is the IP list of the plant side equipment, it will be stored in the local IP list file to provide query.
在本实施例中,需要说明的是,首先,场站存在多个,多个场站就会有多种不同类型的厂站侧设备如主平台、备平台等,每个厂站侧设备都有相应的设备IP,在用户定义采集范围时,可选择是某地域或某集团下的某种设备,此时先在厂站信息数据库中检索出用户所选地域或集团下所有的厂站侧设备的设备IP,然后再根据需要待监控厂站侧设备的设备类型确定出具体设备IP。或者用户也可以直接提供厂站侧设备的IP列表,将其存储到本地IP列表文件下以提供查询。In this embodiment, it needs to be explained that, firstly, there are multiple stations, and multiple stations will have various types of station-side equipment such as the main platform, standby platform, etc., and each station-side device has There is a corresponding device IP. When the user defines the collection range, he can choose a certain region or a certain device under a certain group. At this time, first search all the plant sides in the region or group selected by the user in the plant information database. The device IP of the device, and then determine the specific device IP according to the device type of the plant side device to be monitored. Or the user can also directly provide the IP list of the plant side equipment, and store it in the local IP list file to provide query.
如图3所示,S1022、根据运行数据采集参数中的采集频率、时间区间、运行数据种类拼接启动命令。As shown in FIG. 3 , S1022 , splicing start commands according to the collection frequency, time interval, and type of operation data in the operation data collection parameters.
在本实施例中,需要说明的是,在确定了待监控厂站侧设备的设备IP后,中心侧平台中的任务调度模块再根据运行数据采集参数中的采集频率、时间区间、运行数据种类等等来拼接启动命令,启动命令主要用于远程启动运行数据采集脚本对厂站侧设备进行数据采集。In this embodiment, it should be noted that, after determining the device IP of the station-side device to be monitored, the task scheduling module in the center-side platform will then collect the data according to the collection frequency, time interval, and type of operation data in the operation data collection parameters. Wait to splice the start command, the start command is mainly used to remotely start and run the data collection script to collect data from the plant side equipment.
如图2所示,S103、将运行数据采集脚本上传到厂站侧设备;As shown in Figure 2, S103, upload the running data collection script to the plant side equipment;
在本实施例中,需要说明的是,任务调度模块在生成运行数据采集脚本的启动命令后,将该运行数据采集脚本上传到厂站侧设备,主要内容为任务调度模块读取本地IP列表文件,遍历其中的IP,并将运行数据采集脚本通过scp(secure copy)命令传输到对应IP的厂站侧设备的指定目录下。其中scp命令是用于通过SSH协议安全地将文件复制到远程系统和从远程系统复制文件到本地的命令。In this embodiment, it should be noted that after the task scheduling module generates the startup command of the running data collection script, it uploads the running data collection script to the plant side equipment, and the main content is that the task scheduling module reads the local IP list file , traverse the IPs in it, and transfer the running data collection script to the specified directory of the plant side equipment corresponding to the IP through the scp (secure copy) command. The scp command is a command for safely copying files to a remote system and copying files from a remote system to the local through the SSH protocol.
如图2所示,S104、根据启动命令远程启动运行数据采集脚本,运行数据采集脚本根据接收的命令对厂站侧设备的运行数据进行采集。As shown in FIG. 2, S104. Remotely start the running data collection script according to the startup command, and the running data collection script collects the running data of the plant side equipment according to the received command.
在本实施例中,需要说明的是,在任务调度模块将运行数据采集脚本传输到对应IP的厂站侧设备的指定目录下时,任务调度模块将远程执行由步骤S102中生成的启动命令,通过启动命令远程启动运行数据采集脚本,运行数据采集脚本接收到该命令后对该厂站侧设备的运行数据进行采集。In this embodiment, it should be noted that when the task scheduling module transmits the running data collection script to the specified directory of the plant side equipment corresponding to the IP, the task scheduling module will remotely execute the startup command generated in step S102, Remotely start the running data collection script through the start command, and collect the running data of the plant side equipment after the running data collection script receives the command.
其中,任务调度模块将步骤S102中生成的运行数据采集脚本的启动命令作为参数执行ssh(Secure Shell)命令,远程启动传输到厂站侧设备的运行数据采集脚本。Wherein, the task scheduling module executes the ssh (Secure Shell) command with the startup command of the running data collection script generated in step S102 as a parameter, and remotely starts the running data collection script transmitted to the factory station side equipment.
在本实施例中,还需要说明的是,运行数据采集脚本使用生成器模式,可以将运行数据采集结果与采集逻辑分开,以实现对数据采集的过程进行更加精细的控制,还提高了运行数据采集种类和采集逻辑的灵活扩展能力。其中运行数据采集脚本包括四个模块,运行数据模块、建造者模块、记录器模块以及启动模块,运行数据模块用于定义和存储厂站侧设备的不同类型的运行数据。建造者模块用于根据待解析的命令输出,将真正的运行数据计算或提取出来。记录器模块用于将Director产生的Info类记录下来,并按采集频率将采集结果上传到中心侧平台的数据处理模块。启动模块用于负责启动对厂站侧设备的运行数据进行采集,主要是根据步骤S101中预设的采集频率、时间区间、运行数据种类参数等开始运行数据采集。In this embodiment, it also needs to be explained that the running data collection script uses the generator mode, which can separate the running data collection results from the collection logic, so as to achieve more fine-grained control over the data collection process, and also improve the running data collection process. Flexible expansion capabilities for collection types and collection logic. The running data acquisition script includes four modules, the running data module, the builder module, the recorder module and the startup module. The running data module is used to define and store different types of running data of the plant side equipment. The builder module is used to calculate or extract the real running data according to the command output to be parsed. The recorder module is used to record the Info class generated by the Director, and upload the collection results to the data processing module of the center-side platform according to the collection frequency. The start-up module is used to start the collection of operation data of the plant side equipment, mainly to start operation data collection according to the preset collection frequency, time interval, operation data type parameters, etc. in step S101.
如图2所示,本实施例中的采集方法还包括:S105、运行数据采集脚本根据运行数据采集参数中的采集频率将采集结果上传到中心侧平台的数据处理模块;As shown in Figure 2, the collection method in this embodiment also includes: S105, the running data collection script uploads the collection results to the data processing module of the center side platform according to the collection frequency in the running data collection parameters;
S106、数据处理模块根据采集结果按照运行数据告警规则生成告警信息;其中运行数据告警规则包括运行数据告警阈值规则和运行数据告警趋势规则,运行数据告警阈值规则包括但不限于为:运行数据的运行值高于预设值n次或者低于预设值n次;运行数据告警趋势规则包括但不限于为:运行数据的运行值连续n次增长或者连续n次降低或者增长率高于预设值或者降低率低于预设值。S106. The data processing module generates alarm information according to the operation data alarm rules according to the collection results; wherein the operation data alarm rules include operation data alarm threshold rules and operation data alarm trend rules, and the operation data alarm threshold rules include but are not limited to: The value is higher than the preset value n times or lower than the preset value n times; the operating data alarm trend rules include but are not limited to: the operating value of the operating data increases for n consecutive times or decreases for n consecutive times or the growth rate is higher than the preset value Or the reduction rate is lower than the preset value.
在本实施例中,需要说明的是,运行数据采集脚本根据预设的运行数据参数中的采集频率进行数据采集并同时将采集结果上传到中心侧平台的数据处理模块,也就是说运行数据采集脚本根据步骤S101中预设的采集频率,定时执行rsync命令,将存储在厂站侧设备的指定目录下的采集结果文件上传到数据处理模块。In this embodiment, it should be noted that the running data collection script performs data collection according to the collection frequency in the preset running data parameters and simultaneously uploads the collection results to the data processing module of the central platform, that is to say, the running data collection The script executes the rsync command regularly according to the preset collection frequency in step S101, and uploads the collection result files stored in the specified directory of the plant side equipment to the data processing module.
数据处理模块收到采集结果后,按照运行数据告警规则对上传的采集结果进行匹配,并生成自定义告警信息;其中运行数据告警规则包括运行数据告警阈值规则和运行数据告警趋势规则,运行数据告警阈值规则包括但不限于为:运行数据的运行值高于预设值n次或者低于预设值n次。举例说明如CPU使用率连续三次高于90%,本领域的普通技术人员可以根据各类数据定义不同的阈值,本实施例不做具体限制。运行数据告警趋势规则包括但不限于为:运行数据的运行值连续n次增长或者连续n次降低或者增长率高于预设值或者降低率低于预设值。举例说明如数据库连接数量连续十次增长,本领域的普通技术人员可以根据各类数据定义不同的趋势规则,本实施例不做具体限制。After the data processing module receives the collection results, it matches the uploaded collection results according to the operation data alarm rules, and generates custom alarm information; the operation data alarm rules include the operation data alarm threshold rules and the operation data alarm trend rules, and the operation data alarm Threshold rules include but are not limited to: the operating value of the operating data is higher than the preset value n times or lower than the preset value n times. For example, if the CPU usage rate is higher than 90% for three consecutive times, those skilled in the art may define different thresholds according to various data, which is not specifically limited in this embodiment. The operation data alarm trend rules include but are not limited to: the operation value of the operation data increases continuously for n times or decreases for n times in a row, or the growth rate is higher than a preset value or the decrease rate is lower than a preset value. For example, if the number of database connections increases ten times in a row, those skilled in the art may define different trend rules according to various types of data, which is not specifically limited in this embodiment.
如图2所示,还包括:S107、数据处理模块根据采集结果生成运行趋势图。As shown in FIG. 2 , it also includes: S107 , the data processing module generates an operation trend graph according to the collection result.
在本实施例中,需要说明的是,数据处理模块根据采集结果生成运行数据趋势图,其中运行数据趋势图的生成方式为:根据步骤S104中上报到厂站侧设备的指定目录的运行数据,通过pyecharts生成关于厂站侧设备的运行数据趋势图的html代码。In this embodiment, it should be noted that the data processing module generates the running data trend graph according to the collection results, wherein the generating method of the running data trend graph is: according to the running data reported to the specified directory of the plant side equipment in step S104, Use pyecharts to generate the html code of the running data trend graph of the equipment on the plant side.
在本实施例中,还需要说明的是,若触发运行数据告警阈值规则或运行数据告警趋势规则,则还会生成一条JSON(JavaScriptObject Notation)数据,其中JSON数据的属性包括但不限于为:告警设备IP、告警规则类型、告警详情等,其中告警详情为阈值/趋势规则、实际值/实际趋势。In this embodiment, it should also be noted that if the operation data alarm threshold rule or the operation data alarm trend rule is triggered, a piece of JSON (JavaScript Object Notation) data will also be generated, wherein the attributes of the JSON data include but are not limited to: alarm Device IP, alarm rule type, alarm details, etc., where the alarm details are threshold/trend rule, actual value/actual trend.
如图2所示,还包括:S108、数据处理模块将生成的告警信息推送至中心侧平台的告警发送模块以及将生成的运行趋势图推送至中心侧平台的报告展示模块,告警发送模块发送告警信息,报告展示模块通过网页展示厂站侧设备的运行趋势图。As shown in Figure 2, it also includes: S108, the data processing module pushes the generated alarm information to the alarm sending module of the center side platform and pushes the generated operation trend graph to the report display module of the center side platform, and the alarm sending module sends an alarm The information and report display module displays the operation trend graph of the plant side equipment through the web page.
在本实施例中,需要说明的是,数据处理模块将生成的告警信息推送至中心侧平台的告警发送模块,告警发送模块通过多种方式发送告警信息;若收到步骤S107中发出的JSON数据时,则还通过电子邮件、短信息、微信等方式进行通知。In this embodiment, it should be noted that the data processing module pushes the generated alarm information to the alarm sending module of the central platform, and the alarm sending module sends the alarm information in various ways; if the JSON data sent in step S107 is received Notifications will also be made via e-mail, SMS, WeChat, etc.
数据处理模块还将生成的运行数据趋势图推送至中心侧平台的报告展示模块,报告展示模块通过Web页面展示厂站侧设备的运行数据趋势图,根据步骤S107中生成的厂站侧设备的运行数据趋势图的html代码,使用react技术编写网页框架,引入运行数据趋势图的html代码并展示。其中React技术主要用于构建用户界面(User Interface,简称UI)。如图4所示为展示内存用量的趋势图,在2022-11-29T01:13:50时占用的内存用量为17424MB;如图5所示为CPU使用率的趋势图,在2022-11-29T02:40:52时CPU使用率为33.38%。The data processing module also pushes the generated running data trend graph to the report display module of the center side platform, and the report display module displays the running data trend graph of the factory station side equipment through the Web page, according to the operation of the factory station side equipment generated in step S107 The html code of the data trend graph uses react technology to write the web page framework, introduces and displays the html code that runs the data trend graph. Among them, React technology is mainly used to build the user interface (User Interface, referred to as UI). As shown in Figure 4, it shows the trend graph of memory usage. At 2022-11-29T01:13:50, the occupied memory usage is 17424MB; as shown in Figure 5, it shows the trend graph of CPU usage, at 2022-11-29T02 :40: 33.38% CPU usage at :52.
因此通过运行数据告警阈值及告警趋势规则,提高了运行问题发现的实时性,通过对运行数据趋势图的集中展示,提高了业务人员定位运行问题的准确性。Therefore, through the operation data alarm threshold and alarm trend rules, the real-time performance of operation problem discovery is improved, and the accuracy of business personnel in locating operation problems is improved through the centralized display of operation data trend graphs.
根据本申请的实施例,本申请还提供了一种计算机设备、一种计算机可读存储介质。According to the embodiment of the present application, the present application also provides a computer device and a computer-readable storage medium.
如图6所示,是根据本申请实施例的计算机设备的框图。计算机设备旨在表示各种形式的数字计算机或移动装置。其中数字计算机可以包括台式计算机、便携式计算机、工作台、个人数字助理、服务器、大型计算机和其它适合的计算机。移动装置可以包括平板电脑、智能电话、可穿戴式设备等。As shown in FIG. 6 , it is a block diagram of a computer device according to an embodiment of the present application. Computing equipment is intended to mean any form of digital computer or mobile device. Wherein digital computers may include desktop computers, laptop computers, workstations, personal digital assistants, servers, mainframe computers, and other suitable computers. Mobile devices may include tablets, smartphones, wearable devices, and the like.
如图6所示,设备600包括计算单元601、ROM 602、RAM 603、总线604以及输入/输出(I/O)接口605,计算单元601、ROM 602以及RAM 603通过总线604彼此相连。输入/输出(I/O)接口605也连接至总线604。As shown in Figure 6,
计算单元601可以根据存储在只读存储器(ROM)602中的计算机指令或者从存储单元608加载到随机访问存储器(RAM)603中的计算机指令,来执行本申请方法实施例中的各种处理。计算单元601可以是各种具有处理和计算能力的通用和/或专用处理组件。计算单元601可以包括但不限于中央处理单元(CPU)、图形处理单元(GPU)、各种专用的人工智能(AI)计算芯片、各种运行机器学习模型算法的计算单元、数字信号处理器(DSP)、以及任何适当的处理器、控制器、微控制器等。在一些实施例中,本申请实施例提供的方法可被实现为计算机软件程序,其被有形地包含于计算机可读存储介质,例如存储单元608。The
RAM 603还可存储设备600操作所需的各种程序和数据。计算机程序的部分或者全部可以经由ROM 602和/或通信单元609而被载入和/或安装到设备600上。The
设备600中的输入单元606、输出单元607、存储单元608和通信单元609可以连接至I/O接口605。其中,输入单元606可以是诸如键盘、鼠标、触摸屏、麦克风等;输出单元607可以是诸如显示器、扬声器、指示灯等。设备600能够通过通信单元609与其他设备进行信息、数据等的交换。The
需要说明的是,该设备还可以包括实现正常运行所必需的其他组件。也可以仅包含实现本申请方案所必需的组件,而不必包含图中所示的全部组件。It should be noted that the device may also include other components necessary for normal operation. It is also possible to include only the components necessary to realize the solution of the present application, instead of all the components shown in the figure.
此处描述的系统和技术的各种实施方式可以在数字电子电路系统、集成电路系统、场可编程门阵列(FPGA)、专用集成电路(ASIC)、专用标准产品(ASSP)、芯片上系统的系统(SOC)、负载可编程逻辑设备(CPLD)、计算机硬件、固件、软件和/或它们的组合中实现。Various implementations of the systems and techniques described herein can be implemented in digital electronic circuitry, systems integrated circuits, field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips system (SOC), load programmable logic device (CPLD), computer hardware, firmware, software, and/or a combination thereof.
用于实施本申请的方法的计算机指令可以采用一个或多个编程语言的任何组合来编写。这些计算机指令可以提供给计算单元601,使得计算机指令当由诸如处理器等计算单元601执行时使执行本申请方法实施例中涉及的各步骤。Computer instructions for implementing the methods of the present application may be written in any combination of one or more programming languages. These computer instructions may be provided to the
本申请提供的计算机可读存储介质可以是有形的介质,其可以包含或存储计算机指令,用以执行本申请方法实施例中涉及的各步骤。计算机可读存储介质可以包括但不限于电子的、磁性的、光学的、电磁的等形式的存储介质。The computer-readable storage medium provided in the present application may be a tangible medium, which may contain or store computer instructions for executing the steps involved in the method embodiments of the present application. Computer-readable storage media may include, but are not limited to, electronic, magnetic, optical, electromagnetic, and other forms of storage media.
上述具体实施方式,并不构成对本申请保护范围的限制。本领域技术人员应该明白的是,根据设计要求和其他因素,可以进行各种修改、组合、子组合和替代。任何在本申请的精神和原则之内所作的修改、等同替换和改进等,均应包含在本申请保护范围之内。The above specific implementation methods are not intended to limit the protection scope of the present application. It should be apparent to those skilled in the art that various modifications, combinations, sub-combinations and substitutions may be made depending on design requirements and other factors. Any modifications, equivalent replacements and improvements made within the spirit and principles of this application shall be included within the protection scope of this application.
Claims (10)
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211732538.2A CN116016601A (en) | 2022-12-30 | 2022-12-30 | Situation awareness equipment-based operation data acquisition method, equipment and medium |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202211732538.2A CN116016601A (en) | 2022-12-30 | 2022-12-30 | Situation awareness equipment-based operation data acquisition method, equipment and medium |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116016601A true CN116016601A (en) | 2023-04-25 |
Family
ID=86035135
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202211732538.2A Pending CN116016601A (en) | 2022-12-30 | 2022-12-30 | Situation awareness equipment-based operation data acquisition method, equipment and medium |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116016601A (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN119322810A (en) * | 2024-10-11 | 2025-01-17 | 武汉迪普灵智能科技有限公司 | Multi-source data integration method and system based on geographic information |
-
2022
- 2022-12-30 CN CN202211732538.2A patent/CN116016601A/en active Pending
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN119322810A (en) * | 2024-10-11 | 2025-01-17 | 武汉迪普灵智能科技有限公司 | Multi-source data integration method and system based on geographic information |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US12079255B1 (en) | Systems and methods for updating a status indication in a system providing dynamic indexer discovery | |
| CN107302466B (en) | A big data analysis platform and method for dynamic environment monitoring system | |
| CN111800443B (en) | Data processing system and method, device and electronic equipment | |
| CN114756301B (en) | Log processing method, device and system | |
| CN111881011A (en) | Log management method, platform, server and storage medium | |
| CN105207826A (en) | Security attack alarm positioning system based on Spark big data platform of Tachyou | |
| CN108234199A (en) | Monitoring method, apparatus and system based on Kafka | |
| CN117411810A (en) | A security early warning method for electrical Internet of Things based on edge computing | |
| CN114371888A (en) | Method and device for hot updating of log collection plug-in, electronic equipment and readable medium | |
| US9280426B2 (en) | System and method for server redundancy | |
| CN110417580A (en) | A method, device and storage medium for displaying IB network topology relationship | |
| CN116016601A (en) | Situation awareness equipment-based operation data acquisition method, equipment and medium | |
| CN115801545B (en) | A method, system, device and medium for real-time reporting of abnormality of hybrid cloud management | |
| CN117061334A (en) | Link alarm processing method, device, equipment and storage medium | |
| WO2024066506A1 (en) | Data monitoring and analysis method and apparatus, and server, operation and maintenance system, and storage medium | |
| CN117135099A (en) | A method and system for network equipment status inspection | |
| CN113312197B (en) | Batch fault determining method and device, computer storage medium and electronic equipment | |
| Kashef et al. | Wireless cyber-physical system performance evaluation through a graph database approach | |
| CN119669006A (en) | A method, device, equipment and storage medium for abnormal environment warning | |
| CN114710394B (en) | Alarm synchronization method and device, electronic equipment and readable storage medium | |
| CN117851195A (en) | Computer host operation risk monitoring management and control system based on data analysis | |
| CN117539873A (en) | Multi-device association method, system, device and storage medium for intelligent rail transit system | |
| CN117093555A (en) | Method, device, equipment and readable storage medium for acquiring equipment state information | |
| KR20240072451A (en) | System and method for log monitoring processing based on latent space | |
| CN118277625B (en) | A distributed electromagnetic big data processing system and method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |