WO2012050224A1 - Computer resource control system - Google Patents

Abstract

Provided is a system that that allows the state of a computer resource included in a system that is being monitored to be identified and controlled in real time. The state of the control system itself can also be identified and controlled. This computer resource control system comprises a plurality of servers including: an administration server for determining whether or not an action is required for the computer resource on the basis of data collected from a monitoring agent; and an execution server for outputting a command to execute the action for the computer resource when it has been determined that an action is required for the computer resource. At least one of the servers in the computer resource control system includes the monitoring agent.

Description

Computer resource control system

The present invention relates to a service level management technique for stably operating computer resources that are complicated and large in scale as expressed by the term “cloud”.

Conventionally, virtualization technology has made it possible to use one computer physically as a plurality of computers. In other words, it becomes possible to make hardware hardware by using the virtualization technology, and it is possible to secure a necessary number of servers by copying a server image.

On the other hand, a distributed system that improves performance by sharing processing with multiple small servers instead of a single large server distributes a large-scale batch system that can store and retrieve large amounts of data at high speed. It has been put to practical use in various fields, such as a mechanism for improving performance. Such a distributed system operates as if it were a single computer, while the functions previously performed by the system in one place are distributed among a plurality of computers.

Recently, based on such virtualization technology and large-scale distributed technology, services collectively referred to as cloud have been provided on the network. As a main cloud service, for example, Amazon Web Services (trademark) is known (see Non-Patent Document 1).

"Amazon Web Services", [online], [October 15, 2010 search], Internet <URL: http://aws.amazon.com/jp/>

By the way, in a cloud environment, data centers are virtualized and distributed, so it is possible to flexibly deal with changes in transactions and data volume by dynamically changing computer resources such as virtualized servers. It is expected that a possible system can be constructed. However, in a virtualized / distributed environment, it is difficult to accurately grasp where and what is happening in the system. For example, the cause of high CPU load may be due to middleware garbage collection, transactions may increase due to an increase in the number of users, or a large amount of external communication may occur. is there.

In recent years, it has been required to support more and more transactions and data, and in preparation for various virtualization and decentralized environments, grasp the situation in real time, predict the situation, and control without delay A mechanism is needed. Such a mechanism leads to greatly improving the reliability and performance of the cloud environment. At the same time, however, if such a mechanism fails and control is delayed, cloud functionality can be significantly degraded. Therefore, scalability and fault tolerance performance are also required for the mechanism itself for monitoring and controlling computer resources.

In view of such circumstances, the present invention is intended to provide a solution that can monitor and control the status of computer resources of a monitored system in real time. It also seeks to ensure scalability and fault tolerance performance for such a solution itself.

A computer resource control system according to an aspect of the present invention monitors the status of computer resources and performs control according to the status. The computer resource control system determines whether or not the computer resource needs to be controlled based on the data collected from the monitoring agent, and executes the control for the computer resource when it is determined that the computer resource needs to be controlled. A processing unit that outputs an instruction; a message queue for exchanging data between the monitoring agent and the processing unit; and a first monitoring agent for monitoring the status of the message queue. Based on the data collected from the first monitoring agent, it is determined whether or not it is necessary to control the computer resource.
A computer resource control system according to an aspect of the present invention compares a data collected from a monitoring agent with a predefined control rule to determine whether or not an action is required for a computer resource, and a management server, An execution server that outputs an instruction to execute an action on the computer resource when it is determined that an action on the computer resource is required, and includes at least one of the servers in the computer resource control system. One includes a monitoring agent. According to this, it is possible to provide a system that can grasp and control the status of computer resources included in the system to be monitored in real time. At the same time, the status of computer resources included in such a system can be monitored and controlled in real time.

According to one aspect of the invention, the action includes control of any computer resource. Preferably, the action includes processing for increasing or decreasing the number of servers included in the computer resource control system. According to this, the amount of computer resources to be input can be dynamically controlled. Preferably, the action includes processing such as job execution on the server, program start on the server, various setting changes, workflow control, physical server control, network device control, or cooperation between computer resources. .

Also preferably, the computer resource control system further comprises a message queue server including a message queue for asynchronously exchanging data between the monitoring agent and a server in the computer resource control system. The message queue server preferably includes a monitoring agent that monitors the data exchange status. According to this, computer resources can be appropriately controlled according to the data amount of the message queue.

Furthermore, it is preferable that the message queue server, the management server, and the execution server are each configured by a plurality of servers, and the action includes control for these servers. As an example, each server is configured by a virtual server, and an action is a process that increases or decreases the number of servers that constitute a message queue server, a process that increases or decreases the number of servers that constitute a management server, or a server that constitutes an execution server It is preferable that at least one of the processes for increasing / decreasing the number is included. According to this, since the system is configured in a distributed structure without a single point of failure, it is possible to construct a system that does not go down as a whole even if a failure occurs in any single function.

Preferably, the message queue server sequentially receives data collected from a plurality of monitoring agents, sequentially reads data management queues read by the management server, inputs action instructions from the management server, and sequentially executes by the execution server. The message queue server includes at least one of an execution queue to be read and a management queue sequentially input processing data for executing an action on a computer resource from the execution server and sequentially read by the corresponding monitoring agent. The monitoring agent that monitors the data management queue, the execution queue, and the queue of the management queue. According to this, finer control becomes possible by monitoring the queue for each queue.

More preferably, each server in the computer resource control system includes a monitoring agent that monitors the operating status of each server, and the management server determines whether or not an action is required for the computer resource based on the operating status of each server. to decide. According to this, it is possible to control computer resources such as starting and stopping of instances according to the operating status of each server.

The computer resource control system further includes a database server for storing data, a collection server for reading data collected from a plurality of monitoring agents from the message queue server and registering it in the database, and reading data stored in the database. It is preferable to include at least one of dashboard servers that edit and transmit to the user terminal device. According to this, the dashboard which displays a monitoring condition in real time to a user can be provided.

Preferably, the database server, the collection server, and the dashboard server are each configured by a plurality of servers, and the action preferably includes control for these servers. As an example, each server is configured by a virtual server, and an action configures a process that increases or decreases the number of servers that constitute a database server, a process that increases or decreases the number of servers that constitute a collection server, or a dashboard server At least one of the processes for increasing / decreasing the number of servers is included. According to this, a fault tolerant system can be provided with a distributed structure having no single point of failure.

A computer resource control method according to an aspect of the present invention is a method in which a processing apparatus included in a control system performs processing in a control system that controls computer resources. The processing device determines whether or not to control the computer resource based on data collected from the monitoring agent, and executes control of the computer resource when it is determined that the computer resource needs to be controlled. Outputting instructions and exchanging data between the monitoring agent and the control system via a message queue. The determining step determines whether or not the computer resource needs to be controlled based on data collected from the first monitoring agent that monitors the status of the message queue.
A computer resource control method according to an aspect of the present invention is a method in which a processing apparatus included in a control system performs processing in a control system that monitors the status of computer resources and performs control according to the status. The processing device compares data collected from a plurality of monitoring agents with a predefined control rule to determine whether or not an action is required for a computer resource, and when it is determined that an action is required for a computer resource And outputting an instruction for executing an action on the computer resource. The control system is configured to include a plurality of servers, and at least one of the plurality of servers includes a monitoring agent.

In the present invention, the term system includes not only a system constituted by a physical computer but also a system virtually constructed on the computer. The term computer resource includes all levels of hardware and software related to a computer, regardless of whether it is physically configured or configured virtually. Moreover, unless otherwise specified, the term server may include both real servers and virtual servers. Further, the term queue may include any configuration having the feature that previously input data is output first.

According to the present invention, it is possible to provide an excellent effect that it is possible to provide a solution that can monitor and control the status of computer resources included in a monitored system in real time. In addition, such a solution itself can have an excellent effect of ensuring scalability and fault tolerance performance.

It is a figure which shows schematic structure of a cloud computing environment. It is a figure which shows the outline | summary of a virtualization technique and a decentralization technique. It is a block diagram which shows an example of schematic structure of a computer resource control system. 1 is a block diagram illustrating an embodiment of a computer resource control system. It is an example of a control rule. It is an example of a dashboard. It is a block diagram which shows the other Example of a computer resource control system. It is an example of the flowchart of the process in a computer resource control system.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In addition, the same code | symbol is attached | subjected to the same element and the overlapping description is abbreviate | omitted. The following embodiments are examples for explaining the present invention, and are not intended to limit the present invention only to the embodiments. Further, the present invention can be variously modified without departing from the gist thereof.

FIG. 1 is a diagram showing a schematic configuration of a cloud computing environment (cloud environment) which is a premise of a computer resource control system according to the present invention. As shown in the figure, in a cloud computing environment, a user terminal device 12 is connected to a cloud 10 via a network N.

The cloud 10 is a generic term for systems that provide users with computing resources such as software, hardware, and data storage areas as services through the network N. In general, the cloud 10 Including a plurality of server devices operated in the network. It can be said that the cloud 10 is a more comprehensive concept including ASP services, utility computing, grid computing, SaaS / PaaS, and the like. When viewed from the user terminal device 12 side, the cloud 10 is on the other side of the network N and can be said to be a generic term for computer resources that provide some service to the user terminal device 12. The present invention is applicable to all cloud environments including public clouds, private clouds, and hybrid clouds.

Preferably, physical disks and physical servers distributed on the network in the cloud 10 are virtualized and logically managed. Furthermore, the computer resource control system registers inactive resources among resources managed in a virtualized manner in the resource pool, and dynamically extracts resources from the resource pool in response to changing requests. Then, the computer resource control system assigns a task to the extracted resource, and ensures scalable service provision.

The user terminal device 12 is a terminal device for a user to use the cloud 10, and includes a connection environment to the network N and a browser that runs on the user terminal device 12. Such user terminal devices 12 include personal computers (PCs), personal digital assistants (PDAs), tablet terminal devices, mobile phones, smartphones, and the like.

The network N is a communication line for transmitting and receiving data and the like between the cloud 10 and the user terminal device 12. For example, it may be any of the Internet, a LAN, a dedicated line, a packet communication network, a telephone line, a corporate network, other communication lines, combinations thereof, and the like, regardless of whether they are wired or wireless.

FIG. 2 is a diagram showing an overview of the virtualization technology and the decentralized technology which are the premise of the computer resource control system according to the present invention. As shown in the figure, the physical computer device group 20 operates as if it is a single computer 22 while the functions and processing are distributed in the computer device group 20 by the decentralization technique. For example, the computer device group 20 operates as if an operating system (OS) 223 is running on a single virtual piece of hardware 222 via the network 221.

In addition, the computer device group 20 that operates like a single computer 22 can be virtually used as a plurality of computers (including servers) 24 by the virtualization technology. In other words, it is hardware conversion to hardware. If the virtualized server 24 is copied by this virtualization technology, replication of the same server can be created. Therefore, by copying the server image, the user can secure the necessary number of servers. It becomes like this. Further, in order to reduce the number of servers, the server image may be deleted. As an example of virtualization, as shown in FIG. 2, an OS 225 runs on virtualization software 224 called KVM (Kernel-based Virtual Machine). On the OS 225, another virtual environment 226 such as Java Virtual Machine (JVM. Java is a registered trademark) runs, on which the middleware 227 and the application 228 run.

The individual physical computers constituting the computer device group 20 include a processing device such as a CPU for controlling the operation and processing of the computer, a memory and storage device functioning as a work area for data storage and processing, and an input device. It is preferable to include an output interface, a communication interface, and a bus connecting them. Further, the computer device group 20 may be constituted by a single computer or may be constituted by a plurality of computers distributed on a network. Each computer causes each computer to function as various function realizing means by the processing device executing a predetermined program stored in a memory or a storage device.

FIG. 3 is a block diagram showing an example of a schematic configuration of the computer resource control system 1 according to the present invention. The computer resource control system 1 according to the present embodiment includes a message network 32 and a processing unit 34 that processes data. As shown in the figure, the computer resource control system 1 according to the present embodiment collects 341 monitoring data via a message network 32 from a monitoring agent 30 incorporated in a monitoring point to be monitored. Then, the computer resource control system 1 monitors the monitoring target 343 based on the collected monitoring data 342, predicts the demand 344 of the computer resource necessary for the monitoring target, and dynamically controls the computer resource to be monitored. 345. Specific examples of the computer resource control 345 include increase / decrease in the number of virtual servers, job execution, program activation, various setting changes, workflow control, physical server control including power on / off, network device control, Any control over any computer resources in the cloud 10, such as coordination between servers, may be included. The monitoring agent 30, the message network 32, and the processing unit 34 are all preferably configured inside the cloud 10.

The cloud 10 for constructing the computer resource control system 1 according to the present invention can be constructed in any environment regardless of whether it is a public cloud or a private cloud, as long as an API for managing server resources and the like is implemented. It is also possible to construct a combination of multiple environments. Amazon Web Services is an example of a cloud environment that can be constructed.

The monitoring agent 30 is a small software module and is incorporated in a monitoring point to be monitored, and the monitoring agent 30 collects monitoring information. Examples of monitoring targets include computer resource monitoring in the computer resource control system 1, application monitoring, log file monitoring, process monitoring, and job monitoring. It can also be applied to monitoring unique sensor networks and factory lines. The monitoring agent 30 transmits the collected monitoring information data to the message network 32. The monitoring agent 30 can dynamically change the contents from the processing unit 34 side.

The message network 32 is for realizing data exchange between the monitoring agent 30 embedded in the monitoring point and the processing unit 34. When the number of monitoring targets becomes large, data may be lost due to the throughput on the processing unit 34 side. In order to avoid such a situation, it is preferable to adopt a distributed message network structure for data transfer. Thereby, it becomes possible to efficiently monitor and control a large number of monitoring targets.

The processing unit 34 collects data from the monitoring agent 30 and stores it in the database. Further, it has a function of controlling the computer resources to be monitored in the cloud environment based on the data from the monitoring agent 30. As an example, the operation of the processing unit 34 is defined by DSL (Domain Specific Language) created by the user. The data acquired by the monitoring agent 30 may include numerical data, character data, log files, and other data related to any event that has occurred in the monitoring target. In the present specification, the term measurement value means any data acquired by the monitoring agent 30. In addition, it is preferable that each element of the process part 34 is distributed like the below-mentioned Example. As a result, the processing unit 34 has a structure without a single point of failure, and has a structure that can compensate for performance degradation by increasing the number of virtualized computer resources.

FIG. 4 is a block diagram showing an embodiment of the computer resource control system 1 according to the present invention. As shown in the figure, in this embodiment, the computer resource control system 1 includes a message queue server 41, a collection server 42, a management server 43, an execution server 44, a database server 45, and a dashboard server 46. Including. Each of these servers is preferably distributed by a plurality of virtual servers having the same server image.

The computer resource control system 1 receives monitoring data from the monitoring agent 30 incorporated in the monitoring target application server 40 included in the monitoring target cluster 50 in the environment of the cloud 10. Further, the computer resource control system 1 provides a dashboard 48 that can be browsed by a browser to the user terminal device 12. Note that the message network 32 in FIG. 3 corresponds to the message queue server 41. 3 corresponds to the collection server 42, the management server 43, the execution server 44, the database server 45, and the dashboard server 46. The computer resource control system 1 and the monitoring target application server 40 operate on the cloud 10.

In this embodiment, the computer resource control system 1 can monitor a plurality of monitoring target application servers 40. Each monitoring target application server 40 may be distributed by a plurality of replications. That is, each monitoring target application server 40 may be configured by a plurality of virtual servers, and the number of virtual servers constituting each monitoring target application server 40 may be dynamically changed. For example, assuming that there are 1,000 real servers to be monitored and 10 virtual servers are started up for each real server, the total number of virtual servers is 10,000. Assuming that there are 20 monitoring points for each virtual server, there are a total of 200,000 monitoring points. Further, the monitoring target is not limited to only an application server in a narrow sense that provides a service related to an application. It goes without saying that various servers, applications, processes, jobs, and other computer resources that exist in the environment of the cloud 10 can be monitored.

A monitoring agent 30 for measuring monitoring data is incorporated in the monitoring point of the monitoring target application server 40 to be monitored. Specifically, for example, the user installs a monitoring agent program in an instance of the monitoring target application server 40 to be monitored in advance. The computer resource control system 1 uses the monitoring agent 30 to manage monitoring targets in a predetermined logical unit called a monitoring target cluster 50. In this embodiment, the monitoring agent 30 includes one of a system agent 401 and a log file agent 402. The system agent 401 is a module that manages a process being executed. The process being executed includes not only the OS and middleware but also applications. The system agent 401 captures changes and behaviors occurring in the process, notifies the collected data to the computer resource control system 1 periodically or in response to a predetermined trigger, etc. Change operations and call methods inside the program. The log file agent 402 is a module that monitors files written in the monitoring target. There are many applications that use log files to monitor the status of applications, and by monitoring such logs, it becomes possible to monitor them according to the intention of the application developer. The information collected by the log file agent 402 is notified to the computer resource control system 1 periodically or non-periodically in response to a predetermined trigger or the like, similar to the system agent 401.

As the monitoring target, it is preferable to collectively monitor from the OS level situation to middleware and applications such as JVM and monitoring target applications. For example, the monitoring agent 30 can determine the usage status of a specific service, middleware congestion, CPU load, to which server a job is assigned, the progress of each job, and the blacklisted server. Can be monitored. Further, by dynamically changing the monitoring point, the target to be monitored may be changed according to the operation status of the monitoring target. Thus, processing such as adding the inventory amount of the campaign product to the monitoring target during the campaign or switching the service content when the campaign product is sold can be performed without stopping the monitoring target.

The message queue server 41 asynchronously exchanges data between the monitoring agent 30 incorporated in the monitoring target application server 40 and the computer resource control system 1 and data exchange between services in the computer resource control system 1. Provides a message queue to do. In this embodiment, data exchange between the monitoring agent 30 and the collection server 42, the management server 43, the execution server 44, and the dashboard server 46, and the collection server 42, the management server 43, the execution server 44, and the dash Data exchange between the board server 46 is performed asynchronously via a message queue in the message queue server 41. Here, data exchange includes not only data exchange but also task exchange.

In this embodiment, the message queue in the message queue server 41 includes a data collection queue 411, a data management queue 412, a management queue 413, and an execution queue 414. Each queue preferably holds data in a first-in first-out (FIFO: First In First Out) list structure. Each queue can have a redundant configuration, and message queue data can be prevented from being lost by performing inter-queue communication. Data collected from the monitoring agent 30 to be monitored is sequentially input to the data collection queue 411 and read sequentially by the collection server 42. Data collected from the monitoring agent 30 to be monitored is sequentially input to the data management queue 412 and read sequentially by the management server 43. In the management queue 413, data (including tasks) for controlling the monitoring target server is sequentially input from the management server 43, the execution server 44, and the dashboard server 46, and the management target monitoring agent 30 sequentially Read out. Execution instructions such as instance activation control and warning transmission are sequentially input from the management server 43 to the execution queue 414 and sequentially read by the execution server 44.

The collection server 42 executes processing for registering data transmitted from the monitoring agent 30 in the distributed database. The collection server 42 sequentially retrieves data input to the data collection queue 411 and passes it to the database server 45.

The management server 43 refers to the control rules set in advance based on the data transmitted from the monitoring agent 30, and performs a process of determining whether or not an action such as instance activation control or warning transmission is necessary. The management server 43 sequentially takes out the data input to the data management queue 412 and compares it with a preset control rule. Here, the control rule may include a plurality of control rules. Each control rule preferably includes a definition of a server group to be managed, a setting of a threshold value of information collected by the monitoring agent, and a definition of control contents when the threshold value is exceeded. Each control rule may include a change in the setting contents of the monitoring agent. As the control rule, a rule defined by the computer resource control system 1 in advance as a default may be used, or a user may define it in advance. Preferably, a rule editor is provided for the user to define control rules. This rule editor can set the control rules of the cluster that is the unit to be monitored, such as control for planned fluctuation, control for passive fluctuation according to data, monitoring agent setting change, warning setting, etc. Various control rules can be set according to the conditions. Since the control rule can be described using, for example, a domain specific language (DSL) based on Ruby, it can be described with an intuitive and easy-to-understand rule. Further, the control rule may be set by a graphical editor. In this case, even a user who is not familiar with DSL can intuitively write the rule.

FIG. 5 is an example of a control rule. The example in the figure defines the condition and control contents “If the pending thread has been in a state exceeding the specified state for more than 5 seconds within the instance, increase the number of instances from the same server image.” For example, as an example of a control rule for planned fluctuations, “When what time of day, how many minutes, how many servers here. And when time comes, set the number of servers to the original number. You can stipulate the contents such as "Return." In addition, as a control rule for passive fluctuation based on collected data, for example, it can be defined that the number of servers to be allocated is increased or decreased based on the amount of data to be processed. Also, if you do not want to reduce the throughput of a specific service, set different scale rules for control rules for each application. If you want to switch the service content when the product is sold out, set a rule that monitors the application and changes the system configuration.

Note that preferably, the management server 43 autonomously learns how the increase or decrease in resources has an effect on performance, obtains an optimal control solution, and rewrites the control rule.

Referring back to FIG. 4, the management server 43 compares the data collected from the monitoring agent 30 with the control rule, and determines whether or not an action is required for a computer resource such as a server in the monitored system. In other words, when the monitoring data does not satisfy the condition defined in the control rule, the management server 43 determines that no action is required. On the other hand, when the monitoring data satisfies the condition stipulated in the control rule, the management server 43 determines that an action is necessary, and the action of the control content specified in the control rule is defined in the control rule. An instruction to execute to a computer resource such as a managed server is output. This instruction is input to the execution queue 414.

The execution server 44 performs processing for executing specific actions such as starting and stopping of instances. The execution server 44 sequentially reads out action instructions from the execution queue 414, and executes various controls on predetermined computer resources (including the monitoring target application server 40) defined by the control rules in accordance with the instructions. . As the content of control, it is preferable to correspond to a wide range of control levels from the system level to the cloud level. As an example of system level control, there is a method call of a specific function of an application, an internal variable change, or the like. Examples of control at the cloud level include starting, duplicating, and stopping an instance, changing an allocated resource, and changing a setting of a starting instance. In other words, the virtual server can be activated / replicated / deleted or the virtual server setting can be changed.

The database server 45 is a database that stores various data including data collected by the monitoring agent 30. This database is preferably not a mechanism based on a single database server but a distributed database structure in which a plurality of servers cooperate to increase performance. Thereby, even if the amount of data becomes enormous, the capacity can be accommodated by increasing the number of participating servers. In addition, by providing replication to multiple servers, a database without a single point of failure is constructed. In addition, when database performance degradation is expected, the database performance can be maintained by adding the number of servers.

As an example of the database server 45, a distributed KVS server is applicable. A distributed KVS server adds an arbitrary label (Key) to the data (Value) to be saved, saves a (Key, Value) pair, and specifies the label (Key) when retrieving the saved data Thus, corresponding data (Value) is acquired, and KVS is an abbreviation for Key-Value Store. It is a scale-out type in which data is distributed and stored on multiple servers, and a large amount of data can be handled by adding servers. As an example of the KVS server, there is mongoDB. The database server 45 is preferably a KVS database server, but is not limited to KVS, and may use a database server of another method.

The dashboard server 46 is a server that provides the user terminal device 12 with a dashboard 48 for displaying various types of information to the user and accepting operations from the user. Here, the screen of the dashboard 48 is for displaying information such as predetermined monitoring items on the client device, and its appearance and function are important. The screen of the dashboard 48 includes monitoring of system monitoring status and job execution status, as well as batch job flow by DSL and monitoring and control of the real-time system. The user and the computer resource control system 1 Functions as an interface. The dashboard server 46 receives access via the web service from the user terminal device 12, reads the data stored in the database server 45, edits the screen of the dashboard 48, and transmits the screen information to the user terminal device 12. To do. The operation manager performs system monitoring, configuration management, and control settings on the dashboard 48. Also, the dashboard server 46 displays a warning on the dashboard 48 and sends an email notification when the monitoring information exceeds a preset threshold value. Thereby, the user can monitor efficiently.

In the present embodiment, it is possible to provide display and operation in accordance with a user request by exchanging the dashboard server 46. This makes it easy to sell the computer resource control system as part of another system or to sell it as an OEM.

FIG. 6 is an example of the dashboard 48. Examples of the displayed screen include a metrics view, a system configuration view, a job net monitoring view, a log monitoring view, and a notification list. The metrics view is a screen for monitoring data transmitted from the monitoring agent 30 in real time. A graph corresponding to the measurement item is displayed, and the graph is updated in real time. In addition, past data may be displayed. The system configuration view is a screen for monitoring the system configuration to be monitored from a bird's-eye view. It displays the operating status of each server, displays the operating status of processes running in the server, displays process dependencies between servers, and so on. When the server resource exceeds the threshold or an error occurs in the application, it is displayed so that it can be detected in the system configuration view. The job net monitoring view is a screen for monitoring the execution status of the batch job net managed by the computer resource control system 1. The icon color is changed according to the execution status to visually indicate the execution status.

The log monitoring view is a screen that monitors the output contents of the log file and browses the hit locations that should be monitored. Used for application error detection and batch job progress monitoring. The user can freely set what and how the dashboard 48 displays. Thus, for example, the manager can realize a console function from the manager's viewpoint, and the system administrator can realize a user interface that meets the needs of the user, such as a monitoring control console for system operation.

FIG. 7 is a block diagram showing another embodiment of the computer resource control system 1 according to the present invention. The configuration of the embodiment shown in the figure is almost the same as that of FIG. 4 except that the monitoring agent 30 is incorporated in the server in the computer resource control system 1. In this embodiment, each server in the computer resource control system 1 is distributed by a plurality of virtual servers having the same server image. That is, the computer resource control system 1 includes a plurality of message queue servers 41, a plurality of collection servers 42, a plurality of management servers 43, a plurality of execution servers 44, a plurality of database servers 45, a plurality of dashboards, Server 46. However, the number of servers having the same server image may temporarily become one when a failure occurs.

Similar to the monitoring agent 30 incorporated in the monitoring target application server 40, the monitoring agent 30 incorporated in the server in the computer resource control system 1 collects the monitoring data collected from the monitoring target server in the data collection queue of the message queue server 41. 411 and the data management queue 412. The subsequent processing is the same as in FIG. In other words, the management server 43 performs the same processing on the data collected from the monitoring agent 30 incorporated in the server in the computer resource control system 1 as the data collected from the monitoring agent 30 incorporated in the monitoring target application server 40. Then, the necessity of action for the computer resource is determined with reference to a plurality of predefined control rules. Then, the execution server 44 controls computer resources in the computer resource control system 1 in accordance with fluctuations in the data amount and processing amount for each cluster. As an example, the execution server 44 executes processing such as increasing / decreasing the number of each server in the computer resource control system 1 to maintain an optimal system configuration.

For example, the monitoring agent 30 incorporated in the message queue server 41 receives the amount of data input to each queue in the message queue server 41, that is, the data collection queue 411, the data management queue 412, the management queue 413, and the execution queue 414. Monitor the amount of queues. Further, the separate monitoring agent 30 incorporated in each of the message queue server 41, the collection server 42, the management server 43, the execution server 44, the database server 45, and the dashboard server 46 is connected to each server. Monitor the operating status.

On the other hand, in the control rule, a rule for increasing or decreasing the number of servers of the collection server 42 according to the state of the data collection queue 411 is defined. For example, when the queue amount of the data collection queue 411 exceeds a predetermined threshold value, the instance activation control, that is, the replication (replication) of the collection server 42 is created to increase the number of virtual servers. And the control content are defined. When the amount of the queue is equal to or less than the predetermined threshold, the instance stop control, that is, the condition and the control content that the predetermined number of replications of the collection server 42 are discarded (deleted) and the number of virtual servers is reduced. Defined. Similar control rules are defined for other queues. For example, a rule for increasing or decreasing the number of management servers 43 in accordance with the state of the data management queue 412 is defined. That is, when the queue amount of the data management queue 412 exceeds a predetermined threshold, a predetermined number of replications of the management server 43 are created to increase the number of virtual servers, while the queue amount is equal to the predetermined queue amount. When the threshold value is less than or equal to the threshold, a condition and control contents are defined such that a predetermined number of replications of the management server 43 are discarded and the number of virtual servers is reduced. Also, rules for increasing or decreasing the number of execution servers 44 according to the state of the execution queue 414 are defined. That is, when the queue amount of the execution queue 414 exceeds a predetermined threshold value, a predetermined number of replications of the execution server 44 are created to increase the number of virtual servers, while the queue amount is equal to the predetermined threshold value. In the following case, a condition and control contents are defined such that a predetermined number of replications of the execution server 44 are discarded and the number of virtual servers is reduced. Furthermore, a rule for increasing or decreasing the number of arbitrary servers according to the state of the management queue 413 is defined. In other words, if the amount of the queue of actions for a specific server in the queue of the management queue 413 exceeds a predetermined threshold, a predetermined number of replications of the specific server are created, and the number of virtual servers On the other hand, if the queue amount falls below a predetermined threshold, a condition and control contents are defined such that a predetermined number of replications of the specific server are discarded and the number of virtual servers is reduced. . A rule for increasing or decreasing the number of message queue servers 41 may be defined according to the status of the entire queue in the message queue server 41.

Also, as another control rule, it is preferable that a rule for dynamically controlling server replication or destruction is defined according to the operating status of each server. That is, when the operating status of a server exceeds a predetermined threshold, replication of the server is created, and when the operating status is equal to or lower than the predetermined threshold, the server is discarded. Further, when the server shows an abnormal behavior, a warning is notified to the user. If the problem persists, the server may be restarted by discarding the server and creating a new server replication.

By adopting such a configuration, the computer resource control system 1 dynamically controls the computer resources included in the computer resource control system 1 by the same mechanism as the mechanism for monitoring the monitoring target system in the cloud environment. Is possible. Thus, the computer resource control system 1 not only grasps the status of the monitoring target such as the monitored application server 40 in real time and controls it without delay, but also grasps the status of the computer resource control system 1 itself in real time without delay. Will be able to control.

Since this embodiment is composed of a distributed structure without a single point of failure, even if a failure occurs somewhere in a single function, the structure does not go down as a whole. Moreover, it has a structure that can dynamically cope with a planned or sudden increase in load, and increases the number of servers constituting the computer resource control system 1 in response to an increase in users and monitoring targets. Etc., and configured to maintain a service level by controlling computer resources.

The computer resource control system 1 is preferably provided as an API (Application Program Interface).

Next, the operation of the computer resource control system 1 in this embodiment will be described.

FIG. 8 is an example of a flowchart of processing in the computer resource control system 1.

First, the monitoring agent 30 embedded in the monitoring point in the cloud environment collects monitoring data and transmits it to the message queue server 41 (S81). Note that the monitoring agent 30 continues to send monitoring data to the message queue server 41 periodically or irregularly. The message queue server 41 puts the received data into the data collection queue 411 and the data management queue 412. The collection server 42 sequentially reads the monitoring data from the data collection queue 411 and registers the monitoring data in the data store of the database server 45 (S82). After completing the registration of the monitoring data, the collection server 42 reads the next monitoring data from the message queue, and repeats the process of S82.

The dashboard server 46 creates a dashboard 48 for browsing the status of the monitoring target in response to a request from the user, and transmits it to the user terminal device 12 via the network N (S83). The user terminal device 12 displays the received dashboard 48 on the browser (S84).

In parallel with the data registration process, the management server 43 reads the monitoring data from the data management queue 412 and compares it with the control rule (S85) to determine whether an action is required for the computer resource (S86). If the monitoring data does not satisfy the conditions defined in the control rule, it is determined that no action is required (S86: No). On the other hand, if the monitoring data satisfies the conditions defined in the control rule, it is determined that an action is necessary (S86: Yes), and a specific action instruction is transmitted to the execution queue 414 of the message queue server 41. (S87). Thereafter, the management server 43 reads the monitoring data from the data management queue 412 again, and repeats a series of processes from S85 to S87.

The execution server 44 reads an action instruction from the execution queue 414 and transmits processing data for executing a specific action for the computer resource, such as start or stop of the instance, to the management queue 413 of the message queue server 41 ( S88). Thereafter, the execution server 44 reads the action instruction again from the execution queue and repeats the process of S88.

The processing data input to the management queue 413 is sequentially read by the monitoring agent 30 that is the target of the action, and actions such as server duplication and destruction are executed (S89).

The present invention is not limited to the above-described embodiment, and can be implemented in various other forms without departing from the gist of the present invention. For this reason, the said embodiment is only a mere illustration in all points, and is not interpreted limitedly. For example, the above-described processing steps can be executed in any order or in parallel as long as there is no contradiction in the processing contents.

Further, in the above-described embodiment, the collection server 42, the management server 43, and the execution server 44 are configured by different servers, but any two or all of these servers are included. Needless to say, the functions may be configured in one server. For example, a processing server in which the collection server 42 and the management server 43 are combined into one may be provided, and this processing server may be distributed by a plurality of virtual servers having the same server image. Further, a processing server in which the management server 43 and the execution server 44 are combined may be provided, or a processing server in which the collection server 42, the management server 43, and the execution server 44 are combined may be provided. Then, the monitoring agent 30 may be incorporated in these processing servers, and the computer resource control system 1 may monitor and control the processing servers.

Furthermore, in the above-described embodiment, the monitoring agent 30 includes one of the system agent 401 and the log file agent 402. However, the monitoring agent 30 is not limited to these, and an agent that monitors an arbitrary event is used. You may apply.

1 computer resource control system, 10 cloud, 12 user terminal device, 20 computer device group, 30 monitoring agent, 32 message network, 34 processing unit, 40 monitored application server, 41 message queue server, 42 collection server, 43 management server, 44 execution servers, 45 database servers, 46 dashboard servers, 48 dashboards, 50 monitored clusters, N networks

Claims (17)

A computer resource control system for controlling computer resources, the computer resource control system comprising:
Based on the data collected from the monitoring agent, it is determined whether or not the computer resource needs to be controlled, and when it is determined that the computer resource needs to be controlled, an instruction for executing the control on the computer resource is output. A processing unit;
A message queue for exchanging data between the monitoring agent and the processing unit;
A first monitoring agent for monitoring the status of the message queue;
With
The processing unit determines whether or not control of the computer resource is necessary based on data collected from the first monitoring agent;
Computer resource control system. Control over the computer resources includes starting, copying, stopping or changing settings of any computer resource in the cloud.
The computer resource control system according to claim 1. Control over the computer resources includes processing to increase or decrease the number of arbitrary servers in the cloud,
The computer resource control system according to claim 1. The processing unit compares the data collected from the monitoring agent with a predefined control rule to determine whether or not the computer resource needs to be controlled;
The computer resource control system according to any one of claims 1 to 3. A message queue server, the message queue server comprising the message queue and the first monitoring agent;
The computer resource control system according to claim 1, wherein the computer resource control system is a computer resource control system. A computer resource control system for controlling computer resources, the computer resource control system comprising:
A management server that compares data collected from a plurality of monitoring agents with a predefined control rule to determine whether an action is required for the computer resource;
An execution server that outputs an instruction to execute an action on the computer resource when the management server determines that an action on the computer resource is required;
A message queue server for asynchronously exchanging data among the monitoring agent, the management server, and the execution server, the message comprising a first monitoring agent for monitoring the status of the message queue server A queue server,
Including
The action includes a process of increasing or decreasing the number of servers included in the computer resource control system based on data collected from the first monitoring agent.
A computer resource control system. At least one of the message queue server, the management server, and the execution server is configured by a virtual server,
The action includes a process of increasing or decreasing the number of virtual servers included in the computer resource control system based on data collected from the first monitoring agent.
The computer resource control system according to claim 6. The first monitoring agent monitors data exchange status;
The computer resource control system according to claim 6 or 7, characterized by the above. The message queue server
Data management queues sequentially input data collected from the plurality of monitoring agents and sequentially read out by the management server;
An execution queue sequentially input action instructions from the management server and sequentially read out by the execution server;
Management data sequentially input processing data for executing an action on the computer resource from the execution server, and sequentially read by the corresponding monitoring agent;
With
The first monitoring agent monitors a queue of the data management queue, the execution queue, and the management queue;
The computer resource control system according to claim 6, wherein the computer resource control system is a computer resource control system. Each server in the computer resource control system includes a second monitoring agent that monitors the operating status of each server,
The management server determines whether or not an action is required for the computer resource based on the operating status of each server.
The computer resource control system according to claim 6, wherein the computer resource control system is a computer resource control system. The computer resource control system further includes:
A database server for storing the data;
A collection server that reads data collected from the plurality of monitoring agents from the message queue server and registers the data in the database server;
A dashboard server that reads and edits data stored in the database server, and transmits the data to a user terminal device;
The computer resource control system according to claim 6, further comprising: In a control system for controlling computer resources, a processing device provided in the control system performs processing,
The processing device is
Determining whether to control the computer resource based on data collected from the monitoring agent; and
Outputting an instruction to execute control on the computer resource when it is determined that control on the computer resource is required;
Exchanging data between the monitoring agent and the control system via a message queue;
With
A first monitoring agent monitors the status of the message queue;
The step of determining determines whether or not control of the computer resource is necessary based on data collected from the first monitoring agent;
Computer resource control method. Control over the computer resources includes starting, copying, stopping or changing settings of any computer resource in the cloud.
The computer resource control method according to claim 12. Control over the computer resources includes processing to increase or decrease the number of arbitrary servers in the cloud,
The computer resource control method according to claim 12. The step of determining determines whether or not the computer resource needs to be controlled by comparing data collected from the monitoring agent with a predefined control rule;
The computer resource control method according to claim 12, wherein the computer resource control method is a computer resource control method. In a control system for controlling computer resources, a processing device provided in the control system performs processing,
The processing device is
Comparing the data collected from the monitoring agent with predefined control rules to determine the need for action on the computer resource;
Outputting an instruction to perform an action on the computer resource when it is determined that an action on the computer resource is required;
Exchanging data asynchronously between the monitoring agent and the control system;
With
A first monitoring agent monitors the status of the server processing the replacing step;
The action includes a process of increasing or decreasing the number of servers included in the control system based on data collected from the first monitoring agent.
A computer resource control method. A computer-readable recording medium storing a program for causing a computer to execute the computer resource control method according to any one of claims 12 to 16.

Images