[go: up one dir, main page]

CN113590589A - Database building method and device and electronic equipment - Google Patents

Database building method and device and electronic equipment Download PDF

Info

Publication number
CN113590589A
CN113590589A CN202110875951.3A CN202110875951A CN113590589A CN 113590589 A CN113590589 A CN 113590589A CN 202110875951 A CN202110875951 A CN 202110875951A CN 113590589 A CN113590589 A CN 113590589A
Authority
CN
China
Prior art keywords
database
server
node
target
target server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202110875951.3A
Other languages
Chinese (zh)
Other versions
CN113590589B (en
Inventor
钱璞昕
曾琳奕
雷经纬
杨丽萦
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Industrial and Commercial Bank of China Ltd ICBC
Original Assignee
Industrial and Commercial Bank of China Ltd ICBC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Industrial and Commercial Bank of China Ltd ICBC filed Critical Industrial and Commercial Bank of China Ltd ICBC
Priority to CN202110875951.3A priority Critical patent/CN113590589B/en
Publication of CN113590589A publication Critical patent/CN113590589A/en
Application granted granted Critical
Publication of CN113590589B publication Critical patent/CN113590589B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/21Design, administration or maintenance of databases
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/30Monitoring
    • G06F11/34Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment
    • G06F11/3409Recording or statistical evaluation of computer activity, e.g. of down time, of input/output operation ; Recording or statistical evaluation of user activity, e.g. usability assessment for performance assessment
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F11/00Error detection; Error correction; Monitoring
    • G06F11/36Prevention of errors by analysis, debugging or testing of software
    • G06F11/3668Testing of software
    • G06F11/3672Test management
    • G06F11/3688Test management for test execution, e.g. scheduling of test suites
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F8/00Arrangements for software engineering
    • G06F8/60Software deployment
    • G06F8/61Installation
    • G06F8/63Image based installation; Cloning; Build to order

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • General Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Hardware Design (AREA)
  • Quality & Reliability (AREA)
  • Software Systems (AREA)
  • Databases & Information Systems (AREA)
  • Data Mining & Analysis (AREA)
  • Information Retrieval, Db Structures And Fs Structures Therefor (AREA)

Abstract

本说明书实施方式公开了数据库搭建方法、装置及电子设备,涉及分布式数据存储技术领域,其中方法包括:管控服务器接收数据库搭建请求,数据库搭建请求中携带有数据库的性能需求;从预先设置的模板库中选择与性能需求匹配的模板作为目标模板;获取目标模板中数据节点的数量、控制节点的计算资源量和存储资源量、每个数据节点的计算资源量和存储资源量;从管控服务器所纳管的多个目标服务器中选取与目标模板中匹配的一个或多个目标服务器用于创建数据库节点;根据所选取的每个目标服务器匹配的节点类型,为所选取的每个目标服务器配置数据库组件,形成数据库。本方案通过管控服务器执行步骤自动搭建数据库,能够提高数据库搭建的效率。

Figure 202110875951

Embodiments of this specification disclose a database construction method, device, and electronic device, and relate to the technical field of distributed data storage. The method includes: a management and control server receives a database construction request, and the database construction request carries the performance requirements of the database; Select the template that matches the performance requirements in the library as the target template; obtain the number of data nodes in the target template, the amount of computing resources and storage resources of the control node, the amount of computing resources and storage resources of each data node; One or more target servers that match the target template are selected from the managed multiple target servers to create database nodes; the database is configured for each selected target server according to the node type matched by each selected target server components to form a database. This solution automatically builds a database by controlling the execution steps of the server, which can improve the efficiency of database building.

Figure 202110875951

Description

Database building method and device and electronic equipment
Technical Field
The application relates to the technical field of distributed data storage, in particular to a database building method and device and electronic equipment.
Background
In a relational database of a Massively Parallel Processing (MPP) architecture, Data of each table is distributed to Data Nodes (DN) in a cluster according to rules (such as hash remainder), and a Data analysis task needs to coordinate each Data Node to complete Data Processing work in Parallel through a Coordinator Node (CN) which does not actually store the Data. The structure leads the performance of the database to be strongly and positively correlated with various nodes of the database. Thus, when using massively parallel processing architecture databases, users tend to build as multi-node databases as possible.
In the prior art, when a database is built, a user is required to plan a database architecture, manually install an operating system, divide a disk, upload a database component program package and install the server according to different node types (such as control nodes or data nodes) in the architecture, and configure the mapping relation of each node server in the database software installation process. After all the nodes complete the above operations, operations such as unified connectivity test, configuration modification and the like need to be performed on the node network.
The existing database building method is relatively complex in steps and long in time consumption. Especially, when the number of nodes in the MPP architecture database is large, actual construction work usually needs to take more than one week.
Disclosure of Invention
The embodiment of the specification aims to provide a database building method, a database building device and electronic equipment so as to improve the efficiency of building a database.
In order to solve the technical problem, an embodiment of the present specification provides a database building method, where the method includes: the method comprises the steps that a management and control server receives a database building request, wherein the database building request carries performance requirements of a database; selecting a template matched with the performance requirement from a preset template library as a target template; acquiring the number of data nodes in the target template, the computing resource amount and the storage resource amount of the control node, and the computing resource amount and the storage resource amount of each data node; selecting one or more target servers matched with the number of data nodes in the target template, the computing resource amount and the storage resource amount of the control node and the computing resource amount and the storage resource amount of each data node from a plurality of target servers managed by the management and control server to create a database node; and configuring a database component for each selected target server according to the node type matched with each selected target server to form a database.
According to the database building method provided by the embodiment of the specification, the database is automatically built through the execution steps of the control server, compared with the prior art of building the database manually, the time consumption is short, the manual execution operation is less, and the database building efficiency can be improved.
Drawings
In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly introduced below, it is obvious that the drawings in the following description are only some embodiments described in the present application, and for those skilled in the art, other drawings can be obtained according to the drawings without creative efforts.
FIG. 1 shows a schematic diagram of a distributed data structure;
FIG. 2 shows a flow chart of a database building method according to an embodiment of the invention;
FIG. 3 is a flowchart illustrating specific steps of configuring a database component for each selected target server according to a node type matched with each selected target server to form a database according to an embodiment of the present invention;
FIG. 4 illustrates a flow chart of one method of testing a formed database in accordance with an embodiment of the present invention;
FIG. 5 shows a schematic block diagram of a database building apparatus according to an embodiment of the invention;
FIG. 6 shows a schematic block diagram of another database building apparatus according to an embodiment of the invention;
FIG. 7 shows a functional block diagram of an electronic device according to an embodiment of the invention.
Detailed Description
In order to make those skilled in the art better understand the technical solutions in the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the drawings in the embodiments of the present application, and it is obvious that the described embodiments are only a part of the embodiments of the present application, and not all of the embodiments. All other embodiments obtained by a person of ordinary skill in the art without any inventive work based on the embodiments in the present application shall fall within the scope of protection of the present application.
Fig. 1 shows a schematic diagram of a distributed data structure. In the distributed database architecture, a control node and a plurality of data nodes are included, and the control node is connected with each data node in a communication mode. And the control node receives the operation instruction of the database, analyzes the operation instruction and distributes calculation tasks to the data nodes according to the analysis result. And after the data node executes the calculation task, the calculation result is fed back to the control node. And the control node collects the calculation results fed back by the data nodes, and feeds back the collected calculation results to the user as the execution results of the operation instruction. Each database node comprises a control module, a calculation module and a storage module. The storage module is used for storing data in a database table, the calculation module is responsible for calculation tasks of the data in the storage module, and the control module is used for performing data interaction (such as receiving control distributed tasks, sending calculation results to the control nodes and the like) with the control nodes, controlling internal processing flows of the nodes and the like.
The embodiment of the specification provides a database building method, and the method can automatically complete the building work of a database by adopting a management and control server. The control server is a server different from the control node and the data node. Before executing the database building method, a database building person only needs to configure the management and control server, upload a required file to the management and control server, and open a physical connection channel between each server for building data and the management and control server.
As shown in fig. 2, the database building method provided by the embodiment of the present specification includes the following steps, which may be performed by the administrative server.
S110: and receiving a database building request, wherein the database building request carries the performance requirement of the database.
The performance requirement may be, for example, a computing power requirement, a storage power requirement, a disk capacity, the number of control nodes and data nodes, the maximum allowable number of connections of the database, the maximum allowable number of accesses of the database, a limit on the number of computations per unit time, a limit on the number of queries per unit time, and the like. Demands such as "8 cores + 64G" and "4 cores + 32G" are typically carried, where 8 cores and 4 cores refer to computing power, and 64G and 32G refer to data storage power.
In some embodiments, the database building request may be entered manually, such as through a command line window.
In some embodiments, the database building request is given by other electronic devices in communication connection with the management and control server, and is used for instructing the management and control server to build an automatic database.
S120: and selecting a template matched with the performance requirement from a preset template library as a target template.
The template library is preset in the management and control server, each template in the template library comprises a combination of a control node and a plurality of data nodes, each combination can realize a database architecture, and each node in the combinations is recorded in the template through a database node name. The combination also comprises the number of data nodes, the amount of computing resources and the amount of storage resources of the control node, the amount of computing resources and the amount of storage resources of each data node, and the maximum computing capacity, the maximum storage capacity, the maximum allowable connection number, the maximum allowable access times, the limit of computing times in unit time, the limit of query times in unit time and the like of the database formed by the combination.
The template matched with the performance requirement may be any one of the above combinations that meets all the requirements in the performance requirement, or may be a designated combination of the above combinations that meets all the requirements in the performance requirement, where the designated combination may be a combination with the smallest number of data nodes, a combination with the smallest amount of computing resources or storage resources of the control node, or a combination with the smallest amount of computing resources or storage resources of the data nodes.
A template that matches performance requirements may be exactly matched to the performance requirements on one hand, but much larger on the other hand. For example, the computing power requirement is 8G, the storage power requirement is 64G, and the matched templates in the template library only have the combination of "" 8G +128G "".
S130: the number of data nodes in the target template, the calculation resource quantity and the storage resource quantity of the control node, and the calculation resource quantity and the storage resource quantity of each data node are obtained.
S140: and selecting one or more target servers matched with the number of the data nodes in the target template, the calculation resource quantity and the storage resource quantity of the control node and the calculation resource quantity and the storage resource quantity of each data node from a plurality of target servers managed by the management and control server to create the database node.
Nanotube, i.e., inclusion management. Means that the target server can be operated by the management and control server through the network. The management and control server manages a plurality of servers, and the servers can be used as target servers and selected to be used for creating database nodes according to the performance requirements of the database.
S150: and configuring a database component for each selected target server according to the node type matched with each selected target server to form a database.
And the node type is a control node and a data node in the database architecture. Generally, there is one control node and a plurality of data nodes.
The target template comprises two types of control nodes and data nodes, and when the matched target server is selected, the target server to be selected needs to be matched with information such as the calculation resource amount and the storage resource amount of the control nodes and the data nodes in the target template. The node type matched with each selected target server is the node type corresponding to the finally selected target server when the finally selected target server is matched with information such as the computing resource amount and the storage resource amount of the control node and the data node in the target template.
According to the database building method, the database is automatically built through the execution steps of the control server, compared with the prior art of building the database manually, the time consumption is short, the manual execution operation is less, and the database building efficiency can be improved.
In some embodiments, the management server may select a specified installer from a pre-stored installer library, the specified installer being an installer corresponding to a node type that matches each of the selected target servers, then send the specified installer to the selected target server, and then control the selected target server to execute the installer.
In some embodiments, as shown in fig. 3, step S150 may include the following steps:
s151: selecting a specified mirror image file from a pre-stored mirror image file library; the specified image file is an image file corresponding to the node type matched with each selected target server.
The mirror image file library only stores corresponding mirror image files for different types of nodes. That is, the mirror image file library does not store the mirror image files of all different nodes in the database architecture.
S152: sending the specified mirror image file to the selected target server, wherein the mirror image file carries: and forming a file of the database component, wherein the database component comprises a database node name.
The database node name is a server identifier for distinguishing each server constituting the database. For example, CN denotes a control node server, and DN1, DN2, and DN3 denote three data node servers, respectively.
S153: and mounting the mirror image file to the file system directory of the selected target server.
S154: and replacing the database node name in the mirror image file with the database node name in the target template.
Because the combination of the control nodes and the data nodes in the target template forms a database architecture, and the nodes in the combination are recorded in the target template through the database node names, the database node names in the mirror image files mounted by the selected target server are replaced by the database node names in the target template, so that the selected target server can be connected to realize the database architecture.
In some embodiments, the target server hosted by the governing server has not yet installed an operating system. In this case, the image files in steps S151 to S154 may further include files constituting an operating system, and accordingly, after the image file is mounted to the file system directory of the selected target server, the selected target server has the operating system.
The database assembly and the operating system of the target server are formed in the form of mounting the mirror image file, the process is simple, the consumed time is short, and the process of building the database can be accelerated.
In some embodiments, before step S110, account information of the target server is further obtained, the target server is logged in through the account information, and the network configuration and the directory structure of the file system in the target server are copied to the management and control server, so that the management and control server manages the target server.
In some embodiments, before step S110, account information of the target server is further obtained, the target server is logged in through the account information, and a monitoring software client is installed in the target server to supervise the target server, so that the management and control server manages the target server.
Two ways for the management server to manage the target server are given above.
In some embodiments, as shown in fig. 4, after step S150, the following steps are further included:
s160: and controlling each target server in the formed database to start the database process.
S170: it is checked whether a database process exists in each target server.
In some embodiments, the management and control server may directly log in each node server through an account and a password of each node server, start a database process by controlling a database component on each node server to run, and directly check whether a database process exists in the process list.
In some embodiments, the management and control server may also start the database process by controlling the operation of the database component on each node server through the monitoring software client pre-installed on each node server, and check whether the database process exists in the process list through the monitoring software client.
S180: testing the formed database in the case that the database process is determined to exist, wherein the testing comprises at least one of the following: adding operation, deleting operation, modifying operation and inquiring operation.
Therefore, step S170 is to test whether the database process can be normally started, and step S180 is to test whether the database formed by the joint test of the servers can realize the most basic operations of adding, deleting, and modifying the database.
In some embodiments, the "testing the formed database" in step S180 includes:
s181: and acquiring an address link and a user account of the formed database.
S182: and connecting to the formed database through an address link.
S183: after linking to the formed database, logging in the formed database through the user account.
S184: and sending a test instruction to the database under the condition that the login is successful, wherein the test instruction comprises at least one of the following: adding instructions, deleting instructions, modifying instructions and inquiring instructions.
In some embodiments, the "testing the formed database" in step S180 includes:
s185: and sending the pre-stored test script to a control node server in the formed database.
S186: controlling the test script to execute through a monitoring software client pre-installed on a control node server so as to send a test instruction to a database, wherein the test instruction comprises at least one of the following: adding instructions, deleting instructions, modifying instructions and inquiring instructions.
The embodiment of the specification provides a database building device, which can be used for realizing the database building method shown in fig. 2. As shown in fig. 5, the apparatus includes a receiving module 10, a selecting module 20, a first obtaining module 30, a selecting module 40, and a configuring module 50.
The receiving module 10 is configured to receive a database construction request, where the database construction request carries a performance requirement of a database.
The selection module 20 is configured to select a template matching the performance requirement from a preset template library as a target template.
The first obtaining module 30 is configured to obtain the number of data nodes in the target template, the amount of computing resources and the amount of storage resources of the control node, and the amount of computing resources and the amount of storage resources of each data node.
The selecting module 40 is configured to select, from a plurality of target servers managed by the management and control server, one or more target servers matched with the number of data nodes in the target template, the amount of computing resources and the amount of storage resources of the control node, and the amount of computing resources and the amount of storage resources of each data node to create a database node.
The configuration module 50 is configured to configure a database component for each selected target server according to the node type matched with each selected target server, so as to form a database.
In some embodiments, the target template further comprises a database node name; as shown in fig. 6, the configuration module 50 includes a selection sub-module 51, a sending sub-module 52, a mounting sub-module 53, and a replacement sub-module 54.
The selection sub-module 51 is used for selecting a specified image file from a pre-stored image file library; and the specified mirror image file is a mirror image file corresponding to the node type matched with each selected target server.
The sending submodule 52 is configured to send the specified image file to the selected target server, where the image file carries: and forming a file of a database component, wherein the database component comprises a database node name.
The mounting submodule 53 is configured to mount the image file to a file system directory of the selected target server.
The replacing sub-module 54 is configured to replace the database node name in the image file with the database node name in the target template.
In some embodiments, the database building apparatus further comprises a second obtaining module, a logging module, and a copying module.
The second acquisition module is used for acquiring the account information of the target server. And the login module is used for logging in the target server through the account information. The copying module is used for copying the network configuration and the directory structure of the file system in the target server to the management and control server.
In some embodiments, the database building apparatus further includes a third obtaining module, a login module, and an installation module.
The third acquisition module is used for acquiring the account information of the target server. And the login module is used for logging in the target server through the account information. The installation module is used for installing a monitoring software client in the target server so as to supervise the target server.
In some embodiments, the database building apparatus further comprises a start control module, an inspection module and a test module.
The starting control module is used for controlling each target server in the formed database to start the database process. The checking module is used for checking whether a database process exists in each target server. The testing module is used for testing the formed database under the condition that the database process is determined to exist, wherein the testing comprises at least one of the following steps: adding operation, deleting operation, modifying operation and inquiring operation.
In some embodiments, the test module includes an acquisition submodule, a connection submodule, a login submodule, and an instruction sending submodule.
And the acquisition submodule is used for acquiring the address link and the user account of the formed database. And the connecting submodule is used for connecting to the formed database through the address link. And the login submodule is used for logging in the formed database through the user account after the formed database is linked. The instruction sending submodule is used for sending a test instruction to the database under the condition that the login is successful, wherein the test instruction comprises at least one of the following: adding instructions, deleting instructions, modifying instructions and inquiring instructions.
In some embodiments, the test module includes a script sending sub-module and a control execution sub-module.
And the script sending submodule is used for sending the pre-stored test script to the control node server in the formed database. The control execution submodule is used for controlling the test script to execute through a monitoring software client pre-installed on the control node server so as to send a test instruction to a database, wherein the test instruction comprises at least one of the following: adding instructions, deleting instructions, modifying instructions and inquiring instructions.
An embodiment of the present invention further provides an electronic device, as shown in fig. 7, the electronic device may include a processor 71, a memory 72, and a communication module 73, where the processor 71, the memory 72, and the communication module 73 may be connected by a bus or in another manner, and fig. 7 takes the connection by the bus as an example.
The processor 71 may be a Central Processing Unit (CPU). The Processor 71 may also be other general purpose processors, Digital Signal Processors (DSPs), Application Specific Integrated Circuits (ASICs), Field Programmable Gate Arrays (FPGAs) or other Programmable logic devices, discrete Gate or transistor logic devices, discrete hardware components, or combinations thereof.
The memory 72, as a non-transitory computer-readable storage medium, may be used to store a non-transitory software program, a non-transitory computer-executable program, and modules, such as program instructions/modules corresponding to the database building method in the embodiment of the present invention (for example, the receiving module 10, the selecting module 20, the first obtaining module 30, the selecting module 40, and the configuring module 50 shown in fig. 5). The processor 71 executes various functional applications and data processing of the processor by running the non-transitory software programs, instructions and modules stored in the memory 72, that is, implements the database building method in the above method embodiment.
The memory 72 may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the storage data area may store data created by the processor 71, and the like. Further, the memory 72 may include high speed random access memory, and may also include non-transitory memory, such as at least one magnetic disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory 72 may optionally include memory located remotely from the processor 71, and such remote memory may be connected to the processor 71 via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The one or more modules are stored in the memory 72 and when executed by the processor 71 perform the database building method as in the embodiment shown in fig. 2.
The details of the electronic device may be understood with reference to the corresponding related description and effects in the embodiment of fig. 2, and are not described herein again.
It will be understood by those skilled in the art that all or part of the processes of the methods of the embodiments described above can be implemented by a computer program, which can be stored in a computer-readable storage medium, and when executed, can include the processes of the embodiments of the methods described above. The storage medium may be a magnetic Disk, an optical Disk, a Read-Only Memory (ROM), a Random Access Memory (RAM), a Flash Memory (Flash Memory), a Hard Disk (Hard Disk Drive, abbreviated as HDD), a Solid State Drive (SSD), or the like; the storage medium may also comprise a combination of memories of the kind described above.
In the 50 s of the 20 th century, improvements in a technology could clearly be distinguished between improvements in hardware (e.g., improvements in circuit structures such as diodes, transistors, switches, etc.) and improvements in software (improvements in process flow). However, as technology advances, many of today's process flow improvements have been seen as direct improvements in hardware circuit architecture. Designers almost always obtain the corresponding hardware circuit structure by programming an improved method flow into the hardware circuit. Thus, it cannot be said that an improvement in the process flow cannot be realized by hardware physical modules. For example, a Programmable Logic Device (PLD), such as a Field Programmable Gate Array (FPGA), is an integrated circuit whose Logic functions are determined by programming the Device by a user. A digital system is "integrated" on a PLD by the designer's own programming without requiring the chip manufacturer to design and fabricate a dedicated integrated circuit chip 2. Furthermore, nowadays, instead of manually making an Integrated Circuit chip, such Programming is often implemented by "logic compiler" software, which is similar to a software compiler used in program development and writing, but the original code before compiling is also written by a specific Programming Language, which is called Hardware Description Language (HDL), and HDL is not only one but many, such as abel (advanced Boolean Expression Language), ahdl (alternate Language Description Language), traffic, pl (core unified Programming Language), HDCal, JHDL (Java Hardware Description Language), langue, Lola, HDL, laspam, hardbyscript Description Language (vhr Description Language), and the like, which are currently used by Hardware compiler-software (Hardware Description Language-software). It will also be apparent to those skilled in the art that hardware circuitry that implements the logical method flows can be readily obtained by merely slightly programming the method flows into an integrated circuit using the hardware description languages described above.
The embodiments in the present specification are described in a progressive manner, and the same and similar parts among the embodiments can be referred to each other, and each embodiment focuses on the differences from the other embodiments.
The systems, devices, modules or units described in the above embodiments may be implemented by a computer chip or an entity, or by a product with certain functions.
For convenience of description, the above devices are described as being divided into various units by function, and are described separately. Of course, the functionality of the units may be implemented in one or more software and/or hardware when implementing the present application.
From the above description of the embodiments, it is clear to those skilled in the art that the present application can be implemented by software plus necessary general hardware platform. Based on such understanding, the technical solutions of the present application may be essentially or partially implemented in the form of software products, which may be stored in a storage medium, such as ROM/RAM, magnetic disk, optical disk, etc., and include instructions for causing a computer device (which may be a personal computer, a server, or a network device, etc.) to execute the methods of some parts of the embodiments of the present application.
The application is operational with numerous general purpose or special purpose computing system environments or configurations. For example: personal computers, server computers, hand-held or portable devices, tablet-type devices, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like.
The application may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The application may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.
Although the present application has been described in terms of embodiments, those of ordinary skill in the art will recognize that there are numerous variations and permutations of the present application without departing from the spirit of the application, and it is intended that the appended claims encompass such variations and permutations without departing from the spirit of the application.

Claims (10)

1.一种数据库搭建方法,其特征在于,所述方法包括:1. a database building method, is characterized in that, described method comprises: 管控服务器接收数据库搭建请求,所述数据库搭建请求中携带有数据库的性能需求;The management and control server receives a database construction request, and the database construction request carries the performance requirements of the database; 从预先设置的模板库中选择与所述性能需求匹配的模板,作为目标模板;Select a template matching the performance requirement from a preset template library as a target template; 获取所述目标模板中数据节点的数量、控制节点的计算资源量和存储资源量、每个数据节点的计算资源量和存储资源量;Obtain the number of data nodes in the target template, the amount of computing resources and the amount of storage resources of the control node, the amount of computing resources and the amount of storage resources of each data node; 从所述管控服务器所纳管的多个目标服务器中选取与所述目标模板中数据节点的数量、控制节点的计算资源量和存储资源量、每个数据节点的计算资源量和存储资源量匹配的一个或多个目标服务器用于创建数据库节点;The number of data nodes in the target template, the amount of computing resources and storage resources of control nodes, and the amount of computing resources and storage resources of each data node are selected from multiple target servers managed by the management and control server. one or more target servers for creating database nodes; 根据所选取的每个目标服务器匹配的节点类型,为所选取的每个目标服务器配置数据库组件,形成数据库。According to the node type matched by each selected target server, a database component is configured for each selected target server to form a database. 2.根据权利要求1所述的数据库搭建方法,其特征在于,所述目标模板中还包括数据库节点名称;所述根据所选取的每个目标服务器匹配的节点类型,为所选取的每个目标服务器配置数据库组件,包括:2. The database construction method according to claim 1, wherein the target template also includes a database node name; the node type matched according to each selected target server is for each selected target Server configuration database components, including: 从预先存储的镜像文件库中选择指定的镜像文件;所述指定的镜像文件是与所选取的每个目标服务器匹配的节点类型对应的镜像文件;Select a designated image file from a pre-stored image file library; the designated image file is an image file corresponding to the node type that matches each of the selected target servers; 将指定的镜像文件发送至所选取的目标服务器,其中,所述镜像文件中携带有:构成数据库组件的文件,所述数据库组件中包括数据库节点名称;Sending the specified mirror file to the selected target server, wherein the mirror file carries: a file constituting a database component, and the database component includes a database node name; 将所述镜像文件挂载至所选取的目标服务器的文件系统目录下;The image file is mounted under the file system directory of the selected target server; 将所述镜像文件中的数据库节点名称替换为所述目标模板中的数据库节点名称。Replace the database node name in the image file with the database node name in the target template. 3.根据权利要求1所述的数据库搭建方法,其特征在于,在管控服务器接收数据库搭建请求之前,还包括:3. The database building method according to claim 1, wherein before the management and control server receives the database building request, further comprising: 获取目标服务器的账户信息;Obtain the account information of the target server; 通过所述账户信息登录所述目标服务器;Log in to the target server through the account information; 将所述目标服务器中的网络配置和文件系统的目录结构拷贝至所述管控服务器。Copy the network configuration and the directory structure of the file system in the target server to the management server. 4.根据权利要求1所述的数据库搭建方法,其特征在于,在管控服务器接收数据库搭建请求之前,还包括:4. The database building method according to claim 1, wherein before the management and control server receives the database building request, further comprising: 获取目标服务器的账户信息;Obtain the account information of the target server; 通过所述账户信息登录所述目标服务器;Log in to the target server through the account information; 在所述目标服务器中安装监控软件客户端,以对所述目标服务器进行监管。A monitoring software client is installed in the target server to supervise the target server. 5.根据权利要求1所述的方法,其特征在于,所述根据所选取的每个目标服务器匹配的节点类型,为所选取的每个目标服务器配置数据库组件,形成数据库之后,还包括:5. The method according to claim 1, wherein, according to the node type matched by each selected target server, configure a database component for each selected target server, after forming the database, also comprising: 控制形成的数据库中的各目标服务器启动数据库进程;Control each target server in the formed database to start the database process; 检查各目标服务器中是否存在数据库进程;Check whether there is a database process in each target server; 在确定存在数据库进程的情况下,对形成的数据库进行测试,其中,测试包括以下至少之一:增加操作、删除操作、修改操作、查询操作。When it is determined that there is a database process, a test is performed on the formed database, wherein the test includes at least one of the following operations: adding, deleting, modifying, and querying. 6.根据权利要求5所述的数据库搭建方法,其特征在于,对形成的数据库进行测试,包括:6. database building method according to claim 5 is characterized in that, the database formed is tested, comprising: 获取所述形成的数据库的地址链接和用户账号;Obtain the address link and user account of the formed database; 通过所述地址链接,连接至所述形成的数据库;connecting to the formed database through the address link; 在链接至所述形成的数据库之后,通过所述用户账号登录所述形成的数据库;After linking to the formed database, log in to the formed database through the user account; 在登录成功的情况下,向数据库发送测试指令,其中,所述测试指令包括以下至少之一:增加指令、删除指令、修改指令、查询指令。In the case of successful login, a test instruction is sent to the database, wherein the test instruction includes at least one of the following: an addition instruction, a deletion instruction, a modification instruction, and a query instruction. 7.根据权利要求5所述的数据库搭建方法,其特征在于,对形成的数据库进行测试,包括:7. database building method according to claim 5 is characterized in that, the database formed is tested, comprising: 将预先存储的测试脚本发送至所形成的数据库中的控制节点服务器;Send the pre-stored test script to the control node server in the formed database; 通过所述控制节点服务器上预先安装的监控软件客户端控制所述测试脚本执行,以向数据库发送测试指令,其中,所述测试指令包括以下至少之一:增加指令、删除指令、修改指令、查询指令。The execution of the test script is controlled by the monitoring software client pre-installed on the control node server, so as to send a test instruction to the database, wherein the test instruction includes at least one of the following: adding instruction, deleting instruction, modifying instruction, querying instruction. 8.一种数据库搭建装置,其特征在于,所述装置包括:8. A database building device, wherein the device comprises: 接收模块,用于接收数据库搭建请求,所述数据库搭建请求中携带有数据库的性能需求;a receiving module, configured to receive a database construction request, where the database construction request carries the performance requirements of the database; 选择模块,用于从预先设置的模板库中选择与所述性能需求匹配的模板,作为目标模板;a selection module for selecting a template matching the performance requirement from a preset template library as a target template; 第一获取模块,用于获取所述目标模板中数据节点的数量、控制节点的计算资源量和存储资源量、每个数据节点的计算资源量和存储资源量;a first obtaining module, configured to obtain the number of data nodes in the target template, the amount of computing resources and storage resources of the control node, and the amount of computing resources and storage resources of each data node; 选取模块,用于从所述管控服务器所纳管的多个目标服务器中选取与所述目标模板中数据节点的数量、控制节点的计算资源量和存储资源量、每个数据节点的计算资源量和存储资源量匹配的一个或多个目标服务器用于创建数据库节点;The selection module is used to select the number of data nodes in the target template, the amount of computing resources and storage resources of the control node, and the amount of computing resources of each data node from the multiple target servers managed by the management and control server. One or more target servers matching the amount of storage resources are used to create database nodes; 配置模块,用于根据所选取的每个目标服务器匹配的节点类型,为所选取的每个目标服务器配置数据库组件,形成数据库。The configuration module is used for configuring the database components for each selected target server according to the node type matched by each selected target server to form a database. 9.一种电子设备,其特征在于,包括:9. An electronic device, characterized in that, comprising: 通信模块、存储器和处理器,所述通信模块、所述处理器和所述存储器之间互相通信连接,所述存储器中存储有计算机指令,所述处理器通过执行所述计算机指令,从而实现权利要求1至7任一项所述方法的步骤。A communication module, a memory, and a processor, the communication module, the processor, and the memory are communicatively connected to each other, the memory stores computer instructions, and the processor implements the rights by executing the computer instructions The steps of any of claims 1 to 7 of the method. 10.一种计算机存储介质,其特征在于,所述计算机存储介质存储有计算机程序指令,所述计算机程序指令被执行时实现权利要求1至7任一项所述方法的步骤。10. A computer storage medium, characterized in that the computer storage medium stores computer program instructions, and when the computer program instructions are executed, implements the steps of the method according to any one of claims 1 to 7.
CN202110875951.3A 2021-07-30 2021-07-30 Database building method, device and electronic equipment Active CN113590589B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110875951.3A CN113590589B (en) 2021-07-30 2021-07-30 Database building method, device and electronic equipment

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110875951.3A CN113590589B (en) 2021-07-30 2021-07-30 Database building method, device and electronic equipment

Publications (2)

Publication Number Publication Date
CN113590589A true CN113590589A (en) 2021-11-02
CN113590589B CN113590589B (en) 2025-02-14

Family

ID=78253193

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110875951.3A Active CN113590589B (en) 2021-07-30 2021-07-30 Database building method, device and electronic equipment

Country Status (1)

Country Link
CN (1) CN113590589B (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114706833A (en) * 2022-03-16 2022-07-05 北京汇元网科技股份有限公司 A method, device, electronic device, and storage medium for constructing a high-availability technology for a SQL Server database
CN115934683A (en) * 2022-12-30 2023-04-07 山石网科通信技术股份有限公司 Ambari-based Redis database architecture construction method and its device, electronic equipment
CN118733565A (en) * 2024-06-26 2024-10-01 江苏方洋智能科技有限公司 A cloud database construction and management method and system for a group company

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106161250A (en) * 2016-06-14 2016-11-23 乐视控股(北京)有限公司 The creation method of data base and device
US20170039106A1 (en) * 2015-01-23 2017-02-09 Servicenow, Inc. Distributed Computing System With Resource Managed Database Cloning
CN109814881A (en) * 2017-11-21 2019-05-28 北京京东尚科信息技术有限公司 Method and apparatus for disposing data-base cluster
CN109977099A (en) * 2019-03-16 2019-07-05 平安城市建设科技(深圳)有限公司 Database portion arranging method, user equipment, storage medium and device
CN111683114A (en) * 2020-04-21 2020-09-18 视联动力信息技术股份有限公司 Method and device for upgrading equipment program, terminal equipment and storage medium
CN111796838A (en) * 2020-06-30 2020-10-20 中国工商银行股份有限公司 MPP database automatic deployment method and device
CN112783860A (en) * 2021-01-11 2021-05-11 网易(杭州)网络有限公司 Method and device for constructing mirror database, storage medium and computer equipment

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20170039106A1 (en) * 2015-01-23 2017-02-09 Servicenow, Inc. Distributed Computing System With Resource Managed Database Cloning
CN106161250A (en) * 2016-06-14 2016-11-23 乐视控股(北京)有限公司 The creation method of data base and device
CN109814881A (en) * 2017-11-21 2019-05-28 北京京东尚科信息技术有限公司 Method and apparatus for disposing data-base cluster
CN109977099A (en) * 2019-03-16 2019-07-05 平安城市建设科技(深圳)有限公司 Database portion arranging method, user equipment, storage medium and device
CN111683114A (en) * 2020-04-21 2020-09-18 视联动力信息技术股份有限公司 Method and device for upgrading equipment program, terminal equipment and storage medium
CN111796838A (en) * 2020-06-30 2020-10-20 中国工商银行股份有限公司 MPP database automatic deployment method and device
CN112783860A (en) * 2021-01-11 2021-05-11 网易(杭州)网络有限公司 Method and device for constructing mirror database, storage medium and computer equipment

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114706833A (en) * 2022-03-16 2022-07-05 北京汇元网科技股份有限公司 A method, device, electronic device, and storage medium for constructing a high-availability technology for a SQL Server database
CN115934683A (en) * 2022-12-30 2023-04-07 山石网科通信技术股份有限公司 Ambari-based Redis database architecture construction method and its device, electronic equipment
CN118733565A (en) * 2024-06-26 2024-10-01 江苏方洋智能科技有限公司 A cloud database construction and management method and system for a group company
CN118733565B (en) * 2024-06-26 2025-05-02 江苏方洋智能科技有限公司 A cloud database construction and management method and system for a group company

Also Published As

Publication number Publication date
CN113590589B (en) 2025-02-14

Similar Documents

Publication Publication Date Title
JP2022022077A (en) Methods and equipment for deploying applications, electronic devices, readable storage media and computer programs
CN113590589A (en) Database building method and device and electronic equipment
CN109857451B (en) Method, device, equipment and medium for generating IP core file
CN111580926A (en) Model publishing method, model deployment method, apparatus, device and storage medium
CN115220874B (en) Kubernetes cluster deployment method, device, equipment and storage medium
CN111327692A (en) Model training method and device and cluster system
US11698911B2 (en) System and methods for performing updated query requests in a system of multiple database engine
US20200371902A1 (en) Systems and methods for software regression detection
US12174722B2 (en) Characterizing operation of software applications having large number of components
CN113590595A (en) Database multi-writing method and device and related equipment
CN102355499A (en) Cloud computing system
CN106406980B (en) A kind of dispositions method and device of virtual machine
CN111309297B (en) Script development system and method
US20240160559A1 (en) Automated decoupling of unit tests
CN114647415B (en) Methods, systems, and computer program products for processing a tuple stream
CN112464596B (en) Regression testing method, system, device and readable storage medium
US7434041B2 (en) Infrastructure for verifying configuration and health of a multi-node computer system
US12259851B2 (en) Testing templates used for implementing infrastructure as code
US20060250970A1 (en) Method and apparatus for managing capacity utilization estimation of a data center
CN116340294A (en) Database deployment method and device, computer readable storage medium and electronic equipment
CN113031964B (en) Big data application management method, device, equipment and storage medium
CN116225471A (en) Elasticsearch cluster deployment method, storage medium and electronic device
CN116909584B (en) Deployment method, device, equipment and storage medium of space-time big data engine
CN119806633B (en) System migration compatibility analysis method, device, computer equipment and storage medium
Scriven et al. Resource evaluation and node monitoring in service oriented ad-hoc grids

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant