CN110928774B - Automatic test system based on node type - Google Patents
Automatic test system based on node type Download PDFInfo
- Publication number
- CN110928774B CN110928774B CN201911082062.0A CN201911082062A CN110928774B CN 110928774 B CN110928774 B CN 110928774B CN 201911082062 A CN201911082062 A CN 201911082062A CN 110928774 B CN110928774 B CN 110928774B
- Authority
- CN
- China
- Prior art keywords
- test
- execution
- testing
- report
- information
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Prevention of errors by analysis, debugging or testing of software
- G06F11/3668—Testing of software
- G06F11/3672—Test management
- G06F11/3684—Test management for test design, e.g. generating new test cases
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Prevention of errors by analysis, debugging or testing of software
- G06F11/3668—Testing of software
- G06F11/3672—Test management
- G06F11/3688—Test management for test execution, e.g. scheduling of test suites
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F11/00—Error detection; Error correction; Monitoring
- G06F11/36—Prevention of errors by analysis, debugging or testing of software
- G06F11/3668—Testing of software
- G06F11/3672—Test management
- G06F11/3692—Test management for test results analysis
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Computer Hardware Design (AREA)
- Quality & Reliability (AREA)
- Physics & Mathematics (AREA)
- General Engineering & Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Debugging And Monitoring (AREA)
Abstract
The invention discloses an automatic test system based on node type, which issues different test stages to different machines for testing, simultaneously supports the coordinated execution of test cases on different machines, judges that the output corresponding to the test input is matched with the expected result for completing the test, outputs a test report to a central server for summarizing and analyzing to form a complete test, and generates the test report to be sent to related personnel. Aiming at the service characteristics at the present stage, the invention solves the difficulty of software testing, realizes a set of system for the automatic testing of the omnibearing software, can continuously and automatically complete the testing of the whole service flow, timely generate a report, inform relevant personnel of the testing result, comprehensively monitor the quality of project software, shorten the testing time, reduce misoperation or omission of personnel in the testing process, enlarge the testing depth and improve the project quality.
Description
Technical Field
The invention belongs to the technical field of automatic software testing, and particularly relates to an automatic testing system based on a node type.
Background
In order to complete various services, most of service systems are combined by a plurality of systems, including a client, a server, a mobile terminal, and a combination of B/S and C/S modes. The architecture of the business system requires that different operations call each other in the test process to complete the test of the business process, wherein the targeted tests such as UI compatibility test, performance test and the like are fused in part of the operation process. The fusion of different testing methods in a testing process requires that testing steps are distributed on different machines to finish testing, and the use cases on the different machines are required to be cooperatively executed, the matching condition of actual output and expected output in stages in different environments is detected, a report is reported, and after the whole stage is finished, the execution results of the stages are summarized to obtain a complete testing report.
Looking around the existing technology at present, the technology has strong specificity, the technology and the scene are combined too tightly, and the technical solution or the system for combining B/S and C/S modes into a test scene is not solved. For example, chinese patent with publication number CN104679651a provides an automatic test method and an execution node, where an implementation application obtains a test case through the execution node, and the execution node starts a corresponding process, so that the corresponding process executes the test case; the number of the execution nodes is at least one, and the number of the processes corresponding to each execution node is at least one, so that the automatic test of the test cases is completed by a plurality of processes. Therefore, the technical scheme can carry out automatic test on the test cases in parallel, the described solution is divided according to the types of the cases, and the node machine executes the test cases of the same type; the distributed test method mainly solves the problems that the distributed test method based on the web test lacks support to the C/S and the mobile terminal, and meanwhile, communication and collaboration of different types of use cases cannot be completed, and the test of the use cases in a special scene cannot be completed. Along with the progress of technology, especially the increase of business scenes such as mobile terminals, the complexity of real business scenes exceeds the former, the automatic testing scheme and system based on the current business complexity are required to be realized, and the testing fusion from the mobile terminal to the B/S terminal to the C/S terminal is realized, so that the requirements of mutually coordinated completion of the testing scenes are realized.
And as the Chinese patent with publication number of CN103678093A provides an automatic test framework and a test method, the technical problems that in the prior art, an automatic tool is limited to a single terminal machine, remote control cannot be realized, a case test result cannot be automatically corresponding to a case, and the case test result cannot be integrated into a unified report are effectively solved. The main defect of the technology is that the problem that parameters are required to be transferred and the parameters are required to be transferred to be shared is not solved, and the scheme cannot meet the complexity of the tested scene nowadays.
Also, the chinese patent with publication No. CN103577907a provides a continuous integration test method and system, which mainly solves the problem of continuous integration project while monitoring the targets to be tested running in each real environment; when detecting that a target to be detected running in a certain real environment reaches a preset condition, acquiring an environment identifier corresponding to the real environment in which the target to be detected runs; calling a test case by sending a test command, wherein the test command comprises an environment identifier; the test case configures a corresponding test environment according to the environment identifier; executing the test script in the test case in the test environment, and acquiring a final test result. The system provides support for testing the entire process, nor does it provide an effective solution for supporting multiple use cases therein, nor does it provide a practical solution for generalized analysis of test results.
In addition, the Chinese patent with the publication number of CN106201882A provides an operating system automatic test method and system based on Jenkins, wherein a Jenkins test tool and a robotframe work frame are built on a server in advance; acquiring real-time installation information of an operating system in a target test end; when the real-time installation information of the operating system shows that the corresponding operating system is installed on the target test end, a script file written in advance by the server end is called by running a test task constructed by a Jenkins test tool so as to execute a test case written in advance by a Ride tool in a robot frame, and a corresponding operating system test result is obtained. The technology mainly solves the problems of the operation mode in the software test, provides a solution, lacks the sequencing of the use cases, the scene fusion and the solution of the sharing of test data of multiple platforms, wherein the description is limited to the solution of the problems in the existing robot frame framework, and cannot provide support for the multiple types of test use cases.
Disclosure of Invention
In view of the above, the invention provides an automatic test system based on node type, which can solve the problem of the inter-calling among different types of test cases, wherein the case steps can be composed of UI test, interface test, performance test and mobile terminal test, and parameters can be mutually transferred, so that the inter-calling and parameter transfer sharing of the types are not distinguished among the cases.
A node-based automated testing system, comprising:
the login module is used for providing a user login verification and authority verification function;
the test case module is responsible for the management of the user on the case, namely obtaining case information from a file server, designating the type of the node machine to be executed according to the type of the case, and writing and designing a test strategy formed by combining the required cases according to the test points;
the test strategy module is used for adding test strategies completed by the test case combination into test data, arranging the sequence of execution, configuring strategy groups which need to be repeatedly executed by service logic, and forming an executable test plan for the call of the test plan;
the test plan module is used for customizing an execution mode for the combined test strategy, putting the strategy manually triggered and executed by a user into a manual execution queue, designating a trigger condition for the strategy automatically triggered and executed, and customizing an execution plan table for the strategy regularly executed, thereby completing the definition of the automatic test;
the report module is used for summarizing and analyzing the test results to form a test report;
the configuration module is used for testing basic environment configuration, including supporting software information, testing architecture information and testing software information in the node machines, after the complete information of the node machines is configured, the node machines are automatically copied to complete quick new node machines according to the corresponding testing types when a new tested system is added, and a testing queue is quickly added to complete supporting of testing tasks;
the scheduling module is used for providing an interface for the test plan module, receiving the test plan information sent by the test plan module, analyzing the types of the test cases, publishing the test cases of different types into the corresponding test node machines, and taking charge of the response information receiving of the test node machines to generate an execution parameter list, so that the parameters required by the test cases of different types are shared, the execution sequence of the test cases is coordinated, and the execution of the different use cases executed on the different node machines is coordinated according to the sequence of the test plan;
and the test report module is used for collecting and analyzing the test report reported by the scheduling module according to the test execution.
Further, the login module is specifically implemented as follows: the user account is stored in a database in a symmetrical encryption mode, and the password is stored in an asymmetrical encryption mode; the method comprises the steps of dividing different user groups, distributing authorities according to information of the user groups, attributing users to the user groups, enabling one user to belong to a plurality of groups, enabling authorities of a plurality of groups of one user to be final authorities of the user after duplication removal, generating an authentication character string after user authentication and storing the authentication character string in a cache, wherein the validity period is 30 minutes, and enabling the last operation in the validity period to reset to be 30 minutes after the last operation, and calculating to expire.
Further, the test cases belong to the test policy, and the parameter transfer between the cases is to write the output of the previous case into the cache server to uniquely distinguish the test serial number from the policy number, and the subsequent test cases need to be acquired and used according to the test serial number and the policy number.
Further, after the test execution is completed, the report module writes test result data into a database, and then forms a test report HTML document according to the forms of the module, input, actual result and expected result from the database, stores the test report HTML document into a report catalog, and sends mail to personnel in a user group and trigger execution personnel.
Further, the configuration module stores the information into a configuration file in a file server, downloads configuration file information in a machine when deploying a new node machine, determines supporting software required by the node machine one by one according to the configuration file, generates parameters of the corresponding supporting software according to the configuration file information, and starts a monitoring program to complete service configuration of the node machine so as to be added into a service queue.
Further, the scheduling module monitors the running state of the node for executing the test through the link information in the test process, and after the test case is executed, a case step executing process document is formed and put into a test report; the scheduling module provides a registration interface of the node machine, adopts a tcp/ip protocol, registers information to the scheduling module after the node machine starts monitoring service, periodically detects the working state of the node machine, provides a test plan module call for a normal node machine, and sends abnormal information of the node machine to an administrator for reminding the administrator to troubleshoot the fault, so that the node machine for solving the fault is added into the execution queue again.
Further, the test report module generates a test report through comparing the expected result of the use case, wherein the test report comprises input data, an execution process, actual output data, comparison information with the expected result, machine conditions (such as CPU, GPU, memory, I/O use cases) and network flow information in the test process, further, the digitalized information is summarized into a report, an information graph in the process is drawn, an HTML type test report is generated, user group information belonging to a test plan is obtained, and test report mail is sent to members in the group to complete one test.
The invention issues different testing stages to different machines for testing, and simultaneously can support the coordinated execution of the test cases on different machines, judges that the output corresponding to the test input is compared with the expected result for completing the test, outputs the test report to the central server for summarizing and analyzing to form a complete test, and generates the test report to be sent to related personnel.
Aiming at the service characteristics at the present stage, the invention solves the difficulty of software testing, realizes a set of system for the automatic testing of the omnibearing software, can continuously and automatically complete the testing of the whole service flow, timely generate a report, inform relevant personnel of the testing result, comprehensively monitor the quality of project software, shorten the testing time, reduce misoperation or omission of personnel in the testing process, enlarge the testing depth and improve the project quality.
Drawings
FIG. 1 is a schematic diagram of a test flow of an automated test system according to the present invention.
Fig. 2 is a schematic diagram of a system application scenario of the present invention.
Detailed Description
In order to more particularly describe the present invention, the following detailed description of the technical scheme of the present invention is provided with reference to the accompanying drawings and the specific embodiments.
The specific implementation of the automatic test system comprises the following parts:
(1) An interfacial layer: the user operates the interface.
1.1 use case management: the test cases are placed in a file server (FTP, SVN, GIT can be selected by the file server, SVN is selected as the file server by the example system), when the cases are updated, a case association module is triggered, files in the file server are scanned, case information in the file server is associated to an automatic node machine test platform system, and the preservation of the cases is completed.
1.2 custom test plans: the test system adopts a B/S mode to realize interface management, combines the existing test cases in the system, customizes parameters, edits execution sequences, defines parallel and serial modules, and forms a test strategy to be stored in the system. The test strategy is combined according to the actual business flow, the execution mode is designated, the execution time is stored as a test plan list, and the system executes the test tasks in the test plan list according to the designated mode.
1.3 test configuration: the method comprises the steps that available use case execution machine-test node machines are configured, each node machine consists of different operating systems, a node machine for load execution UI test is WINDOWS, a node machine for load execution interface test and performance test is CENTOS, a node machine for load ANDROID mobile terminal equipment management is UBUNTU system, a node machine for load IOS mobile terminal equipment management is MACOS system, and available node machine information is configured into the system for the test use cases to be called according to different test types.
(2) Data exchange layer: and (5) controlling information exchange and use case data exchange.
And when the control information exchange is controlled in the scheduling module, a tester triggers or a timer triggers to execute the test plan, the management system uses the HTTP protocol to call the interface of the scheduling module to trigger the test, and the scheduling module uses the TCP/IP protocol to connect the test node machine to execute the test plan. The dispatching module comprises a standard HTTP protocol interface and is responsible for receiving external execution instructions, and the HTTP protocol interface is called by using an HTTP method to return a test result. The monitoring module in the node machine is responsible for monitoring in real time, receiving the execution instruction sent by the scheduling module, and after receiving the execution instruction, the node machine executes the instruction one by one to complete the test task and waits for the next test task. The data exchange between the node machine and the file server is to acquire the file through the file acquisition command provided by the file server, and store the file in a local disk for the test task to call. The node machine does not upload the file, delete the last left file in the catalog first every time, download the latest use case file from the file server, thus guarantee the real-time of use case updating.
(3) Interconnection layer: and the system is interconnected with the scheduling module, and the scheduling module is interconnected with the node machine.
Interconnection of the system and the scheduling module: the system adopts a B/S architecture, the system and the dispatching module are interconnected by adopting a standard http protocol interface, and the sending of the test task completes the receiving and sending of information by calling the http interface.
Interconnection between the scheduling module and the node machine: the node machine monitoring program is connected with the scheduling module by adopting TCP/IP protocol interconnection, receives a test instruction sent by the scheduling module, converts the test instruction into a command which can be executed by the node machine, executes the command one by one, and responds a test result to the scheduling module to complete a test task; the interconnection between the node machine and the file server is realized through SVN command, FTP command or GIT command.
The specific implementation flow of the invention is shown in figure 1, a user uploads test cases to a file server, an automatic node machine test platform goes to the file server to obtain case information, the case information is used as a user test strategy alternative set, and the user screens and arranges the test cases according to test requirements to form a test strategy and stores the test strategy; the user selects strategy execution, selects an applicable node machine according to the first case type, triggers the node machine to execute the case plan, downloads the test case according to the strategy, executes the test case, and reports the test result; triggering the next node machine to make a second test case according to a strategy after the first case is executed, and sending a test report to the members of the affiliated group and the personnel triggering the execution by an automatic node machine test platform in a mail mode after all the cases are executed; the implementation details of the specific links are as follows:
(1) Node machine:
the node machine is an environment machine for executing the test case, provides support (interface, UI, performance and safety test) for the execution of the test case, and at least one node machine for each type of test does not affect the test execution; the initialization environment of the node machine is completed by a configuration module; initializing a node machine, and restoring the test environment to an initial state for test case execution; the node machine is required to open monitoring service and receive a test platform instruction; the multiple instructions are sent to the node machine for queuing, which is based on the first-in first-out principle.
(2) And (5) use case storage:
the test cases are stored in the file in a mode that one file stores one test function case; uploading and storing the automatic test cases on the SVN, acquiring automatic test case names from the SVN catalog by the automatic node machine test platform, comparing the automatic test case names with information stored in the database, adding the newly added cases into the database, and setting the deleted cases as deleted in the record of the database; the list of test cases in the database is provided to the test strategy alternatives.
(3) Test report:
transmitting the test report to a shared designated position in an xml mode after the execution of one node machine is completed; asynchronously starting a test report analysis program, and acquiring concise information and recording the concise information into a test step; and integrating reports after all use cases in one strategy are executed, forming a test report HTML, and storing the test report HTML in a designated position.
(4) And (3) sending a test report:
after receiving a signal that the execution of the test strategy is completed, the automatic node machine test platform acquires personnel associated with the strategy and personnel triggering the test to form a mail receiver list; the mail content loads the test report generated after analysis and sends the test report to a mail receiver list.
(5) Monitoring service of node machine:
the node machine uses the port to monitor, uses the signature verification mode to receive the request sent by the trusted host, decrypts the character string after receiving the operation instruction character string of the host, uses the key word like the server to inquire about the specific execution content, downloads the execution content to the local, executes the test task one by one according to the test strategy in the execution content, and reports the execution result to the host after the completion.
When a plurality of different types of tests are involved in the test task, each node machine analyzes and completes the task which the home node should currently execute to perform execution processing according to the test strategy acquired from the host machine, and reports the execution result to the host machine. When the specified parameters need to be returned after the node machine finishes operation in the test strategy, the return parameters are reported to the test host together when the test is finished, so that the test host generates the test preconditions required by the next execution in the test strategy. The direct connection with the host adopts the interactive short link, so as to reduce the connection burden of the host, enable the host to drive a larger number of node computers, enable the node computers to jointly execute test tasks, enable the node computers to cooperatively work and enable the node computers to complete test tasks which are mutually called by different types of test tasks.
(6) The node machine and the host machine use mutual trust:
the method comprises the steps that a MAC inquiry interface is provided when a server is started, and the mutual trust between a node machine and a host machine is achieved through the fact that the server side which is requested when a monitoring program is started generates a signature character string through the MAC address and a connection identifier of the node machine and reports the signature character string to the server side through an MD5 algorithm, so that mutual trust is established.
(7) And (3) distributing a test strategy:
the tester combines the test cases into test cases according to test points, including functional interface functional point test, interface data test, performance test and safety scan; the test strategy comprises interface data input, clicking, responding to page verification, responding to data as interface test sending data, triggering interface test, and verifying interface response data.
(8) The file access mode is as follows:
use case template: and storing the components required by the interface test in a database, selecting the components required by the test by a user through writing a page by using examples, and arranging the sequences of the components according to the test logic to realize the expected test logic. The parameters required in the component are opened outwards by adding one or more input parameters, and one or more output parameters can be added for other components to call; storing the written use case file into a file server, and recording the stored file position and file name in a database for writing and calling the test strategy.
(9) And (3) storing a test strategy:
after the tester saves the written test cases, different test cases are combined into a test strategy according to the requirements of the service flow, and the test strategy is saved in a database, and the test service is distinguished by different names. The test strategy can be a single use case or a combination of a plurality of use cases. The test strategy can be executed in a plurality of batches, can be executed at a designated time according to the preset of a tester, and can be executed under a designated trigger condition, such as starting from a business scene.
(10) Test report:
after each test case is finished, a test report is generated and uploaded to a file server, and a database stores a report address and a report name; and after one test strategy is finished, synthesizing the test report generated by the test, analyzing and forming an integral test report, uploading the integral test report to a file server, and storing the test report name and the file path in a database.
(11) Test notification mail:
acquiring a triggering tester as a addressee, loading project group personnel in project configuration as a transcriber, and taking a testing strategy as a mail title; the attachment is a test report formed after the execution of the acquired current test strategy, mail content is the name of the passing case and the name of the failed case of the current test execution, and detailed steps of the failed case are listed for analysis by testers.
Taking the system application scenario as shown in fig. 2 as an example, the implementation process of the system of the present invention is further described by the following four groups of cases:
case 1:
writing a UI test case 1, a UI test case 2, a UI test case 3, a UI test case 4, a UI test case 5 and a UI test case 6, and uploading to a file server.
And writing a test strategy 1 by the automatic node machine test platform, executing the UI test case 2 in the strategy 1, then executing the UI test case 6, and storing.
Setting a test strategy 1 to run, optionally immediately running, running once at a designated time, and running multiple times at intervals of the designated time.
The automatic node machine testing platform receives the execution policy instructions to send the UI test case 2, the UI test case 1 and the UI test case 6 to the UI test node machine, triggers the UI node machine according to the policy 1 requirement, sequentially executes the test according to the UI test case 2, the UI test case 1 and the UI test case 6, and stores the test result to the appointed position.
After the execution is finished, the automatic node machine testing platform judges that all the tests are finished, obtains test result analysis test reports, and sorts the test reports into HTML documents, and the automatic node machine testing platform cuts in and sends the generated HTML documents to list personnel and personnel triggering the execution according to mail lists.
Case 2:
writing a UI test case 1, an interface test case 2, a performance test case 3, an interface test case 4, a UI test case 5 and a compatibility test case 6, and uploading the UI test case 1, the interface test case 2, the performance test case 3, the interface test case 4 and the compatibility test case 6 to a file server.
An automatic node machine test platform writes a test strategy 2, executes a UI test case 1, an interface test case 2, a performance test case 3, an interface test case 4, a UI test case 5 and a compatibility test case 6 in the strategy 2, and stores the UI test case 1, the interface test case 2, the performance test case 3 and the UI test case 5.
Setting a test strategy 2 to run, optionally immediately, running once at a designated time, and running multiple times at intervals of the designated time.
The automatic node machine test platform receives the requirement of the execution strategy 2 that the UI test case 2, the UI test case 1 and the UI test case 5 are issued to the UI test node machine, the interface test case 2, the interface test case 4 and the performance test node machine are issued, the performance test case 3 and the compatibility test case 6 are issued to the performance test node machine.
Triggering the UI test node machine to execute the UI test case 1 by the automatic node machine test platform according to the requirement of the strategy 2, storing the test result to the designated position, and notifying the automatic node machine test platform of the completion of the UI test case 1 execution.
After receiving the completion notification, the automatic node machine test platform triggers the interface test node machine to execute the interface test case 2 according to the policy 2 requirement, saves the test result to the designated position, and notifies the automatic node machine test platform that the execution of the interface test case 2 is completed.
After receiving the completion notification, the automatic node machine testing platform triggers the performance testing node machine to execute the performance testing case 3 according to the policy 2 requirement, saves the testing result to the designated position, and notifies the automatic node machine testing platform that the execution of the performance testing case 3 is completed.
After receiving the completion notification, the automatic node machine test platform triggers the interface test node machine to execute the interface test case 4 according to the policy 2 requirement, saves the test result to the designated position, and notifies the automatic node machine test platform that the execution of the interface test case 4 is completed.
After the automatic node machine testing platform receives the completion notification, triggering the UI testing node machine to execute the UI test case 5 according to the policy 2 requirement, storing the test result to the designated position, and notifying the automatic node machine testing platform that the UI test case 5 is completed.
After receiving the completion notification, the automatic node machine testing platform triggers the compatibility testing node machine to execute the compatibility testing case 6 according to the requirement of the strategy 2, saves the testing result to the designated position, and notifies the automatic node machine testing platform of the completion of the execution of the compatibility testing case 6.
After the execution is finished, the automatic node machine testing platform judges that all the tests are finished, obtains test result analysis test reports, and sorts the test reports into HTML documents, and the automatic node machine testing platform cuts in and sends the generated HTML documents to list personnel and personnel triggering the execution according to mail lists.
Case 3:
the node type mobile automatic test solution is introduced in the case, firstly, a mobile application program data processing script is written, and the script is integrated into a platform as a plug-in for general data acquisition and aggregation analysis in the execution process of the mobile automatic test case. The plug-in is mainly responsible for collecting information such as a CPU (Central processing Unit), a memory, power consumption, a log stack and the like of the mobile application program in the test execution process, and is associated with the execution action of the mobile automatic test case to perform aggregation analysis after the test is finished, and finally, the aggregation analysis report is provided for a user through the front end of the automatic node machine test platform; the method mainly comprises the following steps:
1. writing a mobile automatic test case, and uploading the test case to a file server;
2. writing a test strategy 3 by an automatic node machine test platform, executing an automatic test case in the strategy 3, and storing the strategy;
3. setting a test strategy 3 to run, optionally immediately running, running once in a designated time, and running for a plurality of times at intervals of the designated time;
4. the automatic node machine test platform receives the requirement of the execution strategy 3 to issue the automatic test cases and the mobile data monitoring scripts to the UI test node machine;
5. the automatic node machine test platform triggers the automatic test node machine to execute the test case according to the policy 3 requirement, calls the mobile application program data monitoring script at the same time when the test starts, monitors the data such as CPU, memory, power consumption, flow, log and the like of the mobile application program in the test process, and after the test is finished, the mobile application program test case execution result, the mobile application program occupies resources in the execution process, and the consumed power consumption and stack log report error information generated by program operation are aggregated and related to the specific test case, and notifies the automatic node machine test platform UI that the test case execution is finished.
After the execution is finished, the automatic node machine testing platform judges that all the tests are finished, obtains the execution results of the test cases, sorts the application program data log aggregation results into an HTML document, and cuts the generated HTML document into and sends the HTML document to list personnel and personnel triggering the execution according to the mail list.
Case 4:
the mobile node type mobile compatibility test solution is introduced by the case, firstly, a mobile equipment control processing script is written, the main function is to search test mobile phones connected to the node machine when an automatic node machine test platform starts a compatibility test task, then, test mobile phone groups are called in a multithreading mode to execute test cases and monitor test progress, after the execution of the test cases is completed, the result is output to the automatic node machine test platform, the script can be integrated into the automatic node machine test platform as a universal compatibility test plug-in unit, and a user needs to write the compatibility test cases according to own requirements, for example, an app is installed on each test mobile phone, then, a UI page is traversed and a screenshot is stored on each page. The automatic node machine test platform is responsible for scheduling and controlling the test execution process, the user is responsible for defining the test content, and finally, after the test is finished, the test result is reported to the automatic node machine test platform server and is provided for the user through the front end of the automatic node machine test platform with an intuitive and comprehensive mobile application program compatibility test analysis report; the method mainly comprises the following steps:
1. writing a compatibility test case, and uploading the compatibility test case to a file server;
2. writing a testing strategy 3 by an automatic node machine testing platform, and executing a compatibility testing case in the strategy 3;
3. the automatic node machine test platform receives the requirement of the execution strategy 3 to issue the compatibility test cases and the mobile equipment control processing scripts to the compatibility test node machine;
4. triggering the compatibility test node machine to start a mobile equipment control processing script according to the policy 3 requirement by the automatic node machine test platform, calling the compatibility test case by the script and executing, finally transmitting the information generated by screenshot and the test execution result to a server after the test is completed, notifying the automatic node machine test platform that the execution of the compatibility test case is completed, and cutting in and transmitting the generated HTML document to list personnel and personnel triggering the execution according to mail list by the automatic node machine test platform after the execution is completed.
The previous description of the embodiments is provided to facilitate a person of ordinary skill in the art in order to make and use the present invention. It will be apparent to those having ordinary skill in the art that various modifications to the above-described embodiments may be readily made and the generic principles described herein may be applied to other embodiments without the use of inventive faculty. Therefore, the present invention is not limited to the above-described embodiments, and those skilled in the art, based on the present disclosure, should make improvements and modifications within the scope of the present invention.
Claims (2)
1. A node-based automated test system, comprising:
the login module is used for providing a user login verification and authority verification function;
the test case module is responsible for the management of the user on the case, namely obtaining case information from a file server, designating the type of the node machine to be executed according to the type of the case, and writing and designing a test strategy formed by combining the required cases according to the test points;
the test strategy module is used for adding test strategies completed by the test case combination into test data, arranging the sequence of execution, configuring strategy groups which need to be repeatedly executed by service logic, and forming an executable test plan for the call of the test plan;
the test plan module is used for customizing an execution mode for the combined test strategy, putting the strategy manually triggered and executed by a user into a manual execution queue, designating a trigger condition for the strategy automatically triggered and executed, and customizing an execution plan table for the strategy regularly executed, thereby completing the definition of the automatic test;
the report module is used for summarizing and analyzing the test results to form a test report;
the configuration module is used for testing basic environment configuration, including supporting software information, testing architecture information and testing software information in the node machines, after the complete information of the node machines is configured, the node machines are automatically copied to complete quick new node machines according to the corresponding testing types when a new tested system is added, and a testing queue is quickly added to complete supporting of testing tasks;
the scheduling module is used for providing an interface for the test plan module, receiving the test plan information sent by the test plan module, analyzing the types of the test cases, publishing the test cases of different types into the corresponding test node machines, and taking charge of the response information receiving of the test node machines to generate an execution parameter list, so that the parameters required by the test cases of different types are shared, the execution sequence of the test cases is coordinated, and the execution of the different use cases executed on the different node machines is coordinated according to the sequence of the test plan;
the test report module is used for summarizing and analyzing the test report reported by the scheduling module according to the test execution;
the login module comprises the following specific implementation scheme: the user account is stored in a database in a symmetrical encryption mode, and the password is stored in an asymmetrical encryption mode; dividing different user groups, distributing authorities according to information of the user groups, attributing users to the user groups, wherein one user can be divided into a plurality of groups, the authority of one user is the final authority of the user after the authority of the plurality of groups is de-duplicated, the user generates an authentication character string after authentication and stores the authentication character string in a cache, the validity period is 30 minutes, and the last operation in the validity period resets the validity period to be 30 minutes after the last operation starts to be calculated and expires;
the test cases belong to a test strategy, the parameter transfer among the cases is to write the output of the previous case into a cache server so as to uniquely distinguish the test serial number from the strategy number, and the subsequent test cases need to be acquired and used according to the test serial number and the strategy number;
the report module writes test result data into a database after test execution is completed, and then forms test report HTML documents according to the forms of modules, inputs, actual results and expected results from the database, stores the test report HTML documents into a report catalog, and sends mails to personnel in a user group and trigger execution personnel;
the configuration module stores the information into a configuration file in a file server, downloads configuration file information in a machine when deploying a new node machine, determines supporting software required by the node machine one by one according to the configuration file, generates parameters corresponding to the supporting software according to the configuration file information, and starts a monitoring program to complete service configuration of the node machine so as to enable the node machine to be added into a service queue;
the scheduling module monitors the running state of the node for executing the test through the link information in the test process, and forms a case step execution process document and puts the case step execution process document into a test report after the test case is executed; the scheduling module provides a registration interface of the node machine, adopts a tcp/ip protocol, registers information to the scheduling module after the node machine starts monitoring service, periodically detects the working state of the node machine, provides a test plan module call for a normal node machine, and sends abnormal information of the node machine to an administrator for reminding the administrator to troubleshoot the fault so that the node machine for solving the fault is added into an execution queue again;
the test report module generates a test report through the expected result of the comparison example, wherein the test report comprises input data, an execution process, actual output data, comparison information with the expected result, machine condition and network flow information in the test process, further, digitalized information is summarized into a report, an information graph in the process is drawn, an HTML type test report is generated, user group information to which a test plan belongs is obtained, and a test report mail is sent to members in the group to complete one test.
2. The automated test system of claim 1, wherein: the system issues different testing stages to different machines for testing, meanwhile, can support the coordinated execution of test cases on different machines, judges that the output corresponding to the test input is compared with the expected result for completing the test, outputs a test report to a central server for summarizing and analyzing to form a complete test, and generates the test report to be sent to related personnel.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911082062.0A CN110928774B (en) | 2019-11-07 | 2019-11-07 | Automatic test system based on node type |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201911082062.0A CN110928774B (en) | 2019-11-07 | 2019-11-07 | Automatic test system based on node type |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN110928774A CN110928774A (en) | 2020-03-27 |
| CN110928774B true CN110928774B (en) | 2023-05-05 |
Family
ID=69852557
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201911082062.0A Active CN110928774B (en) | 2019-11-07 | 2019-11-07 | Automatic test system based on node type |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110928774B (en) |
Families Citing this family (42)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111625404B (en) * | 2020-04-21 | 2023-06-30 | 至誉科技（武汉）有限公司 | Method, system storage medium and electronic equipment for testing NVMe hard disk based on Jenkins |
| CN111611165B (en) * | 2020-05-22 | 2023-04-07 | 厦门理工学院 | Implementation and application of continuous integrated automatic test platform |
| CN111654416B (en) * | 2020-05-29 | 2021-12-24 | 北京智网信测科技有限公司 | Internet of things testing cloud platform and method |
| CN111770004B (en) * | 2020-06-26 | 2021-09-07 | 武汉众邦银行股份有限公司 | HTTP (hyper text transport protocol) (S) flow content automatic verification method and storage medium |
| CN111752844A (en) * | 2020-06-30 | 2020-10-09 | 北京来也网络科技有限公司 | An interface testing method, device, computing device and storage medium |
| CN111930608A (en) * | 2020-06-30 | 2020-11-13 | 成都九洲电子信息系统股份有限公司 | Automatic testing device and method based on process control |
| CN111813676A (en) * | 2020-07-08 | 2020-10-23 | 炬星科技（深圳）有限公司 | Robot software testing method, device and storage medium |
| CN112019544B (en) * | 2020-08-28 | 2022-10-11 | 支付宝(杭州)信息技术有限公司 | Network interface security scanning method, device and system |
| CN112100011A (en) * | 2020-08-31 | 2020-12-18 | 银清科技有限公司 | Performance test method and device |
| CN112015654B (en) * | 2020-08-31 | 2024-11-22 | 京东科技控股股份有限公司 | Method and apparatus for testing |
| CN112015661B (en) * | 2020-09-08 | 2023-10-03 | 南京云柜网络科技有限公司 | Software testing method and device |
| CN113760704B (en) * | 2020-09-16 | 2025-02-21 | 北京沃东天骏信息技术有限公司 | Web UI testing method, device, equipment and storage medium |
| CN112286806B (en) * | 2020-10-28 | 2023-10-03 | 成都佰维存储科技有限公司 | Automatic test method and device, storage medium and electronic equipment |
| CN112511386B (en) * | 2020-12-09 | 2022-07-26 | 爱瑟福信息科技(上海)有限公司 | Vehicle-mounted Ethernet test method and system based on robotframe and Ethernet test equipment |
| CN112631911A (en) * | 2020-12-22 | 2021-04-09 | 平安普惠企业管理有限公司 | Automatic testing method and device, computer equipment and storage medium |
| CN112560290A (en) * | 2020-12-29 | 2021-03-26 | 中国航空工业集团公司沈阳飞机设计研究所 | Automatic testing method and system based on countermeasure simulation platform |
| CN112835789A (en) * | 2021-01-15 | 2021-05-25 | 北京高因科技有限公司 | The Realization Technology of Automatic Testing in Automated Testing Framework |
| CN112783780A (en) * | 2021-01-28 | 2021-05-11 | 开放智能机器（上海）有限公司 | Automatic testing method and system for multi-environment multi-platform embedded system |
| CN114968754B (en) * | 2021-02-26 | 2025-03-18 | 华为云计算技术有限公司 | Application Programming Interface (API) Testing Method and Device |
| CN113051155A (en) * | 2021-03-11 | 2021-06-29 | 中国信息通信研究院 | Control system and control method of automatic test platform |
| CN113568791A (en) * | 2021-07-14 | 2021-10-29 | 麒麟软件有限公司 | Automatic testing tool and method for server operating system based on multi-CPU architecture |
| CN113568842B (en) * | 2021-08-19 | 2022-03-04 | 北京江融信科技有限公司 | Automatic testing method and system for batch tasks |
| CN113986731B (en) * | 2021-10-27 | 2025-03-21 | 深圳市同泰怡信息技术有限公司 | Product configuration information testing method, system, and computer equipment |
| CN114490329B (en) * | 2021-12-27 | 2024-06-14 | 成都鲁易科技有限公司 | Power consumption evaluation method and device of intelligent terminal, storage medium and terminal |
| CN114297074A (en) * | 2021-12-29 | 2022-04-08 | 腾云悦智科技(深圳)有限责任公司 | Method for realizing automatic testing of functions, interfaces and performances based on dynamic configuration |
| CN114629832B (en) * | 2022-03-17 | 2024-06-21 | 广州超云科技有限公司 | Remote automatic test method, system, electronic equipment and storage medium |
| CN114880240B (en) * | 2022-05-31 | 2024-06-21 | 成都秦川物联网科技股份有限公司 | Automatic test system and method for equipment of Internet of things, storage medium and equipment |
| CN115129593A (en) * | 2022-06-28 | 2022-09-30 | 浙江中控技术股份有限公司 | Automatic statistical analysis device and method |
| CN115145826A (en) * | 2022-07-22 | 2022-10-04 | 厦门市美亚柏科信息股份有限公司 | Full-process automatic testing method and system |
| CN115454815B (en) * | 2022-08-12 | 2023-09-26 | 广州极点三维信息科技有限公司 | Automatic test system supporting customized test tasks |
| CN115599666A (en) * | 2022-09-28 | 2023-01-13 | 北京新唐思创教育科技有限公司（Cn） | Automatic testing method, device, equipment and medium |
| CN115269358A (en) * | 2022-09-30 | 2022-11-01 | 中国信息通信研究院 | Performance test method, device, equipment and medium for block chain service node host |
| CN115941719B (en) * | 2022-10-17 | 2024-04-02 | 北京空间飞行器总体设计部 | A system and method for global real-time sharing of spacecraft test case execution information |
| CN115967613B (en) * | 2022-12-20 | 2024-10-01 | 广州骏伯网络科技有限公司 | A method, device, equipment and storage medium for adaptive page dialing alarm |
| CN116225944B (en) * | 2023-03-09 | 2024-05-07 | 矩阵时光数字科技有限公司 | A software testing system and method for pre-setting networking environment |
| CN116303041A (en) * | 2023-03-22 | 2023-06-23 | 展讯半导体(成都)有限公司 | Distributed testing method and system |
| CN116185881A (en) * | 2023-04-27 | 2023-05-30 | 杭州城市大数据运营有限公司 | Source system page change detection positioning method, device, equipment and storage medium |
| CN117076329B (en) * | 2023-10-12 | 2024-01-30 | 浙江云融创新科技有限公司 | Method and system for concurrent execution of use cases in service mutex state |
| CN117421153B (en) * | 2023-11-09 | 2024-05-28 | 哈尔滨市科佳通用机电股份有限公司 | Automatic testing system and method for railway wagon fault image recognition model |
| CN117520210B (en) * | 2024-01-05 | 2024-04-16 | 芯瞳半导体技术(山东)有限公司 | System software testing method, target machine and remote testing central control machine |
| CN118227506B (en) * | 2024-05-14 | 2024-08-02 | 浙江实在智能科技有限公司 | UI (user interface) automatic test system and method based on RPA (remote procedure alliance) robot |
| CN119690856B (en) * | 2025-02-21 | 2025-06-24 | 湖南速子文化科技有限公司 | Entity component system test system, method, storage medium and program product |
Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101727389A (en) * | 2009-11-23 | 2010-06-09 | 中兴通讯股份有限公司 | Automatic test system and method of distributed integrated service |
| CN102495799A (en) * | 2011-12-02 | 2012-06-13 | 刘伟 | Automatic test system and method of movable terminal |
| CN102932205A (en) * | 2012-11-19 | 2013-02-13 | 深圳市亚特尔科技有限公司 | Automatic test method and test platform of network server-side interface |
| CN104407971A (en) * | 2014-11-18 | 2015-03-11 | 中国电子科技集团公司第十研究所 | Method for automatically testing embedded software |
| CN104899134A (en) * | 2015-04-29 | 2015-09-09 | 中国互联网络信息中心 | Automatic domain name registration server testing system and method |
| CN107423211A (en) * | 2017-03-15 | 2017-12-01 | 中国互联网络信息中心 | A kind of SDNS interfaces automatization test system and method |
| CN107643981A (en) * | 2017-08-29 | 2018-01-30 | 顺丰科技有限公司 | A kind of automatic test platform and operation method of polynary operation flow |
| CN108132879A (en) * | 2017-12-21 | 2018-06-08 | 周舟 | Automated software testing method, platform, terminal and medium |
| CN109614310A (en) * | 2018-10-22 | 2019-04-12 | 中国平安财产保险股份有限公司 | Test interface management method, device, computer equipment and storage medium |
Family Cites Families (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20090199047A1 (en) * | 2008-01-31 | 2009-08-06 | Yahoo! Inc. | Executing software performance test jobs in a clustered system |
| US8625772B2 (en) * | 2009-12-22 | 2014-01-07 | Cyara Solutions Pty Ltd. | Integrated testing platform for contact centres |
| US11086765B2 (en) * | 2018-02-02 | 2021-08-10 | Jpmorgan Chase Bank, N.A. | Test reuse exchange and automation system and method |
-
2019
- 2019-11-07 CN CN201911082062.0A patent/CN110928774B/en active Active
Patent Citations (9)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101727389A (en) * | 2009-11-23 | 2010-06-09 | 中兴通讯股份有限公司 | Automatic test system and method of distributed integrated service |
| CN102495799A (en) * | 2011-12-02 | 2012-06-13 | 刘伟 | Automatic test system and method of movable terminal |
| CN102932205A (en) * | 2012-11-19 | 2013-02-13 | 深圳市亚特尔科技有限公司 | Automatic test method and test platform of network server-side interface |
| CN104407971A (en) * | 2014-11-18 | 2015-03-11 | 中国电子科技集团公司第十研究所 | Method for automatically testing embedded software |
| CN104899134A (en) * | 2015-04-29 | 2015-09-09 | 中国互联网络信息中心 | Automatic domain name registration server testing system and method |
| CN107423211A (en) * | 2017-03-15 | 2017-12-01 | 中国互联网络信息中心 | A kind of SDNS interfaces automatization test system and method |
| CN107643981A (en) * | 2017-08-29 | 2018-01-30 | 顺丰科技有限公司 | A kind of automatic test platform and operation method of polynary operation flow |
| CN108132879A (en) * | 2017-12-21 | 2018-06-08 | 周舟 | Automated software testing method, platform, terminal and medium |
| CN109614310A (en) * | 2018-10-22 | 2019-04-12 | 中国平安财产保险股份有限公司 | Test interface management method, device, computer equipment and storage medium |
Non-Patent Citations (2)
| Title |
|---|
| 自动化测试技术在联通cBSS计费系统中的应用;刘海峰;;数字通信世界(第10期);全文 * |
| 软件接口自动化测试技术研究与实现;叶波;孙俊若;林洁;;信息化研究(第04期);全文 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN110928774A (en) | 2020-03-27 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN110928774B (en) | Automatic test system based on node type | |
| US12206818B2 (en) | Automatically collected device problem information to route and guide users' requests | |
| CN107291565B (en) | Operation and maintenance visual automatic operation platform and implementation method | |
| US10467080B2 (en) | Systems and methods to reprogram mobile devices | |
| US20090307763A1 (en) | Automated Test Management System and Method | |
| CN105577475B (en) | Automated performance testing system and method | |
| WO2021203979A1 (en) | Operation and maintenance processing method and apparatus, and computer device | |
| US10489287B2 (en) | Conducting automated software testing using centralized controller and distributed test host servers | |
| US20200026640A1 (en) | Systems and methods for modular test platform for applications | |
| US11546206B2 (en) | Robotic process automation bot operational management system | |
| US20180329808A1 (en) | Conducting Automated Software Testing Using Centralized Controller And Distributed Test Host Servers | |
| CN111052776A (en) | Monitoring of Embedded Subscriber Identity Modules | |
| CN112733369A (en) | Intelligent equipment maintenance method, terminal and system and electronic equipment | |
| CN115357258B (en) | Application deployment method and device, storage medium and electronic device | |
| CN112749948A (en) | Information processing method and device for project management | |
| US8402125B2 (en) | Method of managing operations for administration, maintenance and operational upkeep, management entity and corresponding computer program product | |
| JP2016071398A (en) | Test execution device, test execution method, and computer program | |
| CN117520163A (en) | Application system management method, device, storage medium and electronic device | |
| US9294865B2 (en) | Enhanced system and method for custom programming of large groups of phones without requiring additional equipment | |
| CN116614323A (en) | Cloud storage enterprise network management method and system based on Rclone | |
| JP2016115182A (en) | Virtual equipment test device, virtual equipment test method and virtual equipment test program | |
| KR101550871B1 (en) | Method and system for Automation test system of the Telecommunication system using Smart phone | |
| CN111008116A (en) | A kind of timing snapshot characteristic testing method and system | |
| CN120743771A (en) | Device and method for automated software version iteration testing | |
| CN118984335A (en) | A script push method and system based on task center |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |