CN105407012A - Automatic test method and device - Google Patents

Abstract

The invention discloses an automated testing method and device, wherein the automated testing method includes: acquiring and parsing a first test case pre-stored in an xml file; executing the first test case to obtain a first return value, and judging the Whether the first return value meets the first preset requirement, and if so, determine that the test corresponding to the first test case passes. Compared with the prior art, the test case for realizing the test function is stored in the xml file in the present application, so that when testing, the test case in the xml file can be used to complete the test automatically, therefore, for the writing of the test case It only needs to be done once, and there is no need to manually input during testing, which reduces labor costs and avoids input errors that are easily caused by manual input during testing, thereby improving test accuracy.

Description

An automated testing method and device

technical field

The invention relates to the technical field of automated testing, and more specifically, to an automated testing method and device.

Background technique

With the in-depth development of information digitization, the demand for data storage is increasing, and network-based virtual storage technology has become a development trend. Among them, SAN (Storage Area Network and SAN Protocols, storage area network and its protocol) ) has become a storage system model that has been widely used in recent years due to its high performance and strong scalability.

The test for the FC protocol of the SAN is the basis for realizing its functions. The test method for the FC protocol in the prior art is usually manually input by the staff, and then the input command is executed to achieve the test purpose. However, this method requires high labor costs, and it is often difficult to avoid input errors during the manual input process, which leads to inaccurate test results.

To sum up, the FC protocol testing method for SAN in the prior art has the problems of high labor cost and low testing accuracy.

Contents of the invention

The purpose of the present invention is to provide an automatic testing method and device to solve the problems of high labor cost and low testing accuracy existing in the FC protocol testing method for SAN in the prior art.

In order to achieve the above object, the present invention provides the following technical solutions:

An automated testing method comprising:

Obtain and parse the first test case pre-stored in the xml file;

Executing the first test case to obtain a first return value, judging whether the first return value meets the first preset requirement, and if so, determining that the test corresponding to the first test case passes.

Preferably, the acquisition and parsing of the first test case pre-stored in the xml file includes:

Obtain the first test case pre-stored in the xml file;

The first test case is parsed into a test case that can be executed.

Preferably, it also includes:

If the first return value does not meet the first preset requirement, write the first return value and a reason for the first return value not meeting the first preset requirement into a log file.

Preferably, it also includes:

Obtain and parse the second test case input from the outside world;

Executing the second test case to obtain a second return value, judging whether the second return value meets the second preset requirement, if yes, then determining that the test corresponding to the second test case passes, if not, setting The second return value and the reason causing the second return value not meeting the second preset requirement are written into a log file.

Preferably, it also includes:

Output or write the execution process, return value, and test result corresponding to the execution of the first test case or the execution of the second test case into a log file.

An automated testing device, comprising:

The first processing module is used to obtain and analyze the first test case pre-stored in the xml file;

The first execution module is used to execute the first test case to obtain a first return value, determine whether the first return value meets the first preset requirement, and if so, determine the test corresponding to the first test case pass.

Preferably, the first processing module includes:

an acquisition unit, configured to acquire the first test case pre-stored in the xml file;

The parsing unit is configured to parse the first test case into a test case that can be executed.

Preferably, it also includes:

A recording module, configured to write the first return value and the reason why the first return value does not meet the first preset requirement to a log file if the first return value does not meet the first preset requirement middle.

Preferably, it also includes:

The second processing module is used to obtain and analyze the second test case input from the outside world;

The second execution module is used to execute the second test case to obtain a second return value, determine whether the second return value meets the second preset requirement, and if so, determine the test corresponding to the second test case If passed, if not, write the second return value and the reason why the second return value does not meet the second preset requirement into a log file.

Preferably, it also includes:

The output module is configured to output or write the execution process, return value and test result corresponding to the execution of the first test case or the execution of the second test case into a log file.

The present invention provides an automated testing method and device, wherein the automated testing method includes: acquiring and parsing a first test case pre-stored in an xml file; executing the first test case to obtain a first return value, and judging the Whether the first return value meets the first preset requirement, and if so, determine that the test corresponding to the first test case passes. Compared with the prior art, the test case for realizing the test function is stored in the xml file in the present application, so that when testing, the test case in the xml file can be used to complete the test automatically, therefore, for the writing of the test case It only needs to be done once, and there is no need to manually input during testing, which reduces labor costs and avoids input errors that are easily caused by manual input during testing, thereby improving test accuracy.

Description of drawings

In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the accompanying drawings in the following description are only It is an embodiment of the present invention, and those skilled in the art can also obtain other drawings according to the provided drawings on the premise of not paying creative efforts.

Fig. 1 is a flow chart of an automated testing method provided by an embodiment of the present invention;

Fig. 2 is a schematic structural diagram of an automatic testing device provided by an embodiment of the present invention.

detailed description

The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts belong to the protection scope of the present invention.

Please refer to Fig. 1, which shows a flow chart of an automated testing method provided by an embodiment of the present invention, which may include the following steps:

S11: Obtain and parse the first test case pre-stored in the xml file.

Among them, xml is an extensible markup language, which can be used to mark data and define data types, and is a source language that allows users to define their own markup language. The test cases in the xml file are implemented through xml.

S12: Execute the first test case to obtain the first return value, judge whether the first return value meets the first preset requirement, if yes, execute step S13, and if not, execute step S14.

Wherein, the first preset requirement can be determined by the staff according to actual needs. In addition, while including the test case, the xml may also include the expected test result after executing the test case, that is, the expected return value. Therefore, the first preset requirement may be to compare the first return value with the expected return value. When the two are consistent, it proves that the first return value meets the first preset requirement; Meet the first preset requirement.

S13: Determine that the test corresponding to the first test case passes.

S14: Determine that the test corresponding to the first test case fails.

In this application, the test case used to realize the test function is stored in the xml file, that is, an automated test script is adopted, so that when testing, the test case in the xml file can be used to automatically complete the test. Therefore, only the test case is written. It needs to be done once, and there is no need for manual input during testing, which reduces labor costs and avoids input errors that are easily caused by manual input during testing, thereby improving test accuracy.

At the same time, since no manual input is required for the completion of the test, an automatic testing method provided by the embodiment of the present invention can realize night testing and unmanned testing, and, for the same test case, it only needs to be written once, that is, the xml file The test case in can be used for multiple tests, which is different from manual input for the same test case every time the test case is used. Therefore, an automatic test method provided by this application can effectively avoid duplication of labor. Moreover, the manual input method mentioned in the background technology may change for each input of the same test case, but an automated test method provided by this application can ensure that the test cases used for multiple tests of the same test case Same, to further improve the test accuracy. In addition, the automated testing method provided by the present application can also effectively shield the underlying hardware, making it easier to operate and understand.

In the SAN based on the FC protocol, operations such as data storage and reading are realized through SCSI (SmallComputerSystemInterface, small computer system interface), and SCST is the SCSItarget middle layer subsystem, which provides a unified kernel access for the SCSItarget driver interface to simplify the design and development of SCSItarget drivers. Therefore, the test cases in the embodiments of the present application may all include the isanadm command for executing the scst command.

In an automated testing method provided in the above embodiment, it may also include:

If the first return value does not meet the first preset requirement, then write the first return value and the reason why the first return value does not meet the first preset requirement into the log file.

When the first return value part meets the first preset requirement, it means that the test has failed, and the reason why the first return value does not meet the first preset requirement is automatically analyzed, and the reason and the first return value are written into the log file, It can be checked by the staff at any time, so as to determine the cause of the failure of the test and make further improvements, so as to perform steps S11 to S14 again after the improvement until the test is passed.

In a kind of automated testing method provided by the foregoing embodiment, obtaining and parsing the first test case pre-stored in the xml file may include:

Obtain the first test case pre-stored in the xml file;

The first test case is parsed into a test case capable of being executed.

After the first test case is obtained, the first test case can be checked, and when it is found that the first test user does not meet the relevant requirements to be executed, that is, the first test case cannot be directly executed, the first test case needs to be parsed , so as to ensure that it can be executed normally, and ensure the smooth realization of an automated testing method provided by the embodiment of the present invention.

In an automated testing method provided in the above embodiment, it may also include:

Obtain and parse the second test case input from the outside world;

Execute the second test case to obtain the second return value, judge whether the second return value meets the second preset requirement, if yes, determine that the test corresponding to the second test case passes, if not, then pass the second return value and result The reason why the second return value does not meet the second preset requirement is written into a log file.

For the specific description related to the execution of the second test case, please refer to the relevant content of the execution of the first test case disclosed in the above embodiment.

It should be noted that, in some special cases, it is necessary to manually input test cases, and complete the testing of related functions through the manually input test cases. Usually, the purpose of manually inputting test cases is to realize the detection of the operating environment, so as to ensure the smooth realization of the above test steps. Therefore, in the automated testing method disclosed in the present application, not only the automated testing can be completed, but also the manual input testing can be completed under special circumstances, which improves the functions and makes the testing steps more flexible.

In an automated testing method provided in the above embodiment, it may also include:

Output or write the execution process, return value, and test result corresponding to the execution of the first test case or the execution of the second test case into a log file.

Outputting the execution process, return value and execution result of the first test case or the second test case can facilitate the staff to obtain the relevant information of this test in time, and the execution process of the first test case or the second test case, The return value and execution result are written into the log file, which can be used by the staff to query the information in the log file at any time when needed. Among them, the execution process can include some intermediate variables generated during the execution process, and the execution result is The result of whether the test is passed or not.

Corresponding to the above method embodiment, as shown in Figure 2, the embodiment of the present invention also provides an automated testing device, which may include:

The first processing module 21 is used to obtain and parse the first test case pre-stored in the xml file;

The first execution module 22 is configured to execute the first test case to obtain the first return value, judge whether the first return value meets the first preset requirement, and if so, determine that the test corresponding to the first test case passes.

In this application, the test case used to realize the test function is stored in the xml file, that is, an automated test script is adopted, so that when testing, the test case in the xml file can be used to automatically complete the test. Therefore, only the test case is written. It needs to be done once, and there is no need for manual input during testing, which reduces labor costs and avoids input errors that are easily caused by manual input during testing, thereby improving test accuracy.

In the automated testing device provided in the above embodiment, the first processing module may include:

an acquisition unit, configured to acquire the first test case pre-stored in the xml file;

The parsing unit is configured to parse the first test case into a test case that can be executed.

After the first test case is obtained, the first test case can be checked, and when it is found that the first test user does not meet the relevant requirements to be executed, that is, the first test case cannot be directly executed, the first test case needs to be parsed , so as to ensure that it can be executed normally, and ensure the normal operation of the automated testing device provided by the embodiment of the present invention.

In a kind of automated test device provided by the above-mentioned embodiment, can also include:

The recording module is configured to write the first return value and the reason causing the first return value not meeting the first preset requirement into a log file if the first return value does not meet the first preset requirement.

When the first return value part meets the first preset requirement, it means that the test has failed, and the reason why the first return value does not meet the first preset requirement is automatically analyzed, and the reason and the first return value are written into the log file, Can be viewed by staff at any time

In a kind of automated test device provided by the above-mentioned embodiment, can also include:

The second processing module is used to obtain and analyze the second test case input from the outside world;

The second execution module is used to execute the second test case to obtain the second return value, judge whether the second return value meets the second preset requirement, if yes, determine that the test corresponding to the second test case passes, if not, then Writing the second return value and the reason why the second return value does not meet the second preset requirement into the log file.

Therefore, through the automated testing device disclosed in the present application, not only the automated testing can be completed, but also the manual input testing can be completed under special circumstances, which improves the functions and makes the testing more flexible.

Moreover, each execution module in the automated testing provided by the above embodiments can communicate with other automated testing devices, thereby realizing distributed automated testing.

In a kind of automated test device provided by the above-mentioned embodiment, can also include:

The output module is used to output or write the execution process, return value and test result corresponding to the execution of the first test case or the execution of the second test case into a log file.

Outputting the execution process, return value and execution result of the first test case or the second test case can facilitate the staff to obtain the relevant information of this test in time, and the execution process of the first test case or the second test case , the return value and the execution result are written into the log file, which can be used by the staff to query the information in the log file at any time when needed. Among them, the execution process can include some intermediate variables generated during the execution process, and the execution result It is the result of whether the test is passed or not.

It should be noted that "first" and "second" appearing in the embodiments of the present invention are only for distinguishing different individuals, and do not have any practical meaning.

In addition, it should be noted that the related functions in the automated testing method and device provided by the embodiment of the present invention can be realized through xml:

1. The statement for setting the xml file can be:

#coding=utf-8

importxml.dom.minidom#Open xml document

dom=xml.dom.minidom.parse('abc.xml')#Get the document element object

root=dom.documentElement

bb=root.getElementsByTagName('caption')

b=bb[2]

printb.nodeName

bb=root.getElementsByTagName('item')

b=bb[1]

printb.nodeName

Among them, xml.dom.minidom.parse() is used to open an xml file, and the file object dom variable; documentElement is used to obtain the document element of the dom variable, and the document element is given to root; and corresponds to each node It has its nodeName, nodeValue and nodeType attributes, among them, nodeName is the node name, nodeValue is the value of the node (only valid for text nodes), nodeType is the type of the node; through root.getElementsByTagName('caption') What is obtained is a set of labels labeled caption, b[0] indicates the first label in the set, and b[2] indicates the third label in the set.

2. A common framework can be set up to easily manage the test cases in the xml file through the common isanadm, and provide access interfaces of these data structures for other modules. Among them, Isanadm is an executable command to execute scst, and the above setting statement can be:

(1) first enabletarget

isanadm --fc-enable_target

(2) Add device

Isanadm --fc --open_devDISK0-attributes filename=/dev/vg0101/lun0, scsi_id=1232, lu_id=1233

Check whether the addition is successful:

Isanadm-list_device

View device properties

Isanadm --fc-list_dev_attrDISK0

If the size of the added device changes, it needs to be synchronized:

Isanadm-resync_devDISK0

(3) Add group

Isanadm --fc-add_groupgroup_A

Check whether the addition is successful:

isanadm --fc --list_group

(4) Add lun to the group group

Isanadm --fc-add_lun0-groupgroup_A-deviceDISK0

Check whether the addition is successful:

Isanadm --fc-list_lun-groupgroup_A

(5) Add the initiator to the group group, the initiator is the wwn number of the client fiber card

Isanadm --fc-add_init21:00:00:0e:1e:09:94:a4-groupgroup_A

Check whether the addition is successful:

Isanadm --fc-list_init-groupgroup_A

(6) If the client fails to recognize the mapped disk

Isanadm --fc-Issue_lip

The above description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the general principles defined herein may be implemented in other embodiments without departing from the spirit or scope of the invention. Therefore, the present invention will not be limited to the embodiments shown herein, but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (10)

1. an automated testing method, is characterized in that, comprising:

Obtain and resolve the first test case be pre-stored within xml file;

Perform described first test case and obtain the first return value, judge whether described first return value meets the first preset requirement, if so, then determine that the test corresponding with described first test case is passed through.

2. method according to claim 1, is characterized in that, described acquisition also resolves the first test case be pre-stored within xml file, comprising:

Obtain the first test case be pre-stored within described xml file;

Described first test case is resolved to the test case that can be performed.

3. method according to claim 2, is characterized in that, also comprises:

If described first return value does not meet the first preset requirement, then described first return value and the reason that causes described first return value not meet the first preset requirement are written in journal file.

4. the method according to any one of claims 1 to 3, is characterized in that, also comprises:

Obtain and resolve extraneous the second test case inputted;

Perform described second test case and obtain the second return value, judge whether described second return value meets the second preset requirement, if, then determine that the test corresponding with described second test case is passed through, if not, then by described second return value and cause described second return value do not meet the second preset requirement reason write journal file in.

5. method according to claim 4, is characterized in that, also comprises:

Undertaken exporting or being written in journal file by performing described first test case or performing described second test case corresponding implementation, return value and test result.

6. an automatic test device, is characterized in that, comprising:

First processing module, for obtaining and resolving the first test case be pre-stored within xml file;

First Executive Module, obtaining the first return value for performing described first test case, judging whether described first return value meets the first preset requirement, if so, then determines that the test corresponding with described first test case is passed through.

7. device according to claim 6, is characterized in that, described first processing module comprises:

Acquiring unit, for obtaining the first test case be pre-stored within described xml file;

Resolution unit, for resolving to the test case that can be performed by described first test case.

8. device according to claim 7, is characterized in that, also comprises:

Logging modle, if do not meet the first preset requirement for described first return value, is then written to described first return value and the reason that causes described first return value not meet the first preset requirement in journal file.

9. the device according to any one of claim 6 to 8, is characterized in that, also comprises:

Second processing module, for obtaining and resolving extraneous the second test case inputted;

Second Executive Module, the second return value is obtained for performing described second test case, judge whether described second return value meets the second preset requirement, if, then determine that the test corresponding with described second test case is passed through, if not, then by described second return value and cause described second return value do not meet the second preset requirement reason write journal file in.

10. device according to claim 9, is characterized in that, also comprises:

Output module, for being undertaken exporting or being written in journal file by performing described first test case or performing described second test case corresponding implementation, return value and test result.