KR102603330B1 - Apparatus and method for display the test coverage - Google Patents

Abstract

A test coverage display device according to the present invention includes a test execution unit that measures code coverage for source code, calculates a cumulative total of the number of covers for each code line based on the code coverage measured by the test execution unit, and calculates the cumulative total. It includes a storage unit that calculates and stores a step value corresponding to each code line, and a coverage display unit that displays each code line differently based on the step value stored in the storage unit. According to the present invention, users can more easily check test quality because visual differences in code coverage can be immediately confirmed.

Description

Test coverage display device and display method {APPARATUS AND METHOD FOR DISPLAY THE TEST COVERAGE}

The present invention relates to a test coverage display device and method that can immediately check the test amount of code by making a visual difference in code coverage.

Conventionally, during the program development process, users performed a process of checking the degree of test performance on the source code written to verify the program under development. For example, there is a possibility that a program may operate differently or inefficiently than the author intended due to mistakes in program design or unconsidered variables. When a program produces unwanted results, it is called a bug or program error. To prevent such bugs or program errors, a testing process is required when developing a program. A dynamic test device that numerically verifies whether a program has been sufficiently verified measures code coverage. Code coverage is a measure used to measure the quality of software testing, and refers to the rate at which the source code of one program has been tested. Therefore, code coverage is usually expressed as a percentage.

In other words, code coverage is the result obtained when a test is performed, and represents information about what code was performed by the test. When conducting unit tests for software, tests sometimes focus on the same unit (usually a function). Previously, methods were used to display the number of tests related to each function on the source code editor or to group tests by target function by placing a separate window. However, because this conventional method only considers the static test configuration state before the actual test is executed, there is a problem in that it is difficult to determine which part of the code has actually been tested a lot or which part has been tested relatively little. .

Korean Patent Publication No. 10-2165037 (registered on October 6, 2020)

The present invention was conceived in consideration of the above-mentioned problems, and the purpose of the present invention is to provide a test coverage display device and method that allows users to more easily check test quality by providing a visual difference in code coverage.

A coverage display device according to the present invention for achieving the above object includes a test performing unit that measures code coverage for source code; A storage unit that calculates a cumulative total of the number of covers for each code line based on the code coverage measured by the test execution unit, and calculates and stores a step value corresponding to the cumulative total for each code line; and a coverage display unit that displays each code line differently based on the step value stored in the storage unit.

In addition, the storage unit calculates the maximum accumulation number and minimum accumulation number by dividing into a standard targeting the entire code and a standard targeting code within the function, and calculates the step value based on the maximum accumulation number and minimum accumulation number. can be calculated.

And, the step value can be calculated using the formula below.

Step value=floor((N/maximum cumulative number)*accumulated number of corresponding lines) (where N is the total number of step values)

In addition, the step value includes a total of N steps, and the coverage display unit can give a different color to each of the N steps and display a color corresponding to the step value of each code line on the code line. there is.

In addition, the step value includes a total of N steps, and the coverage display unit can assign a different icon to each of the N steps and display an icon corresponding to the step value of each code line on the code line. there is.

In addition, it may further include an input unit for receiving a color or icon corresponding to the step value from the user.

Additionally, the coverage display unit may display differently only for code lines whose step value is greater than or equal to a preset threshold.

Meanwhile, a test coverage display method according to the present invention for achieving the above object includes a test performance step of measuring code coverage for source code; A storage step of calculating a cumulative total of the number of covers for each code line based on the code coverage measured by the test execution unit, and calculating and storing a step value corresponding to the cumulative total for each code line; and a coverage display step of displaying each code line differently based on the stored step value.

In addition, in the storage step, the maximum accumulation number and minimum accumulation number are calculated by dividing into a standard targeting the entire code and a standard targeting the code within the function, and the step is based on the maximum accumulation number and minimum accumulation number. The value can be calculated.

Additionally, the step value can be calculated using the formula below.

Step value=floor((N/maximum cumulative number)*accumulated number of corresponding lines) (where N is the total number of step values)

In addition, the step value includes a total of N steps, and the coverage display step assigns a different color to each of the N steps, and displays a color corresponding to the step value of each code line on the code line. You can.

In addition, the step value includes a total of N steps, and the coverage display step assigns a different icon to each of the N steps, and displays an icon corresponding to the step value of each code line on the code line. You can.

And, it may further include an input step of receiving a color or icon corresponding to the step value from the user.

Additionally, the coverage display step may be displayed differently only for code lines whose step value is greater than or equal to a preset threshold.

According to the test coverage display device and display method according to the present invention, a visual difference in code coverage can be immediately confirmed, allowing users to more easily check test quality.

1 is a block diagram showing the configuration of a test coverage display device according to the present invention.
Figure 2 is a flow chart explaining the process of setting step values in the test coverage display method according to the present invention.
Figure 3 is a diagram illustrating an embodiment of setting a step value in the test coverage display method according to the present invention.
4 to 6 respectively illustrate display methods according to various embodiments of the test coverage display method according to the present invention.

The detailed description of the present invention described below refers to the accompanying drawings, which show by way of example specific embodiments in which the present invention may be practiced. These embodiments are described in sufficient detail to enable any person skilled in the art to practice the invention. It should be understood that the various embodiments of the present invention are different from one another but are not necessarily mutually exclusive. For example, specific shapes, structures and characteristics described herein may be implemented in one embodiment or another without departing from the spirit and scope of the invention. Additionally, it should be understood that the location or arrangement of individual components within each disclosed embodiment may be changed without departing from the spirit and scope of the invention. Accordingly, the detailed description that follows is not intended to be taken in a limiting sense, and the scope of the invention is limited only by the appended claims, together with all equivalents to what those claims assert, if properly described. Similar reference numbers in the drawings refer to identical or similar functions across various aspects.

1 is a block diagram showing the configuration of a test coverage display device according to the present invention.

The test coverage display device 100 according to the present invention includes a test performance unit 110, a coverage display unit 120, and a storage unit 130.

The test performance unit 110 measures code coverage of the source code. The test performing unit 110 may use various conventional coverage measurement methods. The test performance unit 110 may include a developer PC, build server, or workstation. In addition, the test execution unit 110 is a device that is driven by a certain operating system and is capable of installing and editing software, and may include certain program modules or hardware. Code coverage is one of the indicators that indicates how sufficient the testing is when discussing software testing. In other words, how much of the code itself was executed when the software was tested? Therefore, the test progress results can include executing parts and non-executing parts, and the executing part of the entire code can be defined as code coverage.

The test execution unit 110 is responsible for overall control of the system to measure code coverage, and may include, but is not limited to, a source code analysis unit, a binary code analysis unit, and a command address analysis unit. Here, the source code analysis unit can generate source code analysis information. Here, the source code may be a program language such as C or C++, and the source code analysis unit includes a parser module, defines a class for the node for each component that makes up the source code, and data types of operators and operands. Information can be extracted to create nodes, and an abstract syntax tree (AST) can be created based on the generated nodes. Therefore, the generated source code analysis information may include abstract syntax tree information.

The binary code analysis unit can generate binary code analysis information about the binary code generated by building the source code. Specifically, the binary code analysis unit can generate binary code by building or compiling source code, and can generate binary code analysis information for the generated binary code. Here, the binary code analysis information may include address information of the binary code corresponding to the location of the source code (eg, coding line). Binary code analysis information may include binary code address information, instructions, and binary code generated by building the /home/pakjea/hw/demo/helloc source code.

The command address analysis unit may execute the copy binary code generated by copying the binary code to the embedded board to generate a command address and command address analysis information corresponding to the copy binary code. Specifically, the command address of the copy binary code executed on the embedded board is extracted by the command address extraction unit, the command address analysis unit receives the command address extracted by the command address extraction unit, and the command address for the received command address is extracted. Analysis information can be generated. The copy binary code is executed on the embedded board to generate a command address corresponding to the copy binary code, and the command address generated on the embedded board can be extracted by the command address extractor. Thereafter, the command address extracted by the command address extraction unit may be received by the command address analysis unit to generate command address analysis information. Here, the command address is information mapped to binary code address information, and the command address analysis information includes predetermined information mapped to some information (e.g., binary code and command) among the extracted command address and interpreted binary code analysis information. It could be information.

The test execution unit 110 measures the coverage of the source code using the source code analysis information, binary code analysis information, and command address analysis information. The test execution unit 110 uses the source code analysis information generated by the source code analysis unit, the binary code analysis information generated by the binary code analysis unit, and the command address analysis information generated by the command address analysis unit. You can measure the coverage of the code. Coverage of such source code may include total coverage information, which is information indicating the ratio of executed code among all source code, and change coverage information, which is information indicating the ratio of executed code among changed portions of the source code. Additionally, change coverage information may include change function coverage and change line coverage information.

The test execution unit 110 of the coverage display device 100 according to the present invention accumulates coverage for each test case. In other words, since the same code location can be performed by different test cases, the results of each independent test case are managed independently for the purpose of cumulative calculation of the number of coverages in the future, and the test is performed if the results can be calculated in accumulated form. The unit 110 may be operated in any manner. That is, the configuration and operation of the test performance unit 110 described above is only an example, and may be applied and modified in various ways using various conventional coverage measurement methods and configurations.

The storage unit 120 calculates a cumulative total of the number of covers for each code line based on the code coverage measured by the test execution unit 110, and calculates and stores a step value corresponding to the cumulative total for each code line. You can. Accordingly, the storage unit 120 may have a minimum computational function. In another embodiment, the storage unit 120 may include a predetermined operation unit (not shown) for calculating the step value. Meanwhile, the description above assumes that the step value calculation is performed in the storage unit 120, but the step value calculation is performed in the test performing unit 110 or a separate calculation unit (not shown), and the storage unit 120 performs the calculation. It is also possible to receive and store only the selected step values. In other words, the subject of step value calculation does not necessarily need to be the storage unit 120, but may be the test execution unit 110 or a separate module. Here, the description will be made assuming that the storage unit 120 calculates and stores the step value.

The storage unit 120 calculates the maximum and minimum accumulation counts by dividing them into standards targeting the entire code and standards targeting the code within the function, and calculates the step value based on the maximum and minimum accumulation counts. Calculate.

At this time, the step value can be calculated according to [Equation 1] below.

[Formula 1]

Step value=floor((N/maximum cumulative number)*accumulated number of corresponding lines)

(where N is the total number of step values)

The coverage display unit 130 may display each code line differently based on the step value stored in the storage unit 120. Specifically, when the step value includes a total of N steps, the coverage display unit 130 assigns a different color to each of the N steps and displays the color corresponding to the step value of each code line on the code line. .

In another embodiment, the coverage display unit 130 may assign a different icon to each of the N steps and display an icon corresponding to the step value of each code line on the code line. At this time, the color or icon corresponding to the step value may be preset in the system, but may also be designated by user input. In this case, it may further include an input unit (not shown) to receive user input.

In another embodiment, the coverage display unit 130 may display differently only for code lines whose step value is greater than or equal to a preset threshold.

Figure 2 is a flow chart explaining the process of setting step values in the test coverage display method according to the present invention. Specifically, the flow chart in FIG. 2 shows the processes performed in the test performance unit 110 and the storage unit 120 of the coverage display device 100 according to the present invention.

In order to separate and collect coverage for each test, each test is repeatedly performed (S210). The repeated performance of each test involves repeatedly performing the i test (S211), collecting the coverage of the i test (S212), and storing the i coverage result (S213).

Afterwards, when code coverage for the entire test is obtained, the cumulative number of covers for each code line is calculated. At this time, the calculated cumulative number is divided into a first standard targeting the entire code and a second standard targeting the code within the function, and the maximum cumulative number and minimum cumulative number are calculated.

Finally, the step value of the line is extracted for each criterion and stored in the storage unit 130 (S230).

Although not shown in the flow chart of FIG. 2, when the step value is stored (230), a coverage display step is performed to display each code line differently based on this, and the coverage display method is the operation of the coverage display unit 120 above. Since it is the same as , detailed description is omitted.

Figure 3 is a diagram illustrating an embodiment of setting a step value in the test coverage display method according to the present invention.

In the flow chart of FIG. 2, the cumulative count of each coverage, the overall code-based ranking, and the code-based ranking within the function derived by the cumulative count calculation step (S220) are as shown in FIG. 3.

As shown in Figure 3, the ranking based on the entire code can be known based on the cumulative number of coverages, and the ranking based on the code within the function can be known. The coverage display unit 120 according to the present invention can not only display each code line differently based on the ranking based on the entire code, but also display each code line differently based on the ranking based on the code within the function. It can be displayed.

Of course, each line of code can also be marked for identification based on both the overall code and the code within the function. For example, each code line is identified with a color based on the ranking based on the entire code, and at the same time, an icon is added to (added to, displayed) each code line based on the ranking based on the code within the function. Available. As another example, based on the ranking based on the entire code, each code line is identified with an icon, while at the same time, based on the ranking based on the code within the function, only code lines whose step value is above a preset threshold are colored or displayed. Discernment can be improved by displaying things differently, such as by changing the font.

The user can set whether to display coverage based on a ranking based on the entire code, a ranking based on the code within the function, or both. there is. The input unit (not shown) receives user input and transmits it to the coverage display unit 120, and the coverage display unit 120 may display coverage in various ways based on the user input.

4 to 6 respectively illustrate display methods according to various embodiments of the test coverage display method according to the present invention.

First, Figure 4 shows an example in which colors are divided into N levels and displayed according to the level values. As shown in FIG. 4, the coverage display unit 120 may display coverage by dividing colors into 7 levels, or may display coverage by dividing colors into 10 levels. Users can instantly see which parts of their code are being tested more based on the colors displayed in the coverage.

At this time, the color type or color classification level may be preset, but may also be selected through user input through an input unit (not shown).

Figure 5 shows a method of displaying different icons according to step values. In Figure 5, icons related to weather are displayed on one side of each line, but they may be changed to icons other than weather. Users can immediately see which parts of the code are being tested more based on the icons displayed on one side of each line.

Figure 6 shows a method of displaying so that only code lines that have been tested above a certain value can be identified. The coverage display unit 120 may display in a different way only code lines whose step value is greater than or equal to a preset threshold. Code lines exceeding a preset threshold may be displayed with a dotted or solid line as shown in FIG. 6, but as mentioned above, it is also possible to display them using colors or icons.

The various display methods shown in FIGS. 4 to 6 can be applied individually not only to the ranking of the entire code but also to the ranking of the code within the function, and thus the user can rank the code in the entire code and the code within the function. You can immediately check which parts of the code are being tested more and where the lines of code that have been tested more than a certain number of times (threshold) are located.

The test coverage display method according to various embodiments described above may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. A computer-readable recording medium may include program instructions, data files, data structures, etc., singly or in combination. Program instructions recorded on the medium may be specially designed and constructed for the present invention or may be known and usable by those skilled in the art of computer software. Examples of computer-readable recording media include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, and magnetic media such as floptical disks. -Includes optical media (magneto-optical media) and hardware devices specifically configured to store and execute program instructions, such as ROM, RAM, flash memory, etc. Examples of program instructions include machine language code, such as that produced by a compiler, as well as high-level language code that can be executed by a computer using an interpreter, etc. The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the present invention, and vice versa.

The test coverage display method according to the various embodiments described above may also be implemented in the form of a computer program or application executed by a computer stored in a recording medium.

Although the above description focuses on the embodiment, this is only an example and does not limit the present invention, and those skilled in the art will be able to understand the above examples without departing from the essential characteristics of the present embodiment. You will see that various modifications and applications are possible. For example, each component specifically shown in the embodiments can be modified and implemented. And these variations and differences in application should be construed as being included in the scope of the present invention as defined in the appended claims.

100: test coverage display device
110: Test performance unit
120: storage unit
130: Coverage display unit

Claims (14)

A test execution unit that measures code coverage of source code;
A storage unit that calculates a cumulative total of the number of covers for each code line based on the code coverage measured by the test execution unit, and calculates and stores a step value corresponding to the cumulative total for each code line; and
It includes a coverage display unit that displays each code line differently based on the step value stored in the storage unit,
The storage unit calculates the maximum and minimum accumulation counts by dividing them into a first standard targeting the entire code and a second standard targeting the code within the function, and based on the maximum and minimum accumulation counts, Calculate the step value,
The display unit identifies each code line by one of a color and an icon based on the step value based on the first standard, and simultaneously identifies each code line with the color and the icon based on the step value based on the second standard. A test coverage display device that distinguishes and identifies one from the other. delete According to paragraph 1,
A test coverage display device where the step value is calculated according to the formula below.
Step value=floor((N/maximum cumulative number)*accumulated number of corresponding lines)
(where N is the total number of step values) According to paragraph 1,
The step value includes a total of N steps,
A test coverage display device wherein the coverage display unit gives a different color to each of the N steps and displays a color corresponding to the step value of each code line on the code line. According to paragraph 1,
The step value includes a total of N steps,
A test coverage display device wherein the coverage display unit assigns a different icon to each of the N steps and displays an icon corresponding to a step value of each code line on the code line. According to clause 4 or 5,
A test coverage display device further comprising an input unit for receiving a color or icon corresponding to the step value from the user. According to paragraph 1,
A test coverage display device where the coverage display unit displays differently only for code lines where the step value is greater than or equal to a preset threshold. Performing tests to measure code coverage for source code;
A storage step of calculating a cumulative total of the number of covers for each code line based on the code coverage measured in the test performance step, and calculating and storing a step value corresponding to the cumulative total for each code line; and
A coverage display step of displaying each code line differently based on the stored step value,
In the storage step, the maximum accumulation count and minimum accumulation count are calculated by dividing into a first standard targeting the entire code and a second standard targeting code within the function, and based on the maximum accumulation count and minimum accumulation count. Calculate the step value,
The display step identifies each code line by either a color or an icon based on the step value based on the first standard, and at the same time identifies each code line with the color and the icon based on the step value based on the second standard. A way to display test coverage by identifying it with one of the icons. delete According to clause 8,
A test coverage display method where the step value is calculated using the formula below.
Step value=floor((N/maximum cumulative number)*accumulated number of corresponding lines)
(where N is the total number of step values) According to clause 8,
The step value includes a total of N steps,
In the coverage display step, a different color is given to each of the N steps, and a color corresponding to the step value of each code line is displayed on the code line. According to clause 8,
The step value includes a total of N steps,
In the coverage display step, a different icon is assigned to each of the N steps, and an icon corresponding to a step value of each code line is displayed on the code line. According to claim 11 or 12,
A test coverage display method further comprising an input step of receiving a color or icon corresponding to the step value from the user. According to clause 8,
A test coverage display method in which the coverage display step displays differently only for code lines whose step value is greater than or equal to a preset threshold.

Images