[go: up one dir, main page]

Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Testing with equivalent command lines #317

Open
myurkin opened this issue Mar 21, 2022 · 1 comment
Open

Testing with equivalent command lines #317

myurkin opened this issue Mar 21, 2022 · 1 comment
Labels
DevOps Testing, deployment, automation pri-Medium Worth assigning to a milestone
Milestone

Comments

@myurkin
Copy link
Member
myurkin commented Mar 21, 2022

We are already playing with a testing modality (tests/equiv), where ADDA is run with command lines that must lead to exactly the same outcome. Right now there are only a couple of specific tests (one to be merged soon - #315), so it is less general (sensitive) than the ones in #6. However, it is much simpler and more robust with respect to different compiler versions/modes. So the two (system-)testing modalities can complement each other.

The goal of this issues is to make a general framework for such equivalent testing. A general test script (python or bash), which will read one or several files with pairs of equivalent command lines. Can be similar to (tests/2exec) but simpler, requiring less special workarounds.

@myurkin myurkin added pri-Medium Worth assigning to a milestone DevOps Testing, deployment, automation labels Mar 21, 2022
@myurkin myurkin added this to the 1.6 milestone Mar 21, 2022
@myurkin
Copy link
Member Author
myurkin commented Mar 21, 2022

/cc @stefaniagl @palatni

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
DevOps Testing, deployment, automation pri-Medium Worth assigning to a milestone
Projects
None yet
Development

No branches or pull requests

1 participant