-
Notifications
You must be signed in to change notification settings - Fork 0
Description
Provide a command line option for selecting which test suite to run in a project. For example, if test/ contains two subdirectories, ui/ and db/, running racoltest --suite ui would only run the tests found under test/ui/.
If a project has lots of tests that take a while to run or produce a lot of output, this can help a user narrow down what needs to be done. This method naturally supports nested suites.
Additionally, for the purpose of raColTest, this can make meta testing very easy. Currently, this project produces a failed status report because it needs to test that it acts correctly when things fail. A meta test could run raColTest with the main tests, capture the stdout, and automatically detect failing or passing, as well as parsing the logfile and modify configuration options between tests safely.
May need to modify makefile and test_runner.cpp to recurse through test/ and testbin/ to get this working.
Classing as high priority as I consider this to be a milestone and it is a feature users would likely expect.
Classing as low effort. Changes needed to make this work are likely minimal.