Skip to content

Add support for suite selections #19

@racoltdev

Description

@racoltdev

Provide a command line option for selecting which test suite to run in a project. For example, if test/ contains two subdirectories, ui/ and db/, running racoltest --suite ui would only run the tests found under test/ui/.

If a project has lots of tests that take a while to run or produce a lot of output, this can help a user narrow down what needs to be done. This method naturally supports nested suites.

Additionally, for the purpose of raColTest, this can make meta testing very easy. Currently, this project produces a failed status report because it needs to test that it acts correctly when things fail. A meta test could run raColTest with the main tests, capture the stdout, and automatically detect failing or passing, as well as parsing the logfile and modify configuration options between tests safely.

May need to modify makefile and test_runner.cpp to recurse through test/ and testbin/ to get this working.

Classing as high priority as I consider this to be a milestone and it is a feature users would likely expect.
Classing as low effort. Changes needed to make this work are likely minimal.

Metadata

Metadata

Assignees

No one assigned

    Labels

    High priorityMultiple features rely on this, it is a milestone, or issue strongly effects end usersLow EffortUp to a few days of timeenhancementImprove or add new featurestodoPlanned implementation

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions