Suite Runs
This guide will go over understanding what a Suite Run is and how a Suite Run relates to the other bottest.ai concepts.
At its core, a Suite Run represents the combined execution of all Tests within a Suite, including each Test's multiple Variants and iterations. Similar to a Test Run, a Suite Run can have the following statuses:
- Pass: All Test Runs in the Suite Run received a Pass. This means all Evaluations passed.
- Fail: All Test Runs in the Suite Run received a Fail. This means all Evaluations failed.
- Mixed: The Test Runs in the Suite Run have a mixture of Pass, Fail, Mixed, or other statuses.
- Running: The Suite Run is currently running (or the results are still being parsed/evaluated)
- Stopped: The Suite Run was stopped manually before completing.
- Error: The Suite Run was stopped due to one or more errors during execution or evaluation.