Test Runs
This guide will go over understanding what a Test Run is and how a Test Run relates to the other bottest.ai concepts.
At its core, a Test Run represents a single execution of a Test, including multiple Variants and iterations. A Test Run can have the following statuses:
- Pass: All Evaluations in the Test Run received a Pass.
- Fail: All Evaluations in the Test Run received a Fail.
- Mixed: Some Evaluations in the Test Run are Pass and some are Fail.
- Skipped: The Test was configured to not be included in a Suite Run before the Suite Run was executed.
- Running: The Test Run is currently running (or the results are still being parsed/evaluated).
- Stopped: The Test Run was stopped manually before completing.
- Error: The Test Run was stopped due to one or more errors during execution or evaluation.
A Test Run can be a part of a Suite Run (if the user decides to run a Suite), or individually. Test Runs won't show up in Analytics or Reports (except for the Usage data) if they were ran individually.