test: improve live test progress feedback

This commit is contained in:
Peter Steinberger
2026-03-22 20:57:04 +00:00
parent 2a1acec6a7
commit 1efda3d041
3 changed files with 78 additions and 9 deletions

View File

@@ -130,6 +130,10 @@ Think of the suites as “increasing realism” (and increasing flakiness/cost):
- Prefer running narrowed subsets instead of “everything”
- Live runs will source `~/.profile` to pick up missing API keys
- API key rotation (provider-specific): set `*_API_KEYS` with comma/semicolon format or `*_API_KEY_1`, `*_API_KEY_2` (for example `OPENAI_API_KEYS`, `ANTHROPIC_API_KEYS`, `GEMINI_API_KEYS`) or per-live override via `OPENCLAW_LIVE_*_KEY`; tests retry on rate limit responses.
- Progress/heartbeat output:
- Live suites now emit progress lines to stderr so long provider calls are visibly active even when Vitest console capture is quiet.
- Tune direct-model heartbeats with `OPENCLAW_LIVE_HEARTBEAT_MS`.
- Tune gateway/probe heartbeats with `OPENCLAW_LIVE_GATEWAY_HEARTBEAT_MS`.
## Which suite should I run?