903308dbf2
fix: stabilize qa lab mock suite
2026-04-24 02:46:33 +01:00
d5b326523f
qa-lab: make live lanes CI-ready for v1 E2E automation ( #69122 )
...
* qa-lab: harden CI defaults and failure semantics for live lanes
* qa-lab: add unit tests for suite progress logging defaults
* qa-lab: cover malformed multipass summary edge cases
* qa-lab: share suite summary failure counting helper
* qa-lab: test allow-failures parse wiring and sanitize progress ids
* fix: note qa CI live-lane defaults in changelog (#69122 ) (thanks @joshavant)
2026-04-19 21:13:27 -05:00
bb7e9823a8
QA Lab: add provider registry
...
Move mock and live provider behavior behind provider-owned definitions so suite, manual, Matrix, and transport lanes share defaults, auth staging, model config, and standalone server startup.
Add AIMock as a first-class local provider mode while keeping mock-openai as the scenario-aware deterministic lane.
2026-04-16 21:24:59 -04:00
edfa074e0f
Tests: align pnpm test expectations with main ( #67001 )
...
Merged via squash.
Prepared head SHA: 29c80680538814856+hxy91819@users.noreply.github.com >
Co-authored-by: hxy91819 <8814856+hxy91819@users.noreply.github.com >
Reviewed-by: @hxy91819
2026-04-15 18:31:23 +08:00
fcee268373
feat(qa-lab): support scenario-defined plugin runs
2026-04-12 11:59:50 -07:00
000fc7f233
refactor(qa): add shared QA channel contract and harden worker startup ( #64562 )
...
* refactor(qa): add shared transport contract and suite migration
* refactor(qa): harden worker gateway startup
* fix(qa): scope waits and sanitize shutdown artifacts
* fix(qa): confine artifacts and redact preserved logs
* fix(qa): block symlink escapes in artifact paths
* fix(gateway): clear shutdown race timers
* fix(qa): harden shutdown cleanup paths
* fix(qa): sanitize gateway logs in thrown errors
* fix(qa): harden suite startup and artifact paths
* fix(qa): stage bundled plugins from mutated config
* fix(qa): broaden gateway log bearer redaction
* fix(qa-channel): restore runtime export
* fix(qa): stop failed gateway startups as a process tree
* fix(qa-channel): load runtime hook from api surface
2026-04-12 15:02:57 -03:00
4c14f55c62
test: parallelize QA suite scenarios
2026-04-10 13:45:57 +01:00
c27ee0af42
fix(qa-lab): use strong vm suffix entropy
2026-04-10 08:52:10 +01:00
c6d0baf562
qa-lab: use OpenClaw tmp dir for multipass staging
2026-04-10 00:09:48 +01:00
b88387e4c1
fix: harden qa multipass runner
2026-04-09 23:53:13 +01:00
445fe55331
fix: validate multipass output paths
2026-04-09 23:53:13 +01:00
def2eadb1d
feat: add multipass runner to qa suite
2026-04-09 23:53:13 +01:00
Peter Steinberger