mirror of
https://github.com/openclaw/openclaw.git
synced 2026-08-21 18:08:05 -06:00
63b13ea837
* feat(qa): add crabline channel driver seam * feat: run crabline channel driver smoke * chore: keep crabline qa dependency dev-only * refactor(qa): keep crabline driver details opaque * chore(qa): pin crabline to merged driver API * feat(qa): drive channel driver from profiles * fix(qa): declare crabline runtime peer * feat(qa): resolve crabline channel from scenarios * feat(qa): treat unsupported profile channels as coverage gaps * Revert "feat(qa): treat unsupported profile channels as coverage gaps" This reverts commit 65a97016558705514a1c1ec74870de9b0a6e7886. * fix(qa): adapt crabline driver to chat sdk cli * refactor(qa): pass channel driver metadata directly * chore(qa): update crabline provider pin * chore(qa): default channel scenarios to driver * chore: repair qa dependency lockfile * chore: allow native qa dependency builds * fix(qa): satisfy crabline driver lint * fix(qa): satisfy crabline ci gates * Use crabline transport for smoke QA profile * fix(qa): keep crabline driver opt-in * fix(qa): reuse crabline telegram driver token * fix(qa): route smoke profile through crabline * fix(qa): run full smoke profile lane * fix(qa): remove smoke scenario workflow filter * fix: stabilize crabline smoke qa profile * fix: pin crabline qa dependency * test: keep crabline smoke credential-free * fix: skip visible reasoning lane for crabline smoke * fix: unblock crabline qa ci * Update crabline dependency * Pin crabline to merged main * Use Crabline fake provider servers
QA Scenarios
Seed QA assets for the private qa-lab extension.
Files:
scenarios/index.yaml- canonical QA scenario pack, kickoff mission, and operator identity.scenarios/<theme>/*.yaml- one runnable scenario per YAML file.frontier-harness-plan.md- big-model bakeoff and tuning loop for harness work.convex-credential-broker/- standalone Convex v1 lease broker for pooled live credentials.
Key workflow:
qa suiteis the executable frontier subset / regression loop.qa manualis the scoped personality and style probe after the executable subset is green.qa coverageprints the scenario coverage inventory from scenario YAML.
Operator workflows:
- Use the
openclaw-qa-testingskill for QA Lab live lanes, Convex credential pool operations, and WhatsApp live credential setup/replacement.
Keep this folder in git. Add new scenarios here before wiring them into automation.