Commit Graph

248 Commits

Author SHA1 Message Date
Peter Steinberger 7ed73f5383 test: broaden plugin install update coverage 2026-05-02 02:57:23 +01:00
Peter Steinberger bcd6499abd test: harden plugin update validation 2026-05-01 23:33:05 +01:00
Peter Steinberger 364ec53785 test(release): prefer GPT-5.5 smoke models 2026-05-01 21:45:03 +01:00
Peter Steinberger ed8f50f240 refactor: simplify plugin dependency handling
Simplify plugin installation and runtime loading around package-manager-owned dependencies, with Jiti reserved for local/TS fallback paths.

Also scans npm plugin install roots so hoisted transitive dependencies are covered by dependency denylist and node_modules symlink checks.
2026-05-01 21:32:22 +01:00
Peter Steinberger 70cd7927fb test(release): use stable OpenAI model for Parallels smoke 2026-05-01 20:34:27 +01:00
Vincent Koc dffc295a74 test(e2e): add upgrade survivor scenario probes 2026-05-01 01:18:11 -07:00
Vincent Koc 2500b5d4ec test(e2e): expand published upgrade survivor baselines 2026-05-01 01:18:11 -07:00
Josh Avant ce833acbdb test: strengthen published upgrade survivor lane (#75361)
* test: integrate upgrade survivor baseline controls

* test: gate published upgrade survivor path

* test: preserve upgrade survivor fixture contract

* test: keep upgrade survivor temp state off overlay
2026-04-30 21:50:36 -05:00
Peter Steinberger c0058fda2f test: add published upgrade survivor lane (#75221)
* test: add published upgrade survivor lane

* test: keep published upgrade exit chunk
2026-04-30 23:39:50 +00:00
Peter Steinberger 7beebc9afc test: add upgrade survivor package lane 2026-04-30 19:06:33 +01:00
Peter Steinberger a0fd105e5e ci: split plugin prerelease validation 2026-04-29 08:21:12 +01:00
Peter Steinberger fda8cc2a9d ci: keep heavy plugin sweeps release-only 2026-04-29 06:49:05 +01:00
Peter Steinberger 358b4f24cd test: guard broad plugin resolver fixtures 2026-04-29 06:46:02 +01:00
Peter Steinberger 1476e24af3 refactor(test): share bundled channel Docker harness helpers 2026-04-29 06:15:10 +01:00
Peter Steinberger 806a0119f3 ci(release): reuse live test Docker image 2026-04-29 05:25:42 +01:00
Patrick Erichsen 2a7ba582cb Use kitchen sink for ClawHub plugin E2E (#73821) 2026-04-28 16:44:38 -07:00
Vincent Koc 4509420dd4 test(qa): add gateway CPU scenario pack 2026-04-28 13:26:43 -07:00
Peter Steinberger 7f3dead335 perf: keep gateway cold paths out of startup 2026-04-28 02:50:32 +01:00
Peter Steinberger 39e3d8d31d ci: shard release validation reruns 2026-04-27 23:38:13 +01:00
Peter Steinberger 54e13d4910 ci: split release validation slow shards 2026-04-27 20:30:17 +01:00
Gustavo Madeira Santana dd1a94f089 docs(qa): reorg, audit against code, and refresh stale content
Reorg
- Rename the architecture page title to "QA overview" (slug stays
  /concepts/qa-e2e-automation so inbound links keep working).
- Move "Adding a channel to QA" + scenario-helper-name reference from
  testing.md into qa-e2e-automation.md under "Transport adapters". Architecture
  belongs with the architecture page.
- Drop the duplicate live-transport coverage table from testing.md; canonical
  copy stays in qa-e2e-automation.md under a new "Live transport coverage"
  heading so qa-matrix.md can deep-link to it.
- Slim testing.md QA-specific runners section to ops only, with cross-links.

Audit (against extensions/qa-lab/src/cli.ts, qa-channel/src/config-schema.ts,
and live-transport runtimes)
- qa-e2e-automation.md gains a "Command surface" table covering all 14
  openclaw qa <subcommand> forms; previously only ~7 of 14 were named.
- Document missing OPENCLAW_QA_TELEGRAM_CAPTURE_CONTENT and
  OPENCLAW_QA_DISCORD_CAPTURE_CONTENT env vars (Matrix already had it).
- Cross-link qa coverage from the Reporting section.
- qa-channel.md completes the config-key list (enabled, name, accounts,
  defaultAccount were missing from the schema doc) and pollTimeoutMs range.
- Drop stale "Follow-up work" framing in qa-channel.md (provider/model matrix,
  scenario discovery, orchestration) — all three already shipped.
- Replace "vertical slice" language with current behavior; fix misplaced
  debugger-UI paragraph.

Discoverability
- Add a Note callout to testing.md pointing at the three QA pages
  (QA overview, Matrix QA, QA channel) so maintainers landing on testing.md
  see the QA stack in the prologue.

Glossary entries for the renamed/new doc titles.
2026-04-27 13:40:11 -04:00
Peter Steinberger 98b441edb1 ci: split release docker integration chunks 2026-04-27 13:24:30 +01:00
Peter Steinberger cff1bdb491 ci: trim duplicate release package lanes 2026-04-27 13:15:10 +01:00
Peter Steinberger a0aedea63d fix: guard cli bootstrap imports 2026-04-27 11:24:35 +01:00
Peter Steinberger 98e7242b53 test: split ui unit tests from generic lane 2026-04-27 08:35:04 +01:00
Peter Steinberger a3fcb8db79 ci(docker): split bundled release lanes 2026-04-27 07:17:14 +01:00
Peter Steinberger 44a504cd39 ci: time-box package acceptance legacy compat 2026-04-27 07:11:14 +01:00
Peter Steinberger 45bdfb5f72 ci(docker): keep release path at three chunks 2026-04-27 06:39:46 +01:00
Peter Steinberger 5e9a96fafb ci(docker): reuse cached e2e images for reruns 2026-04-27 06:29:09 +01:00
Vincent Koc 05ebfa4146 docs(help+tools): batch convert prose callouts to Mintlify components
- testing-live: Tip components for model-discovery and authoritative-list guidance
- debugging: --dev flag Note and non-dev gateway stop Tip
- testing: narrowing live tests Tip
- tools/lobster: optional-plugin allowlist Note
- tools/acp-agents-setup: blockquote Important to Warning component
2026-04-26 22:01:55 -07:00
Peter Steinberger 6987132aed ci: add Matrix QA profiles 2026-04-27 05:43:14 +01:00
Peter Steinberger 02455c0c52 ci: include telegram in release package acceptance 2026-04-27 05:14:19 +01:00
Peter Steinberger cc79f4982c docs: explain telegram package artifact testing 2026-04-27 05:09:17 +01:00
Peter Steinberger 3c8760f16d fix: allow heavyweight docker lanes at low parallelism 2026-04-27 05:04:52 +01:00
Peter Steinberger 02d266c6c4 ci: split package acceptance refs 2026-04-27 04:39:19 +01:00
Peter Steinberger 76de167ca1 ci: add package acceptance workflow 2026-04-27 04:25:31 +01:00
Peter Steinberger 7ca2f9fed5 test(docker): align package harness image 2026-04-27 01:22:58 +01:00
Peter Steinberger 42db865673 test(docker): run observability on shared image 2026-04-27 00:49:36 +01:00
Vincent Koc 5d7c6e6bda test(docker): add observability smoke
Add Docker aggregate observability coverage for QA-lab OTEL and Prometheus diagnostics.
2026-04-26 16:43:56 -07:00
Peter Steinberger 998e37fcb3 ci: allow installer smoke baseline override 2026-04-27 00:31:30 +01:00
Peter Steinberger 89ab39ca64 test: simplify changed test routing 2026-04-26 23:58:13 +01:00
Peter Steinberger 2efc4a8233 docs(test): document docker e2e layout 2026-04-26 23:36:31 +01:00
Peter Steinberger d108110a89 ci: use packaged tarball for docker e2e 2026-04-26 23:10:33 +01:00
Peter Steinberger 6a00be5f90 fix(update): complete channel switch follow-up work 2026-04-26 11:38:44 +01:00
Peter Steinberger cd8187d7ce test(parallels): harden smoke agent model setup 2026-04-26 11:38:33 +01:00
Peter Steinberger 8a52c7b3d9 test: cover ClawHub plugin install uninstall 2026-04-26 11:28:18 +01:00
Peter Steinberger e40094a9ef test(browser): add CDP snapshot Docker smoke 2026-04-26 04:40:26 +01:00
Peter Steinberger 0ddbae171d test: cover codex app-server subagents 2026-04-26 03:46:30 +01:00
Peter Steinberger 87142b5fb1 test: narrow live Docker package script changes 2026-04-26 01:59:12 +01:00
Peter Steinberger 099d18f432 test: narrow live Docker ACP changed gate 2026-04-26 01:48:33 +01:00