Commit Graph

51 Commits

Author SHA1 Message Date
Peter Steinberger f1bb7cd919 test(sdk): consolidate packed consumer evidence (#122001)
* test(sdk): consolidate packed consumer evidence

* test(qa): refresh scenario owner references

* test(qa): narrow script execution assertion
2026-08-11 04:18:20 -07:00
Vincent Koc 2e4683ba7f fix(qa): finish aggregate suites without shared cache races (#120816)
* fix(qa): bound parallel aggregate script runs

Punchcard-Session: amber-workshop-workshop-36
Co-authored-by: Dallin Romney <6581799+RomneyDa@users.noreply.github.com>

* test(tui): wait for adopted session frame

Punchcard-Session: amber-workshop-workshop-36

---------

Co-authored-by: Dallin Romney <6581799+RomneyDa@users.noreply.github.com>
2026-08-10 03:32:04 +08:00
Dallin Romney b5369f8e5d fix(qa): replace false Codex pin compatibility evidence (#118012)
* test(qa): replace synthetic Codex pin evidence

* test(qa): update core runtime-pair count

* test(qa): cover official Codex plugin drift

* test(qa): preserve frozen candidate scenario ids
2026-08-07 08:45:26 +08:00
Vincent Koc b4f01afa86 test(qa): cover Canvas agent and node controls (#119047)
* test(qa): cover Canvas agent and node controls

* fix(test): activate Canvas registry before gateway startup

* fix(test): align Canvas node proof with wire contract

* fix(test): narrow Canvas node invocation frames
2026-08-04 20:42:30 +08:00
Vincent Koc ee397f0c59 test(qa): prove ClawHub catalog discovery (#118934)
* test(qa): prove ClawHub catalog discovery

* test(qa): use shared temp cleanup
2026-08-04 09:07:35 +08:00
Vincent Koc 84d9e93dbb chore(qa): cover plugin testing harness contracts (#118933)
* test(qa): cover plugin testing harness contracts

* test(qa): narrow plugin harness tool factory
2026-08-04 09:07:27 +08:00
Vincent Koc 07a9856cce test(qa): cover ClawHub package compatibility (#118985) 2026-08-04 08:29:29 +08:00
Vincent Koc 2de88241a4 test(qa): prove packaged plugin lifecycle transitions (#118973) 2026-08-04 08:13:58 +08:00
Vincent Koc 1d446ad2cc fix(plugins): remove stale load paths during uninstall (#118930)
* test(qa): prove marketplace plugin updates

* fix(plugins): clean exact install load paths on uninstall

* fix(ci): register marketplace lifecycle assertions
2026-08-03 21:57:54 +00:00
Vincent Koc 972eb56ffe test(qa): cover bundled runtime discovery (#118922) 2026-08-03 21:57:42 +00:00
Vincent Koc 10b4baceb3 chore(clawhub): cover plugin release policy contracts (#118971)
* test(clawhub): cover plugin release policy contracts

* test(clawhub): route release checks to policy coverage
2026-08-04 05:55:35 +08:00
Vincent Koc 3ded8fba9b chore(qa): cover plugin tools activation (#118949) 2026-08-04 05:32:58 +08:00
Vincent Koc 42fd51d6c2 test(automation): cover plugin hook lifecycles (#118962) 2026-08-04 05:17:32 +08:00
Vincent Koc d29b9ad083 test(tasks): cover plugin-managed flows (#118919) 2026-08-04 04:51:00 +08:00
Vincent Koc dd656d973d test(qa): cover Plugin SDK import topology (#118878) 2026-08-04 03:33:52 +08:00
Vincent Koc 3c678acc17 test(qa): cover plugin authoring contracts (#118821)
* test(qa): cover plugin SDK entrypoint discovery

* test(qa): cover plugin manifest authoring

* test(qa): cover plugin package metadata
2026-08-03 18:31:14 +00:00
Dallin Romney 947886e764 fix(qa): align release harness contracts (#116812) 2026-08-01 13:24:10 +08:00
Peter Steinberger 3890a5efb6 fix(qa): restore current scenario source and documentation references (#113639)
Co-authored-by: Peter Steinberger <steipete@golden-gate.local>
2026-07-25 05:04:05 -07:00
Dallin Romney 19d17bc3c4 refactor(qa): canonicalize runtime-pair lanes (#112603) 2026-07-23 10:06:12 +09:00
Dallin Romney 132d91e427 refactor(qa): make taxonomy coverage ids unique (#110280) 2026-07-22 16:28:44 +09:00
Peter Steinberger 0a5c2d127f test(qa): acknowledge kitchen sink plugin trust (#110335) 2026-07-18 03:47:43 +01:00
Peter Steinberger 7b03a2ae20 test(qa): model non-assistant parity usage (#103650) 2026-07-10 12:12:28 +01:00
Dallin Romney 95e3b9243b test: execute media and Talk runtime boundaries (#101091)
* test: execute media and Talk runtime boundaries

* test(qa): centralize gateway fixture startup

* test(qa): check in voice call plugin fixture
2026-07-06 16:25:33 -07:00
Dallin Romney 9d68f877ac test(qa): run gateway and MCP scenarios over real transports (#99735) 2026-07-03 20:26:16 -07:00
Dallin Romney 3b4092dbaa test: add executable runtime fixture canaries (#99737)
* test(qa): add runtime fixture canaries

* test(voice-call): track fixture temp directories
2026-07-03 20:22:40 -07:00
Dallin Romney ab9e233d02 improve(qa): execute runtime scenarios through Docker (#99705)
* test(qa): run Docker runtime scenarios end to end

* test(qa): keep plugin lifecycle probe runtime-only
2026-07-03 18:13:28 -07:00
Dallin Romney 677c8ff846 improve: enforce canonical QA scenario ownership (#99628)
* improve: enforce canonical QA scenario ownership

* docs: refresh QA documentation map

* docs: condense QA ownership guidance

* docs: remove QA migration guidance

* refactor: simplify QA scenario ownership checks

* docs: align QA coverage authoring guidance
2026-07-03 15:51:18 -07:00
Dallin Romney fd3f354f46 test(qa): expand docker lane adapter (#97937)
* test(qa): expand docker lane adapter

* Extract QA Docker lane fixture
2026-06-29 17:08:43 -07:00
Dallin Romney 80a3c515fd test: add ClawHub release candidate QA proof (#97896)
* test: add ClawHub release candidate QA proof

* test: harden ClawHub release candidate evidence
2026-06-29 11:14:09 -07:00
Dallin Romney beab0ecb02 test: link ClawHub packaged plugin QA evidence (#97712)
* test: link ClawHub packaged plugin QA evidence

* test: narrow ClawHub QA primary links
2026-06-29 10:46:33 -07:00
Dallin Romney 78f7de01c1 test: link local e2e qa coverage wrappers (#97150) 2026-06-27 18:34:36 -07:00
Dallin Romney f29dbd3ebd test(qa): speed up smoke profile (#96340) 2026-06-24 09:30:59 -07:00
Dallin Romney 438f208a76 perf(qa-lab): speed up unified QA suites (#95944)
* perf(qa-lab): speed up smoke ci suite

* fix(qa-lab): satisfy suite scheduler lint

* fix(qa-lab): settle unified partitions before retry

* fix(qa-lab): preserve isolated suite safeguards

* refactor(qa-lab): make suite isolation explicit

* fix(qa-lab): preserve channel-driver suite serialization

* fix(qa-lab): narrow flow-only isolation metadata
2026-06-22 21:55:54 -07:00
Vincent Koc 495a4f9b8e test(qa): accept verified live fanout completions 2026-06-23 06:46:40 +02:00
Vincent Koc 54b2243de3 test(qa): tighten release profile scenario waits 2026-06-23 06:04:16 +02:00
Dallin Romney e12cf72b17 Standardize QA coverage IDs on dotted names (#94702)
* fix: standardize qa coverage ids

* test: avoid qa coverage id assertion spread
2026-06-18 17:25:26 -07:00
Dallin Romney 0a6736af09 test: fold lifecycle and package proof into QA Lab (#93114)
* test: fold script coverage into qa scenarios

* test: migrate script checks into qa e2e

* test: point qa code refs at migrated e2e

* test: fold plugin lifecycle probe into qa e2e

* test: use shared temp dirs in plugin lifecycle probe

* test: fold plugin lifecycle sweep into qa lab

* test: trim lifecycle docker text assertions

* test: keep followup script conversions split

* test: make lifecycle docker runner script-safe

* test: update changed helper routing expectation
2026-06-17 14:22:04 -07:00
Dallin Romney fef8394079 Convert QA scenarios to YAML files (#92915)
* refactor: load QA scenarios from YAML

* docs: update personal QA scenario docs

* test: keep QA scenarios YAML-only
2026-06-14 17:31:18 -07:00
brokemac79 de4b8d8ebf feat(plugins): allow installed trusted policy contracts
Allow explicitly enabled installed plugins to register declared trusted tool policies and agent tool result middleware, with trusted policy ids scoped by plugin owner.\n\nVerification covered targeted plugin/agent tests, typecheck, build, lint, local autoreview, and a Blacksmith Testbox runtime proof (tbx_01ktr1nq0rhq47fjkwrepm7fd3).
2026-06-10 16:18:23 +10:00
Vincent Koc 4550cfa6a7 fix(qa): run plugin MCP probes from repo root 2026-06-01 07:13:24 +02:00
Shakker 308fdbe7fb refactor: remove skill workshop plugin package 2026-05-30 20:04:52 +01:00
Vincent Koc 81c1892c9a fix(qa): stabilize mock QA scenario contracts 2026-05-27 10:06:08 +02:00
Vincent Koc 2547e35b0a test(qa-lab): add harness sentinel scenarios 2026-05-17 16:19:58 +08:00
Vincent Koc e2eb8e3cfe test(plugins): harden kitchen sink live gauntlet 2026-05-04 14:01:59 -07:00
Vincent Koc 1a4d55de43 test(plugins): split kitchen sink qa personalities (#74612) 2026-04-29 13:56:49 -07:00
Vincent Koc d95719d7c1 test(qa): widen kitchen sink turn budget 2026-04-29 02:29:01 -07:00
Vincent Koc abed3a056d test(qa): add kitchen sink plugin gauntlet 2026-04-29 02:29:01 -07:00
Peter Steinberger c742a706bf feat(plugins): add experimental skill workshop 2026-04-21 21:29:44 +01:00
Peter Steinberger 11e6575c69 test: add QA coverage scenarios 2026-04-21 03:53:23 +01:00
Gustavo Madeira Santana 3a1e469732 QA: track scenario coverage intent 2026-04-17 14:05:49 -04:00