Peter Steinberger
9213792cdf
refactor(qa): derive scenario runtime API from deps ( #119974 )
2026-08-06 08:40:53 -07:00
Vincent Koc
75e5c2694f
fix(qa): enforce scenario provider lane metadata ( #119908 )
...
Punchcard-Session: cobalt-valley-meadow-mg
2026-08-06 23:33:17 +08:00
Vincent Koc
f5add8197f
test(qa): provide Matrix module-flow fixture ( #119953 )
...
Punchcard-Session: cobalt-valley-meadow-mg
2026-08-06 21:56:41 +08:00
Dallin Romney
d6fc4a2a95
refactor(qa): make module flows implementation-aware ( #118069 )
2026-08-06 19:51:28 +08:00
Dallin Romney
8c64ca24b1
fix(qa): include pinned gateway restart in core runtime proof ( #118009 )
...
* fix(qa): run pinned gateway restart runtime pair
* fix(qa): run pinned pair before advisory report
2026-08-06 18:52:20 +08:00
w33d
2ea567972c
fix(diagnostics): attribute plugin LLM usage spans ( #107937 )
...
Emit usage once at the shared plugin completion boundary and expose host-derived plugin identity only on OTel usage spans. Preserve aggregate metric labels and cover the redacted Gateway path end to end.
Refs #98968
Co-authored-by: Vincent Koc <vincentkoc@ieee.org >
Co-authored-by: ZengWen-DT <ceng.wen@xydigit.com >
2026-08-06 16:55:53 +08:00
Onur Solmaz
1f10ef8050
fix(agents): recover once from critical tool loops ( #118647 )
...
* feat(agents): add bounded tool-loop recovery
* feat(agents): wire loop detection into batch recovery
* test(agents): cover bounded tool-loop recovery
* fix(agents): enforce loop thresholds within tool batches
* fix(agents): retain rejected loop batch evidence
* test(agents): update embedded session recovery fixture
* fix(agents): surface terminal loop recovery failures
* fix(agents): preserve loop recovery across retries
* fix(agents): isolate rejected loop evidence
* fix(agents): terminate native critical tool loops
* fix(agents): canonicalize tool loop actions
* fix(agents): preserve tool loop recovery guidance
* fix(agents): preserve code mode tool identity
* fix(agents): preserve prebatch loop evidence
* fix(agents): order native loop termination
* fix(agents): clean up rebased tool validation
* fix(agents): interrupt codex side turns on critical tool loops
* fix(agents): tighten loop recovery batch lifecycle
* fix(agents): drop unconsumed loop detector type export
* fix(agents): drop unconsumed loop relay exports
* test(agents): add agent subscribe to embedded session doubles
* fix(agents): scope critical loop recovery to embedded runs
2026-08-06 14:09:10 +08:00
Vincent Koc
7dcb1ad5ce
fix(qa): attest realized profile executions ( #119761 )
...
* fix(qa): attest profile execution plans
Persist the canonical profile membership partition and scheduler-owned expected and observed execution cells in QA evidence. Validate successful evidence completeness and bind the canonical plan digest into workflow manifests.
Punchcard-Session: silver-meadow-lantern-vx
* test(ci): exercise QA evidence artifact round trips
Punchcard-Session: silver-meadow-lantern-vx
* fix(qa): record only realized profile executions
Co-authored-by: Dallin Romney <dallinromney@gmail.com >
Co-authored-by: ruel225 <ruel225@users.noreply.github.com >
Punchcard-Session: silver-meadow-lantern-vx
* test(qa): type realized channel evidence
Punchcard-Session: silver-meadow-lantern-vx
---------
Co-authored-by: Dallin Romney <dallinromney@gmail.com >
Co-authored-by: ruel225 <ruel225@users.noreply.github.com >
2026-08-06 08:33:02 +08:00
Patrick Erichsen
678a3c18a9
fix(gateway): finish successful sessions after timestamp races ( #119752 )
...
* fix(gateway): correlate session lifecycle by run
* test(qa): expect settled handoffs to survive restart quietly
* test(agents): split embedded run persistence coverage
2026-08-05 17:24:12 -07:00
Vincent Koc
d3d25737cf
fix(qa): recognize portable Slack commentary lane ( #119698 )
...
Punchcard-Session: silver-meadow-lantern-vx
2026-08-06 07:18:12 +08:00
Vincent Koc
7b8bba26c9
fix(qa): report cleanup failures truthfully ( #119727 )
...
* fix(qa): report cleanup failures truthfully
Punchcard-Session: silver-valley-valley-dt
* fix(qa): satisfy cleanup runner static checks
Punchcard-Session: silver-meadow-lantern-vx
2026-08-06 05:16:35 +08:00
Vincent Koc
a3419d4a4b
fix(matrix): retire shared E2EE clients safely ( #119570 )
...
* fix(qa): bound Matrix E2EE client shutdown
Punchcard-Session: silver-valley-valley-dt
* fix(qa): drain Matrix decryptions before SDK shutdown
Punchcard-Session: silver-valley-valley-dt
* fix(matrix): retire shared E2EE clients safely
Punchcard-Session: silver-valley-valley-dt
* fix(matrix): satisfy lifecycle lint gate
Punchcard-Session: silver-valley-valley-dt
2026-08-06 01:14:31 +08:00
Peter Steinberger
b0d8dd3866
fix(qa): reject deleted replies and failed streaming outcomes ( #119660 )
2026-08-05 09:30:42 -07:00
Vincent Koc
ebae858817
fix(qa): restart after migration convergence
2026-08-05 23:43:07 +08:00
Peter Steinberger
e745c298a1
fix(qa): verify Matrix DM rooms really share or isolate their sessions ( #119663 )
...
* fix(qa): verify persisted Matrix room session identities
* test(qa): prove Matrix routing keys and transcript identities independently
* fix(qa): compare authoritative Matrix sender identities across drivers
2026-08-05 08:36:32 -07:00
Peter Steinberger
9bc2f455a5
fix(qa): preserve control UI policy across all suite runtimes ( #119656 )
2026-08-05 08:24:38 -07:00
Peter Steinberger
ce06e7924e
refactor(qa): consolidate scenario runtime helpers ( #119623 )
2026-08-05 08:01:58 -07:00
Peter Steinberger
74014c286d
fix(qa): select the scenario's required provider before its models ( #119491 )
...
* fix(qa): resolve scenario provider requirements before selection
* fix(qa): preserve validated scenario provider lane type
* test(qa): isolate provider lane selection regressions
* fix(qa): honor explicit scenario lanes in unified runtime suites
2026-08-05 05:53:02 -07:00
Peter Steinberger
4c94d9fb93
fix(qa): reject silent and out-of-character persona conversations ( #119497 )
...
* fix(qa): reject unanswered and unsafe character conversations
* fix(qa): propagate classified persona delivery failures
* fix(qa): keep qualitative persona evaluations on live providers
* test(qa): avoid inefficient persona failure table spread
2026-08-05 05:37:54 -07:00
Peter Steinberger
85fd4c9a02
fix(qa): preserve scoped native message and command identity ( #119499 )
2026-08-05 05:34:43 -07:00
Vincent Koc
a52b336f26
fix(qa): isolate Matrix wrong-key recovery accounts ( #119571 )
...
* fix(qa): isolate Matrix wrong-key recovery accounts
Punchcard-Session: silver-valley-valley-dt
* fix(qa): remove obsolete Matrix password guard
Punchcard-Session: silver-valley-valley-dt
2026-08-05 18:35:16 +08:00
Peter Steinberger
ccdfcdf993
fix(qa): retain child output on CLI timeouts ( #119524 )
2026-08-05 00:21:46 -07:00
Vincent Koc
ae54355087
fix(qa): preserve profile execution contracts ( #119519 )
...
Punchcard-Session: silver-valley-valley-dt
2026-08-05 15:07:40 +08:00
Peter Steinberger
702eb6eb57
fix(qa): prove newer session facts outrank competing durable memory ( #119496 )
...
* fix(qa): prove session memory outranks stale durable facts
* fix(qa): require the canonical memory search result window
* fix(qa): honor the optional canonical memory search limit
2026-08-04 23:34:46 -07:00
Jesse Merhi
95d7d95515
feat(tools): support batched tool search queries ( #118623 )
...
* feat(tools): support batched tool search queries
* fix(tools): harden batched tool search
* fix(tools): preserve batch search contracts
* fix(tools): bound batch search processing
* fix(tools): bound batch candidate metadata
* fix(tools): preserve callable batch candidates
* docs(tools): align batch search QA proof
* refactor(tools): isolate search request parsing
* test(qa): strengthen structured search proof
* test(qa): align structured directory proof
* fix(tools): preserve scalar search compatibility
* test(qa): disable batch scenario retries
* test(qa): allow direct-only tools in structured proof
* test(qa): verify nested catalog call result
* test(qa): remove obsolete result scanner
2026-08-05 16:28:10 +10:00
Peter Steinberger
f3186b0876
fix(qa): release parent parity transport before worker acquisition ( #119492 )
2026-08-04 23:23:41 -07:00
Peter Steinberger
cb3890b921
test(qa): isolate active memory request traces ( #119502 )
2026-08-04 23:08:31 -07:00
Peter Steinberger
046a6881bb
fix(qa): prove secret fixtures were read before redaction ( #119495 )
2026-08-04 23:00:32 -07:00
Peter Steinberger
a124966706
fix(qa): require a fresh response for memory recall ( #119493 )
2026-08-04 22:56:58 -07:00
Peter Steinberger
b3aab44f4b
fix(qa): keep live provider scenarios out of mock lanes ( #119498 )
2026-08-04 22:52:57 -07:00
Peter Steinberger
57122c965c
fix(qa): clean partial gateway startup and staged plugin roots ( #119494 )
2026-08-04 22:48:25 -07:00
Peter Steinberger
dc93ea6d69
fix(qa): follow durable finals after streamed previews ( #119378 )
...
* test(qa): isolate memory scenario evidence
* test(qa): follow durable progress completion
* test(qa): run doctor migration noninteractively
* test(qa): split active memory follow-up
* test(qa): wait for preview retirement
* test(qa): require ordered preview retirement
* test(qa): record ordered durable reply evidence
* test(qa): preserve durable delivery budgets
* test(qa): isolate durable lifecycle by account
* test(qa): scope durable reply assertions by account
* test(qa): preserve durable conversation identity
2026-08-04 22:29:15 -07:00
Peter Steinberger
b5d99c1f06
fix(qa): retry transport cleanup and always stop owned labs ( #119442 )
2026-08-04 20:31:28 -07:00
Peter Steinberger
b5237ac86a
fix(qa): preserve scenario isolation in serial suites ( #119439 )
2026-08-04 20:26:47 -07:00
Peter Steinberger
bf1bdb429e
fix(qa): require ready transport accounts ( #119431 )
2026-08-04 20:23:31 -07:00
Vincent Koc
9f8270dedc
fix(qa): stop zombie-only gateway process groups ( #119396 )
...
Punchcard-Session: amber-orchard-valley-s4
2026-08-05 10:07:28 +08:00
Vincent Koc
6a8e11e63c
fix(qa): repair release validation scenarios ( #119150 )
...
* fix(qa): repair parity and matrix media setup
Punchcard-Session: silver-valley-valley-dt
* test(qa): accept token-budgeted compaction suffix
Punchcard-Session: silver-valley-valley-dt
* test(qa): scope request diagnostics
Punchcard-Session: silver-valley-valley-dt
* test(qa): prove thread-memory causality
Punchcard-Session: silver-valley-valley-dt
* test(qa): configure Matrix image generation and fail fast
Punchcard-Session: silver-valley-valley-dt
* fix(qa): require memory get before thread recall
Punchcard-Session: silver-valley-valley-dt
* fix(qa): unify mock provider dispatch
Punchcard-Session: silver-valley-valley-dt
* fix(qa): repair Anthropic IDs and compaction causality
Punchcard-Session: silver-valley-valley-dt
* fix(qa): authenticate compaction wire causality
Punchcard-Session: silver-valley-valley-dt
* fix(qa): preserve Responses tool item identity
Punchcard-Session: silver-valley-valley-dt
* fix(qa): scope restart heartbeat proof
Punchcard-Session: silver-valley-valley-dt
* test(qa): assert causal traces before delivery
Punchcard-Session: silver-valley-valley-dt
* fix(qa): validate code mode completion evidence
Punchcard-Session: silver-valley-valley-dt
* test(qa): split causal catalog checks
Punchcard-Session: silver-valley-valley-dt
* style(qa): format matrix scenario tests
Punchcard-Session: silver-valley-valley-dt
2026-08-05 09:56:06 +08:00
Vincent Koc
fb81d03d8e
fix(commands): restore tool inventory for dynamic models ( #119306 )
...
* fix(qa): scale Telegram compact command timeout
* fix(qa): surface Telegram compact reply failures
Punchcard-Session: amber-workshop-river-yr
* fix(commands): prepare tool inventory model context
Punchcard-Session: amber-workshop-river-yr
* test(commands): type runtime context mock
Punchcard-Session: amber-workshop-river-yr
* docs(changelog): note tool inventory repair
Punchcard-Session: amber-workshop-river-yr
* chore(release): defer tool inventory note
Punchcard-Session: amber-workshop-river-yr
* fix(ci): lower environment variable budget
Punchcard-Session: amber-workshop-river-yr
2026-08-05 06:57:21 +08:00
Peter Steinberger
15499e7fc2
fix(qa): enable OpenAI for stored audio scenario ( #119349 )
2026-08-04 15:08:07 -07:00
Peter Steinberger
f15120c6d1
fix(qa): carry selected runtime into flow scenarios ( #119324 )
...
* fix(qa): carry selected runtime into flow scenarios
* test(qa): align compaction runtime fact assertion
2026-08-04 13:51:35 -07:00
Vincent Koc
aa07d55ec9
fix(qa): align release scenario setup and compaction proof ( #119188 )
...
* fix(qa): align release scenarios with runtime contracts
* fix(qa): retain inferred model provider plugins
* fix(qa): accept default OpenClaw compaction runtime
2026-08-05 03:32:49 +08:00
Vincent Koc
a54bec799c
fix(agents): observe native provider prompt egress ( #119219 )
...
* fix(agents): observe final provider prompt egress
* fix(agents): observe native provider prompt egress
* test(agents): type native prompt observer models
2026-08-04 22:46:07 +08:00
Vincent Koc
6d88ec5248
fix(agents): recover from invalid compaction summaries ( #119137 )
2026-08-04 19:43:25 +08:00
Vincent Koc
7aa3642f6d
test(qa): repair QA catalog integrity ( #119140 )
2026-08-04 15:28:02 +08:00
Vincent Koc
3ac7083213
improve(qa): cover vision channel offload ( #118862 )
...
* test(qa): cover vision channel offload
* test(qa): harden vision channel offload coverage
2026-08-04 14:57:03 +08:00
Vincent Koc
2ca01fb618
test(qa): prove overflow compaction pruning ( #119033 )
2026-08-04 12:15:11 +08:00
Peter Steinberger
cd50780d6a
fix(qa): provision ffmpeg for Playwright scenarios ( #119064 )
2026-08-03 19:40:39 -07:00
Vincent Koc
e29f692066
test(qa): repair scenario catalog baselines ( #119062 )
2026-08-04 10:21:04 +08:00
Vincent Koc
3bbc4ad085
test(qa): cover managed gateway service lifecycle ( #118855 )
2026-08-04 07:07:27 +08:00
Vincent Koc
c27fb940cf
test(qa): cover image generation task lifecycle ( #118915 )
2026-08-04 06:43:40 +08:00