Commit Graph

1421 Commits

Author SHA1 Message Date
Peter Steinberger 9213792cdf refactor(qa): derive scenario runtime API from deps (#119974) 2026-08-06 08:40:53 -07:00
Vincent Koc 75e5c2694f fix(qa): enforce scenario provider lane metadata (#119908)
Punchcard-Session: cobalt-valley-meadow-mg
2026-08-06 23:33:17 +08:00
Vincent Koc f5add8197f test(qa): provide Matrix module-flow fixture (#119953)
Punchcard-Session: cobalt-valley-meadow-mg
2026-08-06 21:56:41 +08:00
Dallin Romney d6fc4a2a95 refactor(qa): make module flows implementation-aware (#118069) 2026-08-06 19:51:28 +08:00
Dallin Romney 8c64ca24b1 fix(qa): include pinned gateway restart in core runtime proof (#118009)
* fix(qa): run pinned gateway restart runtime pair

* fix(qa): run pinned pair before advisory report
2026-08-06 18:52:20 +08:00
w33d 2ea567972c fix(diagnostics): attribute plugin LLM usage spans (#107937)
Emit usage once at the shared plugin completion boundary and expose host-derived plugin identity only on OTel usage spans. Preserve aggregate metric labels and cover the redacted Gateway path end to end.

Refs #98968

Co-authored-by: Vincent Koc <vincentkoc@ieee.org>
Co-authored-by: ZengWen-DT <ceng.wen@xydigit.com>
2026-08-06 16:55:53 +08:00
Onur Solmaz 1f10ef8050 fix(agents): recover once from critical tool loops (#118647)
* feat(agents): add bounded tool-loop recovery

* feat(agents): wire loop detection into batch recovery

* test(agents): cover bounded tool-loop recovery

* fix(agents): enforce loop thresholds within tool batches

* fix(agents): retain rejected loop batch evidence

* test(agents): update embedded session recovery fixture

* fix(agents): surface terminal loop recovery failures

* fix(agents): preserve loop recovery across retries

* fix(agents): isolate rejected loop evidence

* fix(agents): terminate native critical tool loops

* fix(agents): canonicalize tool loop actions

* fix(agents): preserve tool loop recovery guidance

* fix(agents): preserve code mode tool identity

* fix(agents): preserve prebatch loop evidence

* fix(agents): order native loop termination

* fix(agents): clean up rebased tool validation

* fix(agents): interrupt codex side turns on critical tool loops

* fix(agents): tighten loop recovery batch lifecycle

* fix(agents): drop unconsumed loop detector type export

* fix(agents): drop unconsumed loop relay exports

* test(agents): add agent subscribe to embedded session doubles

* fix(agents): scope critical loop recovery to embedded runs
2026-08-06 14:09:10 +08:00
Vincent Koc 7dcb1ad5ce fix(qa): attest realized profile executions (#119761)
* fix(qa): attest profile execution plans

Persist the canonical profile membership partition and scheduler-owned expected and observed execution cells in QA evidence. Validate successful evidence completeness and bind the canonical plan digest into workflow manifests.

Punchcard-Session: silver-meadow-lantern-vx

* test(ci): exercise QA evidence artifact round trips

Punchcard-Session: silver-meadow-lantern-vx

* fix(qa): record only realized profile executions

Co-authored-by: Dallin Romney <dallinromney@gmail.com>
Co-authored-by: ruel225 <ruel225@users.noreply.github.com>
Punchcard-Session: silver-meadow-lantern-vx

* test(qa): type realized channel evidence

Punchcard-Session: silver-meadow-lantern-vx

---------

Co-authored-by: Dallin Romney <dallinromney@gmail.com>
Co-authored-by: ruel225 <ruel225@users.noreply.github.com>
2026-08-06 08:33:02 +08:00
Patrick Erichsen 678a3c18a9 fix(gateway): finish successful sessions after timestamp races (#119752)
* fix(gateway): correlate session lifecycle by run

* test(qa): expect settled handoffs to survive restart quietly

* test(agents): split embedded run persistence coverage
2026-08-05 17:24:12 -07:00
Vincent Koc d3d25737cf fix(qa): recognize portable Slack commentary lane (#119698)
Punchcard-Session: silver-meadow-lantern-vx
2026-08-06 07:18:12 +08:00
Vincent Koc 7b8bba26c9 fix(qa): report cleanup failures truthfully (#119727)
* fix(qa): report cleanup failures truthfully

Punchcard-Session: silver-valley-valley-dt

* fix(qa): satisfy cleanup runner static checks

Punchcard-Session: silver-meadow-lantern-vx
2026-08-06 05:16:35 +08:00
Vincent Koc a3419d4a4b fix(matrix): retire shared E2EE clients safely (#119570)
* fix(qa): bound Matrix E2EE client shutdown

Punchcard-Session: silver-valley-valley-dt

* fix(qa): drain Matrix decryptions before SDK shutdown

Punchcard-Session: silver-valley-valley-dt

* fix(matrix): retire shared E2EE clients safely

Punchcard-Session: silver-valley-valley-dt

* fix(matrix): satisfy lifecycle lint gate

Punchcard-Session: silver-valley-valley-dt
2026-08-06 01:14:31 +08:00
Peter Steinberger b0d8dd3866 fix(qa): reject deleted replies and failed streaming outcomes (#119660) 2026-08-05 09:30:42 -07:00
Vincent Koc ebae858817 fix(qa): restart after migration convergence 2026-08-05 23:43:07 +08:00
Peter Steinberger e745c298a1 fix(qa): verify Matrix DM rooms really share or isolate their sessions (#119663)
* fix(qa): verify persisted Matrix room session identities

* test(qa): prove Matrix routing keys and transcript identities independently

* fix(qa): compare authoritative Matrix sender identities across drivers
2026-08-05 08:36:32 -07:00
Peter Steinberger 9bc2f455a5 fix(qa): preserve control UI policy across all suite runtimes (#119656) 2026-08-05 08:24:38 -07:00
Peter Steinberger ce06e7924e refactor(qa): consolidate scenario runtime helpers (#119623) 2026-08-05 08:01:58 -07:00
Peter Steinberger 74014c286d fix(qa): select the scenario's required provider before its models (#119491)
* fix(qa): resolve scenario provider requirements before selection

* fix(qa): preserve validated scenario provider lane type

* test(qa): isolate provider lane selection regressions

* fix(qa): honor explicit scenario lanes in unified runtime suites
2026-08-05 05:53:02 -07:00
Peter Steinberger 4c94d9fb93 fix(qa): reject silent and out-of-character persona conversations (#119497)
* fix(qa): reject unanswered and unsafe character conversations

* fix(qa): propagate classified persona delivery failures

* fix(qa): keep qualitative persona evaluations on live providers

* test(qa): avoid inefficient persona failure table spread
2026-08-05 05:37:54 -07:00
Peter Steinberger 85fd4c9a02 fix(qa): preserve scoped native message and command identity (#119499) 2026-08-05 05:34:43 -07:00
Vincent Koc a52b336f26 fix(qa): isolate Matrix wrong-key recovery accounts (#119571)
* fix(qa): isolate Matrix wrong-key recovery accounts

Punchcard-Session: silver-valley-valley-dt

* fix(qa): remove obsolete Matrix password guard

Punchcard-Session: silver-valley-valley-dt
2026-08-05 18:35:16 +08:00
Peter Steinberger ccdfcdf993 fix(qa): retain child output on CLI timeouts (#119524) 2026-08-05 00:21:46 -07:00
Vincent Koc ae54355087 fix(qa): preserve profile execution contracts (#119519)
Punchcard-Session: silver-valley-valley-dt
2026-08-05 15:07:40 +08:00
Peter Steinberger 702eb6eb57 fix(qa): prove newer session facts outrank competing durable memory (#119496)
* fix(qa): prove session memory outranks stale durable facts

* fix(qa): require the canonical memory search result window

* fix(qa): honor the optional canonical memory search limit
2026-08-04 23:34:46 -07:00
Jesse Merhi 95d7d95515 feat(tools): support batched tool search queries (#118623)
* feat(tools): support batched tool search queries

* fix(tools): harden batched tool search

* fix(tools): preserve batch search contracts

* fix(tools): bound batch search processing

* fix(tools): bound batch candidate metadata

* fix(tools): preserve callable batch candidates

* docs(tools): align batch search QA proof

* refactor(tools): isolate search request parsing

* test(qa): strengthen structured search proof

* test(qa): align structured directory proof

* fix(tools): preserve scalar search compatibility

* test(qa): disable batch scenario retries

* test(qa): allow direct-only tools in structured proof

* test(qa): verify nested catalog call result

* test(qa): remove obsolete result scanner
2026-08-05 16:28:10 +10:00
Peter Steinberger f3186b0876 fix(qa): release parent parity transport before worker acquisition (#119492) 2026-08-04 23:23:41 -07:00
Peter Steinberger cb3890b921 test(qa): isolate active memory request traces (#119502) 2026-08-04 23:08:31 -07:00
Peter Steinberger 046a6881bb fix(qa): prove secret fixtures were read before redaction (#119495) 2026-08-04 23:00:32 -07:00
Peter Steinberger a124966706 fix(qa): require a fresh response for memory recall (#119493) 2026-08-04 22:56:58 -07:00
Peter Steinberger b3aab44f4b fix(qa): keep live provider scenarios out of mock lanes (#119498) 2026-08-04 22:52:57 -07:00
Peter Steinberger 57122c965c fix(qa): clean partial gateway startup and staged plugin roots (#119494) 2026-08-04 22:48:25 -07:00
Peter Steinberger dc93ea6d69 fix(qa): follow durable finals after streamed previews (#119378)
* test(qa): isolate memory scenario evidence

* test(qa): follow durable progress completion

* test(qa): run doctor migration noninteractively

* test(qa): split active memory follow-up

* test(qa): wait for preview retirement

* test(qa): require ordered preview retirement

* test(qa): record ordered durable reply evidence

* test(qa): preserve durable delivery budgets

* test(qa): isolate durable lifecycle by account

* test(qa): scope durable reply assertions by account

* test(qa): preserve durable conversation identity
2026-08-04 22:29:15 -07:00
Peter Steinberger b5d99c1f06 fix(qa): retry transport cleanup and always stop owned labs (#119442) 2026-08-04 20:31:28 -07:00
Peter Steinberger b5237ac86a fix(qa): preserve scenario isolation in serial suites (#119439) 2026-08-04 20:26:47 -07:00
Peter Steinberger bf1bdb429e fix(qa): require ready transport accounts (#119431) 2026-08-04 20:23:31 -07:00
Vincent Koc 9f8270dedc fix(qa): stop zombie-only gateway process groups (#119396)
Punchcard-Session: amber-orchard-valley-s4
2026-08-05 10:07:28 +08:00
Vincent Koc 6a8e11e63c fix(qa): repair release validation scenarios (#119150)
* fix(qa): repair parity and matrix media setup

Punchcard-Session: silver-valley-valley-dt

* test(qa): accept token-budgeted compaction suffix

Punchcard-Session: silver-valley-valley-dt

* test(qa): scope request diagnostics

Punchcard-Session: silver-valley-valley-dt

* test(qa): prove thread-memory causality

Punchcard-Session: silver-valley-valley-dt

* test(qa): configure Matrix image generation and fail fast

Punchcard-Session: silver-valley-valley-dt

* fix(qa): require memory get before thread recall

Punchcard-Session: silver-valley-valley-dt

* fix(qa): unify mock provider dispatch

Punchcard-Session: silver-valley-valley-dt

* fix(qa): repair Anthropic IDs and compaction causality

Punchcard-Session: silver-valley-valley-dt

* fix(qa): authenticate compaction wire causality

Punchcard-Session: silver-valley-valley-dt

* fix(qa): preserve Responses tool item identity

Punchcard-Session: silver-valley-valley-dt

* fix(qa): scope restart heartbeat proof

Punchcard-Session: silver-valley-valley-dt

* test(qa): assert causal traces before delivery

Punchcard-Session: silver-valley-valley-dt

* fix(qa): validate code mode completion evidence

Punchcard-Session: silver-valley-valley-dt

* test(qa): split causal catalog checks

Punchcard-Session: silver-valley-valley-dt

* style(qa): format matrix scenario tests

Punchcard-Session: silver-valley-valley-dt
2026-08-05 09:56:06 +08:00
Vincent Koc fb81d03d8e fix(commands): restore tool inventory for dynamic models (#119306)
* fix(qa): scale Telegram compact command timeout

* fix(qa): surface Telegram compact reply failures

Punchcard-Session: amber-workshop-river-yr

* fix(commands): prepare tool inventory model context

Punchcard-Session: amber-workshop-river-yr

* test(commands): type runtime context mock

Punchcard-Session: amber-workshop-river-yr

* docs(changelog): note tool inventory repair

Punchcard-Session: amber-workshop-river-yr

* chore(release): defer tool inventory note

Punchcard-Session: amber-workshop-river-yr

* fix(ci): lower environment variable budget

Punchcard-Session: amber-workshop-river-yr
2026-08-05 06:57:21 +08:00
Peter Steinberger 15499e7fc2 fix(qa): enable OpenAI for stored audio scenario (#119349) 2026-08-04 15:08:07 -07:00
Peter Steinberger f15120c6d1 fix(qa): carry selected runtime into flow scenarios (#119324)
* fix(qa): carry selected runtime into flow scenarios

* test(qa): align compaction runtime fact assertion
2026-08-04 13:51:35 -07:00
Vincent Koc aa07d55ec9 fix(qa): align release scenario setup and compaction proof (#119188)
* fix(qa): align release scenarios with runtime contracts

* fix(qa): retain inferred model provider plugins

* fix(qa): accept default OpenClaw compaction runtime
2026-08-05 03:32:49 +08:00
Vincent Koc a54bec799c fix(agents): observe native provider prompt egress (#119219)
* fix(agents): observe final provider prompt egress

* fix(agents): observe native provider prompt egress

* test(agents): type native prompt observer models
2026-08-04 22:46:07 +08:00
Vincent Koc 6d88ec5248 fix(agents): recover from invalid compaction summaries (#119137) 2026-08-04 19:43:25 +08:00
Vincent Koc 7aa3642f6d test(qa): repair QA catalog integrity (#119140) 2026-08-04 15:28:02 +08:00
Vincent Koc 3ac7083213 improve(qa): cover vision channel offload (#118862)
* test(qa): cover vision channel offload

* test(qa): harden vision channel offload coverage
2026-08-04 14:57:03 +08:00
Vincent Koc 2ca01fb618 test(qa): prove overflow compaction pruning (#119033) 2026-08-04 12:15:11 +08:00
Peter Steinberger cd50780d6a fix(qa): provision ffmpeg for Playwright scenarios (#119064) 2026-08-03 19:40:39 -07:00
Vincent Koc e29f692066 test(qa): repair scenario catalog baselines (#119062) 2026-08-04 10:21:04 +08:00
Vincent Koc 3bbc4ad085 test(qa): cover managed gateway service lifecycle (#118855) 2026-08-04 07:07:27 +08:00
Vincent Koc c27fb940cf test(qa): cover image generation task lifecycle (#118915) 2026-08-04 06:43:40 +08:00