Commit Graph

1338 Commits

Author SHA1 Message Date
Dallin Romney af77477a2a fix(qa): generated-image evidence waits despite successful delivery (#117799)
* fix(qa): observe generated images from outbound media

* fix(qa): preserve generated image producer evidence
2026-08-02 17:24:35 +08:00
Dallin Romney 652b0b96e2 qa: deduplicate producer and fallback evidence (#117806) 2026-08-02 17:20:32 +08:00
Peter Steinberger 0138f5b5e3 fix: stop lost cancellations, false success, and stuck Codex compaction (#117902)
* fix(inference): preserve cancellation, lifecycle, and Codex completion ownership

* test(qa): settle visible replies on the active channel transport
2026-08-02 02:03:57 -07:00
Peter Steinberger 80d1965810 test(qa): deduplicate runtime tool fixtures (#117827) 2026-08-01 22:05:55 -07:00
Peter Steinberger e98fdeefdf refactor(errors): consolidate message formatting (#117818) 2026-08-01 22:05:49 -07:00
Peter Steinberger 7c1d5dc7ef fix(inference): preserve run ownership and completion delivery (#117731) 2026-08-01 18:57:05 -07:00
Peter Steinberger ab8090e0d3 test(qa): deduplicate WhatsApp live transport fixtures (#117700) 2026-08-01 17:21:45 -07:00
Peter Steinberger a26df7153f test(qa): deduplicate mock provider fixtures (#117590) 2026-08-01 13:05:21 -07:00
Vincent Koc 263741b1f0 fix(ci): align release validation fixtures (#117494)
* fix(release): align beta 6 e2e fixtures

* fix(doctor): preserve missing state startup signal

* test(release): align beta e2e contracts

* test(agents): use canonical empty auth store

* test(agents): isolate prompt cooldown scheduling

* test(release): align main validation fixtures

* test(release): accept Code Mode plugin tool evidence

* fix(test): repair release validation checks

* test(cron): assert structured session targets
2026-08-02 00:39:36 +08:00
Peter Steinberger 568ea29d2e refactor(plugins): inherit shared package boundary settings (#117474) 2026-08-01 09:11:09 -07:00
Dallin Romney fa8774cc61 fix(qa): Slack progress lane misses successful delivery (#117391)
* fix(qa): verify Slack live delivery observations

* test(qa): update Slack scenario fixture contract

* fix: guard Slack QA proxy network boundary

* refactor: use shared capture for Slack QA observations

* refactor(qa): split Slack fallback evidence

* fix(qa): verify Slack commentary from native capture

* fix(slack): preserve debug capture with proxies

* fix(qa): narrow Slack commentary fallback

* fix(qa): observe successful Slack progress writes
2026-08-02 00:07:01 +08:00
Dallin Romney 56ffa2bca4 fix(qa): preserve Slack fallback evidence (#117420) 2026-08-01 21:31:41 +08:00
Dallin Romney 39cc0a3199 fix(qa): Matrix replies disappear after final replacement (#117390)
* fix(qa): preserve Matrix relations through replacements

* fix: honor Matrix replacement relation semantics

* fix(qa): reconcile late Matrix replacement targets

* test(qa): exercise Matrix recorder through public behavior
2026-08-01 21:27:15 +08:00
Dallin Romney fb9c8e74e6 fix(qa): keep Matrix SDK as QA Lab development dependency (#117392) 2026-08-01 20:59:04 +08:00
Peter Steinberger aa2a5c96f6 feat(channels): record account lifecycle facts and retire inferred health vocabularies (#117300)
* fix(channels): record account lifecycle facts

* fix(channels): bound recorded lifecycle grace

* fix(channels): preserve authored health state

* test: dedupe health snapshot type literal and fix spread order
2026-08-01 02:51:47 -07:00
Peter Steinberger b721cffa44 fix(inference): simplify lifecycle and preserve Codex tool identity (#117298) 2026-08-01 02:05:45 -07:00
Vincent Koc f5a8cb02ea test(release): repair full validation regressions (#116931)
* test(discord): mock thread delete listener

* test(qa): expect blocked update evidence

* test(telegram): preserve recovered context body

* fix(test): configure kitchen-sink personality

* test(browser): expect canonical staged upload paths

* test(browser): canonicalize macOS download roots

* test(feishu): seed legacy session rows offline

* test(telegram): isolate message context session stores

* test(qqbot): expect canonical media paths

* test(anthropic): match canonical transcript paths

* test(qa): expect canonical session store keys

* test(gateway): isolate rewind media reads

* test(release): review plugin child spawns

* test(plugins): expect process-stable manifest metadata

* test(google): retire usage telemetry contracts
2026-08-01 15:42:50 +08:00
Ahmed Tarek 730cf56915 fix(msteams): prevent duplicate final replies (#116398)
* fix(msteams): preserve message-tool thread routing

Co-authored-by: Vincent Koc <vincentkoc@ieee.org>

* test(msteams): prove thread-aware final dedupe

* fix(agents): suppress duplicate source previews

* fix(agents): dedupe current-source reply previews

---------

Co-authored-by: Vincent Koc <vincentkoc@ieee.org>
2026-08-01 15:32:56 +08:00
Dallin Romney 947886e764 fix(qa): align release harness contracts (#116812) 2026-08-01 13:24:10 +08:00
Dallin Romney 2261a9c5b4 test(qa): align fanout catalog with public evidence (#117202) 2026-08-01 13:07:18 +08:00
Dallin Romney 40f0847fc3 fix(qa): isolate Slack MPIM dedupe proof (#116843) 2026-08-01 12:56:10 +08:00
Dallin Romney f58570cb8c fix(qa): stabilize Slack progress and table proofs (#116847)
* fix(qa): stabilize Slack progress and table proofs

* fix(qa): type Slack invalid-blocks instrumentation
2026-08-01 12:55:39 +08:00
Dallin Romney bf32414a4a fix(qa): keep memory context proof on the QA channel (#116849)
* fix(qa): correct memory and Codex watchdog contracts

* test(qa): keep channel assertion in channel catalog
2026-08-01 12:53:00 +08:00
Peter Steinberger cb16d739cf fix(inference): harden Codex streaming, cancellation, and live QA (#116012)
* fix(inference): harden Codex turns, streams, and live QA

* fix(inference): dispatch open CR-delimited response frames

* fix(inference): finish live goal and split streaming regressions

* fix(codex): wait for interrupted turn completion

* fix(codex): narrow terminal collector notification ownership

* fix(inference): harden completion authority and lifecycle

* fix(inference): use canonical source delivery contract

* test(inference): align lifecycle probes with current main

* style(inference): format source delivery verification

* fix(goals): prevent premature completion across staged work

* fix(qa): settle streamed goal turns before continuation

* fix(goals): require visible replies after goal completion

* test(qa): keep goal flow regressions within lint limits
2026-07-31 21:29:33 -07:00
Peter Steinberger 7dd74db836 fix: preserve completion delivery and truthful agent session state (#117119) 2026-07-31 17:35:14 -07:00
Peter Steinberger 6d33976318 fix(qa): authenticate actual scenario execution evidence (#117004)
Co-authored-by: Peter Steinberger <steipete@macos.shared>
2026-07-31 13:03:12 -07:00
Peter Steinberger 80bbdeda1c fix(qa): verify requested scenarios and reject silent character runs (#116912)
* fix(qa): authenticate requested scenario test execution

* fix(qa): reject unanswered character evaluation runs

* refactor(qa): extract native vitest report validation

* fix(qa): require requested native test file to exist

---------

Co-authored-by: Peter Steinberger <steipete@macos.shared>
2026-07-31 09:18:05 -07:00
Peter Steinberger 2073371f80 fix(qa): preserve transport ownership and truthful reporting (#116911)
Co-authored-by: Peter Steinberger <steipete@macos.shared>
2026-07-31 09:00:44 -07:00
Harjoth Khara 102c2e1a64 fix(slack): recover MPIM thread context from outbound replies (#116660)
Co-authored-by: scoootscooob <167050519+scoootscooob@users.noreply.github.com>
2026-07-31 23:12:56 +08:00
Peter Steinberger 366a686cba fix(qa): authenticate producer and generated-media evidence (#116828)
Co-authored-by: Peter Steinberger <steipete@macos.shared>
2026-07-31 05:24:06 -07:00
Peter Steinberger 4d7d710c48 fix(qa-channel): enforce message and thread lifecycle ownership (#116801)
Co-authored-by: Peter Steinberger <steipete@macos.shared>
2026-07-31 04:56:07 -07:00
Peter Steinberger 4ec46e0ff1 fix(qa-lab): support groups and isolate thread timelines (#116803)
Co-authored-by: Peter Steinberger <steipete@macos.shared>
2026-07-31 04:54:03 -07:00
Peter Steinberger 82231b425b fix(qa-channel): isolate account evidence and exclude deleted messages (#116744)
* fix(qa): scope transport verdicts to visible account replies

* refactor(qa): remove obsolete outbound wait aliases

---------

Co-authored-by: Peter Steinberger <steipete@macos.shared>
2026-07-31 04:19:41 -07:00
Peter Steinberger 7ea4129227 fix(qa): authenticate summaries and bound native scenario commands (#116748)
Co-authored-by: Peter Steinberger <steipete@macos.shared>
2026-07-31 03:12:48 -07:00
Peter Steinberger 1f578f0e65 fix(telegram): validate native queue arguments before fallback (#116726)
Co-authored-by: Peter Steinberger <steipete@macos.shared>
2026-07-31 02:45:15 -07:00
Vincent Koc 37b1a71654 fix(release): unblock beta validation workflows (#116708)
* fix(release): repair beta validation workflow state

* fix(qa): dispatch yielded fanout runs without task tracking

* fix(test): honor GPT-Live shard opt-in
2026-07-31 15:47:11 +08:00
Dallin Romney 126933ba73 fix(qa): exceed Slack table aggregate limit in fallback probe (#116447) 2026-07-31 14:56:20 +08:00
Dallin Romney fa5ee0798b fix(qa): use built plugin tools server (#116442) 2026-07-31 14:49:24 +08:00
Dallin Romney 397fe272a0 fix(qa): stop waiting on yielded fanout runs (#116440)
* fix(qa): observe resumed fanout completions

* test(qa): keep runtime watchdog assertions in runtime suite
2026-07-31 14:36:59 +08:00
Dallin Romney b13b3d9a0f fix(qa): bound gateway log cleanup (#116431) 2026-07-31 14:23:36 +08:00
Dallin Romney 5c061507d3 fix(qa): align Slack progress scenarios with fresh finals (#116445)
* fix(qa): verify Slack progress drafts against fresh finals

* fix(qa): narrow Slack progress message identity
2026-07-31 14:22:24 +08:00
Dallin Romney 142e745372 fix(qa): avoid classifying fetched prose as tool failure (#116444)
* fix(qa): avoid classifying fetched prose as tool failure

* test(qa): keep tool result regression concise
2026-07-31 14:21:57 +08:00
Dallin Romney 2857eaa0f5 fix(qa): reset Matrix scenario streaming state (#116454) 2026-07-31 14:19:58 +08:00
Vincent Koc bc63c66988 fix(qa): keep Anthropic parity scenarios working in Code Mode
Route hidden QA capabilities through Code Mode and wait for fanout workers to settle before synthesis.
2026-07-31 13:53:34 +08:00
Patrick Erichsen 61cf4b9246 test(buzz): add live QA Lab channel lane (#116298)
* feat(buzz): add live QA runner

* ci(qa): add gated Buzz live lane

* docs(qa): document Buzz live testing

* fix(buzz): keep QA relay type private

* test(buzz): type QA suite mock

* fix(buzz): preserve racing QA reply relations

* fix(qa): harden Buzz credential redaction

* fix(buzz): ignore retained QA relay events

* fix(buzz): clean up observer setup failures

* test(buzz): return complete racing messages

* fix(buzz): default QA credentials to file

* fix(qa): validate pooled Buzz secrets

* fix(qa): redact structured Buzz auth tags

* fix(buzz): preserve QA credential env override

* fix(qa): redact inspected Buzz auth tags

* test(buzz): limit live QA to supported scenarios

* ci(qa): run Buzz lane in release checks

* fix(qa): require secure remote Buzz relays

* fix(qa): satisfy Buzz QA validation gates

* fix(qa): inject credential leasing into transport adapters
2026-07-30 17:44:27 -07:00
joshavant db4ad84d7f test(qa-lab): preserve Matrix fault proxy identity 2026-07-30 18:47:51 -05:00
joshavant dd4728305f test(qa-lab): use upload-safe Tuwunel fixture 2026-07-30 14:57:44 -05:00
joshavant fe654eaacd test(qa-lab): refresh Matrix Tuwunel fixture 2026-07-30 14:57:44 -05:00
Vincent Koc 0822e8d39e fix(qa): preserve missing Ollama cache telemetry (#116424) 2026-07-30 16:37:54 +00:00
Dallin Romney 424c36a2d5 fix(qa): prevent Slack cleanup from stalling profile runs (#116361)
* fix(qa): release Slack leases after gateway stop

* fix(qa): preserve async Slack cleanup contract

* fix(qa): expose post-gateway adapter cleanup
2026-07-30 19:05:49 +08:00