f453904165
feat: add fal and OpenRouter music generation ( #82789 )
...
* feat: add fal and OpenRouter music generation
* fix: repair music generation CI gates
* chore: refresh proof gate
2026-05-17 02:05:22 +01:00
fd8afc1dce
refactor: unify async media generation
...
Summary:
- Refactor image/music/video generation onto the shared async media-generation scheduler and task lifecycle.
- Make session-backed image generation async with status, duplicate guarding, active-task prompt context, and message-tool completion delivery.
- Update docs/changelog and add /tasks coverage for image-generation task visibility.
Verification:
- Codex review: no accepted/actionable findings.
- pnpm test src/auto-reply/reply/commands-tasks.test.ts src/agents/tools/image-generate-tool.test.ts src/agents/tools/image-generate-background.test.ts src/agents/image-generation-task-status.test.ts -- --reporter=dot
- Previous focused media suite: 12 files / 169 tests passed.
- Crabbox aws check:changed run run_fbd1b62c7472 passed.
- Crabbox aws live openclaw infer run run_c17929e0e224 passed with OpenAI gpt-image-2.
- GitHub CI for rebased head 74d1cda6a6
2026-05-16 22:50:06 +01:00
1a956b6ba1
fix: require message tool for generated media completions
2026-05-16 20:12:42 +01:00
5c87b692cb
feat(openrouter): add inbound audio STT support
2026-05-12 06:50:12 +01:00
24853ced11
docs: outline unified talk API
2026-05-06 02:39:15 +01:00
123f7a697d
docs: update video generation timeout notes
2026-05-05 06:47:07 +01:00
6c8974f3f5
fix: harden async media completion delivery
2026-05-05 06:13:33 +01:00
2d8fa23447
fix(agents): mediate async media completions
2026-05-05 01:42:50 +01:00
17ef9ef895
feat(openrouter): add video generation provider ( #72700 )
...
Adds OpenRouter video generation via video_generate, with hardened async polling/download handling, docs, and regression coverage.
Validation:
- pnpm test src/plugins/plugin-lookup-table.test.ts src/secrets/target-registry.fast-path.test.ts src/gateway/server-startup-post-attach.test.ts extensions/openrouter/video-generation-provider.test.ts src/video-generation/live-test-helpers.test.ts src/media-generation/provider-capabilities.contract.test.ts src/agents/pi-embedded-helpers/failover-matches.test.ts src/plugins/manifest-metadata-scan.test.ts src/agents/openai-transport-stream.test.ts src/media-understanding/openai-compatible-audio.test.ts src/agents/schema-normalization-runtime-contract.test.ts src/agents/provider-request-config.test.ts src/plugin-sdk/provider-stream.test.ts src/agents/pi-embedded-runner/run/attempt.spawn-workspace.websocket.test.ts -- --reporter=verbose
- OPENCLAW_LIVE_TEST=1 OPENCLAW_LIVE_TEST_QUIET=0 OPENCLAW_LIVE_VIDEO_GENERATION_MODELS=openrouter/google/veo-3.1-fast pnpm test:live src/video-generation/video-generation.live.test.ts -- --runInBand
Co-authored-by: notamicrodose <gabrielkripalani@me.com >
2026-04-28 10:57:31 +01:00
0294aebe6f
feat(providers): add DeepInfra provider plugin ( #73038 )
...
* feat(providers): add DeepInfra provider plugin
* feat(deepinfra): add media provider surfaces
* fix(deepinfra): satisfy provider boundary checks
* docs: add gitcrawl maintainer skill
* test: include deepinfra in live media sweeps
* fix: remove stale tts contract import
2026-04-28 01:12:54 +01:00
d1502c2ba1
docs(media-overview): rewrite around CardGroup, sync/async split, and AZ providers
...
The media overview was a 91-line page that opened with a redundant
Title-Case body H1 ('# Media Generation and Understanding'), then
mixed a capability table, a Yes/Yes/Yes provider matrix, dense prose
about async behaviour and STT/Voice Call surfaces, plus duplicate
'Quick links' and 'Related' sections at the end.
Restructure for scan-first reading without losing any content:
- Drop the redundant body H1; lead with a one-paragraph summary.
- Replace the 'Capabilities at a glance' table with a CardGroup of six
entry cards (Image / Video / Music / TTS / Media understanding / STT)
each linking directly to its dedicated page. Mode (sync/async) is
noted on the card so readers see latency expectations up front.
- Convert the provider matrix to checkmarks for readability and align
the column header names. Provider rows already alphabetized.
- Pull async vs synchronous behaviour into a 5-row table that names
why each capability is sync or async, then keep the operator-facing
paragraph that explains task-id handoff.
- Move the long 'Google maps to ... OpenAI maps to ... xAI maps to ...'
paragraph into a per-vendor AccordionGroup so each mapping is a
collapsible panel instead of one large prose block.
- Drop duplicate 'Quick links' section in favour of a single Related
list, sentence-cased to match the rest of the docs.
2026-04-25 22:20:35 -07:00
6a67f65568
fix(voice): reuse preflight transcripts across channels
2026-04-26 05:42:04 +01:00
b511250e5c
feat(media): add voice conversion and speech plugins
2026-04-25 12:12:33 +01:00
d7e2939791
feat: add Gradium text-to-speech provider ( #64958 )
...
Adds the Gradium bundled plugin with TTS and speech-provider registration, docs, label routing, and focused/live coverage.
Also carries the current main lint cleanup needed for the rebased CI lane.
Co-authored-by: laurent <laurent.mazare@gmail.com >
Co-authored-by: Claude Opus 4.6 (1M context) <noreply@anthropic.com >
2026-04-24 18:43:53 +01:00
e5f55dd024
docs: document Google realtime voice support
2026-04-24 10:14:55 +01:00
6667f66fd8
docs(tools): add Related sections and unify See also to Related
2026-04-23 15:41:56 -07:00
2777b089b5
docs: normalize frontmatter titles to sentence case
2026-04-23 13:15:17 -07:00
51ed22e608
feat(providers): add streaming stt providers
2026-04-23 03:05:53 +01:00
4ff720a837
fix(openai): harden realtime stt
2026-04-23 02:22:17 +01:00
67f09ea87a
feat: add xai realtime transcription
2026-04-23 01:38:11 +01:00
012841816d
feat: add xai speech-to-text support
2026-04-23 01:06:07 +01:00
f342da5fcc
feat: add xai media providers
...
Add xAI image generation and text-to-speech provider support with docs, live tests, and guarded provider HTTP handling.\n\nThanks @KateWilkins.
2026-04-23 00:07:39 +01:00
4ef8f4f53c
docs: add media overview page and consolidate TTS duplicate
2026-04-06 16:18:45 +01:00
Peter Steinberger