Patrick Buckley 80e1924d7f feat: enable prompt caching for Anthropic and OpenAI providers (#104) ...

* feat: enable prompt caching for Anthropic and OpenAI providers

Activate automatic prompt caching on both LLM providers to reduce input
token costs on multi-turn conversations. Anthropic gets cache_control:
ephemeral (90% savings on cache hits), OpenAI GPT-5.x gets 24h extended
cache retention (free). Cache metrics flow end-to-end through the entire
data pipeline: provider → session → server SSE → MQ protocol → storage →
Prometheus metrics → admin Usage tab.

- AnthropicProvider: top-level cache_control on all requests, extract
  cache_creation_input_tokens and cache_read_input_tokens from streaming
  and non-streaming responses
- OpenAIProvider: prompt_cache_retention=24h for GPT-5.x, extract
  cached_tokens from usage.prompt_tokens_details
- UsageInfo: new cache_creation_tokens and cache_read_tokens fields
- Migration 020: add cache columns to usage_events table
- Storage: record_usage_event and query_usage updated (sqlite + pg)
- Metrics: turnstone_tokens_total{type="cache_creation|cache_read"}
- Server: on_status passes cache tokens to SSE, storage, and metrics
- MQ: StatusEvent carries cache fields through bridge
- SDKs: Python and TypeScript StatusEvent types updated
- OpenAPI: UsageBreakdownItem schema includes cache fields
- Console UI: Usage tab shows cache write/read as secondary readouts
  with visual separator, dimmed when zero
- 16 new tests, docs and 3 diagrams updated

* fix: address Copilot review feedback

- Fix MQ protocol diagram clipping by switching to vertical package
  layout (inbound on top, outbound below) with package aliases
- Regenerate OpenAPI snapshots to include cache_creation_tokens and
  cache_read_tokens on UsageBreakdownItem
- Replace fragile MagicMock(spec=[]) + del pattern with
  types.SimpleNamespace in cache metrics missing-attributes test

2026-03-16 01:59:55 -07:00

..

__init__.py

Initial commit — turnstone multi-node AI orchestration platform.

2026-03-02 00:33:37 -08:00

conftest.py

Add pluggable storage backend (SQLite + PostgreSQL) and deployment packaging (#20)

2026-03-03 22:57:34 -08:00

test_api_versioning.py

Dev/api versioning openapi (#18)

2026-03-03 20:28:49 -08:00

test_async_broker.py

Add channel integrations with Discord adapter and atomic session resu… (#24)

2026-03-04 13:02:58 -08:00

test_audit.py

feat: governance — RBAC, tool policies, prompt templates, usage track… (#39)

2026-03-10 19:32:37 -07:00

test_auth_identity.py

Add user identity, JWT auth, and admin console UI (#23)

2026-03-04 09:12:18 -08:00

test_auth.py

test: add scope coverage for internal MCP/config reload endpoints (#75)

2026-03-15 13:45:35 -07:00

test_bm25.py

feat: structured memory system — typed/scoped memories with BM25 rele… (#53)

2026-03-13 21:21:09 -07:00

test_bootstrap.py

feat: bootstrap wizard — LLM-guided interactive setup for deployments

2026-03-11 01:58:39 -07:00

test_bridge_events.py

refactor: move bridge content buffer to server-side single source of truth

2026-03-15 15:04:22 -07:00

test_cancel.py

fix: approval timeout UI state and content flush before tool calls (#42)

2026-03-12 11:43:06 -07:00

test_channel_discord.py

feat: Discord content catch-up + bidirectional notification replies (… (#64)

2026-03-14 23:58:27 -07:00

test_channel_protocol.py

feat: intent validation v1 — advisory LLM judge for tool approvals (#50) (#50)

2026-03-13 04:12:46 -07:00

test_channel_routing.py

Add channel integrations with Discord adapter and atomic session resu… (#24)

2026-03-04 13:02:58 -08:00

test_channel_storage.py

Add channel integrations with Discord adapter and atomic session resu… (#24)

2026-03-04 13:02:58 -08:00

test_config_store.py

feat: database-backed settings (ConfigStore) with admin API (#59)

2026-03-14 11:42:18 -07:00

test_config.py

feat: intent validation v1 — advisory LLM judge for tool approvals (#50) (#50)

2026-03-13 04:12:46 -07:00

test_console.py

chore: remove dead code, add MCP integration + collector tests (#45)

2026-03-12 15:16:51 -07:00

test_db.py

feat: structured memory system — typed/scoped memories with BM25 rele… (#53)

2026-03-13 21:21:09 -07:00

test_edit.py

Initial commit — turnstone multi-node AI orchestration platform.

2026-03-02 00:33:37 -08:00

test_fts5.py

Add pluggable storage backend (SQLite + PostgreSQL) and deployment packaging (#20)

2026-03-03 22:57:34 -08:00

test_governance_endpoints.py

feat: governance — RBAC, tool policies, prompt templates, usage track… (#39)

2026-03-10 19:32:37 -07:00

test_governance_storage.py

feat: enable prompt caching for Anthropic and OpenAI providers (#104)

2026-03-16 01:59:55 -07:00

test_healthcheck.py

Fix circuit breaker, rate limiter, and Anthropic web search correctne… (#15)

2026-03-03 18:28:39 -08:00

test_html.py

Initial commit — turnstone multi-node AI orchestration platform.

2026-03-02 00:33:37 -08:00

test_judge_heuristic.py

feat: intent validation v1 — advisory LLM judge for tool approvals (#50) (#50)

2026-03-13 04:12:46 -07:00

test_judge_storage.py

feat: intent validation v1 — advisory LLM judge for tool approvals (#50) (#50)

2026-03-13 04:12:46 -07:00

test_judge.py

feat: intent validation v1 — advisory LLM judge for tool approvals (#50) (#50)

2026-03-13 04:12:46 -07:00

test_logging.py

Add structured logging with structlog and context propagation

2026-03-04 06:47:30 -08:00

test_markdown.py

Quality overhaul: code tooling, CI/CD, architecture diagrams, UI rede… (#1)

2026-03-02 16:55:12 -08:00

test_mcp_admin_api.py

perf: parallelize _collect_mcp_status and _notify_nodes_mcp_reload wi… (#73)

2026-03-15 13:54:49 -07:00

test_mcp_client.py

fix: MCP resource template URI expansion via prefix matching (#46)

2026-03-12 15:46:00 -07:00

test_mcp_hot_reload.py

fix: surface MCP server errors in admin UI instead of silent logging (#100)

2026-03-15 17:12:13 -07:00

test_mcp_integration.py

fix: MCP resource template URI expansion via prefix matching (#46)

2026-03-12 15:46:00 -07:00

test_mcp_prompt_sync.py

feat: wire prompt templates into session startup with full creation-p… (#47)

2026-03-12 16:57:31 -07:00

test_mcp_registry_api.py

fix: address review feedback and add sync-pending indicator

2026-03-15 21:41:02 -07:00

test_mcp_registry.py

feat: MCP Registry integration — discover and install servers from the official registry

2026-03-15 21:09:27 -07:00

test_mcp_server_storage.py

feat: MCP Registry integration — discover and install servers from the official registry

2026-03-15 21:09:27 -07:00

test_memory_api.py

fix: validate scope_id requires scope in memory API (#80)

2026-03-15 14:28:03 -07:00

test_memory_relevance.py

feat: structured memory system — typed/scoped memories with BM25 rele… (#53)

2026-03-13 21:21:09 -07:00

test_metacognition.py

fix: reduce metacognition false positives with strong/weak pattern tiers (#76)

2026-03-15 13:53:39 -07:00

test_model_registry.py

feat: prompt template tech debt — tests, read-only endpoints, double-… (#67)

2026-03-15 02:09:31 -07:00

test_notify_http.py

Add channel notification tool with security hardening (#27)

2026-03-05 17:24:00 -08:00

test_notify_tool.py

Normalize session_id into ws_id as sole persistent identity (#29)

2026-03-07 12:49:07 -08:00

test_oidc_handlers.py

test: add OIDC handler integration tests (22 tests) (#99)

2026-03-15 16:44:44 -07:00

test_oidc_storage.py

feat: OIDC SSO authentication with PKCE, auto-provisioning, and role … (#71)

2026-03-15 03:44:18 -07:00

test_oidc.py

fix(oidc): pin redirect URI via TURNSTONE_OIDC_REDIRECT_BASE env var (#74)

2026-03-15 13:52:05 -07:00

test_openapi.py

Normalize session_id into ws_id as sole persistent identity (#29)

2026-03-07 12:49:07 -08:00

test_prompt_templates_runtime.py

feat: prompt template tech debt — tests, read-only endpoints, double-… (#67)

2026-03-15 02:09:31 -07:00

test_protocol.py

feat: wire prompt templates into session startup with full creation-p… (#47)

2026-03-12 16:57:31 -07:00

test_providers.py

feat: enable prompt caching for Anthropic and OpenAI providers (#104)

2026-03-16 01:59:55 -07:00

test_ratelimit.py

Fix circuit breaker, rate limiter, and Anthropic web search correctne… (#15)

2026-03-03 18:28:39 -08:00

test_reconstruct_messages.py

fix: simplify conversation storage — atomic assistant rows with tool_… (#51)

2026-03-13 14:26:05 -07:00

test_resume_flow.py

Normalize session_id into ws_id as sole persistent identity (#29)

2026-03-07 12:49:07 -08:00

test_safety.py

Initial commit — turnstone multi-node AI orchestration platform.

2026-03-02 00:33:37 -08:00

test_sandbox.py

Quality overhaul: code tooling, CI/CD, architecture diagrams, UI rede… (#1)

2026-03-02 16:55:12 -08:00

test_schedule_api.py

feat: governance — RBAC, tool policies, prompt templates, usage track… (#39)

2026-03-10 19:32:37 -07:00

test_scheduled_tasks_storage.py

Add scheduled task system with cron/at scheduling (#26)

2026-03-05 16:05:00 -08:00

test_scheduler.py

Add scheduled task system with cron/at scheduling (#26)

2026-03-05 16:05:00 -08:00

test_scoring.py

Quality overhaul: code tooling, CI/CD, architecture diagrams, UI rede… (#1)

2026-03-02 16:55:12 -08:00

test_sdk_console.py

Add scheduled task docs and SDK client methods

2026-03-05 18:11:36 -08:00

test_sdk_events.py

fix: approval timeout UI state and content flush before tool calls (#42)

2026-03-12 11:43:06 -07:00

test_sdk_server.py

Normalize session_id into ws_id as sole persistent identity (#29)

2026-03-07 12:49:07 -08:00

test_sdk_sse.py

Add Python and TypeScript client SDKs for server and console APIs (#19)

2026-03-03 21:22:24 -08:00

test_sdk_sync.py

Add cluster-scale schema, fix console proxy UX, harden SDK sync runner (#22)

2026-03-04 06:04:59 -08:00

test_server_live.py

Normalize session_id into ws_id as sole persistent identity (#29)

2026-03-07 12:49:07 -08:00

test_services_storage.py

Add channel notification tool with security hardening (#27)

2026-03-05 17:24:00 -08:00

test_session.py

fix: inject prompt template guardrails into plan agent system message (#79)

2026-03-15 14:24:10 -07:00

test_sessions.py

fix: simplify conversation storage — atomic assistant rows with tool_… (#51)

2026-03-13 14:26:05 -07:00

test_settings_api.py

feat: database-backed settings (ConfigStore) with admin API (#59)

2026-03-14 11:42:18 -07:00

test_settings_registry.py

feat: database-backed settings (ConfigStore) with admin API (#59)

2026-03-14 11:42:18 -07:00

test_sim.py

Quality overhaul: code tooling, CI/CD, architecture diagrams, UI rede… (#1)

2026-03-02 16:55:12 -08:00

test_storage_registry.py

Add pluggable storage backend (SQLite + PostgreSQL) and deployment packaging (#20)

2026-03-03 22:57:34 -08:00

test_storage_sqlite.py

feat: structured memory system — typed/scoped memories with BM25 rele… (#53)

2026-03-13 21:21:09 -07:00

test_structured_memory_storage.py

feat: structured memory system — typed/scoped memories with BM25 rele… (#53)

2026-03-13 21:21:09 -07:00

test_structured_memory.py

feat: structured memory system — typed/scoped memories with BM25 rele… (#53)

2026-03-13 21:21:09 -07:00

test_tool_policy.py

feat: MCP resource and prompt discovery with read_resource tool (#44)

2026-03-12 14:49:58 -07:00

test_tool_search.py

Add MCP dynamic tool refresh with push notifications and periodic pol… (#31)

2026-03-08 03:28:38 -07:00

test_tools_schema.py

feat: structured memory system — typed/scoped memories with BM25 rele… (#53)

2026-03-13 21:21:09 -07:00

test_user_storage.py

feat: governance — RBAC, tool policies, prompt templates, usage track… (#39)

2026-03-10 19:32:37 -07:00

test_watch_storage.py

feat: watch tool — periodic command polling within workstreams (#36)

2026-03-10 08:18:28 -07:00

test_watch.py

feat: watch tool — periodic command polling within workstreams (#36)

2026-03-10 08:18:28 -07:00

test_webui_content.py

refactor: move bridge content buffer to server-side single source of truth

2026-03-15 15:04:22 -07:00

test_workstream.py

feat: prompt template tech debt — tests, read-only endpoints, double-… (#67)

2026-03-15 02:09:31 -07:00

test_ws_template_runtime.py

feat: per-tool "Always" approve instead of blanket auto-approve (#82)

2026-03-15 15:25:40 -07:00

test_ws_template_storage.py

feat: workstream templates — behavioral profiles for workstream creation (#49)

2026-03-12 21:06:51 -07:00