Files
openclaw/extensions/llama-cpp
Jason (Json) 5f1bbed42d fix(doctor): report missing managed local embedding setup (#123575)
* fix(gateway): expose startup blockers before cutover

* fix(gateway): include session blockers in preflight

* fix(gateway): keep preflight finding type private

* fix(gateway): preflight startup auth blockers

* fix(gateway): complete startup preflight readiness

* fix(llama-cpp): keep preflight remediation private

* fix(gateway): keep preflight passive and activation-aware

* fix(gateway): apply startup guard in preflight

* fix(gateway): align auth mode preflight

* fix(gateway): keep preflight state reads isolated

Share the read-only inspection snapshot scope across duplicated runtime chunks so blocked gateway preflight remains non-mutating when bundled provider artifacts read canonical state.

* fix(gateway): keep startup preflight passive

* fix(gateway): ignore inactive embedding owner shadows

* fix(gateway): preserve startup preflight parity

* fix(llama-cpp): keep cache inspection types private

* fix(gateway): close startup preflight parity gaps

* fix(gateway): handle uninitialized memory databases

* test(gateway): observe shell fallback portably

* fix(llama-cpp): normalize embedding model paths

* refactor(gateway): drop broad startup preflight surface

* fix(doctor): report missing managed local embedding setup

* style(memory): simplify setup enablement check

* fix(memory): keep diagnostic result type private

* fix(memory): inspect local setup with remote secret refs

* fix(memory): keep doctor index inspection immutable

* fix(memory): make readiness inspection owner-aware

* fix(doctor): mirror memory slot allowlist policy

* test(doctor): use canonical memory slot id

* fix(doctor): normalize memory provider ids

* fix(doctor): resolve external embedding readiness owner

* fix(plugins): keep embedding inspection result internal

* fix(doctor): isolate plugin state during lint

* fix(doctor): route lint metadata through snapshot

* fix(cli): keep doctor lint startup source-only

* fix(cli): keep doctor lint compile-cache free

* fix(doctor): keep local embedding readiness opt-in

* test(doctor): preserve plugin artifact roots during lint

* fix(doctor): refresh memory readiness registration

* test(doctor): type nullable provider policy mock

* fix(doctor): scope lint state snapshot to provider check

* fix(doctor): isolate selected plugin state checks

* test(doctor): restore only scoped environment

* fix(doctor): defer readiness state inspection

* fix(doctor): keep deferred config reads isolated

* fix(doctor): keep plugin state mode internal

* fix(config): preserve default plugin validation
2026-08-15 20:15:06 -06:00
..

@openclaw/llama-cpp-provider

Official managed llama.cpp provider for OpenClaw GGUF chat and embeddings.

The plugin installs a pinned, integrity-verified llama-server and configures OpenClaw's existing localService supervisor. Model traffic uses the normal OpenAI-compatible chat and embedding transports.

Install

openclaw plugins install @openclaw/llama-cpp-provider

Restart the Gateway after installing or updating the plugin, then choose llama.cpp once during interactive onboarding or configuration.

Configure text inference

After explicit consent, OpenClaw installs the matching server build and downloads Gemma 4 E4B IT Q4_K_M (approximately 5.0 GB) plus EmbeddingGemma (approximately 0.3 GB). The default chat download is offered only on machines with at least 16 GiB of RAM.

Custom GGUF models remain supported through params.modelPath. Rerun llama.cpp setup after changing the model so OpenClaw can verify the file and regenerate the managed router preset.

See the llama.cpp provider guide for platform requirements, custom GGUF configuration, diagnostics, and repair.

Configure embeddings

Set memory.search.provider to local. The plugin preserves the historical local embedding provider and index identity while serving requests through the managed server's /v1/embeddings endpoint.

Package

  • Plugin id: llama-cpp
  • Package: @openclaw/llama-cpp-provider
  • Minimum OpenClaw host: 2026.6.2