mirror of
https://github.com/openclaw/openclaw.git
synced 2026-08-20 01:21:41 -06:00
Peter Steinberger
0135046830
* refactor(llama-cpp): unify server ownership modes * test(llama-cpp): preserve shared discovery limits * fix(plugin-sdk): retain provider auth removal export
40 lines
1.1 KiB
Markdown
40 lines
1.1 KiB
Markdown
---
|
|
summary: "Managed and external llama.cpp servers for GGUF chat and embeddings."
|
|
read_when:
|
|
- You are installing, configuring, or auditing the llama-cpp plugin
|
|
title: "Llama Cpp plugin"
|
|
---
|
|
|
|
# Llama Cpp plugin
|
|
|
|
Managed and external llama.cpp servers for GGUF chat and embeddings.
|
|
|
|
## Distribution
|
|
|
|
- Package: `@openclaw/llama-cpp-provider`
|
|
- Install route: npm; ClawHub
|
|
|
|
## Surface
|
|
|
|
providers: `llama-cpp`; contracts: `embeddingProviders`
|
|
|
|
<!-- openclaw-plugin-reference:manual-start -->
|
|
|
|
## Default text model
|
|
|
|
During interactive setup, OpenClaw installs a pinned, verified `llama-server`
|
|
and offers Gemma 4 E4B IT Q4_K_M as an approximately 5.0 GB download. The model
|
|
offer requires at least 16 GiB of total RAM. Existing cached models are still
|
|
detected on smaller machines.
|
|
|
|
To use another model, set `params.modelPath` to any custom GGUF. Custom models
|
|
are not subject to the bundled-download RAM requirement. On machines below the
|
|
requirement, you can also run a smaller model through Ollama or LM Studio, or
|
|
choose a cloud provider.
|
|
|
|
<!-- openclaw-plugin-reference:manual-end -->
|
|
|
|
## Related docs
|
|
|
|
- [llama-cpp](/plugins/llama-cpp)
|