llama.cpp provider for the WordPress AI Client.

AcrossWP

This plugin provides llama.cpp integration for the WordPress AI Client. It lets WordPress sites use large language models running via a llama.cpp server for text generation and other AI capabilities.
llama.cpp exposes an OpenAI-compatible API, and this provider uses that API to communicate with any GGUF model loaded into your llama.cpp server.
Features:
<ul>
<li>Text generation with any llama.cpp-loaded model</li>
<li>Automatic model discovery from your llama.cpp server</li>
<li>Function calling support</li>
<li>Structured output (JSON mode) support</li>
<li>Settings page to configure the server URL (default: http://127.0.0.1:8080)</li>
<li>Works without an API key for local instances</li>
</ul>
Requirements:
<ul>
<li>PHP 7.4 or higher</li>
<li>WordPress AI Client plugin must be installed and activated</li>
<li>llama.cpp server running locally or on a remote host</li>
</ul>

Alternatives to AI Provider for llama.cpp

Top alternatives