Rodrigo Antunes

<p>This plugin provides Ollama integration for the PHP AI Client SDK using OpenAI-compatible endpoints.</p>
<p><strong>Features:</strong></p>
<ul>
<li>Text generation via <code>/v1/chat/completions</code></li>
<li>Dynamic model listing via <code>/v1/models</code></li>
<li>Automatic provider registration</li>
<li>Keyless/local setup support</li>
</ul>
<p><strong>Requirements:</strong></p>
<ul>
<li>PHP 7.4 or higher</li>
<li>Ollama server available</li>
<li>WordPress AI Client plugin/runtime support</li>
</ul>


Roddyka Local AI Connector for Ollama

Roddyka Local AI Connector for Ollama for the PHP AI Client SDK.

AcrossWP

<p>This plugin provides llama.cpp integration for the WordPress AI Client. It lets WordPress sites use large language models running via a llama.cpp server for text generation and other AI capabilities.</p>
<p>llama.cpp exposes an OpenAI-compatible API, and this provider uses that API to communicate with any GGUF model loaded into your llama.cpp server.</p>
<p><strong>Features:</strong></p>
<ul>
<li>Text generation with any llama.cpp-loaded model</li>
<li>Automatic model discovery from your llama.cpp server</li>
<li>Function calling support</li>
<li>Structured output (JSON mode) support</li>
<li>Settings page to configure the server URL (default: http://127.0.0.1:8080)</li>
<li>Works without an API key for local instances</li>
</ul>
<p><strong>Requirements:</strong></p>
<ul>
<li>PHP 7.4 or higher</li>
<li>WordPress AI Client plugin must be installed and activated</li>
<li>llama.cpp server running locally or on a remote host</li>
</ul>
<h3>Getting Started</h3>
<h4>What do I need before using this plugin?</h4>
<p>You need a running llama.cpp server (local or remote) and the WordPress AI Client plugin installed and activated.</p>
<h4>How do I install llama.cpp?</h4>
<p>On macOS run <code>brew install llama.cpp</code>. For other platforms, see the official docs at https://llama-cpp.com/download/</p>
<h4>Where do I get a model?</h4>
<p>Download a GGUF model from Hugging Face. TinyLlama 1.1B (Q4_K_M, ~636 MB) is a good starting point for testing.</p>
<h4>How do I start the server?</h4>
<p>Run <code>llama-server --models-dir ~/models</code>. The server starts on <code>http://127.0.0.1:8080</code> by default.</p>
<h4>How do I connect WordPress to my llama.cpp server?</h4>
<p>Go to <strong>Settings > llama.cpp</strong> and enter your server URL. Leave it blank to use the default (<code>http://127.0.0.1:8080</code>).</p>
<p>For full step-by-step setup instructions, see the <a href="https://github.com/acrosswp/ai-provider-for-llamacpp/" rel="nofollow ugc">Getting Started Guide</a>.</p>


AI Provider for llama.cpp

llama.cpp provider for the WordPress AI Client.

Roddyka Local AI Connector for Ollama vs AI Provider for llama.cpp