10up

Fueled

<p>This plugin provides <a href="https://ollama.com/" rel="nofollow ugc">Ollama</a> integration for the WordPress AI Client. It lets WordPress sites use large language models running locally or on a remote Ollama instance for text and image generation and other AI capabilities.</p>
<p>Ollama exposes an <a href="https://ollama.com/blog/openai-compatibility" rel="nofollow ugc">OpenAI-compatible API</a>, and this provider uses that API to communicate with any model you have pulled into Ollama (Llama, Mistral, Gemma, Phi, and many more).</p>
<p><strong>Features:</strong></p>
<ul>
<li>Text generation with any Ollama model</li>
<li>Image generation with supported models</li>
<li>Automatic model discovery from your Ollama instance</li>
<li>Function calling support</li>
<li>Structured output (JSON mode) support</li>
<li>Settings page for host URL and seeing available models</li>
<li>Works without an API key for local instances</li>
</ul>
<p><strong>Requirements:</strong></p>
<ul>
<li>PHP 7.4 or higher</li>
<li>WordPress 7.0 or higher</li>
<li>Ollama running locally or on a remote server (like Ollama Cloud)</li>
</ul>


AI Provider for Ollama


I have tried in my local machines and it works very well with ollama


Works very well with ollama

Ollama provider for the WordPress AI Client.

AcrossWP

<p>This plugin provides llama.cpp integration for the WordPress AI Client. It lets WordPress sites use large language models running via a llama.cpp server for text generation and other AI capabilities.</p>
<p>llama.cpp exposes an OpenAI-compatible API, and this provider uses that API to communicate with any GGUF model loaded into your llama.cpp server.</p>
<p><strong>Features:</strong></p>
<ul>
<li>Text generation with any llama.cpp-loaded model</li>
<li>Automatic model discovery from your llama.cpp server</li>
<li>Function calling support</li>
<li>Structured output (JSON mode) support</li>
<li>Settings page to configure the server URL (default: http://127.0.0.1:8080)</li>
<li>Works without an API key for local instances</li>
</ul>
<p><strong>Requirements:</strong></p>
<ul>
<li>PHP 7.4 or higher</li>
<li>WordPress AI Client plugin must be installed and activated</li>
<li>llama.cpp server running locally or on a remote host</li>
</ul>
<h3>Getting Started</h3>
<h4>What do I need before using this plugin?</h4>
<p>You need a running llama.cpp server (local or remote) and the WordPress AI Client plugin installed and activated.</p>
<h4>How do I install llama.cpp?</h4>
<p>On macOS run <code>brew install llama.cpp</code>. For other platforms, see the official docs at https://llama-cpp.com/download/</p>
<h4>Where do I get a model?</h4>
<p>Download a GGUF model from Hugging Face. TinyLlama 1.1B (Q4_K_M, ~636 MB) is a good starting point for testing.</p>
<h4>How do I start the server?</h4>
<p>Run <code>llama-server --models-dir ~/models</code>. The server starts on <code>http://127.0.0.1:8080</code> by default.</p>
<h4>How do I connect WordPress to my llama.cpp server?</h4>
<p>Go to <strong>Settings > llama.cpp</strong> and enter your server URL. Leave it blank to use the default (<code>http://127.0.0.1:8080</code>).</p>
<p>For full step-by-step setup instructions, see the <a href="https://github.com/acrosswp/ai-provider-for-llamacpp/" rel="nofollow ugc">Getting Started Guide</a>.</p>


AI Provider for llama.cpp

llama.cpp provider for the WordPress AI Client.

AI Provider for Ollama vs AI Provider for llama.cpp