Sean Mullins

LLMs.txt Curator helps site owners generate and curate a high-quality <code>llms.txt</code> file for AI assistants and retrieval systems, ensuring only relevant, well-described content is exposed to large language models.
It generates and maintains <code>llms.txt</code> and <code>llms-full.txt</code> — the emerging standard for telling AI systems (ChatGPT, Claude, Perplexity, Gemini, and others) which pages on your site matter most and what they contain.
Unlike auto-generators that dump every URL into a flat file, LLMs.txt Curator takes a curation-first approach. You choose the pages, organise them into sections, fill descriptions, override titles for AI, validate quality, and see exactly which AI bots are reading your file — all from a single interface.
<h4>What makes this different</h4>
Most llms.txt plugins treat the file as a static output. LLMs.txt Curator treats it as a living asset:
<ul>
<li>Quality Score — every generated file shows your coverage percentage, which pages have descriptions, and which still need attention.</li>
<li>Description Suggestions — one click fills all missing descriptions from a five-step fallback chain (SEO meta → excerpt → Open Graph → page content). Never overwrites what you’ve set manually.</li>
<li>Change Detection — a banner appears in your admin when curated pages have been updated since the last generation, with a Regenerate Now button. Your llms.txt stays current without manual checking.</li>
<li>Per-Page Title Override — set a different title for each page specifically for AI consumption, without touching your on-site SEO.</li>
<li>Safety Mode — blocks generation if validation errors exist, preventing a broken file from going live. Includes an on-demand validator with plain-English results.</li>
<li>AI Crawler Analytics — see which bots visited in the last 7 days, with a visual bar chart. OpenAI, Anthropic, Perplexity, Google — know who is actually reading your file.</li>
</ul>
<h4>Core features</h4>
<ul>
<li>Drag-and-drop curation — reorder sections and pages visually; each section becomes an <code>##</code> heading per the spec</li>
<li>llms-full.txt generation — the companion file with full Markdown content for each curated page</li>
<li>Five SEO plugin integrations — Rank Math, Yoast SEO, All in One SEO, SEOPress, The SEO Framework</li>
<li>Schema-aware descriptions — uses structured data before falling back through the description chain</li>
<li>Scheduled regeneration — choose Instant (on publish), Daily, Weekly, or Manual</li>
<li>WooCommerce support — SKU, price, stock, categories, dimensions; respects product visibility</li>
<li>WordPress Multisite — network-activate across all sites; each site manages its own independent llms.txt; Network Admin overview with per-site and bulk regenerate</li>
<li>Pre-built templates — Business, E-commerce, SaaS, Blog, Local Business</li>
<li>Live preview — see your exact llms.txt output before saving</li>
<li>Import / export — move your configuration between sites as JSON</li>
<li>WP-CLI — <code>wp llms-txt regenerate</code>, <code>wp llms-txt status</code>, <code>wp llms-txt crawler-log</code></li>
<li>REST API — <code>POST /wp-json/llms-txt/v1/regenerate</code>, <code>GET /wp-json/llms-txt/v1/status</code></li>
<li>Atomic file writes — temp file → rename; no half-written files served to bots</li>
<li>ETag/304 caching — proper HTTP headers for CDN revalidation</li>
<li>Subdirectory / Bedrock support — correctly finds the site root on non-standard installs</li>
<li>Robots.txt reference — automatically adds a spec-compliant comment</li>
</ul>
<h4>Description Suggestions in detail</h4>
When pages lack descriptions, AI systems get less context. The suggestion engine fills the gap automatically:
<ol>
<li>Schema markup (Rank Math, custom <code>_schema_json</code>)</li>
<li>SEO plugin meta description</li>
<li>WordPress excerpt</li>
<li>Open Graph description (<code>_og_description</code> / <code>og_description</code>)</li>
<li>First 160 characters of post content</li>
</ol>
Already-set descriptions are never touched. Pages that can’t be filled automatically are listed for manual review.
<h4>Quality Score</h4>
Every generated <code>llms.txt</code> ends with a coverage report:
<pre><code>Quality Score: 94%
Pages included: 48
Pages with descriptions: 45
Pages missing descriptions: 3
</code></pre>
This is visible to the AI systems reading your file, and to you in the Preview tab.
<h4>AI Crawler Analytics</h4>
Track 12 known bots: GPTBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended, Applebot-Extended, Meta-ExternalAgent, Bytespider, CCBot, Cohere, DeepSeek, Amazonbot.
The 7-day analytics card shows a visual bar chart of recent activity. All-time totals are kept separately. IP addresses are anonymised before storage — last octet zeroed for IPv4, last 80 bits for IPv6. No data leaves your server.
<h4>Safety Mode</h4>
Before generation, the validator checks:
<ul>
<li>Pages missing or unpublished</li>
<li>Duplicate URLs across sections</li>
<li>Noindex conflicts</li>
<li>Canonical mismatches</li>
<li>Password-protected pages</li>
<li>Thin content (< 100 words, no meta, no excerpt)</li>
<li>File size > 50 KB</li>
<li>Too many pages (> 80)</li>
</ul>
When Safety Mode is on, errors block generation and the results are shown immediately. Warnings are surfaced but don’t block. Everything is explained in plain English.
<h4>Scheduled regeneration</h4>
<ul>
<li>Instant — regenerates ~30 seconds after any page is published or trashed (default)</li>
<li>Daily — once per day, via WP-Cron recurring event</li>
<li>Weekly — once per week</li>
<li>Manual — only when you click Save & Generate</li>
</ul>
<h4>How to get started</h4>
<ol>
<li>Install and activate. The plugin auto-scans your content and creates initial sections.</li>
<li>Curate: drag, drop, add, remove. Aim for 20-60 pages that best represent your site.</li>
<li>Click Generate Missing Descriptions to fill gaps automatically.</li>
<li>Fix any warnings shown in the Safety Mode card.</li>
<li>Set the update mode that suits your workflow.</li>
<li>Save & Generate. Your files are live at <code>/llms.txt</code> and <code>/llms-full.txt</code>.</li>
<li>Enable the AI Crawler Log to see which bots start visiting.</li>
</ol>
<h4>WooCommerce integration</h4>
When WooCommerce is active, the plugin automatically includes SKU, price, and stock status in <code>llms.txt</code> descriptions, and full product details in <code>llms-full.txt</code>. Products with “hidden” visibility are excluded, and you can optionally exclude out-of-stock products.
<h4>Developer hooks</h4>
<ul>
<li><code>llmscu_capability</code> filter — override the required capability (default: <code>manage_options</code>)</li>
<li><code>llmscu_post_limit</code> filter — scanner post limit per type (default: 500)</li>
<li><code>llmscu_full_word_limit</code> filter — per-page word cap in <code>llms-full.txt</code> (default: unlimited)</li>
<li><code>llmscu_regenerated</code> action — fires after each successful regeneration with the content string</li>
</ul>

LLMs.txt Curator

Curate, score, and maintain your llms.txt with quality scoring, description suggestions, change detection, and AI crawler analytics.

Freemius

Team CiteBoost

CiteBoost GEO helps your WordPress site get discovered and cited by AI search engines. It analyzes your content for AI readiness, fixes common crawling issues, and adds structured data so AI engines can understand and reference your pages.
Key Features (Free):
<ul>
<li>AI Visibility Score — Scan all posts and pages to get a 0-100 readiness score for AI search engines</li>
<li>Score History — Track how your AI visibility improves over time with score trend indicators</li>
<li>Robots.txt Management — Detect and fix blocked AI bots with one click (supports both physical and virtual robots.txt)</li>
<li>Schema Detection — See which posts have JSON-LD structured data and which types are missing</li>
<li>Manual JSON-LD Editor — Paste and validate your own JSON-LD markup</li>
<li>Content Analysis — Actionable recommendations for heading structure, word count, and content quality</li>
<li>Author E-E-A-T Checks — Verify author signals that AI engines look for</li>
<li>Bot Crawl Tracking — See which AI crawlers visit your site</li>
<li>AI Referral Tracking — Monitor clicks from ChatGPT, Claude, Perplexity, and other AI sources</li>
<li>Accessible Dashboard — WCAG-compliant interface with keyboard navigation</li>
</ul>
Pro Features:
<ul>
<li>AI Schema Generation — Generate optimized JSON-LD using Claude, GPT, or Gemini (Article, FAQPage, HowTo, BlogPosting, and more)</li>
<li>Quick Generate — Build schema instantly from WordPress post data without API calls</li>
<li>Citation Monitoring — Check whether AI engines cite your content in their responses via the Perplexity API</li>
<li>On-Demand Citation Checks — Run citation checks any time with the Check Citations Now button</li>
<li>Configurable AI Model — Choose which model to use for schema generation</li>
<li>Encrypted API Key Storage — All API keys are encrypted at rest using Sodium</li>
</ul>
Tracks 9 AI bots: GPTBot, OAI-SearchBot, ChatGPT-User, ClaudeBot, Claude-SearchBot, PerplexityBot, Google-Extended, Amazonbot, and Bytespider.
Learn more at <a href="https://wp-geo-optimizer.com" rel="nofollow ugc">wp-geo-optimizer.com</a>.
<h3>External services</h3>
This plugin connects to the following external services when the user explicitly triggers them. No data is sent without user action.
<h4>Anthropic API (Claude)</h4>
Used for AI-powered JSON-LD schema generation when the user selects Claude as their AI provider and clicks “Generate”. 
Sends: post title, excerpt, content summary, and selected schema type. 
<a href="https://www.anthropic.com/terms" rel="nofollow ugc">Terms of Service</a> | <a href="https://www.anthropic.com/privacy" rel="nofollow ugc">Privacy Policy</a>
<h4>OpenAI API (GPT)</h4>
Used for AI-powered JSON-LD schema generation when the user selects GPT as their AI provider and clicks “Generate”. 
Sends: post title, excerpt, content summary, and selected schema type. 
<a href="https://openai.com/terms/" rel="nofollow ugc">Terms of Service</a> | <a href="https://openai.com/privacy/" rel="nofollow ugc">Privacy Policy</a>
<h4>Google Gemini API</h4>
Used for AI-powered JSON-LD schema generation when the user selects Gemini as their AI provider and clicks “Generate”. 
Sends: post title, excerpt, content summary, and selected schema type. 
<a href="https://ai.google.dev/terms" rel="nofollow ugc">Terms of Service</a> | <a href="https://policies.google.com/privacy" rel="nofollow ugc">Privacy Policy</a>
<h4>Perplexity API</h4>
Used for checking if AI search engines cite your content when the user clicks “Check Citations Now”. 
Sends: tracked search queries configured by the user in Settings. 
<a href="https://www.perplexity.ai/hub/terms-of-service" rel="nofollow ugc">Terms of Service</a> | <a href="https://www.perplexity.ai/hub/privacy-policy" rel="nofollow ugc">Privacy Policy</a>
<h4>Freemius SDK</h4>
Used for license management, in-plugin checkout, automatic updates, and optional usage analytics. 
Sends: site URL, plugin version, PHP version, and license status. 
The user is asked for consent during plugin activation opt-in. 
<a href="https://freemius.com/terms/" rel="nofollow ugc">Terms of Service</a> | <a href="https://freemius.com/privacy/" rel="nofollow ugc">Privacy Policy</a>
<h3>Source Code & Build Process</h3>
The JavaScript source code is included in the plugin under <code>assets/src/</code>. The compiled files in <code>assets/build/</code> are generated using <a href="https://developer.wordpress.org/block-editor/reference-guides/packages/packages-scripts/" rel="nofollow ugc">@wordpress/scripts</a> (webpack).
To build from source:
<ol>
<li>Install Node.js 18+</li>
<li>Run <code>npm install</code></li>
<li>Run <code>npm run build</code> — compiles <code>assets/src/index.js</code> → <code>assets/build/</code></li>
</ol>

CiteBoost GEO

Optimize your WordPress site for AI search engines like ChatGPT, Claude, Gemini, and Perplexity.

LLMs.txt Curator vs CiteBoost GEO