Sean Mullins

<p><strong>LLMs.txt Curator</strong> helps site owners generate and curate a high-quality <code>llms.txt</code> file for AI assistants and retrieval systems, ensuring only relevant, well-described content is exposed to large language models.</p>
<p>It generates and maintains <code>llms.txt</code> and <code>llms-full.txt</code> — the emerging standard for telling AI systems (ChatGPT, Claude, Perplexity, Gemini, and others) which pages on your site matter most and what they contain.</p>
<p>Unlike auto-generators that dump every URL into a flat file, LLMs.txt Curator takes a <strong>curation-first approach</strong>. You choose the pages, organise them into sections, fill descriptions, override titles for AI, validate quality, and see exactly which AI bots are reading your file — all from a single interface.</p>
<h4>What makes this different</h4>
<p>Most llms.txt plugins treat the file as a static output. LLMs.txt Curator treats it as a living asset:</p>
<ul>
<li><strong>Quality Score</strong> — every generated file shows your coverage percentage, which pages have descriptions, and which still need attention.</li>
<li><strong>Description Suggestions</strong> — one click fills all missing descriptions from a five-step fallback chain (SEO meta <span aria-hidden="true" class="wp-exclude-emoji">→</span> excerpt <span aria-hidden="true" class="wp-exclude-emoji">→</span> Open Graph <span aria-hidden="true" class="wp-exclude-emoji">→</span> page content). Never overwrites what you’ve set manually.</li>
<li><strong>Change Detection</strong> — a banner appears in your admin when curated pages have been updated since the last generation, with a Regenerate Now button. Your llms.txt stays current without manual checking.</li>
<li><strong>Per-Page Title Override</strong> — set a different title for each page specifically for AI consumption, without touching your on-site SEO.</li>
<li><strong>Safety Mode</strong> — blocks generation if validation errors exist, preventing a broken file from going live. Includes an on-demand validator with plain-English results.</li>
<li><strong>AI Crawler Analytics</strong> — see which bots visited in the last 7 days, with a visual bar chart. OpenAI, Anthropic, Perplexity, Google — know who is actually reading your file.</li>
</ul>
<h4>Core features</h4>
<ul>
<li><strong>Drag-and-drop curation</strong> — reorder sections and pages visually; each section becomes an <code>##</code> heading per the spec</li>
<li><strong>llms-full.txt generation</strong> — the companion file with full Markdown content for each curated page</li>
<li><strong>Five SEO plugin integrations</strong> — Rank Math, Yoast SEO, All in One SEO, SEOPress, The SEO Framework</li>
<li><strong>Schema-aware descriptions</strong> — uses structured data before falling back through the description chain</li>
<li><strong>Scheduled regeneration</strong> — choose Instant (on publish), Daily, Weekly, or Manual</li>
<li><strong>WooCommerce support</strong> — SKU, price, stock, categories, dimensions; respects product visibility</li>
<li><strong>WordPress Multisite</strong> — network-activate across all sites; each site manages its own independent llms.txt; Network Admin overview with per-site and bulk regenerate</li>
<li><strong>Pre-built templates</strong> — Business, E-commerce, SaaS, Blog, Local Business</li>
<li><strong>Live preview</strong> — see your exact llms.txt output before saving</li>
<li><strong>Import / export</strong> — move your configuration between sites as JSON</li>
<li><strong>WP-CLI</strong> — <code>wp llms-txt regenerate</code>, <code>wp llms-txt status</code>, <code>wp llms-txt crawler-log</code></li>
<li><strong>REST API</strong> — <code>POST /wp-json/llms-txt/v1/regenerate</code>, <code>GET /wp-json/llms-txt/v1/status</code></li>
<li><strong>Atomic file writes</strong> — temp file <span aria-hidden="true" class="wp-exclude-emoji">→</span> rename; no half-written files served to bots</li>
<li><strong>ETag/304 caching</strong> — proper HTTP headers for CDN revalidation</li>
<li><strong>Subdirectory / Bedrock support</strong> — correctly finds the site root on non-standard installs</li>
<li><strong>Robots.txt reference</strong> — automatically adds a spec-compliant comment</li>
</ul>
<h4>Description Suggestions in detail</h4>
<p>When pages lack descriptions, AI systems get less context. The suggestion engine fills the gap automatically:</p>
<ol>
<li>Schema markup (Rank Math, custom <code>_schema_json</code>)</li>
<li>SEO plugin meta description</li>
<li>WordPress excerpt</li>
<li>Open Graph description (<code>_og_description</code> / <code>og_description</code>)</li>
<li>First 160 characters of post content</li>
</ol>
<p>Already-set descriptions are never touched. Pages that can’t be filled automatically are listed for manual review.</p>
<h4>Quality Score</h4>
<p>Every generated <code>llms.txt</code> ends with a coverage report:</p>
<pre><code>Quality Score: 94%
Pages included: 48
Pages with descriptions: 45
Pages missing descriptions: 3
</code></pre>
<p>This is visible to the AI systems reading your file, and to you in the Preview tab.</p>
<h4>AI Crawler Analytics</h4>
<p>Track 12 known bots: GPTBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended, Applebot-Extended, Meta-ExternalAgent, Bytespider, CCBot, Cohere, DeepSeek, Amazonbot.</p>
<p>The 7-day analytics card shows a visual bar chart of recent activity. All-time totals are kept separately. IP addresses are anonymised before storage — last octet zeroed for IPv4, last 80 bits for IPv6. No data leaves your server.</p>
<h4>Safety Mode</h4>
<p>Before generation, the validator checks:</p>
<ul>
<li>Pages missing or unpublished</li>
<li>Duplicate URLs across sections</li>
<li>Noindex conflicts</li>
<li>Canonical mismatches</li>
<li>Password-protected pages</li>
<li>Thin content (< 100 words, no meta, no excerpt)</li>
<li>File size > 50 KB</li>
<li>Too many pages (> 80)</li>
</ul>
<p>When Safety Mode is on, errors block generation and the results are shown immediately. Warnings are surfaced but don’t block. Everything is explained in plain English.</p>
<h4>Scheduled regeneration</h4>
<ul>
<li><strong>Instant</strong> — regenerates ~30 seconds after any page is published or trashed (default)</li>
<li><strong>Daily</strong> — once per day, via WP-Cron recurring event</li>
<li><strong>Weekly</strong> — once per week</li>
<li><strong>Manual</strong> — only when you click Save & Generate</li>
</ul>
<h4>How to get started</h4>
<ol>
<li>Install and activate. The plugin auto-scans your content and creates initial sections.</li>
<li>Curate: drag, drop, add, remove. Aim for 20-60 pages that best represent your site.</li>
<li>Click <strong>Generate Missing Descriptions</strong> to fill gaps automatically.</li>
<li>Fix any warnings shown in the Safety Mode card.</li>
<li>Set the update mode that suits your workflow.</li>
<li>Save & Generate. Your files are live at <code>/llms.txt</code> and <code>/llms-full.txt</code>.</li>
<li>Enable the AI Crawler Log to see which bots start visiting.</li>
</ol>
<h4>WooCommerce integration</h4>
<p>When WooCommerce is active, the plugin automatically includes SKU, price, and stock status in <code>llms.txt</code> descriptions, and full product details in <code>llms-full.txt</code>. Products with “hidden” visibility are excluded, and you can optionally exclude out-of-stock products.</p>
<h4>Developer hooks</h4>
<ul>
<li><strong><code>llmscu_capability</code></strong> filter — override the required capability (default: <code>manage_options</code>)</li>
<li><strong><code>llmscu_post_limit</code></strong> filter — scanner post limit per type (default: 500)</li>
<li><strong><code>llmscu_full_word_limit</code></strong> filter — per-page word cap in <code>llms-full.txt</code> (default: unlimited)</li>
<li><strong><code>llmscu_regenerated</code></strong> action — fires after each successful regeneration with the content string</li>
</ul>


LLMs.txt Curator

Curate, score, and maintain your llms.txt with quality scoring, description suggestions, change detection, and AI crawler analytics.

Saskia Teichmann

<p><strong>AI is changing how people find your website.</strong> Tools like ChatGPT, Perplexity, Gemini, and AI Overviews are replacing traditional search for millions of users. If AI can’t find your content, you’re invisible to a growing audience.</p>
<p>citelayer® makes your WordPress site visible to AI — instantly. No coding, no configuration. Install, activate, done.</p>
<h4>🤖 AI Bot Analytics — Know Who’s Crawling Your Site</h4>
<p>Track every AI search-engine visitor and bot crawl in real time. See which AI platforms — ChatGPT, Perplexity, Claude, Gemini — send actual users to your site, and watch the bot traffic that’s discovering your content for those platforms.</p>
<ul>
<li><strong>67 AI/LLM Bots Tracked</strong> — GPTBot, ClaudeBot, PerplexityBot, Google-Extended, DeepSeekBot, xAI-Bot, Meta-ExternalAgent, and 60 more</li>
<li><strong>Real-Time Dashboard</strong> — Stat cards (7d/30d/90d/all-time), 30-day SVG trend chart, top bots leaderboard</li>
<li><strong>AI Blind Spots</strong> — Discover pages invisible to AI bots with AI Discovery Score (0-100). Find and fix content gaps</li>
<li><strong>Crawler Logs</strong> — Full log with filtering by bot, URL path, and date range. Paginated for large datasets</li>
<li><strong>CSV Export</strong> — Download your bot data for offline analysis</li>
<li><strong>Cache Plugin Detection</strong> — Auto-detects WP Rocket, LiteSpeed, W3 Total Cache, WP Super Cache. Provides setup guides to exclude AI bots from caching</li>
<li><strong>90-Day Auto-Cleanup</strong> — Keeps your database lean. No bloat, no maintenance</li>
<li><strong>100% Local</strong> — All data stored in your WordPress database. No external accounts, no API calls</li>
</ul>
<h4>🔍 Get Found by AI Search Engines</h4>
<p>Your site gets an llms.txt file — a new standard that tells AI crawlers what your site is about, what content you publish, and what products you sell. Think of it as robots.txt, but for AI.</p>
<h4>📊 Speak AI’s Language with Schema.org</h4>
<p>Automatically generates structured data (JSON-LD) that AI agents actually understand — your organization info, articles, products, and more. Better structured data = better AI recommendations.</p>
<h4>📄 Serve Clean Content to AI Agents</h4>
<p>When ChatGPT or Perplexity visit your page, citelayer® serves an optimized Markdown version instead of messy HTML. This uses 80% fewer tokens and gives AI a crystal-clear picture of your content.</p>
<h4>🛡️ Stay in Control of Your Content</h4>
<p>Configure how AI systems may use your content — allow or deny training, search indexing, and RAG/context usage. Your content, your rules.</p>
<h4>🛒 Works with WooCommerce</h4>
<p>If you run a shop, citelayer® makes your products visible to AI:</p>
<ul>
<li>Product data automatically included in llms.txt</li>
<li>Product Schema.org markup generated</li>
<li>Product pages served as structured Markdown tables</li>
<li>AI agents can discover your shop via UCP (Universal Commerce Protocol)</li>
</ul>
<h4>📈 Why AI Visibility Matters Now</h4>
<ul>
<li><strong>58% of online searches</strong> will involve AI by the end of 2026</li>
<li>Generative Engine Optimization (GEO) and Answer Engine Optimization (AEO) are the next evolution of SEO</li>
<li>Sites without AI-readable content are <strong>invisible</strong> to ChatGPT, Claude, Perplexity, and AI Overviews</li>
<li>citelayer® is the easiest way to make your WordPress site AI-ready</li>
</ul>
<h4>✅ Free vs. Premium</h4>
<p>The free plugin covers everything you need to get started:</p>
<p>✅ llms.txt generation<br />
✅ Schema.org markup (Organization, WebSite, Article, Product)<br />
✅ Markdown for AI agents<br />
✅ Content-Signal headers<br />
✅ WooCommerce product discovery<br />
✅ AI Bot Analytics (67 bots, dashboard, AI Blind Spots, CSV export)<br />
✅ AI Referral Tracking (Visits from ChatGPT, Perplexity, Claude, Gemini, Copilot)<br />
✅ AI Readiness Scanner<br />
✅ Cache plugin detection & setup guides</p>
<p><strong>Premium adds:</strong></p>
<p>🚀 Full UCP product browsing, cart & checkout for AI agents<br />
📈 AI Visibility Monitoring Dashboard<br />
🔧 Advanced Schema.org (Reviews, FAQ, Shipping)<br />
🛒 Product feed optimization</p>
<p><a href="https://citelayer.ai/premium/" rel="nofollow ugc">Learn more about Premium <span aria-hidden="true" class="wp-exclude-emoji">→</span></a></p>
<p><strong>Get your AI Audit</strong><br />
citelayer® offers thorough AI Visibility Audits as a Service.<br />
<a href="https://citelayer-ai.com/" rel="nofollow ugc">We help you become visible</a></p>


citelayer® – AI SEO & Visibility | llms.txt, Bot Analytics, Schema.org

Get found by ChatGPT, Perplexity & AI search. AI Visibility, llms.txt, Schema.org — make your site the answer AI recommends.

LLMs.txt Curator vs citelayer® – AI SEO & Visibility | llms.txt, Bot Analytics, Schema.org