Ibrahim Elsherbiny

MCPner LLMs.txt Generator – Make Your Website AI-Ready
MCPner LLMs.txt Generator creates a machine-readable text file (<code>/llms.txt</code>) from your WordPress content, helping AI systems like ChatGPT, Claude, and other LLMs understand your site structure and content.
Similar to how <code>robots.txt</code> helps search engines, <code>llms.txt</code> helps AI systems access your content in a clean, optimized format.
<h4>Key Features</h4>
<ul>
<li>Unlimited Content – Include all your posts, pages, and custom post types</li>
<li>Quick Select Mode – Easily choose which content types to include</li>
<li>Advanced Selection – Pick specific items by taxonomy or individual selection</li>
<li>Per-Item Exclusion – Toggle exclusion for individual posts/pages</li>
<li>Auto-Regeneration – Automatically update when content changes</li>
<li>Robots.txt Integration – Add AI bot rules for better discoverability</li>
<li>Static File Generation – Creates a static <code>/llms.txt</code> file at your site root</li>
<li>SEO Plugin Integration – Automatically uses meta descriptions from Yoast, Rank Math, or All in One SEO</li>
<li>Progress Indicator – Visual feedback during file generation</li>
<li>Clean Output – Properly formatted, human and machine-readable output</li>
</ul>
<h4>Features Include</h4>
<ul>
<li>Unlimited links in your llms.txt file</li>
<li>All content types (posts, pages, custom post types, WooCommerce products, etc.)</li>
<li>Advanced Selection Mode with tree-based selection</li>
<li>Auto-regeneration on content changes</li>
<li>Scheduled regeneration options</li>
<li>Robots.txt integration for AI bot rules</li>
<li>Per-item exclusion toggle</li>
<li>Advanced pattern and taxonomy exclusions</li>
<li>Manual generation with progress indicator</li>
</ul>
<h4>How It Works</h4>
Requirements: WordPress Administrator access (user with <code>manage_options</code> capability)
<ol>
<li>Install and activate the plugin</li>
<li>Log in as an Administrator (not Editor/Author/Subscriber)</li>
<li>Go to LLMs.txt in your WordPress admin sidebar menu</li>
<li>On the Settings tab, you’ll see the main dashboard with a “Generate Now” button</li>
<li>Optionally configure content selection in the “Content Selection” tab</li>
<li>Click Generate Now to create your llms.txt file</li>
<li>View your generated file at <code>https://yoursite.com/llms.txt</code></li>
</ol>
AI systems and LLMs can now access your content at <code>https://yoursite.com/llms.txt</code>
<h4>Run This on Dublyo Hosting</h4>
This plugin now includes all core capabilities by default with no license gate. If you want managed WordPress hosting optimized for AI-era workflows, check <a href="https://dublyo.com" rel="nofollow ugc">Dublyo</a>.
Dublyo helps teams run WordPress with automated infrastructure, lower hosting costs, and deployment-friendly tooling.
<h4>Use Cases</h4>
<ul>
<li>Help AI assistants understand your website</li>
<li>Improve AI-powered search results for your content</li>
<li>Provide clean, structured data for machine learning systems</li>
<li>Create AI-friendly documentation of your site</li>
<li>Optimize for next-generation AI search engines</li>
</ul>
<h4>Developer Friendly</h4>
MCPner LLMs.txt Generator includes hooks and filters for developers:
<ul>
<li><code>mcpner_llmstxt_content</code> – Modify content before adding to llms.txt</li>
<li><code>mcpner_llmstxt_output</code> – Customize the complete output</li>
<li><code>mcpner_llmstxt_query_args</code> – Modify the content query</li>
<li><code>mcpner_llmstxt_before_generate</code> – Action before generation starts</li>
<li><code>mcpner_llmstxt_after_generate</code> – Action after generation completes</li>
</ul>

MCPner LLMs.txt Generator

Make your website AI-ready with LLM-optimized content files. Generate llms.txt files for ChatGPT, Claude, and other AI systems.

Ayuda WordPress

Fernando Tellado

VigIA (Spanish for “lookout” or “watchman”, incorporating “IA” – Spanish for “AI”) is a complete AI visibility toolkit for WordPress. Monitor 55+ AI crawlers, control access to your content, and optimize how AI systems discover and understand your site.
<h4>What does VigIA do?</h4>
<ul>
<li>Scores your AI visibility with a 100-point analyzer covering 20 checks across 5 categories</li>
<li>Tracks AI crawlers visiting your site (GPTBot, ClaudeBot, PerplexityBot, and 55+ others)</li>
<li>Provides detailed analytics with charts, statistics, and exportable reports</li>
<li>Blocks unwanted crawlers via PHP (403 response)</li>
<li>Manages robots.txt rules for AI crawlers with compliance monitoring</li>
<li>Sends email alerts about crawler activity (daily, weekly, or monthly)</li>
<li>Generates llms.txt files to help AI systems understand your site</li>
<li>Serves markdown endpoints for individual posts and pages (Markdown for Agents standard)</li>
<li>Generates JSON-LD structured data with Site Identity and AI Discovery signals</li>
<li>Exposes abilities for AI agents and automation tools (WordPress 6.9+)</li>
</ul>
<h4>Key Features</h4>
AI Visibility Analyzer 
* 100-point scoring system with letter grades (A+ to F) 
* 20 individual checks across 5 categories 
* Access & AI Discovery (37 pts): robots.txt, AI bot directives, Content Signals, llms.txt, sitemap, RSS feed 
* Structured Data & Semantic Context (25 pts): JSON-LD schemas, Open Graph, Twitter Cards, meta description, canonical URL 
* Content Structure & Readability (20 pts): heading hierarchy, semantic HTML5, image alt text, content/HTML ratio 
* AI Interaction & Distribution (8 pts): markdown delivery, AI share buttons 
* Access Performance (10 pts): TTFB measurement 
* Smart recommendations with direct links to VigIA features and plugin suggestions 
* Analyze any page on your site with URL autocomplete selector 
* Results cached for 24 hours with manual re-analyze option
Analytics Dashboard 
* Total visits, unique crawlers, and pages crawled statistics 
* Timeline chart with daily breakdown 
* Category distribution (AI Training, AI Search, AI Assistant, Data Scraper) 
* Top crawlers and most crawled pages tables with paginated navigation 
* <a href="https://wordpress.org/plugins/ai-share-summarize/" rel="ugc">AI Share & Summarize</a> integration: see share button clicks per page 
* Recent activity log with filters and paginated navigation 
* Period comparison functionality 
* CSV export
Crawler Blocking 
* Block crawlers via PHP with 403 Forbidden response 
* Quick block dropdown in analytics dashboard 
* Manage blocks from Extras page 
* Works on any server (Apache, Nginx, LiteSpeed, etc.)
Robots.txt Management 
* Add Disallow rules for AI crawlers 
* Visual preview of your robots.txt 
* Compliance monitoring: see which crawlers ignore your rules 
* One-click blocking for non-compliant crawlers 
* Works with both physical and virtual robots.txt
Email Alerts 
* Daily, weekly, or monthly reports 
* Three detail levels: Minimal, Normal, Complete 
* Non-compliant crawler warnings 
* Activity comparison with previous period
Markdown for Agents 
* Serve individual posts/pages as optimized markdown for AI agents 
* Dedicated .md URL endpoints (e.g., /your-post.md) 
* Accept: text/markdown content negotiation 
* Discoverability via link headers and HTML alternate tags 
* YAML frontmatter with title, date, author, categories, tags, and more 
* Respects blocking rules (blocked crawlers get 403) 
* Respects LLMs.txt exclusion filters 
* Analytics integration: tracks markdown requests per crawler 
* X-Markdown-Tokens response header 
* Follows the Cloudflare Markdown for Agents standard
LLMs.txt Generator 
* Select content by post type with one click 
* Filter by taxonomies (categories, tags, custom) 
* Manual include/exclude with AJAX search 
* Exclude by URL patterns (wildcards supported) 
* SEO plugin integration (auto-exclude noindex content) 
* Auto-regeneration (daily, weekly, monthly) 
* Robots.txt integration (add llms.txt and llms-full.txt references) 
* Generate llms.txt and llms-full.txt files 
* Full content or excerpt mode 
* Compatible with Yoast SEO, Rank Math, All in One SEO, SEOPress, and The SEO Framework
JSON-LD Structured Data 
* Generate WebSite and Organization/Person schema for site identity 
* AI Discovery: ReadAction pointers to llms.txt, llms-full.txt, and Markdown for Agents endpoints 
* Social profiles and sameAs links for brand identity across the web 
* SearchAction for Google sitelinks search box 
* Media library integration for logo selection 
* SEO plugin conflict detection (Yoast, Rank Math, AIOSEO, SEOPress, The SEO Framework) 
* Choose output page (front page or any published page) 
* Live JSON-LD preview with real-time updates 
* Smart integration with LLMs.txt and Markdown for Agents features
<h4>Supported AI Crawlers</h4>
VigIA monitors 55+ AI crawlers including:
<ul>
<li>OpenAI: GPTBot, OAI-SearchBot, ChatGPT-User</li>
<li>Anthropic: ClaudeBot, Claude-Web, Claude-SearchBot</li>
<li>Google: Google-Extended, GoogleOther, Gemini-Deep-Research</li>
<li>Perplexity: PerplexityBot, Perplexity-User</li>
<li>Meta: Meta-ExternalAgent, FacebookBot</li>
<li>Microsoft: BingBot</li>
<li>ByteDance: Bytespider</li>
<li>Amazon: Amazonbot</li>
<li>Apple: Applebot-Extended</li>
<li>And many more…</li>
</ul>
<h4>Privacy Focused</h4>
VigIA stores visitor data locally in your WordPress database. No data is sent to external servers.
<h3>Abilities API</h3>
VigIA is one of the first WordPress plugins to implement the <a href="https://developer.wordpress.org/apis/abilities-api/" rel="nofollow ugc">Abilities API</a> introduced in WordPress 6.9. This API allows AI agents, automation tools, and external systems to discover and interact with VigIA’s functionality in a standardized, secure way.
<h4>What are Abilities?</h4>
Abilities are self-contained units of functionality that VigIA exposes through WordPress’s central registry. Each ability has defined inputs, outputs, and permissions, making it easy for automation tools to understand and use them.
<h4>Available Abilities</h4>
VigIA registers the following abilities:
Analytics
<ul>
<li><code>vigia/get-crawler-stats</code> – Get statistics about AI crawler visits (total visits, unique crawlers, pages crawled)</li>
<li><code>vigia/get-top-crawlers</code> – Get a ranked list of most active AI crawlers</li>
<li><code>vigia/get-top-pages</code> – Get the most crawled pages on your site</li>
</ul>
Blocking
<ul>
<li><code>vigia/get-blocked-items</code> – List all blocked crawlers and IP addresses</li>
<li><code>vigia/block-crawler</code> – Block a crawler by User-Agent pattern</li>
<li><code>vigia/unblock-crawler</code> – Remove an existing block</li>
</ul>
Robots.txt
<ul>
<li><code>vigia/get-robots-rules</code> – Get current AI crawler rules in robots.txt</li>
<li><code>vigia/add-robots-disallow</code> – Add a Disallow directive for a crawler</li>
<li><code>vigia/remove-robots-rule</code> – Remove a robots.txt rule</li>
</ul>
<h4>Use Cases</h4>
<ul>
<li>Automated monitoring: AI agents can query crawler statistics and alert you to anomalies</li>
<li>Reactive blocking: Automation tools can block crawlers that repeatedly ignore robots.txt</li>
<li>External dashboards: Aggregate data from multiple WordPress sites with VigIA installed</li>
<li>WP-CLI integration: Future command-line access through the Abilities API</li>
<li>n8n / Make workflows: Build custom automation flows using VigIA’s abilities</li>
</ul>
<h4>Requirements</h4>
The Abilities API requires WordPress 6.9 or later. On older WordPress versions, VigIA works normally but abilities are not available.
<h3>Support</h3>
Need help or have suggestions?
<ul>
<li><a href="https://servicios.ayudawp.com" rel="nofollow ugc">Official website</a></li>
<li><a href="https://wordpress.org/support/plugin/vigia/" rel="ugc">WordPress support forum</a></li>
<li><a href="https://www.youtube.com/AyudaWordPressES" rel="nofollow ugc">YouTube channel</a></li>
<li><a href="https://ayudawp.com" rel="nofollow ugc">Documentation and tutorials</a></li>
</ul>
Love the plugin? Please leave us a 5-star review and help spread the word!
<h3>About AyudaWP</h3>
We are specialists in WordPress security, SEO, AI and performance optimization plugins. We create tools that solve real problems for WordPress site owners while maintaining the highest coding standards and accessibility requirements.

VigIA – AI Visibility, Analytics & Control

Monitor 55+ AI crawlers, control access via robots.txt, and boost your AI visibility with llms.txt, JSON-LD, Markdown for Agents & Visibility Score.

MCPner LLMs.txt Generator vs VigIA – AI Visibility, Analytics & Control