Ambiscale

<p>As AI tools like ChatGPT, Claude, and Perplexity change how people search, <strong>Ambiscale LLMs Friendly</strong> plugin ensures your website is accurately represented – enhancing visibility and accuracy in AI-driven recommendations.</p>
<h3>Why do I need it?</h3>
<p>With AI tools playing a growing role in content discovery and analysis, websites need a reliable, standardized way to communicate with large language models. Our plugin takes care of this automatically – generating structured, LLM-friendly text files that help AI systems accurately interpret and present your WordPress content.</p>
<h3>What is llms.txt</h3>
<p>The llms.txt (similar to robots.txt) is a proposed standard for helping large language models understand website content during inference time. It provides a structured markdown file called llms.txt containing key information about your site, making it easier for AI tools to:</p>
<ul>
<li>Quickly understand what your site is about</li>
<li>Access the most important content</li>
<li>Navigate your site’s structure efficiently</li>
<li>Work within context window limitations</li>
</ul>
<h3>When to use LLMs.txt</h3>
<ul>
<li><strong>Developer documentation</strong> – Ensure AI coding assistants can easily access and understand your technical content.  </li>
<li><strong>Business websites</strong> – Help AI tools accurately interpret your products, services, and company details.  </li>
<li><strong>Educational resources</strong> – Make it easier for AI tutors to explain and navigate your learning materials.  </li>
<li><strong>News & blogs</strong> – Allow AI to summarize, reference, and contextualize your articles with greater precision.  </li>
<li><strong>E-commerce sites</strong> – Enable AI shopping assistants to read and reason over your product catalog.  </li>
<li><strong>Personal portfolios</strong> – Showcase your work and achievements in a format that’s accessible to AI models.</li>
</ul>
<h3>Key features</h3>
<h3>Automatic llms.txt Generation</h3>
<ul>
<li>Creates <code>/llms.txt</code> file following the official specification format</li>
<li>Includes site name, summary, and detailed description</li>
<li>Organizes content by post types with customizable headings</li>
<li>Automatically updates when content changes</li>
</ul>
<h3>Extended Content Support</h3>
<ul>
<li>Generates optional <code>/llms-full.txt</code> with complete post content</li>
<li>Creates individual markdown files for each post</li>
<li>Supports selective export of specific posts</li>
<li>Maintains clean, AI-readable markdown format</li>
</ul>
<h3>Markdown Page Endpoints</h3>
<ul>
<li>Adds <code>?format=md</code> parameter to any post/page URL for markdown version</li>
<li>Implements the llms.txt specification’s <code>.md</code> URL pattern proposal</li>
<li>Blocks search engine bots from accessing markdown versions</li>
<li>Perfect for development environments and API documentation</li>
</ul>
<h3>Flexible Configuration</h3>
<ul>
<li>Choose which post types to include (posts, pages, custom post types)</li>
<li>Customize section headings for each post type</li>
<li>Set custom excerpts specifically for LLM consumption</li>
<li>Control excerpt generation for posts without manual excerpts</li>
</ul>
<h3>Advanced File Management</h3>
<ul>
<li>Choose export location: uploads, wp-content, or root directory</li>
<li>UTF-8 encoding with BOM for maximum compatibility</li>
<li>Automatic cleanup when changing export directories</li>
<li>WordPress Filesystem API integration for security</li>
</ul>
<h3>SEO Integration</h3>
<ul>
<li>Full Yoast SEO sitemap integration</li>
<li>Adds llms.txt files to XML sitemap</li>
<li>Proper lastmod timestamps and priorities</li>
<li>Helps search engines discover your LLM-friendly content</li>
</ul>
<h3>Enterprise Security</h3>
<ul>
<li>Comprehensive security headers implementation</li>
<li>Rate limiting for file generation</li>
<li>Security event logging with IP tracking</li>
<li>Capability-based access controls</li>
<li>Input sanitization and output escaping</li>
</ul>
<h3>Modern Admin Interface</h3>
<ul>
<li>Clean, intuitive settings page with tabs</li>
<li>Live preview of generated files</li>
<li>File status monitoring</li>
<li>One-click regeneration</li>
<li>Responsive design</li>
</ul>
<p>Company site: <a href="https://ambiscale.com" rel="nofollow ugc">Ambiscale</a></p>
<h3>Privacy Policy</h3>
<p>This plugin does not:<br />
– Collect any personal data<br />
– Send data to external servers<br />
– Use cookies<br />
– Track users</p>
<p>All generated files contain only publicly available content from your WordPress site.</p>
<h3>Credits</h3>
<ul>
<li>Developed by <a href="https://ambiscale.com" rel="nofollow ugc">Ambiscale</a></li>
<li>Uses League\HTMLToMarkdown for markdown conversion</li>
<li>Icons and graphics by Ambiscale design team</li>
</ul>


Ambiscale LLMs Friendly

Implements the llms.txt specification to make your WordPress content AI-friendly and optimized for Large Language Models (LLMs).

Anshul

<p>The AI Crawler and SEO Manager by akbansa plugin generates an <code>llms.txt</code> file for crawler discovery and logs visits by AI-based crawlers such as GPTBot, ClaudeBot, and others. It also provides an analytics page in the WordPress admin dashboard to view crawler activity by path, URL, and timestamp.</p>
<h3>Key Features:</h3>
<ul>
<li>Generates <code>llms.txt</code> file for crawler discovery.</li>
<li>Removes <code>llms.txt</code> on plugin uninstall</li>
<li>Schedules automatic generation of <code>llms.txt</code> daily at midnight (frequency configurable: daily, twice daily, hourly)</li>
<li>Uses atomic file writes for <code>llms.txt</code> and <code>sitemap.xml</code> for safety</li>
<li>Integrates with Yoast SEO, Rank Math, or All in One SEO for metadata (falls back to DB if not present)</li>
<li>Admin panel to select/exclude categories and content types for <code>llms.txt</code></li>
<li>Logs every AI crawler request from the frontend (user agent, crawl info, page URL, IP, referrer)</li>
<li>Filters crawlers using <code>config.json</code> and stores all details in a dedicated DB table</li>
<li>Analytics dashboard in admin to view recent crawler activity</li>
<li>Robust AJAX security and error handling</li>
<li>Detects and logs visits from AI crawlers based on their User-Agent.</li>
<li>Stores crawler logs in a database for analysis.</li>
<li>Supports popular AI-based crawlers (e.g., OpenAI, Anthropic, GPTBot, etc.).</li>
<li>Option to customize the list of crawlers via a <code>config.json</code> file.</li>
</ul>
<h3>Short Description</h3>
<p>Advanced AI-powered SEO and analytics for WordPress. Generates llms.txt for AI crawler discovery, logs AI bot visits, and provides comprehensive analytics dashboard.</p>
<h3>Usage</h3>
<ul>
<li>After activation, the plugin will automatically start generating the <code>llms.txt</code> file and log visits from AI-based crawlers.</li>
<li>The crawler logs are stored in the database for analysis.</li>
<li>You can view analytics by navigating to <strong>LLMS Crawlers</strong> in the WordPress admin menu.</li>
</ul>
<h3>Admin Analytics</h3>
<p>The admin panel will display a list of the most recent crawler visits, showing the following information:<br />
– Path<br />
– URL<br />
– Crawler Name<br />
– Timestamp</p>
<h3>Support</h3>
<p>If you encounter any issues, please feel free to reach out via the plugin support page or create an issue on the GitHub repository.</p>
<h3>License</h3>
<p>This plugin is licensed under the GPLv2 or later.</p>
<h3>New Features</h3>
<ol>
<li><strong>Admin Settings Filter</strong>: You can now filter active pages, products, categories, and posts for generating the <code>llms.txt</code>.</li>
<li><strong>Sitemap Handling</strong>: If a <code>sitemap.xml</code> exists, it will be used to get the list of pages. If not, the database will be used as a fallback.</li>
<li><strong>SEO Plugin Integration</strong>: The plugin integrates with Yoast SEO, All in One SEO, and Rank Math to fetch metadata for the <code>llms.txt</code> file.</li>
<li><strong>Frequency Setting</strong>: You can choose the frequency for regenerating the <code>llms.txt</code> file (daily, weekly, monthly, hourly).</li>
<li><strong>Traffic Capture and AI Agent Logging</strong>: A front-end script captures traffic, sends it to the backend, and logs AI agents based on a <code>config.json</code> file.</li>
<li><strong>Sitemap Update</strong>: The <code>sitemap.xml</code> is automatically updated with the absolute path to the <code>llms.txt</code> and the updated timestamp.</li>
</ol>


AI Crawler and SEO Manager by akbansa

The AI Crawler and SEO Manager by akbansa plugin generates an llms.txt file for crawler discovery and logs visits by AI-based crawlers such as GPTBot, …

Ambiscale LLMs Friendly vs AI Crawler and SEO Manager by akbansa