Arkology Studio

<p>AI agents are becoming the new browsers and web surfers. As AI agents become increasingly autonomous they’ll begin to make up the vast majority of website traffic, browsing and even purchasing products online.<br />
Already today, popular AI services such as ChatGPT, Claude, and Perplexity increasingly search and interact with content on the web. AI Ready is a suite of tools for optimizing your website for AI discoverability and comprehension, ultimately leading to increased traffic and conversions.</p>
<h4>Key Features</h4>
<ul>
<li>
<p><strong>AI-Readiness Diagnostics</strong></p>
<ul>
<li>0-100% AI-Ready score with detailed breakdown</li>
<li>Checks llms.txt accessibility and validity</li>
<li>Validates robots.txt AI bot permissions (GPTBot, Claude-Web, etc.)</li>
<li>Detects noai meta tags</li>
<li>Checks JSON-LD structured data presence</li>
<li>Additional checks for XML sitemaps, accessibility, and SEO</li>
</ul>
</li>
<li>
<p><strong>llms.txt Generation</strong></p>
<ul>
<li>Serves <code>/llms.txt</code> with proper <code>text/plain</code> content type</li>
<li>Automatically finds and catalogs your published pages</li>
<li>Extracts meaningful page descriptions using content analysis</li>
<li>Refreshes content when pages are published or updated</li>
<li>Allows advanced users to add custom markdown sections</li>
</ul>
</li>
<li>
<p><strong>Agent Gate</strong></p>
<ul>
<li>Configure robots.txt to allow or block specific AI agents (GPTBot, Claude-Web, Perplexity, etc.)</li>
</ul>
</li>
</ul>


AI-Ready Core

Transform your WordPress site for the Agentic Web. Enhance discoverability and conversions by AI Agents.

roehler

<p>A comprehensive WordPress plugin that generates and maintains an <code>llms.txt</code> file for your website, following the <a href="https://llmstxt.org/" rel="nofollow ugc">llms.txt specification</a> for AI training data documentation.</p>
<h4>Features</h4>
<h4>Core Functionality</h4>
<ul>
<li><strong>Automatic llms.txt Generation</strong>: Creates and maintains an <code>llms.txt</code> file in your website’s root directory</li>
<li><strong>llms.txt Specification Compliance</strong>: Follows the official llms.txt format for AI training data documentation</li>
<li><strong>Dynamic Content Updates</strong>: Automatically updates the file when content changes (configurable)</li>
<li><strong>URL Rewriting</strong>: Serves llms.txt content via <code>/llms.txt</code> URL with proper headers</li>
</ul>
<h4>Admin Interface</h4>
<ul>
<li>Comprehensive Settings Page: Easy-to-use admin interface in WordPress dashboard</li>
<li>File Status Display: Shows current file status, size, last modified date, and generation timestamp</li>
<li>Content Configuration: Select which post types, taxonomies, and metadata to include</li>
<li>Real-time Preview: View your current llms.txt file directly from the admin interface</li>
</ul>
<h4>Content Management</h4>
<ul>
<li>Post Type Selection: Choose which post types to include (posts, pages, custom post types)</li>
<li>Taxonomy Integration: Include categories, tags, and custom taxonomies</li>
<li>Content Filtering: Configure publication status, date ranges, and content limits</li>
<li>Metadata Options: Include/exclude author information, publish dates, excerpts, etc.</li>
<li>Content Limits: Set maximum posts per type and word limits for excerpts</li>
</ul>
<h4>Cache Management</h4>
<ul>
<li>Performance Optimization: Built-in caching system for improved performance</li>
<li>Configurable Cache Duration: Set custom cache expiration times</li>
<li>Manual Cache Control: Refresh or clear cache on demand</li>
<li>Cache Status Monitoring: View cache size, age, and status in admin interface</li>
</ul>
<h4>Technical Features</h4>
<ul>
<li>WordPress Standards Compliance: Follows WordPress coding standards and best practices</li>
<li>Security First: Proper input sanitization, validation, and nonce verification</li>
<li>Extensible Architecture: Hooks and filters for developers to extend functionality</li>
<li>Multisite Compatible: Works with WordPress multisite installations</li>
<li>Clean Uninstall: Removes all data and files when plugin is deleted</li>
</ul>
<h3>Configuration</h3>
<h4>Content Settings</h4>
<ul>
<li>Post Types: Select which post types to include in your llms.txt file</li>
<li>Content Options: Configure maximum posts per type, excerpt length, meta information</li>
<li>Update Frequency: Choose immediate, hourly, daily, or manual updates</li>
<li>Cache Management: Enable caching, set duration, and monitor cache status</li>
</ul>
<h3>Usage</h3>
<p>Once configured, your llms.txt file will be available at: <code>https://yourwebsite.com/llms.txt</code></p>
<h4>Sample Output</h4>
<pre><code>`markdown
</code></pre>
<p>My WordPress Website</p>
<blockquote>
<p>A comprehensive blog about web development, WordPress tutorials, and digital marketing strategies.</p>
</blockquote>
<p>This WordPress website contains the following types of content:</p>
<ul>
<li>Posts: 150 published items</li>
<li>Pages: 25 published items</li>
<li>Portfolio: 12 published items</li>
</ul>
<h3>Posts</h3>
<ul>
<li><a href="https://yoursite.com/getting-started-wordpress-development?format=md" rel="nofollow ugc">Getting Started with WordPress Development</a>: A comprehensive guide for beginners looking to start developing with WordPress…</li>
<li><a href="https://yoursite.com/advanced-custom-fields-tutorial?format=md" rel="nofollow ugc">Advanced Custom Fields Tutorial</a>: Learn how to use ACF to create custom content types and fields…</li>
<li><a href="https://yoursite.com/wordpress-security-best-practices?format=md" rel="nofollow ugc">WordPress Security Best Practices</a>: Essential security measures every WordPress site owner should implement…</li>
</ul>
<h3>Pages</h3>
<ul>
<li><a href="https://yoursite.com/about?format=md" rel="nofollow ugc">About Us</a>: Learn about our company history, mission, and team…</li>
<li><a href="https://yoursite.com/services?format=md" rel="nofollow ugc">Services</a>: Comprehensive overview of our web development and consulting services…</li>
<li><a href="https://yoursite.com/contact?format=md" rel="nofollow ugc">Contact</a>: Get in touch with our team for project inquiries…</li>
</ul>
<h3>Optional</h3>
<ul>
<li><a href="https://yoursite.com/category/" rel="nofollow ugc">Categories</a>: Available categories and tags</li>
<li><a href="https://yoursite.com/tag/" rel="nofollow ugc">Tags</a>: Available categories and tags<br />
`</li>
</ul>
<h3>Developer Information</h3>
<p>The plugin provides several hooks for developers:</p>
<h4>Actions</h4>
<ul>
<li><code>llms_txt_file_generator_before_generate</code> – Before llms.txt content is generated</li>
<li><code>llms_txt_file_generator_after_generate</code> – After llms.txt content is generated</li>
<li><code>llms_txt_file_generator_before_cache_clear</code> – Before cache is cleared</li>
</ul>
<h4>Filters</h4>
<ul>
<li><code>llms_txt_file_generator_content</code> – Modify llms.txt content before output</li>
<li><code>llms_txt_file_generator_post_entry</code> – Modify post entry format</li>
<li><code>llms_txt_file_generator_cache_duration</code> – Modify cache duration</li>
</ul>


Basis LLMs.txt File Generator

Generates and maintains an llms.txt file for AI training data documentation following the llms.txt specification.

AI-Ready Core vs Basis LLMs.txt File Generator