dyaylaci

<p><strong>DY LLMs.txt Tool</strong> allows you to take control of how AI crawlers (ChatGPT, Claude, Perplexity, Google-Extended) verify and index your content. Improve your AEO (Answer Engine Optimization) by generating a structured, machine-readable <code>llms.txt</code> file automatically.</p>
<p>Unlike a standard <code>robots.txt</code> which blocks bots, <code>llms.txt</code> creates a <strong>semantic map</strong> of your site, helping Large Language Models (LLMs) understand your content context better and reducing hallucinations.</p>
<h3>🚀 Key Features</h3>
<ul>
<li><strong>📈 AEO Ready:</strong> Prepare your website for the future of AI Search.</li>
<li><strong>🛍️ WooCommerce Support:</strong> Automatically include Product categories and essential shop pages.</li>
<li><strong>🧩 Perfect Integration:</strong> Fully compatible with <strong>Yoast SEO</strong>, <strong>Rank Math</strong>, and <strong>All in One SEO</strong>. It respects your <code>noindex</code> settings automatically.</li>
<li><strong>🌍 Multilingual Ready:</strong> Seamless integration with <strong>WPML</strong> and <strong>Polylang</strong>. Generates separate endpoints for each language.</li>
<li><strong>🛡️ Privacy First:</strong> Built-in PII Scrubber to mask emails and phone numbers from AI bots.</li>
<li><strong>🤖 Bot Tracker:</strong> Monitor which AI agents (GPTBot, ClaudeBot, etc.) are accessing your file.</li>
<li><strong>⚡ Performance:</strong> Offers both Dynamic (on-the-fly) and Static (Cached) generation modes for high-traffic sites.</li>
</ul>
<h3>💡 Why do you need this?</h3>
<p>AI Search Engines don’t browse websites like humans. They need structured text data. This plugin bridges the gap between your WordPress content and AI models, ensuring your brand is represented correctly in AI-generated answers.<br />
Key features:</p>
<ul>
<li>Entity Clustering: Group content by taxonomy (categories/tags) to create a structured index.</li>
<li>Bot Tracking: Track and report visits from popular AI user agents.</li>
<li>Smart Exclusion: Exclude content manually, by ID, or automatically when marked as <code>noindex</code> by SEO plugins.</li>
<li>Dynamic or Static generation: Generate on-the-fly or write a cached static file for performance.</li>
<li>Privacy controls: Optional masking of emails and phone numbers.</li>
<li>Multilingual support: Works with popular multilingual plugins and can generate separate indexes per language.</li>
</ul>


DY LLMs.txt Tool

Create and manage an llms.txt file for AI crawlers to improve AEO (Answer Engine Optimization) and provide an authoritative AI index for your site.

Viktor Szépe

<h4>This plugin needs more documentation!</h4>
<p>You can edit your robots.txt and add remote content to it.<br />
E.g. you have several sites and want to use a centralized robots.txt.</p>
<h4>Features</h4>
<ul>
<li>Include or exclude WordPress’ own robots.txt (core function)</li>
<li>Include or exclude plugins – e.g. sitemap plugins – output to robots.txt (filter output)</li>
<li>Include or exclude a remote text file (the common part)</li>
<li>Include or exclude custom records from the settings page (the site specific part)</li>
</ul>
<h4>Where is robot.txt?</h4>
<p>WordPress handles robots.txt as a virtual URL – just the same way as posts and pages.</p>
<p>So when you browse to <code>https://example.com/robots.txt</code> WordPress generates robots.txt on the fly.</p>
<h4>TODO</h4>
<ul>
<li>add more description here</li>
<li>add a video too</li>
<li>add an admin notice for subdir installs (robots.txt is useless in a subdir)</li>
<li>‘At least one “Disallow” field must be present in the robots.txt file.’ – check for that</li>
</ul>
<h4>Links</h4>
<p>Development of this plugin goes on on <a href="https://github.com/szepeviktor/multipart-robotstxt-editor" rel="nofollow ugc">GitHub</a>.</p>


Multipart robots.txt editor

Customize your site's robots.txt and include remote content to it

DY LLMs.txt Tool vs Multipart robots.txt editor