dyaylaci

DY LLMs.txt Tool allows you to take control of how AI crawlers (ChatGPT, Claude, Perplexity, Google-Extended) verify and index your content. Improve your AEO (Answer Engine Optimization) by generating a structured, machine-readable <code>llms.txt</code> file automatically.
Unlike a standard <code>robots.txt</code> which blocks bots, <code>llms.txt</code> creates a semantic map of your site, helping Large Language Models (LLMs) understand your content context better and reducing hallucinations.
<h3>🚀 Key Features</h3>
<ul>
<li>📈 AEO Ready: Prepare your website for the future of AI Search.</li>
<li>🛍️ WooCommerce Support: Automatically include Product categories and essential shop pages.</li>
<li>🧩 Perfect Integration: Fully compatible with Yoast SEO, Rank Math, and All in One SEO. It respects your <code>noindex</code> settings automatically.</li>
<li>🌍 Multilingual Ready: Seamless integration with WPML and Polylang. Generates separate endpoints for each language.</li>
<li>🛡️ Privacy First: Built-in PII Scrubber to mask emails and phone numbers from AI bots.</li>
<li>🤖 Bot Tracker: Monitor which AI agents (GPTBot, ClaudeBot, etc.) are accessing your file.</li>
<li>⚡ Performance: Offers both Dynamic (on-the-fly) and Static (Cached) generation modes for high-traffic sites.</li>
</ul>
<h3>💡 Why do you need this?</h3>
AI Search Engines don’t browse websites like humans. They need structured text data. This plugin bridges the gap between your WordPress content and AI models, ensuring your brand is represented correctly in AI-generated answers. 
Key features:
<ul>
<li>Entity Clustering: Group content by taxonomy (categories/tags) to create a structured index.</li>
<li>Bot Tracking: Track and report visits from popular AI user agents.</li>
<li>Smart Exclusion: Exclude content manually, by ID, or automatically when marked as <code>noindex</code> by SEO plugins.</li>
<li>Dynamic or Static generation: Generate on-the-fly or write a cached static file for performance.</li>
<li>Privacy controls: Optional masking of emails and phone numbers.</li>
<li>Multilingual support: Works with popular multilingual plugins and can generate separate indexes per language.</li>
</ul>

DY LLMs.txt Tool

Create and manage an llms.txt file for AI crawlers to improve AEO (Answer Engine Optimization) and provide an authoritative AI index for your site.

Samir Shah

Matt Calvert

This plugin issues an HTTP <code>410</code> response for URLs corresponding to content that has been permanently removed from your site. Originally created by Samir Shah, now maintained by Matt Calvert. When a post or page is deleted, the plugin logs the old URL and returns a <code>410</code> response when that URL is requested. You can also manually manage the list of obsolete URLs.
The <a href="http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html#sec10.4.11" rel="nofollow ugc">HTTP Specification</a> defines the <code>410 Gone</code> response for resources that have been permanently removed. It informs search engines and crawlers that the content will not return, improving crawl efficiency and SEO clarity.
This plugin is actively maintained by Matt Calvert as a personal project, informed by previous professional experience with similar 410-handling logic. No proprietary or employer-owned code has been used.

HTTP 410 (Gone) responses


Still working when tested but an update would be nice to avoid getting hacked or breakdown of site


still working

Sends HTTP 410 (Gone) responses for deleted content, telling search engines the page is permanently removed.

DY LLMs.txt Tool vs HTTP 410 (Gone) responses