ProAI

<p>ProAI TXT Manager for LLMS and Robots is a powerful WordPress plugin that automatically generates and maintains essential txt files for your website:</p>
<ul>
<li><strong>llms.txt</strong> – Provides structured information for AI language models about your site’s content, navigation, and structure</li>
<li><strong>robots.txt</strong> – Controls search engine crawler access and includes sitemap references</li>
</ul>
<h4>Key Features</h4>
<ul>
<li><strong>Automatic Generation</strong>: Creates both llms.txt and robots.txt files automatically</li>
<li><strong>AI-Optimized Content</strong>: Structures llms.txt content specifically for AI language models</li>
<li><strong>Auto-Regeneration</strong>: Updates files automatically when your content changes</li>
<li><strong>Custom Content</strong>: Add your own custom information to both files</li>
<li><strong>SEO Integration</strong>: Automatically detects and includes sitemaps from popular SEO plugins</li>
<li><strong>WordPress Standards</strong>: Follows WordPress security and coding standards</li>
<li><strong>Easy Management</strong>: Simple admin interface for all settings</li>
</ul>
<h4>What is llms.txt?</h4>
<p>The llms.txt file is a structured text file that provides AI language models with essential information about your website, including:</p>
<ul>
<li>Site information and description</li>
<li>Navigation structure</li>
<li>Recent content and categories</li>
<li>Contact information</li>
<li>Custom information you want AI models to know</li>
</ul>
<h4>What’s Included in Robots.txt</h4>
<ul>
<li>WordPress security best practices</li>
<li>Automatic sitemap detection (Yoast, RankMath, WordPress core)</li>
<li>Common WordPress disallow rules</li>
<li>Custom rules you specify</li>
<li>Crawl delay settings</li>
</ul>
<h4>Perfect For</h4>
<ul>
<li>Website owners who want to be AI-friendly</li>
<li>SEO professionals managing multiple sites</li>
<li>Developers building modern WordPress sites</li>
<li>Anyone wanting automated TXT file management</li>
</ul>
<h3>Technical Details</h3>
<h4>File Serving</h4>
<p>The plugin serves files virtually, meaning they don’t actually exist as physical files in your root directory unless you specifically choose to generate them. This prevents clutter and ensures the files are always up-to-date.</p>
<h4>Performance</h4>
<p>The plugin is designed to be lightweight and efficient. File generation only occurs when content changes, and the files are cached for optimal performance.</p>
<h4>Security</h4>
<p>The robots.txt generation follows WordPress security best practices, including:<br />
* Disallowing access to wp-admin (except admin-ajax.php)<br />
* Disallowing access to wp-includes<br />
* Disallowing access to plugin and theme directories<br />
* Preventing access to WordPress system files</p>
<h4>Compatibility</h4>
<ul>
<li>Works with all major SEO plugins</li>
<li>Compatible with multisite installations</li>
<li>Supports custom post types and taxonomies</li>
<li>Works with custom menu structures</li>
</ul>


ProAI TXT Manager for LLMS and Robots

Automatically generates and manages llms.txt and robots.txt files for your WordPress site with AI-optimized content.

Rolf Allard van Hagen

<p>Take control of your WordPress core <strong>XML Sitemap</strong> and add a <strong>Google News Sitemap</strong>. Compatible with WordPress <strong>Multisite</strong>, <strong>Polylang</strong> and <strong>WPML</strong> and most caching plugins. There are no static files created.</p>
<p>NEW: Connect your site to your <strong>Google Search Console</strong> and <strong>Bing Webmaster Tools</strong> to keep an eye on sitemap performance and possible errors.<br />
NEW: <strong>Submit your sitemaps</strong> right from the WordPress admin. Yes, you read that correctly: Sitemap Pings are back!</p>
<h4>Features</h4>
<ul>
<li>Control the WordPress core XML Sitemaps.</li>
<li>Add a Google News Sitemap.</li>
<li>Connect your site to Google Search Console and Bing Webmaster Tools to keep an eye on sitemap performance and possible errors.</li>
<li>Submit/ping sitemaps to Google Search Console and Bing Webmaster Tools for fast reindexation.</li>
<li>Add custom robots.txt rules.</li>
</ul>
<p><strong>XML Sitemap</strong></p>
<ul>
<li>Option to disable the main XML Sitemap Index.</li>
<li>Select sitemaps to include in the sitemap index: post types, taxonomies, authors and google news.</li>
<li>Select which (custom) post types, taxonomy archives and users to include in respective sitemaps.</li>
<li>Exclude specific posts, pages and custom post type posts from sitemaps.</li>
<li>Add a custom sitemap with external URLs.</li>
<li>Add external sitemaps.</li>
<li>Choose the sitemap server/generator: WordPress core or Plugin.</li>
<li>Plugin server: Include featured images or attached images with title.</li>
<li>Choose to update Last modification date only on post modification (default) or also on comments.</li>
<li>Sitemap stylesheet templates can be overridden by theme template files.</li>
</ul>
<p><strong>Google News Sitemap</strong></p>
<ul>
<li>Optionally activate the Google News Sitemap.</li>
<li>Includes the required news sitemap tags: Publication name, language, title and publication date.</li>
<li>Set a News Publication Name (site name by default).</li>
<li>Supports custom post types.</li>
<li>Limit inclusion of certain post categories.</li>
<li>Google News Sitemap stylesheet template can be overridden by theme template files.</li>
</ul>
<h4>Pro Extensions</h4>
<p><strong><a href="https://premium.status301.com/downloads/xml-sitemap-advanced/" rel="nofollow ugc">XML Sitemap Advanced</a></strong></p>
<ul>
<li>Sitemap notifier: Automatic XML Sitemap Index update notification to Google and Bing.</li>
<li>Sitemap notifier log</li>
<li>Set a custom sitemap URL (slug)</li>
<li>Exclude posts and pages in the Bulk Editor.</li>
<li>Optionally include empty taxonomy term and empty author archives</li>
<li>Yoast SEO and Rank Math compatibility: exclude posts set to noindex</li>
</ul>
<p><strong><a href="https://premium.status301.com/downloads/google-news-advanced/" rel="nofollow ugc">Google News Advanced</a></strong></p>
<ul>
<li>Sitemap norifier: Automatic Google News Sitemap update notification to Google.</li>
<li>Sitemap notifier log</li>
<li>Multiple post types – Include more than one post type in the same News Sitemap.</li>
<li>Keywords – Add the keywords tag to your News Sitemap. Keywords can be created from Tags, Categories or a dedicated Keywords taxonomy.</li>
<li>Stock tickers – Add stock tickers tag to your News Sitemap. A dedicated Stock Tickers taxonomy will be available to manage them.</li>
</ul>
<h4>Privacy / GDPR</h4>
<p>This plugin does not collect any user or visitor data nor set browser cookies. Using this plugin should not impact your site privacy policy in any way.</p>
<p><strong>Data that is published</strong></p>
<p>An XML Sitemap index, referencing other sitemaps containing your web site’s public post URLs of selected post types that are already public, along with their last modification date and associated image URLs, and any selected public archive URLs.<br />
An author sitemap can be included, which will contain links to author archive pages. These urls contain author/user slugs, and the author archives can contain author bio information. If you wish to keep this out of public domain, then deactivate the author sitemap and use an SEO plugin to add noindex headers to the respective archive pages.</p>
<p>A Google News Sitemap containing your web site’s public and recent (last 48 hours) URLs of selected news post type, along with their publication time stamp and associated image URL.</p>
<p><strong>Data that is transmitted</strong></p>
<p>when a connection between your site and Google Search Console is configured in this plugin, the sitemap index and google news sitemap can be submitted to Google. No data is transmitted to any third party.</p>
<h4>Contribute</h4>
<p>If you’re happy with this plugin as it is, please consider writing a quick <a href="https://wordpress.org/support/plugin/xml-sitemap-feed/reviews/#new-post" rel="ugc">rating</a> or helping other users out on the <a href="https://wordpress.org/support/plugin/xml-sitemap-feed" rel="ugc">support forum</a>.</p>
<p>If you wish to help build this plugin, you’re very welcome to <a href="https://translate.wordpress.org/projects/wp-plugins/xml-sitemap-feed/" rel="nofollow ugc">translate it into your language</a> or contribute code on <a href="https://github.com/RavanH/xml-sitemap-feed/" rel="nofollow ugc">Github</a>.</p>
<h4>Credits</h4>
<p>XML Sitemap Feed was originally based on the discontinued plugin Standard XML Sitemap Generator by Patrick Chia. Since then, it has been completely rewritten and extended in many ways.</p>
<p><strong>NOTES:</strong></p>
<ol>
<li>
<p>If you <em>do not use fancy URL’s</em> or you have WordPress site running in a <em>subdirectory</em>, a dynamic <strong>robots.txt will NOT be generated</strong>.</p>
</li>
<li>
<p>On large sites, it is advised to use a good caching plugin to improve your site <em>and</em> sitemap performance.</p>
</li>
</ol>


XML Sitemap & Google News


I've been trying several plugins to generate a proper sitemap on our site. This one has a simple yet effective setup and really works like a charm with my CPT's.


Really works with custom post types


This is probably the best sitemap plugin available.


Best Sitemap Plugin

Take control of your WordPress core XML Sitemap and add a Google News Sitemap.

ProAI TXT Manager for LLMS and Robots vs XML Sitemap & Google News