LLMs.txt – AI Website Content Crawling
Generate a structured llms.txt file to manage AI and search engine crawling access across your WordPress site.
Plugin info
Maintenance & Compatibility
Maintenance score
Maintained • Last updated 175 days ago
Is LLMs.txt – AI Website Content Crawling abandoned?
Likely maintained (last update 175 days ago).
Compatibility
Similar & Alternatives
Explore plugins with similar tags, and compare key metrics like downloads, ratings, updates, support, and WP/PHP compatibility.
Description
LLMs.txt – AI Website Content Crawling helps you generate a custom llms.txt file to control how AI language models (LLMs) and search engines crawl your site content.
Key Features
- Automatically generate a valid
llms.txtfile. - Choose which post types are included for AI access.
- Compatible with SEO and privacy-conscious setups.
- Easy to use with minimal configuration.
This plugin is ideal for publishers, bloggers, and businesses looking to control their content visibility to AI systems and bots.
Installation
- Upload the plugin folder to the
/wp-content/plugins/directory. - Activate the plugin through the ‘Plugins’ menu in WordPress.
- Go to Settings > LLMs.txt to configure which post types to include.
- Visit
https://yoursite.com/llms.txtto see the output.
Frequently Asked Questions
It is a proposed standard for signaling content access preferences to large language models and AI crawlers, similar to robots.txt.
No. llms.txt complements robots.txt and focuses specifically on AI crawling policies.
Yes, the plugin allows you to select which post types (e.g., posts, pages, custom types) should be listed.
Review feed
Screenshots
Changelog
1.0
- Initial release.