CeeWP

CeeWP Robots.txt Manager is a lightweight and user-friendly plugin that allows you to easily manage your WordPress site’s virtual robots.txt file. Add custom rules without creating physical files, with full control over search engine access to your content.
Why Choose Robots.txt Manager?
<ul>
<li>No File Management: Works with WordPress’s built-in virtual robots.txt system</li>
<li>Two Operating Modes: Choose between appending to or replacing default rules</li>
<li>User-Friendly Interface: Clean admin panel with helpful examples</li>
<li>WordPress Standards: Follows all WordPress coding and security standards</li>
<li>Automatic Cleanup: Removes all data when uninstalled</li>
</ul>
Key Features:
<ul>
<li>Simple interface to add custom robots.txt rules</li>
<li>Replace Mode: Option to completely replace WordPress default robots.txt with custom rules</li>
<li>Append Mode: Add custom rules to existing WordPress robots.txt (default behavior)</li>
<li>Dynamic Textarea: Automatically adjusts height based on content</li>
<li>Live Preview: Direct link to view your robots.txt file</li>
<li>Smart Warnings: Alerts when search engines are discouraged</li>
<li>Privacy Respect: Honors WordPress privacy settings</li>
<li>Examples Included: Ready-to-use code snippets for common scenarios</li>
<li>Professional UI: Modern interface with WordPress dashicons</li>
</ul>
Perfect for:
<ul>
<li>SEO Professionals: Fine-tune search engine crawling behavior</li>
<li>Website Owners: Block access to private directories and files</li>
<li>Developers: Prevent indexing of development or staging content</li>
<li>E-commerce Sites: Control bot access to sensitive areas</li>
<li>Content Creators: Manage sitemap declarations and crawl rates</li>
</ul>
How It Works:
The plugin adds a new menu item under Settings > Robots.txt Manager where you can easily add your custom rules. Choose between two modes:
<ul>
<li>Append Mode (Default): Your custom rules are added to WordPress’s default robots.txt</li>
<li>Replace Mode: Your custom rules completely replace WordPress’s default robots.txt</li>
</ul>
The interface includes helpful examples, real-time textarea sizing, and a direct link to view your live robots.txt file.
<h3>Privacy</h3>
This plugin does not collect, store, or transmit any personal data. All settings are stored locally in your WordPress database and are only used to generate your robots.txt file.
<h3>Credits</h3>
Developed with ❤️ by CeeWP – https://ceewp.com/
Special thanks to the WordPress community for continuous inspiration and feedback.

CeeWP Robots.txt Manager

Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!

Alex Khomichenko

The leader in content syndication for WordPress publishers now helps protect you from Artificial Intelligence companies using your content without compensation. If you are not blocking the AI companies access, they have no incentive to license your content.
Features include:
<ul>
<li>Block the bots of leading AI companies from scraping your content</li>
<li>See the bots name, IP address and last seek date</li>
<li>Add/remove bots from the block list</li>
<li>Opt in to create a common AI bot list and give blocked bots instructions on how to license your content.</li>
</ul>
SimpleFeed is the leading content syndication solution for WordPress Publishers. We work with over 500 publishers to syndicate their content to Apple News, MSN, SmartNews, Newsbreak, Opera News, Samsung News, Yahoo and just about anywhere your users consume content. We are working with these publishers, and publishers who use this plugin and want to participate, to license their content to leading AI companies.
SimpleFeed has a non-public plug-in which also enables publishers to be more successful in their syndication efforts. SimpleFeed customers get the complete plug in, best practices for successful syndication, and technical support.
Please note that blocking the wrong bot and/or presenting the wrong Robots.txt can lead to traffic declines. This plug in is free and offered “as is” without warranty or support.
Install now to preserve your rights to potential future compensation from the AI companies.
<h3>Use of 3rd Party Services</h3>
The AI Rights Protection by SimpleFeed plugin communicates with an external service hosted at <a href="https://www.simplefeed.com/wp-content/simplefeed/wp-simplefeed-bots-protection-admin-rest.php" rel="nofollow ugc">SimpleFeed</a> to perform the following functions:
<ol>
<li>
Storage of Plugin Settings: The plugin sends and retrieves plugin settings to/from the SimpleFeed service. This ensures that your settings are securely stored and synchronized with the external service.
</li>
<li>
Bot Request Statistics: The plugin collects and stores statistics about bot requests on your WordPress site. These statistics are sent to SimpleFeed for analysis and reporting purposes.
</li>
<li>
Premium Access Validation: The plugin checks with the SimpleFeed service to verify if your WordPress user account has premium access to the plugin features.
</li>
</ol>
For more information, please review the <a href="https://www.simplefeed.com/other/privacy-policy/" rel="nofollow ugc">SimpleFeed Privacy Policy</a> and <a href="https://www.simplefeed.com/other/tos/" rel="nofollow ugc">Terms of Use</a>.
By using this plugin, you agree to the data transmissions to SimpleFeed’s external services for the purposes outlined above.

AI Rights Protection by SimpleFeed

Protect your rights by reviewing and blocking AI bots from using your content without compensation.

CeeWP Robots.txt Manager vs AI Rights Protection by SimpleFeed