Algorithus

This plugin allows you to easily control whether search engines are disallowed from accessing the root directory of your WordPress site by modifying the robots.txt file. You can enable or disable this functionality from the “Reading” settings page.

AWP Disallow Root Control

Disallow access to the root directory via robots.txt with an option to enable or disable.

uisce

Daan Verbaan

AI Scrape Protect is a WordPress plugin designed to protect your website from scraping for AI training purposes. It achieves this by adding opt-out instructions to the <code>robots.txt</code> file for the most common AI scraping bots and including meta tags to control how your content is used.
Version 5.0 introduces a full settings page with granular per-bot control, categorised bot management, AJAX-powered toggles, and support for custom user agents.
Features
<ul>
<li>Adds <code>User-agent</code> and <code>Disallow</code> rules to your <code>robots.txt</code> file to block a comprehensive list of AI scraping bots.</li>
<li>Generates compact robots.txt output: all blocked bots are grouped under a single <code>Disallow: /</code> directive.</li>
<li>Introduces meta tags in the HTML <code><head></code> to provide additional instructions to AI bots.</li>
<li>Separate toggles for content meta tags (<code>noai</code>, <code>nosummary</code>, <code>DisallowAITraining</code>) and image meta tags (<code>noimageai</code>).</li>
<li>Settings page with five categorised tabs: Search Engines, AI Training, AI Search & Answers, General Indexing, Custom Bots.</li>
<li>Group toggle per category to block or allow all bots in that category at once.</li>
<li>Individual per-bot toggle with description and company information for each bot.</li>
<li>Custom bots tab: add and remove your own user agent strings.</li>
<li>Global enable/disable toggle and separate toggles for robots.txt and meta tags.</li>
<li>“Apply default settings” button to reset all options.</li>
<li>Admin bar icon linking to the settings page (visible to administrators only). Icon reflects the current enabled state.</li>
<li>Physical <code>robots.txt</code> detection notice: warns you if a file in your root directory overrides WordPress’s virtual robots.txt.</li>
<li>Fully AJAX-powered settings page: changes are saved instantly without page reloads.</li>
<li>Extensible via the <code>aisp_user_agents</code> filter for developers.</li>
<li>Multisite note: settings are stored per site using <code>get_option</code>/<code>update_option</code>. Network-wide configuration is not supported.</li>
</ul>
Note: robots.txt and meta tag opt-out instructions are not always respected by all bots. This plugin is a measure to discourage scraping rather than a guaranteed technical block.

AI Scrape Protect


Really a super handy plugin. For me personally, I'd like to be able to manage the settings. So I'm looking forward to the next version. Or maybe interaction with the wikipedia entry List_of_bots.


Super handy

Protect your website from AI scraping by adding opt-out instructions to your robots.txt file and including meta tags in the HTML ``.

AWP Disallow Root Control vs AI Scrape Protect