Processby

The plugin allows you to create and edit the robots.txt file on your site.
<h4>Features</h4>
<ul>
<li>Works with multisite network on Subdomains;</li>
<li>An example of the correct file for WordPress;</li>
<li>Works out of the box;</li>
<li>Totally Free.</li>
</ul>

Robots.txt Editor

Lightweight and perfect for multisite installations.

But in documentation need to say where the option/editor is installed (Settings > Read options).

Perfect!

Code For Broke

Blocking AI crawlers from your website is essential for maintaining both its performance and privacy. When left unchecked, these bots can strain server resources, causing slow load times for real users, and may harvest data beyond your intended audience. This creates potential risks, including the exposure of sensitive information and a compromised user experience.
AI Deny offers an effective and straightforward solution to this problem. The plugin works by automatically configuring your website’s robots.txt file to disallow over 30 of the most common AI user-agents known for crawling websites. This ensures that unwanted bots are prevented from accessing your site, reducing server load and safeguarding privacy.
With AI Deny, you can easily block all pre-configured user-agents or customize the list to suit your specific needs. By giving you control over which bots are allowed or denied access, AI Deny helps you protect your content, conserve bandwidth, and deliver a faster, more secure experience for your audience.
AI Deny

AI Deny

Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.

Robots.txt Editor vs AI Deny