Jeff Starr

<p>Does one thing: disables WP robots meta tag.</p>
<p>Activate this plugin to disable the robots meta tag (added in WP version 5.7).</p>
<p><strong>Features</strong></p>
<ul>
<li>Lightweight – only one line of code.</li>
<li>Simple to use – activate and done.</li>
<li>No settings to worry about.</li>
<li>Easy peasy.</li>
</ul>
<p><strong>Why is this useful?</strong></p>
<p>Because most existing WordPress sites (i.e., a LOT of sites) already have robots meta tags taken care of, either via plugin or theme enhancements. So when upgrading to WordPress 5.7, there may be conflicting or redundant meta tags, which may not be optimal for SEO. This simple plugin disables the new WP robots meta tag completely, so it will not interfere with existing meta robots configurations. Or maybe you are setting up a new site and don’t want WordPress to add any meta tags to your pages. Whatever the reason, this plugin will do the job with a click.</p>
<p><strong>More infos</strong></p>
<p>For more information about the new WP Robots functionality:</p>
<ul>
<li><a href="https://make.wordpress.org/core/2021/02/19/robots-api-and-max-image-preview-directive-in-wordpress-5-7/" rel="nofollow ugc">New Robots API</a></li>
<li><a href="https://perishablepress.com/wordpress-disable-wp-robots/" rel="nofollow ugc">WordPress Plugin: Disable WP Robots</a></li>
</ul>
<p><strong>Privacy</strong></p>
<p>This plugin does not collect or store any user data. It does not set any cookies, and it does not connect to any third-party locations. Thus, this plugin does not affect user privacy in any way.</p>
<p>Disable WP Robots is developed and maintained by <a href="https://x.com/perishable" rel="nofollow ugc">Jeff Starr</a>, 15-year <a href="https://plugin-planet.com/" rel="nofollow ugc">WordPress developer</a> and <a href="https://books.perishablepress.com/" rel="nofollow ugc">book author</a>.</p>


Disable WP Robots

Activate this plugin to disable the robots meta tag that was added in WP v5.7.

Viktor Szépe

<h4>This plugin needs more documentation!</h4>
<p>You can edit your robots.txt and add remote content to it.<br />
E.g. you have several sites and want to use a centralized robots.txt.</p>
<h4>Features</h4>
<ul>
<li>Include or exclude WordPress’ own robots.txt (core function)</li>
<li>Include or exclude plugins – e.g. sitemap plugins – output to robots.txt (filter output)</li>
<li>Include or exclude a remote text file (the common part)</li>
<li>Include or exclude custom records from the settings page (the site specific part)</li>
</ul>
<h4>Where is robot.txt?</h4>
<p>WordPress handles robots.txt as a virtual URL – just the same way as posts and pages.</p>
<p>So when you browse to <code>https://example.com/robots.txt</code> WordPress generates robots.txt on the fly.</p>
<h4>TODO</h4>
<ul>
<li>add more description here</li>
<li>add a video too</li>
<li>add an admin notice for subdir installs (robots.txt is useless in a subdir)</li>
<li>‘At least one “Disallow” field must be present in the robots.txt file.’ – check for that</li>
</ul>
<h4>Links</h4>
<p>Development of this plugin goes on on <a href="https://github.com/szepeviktor/multipart-robotstxt-editor" rel="nofollow ugc">GitHub</a>.</p>


Multipart robots.txt editor

Customize your site's robots.txt and include remote content to it

Disable WP Robots vs Multipart robots.txt editor