Jeff Starr

Does one thing: disables WP robots meta tag.
Activate this plugin to disable the robots meta tag (added in WP version 5.7).
Features
<ul>
<li>Lightweight – only one line of code.</li>
<li>Simple to use – activate and done.</li>
<li>No settings to worry about.</li>
<li>Easy peasy.</li>
</ul>
Why is this useful?
Because most existing WordPress sites (i.e., a LOT of sites) already have robots meta tags taken care of, either via plugin or theme enhancements. So when upgrading to WordPress 5.7, there may be conflicting or redundant meta tags, which may not be optimal for SEO. This simple plugin disables the new WP robots meta tag completely, so it will not interfere with existing meta robots configurations. Or maybe you are setting up a new site and don’t want WordPress to add any meta tags to your pages. Whatever the reason, this plugin will do the job with a click.
More infos
For more information about the new WP Robots functionality:
<ul>
<li><a href="https://make.wordpress.org/core/2021/02/19/robots-api-and-max-image-preview-directive-in-wordpress-5-7/" rel="nofollow ugc">New Robots API</a></li>
<li><a href="https://perishablepress.com/wordpress-disable-wp-robots/" rel="nofollow ugc">WordPress Plugin: Disable WP Robots</a></li>
</ul>
Privacy
This plugin does not collect or store any user data. It does not set any cookies, and it does not connect to any third-party locations. Thus, this plugin does not affect user privacy in any way.
Disable WP Robots is developed and maintained by <a href="https://x.com/perishable" rel="nofollow ugc">Jeff Starr</a>, 15-year <a href="https://plugin-planet.com/" rel="nofollow ugc">WordPress developer</a> and <a href="https://books.perishablepress.com/" rel="nofollow ugc">book author</a>.

Disable WP Robots

Activate this plugin to disable the robots meta tag that was added in WP v5.7.

netroby

WP-log-robots is a wordpress plugin, we could used it to loged the search engine robots activity.
after you had installed it . the WP-log-robots will log each robots activity and wrote it to log file .
if your site was : http://www.netroby.com. then the log file would be location at : http://www.netroby.com/robots_log.txt
<h3>Manual Installation</h3>
In case you want to make all steps manually:
<ol>
<li>
Upload to your plugins folder, usually <code>wp-content/plugins/</code> and unzip the file, it will create a <code>wp-content/plugins/wp-log-robots/</code> directory.
</li>
<li>
Make <code>wp-content</code> directory writeable by the web server.
</li>
<li>
Activate the plugin on the plugin screen.
</li>
</ol>
<h3>More Info</h3>
For more info, please visit http://www.netroby.com/ .
(For feedback/comments, please send an e-mail to: netroby[at]netroby.com ).

WP-log-robots

WP-log-robots is a wordpress plugin, we could used it to loged the search engine  robots activity.

Disable WP Robots vs WP-log-robots