netroby

WP-log-robots is a wordpress plugin, we could used it to loged the search engine robots activity.
after you had installed it . the WP-log-robots will log each robots activity and wrote it to log file .
if your site was : http://www.netroby.com. then the log file would be location at : http://www.netroby.com/robots_log.txt
<h3>Manual Installation</h3>
In case you want to make all steps manually:
<ol>
<li>
Upload to your plugins folder, usually <code>wp-content/plugins/</code> and unzip the file, it will create a <code>wp-content/plugins/wp-log-robots/</code> directory.
</li>
<li>
Make <code>wp-content</code> directory writeable by the web server.
</li>
<li>
Activate the plugin on the plugin screen.
</li>
</ol>
<h3>More Info</h3>
For more info, please visit http://www.netroby.com/ .
(For feedback/comments, please send an e-mail to: netroby[at]netroby.com ).

WP-log-robots

WP-log-robots is a wordpress plugin, we could used it to loged the search engine  robots activity.

davide.airaghi

This plugin allows any user having at least one of the following capabilities to edit robots.txt: 
– edit_files (standard WP capability) 
– manage_options (standard WP capability) 
– unfiltered_upload (standard WP capability) 
– upload_files (standard WP capability) 
– wpseo_manage_options (Yoast SEO capability) 
– aioseo_general_settings (All In One SEO capability) 
– aioseo_tools_settings (All In One SEO capability) 
– aioseo_feature_manager_settings (All In One SEO capability) 
– aioseo_local_seo_settings (All In One SEO capability)
The “Robots.txt” option is added under “Settings” menu.

WP-log-robots vs Robots.txt Quick Editor