Arefly

Log the Search Engine Robots Visits of your Webite.
取得搜索引擎的蜘蛛訪問網站的記錄
And you can find your log at http://YOUR_BLOG_URL/robots_log.txt
<h4>Translators</h4>
<ul>
<li>Chinese, Simplified (zh_CN) – <a href="http://www.arefly.com/" rel="nofollow ugc">Arefly</a></li>
<li>Chinese, Traditional (zh_TW) – <a href="http://www.arefly.com" rel="nofollow ugc">Arefly</a></li>
<li>English (en_US) – <a href="http://www.arefly.com" rel="nofollow ugc">Arefly</a></li>
</ul>
If you have created your own language pack, or have an update of an existing one, you can send <a href="https://codex.wordpress.org/Translating_WordPress" rel="nofollow ugc">gettext PO and MO files</a> to <a href="http://www.arefly.com/about/" rel="nofollow ugc">Arefly</a> so that I can bundle it into WP Robots Log. You can download the latest <a href="https://plugins.svn.wordpress.org/wp-robots-log/trunk/lang/wp-robots-log.pot" rel="nofollow ugc">POT file</a>.

WP Robots Log

Log the Search Engine Robots Visits of your Webite. 取得搜索引擎的蜘蛛訪問網站的記錄

Marios Alexandrou

Virtual Robots.txt is an easy (i.e. automated) solution to creating and managing a robots.txt file for your site. Instead of mucking about with FTP, files, permissions ..etc, just upload and activate the plugin and you’re done.
By default, the Virtual Robots.txt plugin allows access to the parts of WordPress that good bots like Google need to access. Other parts are blocked.
If the plugin detects an existing XML sitemap file, a reference to it will be automatically added to your robots.txt file.

Virtual Robots.txt

Awesome, a simple solution to a common issue (site content managers who want to hide certain pages from Google search results).

Just a little note: in my case, the existing Sitemap created by the plugin "Google (XML) Sitemaps Generator" by Arne Brachhold wasn't detected.

Efficient and unobstrusive

I like the fact that it's so clean. Thanks for building it!

Does the Job

Virtual Robots.txt automatically creates a robots.txt file for your site. Your robots.txt file can be easily edited from the plugin settings page.

WP Robots Log vs Virtual Robots.txt