Arefly

Log the Search Engine Robots Visits of your Webite.
取得搜索引擎的蜘蛛訪問網站的記錄
And you can find your log at http://YOUR_BLOG_URL/robots_log.txt
<h4>Translators</h4>
<ul>
<li>Chinese, Simplified (zh_CN) – <a href="http://www.arefly.com/" rel="nofollow ugc">Arefly</a></li>
<li>Chinese, Traditional (zh_TW) – <a href="http://www.arefly.com" rel="nofollow ugc">Arefly</a></li>
<li>English (en_US) – <a href="http://www.arefly.com" rel="nofollow ugc">Arefly</a></li>
</ul>
If you have created your own language pack, or have an update of an existing one, you can send <a href="https://codex.wordpress.org/Translating_WordPress" rel="nofollow ugc">gettext PO and MO files</a> to <a href="http://www.arefly.com/about/" rel="nofollow ugc">Arefly</a> so that I can bundle it into WP Robots Log. You can download the latest <a href="https://plugins.svn.wordpress.org/wp-robots-log/trunk/lang/wp-robots-log.pot" rel="nofollow ugc">POT file</a>.

WP Robots Log

Log the Search Engine Robots Visits of your Webite. 取得搜索引擎的蜘蛛訪問網站的記錄

Samir Shah

Matt Calvert

This plugin issues an HTTP <code>410</code> response for URLs corresponding to content that has been permanently removed from your site. Originally created by Samir Shah, now maintained by Matt Calvert. When a post or page is deleted, the plugin logs the old URL and returns a <code>410</code> response when that URL is requested. You can also manually manage the list of obsolete URLs.
The <a href="http://www.w3.org/Protocols/rfc2616/rfc2616-sec10.html#sec10.4.11" rel="nofollow ugc">HTTP Specification</a> defines the <code>410 Gone</code> response for resources that have been permanently removed. It informs search engines and crawlers that the content will not return, improving crawl efficiency and SEO clarity.
This plugin is actively maintained by Matt Calvert as a personal project, informed by previous professional experience with similar 410-handling logic. No proprietary or employer-owned code has been used.

HTTP 410 (Gone) responses


Still working when tested but an update would be nice to avoid getting hacked or breakdown of site


still working

Sends HTTP 410 (Gone) responses for deleted content, telling search engines the page is permanently removed.

WP Robots Log vs HTTP 410 (Gone) responses