citywanderer

Miina Sikk

Unblock CSS & JS for Googlebot plugin allows Googlebot to access the JavaScript and CSS files.
Google periodically sends to webmasters warnings that their JavaScript .js files and their CSS stylesheets are blocked – even when the webmasters have never explicitly done so. In fact, it is estimated that 85% of all users of Google webmaster tools have received such a warning.
Unblock CSS & JS for Googlebot solves this problem for you — and no configuration is needed. Just install and activate the plugin.
How does it work? It just adds in three lines to your robots.txt file to ensure the Google spider can get through.
You don’t want it anymore? Just uninstall and the added lines will be removed.
For more information and support, check out: http://www.wpsos.io/wordpress-plugin-unblock-css-js-for-googlebot/

Unblock CSS & JS for Googlebot

Modifies robots.txt to allow Googlebot access JS and CSS files.

dizzysoft

Crawler Record logs the last time specific user agents (for search and AI chat/LLMs) accessed your content including:
<ul>
<li>Google</li>
<li>Bing</li>
<li>ChatGPT (OpenAI)</li>
<li>Claude (Anthropic)</li>
<li>Perplexity</li>
<li>DuckDuckGo</li>
</ul>
You can view this information:
<ul>
<li>Admin page: a grouped list of all crawlers, with last seen time, last page, and robots status for the crawler. </li>
<li>Admin Bar (front-end): quick-glance status for the current singular or URL context (no dropdowns in wp-admin).</li>
<li>Per Page/Post: From the edit screen on any page or post, you can see that last time each crawler visited that page.</li>
</ul>
Robots-aware: The plugin checks your robots.txt and evaluates Allow/Disallow rules for a given path. If Settings → Reading → “Discourage search engines” is enabled, all agents are shown as blocked with a prominent warning.
Performance-friendly by design: Write-throttling (default 10 minutes) and an auxiliary “last post ID per agent” record avoids heavy admin queries on large sites.
Privacy-friendly: Saves only bot visit timestamps and last URLs crawled — no personal data.
Learn <a href="https://www.dizzysoft.com/crawler-record-plugin-for-wordpress/" rel="nofollow ugc">how to use this plugin</a>.
<h4>Highlights</h4>
<ul>
<li>Supports common user-agent variants for Google, Bing, OpenAI (ChatGPT), Anthropic (Claude), Perplexity, and DuckDuckGo.</li>
<li>Robots status computed from local robots.txt (physical or virtual) without outbound requests.</li>
<li>Clear UI with grouped sections, microsecond timestamps, and a small diagnostics toggle showing the matched robots group and rule.</li>
</ul>
<h4>Known limitations</h4>
<ul>
<li>robots.txt wildcards (<code>*</code>) and end-of-line marker (<code>$</code>) are not interpreted; matching is prefix-based only. Future versions may add full spec support.</li>
</ul>
<h3>Privacy</h3>
This plugin stores: 
– Timestamps of crawler visits (float, with microseconds) 
– Last URL seen per crawler (per-URL records) 
– Last post ID per crawler (for admin performance)
It does not collect or store personal data about site visitors. No data is transmitted to third parties.
<h3>License</h3>
GPLv2 or later. See LICENSE file.

Crawler Record

Crawler Record tells you the last time each of the most common search/chat bots visited (Google, ChatGPT, etc)- and the pages at which they looked.

Unblock CSS & JS for Googlebot vs Crawler Record