Code For Broke

Blocking AI crawlers from your website is essential for maintaining both its performance and privacy. When left unchecked, these bots can strain server resources, causing slow load times for real users, and may harvest data beyond your intended audience. This creates potential risks, including the exposure of sensitive information and a compromised user experience.
AI Deny offers an effective and straightforward solution to this problem. The plugin works by automatically configuring your website’s robots.txt file to disallow over 30 of the most common AI user-agents known for crawling websites. This ensures that unwanted bots are prevented from accessing your site, reducing server load and safeguarding privacy.
With AI Deny, you can easily block all pre-configured user-agents or customize the list to suit your specific needs. By giving you control over which bots are allowed or denied access, AI Deny helps you protect your content, conserve bandwidth, and deliver a faster, more secure experience for your audience.
AI Deny

AI Deny

Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.

botstracker

Bots Tracker is a custom-built plugin designed to:
<ul>
<li>Detect and log visits from search engine bots and crawlers.</li>
<li>Store visits in a dedicated database table for analysis.</li>
<li>Display detailed bot visits inside WordPress Admin (with filters, pagination, and per-URL crawl budget).</li>
<li>Compare crawl budget between two time ranges (current vs previous period).</li>
</ul>
Main features:
<ol>
<li>
Bot Detection & Logging
<ul>
<li>Detects various bots (Googlebot, Bingbot, GPTBot, etc.) using User-Agent signatures.</li>
<li>Saves bot name, visited URL path, IP address, and visit time to a custom database table.</li>
</ul>
</li>
<li>
Admin Dashboard Pages
<ul>
<li>Main Report: paginate and filter bot visits, with search by URL, bot name, and date range.</li>
<li>Crawl Budget by URL: aggregate visits per URL with total hits, unique bots, and first/last visit times.</li>
<li>Comparative Report: compare total crawl budget between current and previous periods.</li>
</ul>
</li>
<li>
Clean Uninstall
<ul>
<li>On plugin deletion, the custom database table and plugin options are removed from WordPress to keep your database clean.</li>
</ul>
</li>
<li>
Settings & Data Management
<ul>
<li>Configure how long bot visit logs are stored (data retention in days).</li>
<li>Enable or disable bot filtering to store only selected bots (e.g., only Googlebot and Bingbot) or to exclude specific bots.</li>
<li>Run on-demand database optimization for the bot visits table directly from the settings page.</li>
<li>Manually delete old records using a one-click cleanup tool.</li>
<li>Automatic cleanup via WP-Cron based on your configured retention period.</li>
</ul>
</li>
</ol>
<h3>Privacy</h3>
This plugin stores the following data about bot visits in a custom database table: 
– Bot name (derived from the User-Agent string) 
– Bot IP address 
– Visited URL path 
– Visit timestamp
No data is sent to any third-party servers. This plugin tracks bots only, not human visitors.

Azayem Bots Tracker – Bot Visits Logger

A custom plugin to log search engine bot visits and analyze their crawl budget directly inside WordPress (no external services required).

AI Deny vs Azayem Bots Tracker – Bot Visits Logger