crawlantix

<p>Crawlantix AI Bot Tracker monitors visits from 30+ AI crawlers and gives you visibility into how bots interact with your site. See which bots visit, what pages they crawl, and catch misbehaving bots with a built-in logging-only honeypot. Lightweight, privacy-first, and fully functional out of the box.</p>
<p><strong>Free forever — no artificial limits on bot detection.</strong></p>
<p><strong>Tracked Bots (30+):</strong></p>
<ul>
<li>GPTBot / ChatGPT-User / OAI-SearchBot (OpenAI)</li>
<li>ClaudeBot / Claude-Web / anthropic-ai (Anthropic)</li>
<li>Googlebot / Google-Extended (Google / Gemini)</li>
<li>bingbot (Microsoft / Copilot)</li>
<li>PerplexityBot (Perplexity)</li>
<li>DeepSeek, Qwen (Alibaba), Mistral AI</li>
<li>Applebot-Extended (Apple Intelligence)</li>
<li>Meta-ExternalAgent (Meta AI)</li>
<li>Bytespider (ByteDance)</li>
<li>CCBot (Common Crawl), Amazonbot, YouBot, DuckDuckBot</li>
<li>AI2Bot, Diffbot, Timpibot, PetalBot</li>
<li>SemrushBot, AhrefsBot, DataForSeoBot, MJ12bot, DotBot</li>
</ul>
<p><strong>Features:</strong></p>
<h4>Lightweight Bot Detection (30+ Bots)</h4>
<p>Hooks into WordPress <code>init</code> with a priority-1 action. Bails immediately on non-AI User-Agents — zero performance cost for human visitors. All 30+ bots tracked.</p>
<h4>Dashboard with Charts</h4>
<p>Clean dashboard with trend chart and provider breakdown pie chart (Chart.js, bundled locally). Summary cards show total visits, unique bots, pages crawled, and daily averages. No external dependencies.</p>
<h4>Bot Activity Table</h4>
<p>Dedicated tab showing all detected bots with visits, bytes transferred, 24h sparklines, verification status, and honeypot hit counts.</p>
<h4>Crawled Pages</h4>
<p>See which pages bots visit most, which bots crawl them, and when they were last seen.</p>
<h4>Honeypot Endpoint (Logging Only)</h4>
<p>A CSS-hidden, aria-hidden, rel=nofollow link is injected in the footer. Only raw link-extracting bots will follow it. Visits are logged for transparency. Active defense (blocking, tarpit, rate-limit, decoy, shadowban) is reserved for the paid build.</p>
<h4>Bot Verification</h4>
<p>Reverse DNS (FCrDNS) verification for major bots — confirms Googlebot, GPTBot, ClaudeBot, etc. are actually who they claim to be.</p>
<h4>Privacy First</h4>
<p>IP addresses are SHA-256 hashed with a per-install salt before storage. Raw IPs are never saved. Includes WordPress Privacy API exporter and eraser hooks so data-subject access and erasure requests can flow through the standard WordPress Tools <span aria-hidden="true" class="wp-exclude-emoji">→</span> Personal Data workflow.</p>
<h4>AI Discovery Layer</h4>
<p>Serves <code>ai-plugin.json</code> (a discovery manifest that tells visiting AI agents the site is monitored) and <code>llms.txt</code> / <code>llms-full.txt</code> (text content authored by the admin via WordPress pages with slugs <code>llms-txt</code> and <code>llms-full-txt</code>) at the site root.</p>
<h4>Data Retention</h4>
<p>Bot visit data is retained for 30 days. Older records are automatically pruned via WP-Cron.</p>
<h3>External Services</h3>
<p>This plugin connects to the following external services:</p>
<h4>Reverse DNS Lookups</h4>
<p>The bot verification feature performs reverse DNS (FCrDNS) lookups using PHP’s <code>gethostbyaddr()</code> and <code>gethostbyname()</code> functions to verify that bots are who they claim to be (e.g., confirming a request claiming to be Googlebot actually originates from Google’s network). These lookups send the bot’s IP address to your server’s configured DNS resolver and the authoritative DNS servers for the IP address’s reverse DNS zone. Under some privacy regimes, IP addresses may be considered personal data. This feature runs automatically when a known AI bot visits your site and cannot currently be disabled via the admin UI (a filter hook <code>crawlantix_enable_verification</code> is available for developers).</p>
<p>No other external services, third-party APIs, or remote requests are used by this plugin. All analytics data is stored locally in your WordPress database. Chart.js is bundled locally — no CDN requests are made.</p>
<h3>Privacy Policy</h3>
<p>Crawlantix AI Bot Tracker is designed with privacy as a core principle:</p>
<ul>
<li><strong>Bot traffic only.</strong> The plugin only tracks automated bot traffic identified by User-Agent strings. Human visitors are not tracked and no cookies are set.</li>
<li><strong>No raw IP addresses stored.</strong> All IP addresses are SHA-256 hashed with a per-install random salt before storage (or AUTH_SALT when defined in <code>wp-config.php</code>). The original IP address cannot be recovered from the hash. Note: pseudonymous IP hashes may still be considered personal data under GDPR.</li>
<li><strong>Data stored per bot visit:</strong> IP hash, User-Agent string, requested URL, HTTP referrer URL, request method, timestamp, and derived fields (bytes transferred, bot verification status). Referrer URLs may contain personal data depending on the referring site.</li>
<li><strong>WordPress Privacy API integration.</strong> The plugin registers exporter and eraser callbacks with WordPress core, so data-subject access and erasure requests filed through Tools <span aria-hidden="true" class="wp-exclude-emoji">→</span> Personal Data flow correctly.</li>
<li><strong>No external data transmission.</strong> All analytics data remains in your local WordPress database. No data is sent to Crawlantix or third-party services. The only external communication is DNS lookups for bot verification (see External Services above).</li>
<li><strong>Data retention controls.</strong> Bot visit data is automatically pruned after 30 days. Administrators can delete all collected data on uninstall via the “Delete Data on Uninstall” Settings toggle.</li>
</ul>
<p>For sites that require a formal privacy policy disclosure, you may note: “We use the Crawlantix AI Bot Tracker plugin to monitor automated AI bot traffic to our site. This plugin records bot User-Agent strings, pseudonymous IP hashes, pages visited, referrer URLs, and timestamps for detected bot traffic only. Raw IP addresses are cryptographically hashed before storage. No human visitor data is collected.”</p>
<h3>Premium Version</h3>
<p>Crawlantix also offers paid tiers at <a href="https://crawlantix.com" rel="nofollow ugc">crawlantix.com</a> for site owners who need active bot defense in addition to monitoring. The paid build adds the following features on top of everything in this free version:</p>
<h4>Protect tier</h4>
<ul>
<li>Active honeypot responses: HTTP 403 block, tarpit (random 5–25s delay with worker-exhaustion safeguards), rate limit 429, decoy content, shadowban.</li>
<li>Auto-block of repeat honeypot offenders, with configurable thresholds.</li>
<li>Per-IP response rules — apply a chosen response strategy to specific IP hashes (up to 200 rules).</li>
<li>Custom honeypot paths (up to 5) with a reserved-route safety list.</li>
<li>Email alerts for honeypot hits and parameter explosion patterns.</li>
<li>Robots.txt trap entries that catch non-compliant scrapers.</li>
<li>Optional override that suppresses the WordPress core <code>/wp/v2/users</code> REST endpoints (username-enumeration hardening, off by default and easy to opt back in).</li>
</ul>
<h4>Optimize tier</h4>
<ul>
<li>Full REST API at <code>/wp-json/ai-tracker/v1/</code> with API key authentication and 13 endpoints (status, stats, page, trends, bots, top-pages, report, export, alerts, honeypot, crawled-pages, etc.).</li>
<li>GeoIP location tracking with MaxMind GeoLite2.</li>
<li>Crawl Analytics tab with deeper traffic-quality metrics.</li>
<li>Extended data retention up to 365 days.</li>
</ul>
<h4>Scale tier</h4>
<ul>
<li>Backup & restore — export all data as JSON; import with merge or replace modes.</li>
<li>Unlimited retention.</li>
<li>Priority support.</li>
</ul>
<p>The paid build is a drop-in upgrade: same plugin slug, same database tables, same option keys, so all your historical bot data carries over with no migration step on your part.</p>


Crawlantix AI Bot Tracker

Track 30+ AI crawlers visiting your site with real-time dashboards, logging-only honeypot, and bot verification.

Text

<p>ChatBot is an all-in-one platform to create, deploy, and track chatbots across channels, trusted by 2900+ companies.</p>
<p><strong>Create your AI chat bot in a snap and easily launch it on your website, Facebook Messenger, Slack, and more.</strong> Integrate ChatBot with LiveChat and HelpDesk for a seamless support experience that connects live chats, conversations with AI bots, and email support tickets.</p>
<p>Use the ChatBot WordPress plugin to instantly add an AI chatbot and make it appear as an interactive and customizable chat widget on your website.</p>
<h4>End-to-end Customer Service Automation</h4>
<p>Automate tasks 24/7/365, without human engagement: answer support questions, generate leads, schedule meetings, get customer feedback, collect personal data, promote products and create any other custom chat flow in the ChatBot app.</p>
<h4>Self-learning AI Chatbot</h4>
<p>ChatBot uses a dedicated AI model crafted based on the content provided from your website, online store, help center, or text documentation. It learns from your business knowledge (like information about your products and services) and uses this knowledge to answer customers’ questions.</p>
<h4>Answer Up To 80% Of Customers’ Questions With AI</h4>
<p>ChatBot utilizes ML (machine learning), LLM (large language models), and generative AI to dynamically provide answers to questions in chats. It creates a unique and accurate AI model (AI Assist) that is strictly based on the provided data and does not rely on third-party providers like OpenAI (ChatGPT), Google Bard, or Bing AI.</p>
<h3>Why ChatBot is a Better Customer Service Solution than ChatGPT</h3>
<ul>
<li>👉 <strong>One Simple App Interface:</strong> All your chatbot setup, deployment, and optimization are done via the intuitive ChatBot platform interface without any coding.</li>
<li>👉 <strong>Easy No Code Installation:</strong> Setting up a chatbot on your website is quick and simple. It does not require any coding or API use. Simply install the WP plugin, and it’s ready to go.</li>
<li>👉 <strong>One-Click Training and Setup:</strong> To train your chatbot, simply use data from your website, help center, or text articles. The scanned data will be used in your dedicated AI model.</li>
<li>👉 <strong>Customizable Chat Widget:</strong> Easily adjust the look and settings of Chat Widget to fully match your brand and website.</li>
<li>👉 <strong>Easy Chatbot Optimization:</strong> Use data from completed chats to train your chatbot to be even more precise if needed.</li>
<li>👉 <strong>Enterprise-grade Data Security:</strong> All training data and chats are hosted exclusively on the ChatBot platform.</li>
<li>👉 <strong>Reliable AI Model:</strong> ChatBot AI Assist is fully trained on the provided data, and it doesn’t makeup facts in chats. There’s no way of “hacking” the AI model to get out of track with answers.</li>
<li>👉 <strong>Many Automations in One Chatbot Widget:</strong> In addition to answering questions, your chatbot can create support tickets, generate leads, schedule meetings, or redirect to live agents. All automations are set up in a visual drag-and-drop builder.</li>
</ul>
<h3>How ChatBot Will Improve Your WP Website</h3>
<ul>
<li>📈 <strong>Improve customer experience with ChatBot:</strong> Use ChatBot to help your customers round-the-clock and improve your conversion rates to grow your revenue effortlessly.</li>
<li>📈 <strong>Boost visitor engagement on your WordPress website:</strong> Reach out to a wider audience and acquire new customers.</li>
<li>📈 <strong>Turn traffic into growing revenue:</strong> Use real-time communication to get more happy customers.</li>
<li>📈 <strong>Support your website visitors 24/7/365:</strong> Help your visitors at every stage of their decision-making.</li>
</ul>
<h3>Key ChatBot Features</h3>
<ul>
<li>Feature-rich WordPress chat bot plugin</li>
<li>Advanced AI training and custom AI models</li>
<li>Generative AI for dynamic response creation</li>
<li>Easy conversation flow testing and chatbot optimization</li>
<li>One-click installation for WordPress</li>
<li>Fully customizable Chat Widget</li>
<li>Rich messages for a more engaging customer experience</li>
<li>Intuitive interface – no coding and technical skills needed</li>
<li>One-click integrations with LiveChat, Facebook Messenger, Slack, and more</li>
<li>Intuitive drag & drop Visual Builder for more advanced chat automation</li>
<li>Ready-to-start chatbot templates with business-oriented flows</li>
<li>Reports, analytics, and detailed data on visitors</li>
<li>Advanced chatbot actions with integrations and webhooks</li>
</ul>
<h3>ChatBot’s Most Popular Integrations</h3>
<ul>
<li>WordPress</li>
<li>LiveChat</li>
<li>HelpDesk</li>
<li>Facebook Messenger</li>
<li>Shopify</li>
<li>Squarespace</li>
<li>Webflow</li>
<li>BigCommerce</li>
<li>Wix</li>
<li>Slack</li>
<li>Zapier</li>
<li>Freshdesk</li>
<li>Zendesk</li>
</ul>
<h3>Testimonials</h3>
<blockquote>
<p>The ChatBot platform has become a key part of our proposition. It’s fully flexible and has allowed us to <strong>drive 30% more leads while dramatically reducing our cost to serve</strong>.<br />
  Joe Bush, Co-founder of The Chat Shop</p>
<p>With ChatBot, we were able to <strong>reduce our help ticket numbers by 50%!</strong> So now the elves spend less time answering the phones/emails and more time providing an unforgettable experience to our customers.<br />
  Dale & Carey, owners of PackageFromSanta.com</p>
<p>We have used various chatbot platforms in the past, but we find ChatBot to be <strong>the most flexible, quick to implement, and easily trainable</strong>.<br />
  Andy Dharmani, Founder, ako.ai</p>
<p>After we implemented ChatBot, we witnessed immediate relief within our support operation. Our chatbot provides <strong>instantaneous support to 60% of all chatting customers</strong> and has reduced queued visitors by over 50%.<br />
  Brian Vail, CE Support Agent, ProctorU</p>
</blockquote>
<h3>The Text ecosystem</h3>
<p>The ecosystem of <strong>Text</strong> products includes:</p>
<p>– <a href="https://www.livechat.com/?utm_source=wordpress.org&utm_medium=integration&utm_campaign=WordpressIntegration" rel="nofollow ugc">LiveChat</a> – a communication tool that allows you to chat live with your customers – official <a href="https://wordpress.org/plugins/wp-live-chat-software-for-wordpress/" rel="ugc">LiveChat plugin page</a><br />
– <a href="https://www.helpdesk.com/?utm_source=wordpress.org&utm_medium=integration&utm_campaign=WordpressIntegration" rel="nofollow ugc">HelpDesk</a> – an online ticketing system suitable both for small businesses and enterprise clients<br />
– <a href="https://www.chatbot.com/?utm_source=wordpress.org&utm_medium=integration&utm_campaign=WordpressIntegration" rel="nofollow ugc">ChatBot</a> – a bot framework for AI chat bots<br />
– <a href="https://www.knowledgebase.com/?utm_source=wordpress.org&utm_medium=integration&utm_campaign=WordpressIntegration" rel="nofollow ugc">KnowledgeBase</a> – a public Help Center widget<br />
– <a href="https://openwidget.com/?utm_source=wordpress.org&utm_medium=integration&utm_campaign=WordpressIntegration" rel="nofollow ugc">OpenWidget</a> – free widgets for website – official <a href="https://wordpress.org/plugins/free-customer-service-tools-by-openwidget/" rel="ugc">OpenWidget plugin page</a><br />
– <a href="https://platform.text.com/?utm_source=wordpress.org&utm_medium=integration&utm_campaign=WordpressIntegration" rel="nofollow ugc">Text Messaging Platform</a> – chat platform for innovative teams</p>


ChatBot Conversational AI Support

Chatbot for WP, using a ChatGPT-like AI to self-learn and create replies. Easy training based on the website content. Quick setup, easy installation.

Crawlantix AI Bot Tracker vs ChatBot Conversational AI Support