webdigit

WebDigit LLMs Index Suite makes your WordPress site GEO / AI-SEO ready by publishing compact, machine-readable indexes for AI agents.
Key features 
– Synchronized trio: <code>llms.txt</code>, <code>llms-full.txt</code>, <code>llms.json</code> 
– Image inventory: <code>images.md</code> (Markdown table) + <code>images.jsonld</code> (<code>ImageObject</code>) 
– Public URLs: <code>/llms.txt</code> (root) and <code>/llms/*</code> (virtual directory) 
– REST API with caching: <code>GET /wp-json/wdlis/v1/index</code>, <code>GET /wp-json/wdlis/v1/images</code> (ETag + 304) 
– Automation: cron every 6h + WP-CLI (<code>wp llms-suite regenerate</code>) 
– Controls: include post types, exclude URL patterns, image MIME filters, customizable license meta key 
– Security: Only published content is indexed (drafts, private posts excluded) 
– Developer hooks: <code>wdlis_index_query_args</code>, <code>wdlis_index_entries</code>, <code>wdlis_images_query_args</code>, …
Storage & exposure 
– Files are written to <code>/wp-content/uploads/llms/</code>. 
– Public exposure is clean: <code>/llms.txt</code> (root) and <code>/llms/<file></code> served via rewrite rules (no write needed at web root).
Why this matters (GEO / AI-SEO) 
Generative engines and AI copilots prefer clean, structured sources. This plugin publishes a compact text index plus a first-class image inventory to help LLMs discover and summarize your content reliably.
<blockquote>
This plugin does not modify your existing robots.txt or sitemaps and does not call external APIs.
</blockquote>
<h3>Developer Notes</h3>
Filters 
/** 
 * Adjust the WP_Query for index entries. 
 */ 
apply_filters( ‘wdlis_index_query_args’, array $args ): array;
/** 
 * Final pass on index entries before output. 
 * Each entry: [‘url’ => string, ‘title’ => string, ‘lastmod’ => string] 
 */ 
apply_filters( ‘wdlis_index_entries’, array $entries ): array;
/** 
 * Adjust the WP_Query for image entries (attachments). 
 */ 
apply_filters( ‘wdlis_images_query_args’, array $args ): array;
/** 
 * Decide if a URL/file should be included after pattern checks. 
 */ 
apply_filters( ‘wdlis_index_url_should_include’, bool $include, string $url, int $post_id, string $matched_pattern ): bool; 
apply_filters( ‘wdlis_images_should_include’, bool $include, string $filepath, int $attachment_id, string $matched_pattern ): bool;
REST
GET /wp-json/wdlis/v1/index → JSON (with ETag headers)
GET /wp-json/wdlis/v1/images → JSON-LD ItemList (with ETag headers)
<h3>Privacy</h3>
This plugin:
does not collect personal data,
does not transmit data to remote servers,
writes only static helper files to /wp-content/uploads/llms/.
Site owners are responsible for the accuracy of license metadata on images and for excluding private/PII content via settings.

WebDigit LLMs Index Suite

Generate llms.txt, llms-full.txt, llms.json and AI-ready image indexes (Markdown + JSON-LD). Public URLs, REST API (ETag), cron and WP-CLI included.

Hueston

Is ChatGPT, Claude, Perplexity, or Gemini crawling your website? This plugin automatically tracks every AI bot visit to give you the data you need! 🤖
LLM Bot Tracker is the most comprehensive AI crawler analytics plugin for WordPress, providing automatic 24/7 monitoring of artificial intelligence bots, search crawlers, and web scrapers accessing your content.
<h4>🎯 How It Works</h4>
Install → Activate → Done!
That’s it. The plugin immediately starts tracking all AI bot activity in the background. No configuration needed. View your data anytime in the admin dashboard at Tools > LLM Crawler Logs.
<h4>🚀 Why Track AI Bots & Crawlers?</h4>
The web is changing. AI-powered search engines like Perplexity, You.com, and SearchGPT are revolutionizing how people find information. Traditional SEO isn’t enough anymore – you need LLMO (Large Language Model Optimization).
This plugin automatically captures: 
* Every AI bot visit – Timestamp, bot name, pages accessed, IP address 
* AI crawler patterns – Which content AI systems value most 
* Training data usage – When GPT, Claude, or Gemini scrape your content 
* Crawl frequency – How often each AI system visits 
* Geographic origins – Where AI bot traffic originates 
* Response codes – Success rates and errors for AI crawlers
Without this data, you’re flying blind in the AI era of search.
<h4>✨ Core Features</h4>
🤖 Automatic Detection of 59 AI Bots Including:
<ul>
<li>OpenAI Family: GPTBot, ChatGPT-User, OAI-SearchBot (SearchGPT)</li>
<li>Anthropic Family: ClaudeBot, Claude-Web, Claude-SearchBot </li>
<li>Perplexity: PerplexityBot, Perplexity-User</li>
<li>Google AI: Google-Extended, GoogleOther, Google-CloudVertexBot, GoogleAgent-Mariner, Gemini-Deep-Research</li>
<li>Amazon AI: Amazonbot, NovaAct (Nova AI Agent)</li>
<li>Meta AI: FacebookBot, Meta-ExternalAgent, Meta-ExternalFetcher</li>
<li>Microsoft: Bingbot (AI-enhanced), MSN Bot</li>
<li>AI Assistants: Devin (Software Engineering AI), LinerBot (Academic Research), QualifiedBot</li>
<li>Common Crawl: CCBot (feeds multiple AI systems)</li>
<li>ByteDance: Bytespider (TikTok AI)</li>
<li>AI Search & Research: You.com (YouBot), Timpi (Timpibot), Allen Institute (AI2Bot), Cohere (Cohere-AI)</li>
<li>Data Extraction: Diffbot (structured data extraction for ML)</li>
<li>Others: MistralAI, Neeva bot, SemrushBot with AI</li>
</ul>
📊 Powerful Analytics Dashboard (Tools > LLM Crawler Logs) 
* Complete log of all AI bot activity 
* Advanced filtering by bot type, date range, URL path, IP address 
* Configuration Tab – Smart cache detection with setup guides and bot patterns 
* NEW: CSV export – download your data for offline analysis 
* 30-day trend analysis – spot patterns and changes 
* Top bots leaderboard – see your most frequent AI visitors 
* Path analysis – discover your most AI-visited content 
* Geographic IP tracking with location data 
* Bot verification via IP lookup 
* Response code tracking (200, 404, etc.) 
* Bulk actions for log management 
* Export filtered or complete datasets
⚡ Performance & Privacy 
* Runs silently in background – zero configuration 
* Lightweight – adds <0.01s to page load 
* Smart data storage – automatic log rotation 
* GDPR compliant – no human tracking 
* No external API calls 
* 100% local data storage
🎨 Optional Display Shortcodes 
Want to display AI bot stats on your site? Use these optional shortcodes: 
* <code>[wpcs_llm_stats]</code> – Statistics table 
* <code>[wpcs_llm_bar]</code> – Animated bar chart 
* <code>[wpcs_llm_last100]</code> – Recent activity feed 
* <code>[wpcs_llm_ip_list]</code> – Compact IP list 
* <code>[wpcs_crawler_stats]</code> – Combined view
<h4>📈 Who Needs This Plugin?</h4>

<ul>
<li>Content Creators – Know which AI systems value your content</li>
<li>SEO Professionals – Master LLMO and AI SEO with real data</li>
<li>News Publishers – Track AI interest in your stories</li>
<li>E-commerce Sites – Detect AI shopping assistant crawlers</li>
<li>Tech Companies – Monitor competitive AI intelligence gathering</li>
<li>Documentation Sites – See which docs AI systems reference</li>
<li>Educational Platforms – Understand AI training on your content</li>
<li>Any WordPress Site – Future-proof your content strategy</li>
</ul>
<h4>💡 Real User Success Stories</h4>
<blockquote>
“Discovered ChatGPT was hitting our API docs 2,000+ times daily. We optimized those pages and saw a 40% increase in AI-driven traffic!” – Tech Startup
“The background tracking revealed Perplexity visits our site every 6 hours. This data completely changed our content strategy.” – Digital Publisher
“Found ByteDance scraping our entire product catalog at 3 AM daily. Now we can make informed decisions about blocking.” – E-commerce Owner
</blockquote>
<h4>🔍 Actionable Insights You’ll Get</h4>
Automatic tracking reveals: 
* Which AI companies are most interested in your content 
* Your most valuable pages according to AI systems 
* Optimal posting times for AI crawler discovery 
* Suspicious scraping patterns to investigate 
* Content gaps AI systems are looking for 
* Competitive intelligence on AI training data
Make informed decisions about: 
* Which bots to allow or block in robots.txt 
* Content optimization for AI-powered search 
* Publishing schedules for maximum AI visibility 
* Technical SEO for AI crawlers 
* LLMO strategy development
<h4>🛠️ Advanced Administration</h4>
The plugin works automatically, but power users can: 
* Filter logs by any parameter 
* Analyze patterns across time periods 
* Identify bot behavior anomalies 
* Track crawler response codes 
* Monitor crawl budget usage 
* Set up custom tracking rules 
* Export data for external analysis
<h4>📚 Resources & Documentation</h4>
<ul>
<li><a href="https://hueston.co/llmo-ai-seo/what-is-llmo-complete-guide-to-large-language-model-optimization/" rel="nofollow ugc">What is LLMO? Complete Guide</a></li>
<li><a href="https://github.com/HuestonCo/wordpress-llm-crawler-log" rel="nofollow ugc">GitHub Repository</a></li>
<li><a href="https://wordpress.org/support/plugin/llm-bot-tracker-by-hueston/" rel="ugc">Support Forum</a></li>
</ul>
<h4>🏆 Why Choose LLM Bot Tracker?</h4>
✅ Automatic & Effortless – Install and forget, it just works 
✅ Most Comprehensive – Tracks more AI bots than any other plugin 
✅ Lightweight – Won’t slow your site like analytics plugins 
✅ Privacy-First – No cookies, no human tracking, GDPR ready 
✅ Actively Maintained – New bot detection added monthly 
✅ 100% Free Forever – No premium upsells or feature gates 
✅ Professional Support – Built by Hueston, trusted WordPress experts since 2019
Join thousands of sites gaining AI visibility insights. Install LLM Bot Tracker today and understand your AI traffic immediately!
<h3>Additional Information</h3>
<h4>System Requirements</h4>
<ul>
<li>WordPress 6.5 or higher</li>
<li>PHP 7.4 or higher </li>
<li>MySQL 5.6 or higher</li>
<li>10MB free disk space</li>
</ul>
<h4>Privacy Policy</h4>
This plugin only tracks AI bots and crawlers, never human visitors. All data is stored locally in your WordPress database. No external API calls are made. No personal data is collected, transmitted, or sold.
<h4>Credits</h4>
<ul>
<li>Built with ❤️ by the <a href="https://hueston.co" rel="nofollow ugc">Hueston LLMO Team</a></li>
<li>Special thanks to the WordPress community for feedback and testing.</li>
</ul>
<h4>Legal Notice</h4>
This plugin is not affiliated with OpenAI, Anthropic, Perplexity, Google, Meta, or any AI company mentioned. All bot names and trademarks are property of their respective owners. This plugin simply detects and reports on publicly identifiable user agents.

LLM Bot Tracker – AI Crawler Detection & Analytics

Love it

Automatically track ChatGPT, Claude, Perplexity & 56 AI bots crawling your WordPress site. Monitor AI search engine visits, detect AI web scrapers …

WebDigit LLMs Index Suite vs LLM Bot Tracker – AI Crawler Detection & Analytics