mohamed wazery

MW LLMS Index is a WordPress plugin that automatically generates AI-friendly index files for your website. It creates <code>llms.txt</code> (plain text) and <code>llms.json</code> (structured JSON) files inside <code>wp-content/uploads/mw-llm-index/</code>, making it easy for AI systems to discover and understand your content.
Key Features:
<ul>
<li>Automatic Index Generation: Automatically generates <code>llms.txt</code> and <code>llms.json</code> files with all your published posts and pages</li>
<li>SEO Plugin Integration: Seamlessly integrates with popular SEO plugins (Rank Math, Yoast SEO, All in One SEO) to use meta descriptions</li>
<li>Flexible Scheduling: Choose from daily, weekly, or manual regeneration schedules using WP Cron</li>
<li>AI Bot Logging: Optional logging of AI bot visits (GPTBot, ClaudeBot, PerplexityBot) to track when AI systems access your site</li>
<li>REST API Access: Access your index data programmatically via WordPress REST API</li>
<li>Auto-Generation: Automatically creates files on activation if they don’t exist</li>
<li>Clean Uninstall: Removes all generated files and settings when uninstalled</li>
</ul>
Technical Features:
<ul>
<li>✔ WP Cron Integration: Uses WordPress built-in cron system for scheduled updates</li>
<li>✔ Editor Compatibility: Works seamlessly with both Gutenberg and Classic Editor</li>
<li>✔ Zero Frontend Assets: No JavaScript or CSS files loaded on the frontend – lightweight and fast</li>
<li>✔ WordPress Standards: Follows WordPress coding standards and best practices</li>
<li>✔ Multisite Compatible: Works on single-site and multisite installations</li>
</ul>
What is llms.txt?
The <code>llms.txt</code> file is a standardized format for providing AI systems with a structured index of your website’s content. It helps AI models like ChatGPT, Claude, and Perplexity understand what content is available on your site and how to access it.
How It Works:
<ol>
<li>The plugin scans all published posts and pages on your WordPress site</li>
<li>Extracts titles, URLs, and descriptions (from SEO plugins when available)</li>
<li>Generates two files:
<ul>
<li><code>llms.txt</code> – Human-readable plain text format</li>
<li><code>llms.json</code> – Machine-readable JSON format for programmatic access</li>
</ul>
</li>
<li>Files are automatically updated based on your chosen schedule</li>
</ol>
Use Cases:
<ul>
<li>Help AI systems discover and index your content</li>
<li>Improve AI model understanding of your website structure</li>
<li>Provide structured content metadata for AI training</li>
<li>Track when AI bots visit your site</li>
<li>Export your content index for external use</li>
</ul>
Useful Links:
<ul>
<li><a href="https://github.com/mohamedwazery/mw-llms-index/wiki" rel="nofollow ugc">Documentation</a></li>
<li><a href="https://github.com/mohamedwazery/mw-llms-index/issues" rel="nofollow ugc">Report Issues</a></li>
<li><a href="https://github.com/mohamedwazery/mw-llms-index" rel="nofollow ugc">GitHub Repository</a></li>
</ul>
<h3>External Services</h3>
This plugin does NOT connect to any external services or APIs. All data is: 
* Generated locally on your WordPress server 
* Stored in your uploads directory 
* Accessible only through your own domain 
* Not transmitted to third parties
The plugin is completely self-contained and operates entirely within your WordPress installation.
<h3>Support</h3>
For support, feature requests, or bug reports, please visit: 
* <a href="https://github.com/mohamedwazery/mw-llms-index/issues" rel="nofollow ugc">GitHub Issues</a> 
* <a href="https://wordpress.org/support/plugin/mw-llms-index/" rel="ugc">WordPress.org Support Forum</a>
<h3>Credits</h3>
Developed by Mohamed Khalil Wazery 
Website: https://wazery.net
<h3>Privacy</h3>
This plugin: 
* Does not collect any user data 
* Does not send data to external servers 
* Only generates files locally on your WordPress installation 
* Optionally logs AI bot visits locally (can be disabled) 
* Does not use cookies 
* Does not track users
The generated <code>llms.txt</code> and <code>llms.json</code> files are publicly accessible (located in <code>wp-content/uploads/mw-llm-index/</code>) and contain information about your published content, similar to what would be available in your sitemap.
<h3>Security Notes</h3>
Important Security Information:
This plugin does not expose private data and only outputs publicly available content, similar to a sitemap. The generated files contain: 
* Only published posts and pages (same visibility as your public website) 
* Titles, URLs, and meta descriptions (already publicly accessible) 
* No private user information 
* No sensitive data or credentials
The files are placed in <code>wp-content/uploads/mw-llms-index/</code> and are publicly accessible, but they only contain information that is already available on your public website. If you have concerns about specific content being indexed, ensure those posts/pages are set to private or draft status.

MW LLMS Index

Generate AI-friendly llms.txt and llms.json index files to help AI systems discover and understand your WordPress content.

OllieJones

rjasdfiii

<h4>How do I use this plugin?</h4>
After you install and activate this plugin, visit the Index MySQL Tool under the Tools menu. From there you can press the Add Keys Now button. If you have large tables, use it with <a href="https://wp-cli.org/" rel="nofollow ugc">WP-CLI</a> instead to avoid timeouts. See the WP-CLI section to learn more.
<h4>What does it do for my site?</h4>
This plugin works to make your MySQL database work more efficiently by adding high-performance keys to the tables you choose. On request it monitors your site’s use of your MySQL database to detect which database operations are slowest. It is most useful for large sites: sites with many users, posts, pages, and / or products.
You can use it to restore WordPress’s default keys if need be.
<h4>What is this all about?</h4>
Where does WordPress store all that stuff that makes your site great? Where are your pages, posts, products, media, users, custom fields, metadata, and all your valuable content? All that data is in the <a href="https://www.mysql.com/" rel="nofollow ugc">MySQL</a> relational database management system. (Many hosting providers and servers use the <a href="https://mariadb.org/" rel="nofollow ugc">MariaDB</a> fork of the MySQL software; it works exactly the same way as MySQL itself.)
As your site grows, your MySQL tables grow. Giant tables can make your page loads slow down, frustrate your users, and even hurt your search-engine rankings. And, bulk imports can take absurd amounts of time. What can you do about this?
You can install and use a database cleaner plugin to get rid of old unwanted data and reorganize your tables. That makes them smaller, and therefore faster. That is a good and necessary task. That is not the task of this plugin. You can, if your hosting provider supports it, install and use a <a href="https://developer.wordpress.org/reference/classes/wp_object_cache/#persistent-cache-plugins" rel="nofollow ugc">Persistent Object Cache plugin</a> to reduce traffic to your database. That is not the task of this plugin either.
This plugin adds database <a href="https://dev.mysql.com/doc/refman/8.0/en/mysql-indexes.html" rel="nofollow ugc">keys</a> (also called indexes) to your MySQL tables to make it easier for WordPress to find the information it needs. All relational database management systems store your information in long-lived tables. For example, WordPress stores your posts and other content in a table called wp_posts, and custom post fields in another table called wp_postmeta. A successful site can have thousands of posts and hundreds of thousands of custom post fields. MySQL has two jobs:
<ol>
<li>Keep all that data organized.</li>
<li>Find the data it needs quickly.</li>
</ol>
To do its second job, MySQL uses database keys. Each table has one or more keys. For example, <code>wp_posts</code> has a key to let it quickly find posts when you know the author. Without its post_author key MySQL would have to scan every one of your posts looking for matches to the author you want. Our users know what that looks like: slow. With the key, MySQL can jump right to the matching posts.
In a new WordPress site with a couple of users and a dozen posts, the keys don’t matter very much. As the site grows the keys start to matter, a lot. Database management systems are designed to have their keys updated, adjusted, and tweaked as their tables grow. They’re designed to allow the keys to evolve without changing the content of the underlying tables. In organizations with large databases adding, dropping, or altering keys doesn’t change the underlying data. It is a routine maintenance task in many data centers. If changing keys caused databases to lose data, the MySQL and MariaDB developers would hear howling not just from you and me, but from many heavyweight users. (You should still back up your WordPress instance of course.)
Better keys allow WordPress’s code to run faster without any code changes. Experience with large sites shows that many MySQL slowdowns can be improved by better keys. Code is poetry, data is treasure, and database keys are grease that makes code and data work together smoothly.
<h4>Which tables does the plugin add keys to?</h4>
This plugin adds and updates keys in these WordPress and WooCommerce tables.
<ul>
<li>wp_comments</li>
<li>wp_commentmeta</li>
<li>wp_posts</li>
<li>wp_postmeta</li>
<li>wp_termmeta</li>
<li>wp_users</li>
<li>wp_usermeta</li>
<li>wp_options</li>
<li>wp_wc_orders_meta</li>
<li>wp_woocommerce_order_itemmeta</li>
<li>wp_automatewoo_log_meta</li>
</ul>
You only need run this plugin once to get its benefits.
<h4>How can I monitor my database’s operation?</h4>
On the Index MySQL page (from your Tools menu on your dashboard), you will find the “Monitor Database Operations” tab. Use it to request monitoring for a number of minutes you choose.
You can monitor
<ul>
<li>either the site (your user-visible pages) or the dashboard, or both.</li>
<li>all pageviews, or a random sample. (Random samples are useful on very busy sites to reduce monitoring overhead.)</li>
</ul>
Once you have gathered monitoring information, you can view the captured queries, and sort them by how long they take. Or you can save the monitor information to a file and show it to somebody who knows about database operations. Or you can upload the monitor to the plugin’s servers so the authors can look at it.
It’s a good idea to monitor for a five-minute interval at a time of day when your site is busy. Once you’ve completed a monitor, you can examine it to determine which database operations are slowing you down the most.
Please consider uploading your saved monitors to the plugin’s servers. It’s how we learn from your experience to keep improving. Push the Upload button on the monitor’s tab.
<h4>WP-CLI command line operation</h4>
This plugin supports <a href="https://wp-cli.org/" rel="nofollow ugc">WP-CLI</a>. When your tables are large this is the best way to add the high-performance keys: it doesn’t time out.
Give the command <code>wp help index-mysql</code> for details. A few examples:
<ul>
<li><code>wp index-mysql status</code> shows the current status of high-performance keys.</li>
<li><code>wp index-mysql enable --all</code> adds the high-performance keys to all tables that don’t have them.</li>
<li><code>wp index-mysql enable wp_postmeta</code> adds the high-performance keys to the postmeta table.</li>
<li><code>wp index-mysql disable --all</code> removes the high-performance keys from all tables that have them, restoring WordPress’s default keys.</li>
<li><code>wp index-mysql enable --all --dryrun</code> writes out the SQL statements necessary to add the high-performance keys to all tables, but does not run them.</li>
<li><code>wp index-mysql enable --all --dryrun | wp db query</code> writes out the SQL statements and pipes them to wp db to run them.</li>
</ul>
Note: avoid saving the –dryrun output statements to run later. The plugin generates them to match the current state of your tables.
<h4>Why use this plugin?</h4>
Three reasons (maybe four):
<ol>
<li>to save carbon footprint.</li>
<li>to save carbon footprint.</li>
<li>to save carbon footprint.</li>
<li>to save people time.</li>
</ol>
Seriously, the microwatt hours of electricity saved by faster web site technologies add up fast, especially at WordPress’s global scale.
<h4>How can I learn more about making my WordPress site more efficient?</h4>
We offer several plugins to help with your site’s database efficiency. You can <a href="https://www.plumislandmedia.net/wordpress/performance/optimizing-wordpress-database-servers/" rel="nofollow ugc">read about them here</a>.
<h4>Credits</h4>
<ul>
<li>Michael Uno for Admin Page Framework.</li>
<li>Marco Cesarato for LiteSQLParser.</li>
<li>Allan Jardine for Datatables.net.</li>
<li>Leho Kraav and Sebastian Sommer for suggesting the WooCommerce tables.</li>
<li>Japreet Sethi for advice, and for testing on his large installation.</li>
<li>Rick James for everything.</li>
<li>Jetbrains for their IDE tools, especially PhpStorm. It’s hard to imagine trying to navigate an epic code base without their tools.</li>
</ul>

Index WP MySQL For Speed

Thanks for this wonderful, simple, effective and powerful plugin!

It made one of our queries 133 times faster. What a joy.

Made one of our queries 133 times faster!

This is absolutely fantastic work. I've reviewed your discussions on WP issue tracker and various other places and came to the same conclusion. While I had already added some of my own custom indexes long ago, this is even better. Amazing job!

Fantastic

Wow. Fantastic plugin! I am using the CLI to do the optimization, and within 30 seconds, all the problems with slow queries are gone! This plugin is a must-have if you have large database. :)

Fantastic plugins


I can't understand how Wordpress doesn't natively bring these indexes that speed up performance so much. Thanks to the author for this plugin.


Indexing wp should have


Great, great plugin!



Thank you for this masterpiece of software. I've optimized client's databases in seconds, changed table formats to InnoDB in seconds, and added indexes to million chains tables in minutes.



Thanks!



¡Gracias!


1.5 GB Database optimized in minutes

It's great to see a plugin like this created and maintained to such a high standard. Thank you Ollie

Top class


My WordPress-powered sites aren't popular and don't have a lot of posts yet. Still, I noticed a difference in speed immediately.


Impressive


We've used this plugin on a few busy woocommerce websites and the result is amazing.



MySQL cpu usage and response times drop dramatically. Especially if used with object cache.



Thanks again!


Amazing Results

Speed up your WordPress site by adding high-performance keys (database indexes) to your MariaDB / MySQL database tables.

MW LLMS Index vs Index WP MySQL For Speed