WordPress robots.txt plugins

Take control of your WordPress core XML Sitemap and add a Google News Sitemap.

WP Robots Txt Allows you to edit the content of your robots.txt file.

Virtual Robots.txt automatically creates a robots.txt file for your site. Your robots.txt file can be easily edited from the plugin settings page.

Robots.txt for WordPress

Replace the default WordPress robots.txt workflow with a smarter, structured version you can preview before publishing, with Free, Pro, and Premium ed …

Track crawlers, scrapers, LLM assistants, and AI agents on your website. Generate a robots.txt that blocks AI bots. Formerly Dark Visitors.

Tell AI (Artificial Intelligence) companies not to scrape your site for their AI products.

Customize your site's robots.txt and include remote content to it

Provide the easy managment of your robots.txt from admin side. It propose you the advanced then standard robots.txt content too.

The "Advanced Robots.txt Optimizer & Editor" WordPress plugin enhances website functionality, SEO and traffic management by allowing use …

DL Robots.txt Позволяет редактировать содержимое вашего файла robots.txt

This plugin automatically creates a robots.txt analyzing your site to improve your Google ranking and site performance.

Plugin to edit robots.txt file

An easy-to-use plugin that generates and configures a proper robots.txt file, essential for effective search engine optimization (SEO).

Control how AI uses your content — search, AI answers or training — via robots.txt Content Signals, HTTP headers, meta tags and TDMRep.

Shows a warning in the WordPress administration header when the option "Search Engine Visibility: Discourage search engines from indexing this si …

Easily create, edit, and manage your site's robots.txt file directly from the WordPress admin panel.

Blocks the archive.org bots through the WordPress virtual robots.txt file.

Create and edit ads.txt, app-ads.txt files from the convenience of admin dashboard.

Protect your website from AI scraping by adding opt-out instructions to your robots.txt file and including meta tags in the HTML ``.

iRobots.txt SEO is a SEO optimized, secure and customizable robots.txt virtual file creator.

The easiest way to manage meta robots tag.

Blocks the ChatGPT-User bot that is used by plugins in ChatGPT to crawl websites through the WordPress virtual robots.txt file

Provides Webmaster site verification scripts for Google, Yahoo, & Bing. Plugin also provides Google Analytics Tracking Script and sitemap support.

Easy way to discourage search engines from indexing only specific pages / posts with custom meta tags.

Blocks some WooCommerce assets and Search pages that should not be indexed through robots.txt

Checks if a site it's inivisible to search engines after a migration. If so, then the plugin warns you to review this setting.

Easily block over 30 of the most common AI user-agents known for crawling websites, keeping unauthorized bots at bay.

Modifies robots.txt to allow Googlebot access JS and CSS files.

Easily manage your WordPress site's virtual robots.txt file with custom rules. No physical file needed!

Blocks some Feed and Comment resources in order to avoid spam bots

Blocks the Common Crawl bot (CCBot) that gathers data that is used to train AI algorithms like ChatGPT through the WordPress virtual robots.txt file

AI content licensing for WordPress. Block AI crawlers or license your content and get paid. Works with ChatGPT, Claude, Gemini, and more.

See the body word count to identify pages with thin content, then select pages to insert robots noindex,nofollow tags into.

Create robots.txt, ads.txt, security.txt, llms.txt & JSON files with AI-ready content generation (ChatGPT, Claude, Gemini) at any path. No FTP needed.

Automatically generates and manages llms.txt and robots.txt files for your WordPress site with AI-optimized content.

Add some directives to your robots.txt file to keep your site safer

Dynamic robots.txt for Multisite! Change parameters, or don't, for each site of your network without losing the defaults from WordPress Includes.

ChatBot Blocker by CellarWeb adds commands to the WordPress virtual robots.txt file to block various chatbots from using your site content.

Protect your content from AI training crawlers and scraping bots. Add refusal signals, enforce blocks, and deter large-scale extraction.

Disallow access to the root directory via robots.txt with an option to enable or disable.

Generate and control sitemaps, robots.txt, ads.txt, and other essential SEO files with full transparency and no silent automation.

Protect your rights by reviewing and blocking AI bots from using your content without compensation.

A lightweight plugin to edit or create robots.txt directly from your WordPress dashboard. Developed by GoBookMart.

Warns you of server IP address changes, so you can take care of Search Engine Visibility settings.

Easily check your WordPress installation and server details along with database tables, installed plugins, and the active theme.

Advanced SEO Toolkit is a comprehensive solution for optimizing your WordPress site for search engines.

With the help of WhatIsMyBrowser the plugin detects old and bad browsers and denies them access. A special robots.txt denies crawling by bad bots.

Optimize your WordPress site for AI search engines like ChatGPT, Claude, Gemini, and Perplexity.

Generate a structured llms.txt file to manage AI and search engine crawling access across your WordPress site.

Create and manage an llms.txt file from your WordPress admin to guide LLM/AI crawlers. Set policies and disallow rules.

Make your life easy and grow with us. AI-powered SEO assistant for WordPress.

Block, log and monetise AI crawlers directly from your WordPress dashboard.

Scan your WordPress site for SEO issues and get actionable fixes. Includes sitemap, robots.txt, LLMS.txt, Open Graph, cookie consent, analytics, UTM b …

Check whether WordPress pages are technically discoverable with noindex, robots.txt, canonical, sitemap, redirect, and status-code checks.

Manage robots.txt from the WordPress admin: build rules, block bots by category, and serve a physical or virtual robots.txt.

Manage how AI models interact with your content. Implements llms.txt, robots.txt, AI Sitemaps, and machine-readable JSON policies.

Safely creates a virtual llms.txt dynamically. Features interactive bot targeting, map auto-syncing, and decoupled custom instructions.