Denis Bisteinov

Have you encountered an obstacle while creating and editing robots.txt file on your website?
Bisteinoff SEO Robots.txt is an easy-to-use plugin that helps you generate and configure a correct robots.txt file, which is essential for search engine optimization (SEO). This file defines crawling rules for search engine bots such as Google, Bing, Yahoo!, Yandex, and others.
The plugin works perfectly both if the file robots.txt has never been created or if it already exists. Once installed the plugin makes an optimized robots.txt file that includes special rules common for WordPress websites. After that you can proceed further customization specific for your own website if needed.
If the plugin detects one or several Sitemap XML files it will include them into robots.txt file.
No FTP access, manual coding or file editing is required that makes managing settings easy and convenient!
<h4>Key Features</h4>
<ul>
<li>Automatic generation of optimized robots.txt with WordPress-specific rules</li>
<li>Special rules for Google and Yandex search engines</li>
<li>Custom rules support for any search engine bot</li>
<li>Automatic sitemap detection and inclusion</li>
<li>WooCommerce compatibility with specific rules</li>
<li>Multisite support</li>
<li>Easy-to-use admin interface</li>
<li>Modern PHP architecture with namespaces for conflict-free operation</li>
</ul>

Bisteinoff SEO Robots.txt

An easy-to-use plugin that generates and configures a proper robots.txt file, essential for effective search engine optimization (SEO).

msfreed

Thin Content Manager helps you easily identify thin content pages (i.e. posts and pages with minimal textual content) on your site and block them from search engines. The plugin calculates the body word count for each post/page on your site (disregarding words contained within HTML tags and shortcodes) and displays the information on a new ‘Thin Content Manager’ page within the Settings section of your WordPress admin panel. The admin page then provides a simple point-and-click interface to automatically insert robots noindex and nofollow tags – <meta name=”robots” content=”noindex, nofollow”> – into the head section of pages you select. These tags tell Google and other search engine spiders to ignore those pages, which is important for improving your site’s quality score and trust ranking for SEO purposes.
This plugin works with with single site installs only.

Thin Content Manager

See the body word count to identify pages with thin content, then select pages to insert robots noindex,nofollow tags into.

Bisteinoff SEO Robots.txt vs Thin Content Manager