Papin Schipper

boudewijnkok

<h4>What is a sitemap?</h4>
<p>A sitemap is a file where you provide information about the pages and posts your site, and the relationships between them. Search engines read this file to more intelligently crawl your site. A sitemap tells the search engine which pages you think are important in your site, and also provides valuable information about these pages: for example, when the page was last updated, how often the page is changed, and any alternate language versions of a page.</p>
<h4>Plugin Features</h4>
<p>Easily create a sitemap which is then updated every hour, or can be updated manually at any time via the WordPress dashboard. You can select single pages/posts or entire posttypes that you want to exclude from the sitemap. It will generate both an XML sitemap and an HTML sitemap that you can display on your site via the shortcode or gutenberg block.</p>
<h4>We’ll keep search engines up-to-date for you</h4>
<p>If there are changes being made to your sitemap we’ll notify search engines for you. You don’t have to submit them manual anymore.</p>
<h4>What do we add to the sitemap?</h4>
<p>The following URLs are added to the sitemap (with an option to hide them, ofcourse):</p>
<ul>
<li>Pages</li>
<li>Posts</li>
<li>Post images</li>
<li>Post categories</li>
<li>Post tags</li>
<li>Custom post types</li>
<li>Custom taxonomies</li>
<li>Additional pages: Add URLs yourself</li>
</ul>
<h4>Robots editor</h4>
<p>While a sitemap allows search engines to scan pages faster, a robots.txt file disallows search engines from scanning certain pages. This plugin also comes with a handy robots editor to give you full control over your search engine visibility.</p>
<h4>Multilingual</h4>
<p>Companion Sitemap Generator also supports <a href="https://support.google.com/webmasters/answer/2620865?hl=en" rel="nofollow ugc">multilingual sitemaps</a>. Right now this is only supported when using the Polylang plugin but more plugins will be added upon request.</p>
<h4>Multisite</h4>
<p>This plugin has support for multisite. Each site will get its own sitemap.</p>


Companion Sitemap Generator – HTML & XML

Easy to use XML and HTML sitemap generator + Robots editor

apasionados

<p>This plugin adds lines to the virtual robots.txt file (that WordPress creates automagically if the file is not present physically on the server) to block the archive.org bots.</p>
<blockquote>
<p>Please be aware of what this plugin does exactly: If you activate the plugin it will add some lines to the robots.txt file to tell the <a href="https://archive.org/" rel="nofollow ugc">Archive.org bots</a> <strong>not to crawl and index</strong> your page. This means that they won’t store a backup of your site and you won’t be able to browse the different versions of the website through time.</p>
<p>Please keep in mind that if you activate this plugin and your site is deleted from the archive.org index, you can’t undo this. If you remove the plugin and the block of the archive.org bot, they’ll start again crawling and indexing the website from that moment, but all the older information is lost. <strong>Be carefull and think if this is what you want to do!</strong>. If you mess it nobody will not be able to help you (neither we or archive.org).</p>
</blockquote>
<p><strong>Please only activate this plugin if you know what you’re doing</strong>.</p>
<h4>What can I do with this plugin?</h4>
<p>This plugin adds the necessary lines to the virtual robots.txt file that WordPress creates automagically to block the archive.org bots.</p>
<h4>What ideas is this plugin based on?</h4>
<p>None. We needed a fast solution to add these lines to the robots.txt file and this was the solution we coded.</p>
<h4>System requirements</h4>
<p>PHP version 5.5 or greater.</p>
<h4>Block archive.org bots robots.txt Plugin in your Language!</h4>
<p>The first release is avaliable in English and Spanish. In the “languages” folder we have included the necessary files to translate this plugin.</p>
<p>If you would like the plugin in your language and you’re good at translating, please use the <a href="https://translate.wordpress.org/projects/wp-plugins/block-archive-org-robots-txt/" rel="nofollow ugc">native WordPress Translation</a> functionality.</p>
<p>New to Translating a plugin? First read through the <a href="https://make.wordpress.org/polyglots/handbook/tools/glotpress-translate-wordpress-org/" rel="nofollow ugc">Translator Handbook</a>, then select your locale at <a href="https://translate.wordpress.org/" rel="nofollow ugc">Translating WordPress</a> and finally go to the <a href="https://translate.wordpress.org/projects/wp-plugins/block-archive-org-robots-txt/" rel="nofollow ugc">translation page for this plugin</a> to translate it.</p>
<h4>Further Reading</h4>
<p>You can access the description of the plugin in Spanish at: <a href="https://apasionados.es/blog/bloquear-el-bot-de-archive-org-a-traves-de-robots-txt-wordpress-plugin-7752/" rel="nofollow ugc">Block archive.org bots robots.txt en español</a>.</p>
<h3>Contact</h3>
<p>For further information please send us an <a href="https://apasionados.es/contacto/index.php?desde=wordpress-org-block-archive-org-robots-txt" rel="nofollow ugc">email</a>.</p>


Block Archive.org via WordPress robots.txt

Blocks the archive.org bots through the WordPress virtual robots.txt file.

Companion Sitemap Generator – HTML & XML vs Block Archive.org via WordPress robots.txt