ABCdatos

In a nutshell: You don’t want robots wasting your resources and slowing down your site if they don’t give you some kind of direct or indirect benefit. An optimal configuration will maximize your SEO results and reduce your operating costs.
You’ll need less than a minute to set your site characteristics and get a customized robots.txt configuration installed, matching your needs and easily updated without headaches. Let us to apply our experience in maintaining and optimizing sites. A clear knowledge of what we want to do and why, moved us to change the decission method from human created robots.txt to an automated system, things are simpler as they seems. Here comes to help this plugin, doing all the magic for you.
Some of your site specs will be automatically detected to reduce the manual config needs to the minimum. A few simple questions about your site will be enough to vast majority of sites.
<h3>Update procedure</h3>
Any change required to the robots.txt is applied in real time when operating in virtual file mode. If you are working in real file mode, after updating the plugin version you should click the Save Changes button in the configuration screen to regenerate the robots.txt file.

Magic robots.txt

This plugin automatically creates a robots.txt analyzing your site to improve your Google ranking and site performance.

ashlealanier

mickmel

This blocks semalt.com, buttons-for-website.com and others with a 403 Forbidden message so that they no longer show up in your Google Analytics stats. This won’t block ghost referrals (no plugin can do that), but <a href="http://www.greenmellenmedia.com/blocking-ghost-referrals-in-google-analytics/" rel="nofollow ugc">this short video</a> will walk you through that process in Google Analytics.
Once installed, this plugin will run automatically in the background; there is no options panel or anything to see in your dashboard.
Other sites will be added to the block list over time via updates to this plugin.
For more information, visit us at <a href="http://www.greenmellenmedia.com" rel="nofollow ugc">GreenMellenMedia.com</a> or find us on Twitter <a href="http://twitter.com/greenmellen" rel="nofollow ugc">@GreenMellen</a>.
Current list of blocked bots: All sites ending in .xyz, 100dollars-seo.com, 4webmasters.org, 7makemoneyonline.com, adviceforum.info, aliexpress.com, amazonaws.com, anticrawler.org, avtlg.ru, bashtel.ru, best-seo-offer.com, best-seo-solution.com, bestsub.com, bestwebsitesawards.com, blackhatworth.com, burger-imperia.com, buttons-for-website.com, buttons-for-your-website.com, buy-cheap-online.info, chinese-amezon.com, clicksor.com, copyrightclaims.org, corbina.ru, cpty.com, darodar.com, depositfiles-porn.ga, domination.ml, e-buyeasy.com, ebin.cc, econom.co, erot.co, ertelecom.ru, event-tracking.com, fix-website-errors.com, free-floating-buttons.com, floating-share-buttons.com, free-share-buttons.com, free-share-buttons.top, free-social-buttons.com, free-video-tool.com, get-free-social-traffic.com, get-free-traffic-now.com, ɢoogle.com, googlsucks.com, guardlink.com, guardlink.org, hol.es, hongfanji.com, how-to-earn-quick-money.com, howtostopreferralspam.eu, hulfingtonpost.com, hvd-store.com, ilovevitaly.*, is74.ru, kabbalah-red-bracelets.com, kambasoft.com, kes.ru, keywords-monitoring-your-success.com, lifehacĸer.com, magicdiet.gq, makemoneyonline.com, monetizationking.net, mts.ru, mts-nn.ru, nationalcablenetworks.ru, netbynet.ru, o-o-6-o-o.com, pizza-tycoon.com, pogodnyyeavarii.gq, pornhub-forum.ga, priceg.com, qualitymarketzone.com, rank-checker.online, ranking2017.ga, rankings-analytics.com, rankscanner.com, ranksonic.org/info, sanjosestartups.com, sashagreyblog.ga, savetubevideo.com, search.myway.com, search.tb.ask.com, semalt.com, seo-platform.com, sexyali.com, simple-share-buttons.com, site-16528012-1.snip.tw, site-auditor.online, sitequest.ru, snip.to, social-buttons-*, social-s-*, success-seo.com, theguardlan.com, top1-seo-service.com, torture.ml, traffic2money.com, trafficmonetizer.net, uni.me, uptime.com, video–production.com, videos-for-your-business.com, webmonetizer.net, website-analyzer.info, works.if.ua, wow.com, youporn-forum.ga, yourserverisdown.com

GM Block Bots

This blocks semalt.com, buttons-for-website.com and others with a 403 Forbidden message so that they no longer show up in your Google Analytics stats.

Magic robots.txt vs GM Block Bots