Tag: Robots.txt

  • Smart Robots.txt Tools (SEO)

    Smart Robots.txt Tools allows you to improve and customize ‘robots.txt’ file used by search engines and other types of bots when indexing your website. Through this file you can disallow access to some areas of the website for all or only some bots. This plugin allows you to use improved basic rules in robots.txt file…