BizSugar.com › Online Marketing › Importance of Robots.txt File in SEO

Robots.txt File, otherwise known as “Robots Exclusion Protocol or Robot Exclusion Standard“, is a regular text (not html) file that you put on your site, specifically in your root directory, which will instruct search engine spiders or robots which web page of files in your website should be indexed and which pages should be ignored.