You should understand that there isn't any universal rule to create and optimize robots.txt file; it may vary according to the content of the website and your crawl preferences for search engines.
I have discussed how to create robots.txt for WordPress sites with some samples.
How to Create robots.txt WordPress File?
Posted by nirmalablog under ResourcesFrom http://www.wpglossy.com 2971 days ago
Made Hot by: nikhilganotra on August 28, 2016 1:19 pm
Who Voted for this Story
Subscribe
Comments
2961 days ago