There are times when you just don’t want Google to crawl certain pages such as login pages, development pages that aren’t ready to be seen or used by web surfers, temporary areas, and other web content like that. But, how can you stop Googlebot from crawling those pages anyway?
Get the Google out of there!
Posted by Webnauts under Online MarketingFrom http://blog.webnauts.net 5398 days ago
Who Voted for this Story
Subscribe
Comments