Thread: what is a robot.txt file
View Single Post
  #15 (permalink)  
Old 04-09-2010, 06:46 AM
crazedpanda crazedpanda is offline
Member
  
Join Date: Jul 2009
Posts: 79
crazedpanda is on a distinguished road
A robots.txt file tells search engines what they can and what they can not crawl and index in your site.
Reply With Quote