Thread: what is a robot.txt file
View Single Post
  #9 (permalink)  
Old 02-13-2010, 12:00 PM
prakask's Avatar
prakask prakask is offline
Senior Member
  
Join Date: Nov 2009
Posts: 301
prakask is on a distinguished road
This is a file that keeps away search engines from indexing pages you do not want spidered. But every site cannot use it.
__________________
Prakask the Great
ask a doctor online| Online Doctor
Reply With Quote