Quote:
Originally Posted by seopeter
Robots txt file is very usefull to prevent any bot to index your web site, infact each web site should have because i do not think that many crawlers check and index your web site with having robots.txt
|
You are right mate ...Still i think that happens..
But at one instance it happened that i used it and still my site got indexed ..i did some social bookmarking of that site ...it may be the whole sol reason...!!