Thread: SEO & Robots txt file
View Single Post
  #4 (permalink)  
Old 01-18-2010, 07:19 AM
jason830 jason830 is offline
Senior Member
  
Join Date: Aug 2009
Posts: 229
jason830 is on a distinguished road
yes,add a robots on your site is a good way to make spider crawl your site,it could tell spider which page he could crawl, which one he could not.
Reply With Quote