Yahoo spidering

[candiid]

No two ways about it that it is difficult to understand yahoo spiders .However you can predict google crawlers to some extent .

[bermuda]

I think Yahoo bit is like the google's in that it follows the backlinks pointing at websites in order to crawl their pages and contents. No wonder some websites which are powered by thousands of links are getting regularly crawled by the Yahoo search engine robot and as you know it would lead to more pages indexing and listing.

[darylnelson]

There is not much of different between yahoo spidering and Google spidering. Basically, spider is just a PC program that follows some links on web.

[andrewhall345]

What is the responsibility of Gmail with Google site spider aside from that I choose Google but Yahoo is quicker at indexing my latest and current pages.