|
Spider is nothing than PC program that follows some links on web and collects information as it goes. As these crawlers are merely PC programs, they aren't always the smartest of creatures and may get caught in endless loops built by dynamically created webpages.
|