• Posted by PRO-Webs, Support
• 05 March 2009
• S

Spiders are also known as Search Engine Crawlers or Robots, a spider is a search engine program/protocol that "crawls" the world wide web, collecting data, following links, making cached copies of new and updated sites/pages and then storing the crawled URLs in the search engine's index.

• Posted by PRO-Webs, Support
• 12 February 2009
• R

A robot is also referred to as a spider or crawler which are computer programs used by search engines to find and index web pages on the World Wide Web.