SPIDER
A robot process that automatically retrieves Web page content by following links it finds on any starting page. Typically the pages are scanned for key words that are fed into search engine databases. It is also called a webcrawler because it crawls over the Web.
More: Spider