bot 
At its most general level, a bot (short for robot) is any type of automated software, but it's most commonly used in Web-cataloging software. In the world of Web searching, bots are also called spiders and crawlers. They explore the Web by retrieving a document, following all the hyperlinks in it, then generating catalogs of files that can be accessed by search engines.