Search Engine Spiders or Robots

Search Engine use special software called Spider to crawl the website and find new links and website. Search Engine Spiders also know as robots, crawlers, agents etc. Search Engine robots are different from one Search Engine to another. Some of the Major Search Engines and their agents are as follows:

Major Search Engines	Agents
	Googlebot
	Inktomi Slurp
	MSNBot