A Robot (also called a "bot") is a software program that operates to find websites by following links from other websites, crawl through their pages, summarize and categorize the content of the page, and feed it to a search engine's index. Well-known robots are the Googlebot, Bingbot, Baiduspider, and Yandex Bot. There are many others.
