Bot

Also known as: crawler, spider, web crawler

A program search engines use to crawl the web.

Bots visit webpages to collect information and add or update a search engine’s index.

FAQ

Bots index a page by looking at content, tags and attributes. It also looks at alt attributes for images, videos, and more.