Spider

Also known as: Bot, Web Crawler, Crawler

A program search engines use to crawl the web. Bots or spiders visit webpages to collect information and add or update a search engine’s index.

FAQ

This is the discovery process where search engines send out crawlers or bots to update content or find new content on the web.

Similar to search engine crawlers, SEO spiders are able to crawl websites and get onsite data which SEO professionals can use.