The Siteimprove crawler is a cloud-based bot that scans websites to monitor quality, SEO, accessibility, and policy compliance. It identifies itself through specific user agent strings (such as SiteCheck-sitecrawl) and respects robots.txt rules while crawling domains configured within customer accounts.