The Algolia Crawler extracts content from your site and makes it searchable.