Crawls web content to provide search results for Meta AI users.