Being Crawlable by the Right Bots
Check whether important pages are accessible to the crawlers used by the AI services you want to appear in. For ChatGPT Search, OAI-SearchBot is the relevant OpenAI crawler; GPTBot serves a different purpose related to training. Perplexity and other AI platforms have their own crawling and access controls. A robots.txt rule, firewall or bot-protection system can unintentionally prevent access.















































