Robots.txt LLM Policy
AISee how a site's robots.txt treats AI crawlers — GPTBot, ClaudeBot, Google-Extended and more.
Use this from the command line
curl -s https://ipcow.com/api/tools/robots-llm \
-H 'content-type: application/json' \
-d '{"domain":"example.com"}'