# saor.io — robots.txt # Welcome to AI crawlers, search engines, and any polite agent. User-agent: * Allow: / # Explicit permission for AI-focused crawlers User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: ClaudeBot Allow: / User-agent: Claude-Web Allow: / User-agent: Google-Extended Allow: / User-agent: PerplexityBot Allow: / User-agent: YouBot Allow: / User-agent: CCBot Allow: / User-agent: anthropic-ai Allow: / User-agent: cohere-ai Allow: / # AI-readable resources # For humans: just open saor.io in a browser # For AI agents: we've made discovery easy Sitemap: https://saor.io/sitemap.xml # LLM-specific resources (emerging standards) # /llms.txt — curated shortlist of high-signal pages for LLM context # /llms-full.txt — concatenated full product context in one fetch # /agents.txt — plain-text format for AI crawlers (our own) # /.well-known/ai-services.json — machine-readable service descriptor # /for-agents — HTML page written specifically for AI agents