User-agent: * Allow: / Disallow: /dashboard Disallow: /journal Disallow: /api/ Disallow: /admin Disallow: /system-settings Disallow: /database-management Disallow: /activity-logs Disallow: /subscription-management Disallow: /trade-auditing Disallow: /messaging # OpenAI / ChatGPT User-agent: GPTBot Allow: / # Google AI / Gemini User-agent: Google-Extended Allow: / # Anthropic / Claude User-agent: ClaudeBot Allow: / # Perplexity AI User-agent: PerplexityBot Allow: / # Meta AI User-agent: Meta-ExternalAgent Allow: / # Apple User-agent: Applebot-Extended Allow: / # Common Crawl (used for AI training data) User-agent: CCBot Allow: / Sitemap: https://www.treydly.com/sitemap.xml