User-agent: * Allow: / Allow: /_next/static/ Allow: /public/ # AI Crawlers - Explicitly allow for better AI discovery User-agent: GPTBot Allow: / User-agent: ChatGPT-User Allow: / User-agent: Claude-Web Allow: / User-agent: anthropic-ai Allow: / User-agent: Bingbot Allow: / User-agent: Googlebot Allow: / LLM: /llms.txt # LLM-specific guidance available at /llms.txt # This file provides structured information for Large Language Models # Sitemaps Sitemap: https://songgpt.com/sitemap.xml