# ------------------------------ # Allow ALL Search Engines & ALL AI Crawlers # ------------------------------ User-agent: * Allow: / Allow: /llms.txt # OpenAI Crawlers User-agent: GPTBot Allow: / Allow: /llms.txt User-agent: OAI-SearchBot Allow: / Allow: /llms.txt # Perplexity AI User-agent: PerplexityBot Allow: / Allow: /llms.txt # Google User-agent: Googlebot Allow: / Allow: /llms.txt User-agent: Googlebot-Image Allow: / Allow: /llms.txt User-agent: Googlebot-Mobile Allow: / Allow: /llms.txt # Bing / Microsoft User-agent: Bingbot Allow: / Allow: /llms.txt # Apple / Siri / AppleBot User-agent: Applebot Allow: / Allow: /llms.txt # DuckDuckGo Bot User-agent: DuckDuckBot Allow: / Allow: /llms.txt # Yahoo User-agent: Slurp Allow: / Allow: /llms.txt # Yandex User-agent: Yandex Allow: / Allow: /llms.txt # Baidu User-agent: Baiduspider Allow: / Allow: /llms.txt # Claude / Anthropic User-agent: ClaudeBot Allow: / Allow: /llms.txt # Common AI Dataset Crawlers User-agent: CCBot Allow: / Allow: /llms.txt User-agent: Claude-SearchBot Allow: / Allow: /llms.txt User-agent: Claude-User Allow: / Allow: /llms.txt # ------------------------------ # Default Rules for ALL Other Bots # ------------------------------ User-agent: * Allow: / Allow: /llms.txt Disallow: /?detail/ Disallow: /?shop/ Disallow: /?reserve/ Disallow: /?order/ # ------------------------------ # Sitemap # ------------------------------ Sitemap: https://boothfabricators.com/sitemap.xml