# Last reviewed: 2026-09-28 User-agent: * # Private / system / transactional Disallow: /shopping-bag/* Disallow: /user/* Disallow: /*catalogsearch/result/index/* Disallow: /spin-the-wheel* Disallow: /search/* Disallow: /*?search=* Disallow: /*?*sort_by* Disallow: /*?*filter*&*filter* Disallow: /*%2B* Disallow: /*%2b* Disallow: /*?*ls=*&ls=* Disallow: /*?*ls%3*ls%3* Disallow: /*?*oseid=* # AI SEARCH & ASSISTANT BOTS (shared rules) User-agent: OAI-SearchBot User-agent: ChatGPT-User User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Claude-SearchBot User-agent: Claude-User User-agent: DuckAssistBot User-agent: Amazonbot Allow: / Disallow: /shopping-bag/* Disallow: /user/* Disallow: /*catalogsearch/result/index/* Disallow: /spin-the-wheel* Disallow: /search/* Disallow: /*?search=* Disallow: /*?*sort_by* Disallow: /*?*filter*&*filter* Disallow: /*%2B* Disallow: /*%2b* Disallow: /*?*ls=*&ls=* Disallow: /*?*ls%3*ls%3* Disallow: /*?*oseid=* # AI MODEL-TRAINING BOTS - BLOCKED User-agent: GPTBot User-agent: ClaudeBot User-agent: anthropic-ai User-agent: Google-Extended User-agent: Applebot-Extended User-agent: CCBot User-agent: Bytespider User-agent: Diffbot User-agent: Timpibot User-agent: Meta-ExternalAgent User-agent: FacebookBot User-agent: cohere-ai User-agent: Omgili User-agent: img2dataset Disallow: / # GOOGLE ADS User-agent: AdsBot-Google Allow: / Disallow: /shopping-bag/* Disallow: /user/* Disallow: /*catalogsearch/result/index/* Disallow: /spin-the-wheel* Disallow: /search/* Disallow: /*?search=* User-agent: AdsBot-Google-Mobile Allow: / Disallow: /shopping-bag/* Disallow: /user/* Disallow: /*catalogsearch/result/index/* Disallow: /spin-the-wheel* Disallow: /search/* Disallow: /*?search=* User-agent: freddyAiBot Allow: / Sitemap: https://www.thebodyshop.in/sitemap/index.xml