User-Agent: Googlebot User-Agent: Bingbot User-Agent: DuckDuckBot User-Agent: Applebot User-Agent: LinkedInBot User-Agent: Twitterbot User-Agent: facebookexternalhit User-Agent: Slackbot Allow: / User-Agent: OAI-SearchBot User-Agent: GPTBot User-Agent: ChatGPT-User User-Agent: ClaudeBot User-Agent: Claude-SearchBot User-Agent: Claude-User User-Agent: PerplexityBot User-Agent: Perplexity-User User-Agent: Google-Extended User-Agent: Applebot-Extended User-Agent: CCBot User-Agent: Amazonbot User-Agent: meta-externalagent User-Agent: DuckAssistBot User-Agent: MistralAI-User Allow: / User-Agent: Bytespider User-Agent: ImagesiftBot User-Agent: Diffbot User-Agent: DataForSeoBot User-Agent: MJ12bot User-Agent: DotBot User-Agent: PetalBot User-Agent: Scrapy Disallow: / User-Agent: * Allow: / Crawl-delay: 10 Host: https://www.tryclean.ai Sitemap: https://www.tryclean.ai/sitemap.xml