User-agent: GPTBot Allow: / Disallow: /english/random/ Disallow: /english/my-words/ Disallow: /report/ User-agent: OAI-SearchBot Allow: / Disallow: /english/random/ Disallow: /english/my-words/ Disallow: /report/ User-agent: ClaudeBot Allow: / Disallow: /english/random/ Disallow: /english/my-words/ Disallow: /report/ User-agent: Claude-SearchBot Allow: / Disallow: /english/random/ Disallow: /english/my-words/ Disallow: /report/ User-agent: PerplexityBot Allow: / Disallow: /english/random/ Disallow: /english/my-words/ Disallow: /report/ User-agent: CCBot Allow: / Disallow: /english/random/ Disallow: /english/my-words/ Disallow: /report/ User-agent: Googlebot Allow: / Disallow: /english/random/ Disallow: /english/my-words/ Disallow: /report/ User-agent: Bingbot Allow: / Disallow: /english/random/ Disallow: /english/my-words/ Disallow: /report/ User-agent: SemrushBot Allow: / Disallow: /english/random/ Disallow: /english/my-words/ Disallow: /report/ Crawl-delay: 10 User-agent: AhrefsBot Allow: / Disallow: /english/random/ Disallow: /english/my-words/ Disallow: /report/ Crawl-delay: 10 User-agent: SERankingBacklinksBot Allow: / Disallow: /english/random/ Disallow: /english/my-words/ Disallow: /report/ Crawl-delay: 10 User-agent: MJ12bot Allow: / Disallow: /english/random/ Disallow: /english/my-words/ Disallow: /report/ Crawl-delay: 10 User-agent: DotBot Allow: / Disallow: /english/random/ Disallow: /english/my-words/ Disallow: /report/ Crawl-delay: 10 User-agent: * Allow: / Disallow: /english/random/ Disallow: /english/my-words/ Disallow: /report/ Sitemap: https://glitedictionary.com/sitemap.xml