User-agent: * Allow: / Disallow: /*.bak$ Disallow: /*.adgrants-fix-candidate$ Disallow: /*.pre-adgrants-*.bak$ # AI / LLM training + answer crawlers: blocked from the bulk debtor case corpus # only (/cases/). Research, tools, guides, and reference pages remain crawlable # and citable by AI assistants by design. Added 2026-06-16 (privacy red team C2-A). User-agent: GPTBot User-agent: ChatGPT-User User-agent: OAI-SearchBot User-agent: ClaudeBot User-agent: anthropic-ai User-agent: Claude-Web User-agent: Google-Extended User-agent: CCBot User-agent: PerplexityBot User-agent: Perplexity-User User-agent: Bytespider User-agent: Amazonbot User-agent: Applebot-Extended User-agent: Meta-ExternalAgent User-agent: Meta-ExternalFetcher User-agent: Diffbot User-agent: cohere-ai User-agent: Omgilibot User-agent: Timpibot Disallow: /cases/ Sitemap: https://openbankruptcyproject.org/sitemapindex.xml