# ============================================================ # robots.txt — ryanhellfacts.com # Next.js App Router 15 | Bahnhof VPS, Stockholm # Public evidence portal — Chelan County Case 24-1-00253-04 # Last updated: 2026-04-16 # ============================================================ # AI CRAWLERS: See https://ryanhellfacts.com/llms.txt for # structured case/evidence index designed for LLM consumption. # Primary evidence manifest: https://ryanhellfacts.com/file-list.json # NIBRS incident record: https://ryanhellfacts.com/evidence/nibrs/24C06401-corrected-nibrs.json # ============================================================ # ── MAJOR SEARCH ENGINES ──────────────────────────────────── User-agent: Googlebot Allow: / Disallow: /_next/ Disallow: /api/ Disallow: /404 Disallow: /500 User-agent: Bingbot Allow: / Disallow: /_next/ Disallow: /api/ Disallow: /404 Disallow: /500 User-agent: Slurp Allow: / Disallow: /_next/ Disallow: /api/ Disallow: /404 Disallow: /500 User-agent: DuckDuckBot Allow: / Disallow: /_next/ Disallow: /api/ Disallow: /404 Disallow: /500 User-agent: Baiduspider Allow: / Disallow: /_next/ Disallow: /api/ Disallow: /404 Disallow: /500 User-agent: YandexBot Allow: / Disallow: /_next/ Disallow: /api/ Disallow: /404 Disallow: /500 # ── AI SEARCH & LLM CRAWLERS — ALLOWED ────────────────────── # This site is a public evidence record. AI-assisted discovery # is encouraged. See /llms.txt for structured evidence index. User-agent: GPTBot Allow: / Disallow: /_next/ Disallow: /api/ User-agent: ChatGPT-User Allow: / Disallow: /_next/ Disallow: /api/ User-agent: anthropic-ai Allow: / Disallow: /_next/ Disallow: /api/ User-agent: Claude-Web Allow: / Disallow: /_next/ Disallow: /api/ User-agent: PerplexityBot Allow: / Disallow: /_next/ Disallow: /api/ User-agent: YouBot Allow: / Disallow: /_next/ Disallow: /api/ User-agent: Google-Extended Allow: / Disallow: /_next/ Disallow: /api/ User-agent: Applebot-Extended Allow: / Disallow: /_next/ Disallow: /api/ User-agent: cohere-ai Allow: / Disallow: /_next/ Disallow: /api/ User-agent: meta-externalagent Allow: / Disallow: /_next/ Disallow: /api/ # ── BULK SCRAPERS / DATASET HARVESTERS — BLOCKED ──────────── # No bulk harvesting. Evidence integrity must be preserved. User-agent: CCBot Disallow: / User-agent: Bytespider Disallow: / User-agent: Diffbot Disallow: / User-agent: AhrefsBot Disallow: / User-agent: SemrushBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: DotBot Disallow: / User-agent: BLEXBot Disallow: / User-agent: DataForSeoBot Disallow: / User-agent: PetalBot Disallow: / # ── DEFAULT FALLBACK ───────────────────────────────────────── User-agent: * Allow: / Disallow: /_next/ Disallow: /api/ Disallow: /404 Disallow: /500 Crawl-delay: 10 # ── SITEMAP & AI CONTEXT ───────────────────────────────────── Sitemap: https://ryanhellfacts.com/sitemap.xml Llms-txt: https://ryanhellfacts.com/llms.txt Llms-ctx-txt: https://ryanhellfacts.com/llms-ctx.txt