User-agent: * Allow: / # Internal-only paths that ship in the repo but aren't user-facing Disallow: /docs/ Disallow: /tests/ Disallow: /build/ Disallow: /scripts/ Disallow: /tools/ # Worker endpoints (POST-only; a GET returns 405, so keep crawlers out): # /e events, /f correction flags, /c email capture Disallow: /e$ Disallow: /f$ Disallow: /c$ # AI / generative-search crawlers: explicitly allowed (citation visibility) User-agent: GPTBot Allow: / User-agent: PerplexityBot Allow: / User-agent: ClaudeBot Allow: / User-agent: Google-Extended Allow: / Sitemap: https://cityparity.com/sitemap.xml