Add robots.txt and sitemap for SEO #52

Merged
chrisp merged 2 commits from feat/sitemap-robots into main 2026-05-25 05:21:26 +00:00

2 commits

Author SHA1 Message Date
Chris Parsons
8e73296067 Fix robots.txt and sitemap issues from code review
All checks were successful
🚀 Deploy / 🧪 Test (pull_request) Successful in 1m32s
🚀 Deploy / ʦ TypeScript (pull_request) Successful in 1m23s
🚀 Deploy / 🔍 Lint (pull_request) Successful in 49s
🚀 Deploy / 🐳 Build (pull_request) Has been skipped
🚀 Deploy / 🚀 Deploy (pull_request) Has been skipped
- Point Sitemap directive at /sitemap.xml (not .gz) so crawlers receive
  plain XML without needing Content-Encoding headers
- Add Disallow: /leagues/ to block all auth-gated league routes
- Gitignore public/sitemap.xml* so they are always generated fresh at
  build time rather than serving a stale committed snapshot

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-24 22:16:49 -07:00
Chris Parsons
2978ba787d Add robots.txt and sitemap.xml.gz for SEO
Adds a static robots.txt blocking admin/API/auth routes, a sitemap
generation script (scripts/generate-sitemap.mjs) that writes both
sitemap.xml and sitemap.xml.gz to public/, and hooks it into the
build so the sitemap is always fresh on deploy.

Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-24 22:05:37 -07:00