chrisp/brackt
1
1
Fork 0
Code Issues 42 Pull requests Projects Releases Packages Wiki Activity Actions
brackt/public/robots.txt

12 lines
185 B
Text
Raw Normal View History

Add robots.txt and sitemap.xml.gz for SEO Adds a static robots.txt blocking admin/API/auth routes, a sitemap generation script (scripts/generate-sitemap.mjs) that writes both sitemap.xml and sitemap.xml.gz to public/, and hooks it into the build so the sitemap is always fresh on deploy. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-24 22:05:37 -07:00
User-agent: *
Allow: /
Disallow: /admin/
Disallow: /api/
Fix robots.txt and sitemap issues from code review - Point Sitemap directive at /sitemap.xml (not .gz) so crawlers receive plain XML without needing Content-Encoding headers - Add Disallow: /leagues/ to block all auth-gated league routes - Gitignore public/sitemap.xml* so they are always generated fresh at build time rather than serving a stale committed snapshot Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-24 22:16:49 -07:00
Disallow: /leagues/
Add robots.txt and sitemap.xml.gz for SEO Adds a static robots.txt blocking admin/API/auth routes, a sitemap generation script (scripts/generate-sitemap.mjs) that writes both sitemap.xml and sitemap.xml.gz to public/, and hooks it into the build so the sitemap is always fresh on deploy. Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-24 22:05:37 -07:00
Disallow: /onboarding
Disallow: /settings
Disallow: /user-profile
Fix robots.txt and sitemap issues from code review - Point Sitemap directive at /sitemap.xml (not .gz) so crawlers receive plain XML without needing Content-Encoding headers - Add Disallow: /leagues/ to block all auth-gated league routes - Gitignore public/sitemap.xml* so they are always generated fresh at build time rather than serving a stale committed snapshot Co-Authored-By: Claude Sonnet 4.6 <noreply@anthropic.com>
2026-05-24 22:16:49 -07:00
Sitemap: https://brackt.com/sitemap.xml
Reference in a new issue Copy permalink