Skip to content

📈 Open source, privacy-first web analytics — a cookie-less Google Analytics alternative with built-in error tracking and performance monitoring. Self-host it or use our cloud. Get started for free!

updated robots.txt

Blue Moused2f9b2482754
diff --git a/app/routes/[robots.txt].tsx b/app/routes/[robots.txt].tsx
index 5f099ebd7..b7ffe6d96 100644
--- a/app/routes/[robots.txt].tsx
+++ b/app/routes/[robots.txt].tsx
@@ -1,7 +1,14 @@
export const loader = () => {
- const robotText = `User-agent: *
-Allow: /
-Sitemap: https://swetrix.com/sitemap.xml`
+ const robotText = `Sitemap: https://swetrix.com/sitemap.xml
+
+User-agent: *
+Disallow: /ref
+Disallow: /ref/*
+Disallow: /password-reset/*
+Disallow: /verify/*
+Disallow: /share/*
+Disallow: /change-email/*
+`
return new Response(robotText, {
status: 200,