Open source, privacy-first web analytics. Lightweight, cookie-free Google Analytics alternative. Self-hosted or cloud.
TypeScript analyticsanalytics-dashboardclickhouseelixirgoogle-analyticsmarketingopen-source-analyticsphoenixplausible-analyticspostgresqlprivacyprivacy-friendlyself-hostedsimple-analyticsstatisticstailwindcssweb-analyticswebsite-analyticswebsite-statswebsite-tracking
make robots.txt restrictive by default (#3905)
ruslandoga64f35bf8f618
diff --git a/CHANGELOG.md b/CHANGELOG.mdindex 5e0c99d44a..43f8178733 100644--- a/CHANGELOG.md+++ b/CHANGELOG.md@@ -32,6 +32,7 @@ All notable changes to this project will be documented in this file.- Add `CLICKHOUSE_MAX_BUFFER_SIZE_BYTES` env var which defaults to `100000` (100KB)- Add alternative SMTP adapter plausible/analytics#3654- Add `EXTRA_CONFIG_PATH` env var to specify extra Elixir config plausible/analytics#3906+- Add restrictive `robots.txt` for self-hosted plausible/analytics#3905### Removed- Removed the nested custom event property breakdown UI when filtering by a goal in Goal Conversionsdiff --git a/lib/plausible_web/endpoint.ex b/lib/plausible_web/endpoint.exindex 5b6c6f9306..0cc4c91b98 100644--- a/lib/plausible_web/endpoint.ex+++ b/lib/plausible_web/endpoint.ex@@ -33,11 +33,21 @@ defmodule PlausibleWeb.Endpoint doplug(PlausibleWeb.Tracker)plug(PlausibleWeb.Favicon)+ static_paths = ~w(css js images favicon.ico)++ static_paths =+ on_full_build do+ # NOTE: The Cloud uses custom robots.txt from https://github.com/plausible/website: https://plausible.io/robots.txt+ static_paths+ else+ static_paths ++ ["robots.txt"]+ end+plug(Plug.Static,at: "/",from: :plausible,gzip: false,- only: ~w(css js images favicon.ico robots.txt)+ only: static_paths)on_full_build dodiff --git a/priv/static/robots.txt b/priv/static/robots.txtindex 3c9c7c01f3..1f53798bb4 100644--- a/priv/static/robots.txt+++ b/priv/static/robots.txt@@ -1,5 +1,2 @@-# See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file-#-# To ban all spiders from the entire site uncomment the next two lines:-# User-agent: *-# Disallow: /+User-agent: *+Disallow: /