web search done right
bump crawler version
Mikkel Denkerf6995402a18e
diff --git a/frontend/src/routes/webmasters/README.md b/frontend/src/routes/webmasters/README.mdindex b1c4ac37..664e87e9 100644--- a/frontend/src/routes/webmasters/README.md+++ b/frontend/src/routes/webmasters/README.md@@ -2,7 +2,7 @@Stract is an [open source](https://github.com/StractOrg/stract/) web search engine. StractBot is the name of our crawler that collects pages from the web in order to build the index.It is written in Rust and the source code can be found [here](https://github.com/StractOrg/stract/tree/main/crates/core/src/crawler).-The crawler uses the user agent `Mozilla/5.0 (compatible; StractBot/0.1; open source search engine; +https://stract.com/webmasters)`.+The crawler uses the user agent `Mozilla/5.0 (compatible; StractBot/0.2; open source search engine; +https://stract.com/webmasters)`.## Politeness