An open source, non-profit web search engine
Merge branch 'main' into enh_crawler
Olicorne45dca7594ea4
diff --cc README.mdindex 288e980,b659eba..da79f1e--- a/README.md+++ b/README.md@@@ -48,11 -48,10 +48,11 @@@ CrawlinCrawling is distributed across the community, while indexing iscentralised on the main server.- If you have spare computer power and bandwidth, the best way you can help is+ If you have spare computer power and bandwidth, for now the best way you can help isby running our [command linecrawler](https://github.com/mwmbl/crawler-script) with as many threads-as you can spare. A new crawler is in the works in `docker-compose.yml`.+as you can spare.+Some documentation about the new crawler can be found in its [README.md](./mwmbl/crawler/README.md).If you have Firefox you can help out by [installing ourextension](https://addons.mozilla.org/en-GB/firefox/addon/mwmbl-web-crawler/). This