An open source, non-profit web search engine
Commits on main
Publish seed domains in daily batches, to crawl-scoped keys only
f14e107 Claude committed 1 month ago
Address review: dedupe Staan counts, free the user after the status, tolerate old records
bfc0ae8 Claude committed 1 month ago
Keep web users logged in indefinitely via rotating refresh tokens
24a1427 Claude committed 1 month ago
Merge pull request #495 from mwmbl/claude/seed-crawl-outcome
29483d4 Daoud Clarke committed 1 month ago
Merge pull request #488 from mwmbl/claude/blissful-cannon-nmb55t
6f9ba5f Daoud Clarke committed 1 month ago
Merge pull request #494 from mwmbl/claude/confident-johnson-s10j2d
ff482e2 Daoud Clarke committed 1 month ago
Merge pull request #490 from blueheron786/blueheron786/stats_fixes
efa9762 Daoud Clarke committed 1 month ago
Merge pull request #492 from mwmbl/claude/web-session-xgboost-hook
b48a335 Daoud Clarke committed 1 month ago
Merge pull request #491 from mwmbl/claude/affectionate-brown-eglxd5
d892658 Daoud Clarke committed 1 month ago
Make the weekly index count survive errors, races and lost state
2703d88 Claude committed 1 month ago
Count seed crawl pages from the index write, and skip error pages
4f38819 Claude committed 1 month ago
Cap seed crawls per domain and run them in a worker of their own
3371bc0 Claude committed 1 month ago