An open source, non-profit web search engine
Commits on main
Super Search: skip malformed recipes instead of crashing at import
72ab379 Daoud Clarke committed 5 months ago
Merge pull request #344 from mwmbl/apply-mmr-to-super-search
cf507a0 Daoud Clarke committed 5 months ago
Merge pull request #343 from mwmbl/fix-missing-indexed-pages-kitsas
efbe19e Daoud Clarke committed 5 months ago
Extract MMR diversity re-ranking into a standalone MMRRanker
f222d72 Daoud Clarke committed 5 months ago
Bound MMR re-ranking cost: precompute norms and cap to a top window
459a236 Daoud Clarke committed 5 months ago
Replace per-domain result filter with MMR diversity re-ranking
87dc9b2 Daoud Clarke committed 5 months ago
Crawler: fall back to meta description / first paragraph for extract
d1c26ea Daoud Clarke committed 5 months ago
Merge pull request #340 from mwmbl/super-search-results-not-stored
953fb53 Daoud Clarke committed 5 months ago
Merge pull request #337 from mwmbl/fix-robots-txt-spamming
53ae9c9 Daoud Clarke committed 5 months ago
Fix crawler re-crawling every URL via bloom filter dedup bug
6a6e286 Daoud Clarke committed 5 months ago
Make redis parameter required in crawl_url and robots_allowed
c2f399a Daoud Clarke committed 5 months ago
Simplify: make redis parameter optional with None default
306b09a Daoud Clarke committed 5 months ago
Fix polar-sdk import: rename SubscriptionUpdateProduct to CustomerSubscriptionUpdateProduct
5fb9543 Daoud Clarke committed 5 months ago
Merge pull request #335 from mwmbl/fix-robots-not-respecting-jak2k
10ad9d0 Daoud Clarke committed 5 months ago