web search done right
Commits on main
rename SignalAggregator -> SignalComputer more descriptive name. it's used to compute the signals, not necesarrily aggregate them. still not entirely satisfied with the naming, but it's at least better than aggregator
c4a1c53 Mikkel Denker committed 2 years ago
Distributed in-memory key/value store for mapreduce (#181)
37b6c7d Mikkel Denker committed 2 years ago
don't treat 'site.com' etc. as a sentence boundary even though it contains a '.'
a46a24c Mikkel Denker committed 2 years ago
Created ResultLink to handle the opening of result links in new tabs (#178)
7bca42f Wesley Appler committed 2 years ago
make explore work without javascript and add browser features section to privacy statement
c8447c9 Mikkel Denker committed 2 years ago
use more sophisticated encoding detection when utf8 decoding fails. (#172)
f8c58b3 Mikkel Denker committed 2 years ago
refactor crawl planner * make sure crawl plan has frontpage of all crawled sites * order crawl plan to first crawl sites with high harmonic centrality
c7e596a Mikkel Denker committed 2 years ago
refactor snippet into a normal snippet and a rich snippet. a normal snippet should always be returned from the api. an application can then choose to show the rich snippet instead if one is present. this gives more flexibility when building applications on top of stracts api
26eb164 Mikkel Denker committed 2 years ago
change crossencoder scores to be calculated from their ranks. the raw scores from the cross encoder model can be very similar even though site A is way better than site B, so it will be difficult to scale correctly with a coefficient. the models are essentially only trained to optimize the ranks.
11ad03b Mikkel Denker committed 2 years ago
build wasm during 'just setup' and make sure pkg has a package.json file. see https://github.com/rustwasm/wasm-pack/issues/965
7d870b2 Mikkel Denker committed 2 years ago
Parse site block rules into 'HostRankings' instead. (#170)
7583aa4 Mikkel Denker committed 2 years ago