web search done right
Commits on main
optic descriptions and ability to choose optic from frontpage
5ba1236 Mikkel Denker committed 3 years ago
allow bloked sites from site rankings to use FastSiteDomainPatternScorer for faster queries
e969204 Mikkel Denker committed 3 years ago
fixed a bunch of problems with pattern_query implementation and wrote some tests to make sure it works correctly
5ab900e Mikkel Denker committed 3 years ago
Fixed alignment issue for rkyv. Subslice of a memory mapped file might have alignmet 1 but should have atleast 8 to work well with rkyv
2258da4 Mikkel Denker committed 3 years ago
use rwkv for ltr data and some performance optimizations for personal centrality + inbound similarity
605c1fc Mikkel Denker committed 3 years ago
tests to ensure proximity values are calculated correctly
7a19797 Mikkel Denker committed 3 years ago
Fixed bug that caused some optics to match websites they shouldn't
dcf238f Mikkel Denker committed 3 years ago
Updated tantivy to a release. Currently investigating why some docs show up in searches when they shouldn't
2ad3f93 Mikkel Denker committed 3 years ago
Fixed bug where monogram term was not defined. This can happen if a monogram is not part of top_n but the same term in a bigram was
693800f Mikkel Denker committed 3 years ago
take bigrams and trigrams into account during spell correction and as separate bm25 fields
4b7b304 Mikkel Denker committed 3 years ago
webgraph didn't properly merge segments. The new segment paths didn't line up with where the segment should actually be stored. This should now be fixed
ea231fc Mikkel Denker committed 3 years ago
use futures executor for single job instead of tokio since we got an error when trying to build the webgraph. It looked like rayon tried to spawn multiple tokio runtimes on the same thread due to the threadpool
3a5b573 Mikkel Denker committed 3 years ago
hopefully improve webgraph merges by merging in parallel
b003d21 Mikkel Denker committed 3 years ago