web search done right
Commits on main
forgot that we might still have duplicate edges across different segments
b13f0b0 Mikkel Denker committed 3 years ago
Refactor entity code and add start of Wiki template rendering (#75)
dfa4171 Oliver Bøving committed 3 years ago
Re-write webgraph storage backend. The webgraph storage is now essentially a '(from, to) -> label' map stored in rocksdb databases. This heavily simplifies inserts and merges, since we can now insert new edges directly into the db without having to read the existing edges.
8fd2b2a Mikkel Denker committed 3 years ago
Don't animate search results when the query changes (#98)
7ad41ae Oliver Bøving committed 3 years ago
bump webgraph rocksdb to use never version for format (enabling all the nice improvements)
778db90 Mikkel Denker committed 3 years ago
Decrease webgraph memory consumption when building. I think the write too many (and too big) write buffers got allocated, which caused OOM.
f450746 Mikkel Denker committed 3 years ago
Fix iOS searchbar bluring and HTML escape suggestions (#95)
16e10e4 Oliver Bøving committed 3 years ago
related entities in sidebar had the title of the original entity
7bae5aa Mikkel Denker committed 3 years ago
remove webpage body from api and use snippets in alice and qa model to generate answers
61b7a3d Mikkel Denker committed 3 years ago
Move snippet highlighting into svelte. This also removes the need to trust that the api has correctly sanitized the snippet from svelte.
c02924d Mikkel Denker committed 3 years ago
if a crawl job had no discovered urls, the domain might not have any valid range of of urls which would cause the coordinator to crash
b0f2ca7 Mikkel Denker committed 3 years ago