web search done right
Commits on main
[ampc] ability to send requests without timeouts (should be used sparringly)
bd9f1cb Mikkel Denker committed 1 year ago
optimise shortest path to use exact changed nodes (stored in hashset) if there are very few updated nodes
774dbd8 Mikkel Denker committed 1 year ago
combine sketches across workers for more precise bloom filters
037ec2c Mikkel Denker committed 1 year ago
bellman-ford inspired shortest path for distributed graph. works better than approach in approx centrality when graph is sharded. still need to implement some low-hanging fruits for optimisation
49abc74 Mikkel Denker committed 1 year ago
Improve zimba+web-spell docs and release the modules under MIT (#242)
01de7a1 Mikkel Denker committed 1 year ago
urlencode user queries when forwarding to bang location to prevent open redirect vulnerabilities (#239)
05d3cf9 Mikkel Denker committed 1 year ago
Check if either the request or response ip is an internal ip. Fail the request if this is the case (#238)
3945651 Mikkel Denker committed 1 year ago
[webgraph] sort edges by centrality rank instead of raw centrality
3b2a5f7 Mikkel Denker committed 1 year ago
no need to collect all page nodes when calculating centrality. there will be a few duplicates when iterating but that's okay as their hyperloglogs will stay the same
3e683b0 Mikkel Denker committed 1 year ago
[webgraph] control whether or not to skip self links in more queries
9d507de Mikkel Denker committed 1 year ago