web search done right
Commits on main
robots.txt files might contain weird characters which causes parsing to crash
77b95d3 Mikkel Denker committed 3 years ago
for some reason, the needed array feature broke pragme settings in sqlite. Hopefully fixed now
5c670d6 Mikkel Denker committed 3 years ago
crawldb cache size to 64 kb (some guy on hackernews uses this as default)
f64b89b Mikkel Denker committed 3 years ago
there exists a shitton of double slash links on the internet
9604fb2 Mikkel Denker committed 3 years ago
more resilient crawler and better error reporting when fetch fails
83dd901 Mikkel Denker committed 3 years ago
Forgot to update the changelog from yesterdays privacy policy updates
4e10032 Mikkel Denker committed 3 years ago
getting alice cuda acceleration to actually work (hopefully)
dda4529 Mikkel Denker committed 3 years ago
we also need to set the libtorch environment variables to be able to run the tests. We can now run 'just cargo ...' which makes sure cargo has all the necesarry env variables set
b08bf68 Mikkel Denker committed 3 years ago
extracted part of 'just configure' command into a 'just setup'
c450036 Mikkel Denker committed 3 years ago
download libtorch from python script since we need to download from pytorch website if compiling for linux
1e95f94 Mikkel Denker committed 3 years ago
fix threshold in rawmodel test to make it more consistent
2f734a8 Mikkel Denker committed 3 years ago
option to perform simple quantization of some of the accelerated alice layers
479444d Mikkel Denker committed 3 years ago