Skip to content

armgit / mwmbl

Public Imported from GitHub
0

An open source, non-profit web search engine

Commits on main

CONFIRMED no longer exists
Daoud Clarke committed 4 years ago
d47457b
Fix log message
Daoud Clarke committed 4 years ago
b6f2954
Wrap background tasks in try/except
Daoud Clarke committed 4 years ago
e9835ed
Allow batches to fail silently
Daoud Clarke committed 4 years ago
6ea3a95
Queue the right type of batch
Daoud Clarke committed 4 years ago
ddc8664
Queue new batches for indexing
Daoud Clarke committed 4 years ago
2b52b50
Correctly insert new URLs
Daoud Clarke committed 4 years ago
b8c495b
Prevent deadlock when inserting URLs
Daoud Clarke committed 4 years ago
955d650
Cache batches; start a background process
Daoud Clarke committed 4 years ago
1457cba
Use different scores for same domain links
Daoud Clarke committed 4 years ago
ff2312a
Investigate duplication of URLs in batches
Daoud Clarke committed 4 years ago
e27d749
Add a script to count urls in the index
Daoud Clarke committed 4 years ago
eb571fc
Make more robust
Daoud Clarke committed 4 years ago
1d9b5cb
Update queued pages in the index
Daoud Clarke committed 4 years ago
30e1e19
4330551
Factor out connection code
Daoud Clarke committed 4 years ago
b8b605d
CORS is handled by nginx
Daoud Clarke committed 4 years ago
c31cea7
Don't add CORS on the python side
Daoud Clarke committed 4 years ago
96da534
Use updated CORS settings
Daoud Clarke committed 4 years ago
9dbb724
Remove seemingly extraneous backslashes
Daoud Clarke committed 4 years ago
e3baf87
Use an updated template
Daoud Clarke committed 4 years ago
c245be7
Remove problematic SSL_DIRECTIVES line
Daoud Clarke committed 4 years ago
0177251
Enable CORS in nginx
Daoud Clarke committed 4 years ago
a67ca7b
Use the dokku app storage
Daoud Clarke committed 4 years ago
866c17f
Start processing historical data on startup
Daoud Clarke committed 4 years ago
16c2692
Add script to process historical data
Daoud Clarke committed 4 years ago
d400950
Expose the port
Daoud Clarke committed 4 years ago
eb1c599