Skip to content

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

Commits on main

Merge
Gergő Móricz committed 1 year ago
b7d7b8e
feat(api): add OTEL everywhere (#1969)
Gergő Móricz committed 1 year ago
06a0198
308e4f4
fix types
Gergő Móricz committed 1 year ago
4569029
fix(v1/scrape): default to basic proxy
Gergő Móricz committed 1 year ago
5df2f3c
scrape: auto proxy by default
Gergő Móricz committed 1 year ago
c3d8408
extract: ignore invalid by default
Gergő Móricz committed 1 year ago
c07b883
crawl: no more allowBackwardLinks
Gergő Móricz committed 1 year ago
fd26d17
stupid test case (cont.)
Gergő Móricz committed 1 year ago
dbbee4a
stupid test case
Gergő Móricz committed 1 year ago
7ebab2a
feat(scrapeURL): improve waterfalling MRT logic
Gergő Móricz committed 1 year ago
facba27
delete cache
rafaelmmiller committed 1 year ago
c4c2bbd
Update crawl.ts
Nicolas committed 1 year ago
306e697
a9c3e7a
fix(concurency-limit): bump timeout and log if removed
Gergő Móricz committed 1 year ago
2e2967c
Nick:
Nicolas committed 1 year ago
2a710e9
fix v2 bulljobs shit
Gergő Móricz committed 1 year ago
f672e54
fix usage stuff
Gergő Móricz committed 1 year ago
e251516
map changes
Gergő Móricz committed 1 year ago
79c822d
Merge branch 'main' into nsc/v2
Gergő Móricz committed 1 year ago
17008ac
fix(map): returning excessive query parameters
Gergő Móricz committed 1 year ago
6e59bbd
fix test
Gergő Móricz committed 1 year ago
4638e4a
fix in python sdk
Gergő Móricz committed 1 year ago
c1700e0
feat(v2/crawl): change sitemap param
Gergő Móricz committed 1 year ago
548f19a
fix(api/admin/metrics): store queues in a set
Gergő Móricz committed 1 year ago
a9141a4
fix(api): stop using bulljobs_teams table (#1962)
Gergő Móricz committed 1 year ago
5e64ecb