Skip to content

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

Commits on main

Nick: extract fixes
Nicolas committed 1 year ago
b9f621b
Nick: fixed extract issues
Nicolas committed 1 year ago
79e3356
Update extract.ts
Nicolas committed 1 year ago
6d77879
Update map.ts
Nicolas committed 1 year ago
0f8b8a7
revert to pdf parse
Eric Ciarla committed 1 year ago
a20a003
Remove pdf parse
Eric Ciarla committed 1 year ago
194353a
Replace pdf parse with pdf to md
Eric Ciarla committed 1 year ago
1402831
Update index.ts
Eric Ciarla committed 1 year ago
ed7d15d
fix(scrapeURL): increase timeToRun
Gergő Móricz committed 1 year ago
654d6c6
fix(scrapeURL/fire-engine): timeout calculation issues
Gergő Móricz committed 1 year ago
47b968f
Revert "fix(scrapeURL): better timeToRun distribution"
Gergő Móricz committed 1 year ago
7f57c86
fix(scrapeURL): better timeToRun distribution
Gergő Móricz committed 1 year ago
284a6cc
feat(v1/scrape): add more context to timeout logs
Gergő Móricz committed 1 year ago
0013bdf
fix(runWebScraper): proper error handling
Gergő Móricz committed 1 year ago
139e2c9
Update requests.http
Rafael Miller committed 1 year ago
2c233bd
added type to reqs example
rafaelmmiller committed 1 year ago
d8150c6
merged with main
rafaelmmiller committed 1 year ago
b6802bc
added unit tests
rafaelmmiller committed 1 year ago
eab30c4
fix(queue-jobs): fix concurrency limit
Gergő Móricz committed 1 year ago
2de659d
fix(rate-limiter): raise crawlStatus limits
Gergő Móricz committed 1 year ago
72d6a81
e97ee4a
feat(queue-worker): fix redirect slipping
Gergő Móricz committed 1 year ago
30fa78c
Update issue_credits.ts
Nicolas committed 1 year ago
126b46e
Nick: fix actions errors
Nicolas committed 1 year ago
1214d21