Skip to content

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

Commits on main

draft: search with x402
Ademílson Tonato committed 1 year ago
a96ddf9
Add another blocked URL exception
Micah Stairs committed 1 year ago
e8531b9
Add a couple exceptions to our blocked list (#1816)
Micah Stairs committed 1 year ago
e8d4e51
21a5c8a
Nick: no sections edge case (#1814)
Nicolas committed 1 year ago
51a7ad4
Fix search endpoint PDF billing when parsePDF=false (#1806)
devin-ai-integration[bot] committed 1 year ago
10796b0
Update llmExtract.ts
Nicolas committed 1 year ago
4d596c4
Update generic-ai.ts
Nicolas committed 1 year ago
ba04a68
fix(crawler): handle negative limit
Gergő Móricz committed 1 year ago
7336e84
fix(crawler): handle infinite limit
Gergő Móricz committed 1 year ago
7695a8c
feat(crawler): show serde error
Gergő Móricz committed 1 year ago
8d41c99
feat(crawler): port filterLinks to Rust (#1801)
Gergő Móricz committed 1 year ago
a4f4145
timeouts for index engine
Gergő Móricz committed 1 year ago
24a5a71
feat(precrawl): increase budget as discussed
Gergő Móricz committed 1 year ago
ce4e00f
725cdf4
add precrawl queue to bullboard
Gergő Móricz committed 1 year ago
521965b
feat: precrawl worker (#1783)
Gergő Móricz committed 1 year ago
a57277e
hotfix2
Gergő Móricz committed 1 year ago
3a98d09
hotfix
Gergő Móricz committed 1 year ago
4560e14
Add temporary exemption for crawl expiry (#1796)
Micah Stairs committed 1 year ago
cd3c3b7
ad967d4
insert omce jobs upon scrape (#1786)
Gergő Móricz committed 1 year ago
9a6c490
fix(extract): improve enforcement (#1790)
Gergő Móricz committed 1 year ago
e3c45cd
feat: make URL protocol checks case-insensitive (#1788)
devin-ai-integration[bot] committed 1 year ago
ff9544c
fix(scrapeURL/index): exclude waitfor (#1787)
Gergő Móricz committed 1 year ago
5f722a9
fix request frequency insert
Gergő Móricz committed 1 year ago
37968b3