Skip to content

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

Commits on main

fix(api/crawl): do not prefill Crawl-Delay when crawling
Gergő Móricz committed 1 year ago
9ca532f
fix(api/batch/scrape): disallow 0 URLs post-filtering
Gergő Móricz committed 1 year ago
56b0ba7
fix(api/batch/scrape): require at least 1 URL
Gergő Móricz committed 1 year ago
31a4c74
test new mu alternative (#2263)
Thomas Kosmas committed 1 year ago
a5d7c57
Merge pull request #2248 from firecrawl/feat/map-few-results
Ademílson Tonato committed 1 year ago
beee469
feat(crawl): track running crawls in Redis
Gergő Móricz committed 1 year ago
e50a270
Fix YouTube cache markdown bug (#2261)
devin-ai-integration[bot] committed 1 year ago
d6ce193
Update apps/api/src/controllers/v2/crawl-status.ts
Ademílson Tonato committed 1 year ago
3d8e21e
5c4515c
fix: use PSL
amplitudes committed 1 year ago
3c2e1d2
feat(scrapeURL/index): add debug logging to document 404s
Gergő Móricz committed 1 year ago
454a071
c1352c0
Update README.md
Nicolas committed 1 year ago
a21430e
Update README.md
Eric Ciarla committed 1 year ago
c1de0cf
Merge branch 'main' into feat/map-few-results
Ademílson Tonato committed 1 year ago
92d34d3
chore(api): update @coinbase/x402 to version 0.6.6
Ademílson Tonato committed 1 year ago
0fe322a
10e07cb
Revert "debug logging"
Gergő Móricz committed 1 year ago
ef33226
fix(ci/audit):
Gergő Móricz committed 1 year ago
99cff99
fix crawl status
Gergő Móricz committed 1 year ago
0078a8f
debug logging
Gergő Móricz committed 1 year ago
1ccce6f
feat(nuq): fix per-message TTL on prefetch
Gergő Móricz committed 1 year ago
32e8085
feat(nuq): work properly with quorum queues
Gergő Móricz committed 1 year ago
371ee85