Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
TypeScript aiai-agentsai-crawlerai-scrapingai-searchcrawlerdata-extractionhtml-to-markdownllmmarkdownscraperscrapingweb-crawlerweb-dataweb-data-extractionweb-scraperweb-scrapingweb-searchwebscraping
Commits on main
Proxy /exchange/applications, without the consumption flag
ec92fef Developers Digest committed 2 months ago
Let the partner's gate decide whether a monitor run happens (#4428)
a75e0e8 Rakshith Ramprakash committed 2 months ago
fix(pdf): by-reference deadline covers queue wait and scanned OCR rates (#4435)
0be87db Abimael Martell committed 2 months ago
perf(api): shift lag-tolerant reads from primary to read replica
49aa749 mogery committed 2 months ago
fix(api): bound native PDF extraction concurrency with a semaphore
92e16a2 mogery committed 2 months ago
Merge pull request #4431 from firecrawl/exchange/analytics-proxy
f40a10b Developers Digest committed 2 months ago
perf(api): overlap requests-row insert with v2 search work, expose DB pool gauges
c90a794 mogery committed 2 months ago
fix(api): run native PDF extraction off the Node.js event loop
e33e1f6 mogery committed 2 months ago
fix(api): don't drop the first sitemap URL in /map (#4337) (#4338)
215fa7c nosssuri committed 2 months ago
Keep a gateway partner's job token on the monitor it created (#4427)
5c1ea5a Rakshith Ramprakash committed 2 months ago
feat(api): prefer vertex for freeform query model, fall back to gemini api
3527376 mogery committed 2 months ago
feat(api): prefer vertex for interact prompt agent, fall back to gemini api
88102dc mogery committed 2 months ago
feat(sdk): auto-resume large-document scrapes (JS + Python) (#4420)
ab33903 Abimael Martell committed 2 months ago
fix(pdf): enforce the per-team cap inside both by-reference placement functions (#4418)
47260e6 Abimael Martell committed 2 months ago
feat(pdf): prefer fire-pdf's live remaining estimates in timeout messaging (#4417)
73aa40b Abimael Martell committed 2 months ago
feat(sdks): add agent effort param and trace/snapshot endpoints (#4415)
7b65903 Gergő Móricz committed 2 months ago
feat(pdf): by-reference deadline decoupling + content-level job adoption (#4413)
3a1a7e1 Abimael Martell committed 2 months ago
feat(api): default /v2/agent to spark-2, retire spark-1 presets (#4414)
b231f51 Gergő Móricz committed 2 months ago
fix(rust-sdk): tag agent/crawl/batch/map/parse requests with SDK origin
b823457 mogery committed 2 months ago
fix(api): drop unused export on FirebillCheckResult to unblock knip
840ea49 mogery committed 2 months ago
Ask firebill whether a gateway org can afford it, not just the ghost (#4404)
51202ab Rakshith Ramprakash committed 2 months ago
Route gateway-funded orgs through firebill regardless of the ramp (#4403)
0b85d9d Rakshith Ramprakash committed 2 months ago
feat(api): add opt-in prompt-injection check to JSON-mode extraction (#4392)
ac154d2 Rafael Miller committed 2 months ago
feat(pdf): accept fire-engine's large-PDF GCS handoff (#4411)
a7e2c55 Abimael Martell committed 2 months ago
feat(pdf): submit large PDFs to FirePDF by GCS reference (#4409)
d26ad4b Abimael Martell committed 2 months ago