Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
TypeScript aiai-agentsai-crawlerai-scrapingai-searchcrawlerdata-extractionhtml-to-markdownllmmarkdownscraperscrapingweb-crawlerweb-dataweb-data-extractionweb-scraperweb-scrapingweb-searchwebscraping
Commits on main
feat(api): OCR raster images as one-page documents through FirePDF (#4489)
0b87d1e Abimael Martell committed 2 months ago
fix(v2/agent): stop capping pinned exchange toolkits at five (#4496)
973420e Nicolas committed 2 months ago
fix(api): keep Postgres pools warm per deployment profile to stop pooler login storms (#4495)
c9f94b3 Gergő Móricz committed 2 months ago
feat(api): cut change tracking over to Bigtable; keep Postgres as read-only fallback (#4488)
a82d24d Gergő Móricz committed 2 months ago
fix(billing): keep the lockdown surcharge on json scrapes (#4486)
ef39d97 claude[bot] committed 2 months ago
feat(api): route change tracking through the store with optional Bigtable double-write (#4484)
c88d094 Gergő Móricz committed 2 months ago
fix(security): pin postcss-selector-parser >=6.1.3 in ingestion-ui (GHSA-w9m9-85wc-3x92) (#4483)
c0ed10d claude[bot] committed 2 months ago
feat(api): always route pdf/document downloads through fire-engine when available (#4480)
feb0428 Gergő Móricz committed 2 months ago
fix(security): resolve pnpm audit failures from 2026-09-01 audit (#4478)
d5df1a2 cursor[bot] committed 2 months ago
fix(api/pdf): fall back to chrome-cdp prefetch when the pdf engine's direct download fails at the proxy (#4477)
1f193af Gergő Móricz committed 2 months ago
fix(api/agent/list): fix bad clickhouse date parsing (#4471)
6180eb4 Gergő Móricz committed 2 months ago
chore(sdks): bump versions for the agent list endpoint (#4470)
7c688df Gergő Móricz committed 2 months ago
feat(api/agent): add list endpoint that scales properly (#4467)
cc82cc9 Gergő Móricz committed 2 months ago
fix(api/v2/search): lack of logging if awaiting logRequestPromise took time (#4465)
5829858 Gergő Móricz committed 2 months ago
feat(api): introduce new clearer error for concurrency queue timeouts
86d94e4 mogery committed 2 months ago
Merge pull request #4446 from firecrawl/exchange/applications-proxy
2790b23 Developers Digest committed 2 months ago
fix(api/cclog): work around dragonfly limitation of 2^16 command arguments
48b11f3 mogery committed 2 months ago
Merge pull request #4445 from firecrawl/exchange/applications-proxy
28873a2 Developers Digest committed 2 months ago
Merge pull request #4442 from firecrawl/exchange/applications-proxy
5238d49 Developers Digest committed 2 months ago
Raise the privileged large-PDF cap to the 256MB architectural ceiling (#4437)
83df13a Abimael Martell committed 2 months ago