Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
TypeScript aiai-agentsai-crawlerai-scrapingai-searchcrawlerdata-extractionhtml-to-markdownllmmarkdownscraperscrapingweb-crawlerweb-dataweb-data-extractionweb-scraperweb-scrapingweb-searchwebscraping
Commits on main
fix(branding): fall back to heuristic logo pick when the LLM call fails (#4142)
ec14138 Abimael Martell committed 3 months ago
fix(readme): update 'join our community' link to point to Discord (#4067)
d567f83 Shakti committed 3 months ago
Restore rate-limit logging for authenticated 429s (#4140)
7fc7c68 claude[bot] committed 3 months ago
fix(api): fail open to high limits when Autumn errors (#4133)
ab033af firecrawl-spring[bot] committed 3 months ago
chore(api): drop ACUC plan_priority references (#4132)
0d052cb firecrawl-spring[bot] committed 3 months ago
chore(api): drop ACUC concurrency and rate_limits references (#4131)
3fded32 firecrawl-spring[bot] committed 3 months ago
refactor(limits): remove the Autumn-limits ramp experiment (#4111)
f578c51 firecrawl-spring[bot] committed 3 months ago
fix(api): keep branding-only scrapes off the render engine (#4118)
30ca535 Abimael Martell committed 3 months ago
fix(slack): use combined Redis+FDB active count for concurrency display (#4119)
a8cc2d7 firecrawl-spring[bot] committed 3 months ago
fix(docker-compose): honor REDIS_RATE_LIMIT_URL instead of ignoring it (#4105)
b6014a3 Shwetas Dhake committed 3 months ago
feat(slack): source concurrency display from Autumn (#4116)
f215cfb firecrawl-spring[bot] committed 3 months ago
perf(branding): cut redundant DOM walks in the in-page script (#4101)
fb93907 Abimael Martell committed 3 months ago
feat(concurrency): source nuq-router FDB gate concurrency from Autumn (#4114)
1b3a92a firecrawl-spring[bot] committed 3 months ago
feat(concurrency): source FirePDF teamConcurrency payload from Autumn (#4115)
6868e1b firecrawl-spring[bot] committed 3 months ago
feat(api): set Autumn track overageBehavior to overflow (#4108)
61b8ee8 firecrawl-spring[bot] committed 4 months ago
feat(api): relay structured user-facing errors from the media service (#4103)
8627119 Abimael Martell committed 4 months ago
feat(limits): source rate limits/concurrency/priority from Autumn behind a ramp flag (#3599)
76ce8c8 firecrawl-spring[bot] committed 4 months ago
fix(api/search): honor includeDomains by dropping site: parens (#4100)
aa85f19 firecrawl-spring[bot] committed 4 months ago
fix(test-site): patch sharp security advisory (#4097)
2e849c5 Abimael Martell committed 4 months ago
fix(security): patch newly disclosed pnpm advisories (#4095)
ea52d97 Abimael Martell committed 4 months ago
Merge pull request #4091 from firecrawl/fix/api-surface-first-used-company-group
ece4309 Rakshith Ramprakash committed 4 months ago
feat(api): thread org context through the scrape pipeline (#4064)
93387da Rafael Miller committed 4 months ago
fix(python-sdk): map min_age to minAge in scrape options (#4002)
9293920 Saivedant Hava committed 4 months ago