Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
TypeScript aiai-agentsai-crawlerai-scrapingai-searchcrawlerdata-extractionhtml-to-markdownllmmarkdownscraperscrapingweb-crawlerweb-dataweb-data-extractionweb-scraperweb-scrapingweb-searchwebscraping
Commits on main
feat(alexandria): open discovery search and retrieve rollout gates (#4630)
b3cc08d Developers Digest committed 2 months ago
feat(api): provider discovery through Search and billed execution through Scrape (#4621)
cc06662 Developers Digest committed 2 months ago
feat(api): default v1 proxy to auto when no country is specified (#4622)
bbadeb8 Gergő Móricz committed 2 months ago
fix(search): forward domain filters to fire engine (#4617)
a1d434b Gergő Móricz committed 2 months ago
fix(api): skip HTML transformations for sitemap XML (#4615)
30a9697 tomsideguide committed 2 months ago
fix(api): raise includePaths/excludePaths cap from 100 to 1000 patterns (#4611)
da16e79 Gaurav Chadha committed 2 months ago
warn that the research search category moves to the Research Index on 2026-11-16 (#4550)
96426f2 Kris Oei committed 2 months ago
fix(api): re-check blocklist on post-redirect URL for all scrape job types (#4581)
58d0c8e Gergő Móricz committed 2 months ago
feat(api): floor agent interop traffic at the hobby rate-limit multiplier (#4583)
7812a4a Rakshith Ramprakash committed 2 months ago
feat(api): replace Sentry with optional OpenTelemetry OTLP export (#4555)
bca5645 Gergő Móricz committed 2 months ago
fix(rust-sdk): accept negative creditsUsed in crawl and batch scrape status (#4578)
e847d99 Gaurav Rawat committed 2 months ago
chore(sdks): bump versions for the search country option (#4575)
f544d06 claude[bot] committed 2 months ago
fix(api): answer unmatched and wrong-method paths with JSON (#4552)
f31884a Himadri Mishra committed 2 months ago
fix(api/autumn): expire team→org cache and key provisioning by org (#4561)
7a1e57c Rakshith Ramprakash committed 2 months ago
Block bounty publication for restricted domains (#4570)
cd0a254 Developers Digest committed 2 months ago
Expose Exchange bounty publishing and submission routes (#4568)
8c7ee97 Developers Digest committed 2 months ago
fix(api): FirePDF async inline jobs get a deadline margin, aligned polling, and one submit retry (#4566)
2343d7b Abimael Martell committed 2 months ago
fix(api): drain pending log publications on shutdown (#4558)
1db782f rahul-firecrawl committed 2 months ago
fix(api): check Redis pipeline results instead of swallowing command errors (#4557)
e4ac89b Gergő Móricz committed 2 months ago
feat(api): add BetterStack heartbeat to cclog worker (#4556)
69d4f78 Gergő Móricz committed 2 months ago
fix(api/redis): improve error handling on evictable redis (#4554)
fba5b0c Gergő Móricz committed 2 months ago
refactor(billing): parse firebill responses with Zod schemas (#4551)
1cfe7d9 Rakshith Ramprakash committed 2 months ago