Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
TypeScript aiai-agentsai-crawlerai-scrapingai-searchcrawlerdata-extractionhtml-to-markdownllmmarkdownscraperscrapingweb-crawlerweb-dataweb-data-extractionweb-scraperweb-scrapingweb-searchwebscraping
Commits on main
Preserve original URL case when storing search results
f84a2b0 Developers Digest committed 4 months ago
Merge pull request #3886 from firecrawl/jonathan/fix-transient-resolution
d5f9ef4 Developers Digest committed 4 months ago
Key monitor page webhook claim by kind so error can't suppress success
55cea14 Developers Digest committed 4 months ago
Use '-' not ':' in the bill job id (avoid BullMQ key separator)
759b8d1 Developers Digest committed 4 months ago
Close finalize/reconciler races and drop dead inline scrape/crawl path
d8f775b Developers Digest committed 4 months ago
Update queue test for per-consumer prefetch argument
0736581 Developers Digest committed 4 months ago
Wire search finalize to bulkUpsertMonitorPages + deterministic bill id
54fc5b0 Developers Digest committed 4 months ago
Retry search results that were skipped by a transient scrape failure
6dbbe9c Developers Digest committed 4 months ago
Spread monitor jitter wider and parallelize the search consumer
3045be8 Developers Digest committed 4 months ago
Use onConflictDoUpdate for bulk monitor-page upsert
e45a47d Developers Digest committed 4 months ago
Abort orphaned finalize writes on timeout to prevent dedup corruption
e501688 Developers Digest committed 4 months ago
[codex] Stabilize self-hosted map redirect snip (#3883)
0940201 Gergő Móricz committed 4 months ago
Merge pull request #3875 from firecrawl/jonathan/search-monitor-hardening
f68c5a2 Developers Digest committed 4 months ago
fix(js-sdk): add webhook option to startExtract and extract methods (#3318)
0aafb28 Jaydeep pipaliya committed 4 months ago
chore(api): remove x402 micropayment integration (#3873)
82b54a2 firecrawl-spring[bot] committed 4 months ago
fix(python-sdk): handle async v1 batch scrape response dict
2f96891 Yufeng He committed 4 months ago