Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
TypeScript aiai-agentsai-crawlerai-scrapingai-searchcrawlerdata-extractionhtml-to-markdownllmmarkdownscraperscrapingweb-crawlerweb-dataweb-data-extractionweb-scraperweb-scrapingweb-searchwebscraping
Commits on main
Merge branch 'nsc/v2' of https://github.com/mendableai/firecrawl into nsc/v2
70af6aa Nicolas committed 1 year ago
feat(api): separate redis connections for scrape Queue, QueueEvents, and Worker
9f0df42 Gergő Móricz committed 1 year ago
Improve error handling in Python SDK for non-JSON responses (#1827)
4c02340 Rafael Miller committed 1 year ago
feat(python-sdk): implement missing crawl_entire_domain parameter (#1896)
269c709 devin-ai-integration[bot] committed 1 year ago
fix: convert timeout from milliseconds to seconds in Python SDK (#1894)
21103b5 devin-ai-integration[bot] committed 1 year ago
fix(crawl-redis): attempt to cleanup crawl memory post finish (#1901)
27badf3 Gergő Móricz committed 1 year ago