Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
TypeScript aiai-agentsai-crawlerai-scrapingai-searchcrawlerdata-extractionhtml-to-markdownllmmarkdownscraperscrapingweb-crawlerweb-dataweb-data-extractionweb-scraperweb-scrapingweb-searchwebscraping
Commits on main
fix(api/crawl): do not prefill Crawl-Delay when crawling
9ca532f Gergő Móricz committed 1 year ago
Merge pull request #2248 from firecrawl/feat/map-few-results
beee469 AdemÃlson Tonato committed 1 year ago
Merge remote-tracking branch 'origin/main' into feat/map-few-results
5c4515c AdemÃlson Tonato committed 1 year ago
Merge branch 'feat/map-few-results' of github.com:mendableai/firecrawl into feat/map-few-results
c29b7d4 AdemÃlson Tonato committed 1 year ago
refactor(url-utils): improve base domain validation logic to handle multi-part TLDs and update tests
39a087e AdemÃlson Tonato committed 1 year ago
feat(scrapeURL/index): add debug logging to document 404s
454a071 Gergő Móricz committed 1 year ago
Merge pull request #2258 from firecrawl/fix/get-crawl-status-redis
c1352c0 AdemÃlson Tonato committed 1 year ago
refactor: remove redundant check in getDoneJobsOrderedUntil function for Redis job retrieval
cc062e3 AdemÃlson Tonato committed 1 year ago
fix: handle edge case in getDoneJobsOrderedUntil function for Redis job retrieval
51cee42 AdemÃlson Tonato committed 1 year ago
fix: handle `$ref` for recursive schema validation (#2238)
10e07cb Gaurav Chadha committed 1 year ago
Fix a self-hosted docker-compose.yaml bug caused by a recent firecrawl change (#2252)
7d4100b Benjamin Auquite committed 1 year ago