Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
TypeScript aiai-agentsai-crawlerai-scrapingai-searchcrawlerdata-extractionhtml-to-markdownllmmarkdownscraperscrapingweb-crawlerweb-dataweb-data-extractionweb-scraperweb-scrapingweb-searchwebscraping
Commits on main
Revert "fix(html-to-markdown): reinitialize converter lib for every conversion (#1872)"
c8b6687 Gergő Móricz committed 1 year ago
Revert "fix(go): experiment: build go lib in the final container"
5a2ccb8 Gergő Móricz committed 1 year ago
fix: improve robots.txt HTML filtering to check content structure (#1880)
ba3e4cd devin-ai-integration[bot] committed 1 year ago
Revert "Merge branch 'nsc/v2' of https://github.com/mendableai/firecrawl into nsc/v2"
bbceb00 Gergő Móricz committed 1 year ago
Merge branch 'nsc/v2' of https://github.com/mendableai/firecrawl into nsc/v2
f16f79a Nicolas committed 1 year ago
feat(v2): add natural language prompt support to crawl API (#1877)
9259314 devin-ai-integration[bot] committed 1 year ago
fix(crawl-status): move count_jobs_of_crawl_team after checks (#1875)
327af52 Gergő Móricz committed 1 year ago
fix(html-to-markdown): reinitialize converter lib for every conversion (#1872)
5f0715a Gergő Móricz committed 1 year ago