Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
TypeScript aiai-agentsai-crawlerai-scrapingai-searchcrawlerdata-extractionhtml-to-markdownllmmarkdownscraperscrapingweb-crawlerweb-dataweb-data-extractionweb-scraperweb-scrapingweb-searchwebscraping
Commits on main
feat(countryCheck): better protection against XFF spoofing (#2051)
22c98f5 Gergő Móricz committed 1 year ago
feat: add initial Helm chart for Firecrawl deployment (#1262)
d982778 Jakob Stadlhuber committed 1 year ago
feat(api): support extraction of data-* attributes in scrape endpoints (#2006)
0589994 Vishnu Krishnan committed 1 year ago
feat(api): add image extraction support to v2 scrape endpoint (#2008)
30c6bdd Vishnu Krishnan committed 1 year ago
fix: handle UTF-8 encoding properly in Google search scraper (#1924)
26d8cf8 Miguel Antunes committed 1 year ago
fix(scrape): Remove --single-process argument from chrome in playwright-service (#2039)
44c1d44 grahamholley committed 1 year ago
fix(queue-worker): return URL instead of string for Windows file paths (#2036)
bbeabf7 tom committed 1 year ago
fix(map): use tlsclient to fetch sitemap for better reliability (#2034)
879908a Gergő Móricz committed 1 year ago
Merge pull request #2035 from firecrawl/nsc/v2-search-3x-faster
0bd3343 Nicolas committed 1 year ago
(js-sdk):fix v2 client options support and updates version to 3.2.1 (#2033)
5961031 Rafael Miller committed 1 year ago