Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
TypeScript aiai-agentsai-crawlerai-scrapingai-searchcrawlerdata-extractionhtml-to-markdownllmmarkdownscraperscrapingweb-crawlerweb-dataweb-data-extractionweb-scraperweb-scrapingweb-searchwebscraping
Commits on main
feat(api/tests/scrape): Playwright test improvements (#1626)
8dd5bf7 Gergő Móricz committed 1 year ago
feat: enhance metadata extraction by including 'itemprop' attribute in HTML (#1624)
4189713 Ademílson Tonato committed 1 year ago
feat(api/scrape): credits_billed column + handle billing for `/scrape` calls on worker side with stricter timeout enforcement (FIR-2162) (#1607)
72be734 Gergő Móricz committed 1 year ago
fix(scrapeURL): only allow disabling the adblock on playwright (FIR-2200) (#1616)
4167ec5 Gergő Móricz committed 1 year ago
feat(search): ignore concurrency limit for search (FIR-2187) (#1617)
98ceda9 Gergő Móricz committed 1 year ago
feat(api/server): wait 60s for GCE load balancer drain timeout
a2f41fb Gergő Móricz committed 1 year ago
feat(scrapeURL/pdf): bill n credits per page (FIR-1934) (#1553)
93655b5 Gergő Móricz committed 1 year ago