Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
TypeScript aiai-agentsai-crawlerai-scrapingai-searchcrawlerdata-extractionhtml-to-markdownllmmarkdownscraperscrapingweb-crawlerweb-dataweb-data-extractionweb-scraperweb-scrapingweb-searchwebscraping
Commits on main
feat: add engine forcing by domain pattern (#2371)
706cbff devin-ai-integration[bot] committed 1 year ago
Fix: Handle invalid favicon URLs gracefully in metadata extraction (#2361)
608604b Abimael Martell committed 1 year ago
fix(crawl,batch-scrape): return correct protocol on local deployments
45b498d Gergő Móricz committed 1 year ago
Add branding format support to JS and Python SDKs (#2360)
dabf991 devin-ai-integration[bot] committed 1 year ago
Filter non-HTTP(S) protocols (telnet, ftp, ssh, file, mailto) with separate error message (#2357)
5f31044 devin-ai-integration[bot] committed 1 year ago
feat(go-html-to-md): enhance markdown conversion with robust PRE and … (#2321)
8797ee3 Rafael Miller committed 1 year ago
fix: import MAX_MAP_LIMIT from types.ts to resolve 1000 URL cap (#2333)
c399ecc prashu0705 committed 1 year ago
Refactor autoCharge function to use a type definition for the response. Update related functions and calls to ensure consistent response structure. Improve type safety and readability in billing services. (#2341)
7483506 Abimael Martell committed 1 year ago
fix(nuq,concurrency-limit): handle if there are duplicate jobs in the concurrency queue (#2343)
29a1c36 Gergő Móricz committed 1 year ago