Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
TypeScript aiai-agentsai-crawlerai-scrapingai-searchcrawlerdata-extractionhtml-to-markdownllmmarkdownscraperscrapingweb-crawlerweb-dataweb-data-extractionweb-scraperweb-scrapingweb-searchwebscraping
Commits on main
Add proxy location support to crawl and map endpoints (ENG-3361) (#2092)
9a3bd6c tom committed 1 year ago
feat(api): introduce integration schema validation for request schemas
60625c1 rafaelmmiller committed 1 year ago
refactor(api): temporarily disable precrawl queue processing in admin controller and indexing worker
2cae465 rafaelmmiller committed 1 year ago
build is failing. Getting back tsl config for engines. Keeping the fallbacklist without it
69f0cc7 rafaelmmiller committed 1 year ago
Temporarily comment out TLS client engine options in the scraper
1da56fe rafaelmmiller committed 1 year ago
Remove TLS client engine options from the scraper temporarily
0a60985 rafaelmmiller committed 1 year ago
fix(api/native/pdf-parser): trim null chars out of pdf titles (#2086)
03c9339 Gergő Móricz committed 1 year ago
Replace custom address validation functions with ipaddr.js (ENG-3404) (#2084)
52a8fad tom committed 1 year ago
fix(python-sdk): added missing get_queue_status in aio and added to t… (#2081)
3968a60 Rafael Miller committed 1 year ago
fix(api/scrapeURL/index): re-sign expired screenshot URLs (#2080)
4291af2 Gergő Móricz committed 1 year ago
fix(search): get links and descriptions correctly (#2076)
6d86da6 Gergő Móricz committed 1 year ago
feat: historical credit/token usage endpoints + more data in existing usage endpoints (#2077)
90778e4 Gergő Móricz committed 1 year ago
build(deps): bump actions/setup-node from 3 to 4 (#1997)
38de9cf dependabot[bot] committed 1 year ago
build(deps): bump docker/build-push-action from 5 to 6 (#1995)
ccba52d dependabot[bot] committed 1 year ago
build(deps): bump docker/login-action from 1 to 3 (#1996)
9d56585 dependabot[bot] committed 1 year ago
build(deps): bump actions/setup-python from 4 to 5 (#2028)
b7754bd dependabot[bot] committed 1 year ago