Skip to content

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

Commits on main

Nick: fixed prettier
Nicolas committed 1 year ago
00335e2
Create .env.example
Eric Ciarla committed 1 year ago
e5fe9e1
fix(WebCrawler/isFile): add .wav
Gergő Móricz committed 1 year ago
f877fbf
feat(queue-worker/crawl): solidify redirect behaviour
Gergő Móricz committed 1 year ago
d9e017e
fix(crawl): disable smart wait
Gergő Móricz committed 1 year ago
85cbfbb
5d90a6c
removing microsoft from blocklist
rafaelmmiller committed 1 year ago
468b8cd
feat: crawl log parser (poc)
Gergő Móricz committed 1 year ago
877f072
Update requests.http
Nicolas committed 1 year ago
4dbe0e6
Nick: bump node sdk
Nicolas committed 1 year ago
a47e278
fixed optional+default bug on llm schema
rafaelmmiller committed 1 year ago
5c81ea1
fix(crawl-redis/lockURL): reduce logging
Gergő Móricz committed 1 year ago
91a1a9a
fix(js-sdk/batchScrapeUrls): zod support
Gergő Móricz committed 1 year ago
fe6b003
bump version
rafaelmmiller committed 1 year ago
ff878bc
fixes schema warning
rafaelmmiller committed 1 year ago
d8847bb
Add assets for GitHub actions tutorialc
BexTuychiev committed 1 year ago
a093d55
Update email_notification.ts
Nicolas committed 1 year ago
f007f24
Add README to auotmated price tracking project
BexTuychiev committed 1 year ago
57ef400
742c3df
Nick: moving acuc temp to read replica
Nicolas committed 1 year ago
4d287bb
feat(queue-worker): add better logging for worker
Gergő Móricz committed 1 year ago
934363b
fix(crawl-redis): oops
Gergő Móricz committed 1 year ago
f82b9c2
845c274
fix(v1/batch/scrape): horrid memory usage
Gergő Móricz committed 1 year ago
cce9428