Skip to content

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

Commits on main

Nick: __experimental_streamSteps
Nicolas committed 1 year ago
033e9bb
Update package.json
Nicolas committed 1 year ago
558a7f4
Nick: temp file fixes
Nicolas committed 1 year ago
9759f18
Update requests.http
Nicolas committed 1 year ago
ac6650e
feat: new snips test framework (FIR-414) (#1033)
Gergő Móricz committed 1 year ago
5c62bb1
Nick: fixes to extract rephrase prompt
Nicolas committed 1 year ago
9a13c1d
Update crawl-redis.ts
Nicolas committed 1 year ago
a82160a
Nick: formatting fixes
Nicolas committed 1 year ago
f4d10c5
feat: add scrapeId in document.metadata
Gergő Móricz committed 1 year ago
d1f3b96
feat(scrape-status): adapt
Gergő Móricz committed 1 year ago
29c1f12
fix(queue-worker): errored job logging
Gergő Móricz committed 1 year ago
2849ce2
97bf542
fix(queue-worker): graceful shutdown
Gergő Móricz committed 1 year ago
0da3869
fix(scrapeURL/engines/pdf,docx): support authorization
Móricz Gergő committed 1 year ago
3c614a2
49e584f
fix(log_job): don't redact with auth header
Móricz Gergő committed 1 year ago
9e8c629
Update auth.ts
Nicolas committed 1 year ago
14f6968
Nick: temp rl for /extract
Nicolas committed 1 year ago
51cb4b1
Update rate-limiter.ts
Nicolas committed 1 year ago
a199208
Nick: links-billed update (temp)
Nicolas committed 1 year ago
aa31508
feat(crawl): ensure url trimming
Móricz Gergő committed 1 year ago
363021e
fix(scrapeURL): remove short content check
Móricz Gergő committed 1 year ago
977a3e1
Merge branch 'nsc/extract-queue'
Nicolas committed 1 year ago
0a41fdd
Nick: bump 1.12.0
Nicolas committed 1 year ago
7918d0e
Nick:
Nicolas committed 1 year ago
b98e289
Nick: sdk async and get status
Nicolas committed 1 year ago
a185c05
Nick: fixed the sdks
Nicolas committed 1 year ago
9ec08d7