Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
TypeScript aiai-agentsai-crawlerai-scrapingai-searchcrawlerdata-extractionhtml-to-markdownllmmarkdownscraperscrapingweb-crawlerweb-dataweb-data-extractionweb-scraperweb-scrapingweb-searchwebscraping
Commits on main
fix(api): a job id that is not a UUIDv7 is not found, not a Bigtable outage (#4892)
28bbead Gergő Móricz committed 1 month ago
docs(agent): mark spark-1 models deprecated, cover both aliases in the agent snip (#4878)
ae6b897 Gergő Móricz committed 1 month ago
feat(api): stop reading the PostgreSQL job tables (#4694)
85288f4 Gergő Móricz committed 1 month ago
fix(monitors): reserve credits for previously seen PDF pages (#4889)
58d5eef Rakshith Ramprakash committed 1 month ago
fix(branding): run the in-page branding scan once per page (#4884)
4522620 Abimael Martell committed 1 month ago
feat(api): long-poll fire-pdf job status with wait_ms (#4886)
4279c44 Abimael Martell committed 1 month ago
fix(branding): stop returning internal fields in the branding response (#4883)
76abc3e Abimael Martell committed 1 month ago
fix(api): send FirePDF pages_estimate only when it is a positive count (#4885)
ae63ff0 Abimael Martell committed 1 month ago
fix(branding): skip branding on PDFs, documents and images instead of failing the scrape (#4882)
bd83f5d Abimael Martell committed 1 month ago
perf(api): poll fire-pdf jobs on a page-aware early schedule (#4880)
463213e Abimael Martell committed 1 month ago
feat(branding): answer branding decisions with TypeSafe Jev behind a rollout flag (#4879)
60bfb31 Abimael Martell committed 1 month ago
fix(x-twitter): look up the requested handle directly on profile scrapes (#4873)
e58f33e Abimael Martell committed 1 month ago
fix(deps): bump rand, rustls-webpki, and axios to clear Dependabot alerts (#4876)
1a94fb0 Gergő Móricz committed 1 month ago
fix(api): carry the caller's external request id on v2 batch scrape charges (#4872)
a1667ae Gergő Móricz committed 1 month ago
feat(python-sdk): configurable origin attribution for Arcade and other integrators (#4440)
1715e4c Erik Engervall committed 1 month ago
feat(api): Jev-powered safe search filter for search safe: true (#4865)
bb3e582 Gergő Móricz committed 1 month ago
feat(telemetry): record X Search items fetched and price them in x-twitter cost tracking (#4824)
b7bdbdc Abimael Martell committed 1 month ago
fix(elixir-sdk): pin pagination next URLs to the api_url origin (#4868)
1f52d60 Gergő Móricz committed 1 month ago
fix(java-sdk): pin pagination next URLs to the api_url origin (#4870)
997ae07 Gergő Móricz committed 1 month ago
fix(rust-sdk): pin pagination next URLs to the api_url origin (#4866)
6174f2b Gergő Móricz committed 1 month ago
fix(go-sdk): pin pagination next URLs to the api_url origin (#4867)
d46d816 Gergő Móricz committed 1 month ago
fix(js-sdk): pin pagination next URLs to the api_url origin (#4869)
444f312 Gergő Móricz committed 1 month ago
fix(api): end the crawl status cursor after a cancelled or failed job's last page (#4863)
7e4a959 Gergő Móricz committed 1 month ago
fix(python-sdk): stop sending the API key to cross-host next URLs (#4861)
70a134c Gergő Móricz committed 1 month ago
fix(api): reject private targets before proxy dispatch in safeFetch (#4864)
8838973 Gergő Móricz committed 1 month ago
fix(playwright): report the URL the browser actually landed on (#4862)
bce6a2e Gergő Móricz committed 1 month ago
fix(ci): trust only same-repo audit coverage markers (#4860)
981289a Gergő Móricz committed 1 month ago