Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
TypeScript aiai-agentsai-crawlerai-scrapingai-searchcrawlerdata-extractionhtml-to-markdownllmmarkdownscraperscrapingweb-crawlerweb-dataweb-data-extractionweb-scraperweb-scrapingweb-searchwebscraping
Update README.md
Nicolas007e3edfc5c7
diff --git a/README.md b/README.mdindex dd8a740ae..d8e5bdcb4 100644--- a/README.md+++ b/README.md@@ -80,6 +80,7 @@ To use the API, you need to sign up on [Firecrawl](https://firecrawl.dev) and ge- **Media parsing**: pdfs, docx, images.- **Reliability first**: designed to get the data you need - no matter how hard it is.- **Actions**: click, scroll, input, wait and more before extracting data+- **Batching (New)**: scrape thousands of URLs at the same time with a new async endpointYou can find all of Firecrawl's capabilities and how to use them in our [documentation](https://docs.firecrawl.dev)@@ -350,6 +351,19 @@ curl -X POST https://api.firecrawl.dev/v1/scrape \}'```+### Batch Scraping Multiple URLs (New)++You can now batch scrape multiple URLs at the same time. It is very similar to how the /crawl endpoint works. It submits a batch scrape job and returns a job ID to check the status of the batch scrape.++```bash+curl -X POST https://api.firecrawl.dev/v1/batch/scrape \+ -H 'Content-Type: application/json' \+ -H 'Authorization: Bearer YOUR_API_KEY' \+ -d '{+ "urls": ["https://docs.firecrawl.dev", "https://docs.firecrawl.dev/sdks/overview"],+ "formats" : ["markdown", "html"]+ }'+```### Search (v0) (Beta)