Skip to content

Official Crawl4AI Cloud: a hosted web scraping, extraction, and search API for AI agents. Free API key, 1,000 credits a month, no card. Fully open source: this repo is the Apache-2.0 crawler that powers it, and you can self-host it.

520 B
Raw Blame
{
  "name": "ArticleExtractor",
  "baseSelector": ".cards[data-tax=news] .card__data",
  "fields": [
    {
      "name": "title",
      "selector": "h4.card__title",
      "type": "text"
    },
    {
      "name": "link",
      "selector": "h4.card__title a", 
      "type": "attribute",
      "attribute": "href"
    },
    {
      "name": "details",
      "selector": ".card__details",
      "type": "text"
    },
    {
      "name": "topics",
      "selector": ".card__topics.topics",
      "type": "text"
    }
  ]
}