🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Python aiai-scrapingautomationcrawlercrawlingcrawling-pythondatadata-extractionmcpmcp-serverplaywrightpythonscrapingselectorsstealthweb-scraperweb-scrapingweb-scraping-pythonwebscrapingxpath
title: "Spiders, Requests and Crawl Results API Reference" description: "Look up spider lifecycle hooks, request options, session management, crawl statistics and item export methods."
Spider Classes
Here's the reference information for the spider framework classes' parameters, attributes, and methods.
You can import them directly like below:
from scrapling.spiders import Spider, Request, CrawlResult, SessionManager, Response
::: scrapling.spiders.Spider
handler: python
:docstring:
::: scrapling.spiders.Request
handler: python
:docstring:
Result Classes
::: scrapling.spiders.result.CrawlResult
handler: python
:docstring:
::: scrapling.spiders.result.CrawlStats
handler: python
:docstring:
::: scrapling.spiders.result.ItemList
handler: python
:docstring:
Session Management
::: scrapling.spiders.session.SessionManager
handler: python
:docstring: