Skip to content

🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

963 B
Raw Blame

title: "Spiders, Requests and Crawl Results API Reference" description: "Look up spider lifecycle hooks, request options, session management, crawl statistics and item export methods."

Spider Classes

Here's the reference information for the spider framework classes' parameters, attributes, and methods.

You can import them directly like below:

from scrapling.spiders import Spider, Request, CrawlResult, SessionManager, Response

::: scrapling.spiders.Spider

handler: python
:docstring:

::: scrapling.spiders.Request

handler: python
:docstring:

Result Classes

::: scrapling.spiders.result.CrawlResult

handler: python
:docstring:

::: scrapling.spiders.result.CrawlStats

handler: python
:docstring:

::: scrapling.spiders.result.ItemList

handler: python
:docstring:

Session Management

::: scrapling.spiders.session.SessionManager

handler: python
:docstring: