Skip to content

🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

900 B
Raw Blame

title: "Spider、请求和结果 API 参考" description: "查看 Spider 钩子、请求、会话、爬取统计和导出方法。"

Spider 类 {#spider-classes}

这里列出了爬虫框架中各个类的参数、属性和方法。

可以直接导入:

from scrapling.spiders import Spider, Request, CrawlResult, SessionManager, Response

::: scrapling.spiders.Spider

handler: python
:docstring:

::: scrapling.spiders.Request

handler: python
:docstring:

结果类 {#result-classes}

::: scrapling.spiders.result.CrawlResult

handler: python
:docstring:

::: scrapling.spiders.result.CrawlStats

handler: python
:docstring:

::: scrapling.spiders.result.ItemList

handler: python
:docstring:

会话管理 {#session-management}

::: scrapling.spiders.session.SessionManager

handler: python
:docstring: