🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Python aiai-scrapingautomationcrawlercrawlingcrawling-pythondatadata-extractionmcpmcp-serverplaywrightpythonscrapingselectorsstealthweb-scraperweb-scrapingweb-scraping-pythonwebscrapingxpath
Commits on main
refactor(fetchers)!: Remove dynamic sessions and dynamic fetcher
c54966a Karim shoair committed 1 month ago
feat(mcp): Add new tools to set and load browser session state
99a2281 Karim shoair committed 1 month ago
feat(fetchers): add functions to save browser session state and load it
d5b1995 Karim shoair committed 1 month ago
fix(spiders): preserve falsy JSON bodies in request fingerprints (#480)
7831c19 Alex committed 1 month ago
fix: stop response.follow() inheriting the method, params and body (#462)
1ac8e52 Yuval Dinodia committed 1 month ago
docs: mention the default encoding issue for websites with bad default encoding
0d5be50 Karim shoair committed 1 month ago
feat/refactor(mcp)!: Renamed `browser_snapshot` to `browser_extract` while adding more options
890d0c0 Karim shoair committed 1 month ago
Merge branch 'dev' of https://github.com/D4Vinci/Scrapling into dev
2541e6b Karim shoair committed 1 month ago
fix(spiders): pass stealthy_headers to the session instead of curl_cffi (#475)
06ae92f Yiğit ERDOĞAN committed 1 month ago
fix(ai): strip every noise tag, not just the ones before a nested one (#474)
e880293 Yiğit ERDOĞAN committed 1 month ago
fix: make request fingerprint independent of header order (#466)
4b97bfe Sarwadnya Mahajan committed 1 month ago
perf(mcp)!: Combine `selector` and `ref` into one field called `target`
1c3e355 Karim shoair committed 1 month ago
perf(mcp): lower the tokens used by tools definition more.
7372361 Karim shoair committed 1 month ago
refactor(mcp): Move all AI related files to one submodule
d82f835 Karim shoair committed 1 month ago
refactor(mcp)!: Remove all bulk tools to lower tools definition tokens and more optimizations
84ddced Karim shoair committed 1 month ago
docs!: update pages and skill to cover the recent changes
e45311e Karim shoair committed 1 month ago