Skip to content

🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

Commits on main

fix(parser): handle responses with empty body
Karim shoair committed 10 months ago
dac854a
35d5701
feat: add hook to run after collecting an item
Karim shoair committed 10 months ago
3466bca
e0f94cf
feat(spiders): The option to start sessions lazily
Karim shoair committed 10 months ago
927cfd8
f2c6216
feat(spiders): add simple export system for the results
Karim shoair committed 10 months ago
72c3c27
a17bb1d
5a11c24
style(spiders): make the usage of uvloop optional
Karim shoair committed 10 months ago
774364b
feat: spiders use uvloop/winloop when available
Karim shoair committed 10 months ago
0bfdab7
fix(browsers): Close pages that give error
Karim shoair committed 10 months ago
d5b9ed1
build: Add AnyIO to the dependencies
Karim shoair committed 10 months ago
32f4f2a
059a708
1443a46
aa4817f
ops: add local Claude files to gitignore
Karim shoair committed 10 months ago
8e36962
feat(spiders): Add follow function to the response
Karim shoair committed 10 months ago
0634f57
refactor: internal API changes
Karim shoair committed 10 months ago
f80e882
build: pump version up temporary
Karim shoair committed 10 months ago
3a360ac
fix: add missing line
Karim shoair committed 10 months ago
08f3e6e
ops: update workflows to run for this branch
Karim shoair committed 10 months ago
6553d90
test: update tests accordingly
Karim shoair committed 10 months ago
9eb5f68
v0.3.14
Karim shoair committed 10 months ago
de79fe8
test: update database test to suite windows
Karim shoair committed 10 months ago
2f87507
test: remove the check for incognito
Karim shoair committed 10 months ago
f99baf6