🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Python aiai-scrapingautomationcrawlercrawlingcrawling-pythondatadata-extractionmcpmcp-serverplaywrightpythonscrapingselectorsstealthweb-scraperweb-scrapingweb-scraping-pythonwebscrapingxpath
Commits on main
perf(mcp): Add more specific instruction to the server-level instructions
10c6c89 Karim shoair committed 3 months ago
fix(ai): size the MCP bulk page pools within the validator bounds (#393)
f8893d9 Yiğit ERDOĞAN committed 3 months ago
feat(mcp): add a scrapling-mcp console shortcut for easier MCP registration
0f2397c Karim shoair committed 3 months ago
fix(mcp): point the server card website_url at the MCP docs page
902b617 Karim shoair committed 3 months ago
feat(mcp): add tool annotations, server card metadata, and a tools/list cache hint
0e16c4d Karim shoair committed 3 months ago
feat(mcp): Make tools description shorter and add server-level instructions
e90367b Karim shoair committed 3 months ago
fix(browser version): extract current chrome version from playwright package data
2fb5e42 Karim shoair committed 3 months ago
ci: lock workflows to be triggered by the repo owner alone
1166ce3 Karim shoair committed 3 months ago
feat(spiders): Auto throttle based on website speed/protection
ca51962 Karim shoair committed 3 months ago
feat(mcp): Add auth to the mcp server and the option to set allowed host
563b134 Karim shoair committed 3 months ago
docs: Update main pages with the recently added features
0ca4aea Karim shoair committed 3 months ago
fix(cdp): Make browsers accept CDP urls with http protocol
9ecffdb Karim shoair committed 3 months ago
ci(docker): tag images with the release version on merge (#384)
f293d83 JanRK committed 3 months ago