🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev
Python aiai-scrapingautomationcrawlercrawlingcrawling-pythondatadata-extractionmcpmcp-serverplaywrightpythonscrapingselectorsstealthweb-scraperweb-scrapingweb-scraping-pythonwebscrapingxpath
Update ROADMAP.md
Karim shoaire485d51b43c4
diff --git a/ROADMAP.md b/ROADMAP.mdindex f52f858..5847c87 100644--- a/ROADMAP.md+++ b/ROADMAP.md@@ -1,13 +1,14 @@## TODOs-- Add more tests and increase the code coverage.-- Structure the tests folder in a better way.-- Add more documentation.-- Add the browsing ability.-- Create detailed documentation for 'readthedocs' website, preferably add Github action for deploying it.-- Create a Scrapy plugin/decorator to make it replace parsel in the response argument when needed.-- Need to add more functionality to `AttributesHandler` and more navigation functions to `Adaptor` object (ex: functions similar to map, filter, and reduce functions but here pass it to the element and the function is executed on children, siblings, next elements, etc...)-- Add `.filter` method to `Adaptors` object and other similar methods.-- Add functionality to automatically detect pagination URLs-- Add the ability to auto-detect schemas in pages and manipulate them-- Add ability to generate a regex from a group of elements (Like for all href attributes)+- [ ] Add more tests and increase the code coverage.+- [ ] Structure the tests folder in a better way.+- [ ] Add more documentation.+- [x] Add the browsing ability.+- [ ] Create detailed documentation for 'readthedocs' website, preferably add Github action for deploying it.+- [ ] Create a Scrapy plugin/decorator to make it replace parsel in the response argument when needed.+- [ ] Need to add more functionality to `AttributesHandler` and more navigation functions to `Adaptor` object (ex: functions similar to map, filter, and reduce functions but here pass it to the element and the function is executed on children, siblings, next elements, etc...)+- [ ] Add `.filter` method to `Adaptors` object and other similar methods.+- [ ] Add functionality to automatically detect pagination URLs+- [ ] Add the ability to auto-detect schemas in pages and manipulate them.+- [ ] Add `analyzer` ability that tries to learn about the page through meta elements and return what it learned+- [ ] Add ability to generate a regex from a group of elements (Like for all href attributes)-\ No newline at end of file