Skip to content

🕷️ The BEST Web Scraping framework that handles everything from a single request to a full-scale crawl! Don't be shy, join here: https://discord.gg/EMgGbDceNQ and follow here for daily tips and tricks: https://x.com/Scrapling_dev

fix(parser): count all nested children of ignored tags in `get_all_text`

Karim shoair84337ef1acd0
diff --git a/scrapling/parser.py b/scrapling/parser.py
index e18c0aa..aa43100 100644
--- a/scrapling/parser.py
+++ b/scrapling/parser.py
@@ -326,7 +326,7 @@ class Selector(SelectorsGeneration):
if ignore_tags:
for element in self._root.iter(*ignore_tags):
ignored_elements.add(element)
- ignored_elements.update(set(element.iterchildren()))
+ ignored_elements.update(set(_find_all_elements(element)))
_all_strings = []
for node in self._root.iter():