Skip to content

Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥

Update removeUnwantedElements.ts

Nicolas07f4b714af56
diff --git a/apps/api/src/scraper/scrapeURL/lib/removeUnwantedElements.ts b/apps/api/src/scraper/scrapeURL/lib/removeUnwantedElements.ts
index 3afbabd56..3536211d6 100644
--- a/apps/api/src/scraper/scrapeURL/lib/removeUnwantedElements.ts
+++ b/apps/api/src/scraper/scrapeURL/lib/removeUnwantedElements.ts
@@ -39,9 +39,6 @@ const excludeNonMainTags = [
"#nav",
".breadcrumbs",
"#breadcrumbs",
- "#search-form",
- ".search",
- "#search",
".share",
"#share",
".widget",