Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. 🔥
TypeScript aiai-agentsai-crawlerai-scrapingai-searchcrawlerdata-extractionhtml-to-markdownllmmarkdownscraperscrapingweb-crawlerweb-dataweb-data-extractionweb-scraperweb-scrapingweb-searchwebscraping
fix(html-transformer): preserve title tag
Gergő Móricz8af4e4b8dd19
diff --git a/apps/api/sharedLibs/html-transformer/src/lib.rs b/apps/api/sharedLibs/html-transformer/src/lib.rsindex 4b1b57cf2..f5eb86e50 100644--- a/apps/api/sharedLibs/html-transformer/src/lib.rs+++ b/apps/api/sharedLibs/html-transformer/src/lib.rs@@ -128,7 +128,9 @@ pub unsafe extern "C" fn extract_metadata(html: *const libc::c_char) -> *mut i8if let Some(v) = out.get(name) {match v {Value::String(_) => {- out.insert(name.to_string(), Value::Array(vec! [v.clone(), Value::String(content.to_string())]));+ if name != "title" { // preserve title tag in metadata+ out.insert(name.to_string(), Value::Array(vec! [v.clone(), Value::String(content.to_string())]));+ }},Value::Array(_) => {match out.get_mut(name) {