Supercharge your AI agents with data from the web and beyond. Building the library for superintelligence. π₯
TypeScript aiai-agentsai-crawlerai-scrapingai-searchcrawlerdata-extractionhtml-to-markdownllmmarkdownscraperscrapingweb-crawlerweb-dataweb-data-extractionweb-scraperweb-scrapingweb-searchwebscraping
Update index.ts
Nicolas046f489776e0
diff --git a/apps/api/src/lib/search-index/index.ts b/apps/api/src/lib/search-index/index.tsindex 420922ce4..2e946ef7f 100644--- a/apps/api/src/lib/search-index/index.ts+++ b/apps/api/src/lib/search-index/index.ts@@ -1,16 +1,3 @@-/**- * Search Index Module- *- * Real-time search index on top of Firecrawl's web scraping infrastructure.- * Combines keyword (BM25) and semantic (vector) search with RRF ranking.- *- *- * Architecture:- * - Ingest: Crawler β Text Normalization β Chunking β Embeddings β Postgres- * - Query: Hybrid Search (BM25 + Vector) β RRF β Filters β Results- * - Storage: search_documents + search_chunks tables- * - Embeddings: OpenAI text-embedding-3-small (1536 dims)- */export {chunkText,