[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.
Python aifaissgpt-osslangchainllama-indexllmlocalstorageoffline-firstollamaprivacypythonragretrieval-augmented-generationvector-databasevector-searchvectors
docs: Add ColQwen multimodal PDF retrieval to README
aakashf13bd02fbd66
diff --git a/README.md b/README.mdindex 0b0e59f..4bc3627 100755--- a/README.md+++ b/README.md@@ -379,6 +379,54 @@ python -m apps.code_rag --repo-dir "./my_codebase" --query "How does authenticat</details>+### 🎨 ColQwen: Multimodal PDF Retrieval with Vision-Language Models++Search through PDFs using both text and visual understanding with ColQwen2/ColPali models. Perfect for research papers, technical documents, and any PDFs with complex layouts, figures, or diagrams.++> **🍎 Mac Users**: ColQwen is optimized for Apple Silicon with MPS acceleration for faster inference!++```bash+# Build index from PDFs+python -m apps.colqwen_rag build --pdfs ./my_papers/ --index research_papers++# Search with text queries+python -m apps.colqwen_rag search research_papers "How does attention mechanism work?"++# Interactive Q&A+python -m apps.colqwen_rag ask research_papers --interactive+```++<details>+<summary><strong>📋 Click to expand: ColQwen Setup & Usage</strong></summary>++#### Prerequisites+```bash+# Install dependencies+uv pip install colpali_engine pdf2image pillow matplotlib qwen_vl_utils einops seaborn+brew install poppler # macOS only, for PDF processing+```++#### Build Index+```bash+python -m apps.colqwen_rag build \+ --pdfs ./pdf_directory/ \+ --index my_index \+ --model colqwen2 # or colpali+```++#### Search+```bash+python -m apps.colqwen_rag search my_index "your question here" --top-k 5+```++#### Models+- **ColQwen2** (`colqwen2`): Latest vision-language model with improved performance+- **ColPali** (`colpali`): Proven multimodal retriever++For detailed usage, see the [ColQwen Guide](COLQWEN_GUIDE.md).++</details>+### 📧 Your Personal Email Secretary: RAG on Apple Mail!> **Note:** The examples below currently support macOS only. Windows support coming soon.