Skip to content

armgit / LEANN

Public Imported from GitHub
0

[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.

[Readme]update embedding model config according to reddit feedback

yichuan5200309103209801aa581b75
diff --git a/README.md b/README.md
index 748b252..d53f818 100755
--- a/README.md
+++ b/README.md
@@ -189,7 +189,7 @@ All RAG examples share these common parameters. **Interactive mode** is availabl
--force-rebuild # Force rebuild index even if it exists
# Embedding Parameters
---embedding-model MODEL # e.g., facebook/contriever, text-embedding-3-small, nomic-embed-text, or mlx-community/multilingual-e5-base-mlx
+--embedding-model MODEL # e.g., facebook/contriever, text-embedding-3-small, nomic-embed-text, mlx-community/Qwen3-Embedding-0.6B-8bit or nomic-embed-text
--embedding-mode MODE # sentence-transformers, openai, mlx, or ollama
# LLM Parameters (Text generation models)
diff --git a/docs/configuration-guide.md b/docs/configuration-guide.md
index 95cb3f0..22dcaa8 100644
--- a/docs/configuration-guide.md
+++ b/docs/configuration-guide.md
@@ -222,9 +222,15 @@ python apps/document_rag.py --query "What are the main techniques LEANN explores
3. **Use MLX on Apple Silicon** (optional optimization):
```bash
- --embedding-mode mlx --embedding-model mlx-community/multilingual-e5-base-mlx
+ --embedding-mode mlx --embedding-model mlx-community/Qwen3-Embedding-0.6B-8bit
```
+ MLX might not be the best choice, as we tested and found that it only offers 1.3x acceleration compared to HF, so maybe using ollama is a better choice for embedding generation
+4. **Use Ollama**
+ ```bash
+ --embedding-mode ollama --embedding-model nomic-embed-text
+ ```
+ To discover additional embedding models in ollama, check out https://ollama.com/search?c=embedding or read more about embedding models at https://ollama.com/blog/embedding-models, please do check the model size that works best for you
### If Search Quality is Poor
1. **Increase retrieval count**: