[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.
Python aifaissgpt-osslangchainllama-indexllmlocalstorageoffline-firstollamaprivacypythonragretrieval-augmented-generationvector-databasevector-searchvectors
add readme
yichuan52003091032019df04095fb0
diff --git a/README.md b/README.mdindex e51f8c9..747c3cc 100755--- a/README.md+++ b/README.md@@ -8,14 +8,13 @@</p><p align="center">- <strong>⚡ Real-time embedding computation for large-scale RAG on consumer hardware</strong>+ <strong>⚡ Storage Saving RAG sytem on Consumer Device</strong></p><p align="center"><a href="#-quick-start">Quick Start</a> •<a href="#-features">Features</a> •<a href="#-benchmarks">Benchmarks</a> •- <a href="#-documentation">Documentation</a> •<a href="#-paper">Paper</a></p>@@ -23,22 +22,23 @@## 🌟 What is Leann?-**Leann** revolutionizes Retrieval-Augmented Generation (RAG) by eliminating the storage bottleneck of traditional vector databases. Instead of pre-computing and storing billions of embeddings, Leann dynamically computes embeddings at query time using highly optimized graph-based search algorithms.+**Leann** revolutionizes Retrieval-Augmented Generation (RAG) by eliminating the storage bottleneck of traditional vector databases. Instead of pre-computing and storing billions of embeddings, Leann dynamically computes embeddings at query time using optimized graph-based search algorithms.### 🎯 Why Leann?Traditional RAG systems face a fundamental trade-off:- **💾 Storage**: Storing embeddings for millions of documents requires massive disk space-- **🔄 Freshness**: Pre-computed embeddings become stale when documents change+- **🔄 Memory overhead**: The indexes LlamaIndex uses usually face high memory overhead (e.g., in-memory vector databases)- **💰 Cost**: Vector databases are expensive to scale-**Leann solves this by:**+**Leann revolutionizes this with Graph-based recomputation and cutting-edge system optimizations:**-- ✅ **Zero embedding storage** - Only graph structure is persisted-- ✅ **Real-time computation** - Embeddings computed on-demand with ms latency-- ✅ **Memory efficient** - Runs on consumer hardware (8GB RAM)-- ✅ **Always fresh** - No stale embeddings, ever+- ✅ **Zero embedding storage** - Only graph structure is persisted, reducing storage by 94-97%+- ✅ **Real-time computation** - Embeddings computed on-demand with low latency+- ✅ **Memory efficient** - Runs on consumer hardware with theoretical zero memory overhead+- ✅ **Graph-based optimization** - Advanced pruning techniques for efficient search while keeping low storage cost, with batching and overlapping strategies using low-precision search to optimize latency+- ✅ **Pluggable backends** - Support for DiskANN, HNSW, and other ANN algorithms (welcome contributions!)## 🚀 Quick Start