[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.
Python aifaissgpt-osslangchainllama-indexllmlocalstorageoffline-firstollamaprivacypythonragretrieval-augmented-generationvector-databasevector-searchvectors
feat: allow batch_size override via provider_options (#205)
Andy Lee733076a8a9ca
diff --git a/packages/leann-core/src/leann/embedding_compute.py b/packages/leann-core/src/leann/embedding_compute.pyindex fc4fe58..70c1beb 100644--- a/packages/leann-core/src/leann/embedding_compute.py+++ b/packages/leann-core/src/leann/embedding_compute.py@@ -336,6 +336,11 @@ def compute_embeddings("""provider_options = provider_options or {}+ # Allow batch_size override from provider_options (disables adaptive_optimization)+ if "batch_size" in provider_options:+ batch_size = provider_options["batch_size"]+ adaptive_optimization = False # User-specified batch_size takes precedence+if mode == "sentence-transformers":return compute_embeddings_sentence_transformers(texts,