Skip to content

armgit / LEANN

Public Imported from GitHub
0

[MLsys2026 Best Paper]: https://arxiv.org/abs/2506.08276. RAG on Everything with LEANN. Enjoy 97% storage savings while running a fast, accurate, and 100% private RAG application on your personal device.

feat: allow batch_size override via provider_options (#205)

Andy Lee733076a8a9ca
diff --git a/packages/leann-core/src/leann/embedding_compute.py b/packages/leann-core/src/leann/embedding_compute.py
index fc4fe58..70c1beb 100644
--- a/packages/leann-core/src/leann/embedding_compute.py
+++ b/packages/leann-core/src/leann/embedding_compute.py
@@ -336,6 +336,11 @@ def compute_embeddings(
"""
provider_options = provider_options or {}
+ # Allow batch_size override from provider_options (disables adaptive_optimization)
+ if "batch_size" in provider_options:
+ batch_size = provider_options["batch_size"]
+ adaptive_optimization = False # User-specified batch_size takes precedence
+
if mode == "sentence-transformers":
return compute_embeddings_sentence_transformers(
texts,