Skip to content

Open Source alternative to Algolia + Pinecone and an Easier-to-Use alternative to ElasticSearch ⚡ 🔍 ✨ Fast, typo tolerant, in-memory fuzzy Search Engine for building delightful search experiences

Lock batched embedding operation.

Kishore Nallane623454ec59b
diff --git a/src/text_embedder.cpp b/src/text_embedder.cpp
index 1f0752ff..cf4a7c47 100644
--- a/src/text_embedder.cpp
+++ b/src/text_embedder.cpp
@@ -136,6 +136,7 @@ embedding_res_t TextEmbedder::Embed(const std::string& text, const size_t remote
std::vector<embedding_res_t> TextEmbedder::batch_embed(const std::vector<std::string>& inputs, const size_t remote_embedding_batch_size) {
std::vector<embedding_res_t> outputs;
if(!is_remote()) {
+ std::lock_guard<std::mutex> lock(mutex_);
for(int i = 0; i < inputs.size(); i += 8) {
auto input_batch = std::vector<std::string>(inputs.begin() + i, inputs.begin() + std::min(i + 8, static_cast<int>(inputs.size())));
auto encoded_inputs = batch_encode(input_batch);