Open Source alternative to Algolia + Pinecone and an Easier-to-Use alternative to ElasticSearch ⚡ 🔍 ✨ Fast, typo tolerant, in-memory fuzzy Search Engine for building delightful search experiences
C++ algoliadatastoreelasticsearchenterprise-searchfacetingfull-text-searchfuzzy-searchgeosearchin-memoryinstantsearchmerchandisingpineconesearchsearch-enginesemantic-searchsimilarity-searchsite-searchsynonymstypo-tolerancevector-search
Lock batched embedding operation.
Kishore Nallane623454ec59b
diff --git a/src/text_embedder.cpp b/src/text_embedder.cppindex 1f0752ff..cf4a7c47 100644--- a/src/text_embedder.cpp+++ b/src/text_embedder.cpp@@ -136,6 +136,7 @@ embedding_res_t TextEmbedder::Embed(const std::string& text, const size_t remotestd::vector<embedding_res_t> TextEmbedder::batch_embed(const std::vector<std::string>& inputs, const size_t remote_embedding_batch_size) {std::vector<embedding_res_t> outputs;if(!is_remote()) {+ std::lock_guard<std::mutex> lock(mutex_);for(int i = 0; i < inputs.size(); i += 8) {auto input_batch = std::vector<std::string>(inputs.begin() + i, inputs.begin() + std::min(i + 8, static_cast<int>(inputs.size())));auto encoded_inputs = batch_encode(input_batch);