Skip to content

armgit / txtai

Public Imported from GitHub
0

💡 All-in-one AI framework for semantic search, LLM orchestration and language model workflows

Split similarity extras install, closes #696

davidmezzettib2e7b935da14
diff --git a/docs/install.md b/docs/install.md
index 7b096724..4dca1422 100644
--- a/docs/install.md
+++ b/docs/install.md
@@ -26,6 +26,14 @@ Install all dependencies.
pip install txtai[all]
```
+### ANN
+
+Additional ANN backends.
+
+```
+pip install txtai[ann]
+```
+
### API
Serve txtai via a web API.
@@ -84,12 +92,12 @@ pip install txtai[pipeline]
More granular extras are available for pipeline categories: `pipeline-audio`, `pipeline-data`, `pipeline-image`, `pipeline-llm`, `pipeline-text`, and `pipeline-train`.
-### Similarity
+### Vectors
-Word vectors, support for sentence-transformers models not on the HF Hub and additional ANN libraries.
+Support for sentence-transformers models not on the HF Hub and word vectors.
```
-pip install txtai[similarity]
+pip install txtai[vectors]
```
### Workflow
diff --git a/setup.py b/setup.py
index c5dc0484..6af420f6 100644
--- a/setup.py
+++ b/setup.py
@@ -27,6 +27,11 @@ extras["dev"] = [
"pylint",
]
+extras["ann"] = [
+ "annoy>=1.16.3",
+ "hnswlib>=0.5.0",
+]
+
extras["api"] = [
"aiohttp>=3.8.1",
"fastapi>=0.94.0",
@@ -75,10 +80,8 @@ extras["pipeline"] = (
+ extras["pipeline-train"]
)
-extras["similarity"] = [
- "annoy>=1.16.3",
+extras["vectors"] = [
"fasttext>=0.9.2",
- "hnswlib>=0.5.0",
"pymagnitude-lite>=0.1.43",
"scikit-learn>=0.23.1",
"sentence-transformers>=2.2.0",
@@ -94,6 +97,8 @@ extras["workflow"] = [
"xmltodict>=0.12.0",
]
+extras["similarity"] = extras["ann"] + extras["vectors"]
+
extras["all"] = (
extras["api"]
+ extras["cloud"]