Skip to content

Open-Sora: Democratizing Efficient Video Production for All

Python

[fix] update install requirements

zhengzangwb186e9f01698
diff --git a/docs/installation.md b/docs/installation.md
index c827fef..06b4b3c 100644
--- a/docs/installation.md
+++ b/docs/installation.md
@@ -33,9 +33,11 @@ cd Open-Sora
# the default installation is for inference only
pip install -v . # NOTE: for development mode, run `pip install -v -e .`
+```
-# (Optional, recommended for fast speed, especially for training) To enable `layernorm_kernel` and `flash_attn`, you need to install `apex` and `flash-attn` with the following commands.
+(Optional, recommended for fast speed, especially for training) To enable `layernorm_kernel` and `flash_attn`, you need to install `apex` and `flash-attn` with the following commands.
+```bash
# install flash attention
# set enable_flash_attn=False in config to disable flash attention
pip install packaging ninja
@@ -73,6 +75,7 @@ pip install opencv-python
However, if your videos are in av1 codec instead of h264, you need to install ffmpeg (already in our [requirement script](../requirements/requirements-data.txt)), then run the following to make conda support av1 codec:
```bash
+pip uninstall opencv-python
conda install -c conda-forge opencv
```
diff --git a/requirements/requirements-cu121.txt b/requirements/requirements-cu121.txt
index 362381d..cc13920 100644
--- a/requirements/requirements-cu121.txt
+++ b/requirements/requirements-cu121.txt
@@ -1,3 +1,3 @@
-torch==2.2.2 --index-url https://download.pytorch.org/whl/cu121
-torchvision==0.17.2 --index-url https://download.pytorch.org/whl/cu121
-xformers==0.0.25.post1 --index-url https://download.pytorch.org/whl/cu121
+torch==2.3.0 --index-url https://download.pytorch.org/whl/cu121
+torchvision==0.18.0 --index-url https://download.pytorch.org/whl/cu121
+xformers==0.0.26.post1 --index-url https://download.pytorch.org/whl/cu121
diff --git a/requirements/requirements-data.txt b/requirements/requirements-data.txt
index 2933e69..008b90f 100644
--- a/requirements/requirements-data.txt
+++ b/requirements/requirements-data.txt
@@ -2,39 +2,22 @@ gdown>=5.2.0
# [caption llava]
ninja>=1.11.1.1
-transformers>=4.36.2
-tokenizers>=0.15.2
-sentencepiece>=0.2.0
shortuuid>=1.0.13
-accelerate>=0.29.2
-peft>=0.4.0
-bitsandbytes>=0.41.0
-pydantic>=2.7.1
markdown2[all]
-numpy>=1.26.3
scikit-learn>=1.4.2
-gradio>=4.31.3
-gradio_client>=0.16.3
-requests>=2.31.0
-httpx>=0.27.0
-uvicorn>=0.29.0
-fastapi>=0.110.0
-einops>=0.8.0
einops-exts>=0.0.4
-timm==0.9.16
# [camera_motion]
decord==0.6.0
ptvsd==4.3.2
-imageio-ffmpeg==0.4.9
+imageio-ffmpeg>=0.4.9
# [datasets]
-pandarallel==1.6.5
ffmpeg-python==0.2.0
lingua-language-detector==2.0.2
# [frame interpolation]
-imageio==2.34.1
+imageio>=2.34.1
# [aesthetic]
clip @ git+https://github.com/openai/CLIP.git
diff --git a/requirements/requirements-eval.txt b/requirements/requirements-eval.txt
index d17c804..31dd449 100644
--- a/requirements/requirements-eval.txt
+++ b/requirements/requirements-eval.txt
@@ -1,8 +1,8 @@
# [vbench]
detectron2 @ git+https://github.com/facebookresearch/detectron2.git@ff53992
-imageio==2.34.1
+imageio>=2.34.1
pyiqa==0.1.10
-scikit-learn==1.4.2
+scikit-learn>=1.4.2
scikit-image==0.23.2
lvis==0.5.3
boto3==1.34.113
@@ -11,8 +11,3 @@ boto3==1.34.113
decord==0.6.0
pytorchvideo==0.1.5
lpips==0.1.4
-scipy==1.13.0
-
-# [human eval]
-requests==2.31.0
-urllib3==2.2.1
diff --git a/requirements/requirements.txt b/requirements/requirements.txt
index d32cd12..78eb65a 100644
--- a/requirements/requirements.txt
+++ b/requirements/requirements.txt
@@ -1,4 +1,4 @@
-colossalai>=0.3.7
+colossalai==0.3.7
mmengine>=0.10.3
pandas>=2.0.3
timm==0.9.16
@@ -6,7 +6,7 @@ rotary_embedding_torch==0.5.3
ftfy>=6.2.0 # for t5
diffusers==0.27.2 # for vae
accelerate==0.29.2 # for t5
-av>=12.0.0
+av>=12.0.0 # for video loading
# [gradio]
gradio>=4.31.3
diff --git a/setup.py b/setup.py
index 9743539..a90450e 100644
--- a/setup.py
+++ b/setup.py
@@ -79,5 +79,11 @@ setup(
extras_require={
"data": fetch_requirements("requirements/requirements-data.txt"),
"eval": fetch_requirements("requirements/requirements-eval.txt"),
+ "full": fetch_requirements(
+ [
+ "requirements/requirements-data.txt",
+ "requirements/requirements-eval.txt",
+ ]
+ ),
},
)