Open-Sora: Democratizing Efficient Video Production for All
Python
[docs] update readme
zhengzangw0bb4c8d5874f
diff --git a/README.md b/README.mdindex 6130f72..cb66790 100644--- a/README.md+++ b/README.md@@ -24,7 +24,7 @@ With Open-Sora, our goal is to foster innovation, creativity, and inclusivity wi## π° News-* **[2024.06.17]** π₯ We released **Open-Sora 1.2**, which includes **3D-VAE**, **rectified flow**, and **score condition**. The video quality is greatly improved.+* **[2024.06.17]** π₯ We released **Open-Sora 1.2**, which includes **3D-VAE**, **rectified flow**, and **score condition**. The video quality is greatly improved. [[checkpoints]](#open-sora-10-model-weights) [[report]](/docs/report_03.md)* **[2024.04.25]** π€ We released the [Gradio demo for Open-Sora](https://huggingface.co/spaces/hpcai-tech/open-sora) on Hugging Face Spaces.* **[2024.04.25]** We released **Open-Sora 1.1**, which supports **2s~15s, 144p to 720p, any aspect ratio** text-to-image, **text-to-video, image-to-video, video-to-video, infinite time** generation. In addition, a full video processing pipeline is released. [[checkpoints]]() [[report]](/docs/report_02.md)* **[2024.03.18]** We released **Open-Sora 1.0**, a fully open-source project for video generation.@@ -32,7 +32,7 @@ With Open-Sora, our goal is to foster innovation, creativity, and inclusivity wi<a href="https://github.com/hpcaitech/ColossalAI"><img src="assets/readme/colossal_ai.png" width="8%" ></a>acceleration,inference, and more. Our model can produce 2s 512x512 videos with only 3 days training. [[checkpoints]](#open-sora-10-model-weights)- [[blog]](https://hpc-ai.com/blog/open-sora-v1.0) [[report]](docs/report_01.md)+ [[blog]](https://hpc-ai.com/blog/open-sora-v1.0) [[report]](/docs/report_01.md)* **[2024.03.04]** Open-Sora provides training with 46% cost reduction.[[blog]](https://hpc-ai.com/blog/open-sora)@@ -78,7 +78,7 @@ see [here](/assets/texts/t2v_samples.txt) for full prompts.* π **Open-Sora 1.2** released. Model weights are available [here](#model-weights). See our **[report 1.2](docs/report_03.md)** for more details.* β Support rectified flow scheduling.* β Trained our 3D-VAE for temporal dimension compression.-* π **Open-Sora 1.1** released. Model weights are available [here](#model-weights). It is trained on **0s~15s, 144p to 720p, various aspect ratios** videos. See our **[report 1.1](docs/report_02.md)** for more discussions.+* π **Open-Sora 1.1** released. Model weights are available [here](#model-weights). It is trained on **0s~15s, 144p to 720p, various aspect ratios** videos. See our **[report 1.1](/docs/report_02.md)** for more discussions.* π§ **Data processing pipeline v1.1** is released. An automatic [processing pipeline](#data-processing) from raw videos to (text, video clip) pairs is provided, including scene cutting $\rightarrow$ filtering(aesthetic, optical flow, OCR, etc.) $\rightarrow$ captioning $\rightarrow$ managing. With this tool, you can easily build your video dataset.* β Improved ST-DiT architecture includes rope positional encoding, qk norm, longer text length, etc.* β Support training with any resolution, aspect ratio, and duration (including images).