Open-Sora: Democratizing Efficient Video Production for All
Python
[docs] update report
zhengzangw2ebad94b89b5
diff --git a/docs/report_03.md b/docs/report_03.mdindex 7f5d4fb..458e077 100644--- a/docs/report_03.md+++ b/docs/report_03.md@@ -1,11 +1,12 @@# Open-Sora 1.2 Report-- [3D VAE](#3d-vae)+- [Video compression network](#video-compression-network)- [Rectified flow and model adaptation](#rectified-flow-and-model-adaptation)-- [Training data and stages](#training-data-and-stages)+- [More data and better multi-stage training](#more-data-and-better-multi-stage-training)+- [Easy and effective model conditioning](#easy-and-effective-model-conditioning)- [Evaluation](#evaluation)-In Open-Sora 1.2 release, we train a 1.1B models on >20M data, supporting 0s~15s, 144p to 720p, various aspect ratios video generation. Our configurations is listed below, where β means that the data is seen during training, while π means although not trained, the model can inference at that config (inference requires more than one 80G memory GPU). Following our 1.1 version, Open-Sora 1.2 can also do image-to-video generation and video extension.+In Open-Sora 1.2 release, we train a 1.1B models on >20M data, supporting 0s~15s, 144p to 720p, various aspect ratios video generation. Our configurations is listed below. Following our 1.1 version, Open-Sora 1.2 can also do image-to-video generation and video extension.| | image | 2s | 4s | 8s | 16s || ---- | ----- | --- | --- | --- | --- |@@ -14,6 +15,8 @@ In Open-Sora 1.2 release, we train a 1.1B models on >20M data, supporting 0s~15s| 480p | β | β | β | β | π || 720p | β | β | β | π | π |+Here β means that the data is seen during training, and π means although not trained, the model can inference at that config. Inference for π requires more than one 80G memory GPU and sequence parallelism.+Besides features introduced in Open-Sora 1.1, Open-Sora 1.2 highlights:- Video compression network