Open-Sora: Democratizing Efficient Video Production for All
Python
small update on readme
Tom Young6b42f4aa95c4
diff --git a/tools/caption/README.md b/tools/caption/README.mdindex f6fe0c8..8f7dfed 100644--- a/tools/caption/README.md+++ b/tools/caption/README.md@@ -4,7 +4,7 @@ Human labeling of videos is expensive and time-consuming. We adopt powerful imag## PLLaVA Captioning-To balance captioning speed and performance, we chose the 13B version of PLLaVA configured with 2*2 spatial pooling. We feed it with 4 frames evenly extracted from the video.+To balance captioning speed and performance, we chose the 13B version of PLLaVA configured with 2*2 spatial pooling. We feed it with 4 frames evenly extracted from the video. We accelerate its inference via (1) batching and (2) offload frame extraction to a separate process such that the GPU computations and frame extraction happen in parallel.### InstallationInstall the required dependancies by following our [installation instructions](../../docs/installation.md)'s "Data Dependencies" and "PLLaVA Captioning" sections.