Skip to content

DeepInfer: High-performance, large-scale inference framework for DeepSeek models

Python
127 B
Raw Blame
-r requirements-dev.txt
--find-links https://download.pytorch.org/whl/cu132/torch/
torch==2.13.0+cu132

flash-attn-4==4.0.0b34