DeepInfer: High-performance, large-scale inference framework for DeepSeek models
Python
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| engine | ||
| graph_timer | ||
| utils | ||
| asc_utils.cpp 5.0 KB | ||
| cuda_utils.cpp 4.2 KB | ||
| cuda_utils.hpp 1.4 KB | ||
| pybind.cpp 626 B | ||
DeepInfer: High-performance, large-scale inference framework for DeepSeek models
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| engine | ||
| graph_timer | ||
| utils | ||
| asc_utils.cpp 5.0 KB | ||
| cuda_utils.cpp 4.2 KB | ||
| cuda_utils.hpp 1.4 KB | ||
| pybind.cpp 626 B | ||