DeepInfer: High-performance, large-scale inference framework for DeepSeek models
Python
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| __init__.pyi 168 B | ||
| cuda_utils.pyi 699 B | ||
| engine.pyi 30.0 KB | ||
| graph_timer.pyi 1.8 KB | ||
DeepInfer: High-performance, large-scale inference framework for DeepSeek models
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| __init__.pyi 168 B | ||
| cuda_utils.pyi 699 B | ||
| engine.pyi 30.0 KB | ||
| graph_timer.pyi 1.8 KB | ||