DeepInfer: High-performance, large-scale inference framework for DeepSeek models
Python
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| __init__.py 808 B | ||
| ascend.py 5.5 KB | ||
| cpu.py 1.5 KB | ||
| device.py 5.3 KB | ||
| nvidia.py 4.4 KB | ||
DeepInfer: High-performance, large-scale inference framework for DeepSeek models
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| __init__.py 808 B | ||
| ascend.py 5.5 KB | ||
| cpu.py 1.5 KB | ||
| device.py 5.3 KB | ||
| nvidia.py 4.4 KB | ||