DeepInfer: High-performance, large-scale inference framework for DeepSeek models
Python
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| __init__.py 18.8 KB | ||
| policy.py 7.7 KB | ||
| shuffle.py 9.5 KB | ||
DeepInfer: High-performance, large-scale inference framework for DeepSeek models
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| __init__.py 18.8 KB | ||
| policy.py 7.7 KB | ||
| shuffle.py 9.5 KB | ||