DeepInfer: High-performance, large-scale inference framework for DeepSeek models
Python
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| test_expert_shuffle.py 6.2 KB | ||
| test_shm_broadcast.py 4.5 KB | ||
DeepInfer: High-performance, large-scale inference framework for DeepSeek models
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| test_expert_shuffle.py 6.2 KB | ||
| test_shm_broadcast.py 4.5 KB | ||