DeepInfer: High-performance, large-scale inference framework for DeepSeek models
Python
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| distributed | ||
| engine | ||
| models | ||
| ve | ||
| worker | ||
| __init__.py 0 B | ||
| conftest.py 700 B | ||
| test_cuda_sync_guards.py 8.1 KB | ||
DeepInfer: High-performance, large-scale inference framework for DeepSeek models
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| distributed | ||
| engine | ||
| models | ||
| ve | ||
| worker | ||
| __init__.py 0 B | ||
| conftest.py 700 B | ||
| test_cuda_sync_guards.py 8.1 KB | ||