DeepInfer: High-performance, large-scale inference framework for DeepSeek models
Python
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| eplb | ||
| input_metadata | ||
| layers | ||
| models | ||
| parallel_utils | ||
| __init__.py 0 B | ||
| layer_utils.py 717 B | ||
| model_loader.py 5.6 KB | ||
| model_metadata_utils.py 9.6 KB | ||
| model_output.py 619 B | ||
| sampling_inputs.py 4.8 KB | ||
| utils.py 3.2 KB | ||