Skip to content
Arm
Git
Search or jump to…
Ctrl K
Categories
Theme: System
Sign in
Get started
armgit
/
DeepInfer
Public
Imported from GitHub
Fork
0
Watch
0
Star
0
DeepInfer: High-performance, large-scale inference framework for DeepSeek models
Python
Code
Commits
Issues
Pull requests
Wiki
Builds
Discussions
Projects
Insights
Search
Files
main
2 branches · 0 tags
Go to file
t
Code
DeepInfer
/
deepinfer
Name
Last commit message
Last commit date
..
_C
distributed
engine
entrypoints
hugging_face
model_executor
npu_ops
structure_output
ve
worker
PY
__init__.py
2.3 KB
PY
attrdict.py
3.5 KB
PY
config.py
9.3 KB
PY
environ.py
8.7 KB
PY
load_class.py
288 B
PY
logger.py
5.8 KB
PY
model_config_loader.py
886 B
PY
multimodal_tokens.py
1.4 KB
PY
platform.py
8.6 KB
py.typed
70 B
PY
sampling_params.py
5.0 KB
PY
sequence.py
11.0 KB
PY
shared_memory.py
12.1 KB
PY
testing.py
1002 B
PY
timer.py
10.1 KB
PY
utils.py
9.6 KB