Skip to content
Arm
Git
Search or jump to…
Ctrl K
Categories
Theme: System
Sign in
Get started
armgit
/
DeepInfer
Public
Imported from GitHub
Fork
0
Watch
0
Star
0
DeepInfer: High-performance, large-scale inference framework for DeepSeek models
Python
Code
Commits
Issues
Pull requests
Wiki
Builds
Discussions
Projects
Insights
Search
Files
main
2 branches · 0 tags
Go to file
t
Code
DeepInfer
/
deepinfer
/
model_executor
/
layers
/
tilelang_ops
/
cuda
Name
Last commit message
Last commit date
..
PY
__init__.py
0 B
PY
candidate_blocks.py
10.6 KB
PY
compress.py
14.2 KB
PY
compute_seqlens_k_zos.py
1.3 KB
PY
dflash_copy.py
4.9 KB
PY
dflash.py
3.7 KB
PY
flash_mla_utils.py
1.2 KB
PY
fused_sample.py
28.3 KB
PY
fused_transform.py
34.4 KB
PY
gather_engram_tokens_zos.py
3.1 KB
PY
gather_input_ids_zos.py
1.8 KB
PY
gather.py
2.2 KB
PY
get_kv_index.py
5.8 KB
PY
image_embed_ops.py
12.1 KB
PY
kv_index_cat.py
3.4 KB
PY
load_paged_kv_cache.py
9.0 KB
PY
norm.py
14.9 KB
PY
outlier_detection.py
1.5 KB
PY
prepare_cp_mirror.py
12.9 KB
PY
prepare_decode_metadata.py
8.9 KB
PY
quant.py
391 B
PY
random_sampling.py
9.6 KB
PY
sampler.py
18.5 KB
PY
schedule_mtp_varlen.py
3.1 KB
PY
state_cache.py
5.3 KB
PY
store_kv_cache.py
10.1 KB
PY
store_mtp_info.py
2.6 KB
PY
structure_output.py
2.3 KB
PY
sum_smaller_probs.py
2.2 KB
PY
swa_index.py
1.2 KB