Skip to content
Arm
Git
Search or jump to…
Ctrl K
Categories
Theme: System
Sign in
Get started
armgit
/
DeepInfer
Public
Imported from GitHub
Fork
0
Watch
0
Star
0
DeepInfer: High-performance, large-scale inference framework for DeepSeek models
Python
Code
Commits
Issues
Pull requests
Wiki
Builds
Discussions
Projects
Insights
Search
Files
main
2 branches · 0 tags
Go to file
t
Code
DeepInfer
/
deepinfer
/
model_executor
/
layers
/
tilelang_ops
/
asc
Name
Last commit message
Last commit date
..
PY
__init__.py
0 B
PY
candidate_blocks.py
21.8 KB
PY
compress.py
20.4 KB
PY
compute_seqlens_k_zos.py
2.4 KB
PY
dflash_copy.py
8.3 KB
PY
dflash.py
6.2 KB
PY
flash_mla_utils.py
1.8 KB
PY
fused_sample.py
43.9 KB
PY
fused_transform.py
48.3 KB
PY
gather_engram_tokens_zos.py
6.9 KB
PY
gather_input_ids_zos.py
3.8 KB
PY
gather.py
4.0 KB
PY
get_kv_index.py
13.9 KB
PY
image_embed_ops.py
21.2 KB
PY
kv_index_cat.py
3.3 KB
PY
kv_quant.py
9.9 KB
PY
load_paged_kv_cache.py
20.0 KB
PY
norm.py
23.7 KB
PY
prepare_cp_mirror.py
26.9 KB
PY
prepare_v4_decode_metadata.py
11.7 KB
PY
random_sampling.py
9.7 KB
PY
rstd_1ulp.py
3.5 KB
PY
sampler.py
38.6 KB
PY
schedule_mtp_varlen.py
5.0 KB
PY
state_cache.py
3.5 KB
PY
store_kv_cache.py
16.3 KB
PY
store_mtp_info.py
3.1 KB
PY
structure_output.py
4.4 KB
PY
sum_smaller_probs.py
4.6 KB
PY
swa_index.py
2.7 KB