Skip to content
Arm
Git
Search or jump to…
Ctrl K
Categories
Theme: System
Sign in
Get started
armgit
/
DeepInfer
Public
Imported from GitHub
Fork
0
Watch
0
Star
0
DeepInfer: High-performance, large-scale inference framework for DeepSeek models
Python
Code
Commits
Issues
Pull requests
Wiki
Builds
Discussions
Projects
Insights
Search
Files
main
2 branches · 0 tags
Go to file
t
Code
DeepInfer
/
deepinfer
/
model_executor
/
layers
/
tilelang_ops
Name
Last commit message
Last commit date
..
asc
cuda
PY
__init__.py
0 B
PY
cache_common.py
17.6 KB
PY
candidate_blocks.py
14.6 KB
PY
common.py
2.2 KB
PY
compress.py
23.8 KB
PY
compute_seqlens_k_zos.py
3.9 KB
PY
conftest.py
4.6 KB
PY
dflash_copy.py
6.1 KB
PY
dflash.py
8.1 KB
PY
flash_mla_utils.py
3.8 KB
PY
fused_sample.py
37.1 KB
PY
fused_transform.py
46.5 KB
PY
gather_engram_tokens_zos.py
9.5 KB
PY
gather_input_ids_zos.py
7.3 KB
PY
gather.py
4.2 KB
PY
get_kv_index.py
21.5 KB
PY
image_embed_ops.py
25.7 KB
PY
kv_index_cat.py
3.5 KB
PY
load_paged_kv_cache.py
16.1 KB
PY
norm.py
25.9 KB
PY
ops.py
1.2 KB
PY
outlier_detection.py
953 B
PY
prepare_cp_mirror.py
15.3 KB
PY
prepare_v4_decode_metadata.py
24.8 KB
PY
random_sampling.py
13.0 KB
PY
sampler.py
47.7 KB
PY
schedule_mtp_varlen.py
6.8 KB
PY
state_cache.py
7.8 KB
PY
store_kv_cache.py
16.3 KB
PY
store_mtp_info.py
9.6 KB
PY
structure_output.py
6.5 KB
PY
sum_smaller_probs.py
3.2 KB
PY
swa_index.py
4.9 KB