Skip to content
Arm
Git
Search or jump to…
Ctrl K
Categories
Theme: System
Sign in
Get started
armgit
/
BitDecoding-FP4
Public
Imported from GitHub
Fork
0
Watch
0
Star
0
Accurate, fast FP4 KV-cache decoding through algorithm-system co-design.
Python
cuda
kv-cache-quantization
llm-inference
low-bit-quantization
vllm
Code
Commits
Issues
Pull requests
Wiki
Builds
Discussions
Projects
Insights
Search
Files
main
1 branch · 0 tags
Go to file
t
Code
BitDecoding-FP4
/
src
/
nvfp4_decode_kernel
/
_fa4
Name
Last commit message
Last commit date
..
PY
__init__.py
63 B
AUTHORS
30 B
PY
blackwell_helpers.py
47.7 KB
PY
block_info.py
4.4 KB
PY
block_scaled_layout.py
8.4 KB
PY
block_sparse_utils.py
30.2 KB
PY
block_sparsity.py
24.9 KB
PY
copy_utils.py
11.5 KB
PY
cute_dsl_utils.py
4.6 KB
PY
fast_math.py
3.0 KB
LIC
LICENSE
1.5 KB
PY
mask.py
23.8 KB
PY
mma_sm100_desc.py
15.1 KB
PY
pack_gqa.py
10.1 KB
PY
paged_kv.py
6.2 KB
PY
pipeline.py
13.6 KB
PY
seqlen_info.py
4.5 KB
PY
softmax.py
33.5 KB
PY
tile_scheduler.py
29.2 KB
PY
utils.py
31.0 KB