Skip to content
Arm
Git
Search or jump to…
Ctrl K
Categories
Theme: System
Sign in
Get started
armgit
/
BitDecoding-FP4
Public
Imported from GitHub
Fork
0
Watch
0
Star
0
Accurate, fast FP4 KV-cache decoding through algorithm-system co-design.
Python
cuda
kv-cache-quantization
llm-inference
low-bit-quantization
vllm
Code
Commits
Issues
Pull requests
Wiki
Builds
Discussions
Projects
Insights
Search
Files
main
1 branch · 0 tags
Go to file
t
Code
BitDecoding-FP4
/
src
/
nvfp4_decode_kernel
Name
Last commit message
Last commit date
..
_fa4
PY
__init__.py
399 B
PY
_block_scale.py
21.2 KB
PY
_decode.py
51.2 KB
PY
_kernel.py
15.7 KB
PY
_quantize.py
6.5 KB
PY
fp4_decode_kernel.py
372 KB
PY
interface.py
15.6 KB
PY
p_scale.py
3.5 KB
PY
quantize_kv_kernel.py
39.6 KB
PY
quantize_q_kernel.py
37.7 KB
PY
reference.py
34.6 KB
PY
scale_mode.py
2.7 KB
PY
split_k_combine.py
5.0 KB