Skip to content
Arm
Git
Search or jump to…
Ctrl K
Categories
Theme: System
Sign in
Get started
armgit
/
BitDecoding-FP4
Public
Imported from GitHub
Fork
0
Watch
0
Star
0
Accurate, fast FP4 KV-cache decoding through algorithm-system co-design.
Python
cuda
kv-cache-quantization
llm-inference
low-bit-quantization
vllm
Code
Commits
Issues
Pull requests
Wiki
Builds
Discussions
Projects
Insights
Search
Files
main
1 branch · 0 tags
Go to file
t
Code
BitDecoding-FP4
/
src
/
nvfp4_vllm
Name
Last commit message
Last commit date
..
PY
__init__.py
1.2 KB
PY
backend.py
4.9 KB
PY
builder.py
13.3 KB
PY
calibrate.py
13.3 KB
PY
control.py
22.3 KB
PY
engine.py
3.5 KB
PY
guards.py
13.2 KB
PY
impl.py
16.3 KB
PY
layout.py
4.5 KB
PY
metadata.py
6.4 KB
PY
probability_calibration.py
7.3 KB
PY
promote.py
2.2 KB
PY
rotation.py
2.0 KB
PY
runtime.py
26.6 KB
PY
write.py
9.6 KB