Skip to content
Arm
Git
Search or jump to…
Ctrl K
Categories
Theme: System
Sign in
Get started
armgit
/
BitDecoding-FP4
Public
Imported from GitHub
Fork
0
Watch
0
Star
0
Accurate, fast FP4 KV-cache decoding through algorithm-system co-design.
Python
cuda
kv-cache-quantization
llm-inference
low-bit-quantization
vllm
Code
Commits
Issues
Pull requests
Wiki
Builds
Discussions
Projects
Insights
Search
main
1 branch · 0 tags
Go to file
t
Code
Commits on
main
docs: add arXiv, license and OpenBitSys badges and citation
DD-DuDa committed 10 days ago
4e2907d
Copy SHA
docs: add Overview section and rename figure heading
DD-DuDa committed 12 days ago
48c835a
Copy SHA
docs: add native FP4 decoding system overview
dayoudu committed 12 days ago
314b5db
Copy SHA
Add MIT license and preserve third-party licensing
DD-DuDa committed 16 days ago
81ecfbd
Copy SHA
Simplify large-model results wording and table footnotes
DD-DuDa committed 16 days ago
febe5a7
Copy SHA
Add large-model accuracy and KV-cache memory table
Woon Yee committed 16 days ago
df5b46b
Copy SHA
Describe algorithm-system co-design in README
DD-DuDa committed 16 days ago
8c8a5e3
Copy SHA
Initial public release
DD-DuDa committed 16 days ago
62d5cc2
Copy SHA