Skip to content

Accurate, fast FP4 KV-cache decoding through algorithm-system co-design.

Commits on main

48c835a
docs: add native FP4 decoding system overview
dayoudu committed 12 days ago
314b5db
81ecfbd
df5b46b
Describe algorithm-system co-design in README
DD-DuDa committed 16 days ago
8c8a5e3
Initial public release
DD-DuDa committed 16 days ago
62d5cc2