Accurate, fast FP4 KV-cache decoding through algorithm-system co-design.
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| bootstrap_env.sh 1.8 KB | ||
| calibrate_key_smooth_sidecar.py 4.6 KB | ||
| lcb_data.py 3.8 KB | ||
| prepare_data.py 32.5 KB | ||
| score_lcb.py 7.1 KB | ||
Accurate, fast FP4 KV-cache decoding through algorithm-system co-design.
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| bootstrap_env.sh 1.8 KB | ||
| calibrate_key_smooth_sidecar.py 4.6 KB | ||
| lcb_data.py 3.8 KB | ||
| prepare_data.py 32.5 KB | ||
| score_lcb.py 7.1 KB | ||