Skip to content

PTQ-Level Efficiency, QAT-Level Accuracy | 训练后量化的效率,量化感知训练的精度

Commits on main

add system checker in backend (#1097)
Wenhua Cheng committed 11 months ago
ae4ac94
bump version to v0.9.3 (#1091)
chen, suyue committed 11 months ago
f81af70
remove accelerate version limitation (#1090)
chen, suyue committed 11 months ago
39b0643
Fix MXFP/NVFP + FP8 Attn/KV (#1086)
Yi Liu committed 11 months ago
caa246f
remove numpy restriction for gptq kernel (#1084)
Wenhua Cheng committed 11 months ago
0abae38
fix mxfp qdq (#1088)
Yi Liu committed 11 months ago
cd9f20e
Support alg_ext on windows (#1082)
chen, suyue committed 11 months ago
ed07303
ef78c68
fix bf16 option in AutoScheme (#1079)
Wenhua Cheng committed 11 months ago
5329bcd
refine sampler (#1077)
Wenhua Cheng committed 11 months ago
727e573
Support mxfp nvfp lmhead quant (#1051)
Weiwei committed 11 months ago
c4a1479
improve accuracy for 2bit with auto-round-best (#1078)
Wenhua Cheng committed 11 months ago
7907c32
Add MXFP8 MOE/Linear and MXFP4 Linear (#1034)
Yi Liu committed 11 months ago
61bcfdb
7345fe5
update alg_ext and add ut (#1064)
Heng Guo committed 11 months ago
e18f9b6
b1b60e4
Add LLMC integration test (#1053)
Yi Liu committed 11 months ago
9c02a92
export kv scheme (#1068)
Yi Liu committed 11 months ago
e96756c
Optimize CPU CI pipelines (#1071)
Sun, Xuehao committed 11 months ago
2ef7f31
Add compatibility test for ARM (#1073)
Sun, Xuehao committed 11 months ago
be56548
support for gguf mixed q2_k_s (#1059)
Heng Guo committed 11 months ago
e575558
remove tbb (#1069)
Yi Liu committed 12 months ago
e1ec855
Add static FP8 attention support (#1061)
Yi Liu committed 12 months ago
6bde0e1
fix transformers==4.57.1 in CI (#1066)
Sun, Xuehao committed 12 months ago
ede64fa
refine readme (#1063)
Wenhua Cheng committed 12 months ago
2102257
Enhance tokenizer saving (#1057)
Wang, Mengni committed 12 months ago
4ec50d1
Add static FP8 attention support (#1045)
Yi Liu committed 12 months ago
c5b1c41
e1b89d2
Announce llmc integration (#1055)
Yi Liu committed 12 months ago
90871a7