Skip to content

PTQ-Level Efficiency, QAT-Level Accuracy | 训练后量化的效率,量化感知训练的精度

Commits on main

fix mx_fp issues (#286)
wenhuach21 committed 2 years ago
99cff1f
ba5be40
update readme for cpu inference
wenhuach21 committed 2 years ago
141c149
update readme for v0.3.1 release (#283)
wenhuach21 committed 2 years ago
a359222
68138e8
qwen2_bugfix, add adamround vision UT (#281)
WeiweiZhang1 committed 2 years ago
7cfff96
refine eval (#282)
wenhuach21 committed 2 years ago
afa9e26
00122bc
adamround bugfix, refine import (#275)
WeiweiZhang1 committed 2 years ago
a633aa7
98a9c75
fix mutable default value (#272)
wenhuach21 committed 2 years ago
8bf63f3
enable llama3.2-vision model quantization (#269)
WeiweiZhang1 committed 2 years ago
6b99d10
keep the dtype after qdq (#268)
wenhuach21 committed 2 years ago
3a70be8
remove g_idx in gptq format (#267)
wenhuach21 committed 2 years ago
fdfd971
af3db17
Add a warning for improper export formats. (#265)
wenhuach21 committed 2 years ago
be32686
Fix 3bit packing for auto-gptq format (#264)
wenhuach21 committed 2 years ago
6ee91a9
82322ac
refine autoawq exporting code (#261)
wenhuach21 committed 2 years ago
6539d50
update eval and fix example (#260)
n1ck-guo committed 2 years ago
7816eea
enable_qwen2-vl_quantization (#248)
WeiweiZhang1 committed 2 years ago
3275df9
fix preci (#258)
n1ck-guo committed 2 years ago
200fcdd
fix example (#256)
n1ck-guo committed 2 years ago
d8ee1c0
avoid potential bug for auto-gptq 0.8 (#250)
wenhuach21 committed 2 years ago
5dd16fc
support INC API (#255)
WeiweiZhang1 committed 2 years ago
11b99d2
remove unused log (#252)
n1ck-guo committed 2 years ago
9b55ce5
98c4656
b698213
fix example bug (#245)
n1ck-guo committed 2 years ago
0d60ad2
78c1cea