Skip to content

PTQ-Level Efficiency, QAT-Level Accuracy | 训练后量化的效率,量化感知训练的精度

Commits on main

update readme (#550)
Wenhua Cheng committed 1 year ago
59cf22e
c6155fd
fix_quantization_config_for_inference (#542)
WeiweiZhang1 committed 1 year ago
7657640
freeze pytorch & ipex version in CI (#541)
Sun, Xuehao committed 1 year ago
784273e
bump version into v0.5.1 (#540)
Sun, Xuehao committed 1 year ago
336ef66
d6d6dad
bump version into v0.5.0 (#538)
Sun, Xuehao committed 1 year ago
88e6e3b
fix cuda ut (#537)
Heng Guo committed 1 year ago
eee1752
refine readme (#536)
WeiweiZhang1 committed 1 year ago
3f42edd
update readme (#531)
Wenhua Cheng committed 1 year ago
87579ef
fix inference issue (#529)
Wenhua Cheng committed 1 year ago
322ad6e
fix bug of cuda ut (#532)
Heng Guo committed 1 year ago
03f3dcd
update mllm readme (#530)
WeiweiZhang1 committed 1 year ago
5e18368
add backend readme (#528)
Wenhua Cheng committed 1 year ago
c62cd0f
fix typos, add model card link for VLMs (#527)
WeiweiZhang1 committed 1 year ago
45df79c
fix light config (#526)
WeiweiZhang1 committed 1 year ago
796f332
rm fp16 export in autoround format (#525)
Wenhua Cheng committed 1 year ago
5d82266
fix examples model_dtype (#523)
WeiweiZhang1 committed 1 year ago
530bde9
471dae8
patch for vlm (#518)
Heng Guo committed 1 year ago
f3f017a
add regex support in layer_config setting (#519)
Wenhua Cheng committed 1 year ago
d286538
fix bs!=1 for gemma and MiniMax-Text-01 (#515)
Wenhua Cheng committed 1 year ago
23cd60d
move gguf-dq test to cuda (#520)
Heng Guo committed 1 year ago
3774f93
support for more vlms (#390)
Heng Guo committed 1 year ago
9c7a443
add group_size divisible check in backend (#512)
Wenhua Cheng committed 1 year ago
f55cde9
Update requirements-lib.txt (#513)
Yi Liu committed 1 year ago
c480e83
ee890b2
support rtn via iters==0 (#510)
Wenhua Cheng committed 1 year ago
58ca583
fix setup issue on cuda machine (#511)
Wenhua Cheng committed 1 year ago
5801ee9