PTQ-Level Efficiency, QAT-Level Accuracy | 训练后量化的效率,量化感知训练的精度
Update README.md
Haihao Shenc5d21598d975
diff --git a/README.md b/README.mdindex 32acaaf5f..de9deca4d 100644--- a/README.md+++ b/README.md@@ -10,7 +10,7 @@ AutoRound---<div align="left">-AutoRound is an advanced weight-only quantization algorithm, based on SignRound. It's tailored for a wide range of models and consistently delivers noticeable improvements, often significantly outperforming SignRound with the cost of more tuning time for quantization.+AutoRound is an advanced weight-only quantization algorithm for low-bits LLM inference. It's tailored for a wide range of models and consistently delivers noticeable improvements, often significantly outperforming SignRound with the cost of more tuning time for quantization.## Prerequisites- Python 3.9 or higher@@ -283,7 +283,7 @@ For wikitext2/ptb-new/c4-new ppl, we follow the code of gptq and set the sequenc</tr></table>-We provide a [comparative analysis](docs/README.md) with other methods in our accuracy data section. Notably, our approach has outperformed GPTQ with a score of 30/32 and AWQ with a score of 27/32 across llamv1/llamav2/mistral-7b on W4G-1, W4G128, W3G128, W2G128. And the tuning costs are comparable.+We provide a [comprehensive analysis](docs/README.md) with other methods in our accuracy data section. Notably, our approach has outperformed GPTQ with a score of 30/32 and AWQ with a score of 27/32 across llamv1/llamav2/mistral-7b on W4G-1, W4G128, W3G128, W2G128. And the tuning costs are comparable.## Tips1 Consider increasing tuning steps to achieve better results, albeit with increased tuning time.