Skip to content

PTQ-Level Efficiency, QAT-Level Accuracy | 训练后量化的效率,量化感知训练的精度

fix incorrect recipe data (#471)

WeiweiZhang1002ca16dcfc3
diff --git a/README.md b/README.md
index 200a4110f..31b4cb4a8 100644
--- a/README.md
+++ b/README.md
@@ -126,30 +126,17 @@ auto-round-fast \
</details>
<br>
-#### Auto-Round Recipe Results
-In conclusion, we recommend using auto-round for INT4 and auto-round-best for INT2. However, you may adjust the configuration to suit your specific requirements and available resources.
+In conclusion, we recommend using **auto-round for INT4 and auto-round-best for INT2**. However, you may adjust the configuration to suit your specific requirements and available resources.
-- Average Accuracy of 13 tasks(W4G128) and Time Cost(enable_torch_compile) Results
+Average Accuracy of 13 tasks(W4G128) and Time Cost(enable_torch_compile) Results
- | Model | Qwen2.5-0.5B-Instruct | Falcon3-3B | Qwen2.5-7B-Instruct | Falcon3-10B | Qwen2.5-72B-Instruct |
- |---------|-----------------------|----------------------|---------------------|----------------------|-----------------------|
- | 16bits | 0.5541 | 0.6614 | 0.6470 | 0.6151 | 0.7229 |
- | Best | **0.5675**(7m) | **0.6638**(23m) | 0.6426(58m) | **0.6092**(81m) | 0.7242(575m) |
- | Default | 0.5659(2m) | 0.6496(6m) | 0.6441(13m) | 0.6080(18m) | **0.7252**(118m) |
- | Light | 0.5564(2m) | 0.6433(3m) | **0.6453**(5m) | 0.6063(6m) | 0.7243(37m) |
+| Model | Qwen2.5-0.5B-Instruct | Falcon3-3B | Qwen2.5-7B-Instruct | Falcon3-10B | Qwen2.5-72B-Instruct |
+|---------|-----------------------|----------------------|---------------------|----------------------|-----------------------|
+| 16bits | 0.4192 | 0.5203 | 0.6470 | 0.6151 | 0.7229 |
+| Best | **0.4137**(7m) | **0.5142**(23m) | 0.6426(58m) | **0.6092**(81m) | 0.7242(575m) |
+| Default | 0.4129(2m) | 0.5133(6m) | 0.6441(13m) | 0.6080(18m) | **0.7252**(118m) |
+| Light | 0.4052(2m) | 0.5108(3m) | **0.6453**(5m) | 0.6063(6m) | 0.7243(37m) |
- <details>
- <summary>W2G64 quantization Results</summary>
-
- - Average Accuracy of 13 tasks(W2G64) and Time Cost(enable_torch_compile) Results
-
- | Model | Qwen2.5-0.5B-Instruct | Falcon3-3B | Qwen2.5-7B-Instruct | Falcon3-10B | Qwen2.5-72B-Instruct |
- |---------|-----------------------|----------------------|---------------------|----------------------|-----------------------|
- | 16bits | 0.5541 | 0.6614 | 0.6470 | 0.6151 | 0.7229 |
- | Best | **0.3794**(6m) | **0.5272**(24m) | **0.6097**(56m)| **0.6066**(79m) | **0.7201**(564m) |
- | Default | 0.3762(2m) | 0.5232(6m) | 0.6004(13m) | 0.5972(18m) | 0.7143(122m) |
- | Light | 0.3540(2m) | 0.5041(3m) | 0.5532(5m) | 0.5716(7m) | 0.7089(38m) |
- </details>
<br>
@@ -463,3 +450,4 @@ If you find AutoRound useful for your research, please cite our paper:
+