Skip to content

PTQ-Level Efficiency, QAT-Level Accuracy | 训练后量化的效率,量化感知训练的精度

tiny change

wenhuach21b3c4ea1c40f9
diff --git a/README.md b/README.md
index 2f63a61ca..7ac464011 100644
--- a/README.md
+++ b/README.md
@@ -121,10 +121,10 @@ Random issues in tuning Qwen models. ChatGlm-V1 is not supported
| W4G128 | MMLU | Lamb. | Hella. | Wino. | Piqa | Truth. | Open. | Boolq | RTE | ARC-e | ARC-c. | AVG. |
|-------------------------------------------------|-------|-------|--------|-------|-------|--------|-------|-------|-------|-------|--------|-------|
| mistralai/Mixtral-8x7B-v0.1 BF16 | 69.83 | 78.44 | 64.89 | 76.40 | 82.43 | 34.15 | 35.40 | 84.98 | 71.12 | 84.22 | 56.91 | 67.16 |
-| mistralai/Mixtral-8x7B-v0.1 Signround+ | 68.90 | 78.11 | 64.31 | 74.27 | 82.10 | 30.97 | 34.20 | 84.57 | 67.87 | 83.96 | 56.57 | 65.98 |
-| mistralai/Mixtral-8x7B-v0.1 Signround+ iter800 | 68.84 | 77.99 | 64.18 | 75.30 | 81.82 | 31.21 | 35.80 | 85.41 | 68.95 | 83.75 | 55.38 | 66.24 |
-| microsoft/phi-2 | 56.40 | 62.78 | 55.83 | 75.77 | 78.67 | 31.21 | 40.40 | 83.36 | 62.45 | 80.05 | 52.90 | 61.80 |
-| microsoft/phi-2 Signround+ | 54.57 | 61.32 | 55.04 | 76.48 | 78.89 | 29.74 | 40.60 | 83.24 | 66.43 | 79.76 | 52.30 | 61.67 |
+| mistralai/Mixtral-8x7B-v0.1 AutoRound | 68.90 | 78.11 | 64.31 | 74.27 | 82.10 | 30.97 | 34.20 | 84.57 | 67.87 | 83.96 | 56.57 | 65.98 |
+| mistralai/Mixtral-8x7B-v0.1 AutoRound iter800 | 68.84 | 77.99 | 64.18 | 75.30 | 81.82 | 31.21 | 35.80 | 85.41 | 68.95 | 83.75 | 55.38 | 66.24 |
+| microsoft/phi-2 FP16 | 56.40 | 62.78 | 55.83 | 75.77 | 78.67 | 31.21 | 40.40 | 83.36 | 62.45 | 80.05 | 52.90 | 61.80 |
+| microsoft/phi-2 AutoRound | 54.57 | 61.32 | 55.04 | 76.48 | 78.89 | 29.74 | 40.60 | 83.24 | 66.43 | 79.76 | 52.30 | 61.67 |