Skip to content

PTQ-Level Efficiency, QAT-Level Accuracy | 训练后量化的效率,量化感知训练的精度

Fix dataset and batch_size not taking effect in CLI (#2102)

Wang, Chang212c8bda43f1
diff --git a/auto_round/autoround.py b/auto_round/autoround.py
index 2b67300de..3bb20e274 100644
--- a/auto_round/autoround.py
+++ b/auto_round/autoround.py
@@ -244,8 +244,10 @@ class AutoRound:
seed=seed,
low_cpu_mem_usage=low_cpu_mem_usage,
layer_config=layer_config,
+ dataset=dataset,
nsamples=nsamples,
seqlen=seqlen,
+ batch_size=batch_size,
**entry_kwargs,
)