PTQ-Level Efficiency, QAT-Level Accuracy | 训练后量化的效率,量化感知训练的精度
Fix dataset and batch_size not taking effect in CLI (#2102)
Wang, Chang212c8bda43f1
diff --git a/auto_round/autoround.py b/auto_round/autoround.pyindex 2b67300de..3bb20e274 100644--- a/auto_round/autoround.py+++ b/auto_round/autoround.py@@ -244,8 +244,10 @@ class AutoRound:seed=seed,low_cpu_mem_usage=low_cpu_mem_usage,layer_config=layer_config,+ dataset=dataset,nsamples=nsamples,seqlen=seqlen,+ batch_size=batch_size,**entry_kwargs,)