PTQ-Level Efficiency, QAT-Level Accuracy | 训练后量化的效率,量化感知训练的精度
fix a bug in example (#40)
wenhuach21822749fb4f7e
diff --git a/examples/language-modeling/main_customized_data.py b/examples/language-modeling/main_customized_data.pyindex 608e03a61..798894aa0 100644--- a/examples/language-modeling/main_customized_data.py+++ b/examples/language-modeling/main_customized_data.py@@ -243,7 +243,7 @@ if __name__ == '__main__':print(f"{n} will not be quantized due to its shape not being divisible by 32, resulting in an exporting issue to autogptq")- data = customized_data(tokenizer, args.seqlen)+ data = customized_data()autoround = round(model, tokenizer, args.bits, args.group_size, dataloader=data, sym=args.sym,batch_size=args.train_bs,