Skip to content

PTQ-Level Efficiency, QAT-Level Accuracy | 训练后量化的效率,量化感知训练的精度

fix a bug in example (#40)

wenhuach21822749fb4f7e
diff --git a/examples/language-modeling/main_customized_data.py b/examples/language-modeling/main_customized_data.py
index 608e03a61..798894aa0 100644
--- a/examples/language-modeling/main_customized_data.py
+++ b/examples/language-modeling/main_customized_data.py
@@ -243,7 +243,7 @@ if __name__ == '__main__':
print(
f"{n} will not be quantized due to its shape not being divisible by 32, resulting in an exporting issue to autogptq")
- data = customized_data(tokenizer, args.seqlen)
+ data = customized_data()
autoround = round(model, tokenizer, args.bits, args.group_size, dataloader=data, sym=args.sym,
batch_size=args.train_bs,