PTQ-Level Efficiency, QAT-Level Accuracy | 训练后量化的效率,量化感知训练的精度
update readme
wenhuach21212119ab71da
diff --git a/README.md b/README.mdindex 382aa1c18..7549cd850 100644--- a/README.md+++ b/README.md@@ -30,17 +30,12 @@ output_dir = "/PATH/TO/SAVE/COMPRESSED/MODEL/"autoround.export_to_itrex(output_dir=output_dir)# then follow itrex to run the model https://github.com/intel/intel-extension-for-transformers/tree/main/intel_extension_for_transformers/llm/runtime/graph--## export to autogptq for gpu deployment## please install auto-gptq https://github.com/AutoGPTQ/AutoGPTQ# output_dir = "/PATH/TO/SAVE/COMPRESSED/MODEL/"# autoround.export_to_autogptq(output_dir, use_triton=True) ## Utilizing Triton for 2-bit and 4-bit scenarios## then follow autogptq to load the model---```### Detailed Hyperparameters- `model`: The PyTorch model to be quantized.