Skip to content

PTQ-Level Efficiency, QAT-Level Accuracy | 训练后量化的效率,量化感知训练的精度

update readme

wenhuach21212119ab71da
diff --git a/README.md b/README.md
index 382aa1c18..7549cd850 100644
--- a/README.md
+++ b/README.md
@@ -30,17 +30,12 @@ output_dir = "/PATH/TO/SAVE/COMPRESSED/MODEL/"
autoround.export_to_itrex(output_dir=output_dir)
# then follow itrex to run the model https://github.com/intel/intel-extension-for-transformers/tree/main/intel_extension_for_transformers/llm/runtime/graph
-
-
## export to autogptq for gpu deployment
## please install auto-gptq https://github.com/AutoGPTQ/AutoGPTQ
# output_dir = "/PATH/TO/SAVE/COMPRESSED/MODEL/"
# autoround.export_to_autogptq(output_dir, use_triton=True) ## Utilizing Triton for 2-bit and 4-bit scenarios
## then follow autogptq to load the model
-
-
-
```
### Detailed Hyperparameters
- `model`: The PyTorch model to be quantized.