PTQ-Level Efficiency, QAT-Level Accuracy | 训练后量化的效率,量化感知训练的精度
bump to v0.4.6 (#449)
Sun, Xuehao1a9205a4167f
diff --git a/README.md b/README.mdindex d3bf04e61..7aaf5d2d5 100644--- a/README.md+++ b/README.md@@ -5,7 +5,7 @@ AutoRound<h3> Advanced Quantization Algorithm for LLMs</h3>[](https://github.com/intel/auto-round)-[](https://github.com/intel/auto-round)+[](https://github.com/intel/auto-round)[](https://github.com/intel/auto-round/blob/main/LICENSE)<a href="https://huggingface.co/OPEA"><img alt="Model Checkpoints" src="https://img.shields.io/badge/%F0%9F%A4%97%20HF-Models-F57C00">@@ -236,9 +236,7 @@ adopted within the community, **only 4-bits quantization is supported**.Testing was conducted on the Nvidia A100 80G using the nightly version of PyTorch 2.6.0.dev20241029+cu124. Please notethat data-loading and packing costs have been excluded from the evaluation. **We enable torch.compile for Torch 2.6, but not for-2.5-due to encountered issues.**+loading and packing costs have been excluded from the evaluation. **We recommend enabling torch.compile for PyTorch versions 2.6 and above.**To optimize GPU memory usage, in addition to activating `low_gpu_mem_usage`, you can set `gradient_accumulate_steps=8`and adiff --git a/auto_round/version.py b/auto_round/version.pyindex 99676214e..100d95bd4 100644--- a/auto_round/version.py+++ b/auto_round/version.py@@ -14,4 +14,4 @@"""Intel® auto-round: An open-source Python librarysupporting popular model weight only compression based on signround."""-__version__ = "0.4.5"+__version__ = "0.4.6"