Skip to content

PTQ-Level Efficiency, QAT-Level Accuracy | 训练后量化的效率,量化感知训练的精度

bump to v0.4.6 (#449)

Sun, Xuehao1a9205a4167f
diff --git a/README.md b/README.md
index d3bf04e61..7aaf5d2d5 100644
--- a/README.md
+++ b/README.md
@@ -5,7 +5,7 @@ AutoRound
<h3> Advanced Quantization Algorithm for LLMs</h3>
[![python](https://img.shields.io/badge/python-3.9%2B-blue)](https://github.com/intel/auto-round)
-[![version](https://img.shields.io/badge/release-0.4.5-green)](https://github.com/intel/auto-round)
+[![version](https://img.shields.io/badge/release-0.4.6-green)](https://github.com/intel/auto-round)
[![license](https://img.shields.io/badge/license-Apache%202-9C27B0)](https://github.com/intel/auto-round/blob/main/LICENSE)
<a href="https://huggingface.co/OPEA">
<img alt="Model Checkpoints" src="https://img.shields.io/badge/%F0%9F%A4%97%20HF-Models-F57C00">
@@ -236,9 +236,7 @@ adopted within the community, **only 4-bits quantization is supported**.
Testing was conducted on the Nvidia A100 80G using the nightly version of PyTorch 2.6.0.dev20241029+cu124. Please note
that data
-loading and packing costs have been excluded from the evaluation. **We enable torch.compile for Torch 2.6, but not for
-2.5
-due to encountered issues.**
+loading and packing costs have been excluded from the evaluation. **We recommend enabling torch.compile for PyTorch versions 2.6 and above.**
To optimize GPU memory usage, in addition to activating `low_gpu_mem_usage`, you can set `gradient_accumulate_steps=8`
and a
diff --git a/auto_round/version.py b/auto_round/version.py
index 99676214e..100d95bd4 100644
--- a/auto_round/version.py
+++ b/auto_round/version.py
@@ -14,4 +14,4 @@
"""Intel® auto-round: An open-source Python library
supporting popular model weight only compression based on signround."""
-__version__ = "0.4.5"
+__version__ = "0.4.6"