PTQ-Level Efficiency, QAT-Level Accuracy | 训练后量化的效率,量化感知训练的精度
Update document for Qwen Omni quantized models (#1568)
Liang Lv92f0aaa3458d
diff --git a/auto_round/compressors/mllm/README.md b/auto_round/compressors/mllm/README.mdindex c28cc0520..343e5d52a 100644--- a/auto_round/compressors/mllm/README.md+++ b/auto_round/compressors/mllm/README.md@@ -65,6 +65,8 @@ model architecture or kernel limitations.| mistralai/Mistral-Small-3.1 | pile/llava | X | [Mistral-Small-3.1-24B-Instruct-2503-int4-AutoRound-gptq-sym](https://huggingface.co/OPEA/Mistral-Small-3.1-24B-Instruct-2503-int4-AutoRound-gptq-sym), [Mistral-Small-3.1-24B-Instruct-2503-int4-AutoRound-awq-sym](https://huggingface.co/OPEA/Mistral-Small-3.1-24B-Instruct-2503-int4-AutoRound-awq-sym) || moonshotai/Kimi-VL | pile/llava | √ | || Qwen/Qwen2-VL | pile/llava | - | [Qwen2-VL-7B-Instruct-int4-sym](https://huggingface.co/OPEA/Qwen2-VL-7B-Instruct-int4-sym-inc), [Qwen2-VL-72B-Instruct-int4-sym](https://huggingface.co/OPEA/Qwen2-VL-72B-Instruct-int4-sym-inc), [Qwen2-VL-72B-Instruct-int2-sym](https://huggingface.co/OPEA/Qwen2-VL-72B-Instruct-int2-sym-inc) |+| Qwen/Qwen2.5-Omni | pile | √ | [Qwen2.5-Omni-7B](https://huggingface.co/Intel/Qwen2.5-Omni-7B-int4-AutoRound) |+| Qwen/Qwen3-Omni | pile | √ | [Qwen3-Omni-30B-A3B-Instruct](https://huggingface.co/Intel/Qwen3-Omni-30B-A3B-Instruct-int4-AutoRound) || rhymes-ai/Aria | pile/llava | √ | || THUDM/CogVLM2 | pile/llava | √ | [cogvlm2-llama3-chat-19B-int4-sym](https://huggingface.co/OPEA/cogvlm2-llama3-chat-19B-int4-sym-inc), [cogvlm2-llama3-chat-19B-qvision-int4-sym](https://huggingface.co/OPEA/cogvlm2-llama3-chat-19B-qvision-int4-sym-inc) || THUDM/glm-4v | pile | X | [glm-4v-9b-int4-sym](https://huggingface.co/OPEA/glm-4v-9b-int4-sym-inc) |