PTQ-Level Efficiency, QAT-Level Accuracy | 训练后量化的效率,量化感知训练的精度
add cogvlm recipe and refine readme (#340)
WeiweiZhang18021793684a4
diff --git a/README.md b/README.mdindex f7af87f5e..9ea91e90c 100644--- a/README.md+++ b/README.md@@ -312,6 +312,7 @@ release most of the models ourselves.Model | Supported ||----------------------------------------|---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|+| THUDM/cogvlm2-llama3-chinese-chat-19B | [recipe](./docs/cogvlm2-llama3-chat-19B_sym.md) || Qwen/Qwen2-VL-Instruct | [recipe](./docs/Qwen2-VL-7B-Instruct_sym.md) || meta-llama/Llama-3.2-11B-Vision | [recipe](./docs/Llama-3.2-11B-Vision-Instruct_sym.md) || microsoft/Phi-3.5-vision-instruct | [recipe](./docs/Phi-3.5-vision-instruct_sym.md) |diff --git a/auto_round/mllm/README.md b/auto_round/mllm/README.mdindex 799cef644..80078715d 100644--- a/auto_round/mllm/README.md+++ b/auto_round/mllm/README.md@@ -116,7 +116,7 @@ Processor is callback interface for calling different processors, such as texts-## Inference for Models+## InferenceFor the AutoRound format, please add the following code at the beginning of the original model's inference code.```python@@ -125,10 +125,11 @@ from auto_round import AutoRoundConfig ## must import for auto-round formatFor more details on quantization, inference, evaluation, and environment, see the following recipe:-- [Qwen2-VL-Instruct](../../docs/Qwen2-VL-7B-Instruct_sym.md)+- [Qwen2-VL-7B-Instruct](../../docs/Qwen2-VL-7B-Instruct_sym.md)- [Llama-3.2-11B-Vision](../../docs/Llama-3.2-11B-Vision-Instruct_sym.md)- [Phi-3.5-vision-instruct](../../docs/Phi-3.5-vision-instruct_sym.md)- [llava-v1.5-7b](../../docs/llava-v1.5-7b_sym.md)+- [cogvlm2-llama3-chat-19B](../../docs/cogvlm2-llama3-chat-19B_sym.md)