Skip to content

PTQ-Level Efficiency, QAT-Level Accuracy | 训练后量化的效率,量化感知训练的精度

add cogvlm recipe and refine readme (#340)

WeiweiZhang18021793684a4
diff --git a/README.md b/README.md
index f7af87f5e..9ea91e90c 100644
--- a/README.md
+++ b/README.md
@@ -312,6 +312,7 @@ release most of the models ourselves.
Model | Supported |
|----------------------------------------|---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+| THUDM/cogvlm2-llama3-chinese-chat-19B | [recipe](./docs/cogvlm2-llama3-chat-19B_sym.md) |
| Qwen/Qwen2-VL-Instruct | [recipe](./docs/Qwen2-VL-7B-Instruct_sym.md) |
| meta-llama/Llama-3.2-11B-Vision | [recipe](./docs/Llama-3.2-11B-Vision-Instruct_sym.md) |
| microsoft/Phi-3.5-vision-instruct | [recipe](./docs/Phi-3.5-vision-instruct_sym.md) |
diff --git a/auto_round/mllm/README.md b/auto_round/mllm/README.md
index 799cef644..80078715d 100644
--- a/auto_round/mllm/README.md
+++ b/auto_round/mllm/README.md
@@ -116,7 +116,7 @@ Processor is callback interface for calling different processors, such as texts
-## Inference for Models
+## Inference
For the AutoRound format, please add the following code at the beginning of the original model's inference code.
```python
@@ -125,10 +125,11 @@ from auto_round import AutoRoundConfig ## must import for auto-round format
For more details on quantization, inference, evaluation, and environment, see the following recipe:
-- [Qwen2-VL-Instruct](../../docs/Qwen2-VL-7B-Instruct_sym.md)
+- [Qwen2-VL-7B-Instruct](../../docs/Qwen2-VL-7B-Instruct_sym.md)
- [Llama-3.2-11B-Vision](../../docs/Llama-3.2-11B-Vision-Instruct_sym.md)
- [Phi-3.5-vision-instruct](../../docs/Phi-3.5-vision-instruct_sym.md)
- [llava-v1.5-7b](../../docs/llava-v1.5-7b_sym.md)
+- [cogvlm2-llama3-chat-19B](../../docs/cogvlm2-llama3-chat-19B_sym.md)