Skip to content

PTQ-Level Efficiency, QAT-Level Accuracy | 训练后量化的效率,量化感知训练的精度

168 B
Raw Blame
llmcompressor @ git+https://github.com/vllm-project/llm-compressor.git@main
compressed-tensors @ git+https://github.com/vllm-project/compressed-tensors.git@main
triton