A high-performance inference engine for AI models
enum QuantizationMode : uint32_t { U4 = 0, I8 = 1, U8 = 2, U2 = 3, };