A high-performance inference engine for AI models
enum EmbeddingTableKind : uint32_t { Dense = 0, Quantized = 1, D4S4 = 2, };