A high-performance inference engine for AI models
Commits on main
Introduce cold pool buffers for benchmarking memory-bound kernel (#537)
4034d56 CCYeh committed 5 months ago
Introduce Metal device tiers and tier-tuned GEMV/QMV dispatch (#529)
6b52bd6 CCYeh committed 5 months ago