A high-performance inference engine for AI models
Commits on main
Unify token ids to be u32 in both embedding lookup and sampling (#616)
2d8cd6f uuuvn committed 4 months ago
Metal DSL: support function constants in host-side dispatch expressions (#608)
0fc632a CCYeh committed 4 months ago