A high-performance inference engine for AI models
Commits on main
Add shared-Gumbel noise to the Weaver final pruning score (#870)
ea3ca0b Maksim Nakhodnov committed 1 month ago
Use BF16 logits for DFlash readout and remove widened output (#859)
5df8196 Chen-Chen Yeh committed 1 month ago
chat: keep tool-call parameter text verbatim, type it by the schema (#850)
ff5b25e ry2009 committed 1 month ago
feat(cli): support tool context in benchmark tasks (#849)
660a1c3 Artur Mullakhmetov committed 1 month ago