A high-performance inference engine for AI models
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| backends | ||
| config | ||
| encodable_block | ||
| engine | ||
| speculators | ||
| utils | ||
| data_type.rs 1.4 KB | ||
| lib.rs 378 B | ||
| safetensors.rs 7.1 KB | ||
| trie.rs 7.3 KB | ||
A high-performance inference engine for AI models
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| backends | ||
| config | ||
| encodable_block | ||
| engine | ||
| speculators | ||
| utils | ||
| data_type.rs 1.4 KB | ||
| lib.rs 378 B | ||
| safetensors.rs 7.1 KB | ||
| trie.rs 7.3 KB | ||