A straightforward method for training your LLM, from downloading data to generating text.
| Name | Last commit message | Last commit date |
|---|---|---|
| .. | ||
| __init__.py 866 B | ||
| attention.py 8.2 KB | ||
| block.py 1.7 KB | ||
| config.py 4.9 KB | ||
| kv_cache.py 2.5 KB | ||
| mlp.py 1.1 KB | ||
| model.py 9.3 KB | ||
| moe.py 3.1 KB | ||
| norm.py 1011 B | ||
| rope.py 1.9 KB | ||