Skip to content

A straightforward method for training your LLM, from downloading data to generating text.

Commits on main

fecb635
b6d12a5
f3524df
c2e20f3
Merge pull request #9 from konglingfan/main
Fareed Khan committed 1 year ago
15fe516
Update generate_text.py to use config[]
lingfank committed 1 year ago
0fbf878
Simple SFT RLHF Guide
Fareed Khan committed 1 year ago
163ba68
f7e9aee
Update README.md
Schleiferdyne Systems committed 1 year ago
9cdfe80
Update attention.py
TianyiQ committed 1 year ago
9acf1f3
99358bd
Revert "Fix attention scaling factor"
Fareed Khan committed 1 year ago
8e1fbb7
Merge pull request #3 from TianyiQ/main
Fareed Khan committed 1 year ago
e90143b
chore: reduce model depth
Tianyi (Alex) Qiu committed 1 year ago
55949c9
chore: restore original model size
Tianyi (Alex) Qiu committed 1 year ago
0ee6461
fix: moving tensors to cuda in evaluation
Tianyi (Alex) Qiu committed 1 year ago
5b22ab7
fix: robustly moving model to cuda
Tianyi (Alex) Qiu committed 1 year ago
c546347
chore: add eval progress bar
Tianyi (Alex) Qiu committed 1 year ago
f59754b
fix: ensure entire model is on same device
Tianyi (Alex) Qiu committed 1 year ago
a4e2f60
chore: change device to cuda
Tianyi (Alex) Qiu committed 1 year ago
1148c72
fix: evaluate pass parameters
Tianyi (Alex) Qiu committed 1 year ago
91573b9
fix: broken computational graph
Tianyi (Alex) Qiu committed 1 year ago
77cc348