Skip to content

Automation foundation model for tiny devices: 2-bit, 8-29 MB, tool calls, ASR, structured extraction and embeddings on phones, wearables, smart homes, robots, cars and microcontrollers.

Commits on main

Tool call refactor
HenryNdubuaku committed 8 months ago
e1c1468
Merge pull request #4 from cactus-compute/tools
Henry Ndubuaku committed 8 months ago
a01d2e4
fix tool calls
HenryNdubuaku committed 8 months ago
e36b1f1
tool call
HenryNdubuaku committed 8 months ago
9bc4abf
first push
HenryNdubuaku committed 8 months ago
8132d76
dataset
HenryNdubuaku committed 8 months ago
2bb8325
tools dataset creation
HenryNdubuaku committed 8 months ago
e25f51d
Add xlam dataset convert/upload scripts
justinl66 committed 8 months ago
3a04965
training bugs
HenryNdubuaku committed 8 months ago
5d12388
Merge pull request #2 from cactus-compute/fixed-mrl
Henry Ndubuaku committed 8 months ago
9fbe8b4
updated baseline results
Noah Cylich committed 8 months ago
8648e0e
fixed small bugs
Noah Cylich committed 8 months ago
65bc80f
Merge branch 'main' into fixed-mrl
Noah Cylich committed 8 months ago
7d8f27d
4965912
1 additional ablation
Noah Cylich committed 8 months ago
c509657
Merge remote-tracking branch 'origin/main'
Karen Mosoyan committed 8 months ago
35da450
more planning
Karen Mosoyan committed 8 months ago
8db045b
updates
HenryNdubuaku committed 8 months ago
56d051e
proper matryoshka and results
Noah Cylich committed 8 months ago
cbc3805
added post and pretraining docs
Karen Mosoyan committed 8 months ago
4ca75ed
proper matryoshka FFN splitting
Noah Cylich committed 8 months ago
58cc69e
28ed015
adding speech val ppl to metrics
Noah Cylich committed 8 months ago
77d9404
Add speech
HenryNdubuaku committed 8 months ago
56e88e1
bugfix
HenryNdubuaku committed 8 months ago
ea24010
optimise
HenryNdubuaku committed 8 months ago
af75c4b
optimise
HenryNdubuaku committed 8 months ago
73e4f46
needle cleanup
HenryNdubuaku committed 8 months ago
a20cb7b
updates
HenryNdubuaku committed 8 months ago
c53580f
updates
HenryNdubuaku committed 8 months ago
10b69b3