A computer, compiled into the weights of a language model. An exact CPU inside Qwen3.5-4B, with Gated DeltaNet state as RAM.
Commits on main
RISC-V model is now the main Qwenputer on HF (CHIP-8 moved to -CHIP8); sync experimental/riscv to rv-p3b c94709a (executor in generation, batching, exact /)
b25289b Divyansh Agrawal committed 1 month ago
README: MMLU 71.9 vs 71.7 for base (99% identical answers, KL 7e-4)
6ee6f97 Divyansh Agrawal committed 1 month ago
Sync q35-int 496d591 (fraction printing, release checks); running.md cleaned for publication
652ef65 Divyansh Agrawal committed 1 month ago
README: Usage heading; lead with GDN-as-RAM; first person for our own evaluation notes
de8f4d5 Divyansh Agrawal committed 1 month ago
README: objective framing for the Gated DeltaNet section
302cd84 Divyansh Agrawal committed 1 month ago
README: frame the memory section as 'we use Gated DeltaNet as RAM'
4ba82b7 Divyansh Agrawal committed 1 month ago
README: Gated DeltaNet as RAM, with figure (docs/gdn-ram.png, docs/figures/gdn_ram.py)
f4dbc0a Divyansh Agrawal committed 1 month ago
Banner: larger title, raised and aligned with the diagram
ea3aaa7 Divyansh Agrawal committed 1 month ago
Qwenputer: a computer, compiled into the weights of a language model
46ae3d5 Divyansh Agrawal committed 1 month ago