Repository navigation

Commits

Commits on Apr 20, 2026
- fix training
  kyegomez
  committed
  eae0f04
- [bugf][act-halting][gate halted positions from weight accumulation][bugf][moe-router-bias][stop
  kyegomez
  committed
  289981b
- [improvement][loguru-logging][replace print with loguru in training script][feat][ckpt-logging][add checkpoint start and success log events][docs][readme-optimizer][remove muon optimizer
  kyegomez
  committed< 10000 /span>
  7ba6907
- [fix][rope Every decode token was stuck at position 0, so <q_decoded, k_cached> lost the (n - m) term entirely]
  kyegomez
  committed
  18cca89
- just use adam for now in training maybe add muon later
  kyegomez
  committed
  537b116
- readme
  kyegomez
  committed
  137cd88
- readme
  kyegomez
  committed
  f37d405
- readme
  kyegomez
  committed
  ef2cac6
- [docs][readme-badges][add pypi twitter github badges to
  kyegomez
  committed
  12f6c5b
- [feat][training-script][add 3b fineweb-edu training
  kyegomez
  committed
  5ffb897
- use gpt-oss tokenizer because it's a great tokenizer
  kyegomez
  committed
  97bc414
- [feat][dropout][add dropout to config attn and
  kyegomez
  committed
  5cfef74
- Update README.md
  kyegomez
  authored
  0623ceb
- [Update variants with parameter count equation]
  kyegomez
  committed
  a825ba2
- more references fix
  kyegomez
  committed
  f00d10b
Commits on Apr 19, 2026
- clean up
  kyegomez
  committed
  e522ecf
- format
  kyegomez
  committed
  1c54259
- variants
  kyegomez
  committed
  9cce1c1
- pip and readme
  kyegomez
  committed
  299a0cd
- [bugf][lora-b-init][fix zero-init B making adapter always output zero][bugf][lti-get-a][fix 0 times
  kyegomez
  committed
  806a8da
- disclaimer and rope tests
  kyegomez
  committed
  53f786a
- installation
  kyegomez
  committed
  14a806c
- cleanup
  kyegomez
  committed
  7abd3e5
- readme
  kyegomez
  committed
  0818bf8
- [DOCS] [LICENSE]
  kyegomez
  committed
  fb2939b
Commits on Apr 18, 2026
- tests
  kyegomez
  committed
  0699c00
- example .py
  kyegomez
  committed
  c258cdc
- [FEAT][Main.py]
  kyegomez
  committed
  7916266
- moe
  kyegomez
  committed
  4ce503f
- paper
  kyegomez
  committed
  79b916d
- reference
  kyegomez
  committed
  4aea9d9
- Initial commit
  kyegomez
  authored
  8fa7022

Branch selector

User selector

Datepicker

Commit history

Commits on Apr 20, 2026

Commits on Apr 19, 2026

Commits on Apr 18, 2026