Repository navigation

Commits

Commits on May 17, 2026
- just save one snapshot
  dsnsgithub
  committed
  4add76d
- move zero grad to the top of the training loop
  dsnsgithub
  committed
  28a909c
- label input/expected tokens variable
  dsnsgithub
  committed
  7da2df7
- reduce learning rate
  dsnsgithub
  committed
  0fdeaa8
- use better entropy test
  dsnsgithub
  committed
  80418e7
- replace view with reshape
  dsnsgithub
  committed
  0e38678
- use reshape instead of transpose
  dsnsgithub
  committed
  f31c5ff
- explain each part of attention in more detail
  dsnsgithub
  committed
  6616081
- add multi-head attention
  dsnsgithub
  committed
  690a4dd
- rename i to step
  dsnsgithub
  committed
  9c6d15b
- save on individual steps
  dsnsgithub
  committed
  72bf4e0
Commits on May 13, 2026
- trained on 2 million stories, 3 epochs
  dsnsgithub
  committed
  1bac3ee
Commits on May 10, 2026
- trained model-cuda.pth
  dsnsgithub
  committed
  74b5b6a
- use cuda 12.8 for rtx 6000 support
  dsnsgithub
  committed
  b3dd82e
Commits on May 7, 2026
- use 3 epoch max
  dsnsgithub
  committed
  968e3a8
- add temp and similarity weight
  dsnsgithub
  committed
  4015656
- try custom loss with similarity score
  dsnsgithub
  committed
  e464deb
- update epoch numbers to be from 1-5
  dsnsgithub
  committed
  7c84958
- add step for better progress display
  dsnsgithub
  committed
  0c19df6
- update cuda model
  dsnsgithub
  committed
  862fd6d
- Refine README.md for clarity and conciseness
  dsnsgithub
  authored
  23e53cc
- Refine README content and remove duplication
  dsnsgithub
  authored
  1e910f7
- Update project name, version, and description
  dsnsgithub
  authored
  587f015
- Name project Mango LLM and enhance README
  dsnsgithub
  authored
  49b0db9
- Update README formatting and clarify sections
  dsnsgithub
  authored
  25bd173
- Clarify CUDA support and old directory description
  dsnsgithub
  authored
  789d1c3
- Update goal statement for clarity and detail
  dsnsgithub
  authored
  82d7e4f
- Update README to clarify AI assistance in code
  dsnsgithub
  authored
  642910c
- go back down to 50,000
  dsnsgithub
  committed
  ef5584c
- Update dataset placement instructions in README
  dsnsgithub
  authored
  6abf180
Commits on May 5, 2026
- filter dataset stories
  dsnsgithub
  committed
  ac0eb30
- increase dataset size
  dsnsgithub
  committed
  c96f652
- bring it down to 128 embedding dimensions
  dsnsgithub
  committed
  13eaedf
- save entire model, bump embedding dimensions to 256
  dsnsgithub
  committed
  d843405
Commits on May 4, 2026
- use dataloader for future speedups
  dsnsgithub
  committed
  7ece650

Branch selector

User selector

Datepicker

Commit history

Commits on May 17, 2026

Commits on May 13, 2026

Commits on May 10, 2026

Commits on May 7, 2026

Commits on May 5, 2026

Commits on May 4, 2026