Repository navigation

Commits

Commits on Mar 29, 2022
- feat : custom final ln
  borisdayma
  committed
  c972c34
Commits on Mar 28, 2022
- style: lint
  borisdayma
  committed
  34c02c9
- feat: no sinkformer by default
  borisdayma
  committed
  bb5036a
- feat: support preln
  borisdayma
  committed
  a2c06f2
- feat: implement sinkformer
  borisdayma
  committed
  72efe4b
- feat: add dot_product_attention_weight
  borisdayma
  committed
  8878ae8
- feat: placeholders for more config
  borisdayma
  committed
  69bcbeb
- feat: add mini_glu config
  borisdayma
  committed
  a7e5050
- feat: force final ln in encoder
  borisdayma
  committed
  32f4ba5
- feat: allow more configurations
  borisdayma
  committed
  5bd4c20
- fix: DeepNet doesn't scale weights of embedding/output layers (#150)
  shumingma
  authored
  503d6b4
Commits on Mar 27, 2022
- feat: remove unecessary LN
  borisdayma
  committed
  02824a7
Commits on Mar 25, 2022
- feat: update mini config
  borisdayma
  committed
  d9a16f2
- feat: add cogview
  borisdayma
  committed
  472c4cc
- fix(textnormalizer): consider utf8 on windows (#148)
  illtellyoulater
  authored
  3b8d8cb
Commits on Mar 24, 2022
- feat: implement transformer variants (#144)
  borisdayma
  authored
  542378c
Commits on Mar 19, 2022
- feat(train): log norm and histograms (#143)
  borisdayma
  authored
  b7b619a
Commits on Mar 17, 2022
- feat(data): super conditioning (#141)
  borisdayma
  authored
  7939874
Commits on Mar 14, 2022
- feat: support pod (#139)
  borisdayma
  authored
  803ccbf
Commits on Feb 23, 2022
- fix: no gradient checkpointing for new model
  borisdayma
  committed
  2e02683
- feat: no gradient checkpointing for params init
  borisdayma
  committed
  b798ed3
- feat: update configs
  borisdayma
  committed
  79557f9
- feat(dev): require datasets
  borisdayma
  committed
  3d64598
- fix(train): consider schedule offset
  borisdayma
  committed
  bc4734f
- feat(train): local jax cache
  borisdayma
  committed
  9f5e879
- feat: add bucket reference to artifact
  borisdayma
  committed
  d368fb6
Commits on Feb 22, 2022
- style: lint
  borisdayma
  committed
  d5d442a
- feat: handle gradient checkpointing
  borisdayma
  committed
  5173ec7
- feat: load from bucket
  borisdayma
  committed
  1c4e839
- feat(train): save to bucket
  borisdayma
  committed
  50498e6
- feat: reduce artifact space + offset step
  borisdayma
  committed
  34cf91c
Commits on Feb 21, 2022
- feat(demo): update reference
  borisdayma
  committed
  e558000
- feat: restore weights on CPU
  borisdayma
  committed
  5f954fc
- feat(train): simplify tokenizer loading
  borisdayma
  committed
  4cb21dd
Commits on Feb 10, 2022
- doc: update README
  borisdayma
  committed
  db5a22a

Branch selector

User selector

Datepicker

Commit history

Commits on Mar 29, 2022

Commits on Mar 28, 2022

Commits on Mar 27, 2022

Commits on Mar 25, 2022

Commits on Mar 24, 2022

Commits on Mar 19, 2022

Commits on Mar 17, 2022

Commits on Mar 14, 2022

Commits on Feb 23, 2022

Commits on Feb 22, 2022

Commits on Feb 21, 2022

Commits on Feb 10, 2022