5 Commits

Author SHA1 Message Date
Kye Gomez
289981ba01 [bugf][act-halting][gate halted positions from weight accumulation][bugf][moe-router-bias][stop
load balance bias gradient leak][bugf][act-cache-consistency][keep all loops with kv
  cache][bugf][lora-depth-extrapolation][clamp scale index beyond max
  loops][improvement][pyproject-version][bump version to 0 4 0]
2026-04-20 09:17:43 -04:00
Kye Gomez
12f6c5b32e [docs][readme-badges][add pypi twitter github badges to
readme][improvement][init-sort][sort imports alphabetically in
  init][improvement][version-bump][bump version to
  0.3.0][feat][tokenizer-class][add MythosTokenizer to init
  exports][feat][test-tokenizer][add tokenizer test suite with printed output]
2026-04-19 23:18:05 -04:00
Kye Gomez
5ffb897dcf [feat][training-script][add 3b fineweb-edu training
script][feat][tokenizer][add MythosTokenizer class with encode
  decode][improvement][deps][add transformers and datasets
  dependencies][docs][readme-training][add training section with run
  commands][improvement][pyproject][pin torch and add new deps]
2026-04-19 22:48:30 -04:00
Kye Gomez
a825ba217f [Update variants with parameter count equation] 2026-04-19 21:55:06 -04:00
Kye Gomez
299a0cdb0a pip and readme 2026-04-19 08:33:09 -04:00