Pretraining: 2 curated resources
Curated material on pretraining within model training.
2 resources · page 1 of 1
nanochat
A compact training harness spanning the model-development lifecycle.
The Smol Training Playbook
A training account that includes failed experiments and engineering decisions.