Model Training for expert learners
6 resources · page 1 of 1
nanochat
A compact training harness spanning the model-development lifecycle.
DeepSeek-R1: Incentivizing Reasoning via RL (arXiv 2501.12948)
by DeepSeek
Study the reported reinforcement-learning recipe behind DeepSeek-R1.
The Smol Training Playbook
A training account that includes failed experiments and engineering decisions.
The Ultra-Scale Playbook
Understand how parallelism changes memory use and training throughput.
The FineWeb Datasets
by Guilherme Penedo and coauthors, Hugging Face
Study how filtering and deduplication affect pretraining data.
verl (HybridFlow)
by verl project (originated at ByteDance Seed)
Explore how an RL training framework coordinates generation and optimization.