---
id: "/model-training/expert/"
title: "Model Training for expert learners"
creator: null
creator_url: null
url: "https://skillissue.dev/model-training/expert/"
level: null
level_max: null
category: null
subcategory: null
region: null
license: null
license_scope: null
models: null
source_date: null
date_added: null
---

# Model Training for expert learners

[Beginner](/model-training/beginner/index.md) [Intermediate](/model-training/intermediate/index.md) [Advanced](/model-training/advanced/index.md) [Expert](/model-training/expert/index.md)

6 resources · page 1 of 1

- 

### [nanochat](/model-training/pretraining/andrej-karpathy-nanochat/index.md)

by [Andrej Karpathy](https://github.com/karpathy/nanochat)

A compact training harness spanning the model-development lifecycle.

Expert · West · open resource · en

- 

### [DeepSeek-R1: Incentivizing Reasoning via RL (arXiv 2501.12948)](/model-training/post-training-rl/deepseek-deepseek-r1-incentivizing-reasoning-via-rl/index.md)

by [DeepSeek](https://arxiv.org/abs/2501.12948)

Study the reported reinforcement-learning recipe behind DeepSeek-R1.

Expert · CN · closed resource · en

- 

### [The Smol Training Playbook](/model-training/pretraining/hugging-face-the-smol-training-playbook/index.md)

by [Hugging Face (SmolLM team)](https://huggingfacetb-smol-training-playbook.hf.space/)

A training account that includes failed experiments and engineering decisions.

Expert · other · closed resource · en

- 

### [The Ultra-Scale Playbook](/model-training/training-infrastructure/hugging-face-the-ultra-scale-playbook/index.md)

by [Hugging Face (nanotron)](https://nanotron-ultrascale-playbook.static.hf.space/index.html)

Understand how parallelism changes memory use and training throughput.

Expert · other · closed resource · en

- 

### [The FineWeb Datasets](/model-training/training-data/huggingface-fineweb/index.md)

by [Guilherme Penedo and coauthors, Hugging Face](https://arxiv.org/abs/2406.17557)

Study how filtering and deduplication affect pretraining data.

Expert · other · open resource · en

- 

### [verl (HybridFlow)](/model-training/post-training-rl/verl-project-verl/index.md)

by [verl project (originated at ByteDance Seed)](https://github.com/verl-project/verl)

Explore how an RL training framework coordinates generation and optimization.

Expert · CN · open resource · en

[Plain-text Markdown copy](/model-training/expert/index.md)