---
id: "/model-training/"
title: "Model Training"
creator: null
creator_url: null
url: "https://skillissue.dev/model-training/"
level: null
level_max: null
category: null
subcategory: null
region: null
license: null
license_scope: null
models: null
source_date: null
date_added: null
---

# Model Training

Study the data, algorithms and infrastructure used to change model weights.

- [Pretraining](/model-training/pretraining/index.md) (2)

- [Training Data](/model-training/training-data/index.md) (1)

- [Post Training Rl](/model-training/post-training-rl/index.md) (5)

- [Fine Tuning](/model-training/fine-tuning/index.md) (2)

- [Training Infrastructure](/model-training/training-infrastructure/index.md) (1)

[Beginner](/model-training/beginner/index.md) [Intermediate](/model-training/intermediate/index.md) [Advanced](/model-training/advanced/index.md) [Expert](/model-training/expert/index.md)

11 resources · page 1 of 1

- 

### [LlamaFactory](/model-training/fine-tuning/hiyouga-llamafactory/index.md)

by [hiyouga (Yaowei Zheng) et al.](https://github.com/hiyouga/LlamaFactory)

Compare adaptation methods within a shared training interface.

Advanced · CN · open resource · en

- 

### [TRL - Transformers Reinforcement Learning](/model-training/post-training-rl/hugging-face-trl-transformers-reinforcement-learning/index.md)

by [Hugging Face](https://huggingface.co/docs/trl/index)

Find training interfaces for supervised and preference-based adaptation.

Advanced · other · closed resource · en

- 

### [Reinforcement Learning from Human Feedback (book)](/model-training/post-training-rl/nathan-lambert-reinforcement-learning-from-human-feedback/index.md)

by [Nathan Lambert](https://rlhfbook.com/)

A conceptual path through reward modeling and post-training methods.

Advanced · West · closed resource · en

- 

### [Controlling Reasoning Effort in LLMs (Ahead of AI)](/model-training/post-training-rl/sebastian-raschka-ahead-of-ai/index.md)

by [Sebastian Raschka](https://magazine.sebastianraschka.com/p/controlling-reasoning-effort-in-llms)

A free Ahead of AI article on training controllable reasoning effort.

Advanced · West · closed resource · en

- 

### [Unsloth](/model-training/fine-tuning/unsloth-unsloth/index.md)

by [Unsloth](https://github.com/unslothai/unsloth)

Study local training and adaptation workflows for supported models.

Advanced · West · open resource · en

- 

### [nanochat](/model-training/pretraining/andrej-karpathy-nanochat/index.md)

by [Andrej Karpathy](https://github.com/karpathy/nanochat)

A compact training harness spanning the model-development lifecycle.

Expert · West · open resource · en

- 

### [DeepSeek-R1: Incentivizing Reasoning via RL (arXiv 2501.12948)](/model-training/post-training-rl/deepseek-deepseek-r1-incentivizing-reasoning-via-rl/index.md)

by [DeepSeek](https://arxiv.org/abs/2501.12948)

Study the reported reinforcement-learning recipe behind DeepSeek-R1.

Expert · CN · closed resource · en

- 

### [The Smol Training Playbook](/model-training/pretraining/hugging-face-the-smol-training-playbook/index.md)

by [Hugging Face (SmolLM team)](https://huggingfacetb-smol-training-playbook.hf.space/)

A training account that includes failed experiments and engineering decisions.

Expert · other · closed resource · en

- 

### [The Ultra-Scale Playbook](/model-training/training-infrastructure/hugging-face-the-ultra-scale-playbook/index.md)

by [Hugging Face (nanotron)](https://nanotron-ultrascale-playbook.static.hf.space/index.html)

Understand how parallelism changes memory use and training throughput.

Expert · other · closed resource · en

- 

### [The FineWeb Datasets](/model-training/training-data/huggingface-fineweb/index.md)

by [Guilherme Penedo and coauthors, Hugging Face](https://arxiv.org/abs/2406.17557)

Study how filtering and deduplication affect pretraining data.

Expert · other · open resource · en

- 

### [verl (HybridFlow)](/model-training/post-training-rl/verl-project-verl/index.md)

by [verl project (originated at ByteDance Seed)](https://github.com/verl-project/verl)

Explore how an RL training framework coordinates generation and optimization.

Expert · CN · open resource · en

[Plain-text Markdown copy](/model-training/index.md)