---
id: "/model-training/pretraining/"
title: "Pretraining: 2 curated resources"
creator: null
creator_url: null
url: "https://skillissue.dev/model-training/pretraining/"
level: null
level_max: null
category: null
subcategory: null
region: null
license: null
license_scope: null
models: null
source_date: null
date_added: null
---

# Pretraining: 2 curated resources

Curated material on pretraining within model training.

[Beginner](/model-training/beginner/index.md) [Intermediate](/model-training/intermediate/index.md) [Advanced](/model-training/advanced/index.md) [Expert](/model-training/expert/index.md)

2 resources · page 1 of 1

- 

### [nanochat](/model-training/pretraining/andrej-karpathy-nanochat/index.md)

by [Andrej Karpathy](https://github.com/karpathy/nanochat)

A compact training harness spanning the model-development lifecycle.

Expert · West · open resource · en

- 

### [The Smol Training Playbook](/model-training/pretraining/hugging-face-the-smol-training-playbook/index.md)

by [Hugging Face (SmolLM team)](https://huggingfacetb-smol-training-playbook.hf.space/)

A training account that includes failed experiments and engineering decisions.

Expert · other · closed resource · en

[Plain-text Markdown copy](/model-training/pretraining/index.md)