LLMs-from-scratch (book code)

by Sebastian Raschka

Read the original →

Follow a GPT implementation rather than treating the model as a black box.

Raschka's companion repository walks through text preparation, attention, pretraining and fine-tuning. The code is freely readable, while the associated book is a separate product.

Level
Intermediate
Models
any
Category
Foundations
Tags
Source date
date not stated
Added
2026-10-18
Last verified
2026-10-18
Status
ok
Prerequisites
Assumes basic LLM familiarity or the ability to read examples and configure a workflow.
Subcategory
from scratch implementations
Region
West
Original language
en
Access
free
Resource reuse
closed: No general open-reuse grant established from the inspected page. Closed is the conservative index bucket, not a legal finding; the resource is publicly readable. Facet definitions

Summary in our own words. Rights remain with the original creator. Credit and correction policy.

Plain-text Markdown copy