---
id: "sebastian-raschka-llms-from-scratch"
title: "LLMs-from-scratch (book code)"
creator: "Sebastian Raschka"
creator_url: "https://github.com/rasbt/LLMs-from-scratch"
url: "https://github.com/rasbt/LLMs-from-scratch"
level: "intermediate"
level_max: null
category: "foundations"
subcategory: "from-scratch-implementations"
region: "West"
license: "closed"
license_scope: "linked-resource"
models: ["any"]
source_date: null
date_added: "2026-10-18"
---

[Foundations](/foundations/index.md)

# LLMs-from-scratch (book code)

by [Sebastian Raschka](https://github.com/rasbt/LLMs-from-scratch)

[Read the original →](https://github.com/rasbt/LLMs-from-scratch)

Follow a GPT implementation rather than treating the model as a black box.

Raschka's companion repository walks through text preparation, attention, pretraining and fine-tuning. The code is freely readable, while the associated book is a separate product.

Level: [Intermediate](/levels/index.md#intermediate)
Models: any
Category: [Foundations](/foundations/index.md)
Tags: 
Source date: date not stated
Added: 2026-10-18
Last verified: 2026-10-18
Status: ok
Prerequisites: Assumes basic LLM familiarity or the ability to read examples and configure a workflow.
Subcategory: [from scratch implementations](/foundations/from-scratch-implementations/index.md)
Region: West
Original language: en
Access: free
Resource reuse: closed: No general open-reuse grant established from the inspected page. Closed is the conservative index bucket, not a legal finding; the resource is publicly readable. [Facet definitions](/about/index.md#facets)

Summary in our own words. Rights remain with the original creator. [Credit and correction policy](/about/index.md#credit-policy).

[Plain-text Markdown copy](/foundations/from-scratch-implementations/sebastian-raschka-llms-from-scratch/index.md)