---
id: "ai-forever-rugpt-training"
title: "ruGPT training and fine-tuning examples"
creator: "SberDevices / ai-forever"
creator_url: "https://github.com/ai-forever/ru-gpts"
creator_x: null
url: "https://github.com/ai-forever/ru-gpts"
level: "advanced"
level_max: null
category: "model-training"
subcategory: "fine-tuning"
region: "RU"
license: "open"
license_scope: "linked-resource"
access: "free"
models: ["rugpt"]
source_date: null
date_added: "2026-10-18"
---

[Model Training](/model-training/index.md)

# ruGPT training and fine-tuning examples

by [SberDevices / ai-forever](https://github.com/ai-forever/ru-gpts)

[Read the original →](https://github.com/ai-forever/ru-gpts)

Inspect Russian-model fine-tuning and pretraining scripts, with explicit warnings about the legacy environment.

The ruGPT repository pairs fine-tuning notebooks with pretraining scripts and the SberDevices team’s training notes. Trace how text files, context length and evaluation enter the workflow. This is a legacy implementation reference, not a current turnkey recipe: dependency pins, external datasets and GPU assumptions must be rechecked. The main README is English despite the Russian-language models.

Level: [Advanced](/levels/index.md#advanced)
Models: rugpt
Category: [Model Training](/model-training/index.md)
Tags: [practical-guide](/tags/practical-guide/index.md)
Source date: date not stated
Added: 2026-10-18
Last verified: 2026-10-18
Status: ok
Prerequisites: Requires experience with transformer training, GPU environments and dependency compatibility to assess and adapt legacy scripts.
Subcategory: [fine tuning](/model-training/fine-tuning/index.md)
Region: RU
Original language: en
Access: free
Resource reuse: open: Repository code carries Apache-2.0. Check individual model and dataset terms separately. [Facet definitions](/about/index.md#facets)

Summary in our own words. Rights remain with the original creator. [Credit and correction policy](/about/index.md#credit-policy).

[Plain-text Markdown copy](/model-training/fine-tuning/ai-forever-rugpt-training/index.md)