--- id: "/tags/training-fine-tuning/" title: "Training Fine Tuning" creator: null creator_url: null creator_x: null url: "https://skillissue.dev/tags/training-fine-tuning/" level: null level_max: null category: null subcategory: null region: null license: null license_scope: null access: null models: null source_date: null date_added: null resource_kind: null verification_basis: null access_evidence: null domain_top: null domain_sub: null last_verified: null --- # Training Fine Tuning [Beginner](/levels/beginner/index.md) [Intermediate](/levels/intermediate/index.md) [Advanced](/levels/advanced/index.md) [Expert](/levels/expert/index.md) 16 resources · page 1 of 1 - ### [LLaMA-Factory](/agents/agent-design-patterns/llama-factory/index.md) Creator not supplied; see original source. LLaMA-Factory GitHub repo: unified framework for fine-tuning over 100 LLMs and VLMs. Not applicable (entity) · unknown · unknown resource · zh|en - ### [hiyouga/LlamaFactory](/agents/agent-design-patterns/llama-factory-2/index.md) Creator not supplied; see original source. LlamaFactory GitHub repo (ACL 2024): unified fine-tuning toolkit for over 100 language and vision-language models. Not applicable (entity) · unknown · unknown resource · zh|en - ### [open-instruct (Ai2)](/agents/agent-design-patterns/open-instruct-ai2/index.md) Creator not supplied; see original source. Ai2 open-instruct GitHub repo: post-training codebase for instruction tuning and RL of language models. Not applicable (entity) · unknown · unknown resource · en - ### [Unsloth notebooks](/agents/agent-design-patterns/unsloth-notebooks/index.md) Creator not supplied; see original source. Unsloth notebooks GitHub repo: Colab notebooks for fine-tuning and RL of text, vision and audio models. Not applicable (entity) · unknown · unknown resource · en - ### [Unsloth](/agents/agent-design-patterns/unsloth-repo/index.md) Creator not supplied; see original source. Unsloth GitHub repo: memory-efficient fine-tuning and local running of LLMs. Not applicable (entity) · unknown · unknown resource · en - ### [Axolotl docs](/agents/agent-design-patterns/axolotl-docs/index.md) Creator not supplied; see original source. Axolotl documentation: open-source, config-driven tool for fine-tuning and post-training LLMs. Intermediate · unknown · unknown resource · en - ### [HF smol course](/agents/agent-design-patterns/hf-smol-course/index.md) Creator not supplied; see original source. Hugging Face smol course GitHub repo: practical course on fine-tuning and aligning small language models. Intermediate · unknown · unknown resource · en - ### [PyTorch tutorials](/agents/agent-design-patterns/pytorch-tutorials/index.md) Creator not supplied; see original source. Official PyTorch tutorials covering basics, training, deployment and performance, with runnable code. Intermediate · unknown · unknown resource · en - ### [RLHF Book (Nathan Lambert)](/agents/agent-design-patterns/rlhf-book-nathan-lambert/index.md) Creator not supplied; see original source. Nathan Lambert's free online RLHF book covering preference tuning, reward models, RLVR and post-training of language models. Intermediate–Advanced · unknown · unknown resource · en - ### [TensorFlow tutorials](/agents/agent-design-patterns/tensorflow-tutorials/index.md) Creator not supplied; see original source. Official TensorFlow tutorials on training and deploying machine-learning models. Intermediate · unknown · unknown resource · en - ### [Engineering fast, performant AI agents through fine-tuning (Decagon)](/agents/agent-design-patterns/decagon-engineering-fast-agents-through-fine-tuning/index.md) Creator not supplied; see original source. Decagon engineering post on using several fine-tuned smaller models to cut latency in customer-service agents. Advanced · unknown · unknown resource · en - ### [Direct Preference Optimization](/agents/agent-design-patterns/direct-preference-optimization/index.md) Creator not supplied; see original source. arXiv paper (2023) introducing Direct Preference Optimization (DPO), preference training without a separate reward model. Advanced · unknown · unknown resource · en - ### [LoRA](/agents/agent-design-patterns/lora/index.md) Creator not supplied; see original source. arXiv paper (2021) "LoRA: Low-Rank Adaptation of Large Language Models", introducing LoRA, low-rank adaptation for fine-tuning large models. Advanced · unknown · unknown resource · en - ### [Training language models to follow instructions with human feedback](/agents/agent-design-patterns/training-language-models-to-follow-instructions-with-human-feedback/index.md) Creator not supplied; see original source. arXiv paper (2022) "Training language models to follow instructions with human feedback", describing InstructGPT and the RLHF post-training pipeline. Advanced · unknown · unknown resource · en - ### [TRL documentation](/agents/agent-design-patterns/trl-documentation/index.md) Creator not supplied; see original source. Hugging Face TRL documentation: trainers for SFT, DPO, GRPO and other post-training methods. Advanced · unknown · unknown resource · en - ### [Tülu 3](/agents/agent-design-patterns/t-lu-3/index.md) Creator not supplied; see original source. arXiv paper (2024) describing Tülu 3, a fully open post-training recipe that introduced RLVR. Expert · unknown · unknown resource · en [Plain-text Markdown copy](/tags/training-fine-tuning/index.md)