--- id: "/model-training/page/4/" title: "Model Training · page 4" creator: null creator_url: null creator_x: null url: "https://skillissue.dev/model-training/page/4/" level: null level_max: null category: null subcategory: null region: null license: null license_scope: null access: null models: null source_date: null date_added: null resource_kind: null verification_basis: null access_evidence: null domain_top: null domain_sub: null last_verified: null --- # Model Training Study the data, algorithms and infrastructure used to change model weights. - [Pretraining](/model-training/pretraining/index.md) (3) - [Training Data](/model-training/training-data/index.md) (1) - [Post Training Rl](/model-training/post-training-rl/index.md) (5) - [Fine Tuning](/model-training/fine-tuning/index.md) (4) - [Training Infrastructure](/model-training/training-infrastructure/index.md) (123) [Beginner](/model-training/beginner/index.md) [Intermediate](/model-training/intermediate/index.md) [Advanced](/model-training/advanced/index.md) [Expert](/model-training/expert/index.md) 136 resources · page 4 of 5 - ### [Fireworks AI documentation](/model-training/training-infrastructure/fireworks-ai-documentation/index.md) Creator not supplied; see original source. Fireworks AI documentation: serverless and dedicated inference, fine-tuning and deployment of open models. Advanced · unknown · unknown resource · en - ### [Three Tests to Run Before You Switch from LoRA to FullFT (Fireworks AI)](/model-training/training-infrastructure/fireworks-three-tests-before-you-switch-from-lora-to-fullft/index.md) Creator not supplied; see original source. Fireworks AI post with controlled experiments on Qwen3.5-9B showing what to test before switching from LoRA to full fine-tuning. Advanced · unknown · unknown resource · en - ### [GigaChat Family: Efficient Russian Language Modeling Through Mixture of Experts Architecture](/model-training/pretraining/gigachat-family-moe-training-report/index.md) by [GigaChat team / SaluteDevices](https://arxiv.org/abs/2506.09440v1) Study a Russian-origin model team’s account of mixture-of-experts architecture, pretraining and evaluation. Advanced · RU · open resource · en - ### [Building an efficient harness for advanced enterprise work (Glean)](/model-training/training-infrastructure/glean-building-an-efficient-harness-for-advanced-enterprise-work/index.md) Creator not supplied; see original source. Glean post on its coding-agent harness using code execution, tool-output truncation and progressive disclosure to cut tokens. Advanced · unknown · unknown resource · en - ### [Grouped-Query Attention](/model-training/training-infrastructure/grouped-query-attention/index.md) Creator not supplied; see original source. arXiv paper (2023) introducing grouped-query attention (GQA) and uptraining multi-head models to it. Advanced · unknown · unknown resource · en - ### [LlamaFactory](/model-training/fine-tuning/hiyouga-llamafactory/index.md) by [hiyouga (Yaowei Zheng) et al.](https://github.com/hiyouga/LlamaFactory) Compare adaptation methods within a shared training interface. Advanced · CN · open resource · en - ### [TRL - Transformers Reinforcement Learning](/model-training/post-training-rl/hugging-face-trl-transformers-reinforcement-learning/index.md) by [Hugging Face](https://huggingface.co/docs/trl/index) Find training interfaces for supervised and preference-based adaptation. Advanced · other · closed resource · en - ### [MindSpore 中文 API 文档](/model-training/training-infrastructure/mindspore-api/index.md) Creator not supplied; see original source. MindSpore API documentation in Chinese for Huawei's deep learning training and inference framework. Advanced · unknown · unknown resource · zh - ### [Modal guides](/model-training/training-infrastructure/modal-guides/index.md) Creator not supplied; see original source. Modal guides: deploying model serving, GPU jobs and scalable applications on Modal's serverless platform. Advanced · unknown · unknown resource · en - ### [Scaling to 1 million concurrent sandboxes in seconds (Modal)](/model-training/training-infrastructure/modal-scaling-to-1m-concurrent-sandboxes/index.md) Creator not supplied; see original source. Modal engineering post on building a scheduler that runs one million concurrent code sandboxes per workspace. Advanced · unknown · unknown resource · en - ### [Moore Threads docs center](/model-training/training-infrastructure/moore-threads-docs-center/index.md) Creator not supplied; see original source. Moore Threads documentation centre for its Chinese GPUs and the MUSA SDK (in Chinese). Advanced · unknown · unknown resource · zh - ### [Reinforcement Learning from Human Feedback (book)](/model-training/post-training-rl/nathan-lambert-reinforcement-learning-from-human-feedback/index.md) by [Nathan Lambert](https://rlhfbook.com/) A conceptual path through reward modeling and post-training methods. Advanced · West · closed resource · en - ### [PEFT documentation](/model-training/training-infrastructure/peft-documentation/index.md) Creator not supplied; see original source. Hugging Face PEFT documentation: parameter-efficient fine-tuning methods such as LoRA, with recipes. Advanced · unknown · unknown resource · en - ### [Qiskit Machine Learning](/model-training/training-infrastructure/qiskit-machine-learning/index.md) Creator not supplied; see original source. Qiskit Machine Learning documentation: quantum kernels and quantum neural networks for ML experiments. Advanced · unknown · unknown resource · en - ### [QLoRA](/model-training/training-infrastructure/qlora/index.md) Creator not supplied; see original source. arXiv paper (2023) introducing QLoRA, fine-tuning 4-bit quantized LLMs with low-rank adapters. Advanced · unknown · unknown resource · en - ### [Ray Serve documentation](/model-training/training-infrastructure/ray-serve-documentation/index.md) Creator not supplied; see original source. Ray Serve documentation: scalable library for building online inference APIs and composing model deployments. Advanced · unknown · unknown resource · en - ### [Controlling Reasoning Effort in LLMs (Ahead of AI)](/model-training/post-training-rl/sebastian-raschka-ahead-of-ai/index.md) by [Sebastian Raschka](https://magazine.sebastianraschka.com/p/controlling-reasoning-effort-in-llms) A free Ahead of AI article on training controllable reasoning effort. Advanced · West · closed resource · en - ### [SGLang docs: HiCache best practices](/model-training/training-infrastructure/sglang-hicache-best-practices/index.md) Creator not supplied; see original source. SGLang HiCache best practices: configuring hierarchical KV caching across GPU, CPU and storage. Advanced · unknown · unknown resource · en - ### [Tinker documentation](/model-training/training-infrastructure/tinker-documentation/index.md) Creator not supplied; see original source. Tinker documentation from Thinking Machines Lab: training API for fine-tuning open-weight LLMs, with SDK reference and recipes. Advanced · unknown · unknown resource · en - ### [AdapTive-LeArning Speculator System (ATLAS) (Together AI)](/model-training/training-infrastructure/together-ai-atlas-runtime-learning-speculators/index.md) Creator not supplied; see original source. Together AI post on ATLAS, a speculative decoding system whose speculators keep learning from the live workload. Advanced · unknown · unknown resource · en - ### [Cache-aware prefill-decode disaggregation (Together AI)](/model-training/training-infrastructure/together-ai-cache-aware-prefill-decode-disaggregation/index.md) Creator not supplied; see original source. Together AI post on cache-aware prefill-decode disaggregation for faster long-context inference serving. Advanced · unknown · unknown resource · en - ### [Together AI documentation](/model-training/training-infrastructure/together-ai-documentation/index.md) Creator not supplied; see original source. Together AI documentation for running, fine-tuning and serving open-source models. Advanced · unknown · unknown resource · en - ### [Unsloth](/model-training/fine-tuning/unsloth-unsloth/index.md) by [Unsloth](https://github.com/unslothai/unsloth) Study local training and adaptation workflows for supported models. Advanced · West · open resource · en - ### [vLLM docs: Automatic prefix caching](/model-training/training-infrastructure/vllm-automatic-prefix-caching-design/index.md) Creator not supplied; see original source. vLLM design document on automatic prefix caching and how shared prompt prefixes reuse the KV cache. Advanced · unknown · unknown resource · en - ### [vLLM docs](/model-training/training-infrastructure/vllm-docs/index.md) Creator not supplied; see original source. vLLM latest documentation: installation, serving, supported models and quantisation for the LLM inference engine. Advanced · unknown · unknown resource · en - ### [nanochat](/model-training/pretraining/andrej-karpathy-nanochat/index.md) by [Andrej Karpathy](https://github.com/karpathy/nanochat) [@karpathy](https://twitter.com/karpathy) A compact training harness spanning the model-development lifecycle. Expert · West · open resource · en - ### [CMU 11-868 LLM Systems](/model-training/training-infrastructure/cmu-11-868-llm-systems/index.md) Creator not supplied; see original source. CMU 11-868 LLM Systems course site: systems for training and serving large language models, with schedule and readings. Expert · unknown · unknown resource · en - ### [CUDA C++ Programming Guide](/model-training/training-infrastructure/cuda-c-programming-guide/index.md) Creator not supplied; see original source. NVIDIA CUDA C++ Programming Guide: reference for the CUDA programming model, memory hierarchy and interfaces. Expert · unknown · unknown resource · en - ### [DeepSeek-R1: Incentivizing Reasoning via RL (arXiv 2501.12948)](/model-training/post-training-rl/deepseek-deepseek-r1-incentivizing-reasoning-via-rl/index.md) by [DeepSeek](https://arxiv.org/abs/2501.12948) Study the reported reinforcement-learning recipe behind DeepSeek-R1. Expert · CN · closed resource · en - ### [EAGLE](/model-training/training-infrastructure/eagle/index.md) Creator not supplied; see original source. arXiv paper (2024) introducing EAGLE, speculative sampling with feature-level draft heads. Expert · unknown · unknown resource · en - ### [Fast Inference from Transformers via Speculative Decoding](/model-training/training-infrastructure/fast-inference-from-transformers-via-speculative-decoding/index.md) Creator not supplied; see original source. arXiv paper (2022) introducing speculative decoding to speed up transformer inference without changing outputs. Expert · unknown · unknown resource · en - ### [FlashAttention](/model-training/training-infrastructure/flashattention/index.md) Creator not supplied; see original source. arXiv paper (2022) introducing FlashAttention, an IO-aware exact attention algorithm for GPUs. Expert · unknown · unknown resource · en [Previous page](/model-training/page/3/index.md) [Next page](/model-training/page/5/index.md) [Plain-text Markdown copy](/model-training/page/4/index.md)