--- id: "/model-training/training-infrastructure/page/3/" title: "Training Infrastructure: 123 curated resources · page 3" creator: null creator_url: null creator_x: null url: "https://skillissue.dev/model-training/training-infrastructure/page/3/" level: null level_max: null category: null subcategory: null region: null license: null license_scope: null access: null models: null source_date: null date_added: null resource_kind: null verification_basis: null access_evidence: null domain_top: null domain_sub: null last_verified: null --- # Training Infrastructure: 123 curated resources Curated material on training infrastructure within model training. [Beginner](/model-training/beginner/index.md) [Intermediate](/model-training/intermediate/index.md) [Advanced](/model-training/advanced/index.md) [Expert](/model-training/expert/index.md) 123 resources · page 3 of 4 - ### [google-ai-edge/gallery: skills](/model-training/training-infrastructure/google-ai-edge-gallery-skills/index.md) Creator not supplied; see original source. Google AI Edge Gallery skills folder on GitHub: skills for on-device ML and generative AI apps. Intermediate · unknown · unknown resource · en - ### [Google TPU docs](/model-training/training-infrastructure/google-tpu-docs/index.md) Creator not supplied; see original source. Google Cloud TPU documentation for running machine-learning training and inference on Tensor Processing Units. Intermediate–Advanced · unknown · unknown resource · en - ### [GPU MODE](/model-training/training-infrastructure/gpu-mode/index.md) Creator not supplied; see original source. GPU MODE site: community for learning GPU programming through lectures, hackathons, kernel competitions and working groups. Intermediate–Advanced · unknown · unknown resource · en - ### [GPU MODE lectures](/model-training/training-infrastructure/gpu-mode-lectures/index.md) Creator not supplied; see original source. GPU MODE lectures GitHub repo: slides and code from community lectures on GPU programming and CUDA kernels. Intermediate–Advanced · unknown · unknown resource · en - ### [GPU MODE resource stream](/model-training/training-infrastructure/gpu-mode-resource-stream/index.md) Creator not supplied; see original source. GPU MODE resource-stream GitHub repo: curated links to CUDA and GPU programming books, papers, posts and videos. Intermediate · unknown · unknown resource · en - ### [Groq blog](/model-training/training-infrastructure/groq-blog/index.md) Creator not supplied; see original source. Groq blog with posts on its LPU inference hardware, cloud API and supported models. Intermediate · unknown · unknown resource · en - ### [Groq documentation](/model-training/training-infrastructure/groq-documentation/index.md) Creator not supplied; see original source. Groq documentation: OpenAI-compatible API, available models and rate limits for its LPU inference service. Intermediate · unknown · unknown resource · en - ### [Making Deep Learning Go Brrrr From First Principles (Horace He)](/model-training/training-infrastructure/horace-he-making-dl-go-brrrr/index.md) Creator not supplied; see original source. Horace He's Making Deep Learning Go Brrrr: first-principles guide to whether models are compute-, memory- or overhead-bound. Intermediate · unknown · unknown resource · en - ### [vLLM documentation](/model-training/training-infrastructure/inference-serving-quantization/index.md) Creator not supplied; see original source. vLLM documentation: open-source engine for high-throughput LLM inference and serving. Intermediate–Advanced · unknown · unknown resource · en - ### [LM Studio blog](/model-training/training-infrastructure/lm-studio-blog/index.md) Creator not supplied; see original source. LM Studio blog with release notes and technical posts on running LLMs locally. Intermediate · unknown · unknown resource · en - ### [Modal blog](/model-training/training-infrastructure/modal-blog/index.md) Creator not supplied; see original source. Modal blog on serverless GPU computing, infrastructure engineering and running AI workloads. Intermediate · unknown · unknown resource · en - ### [Ollama blog](/model-training/training-infrastructure/ollama-blog/index.md) Creator not supplied; see original source. Ollama blog with release notes, supported model announcements and guides for running models locally. Intermediate · unknown · unknown resource · und - ### [OpenRouter docs: Prompt Caching](/model-training/training-infrastructure/openrouter-prompt-caching/index.md) Creator not supplied; see original source. OpenRouter guide to prompt caching across model providers, with cost implications. Intermediate · unknown · unknown resource · en - ### [PyTorch FSDP tutorial](/model-training/training-infrastructure/pytorch-fsdp-tutorial/index.md) Creator not supplied; see original source. PyTorch tutorial on Fully Sharded Data Parallel (FSDP2) for training large models across GPUs. Intermediate–Advanced · unknown · unknown resource · en - ### [Qwen 中文文档](/model-training/training-infrastructure/qwen/index.md) Creator not supplied; see original source. Qwen documentation in Chinese: usage, deployment and fine-tuning of Qwen language and multimodal models. Intermediate · unknown · unknown resource · zh - ### [SGLang documentation](/model-training/training-infrastructure/sglang/index.md) Creator not supplied; see original source. SGLang documentation: serving framework for large language and multimodal models. Intermediate–Advanced · unknown · unknown resource · en - ### [Together AI blog](/model-training/training-infrastructure/together-ai-blog/index.md) Creator not supplied; see original source. Together AI blog with product launches, research and technical guides on inference, fine-tuning and GPU clusters. Intermediate · unknown · unknown resource · en - ### [Transformers documentation](/model-training/training-infrastructure/transformers-documentation/index.md) Creator not supplied; see original source. Hugging Face Transformers documentation: reference for model architectures, loading, training and generation. Intermediate · unknown · unknown resource · en - ### [Triton Puzzles](/model-training/training-infrastructure/triton-puzzles/index.md) Creator not supplied; see original source. Triton Puzzles GitHub repo: interactive exercises for learning to write GPU kernels in Triton. Intermediate · unknown · unknown resource · en - ### [Triton tutorials](/model-training/training-infrastructure/triton-tutorials/index.md) Creator not supplied; see original source. Triton tutorials: ordered examples from vector addition to fused softmax, matmul and fused attention GPU kernels. Intermediate–Advanced · unknown · unknown resource · en - ### [Unsloth blog](/model-training/training-infrastructure/unsloth-blog/index.md) Creator not supplied; see original source. Unsloth blog with guides and release notes for fast, memory-efficient LLM fine-tuning. Intermediate · unknown · unknown resource · en - ### [A graph placement methodology for fast chip design](/model-training/training-infrastructure/alphachip-mirhoseini-et-al-nature-2021/index.md) Creator not supplied; see original source. Nature paper (2021) by Mirhoseini et al. introducing the reinforcement learning chip floorplanning method later named AlphaChip. Advanced · unknown · unknown resource · en - ### [Agentic inference optimization (Baseten)](/model-training/training-infrastructure/baseten-agentic-inference-optimization/index.md) Creator not supplied; see original source. Baseten post on optimising inference engines for agent workloads, reporting decode-speed and latency gains over vLLM. Advanced · unknown · unknown resource · en - ### [Baseten documentation](/model-training/training-infrastructure/baseten-documentation/index.md) Creator not supplied; see original source. Baseten documentation for running hosted models, deploying custom models and training on GPU infrastructure. Advanced · unknown · unknown resource · en - ### [BentoML documentation](/model-training/training-infrastructure/bentoml-documentation/index.md) Creator not supplied; see original source. BentoML documentation: open-source inference platform for packaging, deploying and scaling AI models. Advanced · unknown · unknown resource · en - ### [Code execution with MCP](/model-training/training-infrastructure/code-execution-with-mcp/index.md) Creator not supplied; see original source. Anthropic post on code execution with MCP: agents write code to call tools, reducing token use and context load. Advanced · unknown · unknown resource · en - ### [Defeating Nondeterminism in LLM Inference](/model-training/training-infrastructure/defeating-nondeterminism-in-llm-inference/index.md) Creator not supplied; see original source. Thinking Machines Lab post on the causes of nondeterminism in LLM inference and batch-invariant kernels to fix it. Advanced · unknown · unknown resource · en - ### [DoWhy documentation](/model-training/training-infrastructure/dowhy-2/index.md) Creator not supplied; see original source. DoWhy documentation: Python library for causal inference with modelling, identification, estimation and refutation steps. Advanced · unknown · unknown resource · en - ### [EconML](/model-training/training-infrastructure/econml/index.md) Creator not supplied; see original source. EconML documentation: Python methods for estimating heterogeneous treatment effects with machine learning. Advanced · unknown · unknown resource · en - ### [Feast documentation](/model-training/training-infrastructure/feast-documentation/index.md) Creator not supplied; see original source. Feast documentation: open-source feature store for serving consistent features to ML training and inference. Advanced · unknown · unknown resource · en - ### [Fireworks AI documentation](/model-training/training-infrastructure/fireworks-ai-documentation/index.md) Creator not supplied; see original source. Fireworks AI documentation: serverless and dedicated inference, fine-tuning and deployment of open models. Advanced · unknown · unknown resource · en - ### [Three Tests to Run Before You Switch from LoRA to FullFT (Fireworks AI)](/model-training/training-infrastructure/fireworks-three-tests-before-you-switch-from-lora-to-fullft/index.md) Creator not supplied; see original source. Fireworks AI post with controlled experiments on Qwen3.5-9B showing what to test before switching from LoRA to full fine-tuning. Advanced · unknown · unknown resource · en [Previous page](/model-training/training-infrastructure/page/2/index.md) [Next page](/model-training/training-infrastructure/page/4/index.md) [Plain-text Markdown copy](/model-training/training-infrastructure/page/3/index.md)