--- id: "/model-training/advanced/page/2/" title: "Model Training for advanced learners · page 2" creator: null creator_url: null creator_x: null url: "https://skillissue.dev/model-training/advanced/page/2/" level: null level_max: null category: null subcategory: null region: null license: null license_scope: null access: null models: null source_date: null date_added: null resource_kind: null verification_basis: null access_evidence: null domain_top: null domain_sub: null last_verified: null --- # Model Training for advanced learners [Beginner](/model-training/beginner/index.md) [Intermediate](/model-training/intermediate/index.md) [Advanced](/model-training/advanced/index.md) [Expert](/model-training/expert/index.md) 93 resources · page 2 of 3 - ### [NVIDIA Dynamo](/model-training/training-infrastructure/nvidia-dynamo/index.md) Creator not supplied; see original source. ai-dynamo Dynamo GitHub repo: NVIDIA's datacenter-scale distributed, disaggregated inference serving framework. Not applicable (entity) · unknown · unknown resource · en - ### [NVIDIA NeMo Speech](/model-training/training-infrastructure/nvidia-nemo-speech/index.md) Creator not supplied; see original source. NVIDIA NeMo Speech GitHub repo: framework for speech recognition and TTS model training and inference. Not applicable (entity) · unknown · unknown resource · en - ### [NVIDIA/TensorRT-LLM](/model-training/training-infrastructure/nvidia-tensorrt-llm/index.md) Creator not supplied; see original source. NVIDIA TensorRT-LLM GitHub repo: Python API and kernels for optimised LLM inference on NVIDIA GPUs. Not applicable (entity) · unknown · unknown resource · en - ### [NVIDIA VerilogEval](/model-training/training-infrastructure/nvidia-verilogeval/index.md) Creator not supplied; see original source. NVIDIA VerilogEval GitHub repo: benchmark for evaluating LLMs on generating Verilog hardware-description code. Not applicable (entity) · unknown · unknown resource · en - ### [Ollama](/model-training/training-infrastructure/ollama-repo/index.md) Creator not supplied; see original source. Ollama GitHub repo: runtime for running open LLMs locally, with API and cloud options. Not applicable (entity) · unknown · unknown resource · en - ### [OLMo training and inference](/model-training/training-infrastructure/olmo-training-and-inference/index.md) Creator not supplied; see original source. Ai2 OLMo GitHub repo: modelling, training, evaluation and inference code for OLMo open language models. Not applicable (entity) · unknown · unknown resource · en - ### [OpenROAD](/model-training/training-infrastructure/openroad/index.md) Creator not supplied; see original source. OpenROAD GitHub repo: open RTL-to-GDS chip design flow, also used in ML-for-EDA research. Not applicable (entity) · unknown · unknown resource · en - ### [SageAttention](/model-training/training-infrastructure/sageattention/index.md) Creator not supplied; see original source. Tsinghua SageAttention GitHub repo: quantised low-bit attention kernels for faster inference. Not applicable (entity) · unknown · unknown resource · en - ### [onediff](/model-training/training-infrastructure/siliconflow-onediff/index.md) Creator not supplied; see original source. SiliconFlow onediff GitHub repo: acceleration library for diffusion model inference. Not applicable (entity) · unknown · unknown resource · en|zh - ### [Tenstorrent](/model-training/training-infrastructure/tenstorrent/index.md) Creator not supplied; see original source. Tenstorrent: company building RISC-V based AI accelerators and computers. Not applicable (entity) · unknown · unknown resource · en - ### [ThunderKittens](/model-training/training-infrastructure/thunderkittens/index.md) Creator not supplied; see original source. HazyResearch ThunderKittens GitHub repo: tile primitives framework for writing fast GPU kernels. Not applicable (entity) · unknown · unknown resource · en - ### [TileKernels](/model-training/training-infrastructure/tilekernels/index.md) Creator not supplied; see original source. DeepSeek TileKernels GitHub repo: library of GPU kernels written in TileLang. Not applicable (entity) · unknown · unknown resource · en - ### [Together cookbook](/model-training/training-infrastructure/together-cookbook/index.md) Creator not supplied; see original source. Together cookbook GitHub repo: notebooks with recipes for building with Together AI models. Not applicable (entity) · unknown · unknown resource · en - ### [torchtitan](/model-training/training-infrastructure/torchtitan/index.md) Creator not supplied; see original source. PyTorch torchtitan GitHub repo: PyTorch-native platform for large-scale generative model pretraining. Not applicable (entity) · unknown · unknown resource · en - ### [fairseq: NLLB branch](/model-training/training-infrastructure/translation-localization/index.md) Creator not supplied; see original source. Meta fairseq nllb branch on GitHub: code for the No Language Left Behind translation models. Not applicable (entity) · unknown · unknown resource · en - ### [Triton-distributed](/model-training/training-infrastructure/triton-distributed/index.md) Creator not supplied; see original source. ByteDance Seed Triton-distributed GitHub repo: distributed compiler and parallel kernels overlapping compute and communication. Not applicable (entity) · unknown · unknown resource · en - ### [TurboDiffusion (thu-ml)](/model-training/training-infrastructure/turbodiffusion-thu-ml/index.md) Creator not supplied; see original source. Tsinghua TurboDiffusion GitHub repo: acceleration framework for video diffusion models. Not applicable (entity) · unknown · unknown resource · en - ### [GPU Glossary (Modal)](/model-training/training-infrastructure/modal-gpu-glossary/index.md) Creator not supplied; see original source. Modal GPU Glossary: reference explaining GPU hardware and software terms from CUDA cores to memory hierarchy. Beginner–Expert · unknown · unknown resource · en - ### [AMD ROCm](/model-training/training-infrastructure/amd-rocm/index.md) Creator not supplied; see original source. AMD ROCm developer hub with documentation, training and tools for GPU-accelerated computing on AMD hardware. Intermediate–Advanced · unknown · unknown resource · en - ### [Google TPU docs](/model-training/training-infrastructure/google-tpu-docs/index.md) Creator not supplied; see original source. Google Cloud TPU documentation for running machine-learning training and inference on Tensor Processing Units. Intermediate–Advanced · unknown · unknown resource · en - ### [GPU MODE](/model-training/training-infrastructure/gpu-mode/index.md) Creator not supplied; see original source. GPU MODE site: community for learning GPU programming through lectures, hackathons, kernel competitions and working groups. Intermediate–Advanced · unknown · unknown resource · en - ### [GPU MODE lectures](/model-training/training-infrastructure/gpu-mode-lectures/index.md) Creator not supplied; see original source. GPU MODE lectures GitHub repo: slides and code from community lectures on GPU programming and CUDA kernels. Intermediate–Advanced · unknown · unknown resource · en - ### [vLLM documentation](/model-training/training-infrastructure/inference-serving-quantization/index.md) Creator not supplied; see original source. vLLM documentation: open-source engine for high-throughput LLM inference and serving. Intermediate–Advanced · unknown · unknown resource · en - ### [PyTorch FSDP tutorial](/model-training/training-infrastructure/pytorch-fsdp-tutorial/index.md) Creator not supplied; see original source. PyTorch tutorial on Fully Sharded Data Parallel (FSDP2) for training large models across GPUs. Intermediate–Advanced · unknown · unknown resource · en - ### [SGLang documentation](/model-training/training-infrastructure/sglang/index.md) Creator not supplied; see original source. SGLang documentation: serving framework for large language and multimodal models. Intermediate–Advanced · unknown · unknown resource · en - ### [Triton tutorials](/model-training/training-infrastructure/triton-tutorials/index.md) Creator not supplied; see original source. Triton tutorials: ordered examples from vector addition to fused softmax, matmul and fused attention GPU kernels. Intermediate–Advanced · unknown · unknown resource · en - ### [ruGPT training and fine-tuning examples](/model-training/fine-tuning/ai-forever-rugpt-training/index.md) by [SberDevices / ai-forever](https://github.com/ai-forever/ru-gpts) Inspect Russian-model fine-tuning and pretraining scripts, with explicit warnings about the legacy environment. Advanced · RU · open resource · en - ### [A graph placement methodology for fast chip design](/model-training/training-infrastructure/alphachip-mirhoseini-et-al-nature-2021/index.md) Creator not supplied; see original source. Nature paper (2021) by Mirhoseini et al. introducing the reinforcement learning chip floorplanning method later named AlphaChip. Advanced · unknown · unknown resource · en - ### [Agentic inference optimization (Baseten)](/model-training/training-infrastructure/baseten-agentic-inference-optimization/index.md) Creator not supplied; see original source. Baseten post on optimising inference engines for agent workloads, reporting decode-speed and latency gains over vLLM. Advanced · unknown · unknown resource · en - ### [Baseten documentation](/model-training/training-infrastructure/baseten-documentation/index.md) Creator not supplied; see original source. Baseten documentation for running hosted models, deploying custom models and training on GPU infrastructure. Advanced · unknown · unknown resource · en - ### [BentoML documentation](/model-training/training-infrastructure/bentoml-documentation/index.md) Creator not supplied; see original source. BentoML documentation: open-source inference platform for packaging, deploying and scaling AI models. Advanced · unknown · unknown resource · en - ### [Code execution with MCP](/model-training/training-infrastructure/code-execution-with-mcp/index.md) Creator not supplied; see original source. Anthropic post on code execution with MCP: agents write code to call tools, reducing token use and context load. Advanced · unknown · unknown resource · en [Previous page](/model-training/advanced/index.md) [Next page](/model-training/advanced/page/3/index.md) [Plain-text Markdown copy](/model-training/advanced/page/2/index.md)