Training Infrastructure: 123 curated resources

Curated material on training infrastructure within model training.

123 resources · page 2 of 4

• NVIDIA Dynamo

  Creator not supplied; see original source.

  ai-dynamo Dynamo GitHub repo: NVIDIA's datacenter-scale distributed, disaggregated inference serving framework.

  Not applicable (entity) · unknown · unknown resource · en

• NVIDIA NeMo Speech

  Creator not supplied; see original source.

  NVIDIA NeMo Speech GitHub repo: framework for speech recognition and TTS model training and inference.

  Not applicable (entity) · unknown · unknown resource · en

• NVIDIA/TensorRT-LLM

  Creator not supplied; see original source.

  NVIDIA TensorRT-LLM GitHub repo: Python API and kernels for optimised LLM inference on NVIDIA GPUs.

  Not applicable (entity) · unknown · unknown resource · en

• NVIDIA VerilogEval

  Creator not supplied; see original source.

  NVIDIA VerilogEval GitHub repo: benchmark for evaluating LLMs on generating Verilog hardware-description code.

  Not applicable (entity) · unknown · unknown resource · en

• Ollama

  Creator not supplied; see original source.

  Ollama GitHub repo: runtime for running open LLMs locally, with API and cloud options.

  Not applicable (entity) · unknown · unknown resource · en

• OLMo training and inference

  Creator not supplied; see original source.

  Ai2 OLMo GitHub repo: modelling, training, evaluation and inference code for OLMo open language models.

  Not applicable (entity) · unknown · unknown resource · en

• OpenROAD

  Creator not supplied; see original source.

  OpenROAD GitHub repo: open RTL-to-GDS chip design flow, also used in ML-for-EDA research.

  Not applicable (entity) · unknown · unknown resource · en

• SageAttention

  Creator not supplied; see original source.

  Tsinghua SageAttention GitHub repo: quantised low-bit attention kernels for faster inference.

  Not applicable (entity) · unknown · unknown resource · en

• onediff

  Creator not supplied; see original source.

  SiliconFlow onediff GitHub repo: acceleration library for diffusion model inference.

  Not applicable (entity) · unknown · unknown resource · en|zh

• Tenstorrent

  Creator not supplied; see original source.

  Tenstorrent: company building RISC-V based AI accelerators and computers.

  Not applicable (entity) · unknown · unknown resource · en

• ThunderKittens

  Creator not supplied; see original source.

  HazyResearch ThunderKittens GitHub repo: tile primitives framework for writing fast GPU kernels.

  Not applicable (entity) · unknown · unknown resource · en

• TileKernels

  Creator not supplied; see original source.

  DeepSeek TileKernels GitHub repo: library of GPU kernels written in TileLang.

  Not applicable (entity) · unknown · unknown resource · en

• Together cookbook

  Creator not supplied; see original source.

  Together cookbook GitHub repo: notebooks with recipes for building with Together AI models.

  Not applicable (entity) · unknown · unknown resource · en

• torchtitan

  Creator not supplied; see original source.

  PyTorch torchtitan GitHub repo: PyTorch-native platform for large-scale generative model pretraining.

  Not applicable (entity) · unknown · unknown resource · en

• fairseq: NLLB branch

  Creator not supplied; see original source.

  Meta fairseq nllb branch on GitHub: code for the No Language Left Behind translation models.

  Not applicable (entity) · unknown · unknown resource · en

• Triton-distributed

  Creator not supplied; see original source.

  ByteDance Seed Triton-distributed GitHub repo: distributed compiler and parallel kernels overlapping compute and communication.

  Not applicable (entity) · unknown · unknown resource · en

• TurboDiffusion (thu-ml)

  Creator not supplied; see original source.

  Tsinghua TurboDiffusion GitHub repo: acceleration framework for video diffusion models.

  Not applicable (entity) · unknown · unknown resource · en

• Alibaba Cloud Model Studio: Prompt engineering guide

  Creator not supplied; see original source.

  Alibaba Cloud Model Studio prompt engineering guide in Chinese with techniques for designing and optimising prompts.

  Beginner · unknown · unknown resource · zh

• Cloud.ru Foundation Models documentation

  Creator not supplied; see original source.

  Cloud.ru Foundation Models documentation: Sber subsidiary's unified API for hosted language models (in Russian).

  Beginner · unknown · unknown resource · ru

• fal Docs (fal.ai/docs)

  Creator not supplied; see original source.

  fal documentation for deploying and calling generative media models on fal's serving platform.

  Beginner · unknown · unknown resource · en

• GPU Puzzles (Sasha Rush)

  Creator not supplied; see original source.

  Sasha Rush's GPU Puzzles GitHub repo: interactive notebook exercises for learning CUDA programming.

  Beginner–Intermediate · unknown · unknown resource · en

• GroqDocs: Prompt Basics

  Creator not supplied; see original source.

  Groq prompting guide covering roles, instructions, context, input and output formats, and sampling parameters.

  Beginner · unknown · unknown resource · en

• LM Studio docs

  Creator not supplied; see original source.

  LM Studio app documentation: running Llama, DeepSeek, Qwen and other LLMs locally on a desktop.

  Beginner · unknown · unknown resource · en

• GPU Glossary (Modal)

  Creator not supplied; see original source.

  Modal GPU Glossary: reference explaining GPU hardware and software terms from CUDA cores to memory hierarchy.

  Beginner–Expert · unknown · unknown resource · en

• GigaChat docs: Prompt engineering basics

  Creator not supplied; see original source.

  Sber GigaChat prompt engineering basics in Russian: how to write effective prompts for GigaChat.

  Beginner · unknown · unknown resource · ru

• SiliconFlow docs: Platform introduction

  Creator not supplied; see original source.

  SiliconFlow platform introduction in Chinese: inference service offering API access to many open models.

  Beginner · unknown · unknown resource · zh

• Volcano Engine Ark (方舟) docs

  Creator not supplied; see original source.

  Volcano Engine Ark documentation entry: ByteDance's model platform docs, redirecting to docs.volcengine.com.

  Beginner · unknown · unknown resource · zh

• Alibaba Cloud Model Studio: Create a knowledge base

  Creator not supplied; see original source.

  Alibaba Cloud Model Studio documentation on creating knowledge bases for RAG, with parsing and chunking settings (in Chinese).

  Intermediate · unknown · unknown resource · zh

• AMD ROCm

  Creator not supplied; see original source.

  AMD ROCm developer hub with documentation, training and tools for GPU-accelerated computing on AMD hardware.

  Intermediate–Advanced · unknown · unknown resource · en

• Cerebras blog

  Creator not supplied; see original source.

  Cerebras blog on wafer-scale chips, fast inference, model performance and developer tooling.

  Intermediate · unknown · unknown resource · en

• Cloudflare Workers AI

  Creator not supplied; see original source.

  Cloudflare Workers AI documentation for running ML models on serverless GPUs across Cloudflare's network.

  Intermediate · unknown · unknown resource · en

• Fireworks blog

  Creator not supplied; see original source.

  Fireworks AI blog on inference performance, fine-tuning and model releases on its serving platform.

  Intermediate · unknown · unknown resource · en

Plain-text Markdown copy