Infrastructure, chips & efficiency for intermediate learners
77 resources · page 3 of 3
vLLM documentation
by vLLM project
vLLM documentation: open-source engine for high-throughput LLM inference and serving.
LM Studio blog
by LM Studio
LM Studio blog with release notes and technical posts on running LLMs locally.
Modal blog
by Modal
Modal blog on serverless GPU computing, infrastructure engineering and running AI workloads.
Ollama blog
by Ollama
Ollama blog with release notes, supported model announcements and guides for running models locally.
OpenRouter docs: Prompt Caching
by OpenRouter
OpenRouter guide to prompt caching across model providers, with cost implications.
PyTorch FSDP tutorial
PyTorch tutorial on Fully Sharded Data Parallel (FSDP2) for training large models across GPUs.
Qwen 中文文档
Qwen documentation in Chinese: usage, deployment and fine-tuning of Qwen language and multimodal models.
SGLang documentation
SGLang documentation: serving framework for large language and multimodal models.
Together AI blog
by Together AI
Together AI blog with product launches, research and technical guides on inference, fine-tuning and GPU clusters.
Transformers documentation
by Hugging Face
Hugging Face Transformers documentation: reference for model architectures, loading, training and generation.
Triton Puzzles
by GPU MODE
Triton Puzzles GitHub repo: interactive exercises for learning to write GPU kernels in Triton.
Triton tutorials
Triton tutorials: ordered examples from vector addition to fused softmax, matmul and fused attention GPU kernels.
Unsloth blog
by Unsloth AI
Unsloth blog with guides and release notes for fast, memory-efficient LLM fine-tuning.