Foundations
Understand language models and choose a learning path.
- Llm Fundamentals (139)
- Courses And Learning Paths (179)
- From Scratch Implementations (1)
- Practitioner Overviews (387)
706 resources · page 21 of 23
Convex Optimization
Creator not supplied; see original source.
Boyd and Vandenberghe's Convex Optimization book site with free PDF, slides and exercises.
DenseNet
Creator not supplied; see original source.
arXiv paper (2016) "Densely Connected Convolutional Networks", introducing DenseNet, where each layer receives feature maps from all earlier layers.
DETR
Creator not supplied; see original source.
arXiv HTML version of the DETR paper (2020) on end-to-end object detection with transformers.
DINOv2: Learning Robust Visual Features without Supervision
Creator not supplied; see original source.
arXiv HTML version of the DINOv2 paper (2023) on self-supervised visual features.
Deep Learning Recommendation Model for Personalization and Recommendation Systems (DLRM)
Creator not supplied; see original source.
arXiv PDF of Meta's DLRM paper (2019), a deep learning recommendation model for personalisation.
DQN (Atari)
Creator not supplied; see original source.
arXiv paper (2013) "Playing Atari with Deep Reinforcement Learning", introducing DQN, deep Q-learning from pixels on Atari games.
DreamerV3
Creator not supplied; see original source.
arXiv paper (2023) introducing DreamerV3, a world-model RL agent that masters diverse domains with fixed settings.
EfficientNet
Creator not supplied; see original source.
ICML 2019 paper (PDF) EfficientNet: scaling convolutional networks by depth, width and resolution.
ESPnet
Creator not supplied; see original source.
ESPnet documentation: end-to-end speech processing toolkit with recipes for recognition, synthesis and translation.
Faster R-CNN
Creator not supplied; see original source.
NeurIPS paper (PDF, 2015) Faster R-CNN: real-time object detection with region proposal networks.
GAT
Creator not supplied; see original source.
arXiv paper (2017) "Graph Attention Networks", introducing GAT, which weights neighbour nodes with masked self-attention.
GCN
Creator not supplied; see original source.
arXiv paper (2016) "Semi-Supervised Classification with Graph Convolutional Networks", introducing GCN layers for node classification.
GraphSAGE
Creator not supplied; see original source.
arXiv paper (2017) "Inductive Representation Learning on Large Graphs", introducing GraphSAGE for inductive node embeddings.
GRU
Creator not supplied; see original source.
arXiv paper (2014) introducing the RNN encoder–decoder with gated recurrent units (GRU) for machine translation.
GRU empirical evaluation
Creator not supplied; see original source.
arXiv paper (2014) empirically comparing gated recurrent units (GRU) and LSTM on sequence modelling.
IMPALA
Creator not supplied; see original source.
arXiv paper (2018) introducing IMPALA, a scalable distributed deep RL architecture.
Inception / GoogLeNet
Creator not supplied; see original source.
arXiv PDF of the GoogLeNet paper (2014) introducing the Inception architecture.
Jumanji
Creator not supplied; see original source.
Jumanji documentation: InstaDeep's suite of JAX reinforcement-learning environments for combinatorial and decision problems.
Kraken
Creator not supplied; see original source.
Kraken documentation: open-source text recognition system for historical and non-Latin scripts.
Language Models are Few-Shot Learners
Creator not supplied; see original source.
arXiv paper (2020) "Language Models are Few-Shot Learners", introducing GPT-3 and in-context few-shot learning.
Lil'Log
Research learning notes that connect methods to their literature.
Mask R-CNN
Creator not supplied; see original source.
arXiv paper (2017) "Mask R-CNN", introducing Mask R-CNN for instance segmentation.
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Creator not supplied; see original source.
arXiv PDF of the MobileNets paper (2017) on efficient convolutional networks for mobile vision.
Moirai
Creator not supplied; see original source.
arXiv PDF of the Moirai paper (2024), Salesforce's universal time-series forecasting transformer.
Montreal Forced Aligner
Creator not supplied; see original source.
Montreal Forced Aligner documentation: tool for aligning speech audio with transcripts and training pronunciation models.
MuZero
Creator not supplied; see original source.
arXiv paper (2019) introducing MuZero, planning with a learned model to master Atari, Go, chess and shogi.
Neural Collaborative Filtering
Creator not supplied; see original source.
arXiv PDF of the Neural Collaborative Filtering paper (2017) for neural recommender systems.
OpenAI Five (Dota 2)
Creator not supplied; see original source.
arXiv paper (2019) "Dota 2 with Large Scale Deep Reinforcement Learning", describing OpenAI Five's large-scale reinforcement learning for Dota 2.
OpenNMT
Creator not supplied; see original source.
OpenNMT site: open-source ecosystem for neural machine translation with training and deployment tools.
pgmpy
Creator not supplied; see original source.
pgmpy documentation: Python library for probabilistic graphical models and causal inference.
PPO
Creator not supplied; see original source.
arXiv paper (2017) "Proximal Policy Optimization Algorithms", introducing PPO, a policy gradient method with a clipped surrogate objective.
Pyro
Creator not supplied; see original source.
Pyro: deep probabilistic programming library on PyTorch with inference tutorials.