Foundations for advanced learners
588 resources · page 18 of 19
Faster R-CNN
Creator not supplied; see original source.
NeurIPS paper (PDF, 2015) Faster R-CNN: real-time object detection with region proposal networks.
GAT
Creator not supplied; see original source.
arXiv paper (2017) "Graph Attention Networks", introducing GAT, which weights neighbour nodes with masked self-attention.
GCN
Creator not supplied; see original source.
arXiv paper (2016) "Semi-Supervised Classification with Graph Convolutional Networks", introducing GCN layers for node classification.
GraphSAGE
Creator not supplied; see original source.
arXiv paper (2017) "Inductive Representation Learning on Large Graphs", introducing GraphSAGE for inductive node embeddings.
GRU
Creator not supplied; see original source.
arXiv paper (2014) introducing the RNN encoder–decoder with gated recurrent units (GRU) for machine translation.
GRU empirical evaluation
Creator not supplied; see original source.
arXiv paper (2014) empirically comparing gated recurrent units (GRU) and LSTM on sequence modelling.
IMPALA
Creator not supplied; see original source.
arXiv paper (2018) introducing IMPALA, a scalable distributed deep RL architecture.
Inception / GoogLeNet
Creator not supplied; see original source.
arXiv PDF of the GoogLeNet paper (2014) introducing the Inception architecture.
Jumanji
Creator not supplied; see original source.
Jumanji documentation: InstaDeep's suite of JAX reinforcement-learning environments for combinatorial and decision problems.
Kraken
Creator not supplied; see original source.
Kraken documentation: open-source text recognition system for historical and non-Latin scripts.
Language Models are Few-Shot Learners
Creator not supplied; see original source.
arXiv paper (2020) "Language Models are Few-Shot Learners", introducing GPT-3 and in-context few-shot learning.
Lil'Log
Research learning notes that connect methods to their literature.
Mask R-CNN
Creator not supplied; see original source.
arXiv paper (2017) "Mask R-CNN", introducing Mask R-CNN for instance segmentation.
MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications
Creator not supplied; see original source.
arXiv PDF of the MobileNets paper (2017) on efficient convolutional networks for mobile vision.
Moirai
Creator not supplied; see original source.
arXiv PDF of the Moirai paper (2024), Salesforce's universal time-series forecasting transformer.
Montreal Forced Aligner
Creator not supplied; see original source.
Montreal Forced Aligner documentation: tool for aligning speech audio with transcripts and training pronunciation models.
MuZero
Creator not supplied; see original source.
arXiv paper (2019) introducing MuZero, planning with a learned model to master Atari, Go, chess and shogi.
Neural Collaborative Filtering
Creator not supplied; see original source.
arXiv PDF of the Neural Collaborative Filtering paper (2017) for neural recommender systems.
OpenAI Five (Dota 2)
Creator not supplied; see original source.
arXiv paper (2019) "Dota 2 with Large Scale Deep Reinforcement Learning", describing OpenAI Five's large-scale reinforcement learning for Dota 2.
OpenNMT
Creator not supplied; see original source.
OpenNMT site: open-source ecosystem for neural machine translation with training and deployment tools.
pgmpy
Creator not supplied; see original source.
pgmpy documentation: Python library for probabilistic graphical models and causal inference.
PPO
Creator not supplied; see original source.
arXiv paper (2017) "Proximal Policy Optimization Algorithms", introducing PPO, a policy gradient method with a clipped surrogate objective.
Pyro
Creator not supplied; see original source.
Pyro: deep probabilistic programming library on PyTorch with inference tutorials.
Relational inductive biases, deep learning, and graph networks
Creator not supplied; see original source.
arXiv paper (2018) "Relational inductive biases, deep learning, and graph networks", defining the graph network block that unifies many GNN variants.
ResNet
Creator not supplied; see original source.
arXiv paper (2015) "Deep Residual Learning for Image Recognition", introducing ResNet residual networks.
RL4CO
Creator not supplied; see original source.
RL4CO documentation: reinforcement-learning benchmark and library for combinatorial optimisation problems.
RWKV
Creator not supplied; see original source.
arXiv paper (2023) introducing RWKV, a recurrent architecture trained in parallel like a transformer.
Efficiently Modeling Long Sequences with Structured State Spaces (S4)
Creator not supplied; see original source.
arXiv paper (2021) "Efficiently Modeling Long Sequences with Structured State Spaces", introducing S4, structured state space models for long sequences.
SAC
Creator not supplied; see original source.
arXiv paper (2018) introducing Soft Actor-Critic (SAC), off-policy maximum-entropy deep reinforcement learning.
SAM
Creator not supplied; see original source.
arXiv paper (2023) introducing Segment Anything (SAM), a promptable image segmentation model and dataset.
Scaling Laws for Neural Language Models
Creator not supplied; see original source.
arXiv paper (2020) "Scaling Laws for Neural Language Models", measuring power-law scaling of language model loss with size, data and compute.
scvi-tools
Creator not supplied; see original source.
scvi-tools: library of probabilistic deep generative models for single-cell omics data.