--- id: "/foundations/advanced/page/18/" title: "Foundations for advanced learners · page 18" creator: null creator_url: null creator_x: null url: "https://skillissue.dev/foundations/advanced/page/18/" level: null level_max: null category: null subcategory: null region: null license: null license_scope: null access: null models: null source_date: null date_added: null resource_kind: null verification_basis: null access_evidence: null domain_top: null domain_sub: null last_verified: null --- # Foundations for advanced learners [Beginner](/foundations/beginner/index.md) [Intermediate](/foundations/intermediate/index.md) [Advanced](/foundations/advanced/index.md) [Expert](/foundations/expert/index.md) 588 resources · page 18 of 19 - ### [Faster R-CNN](/foundations/llm-fundamentals/faster-r-cnn/index.md) Creator not supplied; see original source. NeurIPS paper (PDF, 2015) Faster R-CNN: real-time object detection with region proposal networks. Advanced–Expert · unknown · unknown resource · zh - ### [GAT](/foundations/llm-fundamentals/gat/index.md) Creator not supplied; see original source. arXiv paper (2017) "Graph Attention Networks", introducing GAT, which weights neighbour nodes with masked self-attention. Advanced–Expert · unknown · unknown resource · en - ### [GCN](/foundations/llm-fundamentals/gcn/index.md) Creator not supplied; see original source. arXiv paper (2016) "Semi-Supervised Classification with Graph Convolutional Networks", introducing GCN layers for node classification. Advanced–Expert · unknown · unknown resource · en - ### [GraphSAGE](/foundations/llm-fundamentals/graphsage/index.md) Creator not supplied; see original source. arXiv paper (2017) "Inductive Representation Learning on Large Graphs", introducing GraphSAGE for inductive node embeddings. Advanced–Expert · unknown · unknown resource · en - ### [GRU](/foundations/llm-fundamentals/gru/index.md) Creator not supplied; see original source. arXiv paper (2014) introducing the RNN encoder–decoder with gated recurrent units (GRU) for machine translation. Advanced–Expert · unknown · unknown resource · en - ### [GRU empirical evaluation](/foundations/llm-fundamentals/gru-empirical-evaluation/index.md) Creator not supplied; see original source. arXiv paper (2014) empirically comparing gated recurrent units (GRU) and LSTM on sequence modelling. Advanced–Expert · unknown · unknown resource · en - ### [IMPALA](/foundations/llm-fundamentals/impala/index.md) Creator not supplied; see original source. arXiv paper (2018) introducing IMPALA, a scalable distributed deep RL architecture. Advanced–Expert · unknown · unknown resource · en - ### [Inception / GoogLeNet](/foundations/llm-fundamentals/inception-googlenet/index.md) Creator not supplied; see original source. arXiv PDF of the GoogLeNet paper (2014) introducing the Inception architecture. Advanced–Expert · unknown · unknown resource · und - ### [Jumanji](/foundations/llm-fundamentals/jumanji/index.md) Creator not supplied; see original source. Jumanji documentation: InstaDeep's suite of JAX reinforcement-learning environments for combinatorial and decision problems. Advanced · unknown · unknown resource · en - ### [Kraken](/foundations/courses-and-learning-paths/kraken/index.md) Creator not supplied; see original source. Kraken documentation: open-source text recognition system for historical and non-Latin scripts. Advanced · unknown · unknown resource · en - ### [Language Models are Few-Shot Learners](/foundations/courses-and-learning-paths/language-models-are-few-shot-learners/index.md) Creator not supplied; see original source. arXiv paper (2020) "Language Models are Few-Shot Learners", introducing GPT-3 and in-context few-shot learning. Advanced · unknown · unknown resource · en - ### [Lil'Log](/foundations/practitioner-overviews/lilian-weng-lil-log/index.md) by [Lilian Weng](https://lilianweng.github.io/) [@lilianweng](https://twitter.com/lilianweng/) Research learning notes that connect methods to their literature. Advanced · West · closed resource · en - ### [Mask R-CNN](/foundations/llm-fundamentals/mask-r-cnn/index.md) Creator not supplied; see original source. arXiv paper (2017) "Mask R-CNN", introducing Mask R-CNN for instance segmentation. Advanced–Expert · unknown · unknown resource · en - ### [MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications](/foundations/llm-fundamentals/mobilenet/index.md) Creator not supplied; see original source. arXiv PDF of the MobileNets paper (2017) on efficient convolutional networks for mobile vision. Advanced–Expert · unknown · unknown resource · und - ### [Moirai](/foundations/llm-fundamentals/moirai/index.md) Creator not supplied; see original source. arXiv PDF of the Moirai paper (2024), Salesforce's universal time-series forecasting transformer. Advanced–Expert · unknown · unknown resource · und - ### [Montreal Forced Aligner](/foundations/llm-fundamentals/montreal-forced-aligner/index.md) Creator not supplied; see original source. Montreal Forced Aligner documentation: tool for aligning speech audio with transcripts and training pronunciation models. Advanced · unknown · unknown resource · en - ### [MuZero](/foundations/llm-fundamentals/muzero/index.md) Creator not supplied; see original source. arXiv paper (2019) introducing MuZero, planning with a learned model to master Atari, Go, chess and shogi. Advanced–Expert · unknown · unknown resource · en - ### [Neural Collaborative Filtering](/foundations/llm-fundamentals/neural-collaborative-filtering/index.md) Creator not supplied; see original source. arXiv PDF of the Neural Collaborative Filtering paper (2017) for neural recommender systems. Advanced–Expert · unknown · unknown resource · zh - ### [OpenAI Five (Dota 2)](/foundations/llm-fundamentals/openai-five-dota-2/index.md) Creator not supplied; see original source. arXiv paper (2019) "Dota 2 with Large Scale Deep Reinforcement Learning", describing OpenAI Five's large-scale reinforcement learning for Dota 2. Advanced–Expert · unknown · unknown resource · en - ### [OpenNMT](/foundations/courses-and-learning-paths/opennmt/index.md) Creator not supplied; see original source. OpenNMT site: open-source ecosystem for neural machine translation with training and deployment tools. Advanced · unknown · unknown resource · en - ### [pgmpy](/foundations/courses-and-learning-paths/pgmpy/index.md) Creator not supplied; see original source. pgmpy documentation: Python library for probabilistic graphical models and causal inference. Advanced · unknown · unknown resource · en - ### [PPO](/foundations/llm-fundamentals/ppo/index.md) Creator not supplied; see original source. arXiv paper (2017) "Proximal Policy Optimization Algorithms", introducing PPO, a policy gradient method with a clipped surrogate objective. Advanced–Expert · unknown · unknown resource · en - ### [Pyro](/foundations/courses-and-learning-paths/pyro/index.md) Creator not supplied; see original source. Pyro: deep probabilistic programming library on PyTorch with inference tutorials. Advanced · unknown · unknown resource · en - ### [Relational inductive biases, deep learning, and graph networks](/foundations/llm-fundamentals/relational-inductive-biases-graph-networks/index.md) Creator not supplied; see original source. arXiv paper (2018) "Relational inductive biases, deep learning, and graph networks", defining the graph network block that unifies many GNN variants. Advanced–Expert · unknown · unknown resource · en - ### [ResNet](/foundations/llm-fundamentals/resnet/index.md) Creator not supplied; see original source. arXiv paper (2015) "Deep Residual Learning for Image Recognition", introducing ResNet residual networks. Advanced–Expert · unknown · unknown resource · en - ### [RL4CO](/foundations/llm-fundamentals/rl4co/index.md) Creator not supplied; see original source. RL4CO documentation: reinforcement-learning benchmark and library for combinatorial optimisation problems. Advanced · unknown · unknown resource · en - ### [RWKV](/foundations/llm-fundamentals/rwkv/index.md) Creator not supplied; see original source. arXiv paper (2023) introducing RWKV, a recurrent architecture trained in parallel like a transformer. Advanced–Expert · unknown · unknown resource · en - ### [Efficiently Modeling Long Sequences with Structured State Spaces (S4)](/foundations/llm-fundamentals/s4-structured-state-spaces/index.md) Creator not supplied; see original source. arXiv paper (2021) "Efficiently Modeling Long Sequences with Structured State Spaces", introducing S4, structured state space models for long sequences. Advanced–Expert · unknown · unknown resource · en - ### [SAC](/foundations/llm-fundamentals/sac/index.md) Creator not supplied; see original source. arXiv paper (2018) introducing Soft Actor-Critic (SAC), off-policy maximum-entropy deep reinforcement learning. Advanced–Expert · unknown · unknown resource · en - ### [SAM](/foundations/llm-fundamentals/sam/index.md) Creator not supplied; see original source. arXiv paper (2023) introducing Segment Anything (SAM), a promptable image segmentation model and dataset. Advanced–Expert · unknown · unknown resource · en - ### [Scaling Laws for Neural Language Models](/foundations/courses-and-learning-paths/scaling-laws-for-neural-language-models/index.md) Creator not supplied; see original source. arXiv paper (2020) "Scaling Laws for Neural Language Models", measuring power-law scaling of language model loss with size, data and compute. Advanced · unknown · unknown resource · en - ### [scvi-tools](/foundations/courses-and-learning-paths/scvi-tools/index.md) Creator not supplied; see original source. scvi-tools: library of probabilistic deep generative models for single-cell omics data. Advanced · unknown · unknown resource · en [Previous page](/foundations/advanced/page/17/index.md) [Next page](/foundations/advanced/page/19/index.md) [Plain-text Markdown copy](/foundations/advanced/page/18/index.md)