--- id: "/foundations/page/21/" title: "Foundations · page 21" creator: null creator_url: null creator_x: null url: "https://skillissue.dev/foundations/page/21/" level: null level_max: null category: null subcategory: null region: null license: null license_scope: null access: null models: null source_date: null date_added: null resource_kind: null verification_basis: null access_evidence: null domain_top: null domain_sub: null last_verified: null --- # Foundations Understand language models and choose a learning path. - [Llm Fundamentals](/foundations/llm-fundamentals/index.md) (139) - [Courses And Learning Paths](/foundations/courses-and-learning-paths/index.md) (179) - [From Scratch Implementations](/foundations/from-scratch-implementations/index.md) (1) - [Practitioner Overviews](/foundations/practitioner-overviews/index.md) (387) [Beginner](/foundations/beginner/index.md) [Intermediate](/foundations/intermediate/index.md) [Advanced](/foundations/advanced/index.md) [Expert](/foundations/expert/index.md) 706 resources · page 21 of 23 - ### [Convex Optimization](/foundations/courses-and-learning-paths/convex-optimization/index.md) Creator not supplied; see original source. Boyd and Vandenberghe's Convex Optimization book site with free PDF, slides and exercises. Advanced · unknown · unknown resource · en - ### [DenseNet](/foundations/llm-fundamentals/densenet/index.md) Creator not supplied; see original source. arXiv paper (2016) "Densely Connected Convolutional Networks", introducing DenseNet, where each layer receives feature maps from all earlier layers. Advanced–Expert · unknown · unknown resource · en - ### [DETR](/foundations/llm-fundamentals/detr/index.md) Creator not supplied; see original source. arXiv HTML version of the DETR paper (2020) on end-to-end object detection with transformers. Advanced–Expert · unknown · unknown resource · en - ### [DINOv2: Learning Robust Visual Features without Supervision](/foundations/llm-fundamentals/dinov2-2/index.md) Creator not supplied; see original source. arXiv HTML version of the DINOv2 paper (2023) on self-supervised visual features. Advanced–Expert · unknown · unknown resource · en - ### [Deep Learning Recommendation Model for Personalization and Recommendation Systems (DLRM)](/foundations/llm-fundamentals/dlrm-2/index.md) Creator not supplied; see original source. arXiv PDF of Meta's DLRM paper (2019), a deep learning recommendation model for personalisation. Advanced–Expert · unknown · unknown resource · und - ### [DQN (Atari)](/foundations/llm-fundamentals/dqn-atari/index.md) Creator not supplied; see original source. arXiv paper (2013) "Playing Atari with Deep Reinforcement Learning", introducing DQN, deep Q-learning from pixels on Atari games. Advanced–Expert · unknown · unknown resource · en - ### [DreamerV3](/foundations/llm-fundamentals/dreamerv3/index.md) Creator not supplied; see original source. arXiv paper (2023) introducing DreamerV3, a world-model RL agent that masters diverse domains with fixed settings. Advanced–Expert · unknown · unknown resource · en - ### [EfficientNet](/foundations/llm-fundamentals/efficientnet/index.md) Creator not supplied; see original source. ICML 2019 paper (PDF) EfficientNet: scaling convolutional networks by depth, width and resolution. Advanced–Expert · unknown · unknown resource · und - ### [ESPnet](/foundations/llm-fundamentals/espnet/index.md) Creator not supplied; see original source. ESPnet documentation: end-to-end speech processing toolkit with recipes for recognition, synthesis and translation. Advanced · unknown · unknown resource · en - ### [Faster R-CNN](/foundations/llm-fundamentals/faster-r-cnn/index.md) Creator not supplied; see original source. NeurIPS paper (PDF, 2015) Faster R-CNN: real-time object detection with region proposal networks. Advanced–Expert · unknown · unknown resource · zh - ### [GAT](/foundations/llm-fundamentals/gat/index.md) Creator not supplied; see original source. arXiv paper (2017) "Graph Attention Networks", introducing GAT, which weights neighbour nodes with masked self-attention. Advanced–Expert · unknown · unknown resource · en - ### [GCN](/foundations/llm-fundamentals/gcn/index.md) Creator not supplied; see original source. arXiv paper (2016) "Semi-Supervised Classification with Graph Convolutional Networks", introducing GCN layers for node classification. Advanced–Expert · unknown · unknown resource · en - ### [GraphSAGE](/foundations/llm-fundamentals/graphsage/index.md) Creator not supplied; see original source. arXiv paper (2017) "Inductive Representation Learning on Large Graphs", introducing GraphSAGE for inductive node embeddings. Advanced–Expert · unknown · unknown resource · en - ### [GRU](/foundations/llm-fundamentals/gru/index.md) Creator not supplied; see original source. arXiv paper (2014) introducing the RNN encoder–decoder with gated recurrent units (GRU) for machine translation. Advanced–Expert · unknown · unknown resource · en - ### [GRU empirical evaluation](/foundations/llm-fundamentals/gru-empirical-evaluation/index.md) Creator not supplied; see original source. arXiv paper (2014) empirically comparing gated recurrent units (GRU) and LSTM on sequence modelling. Advanced–Expert · unknown · unknown resource · en - ### [IMPALA](/foundations/llm-fundamentals/impala/index.md) Creator not supplied; see original source. arXiv paper (2018) introducing IMPALA, a scalable distributed deep RL architecture. Advanced–Expert · unknown · unknown resource · en - ### [Inception / GoogLeNet](/foundations/llm-fundamentals/inception-googlenet/index.md) Creator not supplied; see original source. arXiv PDF of the GoogLeNet paper (2014) introducing the Inception architecture. Advanced–Expert · unknown · unknown resource · und - ### [Jumanji](/foundations/llm-fundamentals/jumanji/index.md) Creator not supplied; see original source. Jumanji documentation: InstaDeep's suite of JAX reinforcement-learning environments for combinatorial and decision problems. Advanced · unknown · unknown resource · en - ### [Kraken](/foundations/courses-and-learning-paths/kraken/index.md) Creator not supplied; see original source. Kraken documentation: open-source text recognition system for historical and non-Latin scripts. Advanced · unknown · unknown resource · en - ### [Language Models are Few-Shot Learners](/foundations/courses-and-learning-paths/language-models-are-few-shot-learners/index.md) Creator not supplied; see original source. arXiv paper (2020) "Language Models are Few-Shot Learners", introducing GPT-3 and in-context few-shot learning. Advanced · unknown · unknown resource · en - ### [Lil'Log](/foundations/practitioner-overviews/lilian-weng-lil-log/index.md) by [Lilian Weng](https://lilianweng.github.io/) [@lilianweng](https://twitter.com/lilianweng/) Research learning notes that connect methods to their literature. Advanced · West · closed resource · en - ### [Mask R-CNN](/foundations/llm-fundamentals/mask-r-cnn/index.md) Creator not supplied; see original source. arXiv paper (2017) "Mask R-CNN", introducing Mask R-CNN for instance segmentation. Advanced–Expert · unknown · unknown resource · en - ### [MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications](/foundations/llm-fundamentals/mobilenet/index.md) Creator not supplied; see original source. arXiv PDF of the MobileNets paper (2017) on efficient convolutional networks for mobile vision. Advanced–Expert · unknown · unknown resource · und - ### [Moirai](/foundations/llm-fundamentals/moirai/index.md) Creator not supplied; see original source. arXiv PDF of the Moirai paper (2024), Salesforce's universal time-series forecasting transformer. Advanced–Expert · unknown · unknown resource · und - ### [Montreal Forced Aligner](/foundations/llm-fundamentals/montreal-forced-aligner/index.md) Creator not supplied; see original source. Montreal Forced Aligner documentation: tool for aligning speech audio with transcripts and training pronunciation models. Advanced · unknown · unknown resource · en - ### [MuZero](/foundations/llm-fundamentals/muzero/index.md) Creator not supplied; see original source. arXiv paper (2019) introducing MuZero, planning with a learned model to master Atari, Go, chess and shogi. Advanced–Expert · unknown · unknown resource · en - ### [Neural Collaborative Filtering](/foundations/llm-fundamentals/neural-collaborative-filtering/index.md) Creator not supplied; see original source. arXiv PDF of the Neural Collaborative Filtering paper (2017) for neural recommender systems. Advanced–Expert · unknown · unknown resource · zh - ### [OpenAI Five (Dota 2)](/foundations/llm-fundamentals/openai-five-dota-2/index.md) Creator not supplied; see original source. arXiv paper (2019) "Dota 2 with Large Scale Deep Reinforcement Learning", describing OpenAI Five's large-scale reinforcement learning for Dota 2. Advanced–Expert · unknown · unknown resource · en - ### [OpenNMT](/foundations/courses-and-learning-paths/opennmt/index.md) Creator not supplied; see original source. OpenNMT site: open-source ecosystem for neural machine translation with training and deployment tools. Advanced · unknown · unknown resource · en - ### [pgmpy](/foundations/courses-and-learning-paths/pgmpy/index.md) Creator not supplied; see original source. pgmpy documentation: Python library for probabilistic graphical models and causal inference. Advanced · unknown · unknown resource · en - ### [PPO](/foundations/llm-fundamentals/ppo/index.md) Creator not supplied; see original source. arXiv paper (2017) "Proximal Policy Optimization Algorithms", introducing PPO, a policy gradient method with a clipped surrogate objective. Advanced–Expert · unknown · unknown resource · en - ### [Pyro](/foundations/courses-and-learning-paths/pyro/index.md) Creator not supplied; see original source. Pyro: deep probabilistic programming library on PyTorch with inference tutorials. Advanced · unknown · unknown resource · en [Previous page](/foundations/page/20/index.md) [Next page](/foundations/page/22/index.md) [Plain-text Markdown copy](/foundations/page/21/index.md)