Interpretability

13 resources · page 1 of 1

• Transformer Circuits Thread

  Creator not supplied; see original source.

  Transformer Circuits Thread: Anthropic interpretability research series reverse-engineering transformer models.

  Not applicable (entity) · unknown · unknown resource · en

• Neuronpedia

  Creator not supplied; see original source.

  Neuronpedia: open-source interpretability platform for exploring sparse autoencoder features and circuits.

  Not applicable (entity) · unknown · unknown resource · en

• SAELens

  Creator not supplied; see original source.

  SAELens GitHub repo: training and analysing sparse autoencoders on language models.

  Not applicable (entity) · unknown · unknown resource · en

• TransformerLens

  Creator not supplied; see original source.

  TransformerLens GitHub repo: library for mechanistic interpretability of GPT-style language models.

  Not applicable (entity) · unknown · unknown resource · en

• Transluce

  Creator not supplied; see original source.

  Transluce: nonprofit lab building open tools for AI oversight and interpretability.

  Not applicable (entity) · unknown · unknown resource · en

• Apollo Research: Science

  Creator not supplied; see original source.

  Apollo Research science page listing its research and pre-deployment evaluations on AI scheming and mitigations.

  Intermediate–Advanced · unknown · unknown resource · en

• Interpretable Machine Learning

  Creator not supplied; see original source.

  Christoph Molnar's Interpretable Machine Learning book: free online guide to explainability methods and their limits.

  Intermediate · unknown · unknown resource · en

• How To Become A Mechanistic Interpretability Researcher

  Creator not supplied; see original source.

  Neel Nanda's AI Alignment Forum guide on how to become a mechanistic interpretability researcher, which replaced his earlier getting-started page.

  Intermediate · unknown · unknown resource · en

• Goodfire research

  Creator not supplied; see original source.

  Goodfire research page: interpretability research on understanding and editing the internals of AI models.

  Advanced · unknown · unknown resource · en

• InterpretML

  Creator not supplied; see original source.

  InterpretML: open-source toolkit for glassbox models and explaining ML model behaviour.

  Advanced · unknown · unknown resource · en

• Tracing the thoughts of a large language model

  Creator not supplied; see original source.

  Anthropic interpretability research tracing internal mechanisms of Claude with attribution graphs.

  Advanced · unknown · unknown resource · en

• A Mathematical Framework for Transformer Circuits

  Creator not supplied; see original source.

  Anthropic Transformer Circuits paper A Mathematical Framework for Transformer Circuits (2021).

  Expert · unknown · unknown resource · en

• On the Biology of a Large Language Model

  Creator not supplied; see original source.

  Anthropic Transformer Circuits paper On the Biology of a Large Language Model: attribution graphs on Claude 3.5 Haiku.

  Expert · unknown · unknown resource · en

Plain-text Markdown copy