--- id: "/safety-security-interpretability/interpretability/" title: "interpretability: 13 curated resources" url: "https://skillissue.dev/safety-security-interpretability/interpretability/" --- # interpretability: 13 curated resources interpretability [Beginner](/safety-security-interpretability/beginner/index.md) [Intermediate](/safety-security-interpretability/intermediate/index.md) [Advanced](/safety-security-interpretability/advanced/index.md) [Expert](/safety-security-interpretability/expert/index.md) 13 resources · page 1 of 1 - ### [Transformer Circuits Thread](/security-and-red-teaming/safety-and-alignment-evals/model-welfare-interpretability/index.md) by [Anthropic](https://www.anthropic.com/) Transformer Circuits Thread: Anthropic interpretability research series reverse-engineering transformer models. entity org US; international en - ### [Neuronpedia](/security-and-red-teaming/safety-and-alignment-evals/neuronpedia/index.md) by [Neuronpedia](https://neuronpedia.org/) Neuronpedia: open-source interpretability platform for exploring sparse autoencoder features and circuits. entity lab US en - ### [SAELens](/security-and-red-teaming/safety-and-alignment-evals/saelens/index.md) by [Decode Research](https://decoderesearch.org) SAELens GitHub repo: training and analysing sparse autoencoders on language models. entity repo Global en - ### [TransformerLens](/security-and-red-teaming/safety-and-alignment-evals/transformerlens/index.md) by [TransformerLensOrg](https://github.com/TransformerLensOrg) TransformerLens GitHub repo: library for mechanistic interpretability of GPT-style language models. entity repo US en - ### [Transluce](/security-and-red-teaming/safety-and-alignment-evals/transluce/index.md) by [Transluce](https://transluce.org/) Transluce: nonprofit lab building open tools for AI oversight and interpretability. entity lab US en - ### [Apollo Research: Science](/security-and-red-teaming/safety-and-alignment-evals/apollo-research/index.md) by [Apollo Research](https://apolloresearch.ai/) Apollo Research science page listing its research and pre-deployment evaluations on AI scheming and mitigations. Intermediate–Advanced learning_resource docs UK en - ### [Interpretable Machine Learning](/security-and-red-teaming/safety-and-alignment-evals/interpretable-machine-learning/index.md) by [Christoph Molnar](https://christophm.github.io/) Christoph Molnar's Interpretable Machine Learning book: free online guide to explainability methods and their limits. Intermediate learning_resource guide Germany en - ### [How To Become A Mechanistic Interpretability Researcher](/security-and-red-teaming/safety-and-alignment-evals/neel-nanda-getting-started-in-mech-interp/index.md) by [Neel Nanda](https://www.neelnanda.io/) Neel Nanda's AI Alignment Forum guide on how to become a mechanistic interpretability researcher, which replaced his earlier getting-started page. Intermediate learning_resource guide UK en - ### [Goodfire research](/security-and-red-teaming/safety-and-alignment-evals/goodfire-research/index.md) by [Goodfire](https://goodfire.com/) Goodfire research page: interpretability research on understanding and editing the internals of AI models. Advanced learning_resource docs US en - ### [InterpretML](/security-and-red-teaming/safety-and-alignment-evals/interpretml/index.md) by [Microsoft (InterpretML)](https://interpret.ml/) InterpretML: open-source toolkit for glassbox models and explaining ML model behaviour. Advanced learning_resource docs US; international en - ### [Tracing the thoughts of a large language model](/security-and-red-teaming/safety-and-alignment-evals/tracing-the-thoughts-of-a-large-language-model/index.md) by [Anthropic](https://anthropic.com/) Anthropic interpretability research tracing internal mechanisms of Claude with attribution graphs. Advanced learning_resource paper US en - ### [A Mathematical Framework for Transformer Circuits](/security-and-red-teaming/safety-and-alignment-evals/a-mathematical-framework-for-transformer-circuits/index.md) by [Anthropic](https://www.anthropic.com/) Anthropic Transformer Circuits paper A Mathematical Framework for Transformer Circuits (2021). Expert learning_resource paper US en - ### [On the Biology of a Large Language Model](/security-and-red-teaming/safety-and-alignment-evals/on-the-biology-of-a-large-language-model/index.md) by [Anthropic](https://www.anthropic.com/) Anthropic Transformer Circuits paper On the Biology of a Large Language Model: attribution graphs on Claude 3.5 Haiku. Expert learning_resource paper US en [Plain-text Markdown copy](/safety-security-interpretability/interpretability/index.md)