Context Engineering
Select, retrieve and maintain information across model calls.
- Context Management (5)
- Retrieval And Rag (89)
- Memory (1)
- Agent Instruction Files (2)
- Loop Engineering (1)
98 resources · page 3 of 4
Selectel tutorial: Deploying a private LLM in a Kubernetes cluster
Creator not supplied; see original source.
Selectel tutorial in Russian on deploying a private LLM and RAG stack (vLLM, Qdrant, n8n) in Managed Kubernetes.
JetBrains AI Assistant: Generate documentation
Creator not supplied; see original source.
JetBrains AI Assistant documentation on generating code documentation with AI and customising the prompt.
Get started with Copilot in Excel (Excel support)
Creator not supplied; see original source.
Microsoft Support getting-started guide for Copilot in Excel: data analysis, formulas and charts.
Get started with Copilot in Excel
Creator not supplied; see original source.
Microsoft Support guide to Copilot in Excel for analysing data, generating formulas and creating charts.
Benchmarks are broken (Surge AI)
Creator not supplied; see original source.
Surge AI post arguing academic benchmarks poorly reflect model quality, with examples of benchmark flaws.
HANDBOOK.md Benchmark (Surge AI)
Creator not supplied; see original source.
Surge AI post on HANDBOOK.md, a benchmark testing whether agents follow long company policy handbooks.
HellaSwag or HellaBad? (Surge AI)
Creator not supplied; see original source.
Surge AI audit reporting errors in 36% of HellaSwag benchmark rows, with examples.
The Pile
Creator not supplied; see original source.
arXiv paper (2021) "The Pile: An 800GB Dataset of Diverse Text for Language Modeling", describing its 22 component sources and construction.
How Shopify and Toloka built a ground-truth flywheel
Creator not supplied; see original source.
Toloka case study on building a human-labelled ground-truth loop with Shopify to keep skill agents accurate.
Writing tests with GitHub Copilot
Creator not supplied; see original source.
GitHub tutorial on generating unit and integration tests with GitHub Copilot.
Ai2 model cards and datasets
Creator not supplied; see original source.
Ai2's Hugging Face organisation page listing its model checkpoints, model cards and datasets, including OLMo.
Alibi Detect
Creator not supplied; see original source.
Alibi Detect documentation: Python library for outlier, adversarial and data-drift detection in ML systems.
Effective harnesses for long-running agents
by Anthropic
Harness design for agents that work across many context windows.
Context Rot: How Increasing Input Tokens Impacts LLM Performance
by Chroma
Measures how output quality drops as input length grows.
Cleanlab documentation
Creator not supplied; see original source.
Cleanlab documentation: open-source library for finding label errors and data issues in ML datasets.
Datasheets for Datasets
Creator not supplied; see original source.
Microsoft Research page for Datasheets for Datasets, proposing standard documentation for ML datasets.
LanceDB documentation
Creator not supplied; see original source.
LanceDB documentation: multimodal lakehouse and vector database for AI data, with versioned tables and retrieval.
LLM-jp corpora (GitLab)
Creator not supplied; see original source.
LLM-jp datasets on the NII GitLab: open Japanese pretraining corpora.
A Survey of Context Engineering for LLMs (arXiv 2507.13334)
by Mei et al. (Chinese Academy of Sciences et al.)
A research map of retrieval, context processing and memory systems.
NeurIPS paper checklist
Creator not supplied; see original source.
NeurIPS paper checklist covering assumptions, limitations, experimental details, reproducibility and broader impacts.
RAG Techniques
by Nir Diamant and contributors
Compare retrieval designs through code-oriented examples.
Qdrant documentation
Creator not supplied; see original source.
Qdrant documentation: vector search engine with quickstarts, filtering, hybrid search and deployment guides.
Retrieval-Augmented Generation
Creator not supplied; see original source.
arXiv paper (2020) "Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks", introducing retrieval-augmented generation (RAG).
RL environments for LLM agents: Design, rewards, and validation (Snorkel)
Creator not supplied; see original source.
Snorkel AI post on designing RL environments for LLM agents: state, actions, rewards and validation.
Partial Credit in RL: When It Opposes Completion (Snorkel)
Creator not supplied; see original source.
Snorkel AI post on how partial-credit rewards in reinforcement learning can work against task completion.
Training Compute-Optimal Large Language Models
Creator not supplied; see original source.
arXiv paper (2022) "Training Compute-Optimal Large Language Models", describing Chinchilla and compute-optimal model size versus training tokens.
Weaviate documentation
Creator not supplied; see original source.
Weaviate documentation: open-source vector database with guides on indexing, search and RAG pipelines.
Synthetic Data in Investment Management (CFA Institute)
Creator not supplied; see original source.
CFA Institute Research and Policy Center report (2025) on synthetic data in investment management.
DataComp / DCLM
Creator not supplied; see original source.
DataComp site: data-centric benchmarks for building better training datasets for CLIP models and language models (DCLM).
DCLM paper
Creator not supplied; see original source.
arXiv paper (2024) introducing DataComp-LM (DCLM), a testbed for curating language model training sets.
Context Engineering for AI Agents: Lessons from Building Manus
Creator not supplied; see original source.
Manus post on context engineering lessons: designing around the KV cache, masking tools and using the filesystem as memory.
Microsoft GraphRAG
Creator not supplied; see original source.
Microsoft GraphRAG documentation: RAG approach that builds an LLM-generated knowledge graph for global summarisation queries.