Data & datasets for advanced learners
45 resources · page 2 of 2
Ai2 model cards and datasets
by Ai2
Ai2's Hugging Face organisation page listing its model checkpoints, model cards and datasets, including OLMo.
Alibi Detect
by Seldon
Alibi Detect documentation: Python library for outlier, adversarial and data-drift detection in ML systems.
Cleanlab documentation
by Cleanlab
Cleanlab documentation: open-source library for finding label errors and data issues in ML datasets.
Datasheets for Datasets
by Timnit Gebru et al. (Microsoft Research)
Microsoft Research page for Datasheets for Datasets, proposing standard documentation for ML datasets.
LanceDB documentation
by LanceDB
LanceDB documentation: multimodal lakehouse and vector database for AI data, with versioned tables and retrieval.
LLM-jp corpora (GitLab)
by LLM-jp (National Institute of Informatics)
LLM-jp datasets on the NII GitLab: open Japanese pretraining corpora.
NeurIPS paper checklist
NeurIPS paper checklist covering assumptions, limitations, experimental details, reproducibility and broader impacts.
Qdrant documentation
by Qdrant
Qdrant documentation: vector search engine with quickstarts, filtering, hybrid search and deployment guides.
Retrieval-Augmented Generation
by Patrick Lewis et al. (Facebook AI Research)
arXiv paper (2020) "Retrieval-Augmented Generation for Knowledge-Intensive NLP Tasks", introducing retrieval-augmented generation (RAG).
RL environments for LLM agents: Design, rewards, and validation (Snorkel)
by Snorkel AI
Snorkel AI post on designing RL environments for LLM agents: state, actions, rewards and validation.
Partial Credit in RL: When It Opposes Completion (Snorkel)
by Snorkel AI
Snorkel AI post on how partial-credit rewards in reinforcement learning can work against task completion.
Training Compute-Optimal Large Language Models
by Jordan Hoffmann et al. (DeepMind)
arXiv paper (2022) "Training Compute-Optimal Large Language Models", describing Chinchilla and compute-optimal model size versus training tokens.
Weaviate documentation
by Weaviate
Weaviate documentation: open-source vector database with guides on indexing, search and RAG pipelines.