Data Datasets

88 resources · page 1 of 3

• AI9Stars model and dataset registry

  Creator not supplied; see original source.

  AI9Stars Hugging Face organisation: compact G9 language models and datasets.

  Not applicable (entity) · unknown · unknown resource · en

• AMLSim

  Creator not supplied; see original source.

  IBM AMLSim GitHub repo: multi-agent simulator generating synthetic bank transaction data for anti-money-laundering research.

  Not applicable (entity) · unknown · unknown resource · en

• Argilla

  Creator not supplied; see original source.

  Argilla GitHub repo: collaboration tool for building datasets with human feedback and annotation.

  Not applicable (entity) · unknown · unknown resource · en

• ColBERT

  Creator not supplied; see original source.

  Stanford ColBERT GitHub repo: late-interaction neural retrieval model and library.

  Not applicable (entity) · unknown · unknown resource · en

• Common Crawl

  Creator not supplied; see original source.

  Common Crawl: nonprofit maintaining an open repository of web crawl data, a common source of model training data.

  Not applicable (entity) · unknown · unknown resource · en

• data engineering / RAG pipelines

  Creator not supplied; see original source.

  InfiniFlow RAGFlow GitHub repo: open-source retrieval-augmented generation engine with document parsing.

  Not applicable (entity) · unknown · unknown resource · en

• datatrove

  Creator not supplied; see original source.

  Hugging Face datatrove GitHub repo: large-scale text data processing library, used to build FineWeb.

  Not applicable (entity) · unknown · unknown resource · en

• DatologyAI

  Creator not supplied; see original source.

  DatologyAI: company offering automated curation of model training data.

  Not applicable (entity) · unknown · unknown resource · en

• Docling (IBM)

  Creator not supplied; see original source.

  IBM Docling GitHub repo: converts PDFs and other documents into structured formats for generative AI.

  Not applicable (entity) · unknown · unknown resource · en

• FathomNet

  Creator not supplied; see original source.

  FathomNet: labelled database of underwater images with ML tools for analysing ocean visual data.

  Not applicable (entity) · unknown · unknown resource · en

• FineWeb

  Creator not supplied; see original source.

  Hugging Face FineWeb dataset: about 15 trillion tokens of filtered English web text for LLM pretraining.

  Not applicable (entity) · unknown · unknown resource · en

• Global Fishing Watch

  Creator not supplied; see original source.

  Global Fishing Watch: uses machine learning on satellite and vessel data to map human activity at sea.

  Not applicable (entity) · unknown · unknown resource · en|es

• HF datasets

  Creator not supplied; see original source.

  Hugging Face Datasets hub: searchable catalogue of public machine-learning datasets.

  Not applicable (entity) · unknown · unknown resource · und

• LightOn HF

  Creator not supplied; see original source.

  LightOn Hugging Face organisation: retrieval, OCR and language models.

  Not applicable (entity) · unknown · unknown resource · und

• OtterTune wiki: An End-To-End Tuning Example

  Creator not supplied; see original source.

  OtterTune wiki page on GitHub (CMU): end-to-end example of machine-learning database configuration tuning.

  Not applicable (entity) · unknown · unknown resource · en

• Marker (Datalab)

  Creator not supplied; see original source.

  Datalab Marker GitHub repo: converts PDF documents to Markdown and JSON.

  Not applicable (entity) · unknown · unknown resource · en

• MinerU (OpenDataLab)

  Creator not supplied; see original source.

  OpenDataLab MinerU GitHub repo: converts PDFs and Office documents into Markdown and JSON.

  Not applicable (entity) · unknown · unknown resource · en

• Multimodal Universe

  Creator not supplied; see original source.

  Multimodal Universe GitHub repo: large dataset of astronomical images, spectra and light curves for training ML models.

  Not applicable (entity) · unknown · unknown resource · en

• MVTec Anomaly Detection dataset

  Creator not supplied; see original source.

  MVTec AD dataset page: over 5,000 high-resolution images for industrial anomaly detection and localisation.

  Not applicable (entity) · unknown · unknown resource · en

• Qwen-Agent

  Creator not supplied; see original source.

  QwenLM Qwen-Agent GitHub repo: agent framework with function calling, MCP and code interpreter for Qwen models.

  Not applicable (entity) · unknown · unknown resource · zh

• RAG_Techniques

  Creator not supplied; see original source.

  RAG_Techniques GitHub repo (Nir Diamant): notebooks demonstrating many retrieval-augmented generation techniques.

  Not applicable (entity) · unknown · unknown resource · en

• circuit_training: Ariane RISC-V example

  Creator not supplied; see original source.

  Ariane documentation in Google's circuit_training repo: RL chip floorplanning on the Ariane RISC-V design.

  Not applicable (entity) · unknown · unknown resource · und

• Vera C. Rubin Observatory

  Creator not supplied; see original source.

  Vera C. Rubin Observatory: NSF–DOE telescope running the LSST survey, whose alert stream requires ML triage.

  Not applicable (entity) · unknown · unknown resource · en|es

• xView2 / xBD

  Creator not supplied; see original source.

  xView2 challenge site: xBD satellite imagery dataset for assessing building damage after natural disasters.

  Not applicable (entity) · unknown · unknown resource · en

• Yambda dataset

  Creator not supplied; see original source.

  Yandex Yambda dataset on Hugging Face: large music-streaming interaction dataset for recommender-system research.

  Not applicable (entity) · unknown · unknown resource · en

• Postman: Write scripts to test API response data

  Creator not supplied; see original source.

  Postman documentation on writing test scripts that assert API response data.

  Beginner–Intermediate · unknown · unknown resource · und

• DataTalksClub LLM Zoomcamp

  Creator not supplied; see original source.

  DataTalksClub LLM Zoomcamp GitHub repo: free course on building LLM and RAG applications.

  Beginner–Intermediate · unknown · unknown resource · en

• Summarize incidents with Microsoft Copilot in Microsoft Defender

  Creator not supplied; see original source.

  Microsoft Learn page on generating incident summaries with Microsoft Copilot in Microsoft Defender.

  Beginner–Intermediate · unknown · unknown resource · en

• Getting started with Pulumi Neo

  Creator not supplied; see original source.

  Pulumi documentation on setting up Pulumi Neo, an AI agent for infrastructure-as-code tasks.

  Beginner · unknown · unknown resource · en

• How to Shape a Strong AI Testing and Evaluation Ecosystem (Scale AI)

  Creator not supplied; see original source.

  Scale AI policy post on building an AI testing and evaluation ecosystem for the United States.

  Beginner · unknown · unknown resource · en

• Screen annotators with Exams for higher-quality data (Toloka)

  Creator not supplied; see original source.

  Toloka post on screening data annotators with training and exams to improve label quality.

  Beginner · unknown · unknown resource · en

• Using GitHub Copilot code review

  Creator not supplied; see original source.

  GitHub documentation on requesting pull-request code reviews from GitHub Copilot.

  Intermediate · unknown · unknown resource · en

Plain-text Markdown copy