--- id: "/tags/data-datasets/" title: "Data Datasets" creator: null creator_url: null creator_x: null url: "https://skillissue.dev/tags/data-datasets/" level: null level_max: null category: null subcategory: null region: null license: null license_scope: null access: null models: null source_date: null date_added: null resource_kind: null verification_basis: null access_evidence: null domain_top: null domain_sub: null last_verified: null --- # Data Datasets [Beginner](/levels/beginner/index.md) [Intermediate](/levels/intermediate/index.md) [Advanced](/levels/advanced/index.md) [Expert](/levels/expert/index.md) 88 resources · page 1 of 3 - ### [AI9Stars model and dataset registry](/context-engineering/retrieval-and-rag/ai9stars-model-and-dataset-registry/index.md) Creator not supplied; see original source. AI9Stars Hugging Face organisation: compact G9 language models and datasets. Not applicable (entity) · unknown · unknown resource · en - ### [AMLSim](/context-engineering/retrieval-and-rag/amlsim/index.md) Creator not supplied; see original source. IBM AMLSim GitHub repo: multi-agent simulator generating synthetic bank transaction data for anti-money-laundering research. Not applicable (entity) · unknown · unknown resource · en - ### [Argilla](/context-engineering/retrieval-and-rag/argilla-repo/index.md) Creator not supplied; see original source. Argilla GitHub repo: collaboration tool for building datasets with human feedback and annotation. Not applicable (entity) · unknown · unknown resource · en - ### [ColBERT](/context-engineering/retrieval-and-rag/colbert/index.md) Creator not supplied; see original source. Stanford ColBERT GitHub repo: late-interaction neural retrieval model and library. Not applicable (entity) · unknown · unknown resource · en - ### [Common Crawl](/context-engineering/retrieval-and-rag/common-crawl/index.md) Creator not supplied; see original source. Common Crawl: nonprofit maintaining an open repository of web crawl data, a common source of model training data. Not applicable (entity) · unknown · unknown resource · en - ### [data engineering / RAG pipelines](/context-engineering/retrieval-and-rag/data-engineering-rag-pipelines/index.md) Creator not supplied; see original source. InfiniFlow RAGFlow GitHub repo: open-source retrieval-augmented generation engine with document parsing. Not applicable (entity) · unknown · unknown resource · en - ### [datatrove](/context-engineering/retrieval-and-rag/datatrove/index.md) Creator not supplied; see original source. Hugging Face datatrove GitHub repo: large-scale text data processing library, used to build FineWeb. Not applicable (entity) · unknown · unknown resource · en - ### [DatologyAI](/context-engineering/retrieval-and-rag/datologyai/index.md) Creator not supplied; see original source. DatologyAI: company offering automated curation of model training data. Not applicable (entity) · unknown · unknown resource · en - ### [Docling (IBM)](/context-engineering/retrieval-and-rag/docling-ibm/index.md) Creator not supplied; see original source. IBM Docling GitHub repo: converts PDFs and other documents into structured formats for generative AI. Not applicable (entity) · unknown · unknown resource · en - ### [FathomNet](/context-engineering/retrieval-and-rag/fathomnet/index.md) Creator not supplied; see original source. FathomNet: labelled database of underwater images with ML tools for analysing ocean visual data. Not applicable (entity) · unknown · unknown resource · en - ### [FineWeb](/context-engineering/retrieval-and-rag/fineweb/index.md) Creator not supplied; see original source. Hugging Face FineWeb dataset: about 15 trillion tokens of filtered English web text for LLM pretraining. Not applicable (entity) · unknown · unknown resource · en - ### [Global Fishing Watch](/context-engineering/retrieval-and-rag/global-fishing-watch/index.md) Creator not supplied; see original source. Global Fishing Watch: uses machine learning on satellite and vessel data to map human activity at sea. Not applicable (entity) · unknown · unknown resource · en|es - ### [HF datasets](/context-engineering/retrieval-and-rag/hf-datasets/index.md) Creator not supplied; see original source. Hugging Face Datasets hub: searchable catalogue of public machine-learning datasets. Not applicable (entity) · unknown · unknown resource · und - ### [LightOn HF](/context-engineering/retrieval-and-rag/lighton-hf/index.md) Creator not supplied; see original source. LightOn Hugging Face organisation: retrieval, OCR and language models. Not applicable (entity) · unknown · unknown resource · und - ### [OtterTune wiki: An End-To-End Tuning Example](/context-engineering/retrieval-and-rag/machine-learning-database-configuration-tuning-an-end-to-end-tuning-example-veri/index.md) Creator not supplied; see original source. OtterTune wiki page on GitHub (CMU): end-to-end example of machine-learning database configuration tuning. Not applicable (entity) · unknown · unknown resource · en - ### [Marker (Datalab)](/context-engineering/retrieval-and-rag/marker-datalab/index.md) Creator not supplied; see original source. Datalab Marker GitHub repo: converts PDF documents to Markdown and JSON. Not applicable (entity) · unknown · unknown resource · en - ### [MinerU (OpenDataLab)](/context-engineering/retrieval-and-rag/mineru-opendatalab/index.md) Creator not supplied; see original source. OpenDataLab MinerU GitHub repo: converts PDFs and Office documents into Markdown and JSON. Not applicable (entity) · unknown · unknown resource · en - ### [Multimodal Universe](/context-engineering/retrieval-and-rag/multimodal-universe/index.md) Creator not supplied; see original source. Multimodal Universe GitHub repo: large dataset of astronomical images, spectra and light curves for training ML models. Not applicable (entity) · unknown · unknown resource · en - ### [MVTec Anomaly Detection dataset](/context-engineering/retrieval-and-rag/mvtec-anomaly-detection-dataset/index.md) Creator not supplied; see original source. MVTec AD dataset page: over 5,000 high-resolution images for industrial anomaly detection and localisation. Not applicable (entity) · unknown · unknown resource · en - ### [Qwen-Agent](/context-engineering/retrieval-and-rag/qwen-agent/index.md) Creator not supplied; see original source. QwenLM Qwen-Agent GitHub repo: agent framework with function calling, MCP and code interpreter for Qwen models. Not applicable (entity) · unknown · unknown resource · zh - ### [RAG_Techniques](/context-engineering/retrieval-and-rag/rag-techniques/index.md) Creator not supplied; see original source. RAG_Techniques GitHub repo (Nir Diamant): notebooks demonstrating many retrieval-augmented generation techniques. Not applicable (entity) · unknown · unknown resource · en - ### [circuit_training: Ariane RISC-V example](/context-engineering/retrieval-and-rag/reinforcement-learning-chip-floorplanning-circuit-training-at-scale-with-ariane-/index.md) Creator not supplied; see original source. Ariane documentation in Google's circuit_training repo: RL chip floorplanning on the Ariane RISC-V design. Not applicable (entity) · unknown · unknown resource · und - ### [Vera C. Rubin Observatory](/context-engineering/retrieval-and-rag/vera-c-rubin-observatory/index.md) Creator not supplied; see original source. Vera C. Rubin Observatory: NSF–DOE telescope running the LSST survey, whose alert stream requires ML triage. Not applicable (entity) · unknown · unknown resource · en|es - ### [xView2 / xBD](/context-engineering/retrieval-and-rag/xview2-xbd/index.md) Creator not supplied; see original source. xView2 challenge site: xBD satellite imagery dataset for assessing building damage after natural disasters. Not applicable (entity) · unknown · unknown resource · en - ### [Yambda dataset](/context-engineering/retrieval-and-rag/yambda-dataset/index.md) Creator not supplied; see original source. Yandex Yambda dataset on Hugging Face: large music-streaming interaction dataset for recommender-system research. Not applicable (entity) · unknown · unknown resource · en - ### [Postman: Write scripts to test API response data](/context-engineering/retrieval-and-rag/api-response-assertion-and-contract-test-authoring-write-scripts-to-test-api-res/index.md) Creator not supplied; see original source. Postman documentation on writing test scripts that assert API response data. Beginner–Intermediate · unknown · unknown resource · und - ### [DataTalksClub LLM Zoomcamp](/context-engineering/retrieval-and-rag/datatalksclub-llm-zoomcamp/index.md) Creator not supplied; see original source. DataTalksClub LLM Zoomcamp GitHub repo: free course on building LLM and RAG applications. Beginner–Intermediate · unknown · unknown resource · en - ### [Summarize incidents with Microsoft Copilot in Microsoft Defender](/context-engineering/retrieval-and-rag/defensive-soc-incident-summarization-and-triage-summarize-incidents-with-microso/index.md) Creator not supplied; see original source. Microsoft Learn page on generating incident summaries with Microsoft Copilot in Microsoft Defender. Beginner–Intermediate · unknown · unknown resource · en - ### [Getting started with Pulumi Neo](/context-engineering/retrieval-and-rag/infrastructure-as-code-maintenance-and-upgrade-planning-getting-started-with-pul/index.md) Creator not supplied; see original source. Pulumi documentation on setting up Pulumi Neo, an AI agent for infrastructure-as-code tasks. Beginner · unknown · unknown resource · en - ### [How to Shape a Strong AI Testing and Evaluation Ecosystem (Scale AI)](/context-engineering/retrieval-and-rag/scale-ai-building-trust-at-the-frontier/index.md) Creator not supplied; see original source. Scale AI policy post on building an AI testing and evaluation ecosystem for the United States. Beginner · unknown · unknown resource · en - ### [Screen annotators with Exams for higher-quality data (Toloka)](/context-engineering/retrieval-and-rag/toloka-screen-annotators-with-exams/index.md) Creator not supplied; see original source. Toloka post on screening data annotators with training and exams to improve label quality. Beginner · unknown · unknown resource · en - ### [Using GitHub Copilot code review](/context-engineering/retrieval-and-rag/ai-assisted-pull-request-code-review-using-github-copilot-code-review/index.md) Creator not supplied; see original source. GitHub documentation on requesting pull-request code reviews from GitHub Copilot. Intermediate · unknown · unknown resource · en [Next page](/tags/data-datasets/page/2/index.md) [Plain-text Markdown copy](/tags/data-datasets/index.md)