Modality Evals Image Video Speech

87 resources · page 1 of 3

• 3D Arena (HF Space)

  Creator not supplied; see original source.

  3D Arena Space: voting arena and leaderboard for AI-generated 3D models.

  Not applicable (entity) · unknown · unknown resource · en

• 3DGen-Arena (3DTopia)

  Creator not supplied; see original source.

  3DTopia 3DGen-Arena Space: arena comparing open-source text- and image-to-3D generation models.

  Not applicable (entity) · unknown · unknown resource · en

• ActivityNet

  Creator not supplied; see original source.

  ActivityNet GitHub repo: tools and evaluation code for the ActivityNet human activity benchmark.

  Not applicable (entity) · unknown · unknown resource · en

• Artificial Analysis ASR leaderboard

  Creator not supplied; see original source.

  Artificial Analysis leaderboard for non-streaming speech-to-text, comparing word error rate, processing speed and price per model.

  Not applicable (entity) · unknown · unknown resource · en

• Artificial Analysis Image Arena

  Creator not supplied; see original source.

  Artificial Analysis Image Arena: blind-vote rankings of text-to-image and image editing models.

  Not applicable (entity) · unknown · unknown resource · en

• Artificial Analysis Image Editing Leaderboard

  Creator not supplied; see original source.

  Artificial Analysis image editing leaderboard: blind-vote rankings of image editing models with speed and price.

  Not applicable (entity) · unknown · unknown resource · en

• Artificial Analysis speech arena

  Creator not supplied; see original source.

  Artificial Analysis Speech Arena: blind human votes between paired text-to-speech samples to rank voice models.

  Not applicable (entity) · unknown · unknown resource · en

• Artificial Analysis Text to Speech Leaderboard

  Creator not supplied; see original source.

  Artificial Analysis text-to-speech leaderboard: Elo rankings of speech models from blind pairwise votes.

  Not applicable (entity) · unknown · unknown resource · en

• Artificial Analysis Speech to Text Leaderboard

  Creator not supplied; see original source.

  Artificial Analysis speech-to-text leaderboard ranking ASR models by word error rate, speed and price.

  Not applicable (entity) · unknown · unknown resource · en

• Artificial Analysis text-to-image arena

  Creator not supplied; see original source.

  Artificial Analysis text-to-image arena where users vote between anonymous image outputs to rank models.

  Not applicable (entity) · unknown · unknown resource · en

• Artificial Analysis Text-to-Image Leaderboard

  Creator not supplied; see original source.

  Artificial Analysis text-to-image leaderboard: blind-vote rankings of image models with generation speed and price.

  Not applicable (entity) · unknown · unknown resource · en

• Artificial Analysis TTS leaderboard

  Creator not supplied; see original source.

  Artificial Analysis text-to-speech leaderboard comparing voice quality preference, speed and price of speech generation models.

  Not applicable (entity) · unknown · unknown resource · en

• Artificial Analysis video arena

  Creator not supplied; see original source.

  Artificial Analysis Video Arena: blind-vote rankings of AI video generation models.

  Not applicable (entity) · unknown · unknown resource · und

• AudioBench

  Creator not supplied; see original source.

  AudioBench GitHub repo: benchmark toolkit for evaluating audio large language models across speech and audio tasks.

  Not applicable (entity) · unknown · unknown resource · en

• Audiobox Aesthetics

  Creator not supplied; see original source.

  Meta audiobox-aesthetics GitHub repo: automatic quality assessment models for speech, music and sound.

  Not applicable (entity) · unknown · unknown resource · en

• BLINK

  Creator not supplied; see original source.

  BLINK project page: benchmark of visual perception tasks that multimodal LLMs find hard, such as depth and correspondence.

  Not applicable (entity) · unknown · unknown resource · en

• ChartQA

  Creator not supplied; see original source.

  ChartQA GitHub repo: benchmark for question answering over charts.

  Not applicable (entity) · unknown · unknown resource · en

• CIFAR-10 and CIFAR-100

  Creator not supplied; see original source.

  Creator-hosted page for the CIFAR-10 and CIFAR-100 image classification datasets, with download links and format details.

  Not applicable (entity) · unknown · unknown resource · en

• DocVQA

  Creator not supplied; see original source.

  DocVQA site: document visual question answering challenges and datasets built from real document images.

  Not applicable (entity) · unknown · unknown resource · en

• DPG-Bench (TencentQQGYLab/ELLA)

  Creator not supplied; see original source.

  TencentQQGYLab ELLA GitHub repo: LLM-equipped diffusion models and the DPG-Bench dense prompt benchmark.

  Not applicable (entity) · unknown · unknown resource · en

• DreamBench++

  Creator not supplied; see original source.

  DreamBench++ project page: a human-aligned benchmark for personalised, subject-driven image generation.

  Not applicable (entity) · unknown · unknown resource · en

• EditBench

  Creator not supplied; see original source.

  Google Research page for Imagen Editor and EditBench, a benchmark for text-guided image inpainting with human evaluation.

  Not applicable (entity) · unknown · unknown resource · en

• EgoSchema

  Creator not supplied; see original source.

  EgoSchema site: long-form egocentric video question answering for testing long-range video understanding.

  Not applicable (entity) · unknown · unknown resource · en

• encodechka

  Creator not supplied; see original source.

  encodechka GitHub repo: benchmark of Russian sentence encoders across tasks, with a results table.

  Not applicable (entity) · unknown · unknown resource · en

• EvalCrafter

  Creator not supplied; see original source.

  EvalCrafter project page: a framework for evaluating text-to-video models with automatic metrics and human ratings.

  Not applicable (entity) · unknown · unknown resource · en

• GEdit-Bench (StepFun Step1X-Edit)

  Creator not supplied; see original source.

  StepFun Step1X-Edit GitHub repo: open image-editing model whose release includes GEdit-Bench, a benchmark of real-world editing requests.

  Not applicable (entity) · unknown · unknown resource · en

• GenAI-Arena (TIGER Lab)

  Creator not supplied; see original source.

  TIGER Lab GenAI-Arena Space: academic arena voting between generative image, editing and video models.

  Not applicable (entity) · unknown · unknown resource · en

• GenEval

  Creator not supplied; see original source.

  GenEval GitHub repo: object-focused framework for evaluating text-to-image alignment.

  Not applicable (entity) · unknown · unknown resource · en

• GQA

  Creator not supplied; see original source.

  GQA dataset site: real-image visual question answering with scene graphs for testing compositional reasoning.

  Not applicable (entity) · unknown · unknown resource · en

• HEAR

  Creator not supplied; see original source.

  HEAR benchmark site: holistic evaluation of audio representations across speech, music and environmental sound tasks.

  Not applicable (entity) · unknown · unknown resource · en

• HEIM

  Creator not supplied; see original source.

  Stanford CRFM HEIM: holistic evaluation of text-to-image models on quality, alignment, bias and other dimensions.

  Not applicable (entity) · unknown · unknown resource · en

• ImageReward

  Creator not supplied; see original source.

  ImageReward GitHub repo (NeurIPS 2023): human preference reward model and data for text-to-image evaluation.

  Not applicable (entity) · unknown · unknown resource · en

Plain-text Markdown copy