--- id: "/evaluation-benchmarks/beginner/page/12/" title: "Evaluation & benchmarks for beginner learners · page 12" url: "https://skillissue.dev/evaluation-benchmarks/beginner/page/12/" --- # Evaluation & benchmarks for beginner learners [Beginner](/evaluation-benchmarks/beginner/index.md) [Intermediate](/evaluation-benchmarks/intermediate/index.md) [Advanced](/evaluation-benchmarks/advanced/index.md) [Expert](/evaluation-benchmarks/expert/index.md) 420 resources · page 12 of 14 - ### [SWE-Bench Pro: Can AI Agents Solve Long-Horizon Software Engineering Tasks?](/evaluation/benchmarks-and-leaderboards/swe-bench-pro-paper/index.md) by [Xiang Deng et al. (Scale AI)](https://scale.com/) SWE-Bench Pro paper: long-horizon software-engineering tasks, including a held-out commercial split, for evaluating coding agents. entity benchmark US (Scale) en - ### [SWE-Lancer](/evaluation/benchmarks-and-leaderboards/swe-lancer/index.md) by [OpenAI](https://openai.com/) OpenAI SWE-Lancer GitHub repo: dataset and code for real freelance software engineering tasks. entity repo US en - ### [SWE-MERA](/evaluation/benchmarks-and-leaderboards/swe-mera/index.md) by [MERA Evaluation](https://mera.a-ai.ru/) SWE-MERA page: continuously refreshed software-engineering tasks built as a contamination-resistant alternative to SWE-bench. entity benchmark Russia en - ### [SWE-rebench](/evaluation/benchmarks-and-leaderboards/swe-rebench/index.md) by [Nebius (SWE-rebench)](https://nebius.com/) SWE-rebench: continuously updated, decontaminated software-engineering benchmark with leaderboard. entity leaderboard EU/Russia (Nebius) en - ### [T-Tech Ru Dialogue Benchmarks](/evaluation/benchmarks-and-leaderboards/t-tech-ru-dialogue-benchmarks/index.md) by [T-Tech](https://huggingface.co/t-tech) T-Tech collection on Hugging Face of benchmarks for evaluating Russian-language dialogue models. entity benchmark Russia ru - ### [T2I-CompBench](/evaluation/benchmarks-and-leaderboards/t2i-compbench/index.md) by [Karine_H](https://github.com/Karine-Huang) T2I-CompBench GitHub repo: benchmark for compositional text-to-image generation such as attribute binding and spatial relations. entity repo China / International en - ### [T3Bench](/evaluation/benchmarks-and-leaderboards/t3bench/index.md) by [T3Bench team](https://t3bench.com/) T3Bench site: benchmark for text-to-3D generation measuring quality and alignment with the prompt. entity benchmark China / International en - ### [TabArena leaderboard](/evaluation/benchmarks-and-leaderboards/tabarena/index.md) by [TabArena](https://huggingface.co/TabArena) TabArena leaderboard Hugging Face Space: living benchmark of machine-learning models on tabular datasets. entity benchmark US / International en - ### [τ-bench](/evaluation/benchmarks-and-leaderboards/tau-bench-family-tau-tau2-tau3-bench/index.md) by [Sierra (τ-bench)](https://sierra.ai/) τ-bench site: benchmarks of AI agents conversing with users, calling tools and following policies across domains. entity leaderboard US (Sierra) en - ### [tau2-bench](/evaluation/benchmarks-and-leaderboards/tau2-bench/index.md) by [Sierra Research](https://sierra.ai) tau2-bench GitHub repo (Sierra): benchmark of tool-using agents interacting with users under domain policies. entity leaderboard West en - ### [TaxCalcBench (Column Tax)](/evaluation/benchmarks-and-leaderboards/taxcalcbench-tax-return-calculation-and-failure-analysis/index.md) by [Column Tax](https://www.columntax.com/) Column Tax post introducing TaxCalcBench, a benchmark of tax-return calculation cases with an analysis of where models fail. entity benchmark United States en - ### [TC260 national cybersecurity standards committee](/evaluation/benchmarks-and-leaderboards/tc260-national-cybersecurity-standards-committee/index.md) by [National Information Security Standardization Technical Committee (TC260)](https://www.tc260.org.cn/) TC260 official site: China's national cybersecurity standardisation committee, which issues AI security standards. entity standard-policy China zh - ### [Temporal Graph Benchmark](/evaluation/benchmarks-and-leaderboards/temporal-graph-benchmark/index.md) by [Complex Data Lab (McGill University and Mila)](https://www.complexdatalab.com/) Temporal Graph Benchmark documentation: datasets and tasks for evaluating machine learning on dynamic graphs. entity benchmark Canada / International en - ### [Terminal-Bench](/evaluation/benchmarks-and-leaderboards/terminal-bench/index.md) by [Terminal-Bench team (Stanford University and Laude Institute)](https://www.tbench.ai/) Terminal-Bench: benchmark of AI agents completing tasks in sandboxed terminal environments. entity leaderboard West en - ### [Terminal-Bench 2.0 (Snorkel)](/evaluation/benchmarks-and-leaderboards/terminal-bench-2-0-snorkel/index.md) by [Snorkel AI](https://snorkel.ai/) Snorkel-hosted Terminal-Bench 2.0 leaderboard: 89 human-checked terminal tasks scored by resolution rate. entity leaderboard US en - ### [Thai LLM Leaderboard](/evaluation/benchmarks-and-leaderboards/thai-llm-leaderboard/index.md) by [ThaiLLM Leaderboard](https://huggingface.co/ThaiLLM-Leaderboard) Thai LLM Leaderboard Hugging Face Space: evaluation results of models across Thai benchmarks. entity repo Thailand th - ### [The Agent Company](/evaluation/benchmarks-and-leaderboards/the-agent-company/index.md) by [TheAgentCompany team (Carnegie Mellon University)](https://the-agent-company.com/) TheAgentCompany site: benchmark of simulated software-company tasks for evaluating LLM agents across business tools. entity benchmark US / International en - ### [Therapeutics Data Commons](/evaluation/benchmarks-and-leaderboards/therapeutics-data-commons/index.md) by [Therapeutics Data Commons team (Harvard University)](https://tdcommons.ai/) Therapeutics Data Commons: datasets, tasks and leaderboards for machine learning across drug discovery and development. entity benchmark US / International en - ### [TII Arabic LLM benchmark index](/evaluation/benchmarks-and-leaderboards/tii-arabic-llm-benchmark-index/index.md) by [Technology Innovation Institute](https://tii.ae/) TII Arabic-LLM-Benchmarks GitHub repo: list of benchmarks for evaluating Arabic LLMs. entity repo United Arab Emirates; Arab region en - ### [TMMLU+ (Taiwan)](/evaluation/benchmarks-and-leaderboards/tmmlu-taiwan/index.md) by [iKala](https://huggingface.co/ikala) iKala TMMLU+ dataset: Traditional Chinese multiple-choice questions across 66 subjects with a Taiwan-specific context. entity benchmark Taiwan zh - ### [ToolBench](/evaluation/benchmarks-and-leaderboards/toolbench/index.md) by [OpenBMB](https://www.openbmb.cn) OpenBMB ToolBench GitHub repo (ICLR 2024): platform and benchmark for training and evaluating LLM tool use. entity repo China / International en - ### [Top 3D AI Arena](/evaluation/benchmarks-and-leaderboards/top-3d-ai-arena/index.md) by [Top 3D AI](https://top3d.ai/) Top 3D AI leaderboard ranking 3D generation tools by Elo from blind community votes. entity benchmark International en - ### [Российский энтузиаст создал бесплатный ИИ-бенчмарк (Tproger)](/evaluation/benchmarks-and-leaderboards/tproger-on-llm-arena-2024-07-31/index.md) by [Tproger](https://tproger.ru/) Tproger report in Russian on LLM Arena, a free blind pairwise benchmark for Russian-language models. entity news Russia ru - ### [TruthfulQA](/evaluation/benchmarks-and-leaderboards/truthfulqa/index.md) by [sylinrl](https://github.com/sylinrl) TruthfulQA GitHub repo: benchmark testing whether language models repeat common human misconceptions, with data and evaluation code. entity benchmark US en - ### [TTS Arena V2 (Hugging Face Space)](/evaluation/benchmarks-and-leaderboards/tts-arena-v2-hf/index.md) by [TTS AGI](https://huggingface.co/TTS-AGI) TTS Arena V2 Space: community arena voting between anonymous text-to-speech models. entity leaderboard Global (community) en - ### [UK AI Security Institute](/evaluation/benchmarks-and-leaderboards/uk-ai-security-institute/index.md) by [UK AI Security Institute](https://www.aisi.gov.uk/) UK AI Security Institute: government body publishing frontier AI evaluations and the Inspect evaluation framework. entity leaderboard West en - ### [UK AISI Inspect Evals](/evaluation/benchmarks-and-leaderboards/uk-aisi-inspect-evals/index.md) by [Department of Business, Energy and Industrial Strategy](https://github.com/UKGovernmentBEIS) UK AISI Inspect Evals: registry of evaluations implemented in Inspect, including cybersecurity, safety and agent benchmarks. entity benchmark UK [STATE] en|mul - ### [Announcing Inspect Evals (UK AISI)](/evaluation/benchmarks-and-leaderboards/uk-aisi-inspect-evals-announcement/index.md) by [UK AI Security Institute](https://www.aisi.gov.uk/) UK AISI announcement of Inspect Evals, an open-source collection of LLM evaluations. entity news UK [STATE] en - ### [Ukrainian LLM Leaderboard (lang-uk)](/evaluation/benchmarks-and-leaderboards/ukrainian-llm-leaderboard-lang-uk/index.md) by [Lang UK](https://huggingface.co/lang-uk) lang-uk Ukrainian LLM Leaderboard Hugging Face Space: dashboard of model results on Ukrainian tasks. entity repo Ukraine uk - ### [Vals.ai](/evaluation/benchmarks-and-leaderboards/vals-ai/index.md) by [Vals AI](https://www.vals.ai/) Vals AI benchmarks: independently run leaderboards on coding, finance, legal and science tasks with evaluation costs. entity leaderboard US en - ### [Vals AI MMMU Pro Leaderboard](/evaluation/benchmarks-and-leaderboards/vals-ai-mmmu-pro-archived/index.md) by [Vals AI](https://www.vals.ai/) Vals AI MMMU-Pro page: archived multimodal reasoning results and methodology; no longer run on new models. entity leaderboard US (commercial) en - ### [Vals AI's Latest Benchmark Finds Legal and General AI Now Outperform Lawyers in Legal Research (LawNext)](/evaluation/benchmarks-and-leaderboards/vals-ai-vlair-legal-research-report-lawnext-coverage-oct-2025/index.md) by [LawSites](https://lawnext.com/) LawNext article on Vals AI's legal research benchmark comparing legal AI tools and general LLMs with a lawyer baseline. entity benchmark US en [Previous page](/evaluation-benchmarks/beginner/page/11/index.md) [Next page](/evaluation-benchmarks/beginner/page/13/index.md) [Plain-text Markdown copy](/evaluation-benchmarks/beginner/page/12/index.md)