# Medical Evals AI

> Independent MedXpertQA analysis covering Text and MM test splits, answer choices, difficulty filtering, sampled evaluations, prompt conditions and historical results.

MedXpertQA stresses expert medical knowledge and reasoning through separate text and multimodal examination tracks. We explain the construction choices behind its difficulty, inspect the difference between full and sampled evaluations, and preserve the conditions behind selected 2025 paper results. Our original analysis and task explorer help readers assess what the benchmark measures. We are independent of its creators and do not claim new experiments or a current frontier leaderboard.

## Provenance
Independent analysis published by Arcophos. Benchmark creation belongs to the credited authors. Result rows are selected paper-reported measurements with their source versions and evaluation conditions, not new Arcophos runs or a live leaderboard.

## Benchmark dossiers
- [MedXpertQA Text and MM](https://medicalevals.ai/benchmarks/medxpertqa/): Expert exam difficulty needs an equally careful comparison. Source version: ICML 2025 / arXiv v3.

## Original analyses
- [MedXpertQA Text versus MM: a higher score does not isolate an image benefit](https://medicalevals.ai/guides/medxpertqa-text-versus-mm/): Compare the two tracks without conflating question populations, answer choices and modalities.
- [MedXpertQA: difficulty filtering and public-question exposure](https://medicalevals.ai/guides/medxpertqa-difficulty-and-exposure/): Analyze what a deliberately challenging examination benchmark can and cannot establish.
- [Read MedXpertQA results with the sample flag still attached](https://medicalevals.ai/guides/medxpertqa-results-audit/): A practical audit of full versus sampled evaluations, prompts and historical model rows.

## Inspect the evidence
- [Evidence JSON](https://medicalevals.ai/evidence.json): Task definitions, dataset facts, scoring rules, source-version results, our interpretations, and reference IDs.
- [Sources](https://medicalevals.ai/sources/): Original papers and repositories with evidence locators.
- [Editorial method](https://medicalevals.ai/methodology/): Source reconciliation and interpretation boundaries.
- [About](https://medicalevals.ai/about/): Ownership and corrections.

Analysis updated: 2026-09-28