FPS-Bench Leaderboard

High-frame-rate video understanding. Build a predictions file with scripts/evaluate.py and upload it to be scored and added to the table (see the repo).


Human Performance	human	72.2
GPT-4o	closed-source VLM	31.8
Oryx	open-source VLM	31.3
Qwen-3-VL-32B	open-source VLM	30.7
Gemini 2.5 Pro	closed-source VLM	28.9
InternVL-3.5-8B	open-source VLM	28.7
OmniVinci	open-source VLM	28.5
Qwen-3-VL-8B	open-source VLM	28
InternVL-3.5-14B	open-source VLM	27.9
LLaVA-1.5	open-source image VLM	27.1
LLaVA-OneVision	open-source VLM	27
LLaVA-NeXT-Video	open-source VLM	26.5
DeepSeek-VL2-Small	open-source image VLM	26.3
Random baseline	baseline	25
DeepSeek-VL2-Tiny	open-source image VLM	24.6
DeepSeek-VL2-Base	open-source image VLM	24