A Very Big Video Reasoning Suite

We bet on a future that video reasoning is the next fundamental intelligence paradigm, after language reasoning, where spatiotemporal embodied world experiences could be more naturally captured.

Data Engines

View All
read_the_chart_data_semantic_comprehension
GitHub
Knowledge training set
The scene shows a sales table with Month as rows and Product as columns. Find the minimum value within the row corresponding to the Month 'Mar' and draw a red rectangular border around the corresponding cell to highlight it.
First Frame
Last Frame
predict_next_color
GitHub
Abstraction in-domain testset
Predict the next color in the sequence.
First Frame
Last Frame
rotation
GitHub
Spatiality in-domain testset
A 6-block sculpture sits fixed on a table. First frame: Your camera is tilted at 22° elevation, viewing from 290° azimuth. Final frame: Your camera remains at 22° elevation, but rotates horizontally to 110° azimuth. This is a 180-degree rotation Create a smooth video showing the camera's horizontal rotation around the sculpture, and try to maintain the tilted viewing angle throughout.
First Frame
Last Frame
multiple_occlusions_vertical
GitHub
Transformation in-domain testset
The scene shows 3 objects arranged in a horizontal line in the center of the frame, with a dark rectangular mask initially positioned above them. Move the mask vertically downward in a continuous motion until it leaves the frame. As it moves, the mask passes in front of the objects, temporarily blocking them from view.
First Frame
Last Frame
connecting_color
GitHub
Perception out-of-domain testset
The scene shows colored shapes in 2 different colors. Each color appears exactly 2 times. First, for each color, draw one smooth curve connecting the leftmost and rightmost shapes of that color. Only connect shapes with the exact same color, and do not connect different colors. Keep the curves from crossing any shapes or other curves. Show the complete drawing process step by step.
First Frame
Last Frame

Inference Results

View Full Bench
Ball Bounces - Samples
00
01
02
03
04
Task Domains 1/5
Ball Bounces
Knowledge in-domain testset
Shape Scale Then Outline
Abstraction in-domain testset
Key Door Matching
Spatiality in-domain testset
Rotation Puzzle
Transformation in-domain testset
Color Triple Intersection
Perception out-of-domain testset
Prompt
Loading...
Ground Truth
First
First Frame
Final
Final Frame
Model Outputs
1/
VBVR-Wan2.2
VBVR-Wan2.2
CogVideoX 1.5
Kling 2.6
LTX-2
Runway Gen-4
Sora 2
Veo 3
Wan 2.2 I2V
Hunyuan I2V
Seedance 2.0

Leaderboard

Modality
Split
Type
Category
2026-04-28