A Very Big Video Reasoning Suite

We bet on a future that video reasoning is the next fundamental intelligence paradigm, after language reasoning, where spatiotemporal embodied world experiences could be more naturally captured.

Data Engines

View All
identify_one_and_nine
GitHub
Knowledge training set
The image shows a subset of digits chosen from 1 to 9 placed in different positions. Find digit 1 and digit 9. Only circle digits '1' and '9'. Do not circle other digits. Draw a red circle around each target digit.
First Frame
Last Frame
object_subtraction
GitHub
Abstraction out-of-domain testset
Most objects share the same visual characteristic (color or shape). Identify and remove the one object that looks different from the others. Keep all other objects unchanged.
First Frame
Last Frame
LEGO_construction_assembly
GitHub
Spatiality in-domain testset
This is LEGO assembly step 4. The scene shows a partial model on the right and a 1x1 green brick on the left in a callout box. Take the green brick and attach it to the model at the position indicated by the red arrow. Move the brick smoothly from the callout to its destination, align it correctly, and snap it into place.
First Frame
Last Frame
object_packing
GitHub
Transformation training set
The scene shows objects on the left side and a container on the right side. Place the objects into the container one by one in the color order: orange - brown. Each object must be placed individually in the exact order specified, and all objects must end up inside the container.
First Frame
Last Frame
highlight_horizontal_lines
GitHub
Perception training set
The image contains several straight lines, including horizontal and vertical lines. Circle every horizontal line. Do not circle any vertical line.
First Frame
Last Frame

Inference Results

View Full Bench
Domino Chain Gap Analysis - Samples
00
01
02
03
04
Task Domains 1/5
Domino Chain Gap Analysis
Knowledge in-domain testset
Light Sequence
Abstraction in-domain testset
Key Door Matching
Spatiality in-domain testset
Separate Objects (Spinning)
Transformation in-domain testset
Mark Wave Peaks
Perception out-of-domain testset
Prompt
Loading...
Ground Truth
First
First Frame
Final
Final Frame
Model Outputs
1/
VBVR-Wan2.2
VBVR-Wan2.2
CogVideoX 1.5
Kling 2.6
LTX-2
Runway Gen-4
Sora 2
Veo 3
Wan 2.2 I2V
Hunyuan I2V
Seedance 2.0

Leaderboard

Modality
Split
Type
Category
2026-04-28