PermaVid revisit benchmark · multi-visit degradation

Does the model still get it right the 2nd, 3rd, 8th time the camera comes back?

Each table takes one observed viewpoint that the camera returns to several times along the trajectory, and lays out every model's render at each successive visit. The GT row is the fixed real target; a good model keeps matching it, a forgetful one degrades visit by visit (watch the PSNR and the Δ column). Rows are sorted by mean fidelity across the visits.

Full motion · span 1.00
EF_Lewis_1 — observed pose 20 revisited 8× (frames [39, 59, 72, 89, 112, 123, 143, 168]). Columns = successive visits; GT is the fixed target, models drift. Δ = PSNR(visit 1) − PSNR(visit 8); positive = degraded over revisits.
model (mean dB)visit 1
frame 39		visit 2
frame 59		visit 3
frame 72		visit 4
frame 89		visit 5
frame 112		visit 6
frame 123		visit 7
frame 143		visit 8
frame 168		Δ v1→vN
GT (real render)—
Ours VACE-14B (PermaVid) 21.9
22.3 dB
19.8 dB
22.5 dB
21.7 dB
22.1 dB
19.8 dB
22.5 dB
24.0 dB
▲ -1.7
GEN3C 21.5
20.5 dB
21.0 dB
21.5 dB
21.0 dB
22.1 dB
21.2 dB
22.4 dB
22.5 dB
▲ -2.0
MatrixGame-3 21.3
22.5 dB
22.7 dB
21.5 dB
22.0 dB
21.7 dB
18.8 dB
19.7 dB
21.7 dB
▼ +0.8
NVS-Solver 18.8
19.7 dB
18.7 dB
19.9 dB
19.2 dB
18.8 dB
18.5 dB
16.4 dB
19.0 dB
▼ +0.7
SpMem 18.1
20.1 dB
21.2 dB
21.5 dB
19.4 dB
19.7 dB
14.0 dB
15.4 dB
13.7 dB
▼ +6.4
TrajectoryCrafter 17.8
17.1 dB
18.3 dB
16.1 dB
18.6 dB
19.1 dB
19.4 dB
18.7 dB
15.5 dB
▼ +1.6
FrameCrafter 16.3
20.7 dB
16.5 dB
18.0 dB
16.8 dB
18.1 dB
19.3 dB
10.1 dB
10.7 dB
▼ +10.0
VACE-14B (DL3DV ft) 15.8
16.0 dB
11.9 dB
14.1 dB
12.7 dB
13.1 dB
22.2 dB
20.5 dB
15.8 dB
• +0.2
Lyra 2.0 15.7
19.3 dB
19.1 dB
21.9 dB
22.3 dB
21.7 dB
6.4 dB
5.0 dB
10.2 dB
▼ +9.1
FlexWorld 15.0
15.9 dB
13.1 dB
14.3 dB
12.9 dB
17.5 dB
15.6 dB
15.8 dB
15.1 dB
▼ +0.8
ViewExtrapolator 14.5
18.7 dB
17.3 dB
18.8 dB
19.3 dB
17.3 dB
10.4 dB
6.9 dB
7.1 dB
▼ +11.6
ViewCrafter 10.7
14.7 dB
15.1 dB
12.3 dB
11.5 dB
9.9 dB
9.0 dB
7.0 dB
6.4 dB
▼ +8.3
Shape-of-Motion 9.4
5.9 dB
4.1 dB
6.8 dB
6.0 dB
5.7 dB
20.6 dB
19.3 dB
6.9 dB
▲ -1.0
COSMOS3 (base) 8.7
10.0 dB
10.8 dB
8.5 dB
8.1 dB
9.8 dB
8.4 dB
6.0 dB
8.1 dB
▼ +2.0
QA_Holding_Cells_A — observed pose 30 revisited 5× (frames [38, 120, 152, 162, 177]). Columns = successive visits; GT is the fixed target, models drift. Δ = PSNR(visit 1) − PSNR(visit 5); positive = degraded over revisits.
model (mean dB)visit 1
frame 38		visit 2
frame 120		visit 3
frame 152		visit 4
frame 162		visit 5
frame 177		Δ v1→vN
GT (real render)—
FlexWorld 17.4
14.8 dB
19.3 dB
17.6 dB
18.3 dB
16.9 dB
▲ -2.1
Shape-of-Motion 16.2
19.0 dB
15.7 dB
16.9 dB
12.4 dB
17.3 dB
▼ +1.6
Lyra 2.0 16.0
16.2 dB
16.3 dB
17.2 dB
13.5 dB
16.6 dB
▲ -0.4
GEN3C 14.9
14.2 dB
15.3 dB
15.3 dB
14.3 dB
15.4 dB
▲ -1.2
NVS-Solver 13.3
16.1 dB
12.5 dB
13.0 dB
11.0 dB
13.7 dB
▼ +2.4
MatrixGame-3 12.0
10.6 dB
11.1 dB
11.8 dB
12.4 dB
14.2 dB
▲ -3.6
Ours VACE-14B (PermaVid) 11.8
12.6 dB
12.1 dB
11.4 dB
11.0 dB
12.1 dB
▼ +0.4
SpMem 11.3
14.9 dB
11.1 dB
10.2 dB
10.9 dB
9.6 dB
▼ +5.3
VACE-14B (DL3DV ft) 11.3
11.7 dB
12.5 dB
11.1 dB
9.8 dB
11.4 dB
• +0.2
ViewCrafter 11.0
15.8 dB
10.7 dB
9.3 dB
9.7 dB
9.3 dB
▼ +6.5
FrameCrafter 10.6
19.2 dB
8.8 dB
7.7 dB
8.3 dB
9.0 dB
▼ +10.2
COSMOS3 (base) 10.2
16.3 dB
8.8 dB
7.7 dB
8.9 dB
9.3 dB
▼ +7.0
ViewExtrapolator 9.7
17.8 dB
6.6 dB
7.7 dB
8.6 dB
7.8 dB
▼ +10.0
TrajectoryCrafter 9.0
10.8 dB
7.3 dB
7.3 dB
7.8 dB
11.6 dB
▲ -0.8
ChineseWaterTown_Ver1 — observed pose 6 revisited 4× (frames [37, 60, 77, 100]). Columns = successive visits; GT is the fixed target, models drift. Δ = PSNR(visit 1) − PSNR(visit 4); positive = degraded over revisits.
model (mean dB)visit 1
frame 37		visit 2
frame 60		visit 3
frame 77		visit 4
frame 100		Δ v1→vN
GT (real render)—
Ours VACE-14B (PermaVid) 28.5
29.0 dB
28.9 dB
27.8 dB
28.3 dB
▼ +0.7
VACE-14B (DL3DV ft) 22.7
26.2 dB
26.5 dB
18.9 dB
19.4 dB
▼ +6.9
TrajectoryCrafter 22.6
21.2 dB
23.4 dB
24.0 dB
21.7 dB
▲ -0.5
MatrixGame-3 21.7
21.8 dB
21.9 dB
21.6 dB
21.4 dB
▼ +0.3
Voyager 21.5
19.9 dB
20.7 dB
22.7 dB
22.6 dB
▲ -2.7
NVS-Solver 21.3
23.7 dB
23.5 dB
22.5 dB
15.4 dB
▼ +8.3
SpMem 20.0
21.4 dB
22.3 dB
19.6 dB
16.7 dB
▼ +4.7
GEN3C 19.9
23.3 dB
13.3 dB
27.0 dB
16.1 dB
▼ +7.2
Lyra 2.0 18.9
21.4 dB
18.5 dB
14.5 dB
21.0 dB
▼ +0.4
ViewCrafter 18.3
23.6 dB
19.0 dB
17.7 dB
13.0 dB
▼ +10.6
ViewExtrapolator 17.9
21.9 dB
23.9 dB
19.1 dB
6.6 dB
▼ +15.4
FrameCrafter 17.1
19.7 dB
23.5 dB
15.9 dB
9.4 dB
▼ +10.3
FlexWorld 9.0
7.6 dB
7.6 dB
10.4 dB
10.5 dB
▲ -2.9
COSMOS3 (base) 8.4
12.6 dB
10.7 dB
4.6 dB
5.9 dB
▼ +6.7
Shape-of-Motion 4.8
5.1 dB
6.5 dB
3.0 dB
4.5 dB
▼ +0.6
Science_Fiction_valley_town — observed pose 35 revisited 3× (frames [40, 69, 83]). Columns = successive visits; GT is the fixed target, models drift. Δ = PSNR(visit 1) − PSNR(visit 3); positive = degraded over revisits.
model (mean dB)visit 1
frame 40		visit 2
frame 69		visit 3
frame 83		Δ v1→vN
GT (real render)—
Ours VACE-14B (PermaVid) 12.9
13.6 dB
14.0 dB
11.2 dB
▼ +2.4
VACE-14B (DL3DV ft) 12.1
11.9 dB
13.2 dB
11.2 dB
▼ +0.6
Voyager 11.7
12.0 dB
11.2 dB
12.0 dB
• +0.1
SpMem 10.8
11.6 dB
10.2 dB
10.7 dB
▼ +0.9
FrameCrafter 10.7
9.3 dB
13.1 dB
9.8 dB
▲ -0.5
MatrixGame-3 10.7
11.7 dB
9.8 dB
10.5 dB
▼ +1.2
NVS-Solver 10.1
9.6 dB
10.5 dB
10.2 dB
▲ -0.7
COSMOS3 (base) 10.0
9.0 dB
9.7 dB
11.2 dB
▲ -2.2
GEN3C 9.8
8.8 dB
11.5 dB
9.1 dB
▲ -0.3
Lyra 2.0 9.6
8.9 dB
10.0 dB
9.8 dB
▲ -0.9
FlexWorld 9.4
8.3 dB
11.4 dB
8.4 dB
• -0.0
ViewCrafter 8.6
8.7 dB
8.6 dB
8.6 dB
• +0.2
ViewExtrapolator 8.4
6.3 dB
9.5 dB
9.4 dB
▲ -3.1
TrajectoryCrafter 8.1
6.2 dB
9.9 dB
8.1 dB
▲ -1.9
Shape-of-Motion 7.5
4.9 dB
11.6 dB
6.1 dB
▲ -1.2
ModularVictorianCity — observed pose 34 revisited 3× (frames [103, 117, 135]). Columns = successive visits; GT is the fixed target, models drift. Δ = PSNR(visit 1) − PSNR(visit 3); positive = degraded over revisits.
model (mean dB)visit 1
frame 103		visit 2
frame 117		visit 3
frame 135		Δ v1→vN
GT (real render)—
Ours VACE-14B (PermaVid) 14.8
14.7 dB
15.2 dB
14.5 dB
• +0.2
VACE-14B (DL3DV ft) 14.3
14.4 dB
14.7 dB
13.9 dB
▼ +0.4
Lyra 2.0 13.7
13.9 dB
13.0 dB
14.1 dB
• -0.3
FlexWorld 13.3
13.9 dB
13.0 dB
12.9 dB
▼ +1.0
SpMem 13.2
12.9 dB
13.1 dB
13.7 dB
▲ -0.8
Shape-of-Motion 13.1
13.8 dB
12.4 dB
13.1 dB
▼ +0.7
GEN3C 13.0
11.2 dB
13.5 dB
14.5 dB
▲ -3.3
TrajectoryCrafter 12.6
13.0 dB
11.8 dB
13.0 dB
• +0.1
Voyager 12.5
12.1 dB
12.5 dB
12.8 dB
▲ -0.6
COSMOS3 (base) 12.2
14.7 dB
13.5 dB
8.5 dB
▼ +6.1
MatrixGame-3 11.9
11.5 dB
11.8 dB
12.3 dB
▲ -0.9
FrameCrafter 11.9
12.3 dB
12.2 dB
11.2 dB
▼ +1.1
NVS-Solver 11.6
12.0 dB
11.3 dB
11.5 dB
▼ +0.5
ViewExtrapolator 10.6
11.3 dB
10.2 dB
10.2 dB
▼ +1.1
ViewCrafter 8.9
8.7 dB
8.9 dB
9.1 dB
▲ -0.4
Slow · span 0.33
ModularVictorianCity — observed pose 26 revisited 5× (frames [49, 60, 70, 91, 100]). Columns = successive visits; GT is the fixed target, models drift. Δ = PSNR(visit 1) − PSNR(visit 5); positive = degraded over revisits.
model (mean dB)visit 1
frame 49		visit 2
frame 60		visit 3
frame 70		visit 4
frame 91		visit 5
frame 100		Δ v1→vN
GT (real render)—
FrameCrafter 18.1
17.8 dB
18.7 dB
18.4 dB
17.3 dB
18.0 dB
• -0.2
Lyra 2.0 17.0
15.9 dB
15.9 dB
17.4 dB
17.8 dB
18.0 dB
▲ -2.1
Voyager 16.3
16.2 dB
16.2 dB
15.9 dB
17.0 dB
16.3 dB
• -0.1
MatrixGame-3 16.2
16.7 dB
16.5 dB
16.0 dB
15.9 dB
16.1 dB
▼ +0.6
GEN3C 16.2
15.6 dB
15.2 dB
15.5 dB
17.8 dB
16.9 dB
▲ -1.2
NVS-Solver 15.8
16.7 dB
16.2 dB
16.0 dB
15.2 dB
15.2 dB
▼ +1.5
TrajectoryCrafter 15.6
13.6 dB
15.7 dB
16.3 dB
15.9 dB
16.3 dB
▲ -2.7
VACE-14B (finetuned) 15.3
15.3 dB
15.2 dB
15.8 dB
15.5 dB
14.8 dB
▼ +0.5
ViewExtrapolator 15.1
16.6 dB
15.8 dB
14.9 dB
14.3 dB
14.0 dB
▼ +2.6
SpMem 15.0
16.9 dB
14.0 dB
13.1 dB
15.5 dB
15.7 dB
▼ +1.1
FlexWorld 14.6
13.7 dB
14.7 dB
14.5 dB
15.1 dB
14.8 dB
▲ -1.1
ViewCrafter 12.1
14.6 dB
13.3 dB
11.9 dB
10.4 dB
10.3 dB
▼ +4.3