Input / output pairs — the AV object-removal pipeline

Fourteen pairs drawn at random from the 1157 clips the pipeline has passed so far on the speech-free, music-free source set. Left is the untouched source; right is the pipeline's output — the object erased from the picture and its sound separated out of the mix, with the rest of the soundtrack intact. Play with sound on.

5,427 clips processed
1,157 passed the gates
14 random verified pairs shown

What runs between input and output

1 caption — Qwen3-Omni 2 pick the target — GPT-4o-mini 3 segment — SAM3 4 erase — EffectErase 5 verify — SAM3 re-segment 6 separate the sound — SAM-Audio, best of 10

Nothing but the source clip is given: the pipeline captions it, decides what to remove, and does the removal. Clips that fail any gate are discarded — 79% of what it saw — so these are drawn from the survivors.

How each pair was verified

SAM-Audio splits the soundtrack into a target (the object's sound) and a residual (everything else); the residual is what you hear on the right. A pair is only shown if it fails in neither direction: the residual keeps at least 30% of the source, so the scene is not wiped; the target holds at least 20%, so something was genuinely taken out; and the target matches the prompt better than the residual does. Both numbers appear on every card.

That two-sided test matters — the pipeline's built-in ranking maximises similarity to the extracted target, which is maximised by dumping the whole mix into it and leaving silence behind. Roughly one selection in four collapses that way and is excluded here.

removed: man JAVEdit-100k javedit_1a3a8f2a76f2
1280×720 · 25 fps · 4.86s

INPUT · source

input frames
input spectrogram
source audio

OUTPUT · man removed

output frames
output spectrogram
after removal — the rest of the mix survives
waveforms
source vs object removed
19%mask area
0.989visual removal score
53%of the mix pulled into the object
83%of the mix left behind
visualwinning prompt · seed 1132891577
removed: crowd of people InsAVE-80K insave_add_and_remove_06746
1280×704 · 23.98 fps · 3.42s

INPUT · source

input frames
input spectrogram
source audio

OUTPUT · crowd of people removed

output frames
output spectrogram
after removal — the rest of the mix survives
waveforms
source vs object removed
17%mask area
1.000visual removal score
49%of the mix pulled into the object
84%of the mix left behind
visualwinning prompt · seed 1453635084
removed: woman JAVEdit-100k javedit_0b4017e582e3
1280×720 · 25 fps · 4.86s

INPUT · source

input frames
input spectrogram
source audio

OUTPUT · woman removed

output frames
output spectrogram
after removal — the rest of the mix survives
waveforms
source vs object removed
16%mask area
1.000visual removal score
73%of the mix pulled into the object
65%of the mix left behind
textwinning prompt · seed 1132891577
removed: large brown bear InsAVE-80K insave_general_editing_36342
1280×704 · 23.98 fps · 5.09s

INPUT · source

input frames
input spectrogram
source audio

OUTPUT · large brown bear removed

output frames
output spectrogram
after removal — the rest of the mix survives
waveforms
source vs object removed
17%mask area
1.000visual removal score
67%of the mix pulled into the object
73%of the mix left behind
visualwinning prompt · seed 1778986134
removed: woman InsAVE-80K insave_general_editing_32442
1280×704 · 24 fps · 5.04s

INPUT · source

input frames
input spectrogram
source audio

OUTPUT · woman removed

output frames
output spectrogram
after removal — the rest of the mix survives
waveforms
source vs object removed
20%mask area
1.000visual removal score
79%of the mix pulled into the object
62%of the mix left behind
visualwinning prompt · seed 1453635084
removed: man JAVEdit-100k javedit_38861d7c8184
1280×720 · 25 fps · 4.86s

INPUT · source

input frames
input spectrogram
source audio

OUTPUT · man removed

output frames
output spectrogram
after removal — the rest of the mix survives
waveforms
source vs object removed
29%mask area
1.000visual removal score
59%of the mix pulled into the object
85%of the mix left behind
textwinning prompt · seed 240868205
removed: man JAVEdit-100k javedit_ac5e1eb921b7
1280×720 · 25 fps · 4.86s

INPUT · source

input frames
input spectrogram
source audio

OUTPUT · man removed

output frames
output spectrogram
after removal — the rest of the mix survives
waveforms
source vs object removed
37%mask area
1.000visual removal score
75%of the mix pulled into the object
63%of the mix left behind
textwinning prompt · seed 1453635084
removed: Jeep Wrangler InsAVE-80K insave_general_editing_44977
1280×704 · 23.98 fps · 5.09s

INPUT · source

input frames
input spectrogram
source audio

OUTPUT · Jeep Wrangler removed

output frames
output spectrogram
after removal — the rest of the mix survives
waveforms
source vs object removed
35%mask area
1.000visual removal score
42%of the mix pulled into the object
90%of the mix left behind
textwinning prompt · seed 1335522078
removed: military helicopter InsAVE-80K insave_general_editing_45206
1280×704 · 24 fps · 5.04s

INPUT · source

input frames
input spectrogram
source audio

OUTPUT · military helicopter removed

output frames
output spectrogram
after removal — the rest of the mix survives
waveforms
source vs object removed
16%mask area
1.000visual removal score
65%of the mix pulled into the object
67%of the mix left behind
textwinning prompt · seed 1132891577
removed: man JAVEdit-100k javedit_d225646bdee7
1280×720 · 25 fps · 4.86s

INPUT · source

input frames
input spectrogram
source audio

OUTPUT · man removed

output frames
output spectrogram
after removal — the rest of the mix survives
waveforms
source vs object removed
31%mask area
1.000visual removal score
52%of the mix pulled into the object
80%of the mix left behind
textwinning prompt · seed 1453635084
removed: man in a black shirt JAVEdit-100k javedit_8416e0fa82ca
1280×720 · 25 fps · 4.86s

INPUT · source

input frames
input spectrogram
source audio

OUTPUT · man in a black shirt removed

output frames
output spectrogram
after removal — the rest of the mix survives
waveforms
source vs object removed
31%mask area
1.000visual removal score
79%of the mix pulled into the object
58%of the mix left behind
textwinning prompt · seed 240868205
removed: man JAVEdit-100k javedit_677673f362ab
1280×720 · 25 fps · 4.86s

INPUT · source

input frames
input spectrogram
source audio

OUTPUT · man removed

output frames
output spectrogram
after removal — the rest of the mix survives
waveforms
source vs object removed
68%mask area
1.000visual removal score
69%of the mix pulled into the object
71%of the mix left behind
textwinning prompt · seed 1453635084
removed: woman InsAVE-80K insave_add_and_remove_00748
1280×704 · 24 fps · 5.04s

INPUT · source

input frames
input spectrogram
source audio

OUTPUT · woman removed

output frames
output spectrogram
after removal — the rest of the mix survives
waveforms
source vs object removed
30%mask area
1.000visual removal score
72%of the mix pulled into the object
66%of the mix left behind
visualwinning prompt · seed 1132891577
removed: woman InsAVE-80K insave_add_and_remove_00293
1280×704 · 23.98 fps · 3.42s

INPUT · source

input frames
input spectrogram
source audio

OUTPUT · woman removed

output frames
output spectrogram
after removal — the rest of the mix survives
waveforms
source vs object removed
25%mask area
1.000visual removal score
78%of the mix pulled into the object
61%of the mix left behind
visualwinning prompt · seed 240868205