Google launched Omni at I/O in May, and it edits video by instruction. I ran five of my own clips through it and asked it to add something impossible to each one, which turned out to be a much bigger pain than I expected. It is not a professional tool yet, but a few of these outputs are a signal that convincing VFX from generative AI are coming. The clips are from the test reel in Issue 08.
T.01
A stroll down a marsh boardwalk becomes a walk through dinosaur country. A herd of long-necked sauropods grazes in the reeds ahead of the stroller, and a pterosaur crosses overhead.
T.02
My dad fishing with my son off the dock, and a huge fish jumps out of the water in front of them.
The splash under the fish reads more like a solid white ring than moving water.
T.03
The bald eagle rears up on its perch and a giant egg appears beside its feet.
The egg sits against the side of the perch instead of on top of it.
T.04
A quiet morning on the bay gets a full-rigged pirate ship sailing in close to shore and firing its cannons.
The re-render brightened the marsh grass into a uniform lawn and changed the figure's outfit.
T.05
The sledding hill turns into a river of chocolate. The sleds came back as giant frosted donuts and the snowbanks read as whipped cream.
The original run had three sledders. Two made it into the edit.