Finger Frame AI

Turn a local video of the two-hand finger-frame gesture into an H.264 MP4 where the area inside the fingers reveals an AI-restyled version of the scene.

The bundled pipeline uses:

1. Gemini Omni to restyle the existing clip while asking it to preserve timing, motion, framing, pose, and expression.
2. MediaPipe Hand Landmarker to track both index fingers and thumbs.
3. FFmpeg/OpenCV to composite the restyled video into the tracked quadrilateral and retain source audio.

When to Use

Trigger when the user asks to:

• Apply a finger-frame, hand-frame, or fingers-as-a-window video effect.
• Put an anime, claymation, watercolor, CGI, or custom AI world inside a finger gesture.
• Run the Finger Frame AI video pipeline on a local clip.

Do not substitute Veo video generation. This effect needs a restyled version of the existing timeline so it can align with hand tracking from the source.