Gemini Live API Development Skill

Overview

The Live API enables low-latency, real-time voice and video interactions with Gemini over WebSockets. It processes continuous streams of audio, video, or text to deliver immediate, human-like spoken responses and background reasoning.

Key capabilities:

• Bidirectional audio streaming — real-time mic-to-speaker conversations
• Background reasoning (extended thinking) — multi-step background reasoning with spoken conversational fillers
• Live streaming transcription — real-time speech-to-text with interim and finalized streams
• Video streaming — send camera/screen frames alongside audio
• Text input/output — send and receive text within a live session
• Audio transcriptions — get text transcripts of both input and output audio
• Voice Activity Detection (VAD) — automatic server VAD, client-side Hybrid VAD, and manual Push-to-Talk
• Asynchronous function calling — non-blocking tool execution while audio continues streaming
• Full-session client content — inject and update conversation turns mid-stream
• Session management — context compression, session resumption, GoAway signals
• Ephemeral tokens — secure client-side authentication