skills/vobiz.ai/vobiz-audio-streams

vobiz-audio-streams

Installation
SKILL.md

Vobiz Audio Streams skill

Use this for AI voice agents, real-time transcription, custom STT/TTS pipelines, or any workflow that needs raw audio frames rather than just recordings.

How it works

  1. During a call, your VobizXML answer handler returns a <Stream bidirectional="true" keepCallAlive="true">wss://your-server/ws</Stream> element. The WebSocket URL is the element's text content, not a url="" attribute.
  2. Vobiz opens a WebSocket to your server and sends a single start event with callId, streamId, tracks, and mediaFormat nested under start.
  3. Audio frames flow Vobiz → your server as media events (~50 per second per track, 20 ms each).
  4. For bidirectional streams, your server sends playAudio events back, plus checkpoint, clearAudio, and stop control messages.
  5. When the call ends, the WebSocket closes - there is no inbound stop event.

Two ways to start a stream

Approach When to use
<Stream> XML element The call is being set up by your answer handler. Best for AI agents that own the call from the first ring. This is the documented path for full-duplex voice agents.
REST POST .../Stream/ The call is already live and you want to attach (or fork) audio mid-call - e.g. start transcription after a transfer, or stream a leg that is in a <Conference>. Returns a stream_id you can later list/get/stop.
Installs
40
First Seen
Jul 14, 2026