Groq Core Workflow A: Chat, Tools & Structured Output

Overview

Primary integration patterns for Groq: chat completions, tool/function calling, JSON mode, and structured outputs. Groq's LPU delivers sub-200ms time-to-first-token, making these patterns viable for real-time user-facing features.

Prerequisites

groq-sdk installed, GROQ_API_KEY set
Understanding of Groq model capabilities

Model Selection for This Workflow

Task	Recommended Model	Why
Chat with tools	`llama-3.3-70b-versatile`	Best tool-calling accuracy
JSON extraction	`llama-3.1-8b-instant`	Fast, accurate for structured tasks
Structured outputs	`llama-3.3-70b-versatile`	Supports `strict: true` schema compliance
Vision + chat	`meta-llama/llama-4-scout-17b-16e-instruct`	Multimodal input

Instructions

Installs

Repository

jeremylongshore…s-skills

GitHub Stars

2.3K

First Seen

Jan 25, 2026

Security Audits

Gen Agent Trust HubPass

SocketPass

SnykPass