AI/ML Integration

SAM 2 ONNX Client-Side Setup

Model Files

Store in client/public/models/:

• sam2_hiera_tiny_encoder.onnx — Image encoder (~30MB)
• sam2_hiera_tiny_decoder.onnx — Mask decoder (~4MB) Source: https://huggingface.co/sam2-hf/sam2-hiera-tiny-onnx

ONNX Runtime Configuration

import * as ort from 'onnxruntime-web';
// CRITICAL: Use exactly version 1.19.0 — newer versions have WebGPU issues
// npm install onnxruntime-web@1.19.0