API And SaaS Ingestion Patterns

Overview

Use this skill when the source system is an external API or SaaS platform rather than a database or file drop. It helps agents design reliable extraction, pagination, throttling, auth handling, and backfill-safe ingestion contracts.

When to Use

• extracting from REST or GraphQL APIs
• ingesting SaaS platform data
• handling pagination, cursors, or sync tokens
• dealing with rate limits and source-side throttling
• backfilling historical API data safely

Do not treat APIs like static tables. They change behavior, availability, and limits over time.

Workflow