throttle-writes-with-a-queue
Installation
SKILL.md
Use it when
- The target app allows a limited number of calls, for example 10 per second or 1,000 per day, and producers can exceed it.
- Producers start more than 20 runs at the same moment, the limit per workflow.
- A delay of up to the maximum age (default 60 seconds) before the write is fine.
Why this design
Advantages:
- Flush rules cap the pace: flushes per time window (default 10 per 1 second), batch size (default 1,000, up to 10,000) and maximum age (default 60 seconds, up to 86,400).
- Many producers, one writer: every workflow that adds records shares one pace.
- Records wait in the queue while the writer is paused or failing.
Trade-offs:
- One more resource to watch: records pile up if the consumer stops.
- The writer handles an array.
- No automatic retry of a failed consumer run: replay it.