Queue Processing

Comparable to: BullMQ, Celery, SQS

Key Concepts

Use the concepts below when they fit the task. Not every queue setup needs all of them.

• Named queues are declared in iii-config.yaml under queue_configs
• Standard queues process jobs concurrently; FIFO queues preserve ordering
• TriggerAction.Enqueue({ queue }) dispatches a job to a named queue
• Failed jobs auto-retry with exponential backoff up to max_retries
• Jobs that exhaust retries land in a dead letter queue for inspection
• Each consumer function receives the job payload and a messageReceiptId
• Fan-out is achieved by having one producer trigger multiple distinct consumer functions via separate enqueue calls

Architecture

Producer function