async-inference
Installation
SKILL.md
This skill guides implementation of SageMaker async inference, ideal for workloads that exceed real-time inference limits (60-second timeout, 6MB payload). Async inference stores inputs/outputs in S3 and supports polling or SNS notifications.
When to Use Async Inference
| Scenario | Inference Type |
|---|---|
| Response < 60 seconds | Real-time |
| Response 1-15 minutes | Async |
| Payload > 6MB | Async |
| Batch processing | Async or Batch Transform |
| Cost-sensitive (scale to zero) | Async with auto-scaling |