data-engineering-storage-authentication
Installation
SKILL.md
Cloud Storage Authentication
Secure authentication patterns for accessing cloud storage (S3, GCS, Azure Blob) and cloud services in data pipelines. Covers IAM roles, service principals, secret managers, and best practices for credential management.
Quick Reference
| Provider | Recommended Auth | Alternative |
|---|---|---|
| AWS | IAM roles (EC2/ECS/Lambda) | Environment variables, Secrets Manager |
| GCP | Workload Identity / ADC | Service account keys (discouraged) |
| Azure | Managed Identity | Service principal with certificate |
| Local Dev | .env files + local credentials |
Static keys (temporary only) |