Infrastructure CI/CD for Data Engineering

Skill by ara.so — Data Skills collection

This project demonstrates practical CI/CD patterns for deploying data infrastructure changes using GitHub Actions, Terraform, and AWS. It uses OpenID Connect (OIDC) for secure, keyless authentication between GitHub Actions and AWS, eliminating the need for long-lived AWS credentials.

What This Project Does

• Bootstraps infrastructure: Creates S3 backend for Terraform state and OIDC provider for GitHub Actions
• Automates deployments: Uses GitHub Actions workflows to plan and apply Terraform changes
• Enforces reviews: Requires manual approval before production deployments
• Validates code: Runs Terraform formatting and validation checks on PRs

Project Structure