cloud-platforms
Installation
SKILL.md
Cloud Platforms for Data Engineering
Production-grade cloud infrastructure for data pipelines, storage, and analytics on AWS, GCP, and Azure.
Quick Start
# AWS S3 + Lambda Data Pipeline
import boto3
import json
s3_client = boto3.client('s3')
glue_client = boto3.client('glue')
def lambda_handler(event, context):
"""Process S3 event and trigger Glue job."""
bucket = event['Records'][0]['s3']['bucket']['name']
key = event['Records'][0]['s3']['object']['key']
Related skills
More from pluginagentmarketplace/custom-plugin-data-engineer
statistics-math
Statistics, probability, linear algebra, and mathematical foundations for data science
327deep-learning
PyTorch, TensorFlow, neural networks, CNNs, transformers, and deep learning for production
48big-data
Apache Spark, Hadoop, distributed computing, and large-scale data processing for petabyte-scale workloads
43python-programming
Master Python fundamentals, OOP, data structures, async programming, and production-grade scripting for data engineering
31data-engineering
Data pipeline architecture, ETL/ELT patterns, data modeling, and production data platform design
29etl-tools
Apache Airflow, dbt, Prefect, Dagster, and modern data orchestration for production data pipelines
28