Scala Data Engineering On JVM Runtimes

Overview

Use this skill when Scala is the implementation language for distributed or streaming data systems. It helps agents manage build compatibility, packaging, JVM dependency issues, typed data models, serialization behavior, and runtime assumptions that often cause production failures long after code compiles.

When to Use

• building or modifying Scala Spark jobs
• implementing Flink, Kafka Streams, or JVM-native data processors in Scala
• managing sbt builds, shaded JARs, or runtime compatibility
• choosing typed datasets, encoders, or JVM serialization strategies
• debugging classpath, version, or packaging problems in distributed runtimes

Do not assume compile success means distributed runtime safety.

Workflow