di-agent-flow-pushdown-optimizer
Installation
SKILL.md
DataStage Flow Pushdown Optimizer
Analyze a DataStage flow and rewrite it as a Full Pushdown flow — all computation moves inside the database engine as a single SQL statement, leaving exactly 2 stages: one connector + one sink.
Scope: Both Target Full Pushdown (ELT) and Source Full Pushdown (TEL) are supported, subject to the following constraints:
| Mode | Condition |
|---|---|
| Target Full Pushdown (ELT) | All connectors (source + target) share the same connection; flow has a write target |
| Source Full Pushdown (TEL) | All source connectors share the same connection; sink is Sequential File, PxCopy, or PxPeek (no write target DB connector) |
Not supported:
- Partial pushdown (any intermediate stage not convertible to SQL)
- TEL with a different-connection DB as sink (sink config cannot be preserved through the pipeline) — future work