udf-benchmark
Installation
SKILL.md
UDF Benchmark
Workflow
- Step 1: Implement BenchUtils (fill in TODO methods)
- Step 2: Validate with a small dataset
- Step 3: Generate full benchmark data and run benchmarks
- Step 4: cuDF microbenchmarks (skip for SQL targets)
Before making any edits, create a visible TODO checklist for every workflow step in this skill and keep it updated. Do not produce a final answer until every required checklist item is marked complete.
Prerequisites
- Project directory from Steps 1-2 (udf-gen-test, udf-convert-to-*) with passing tests
Derive <CamelName> and <snake_name> from the UDF class name.
Note: Commands require access to
/tmp(Spark temp storage) and/dev(GPU device). If commands fail due to sandbox restrictions, re-run them unsandboxed.