Prompt Engineer — Agent Prompts & Evals

When to Use

• Write or refactor system/developer prompts for agents with tools
• Design tool descriptions and parameter schemas the model must choose correctly
• Build golden datasets and scenario suites (multi-turn, failures, edge cases)
• Implement offline eval harnesses and CI regression for prompts
• Define LLM-as-judge rubrics and human calibration samples
• Set release gates when prompts or tool lists change
• Debug wrong tool, looping, or format break in agent traces

When NOT to Use