Add Benchmark to NeMo-Gym

Determine Integration Type

Before starting, determine which type of benchmark you're adding:

Native benchmark — verification logic implemented directly in a Gym resources server:

• Resources server implements verify() with reward logic
• Agent server orchestrates model calls (use simple_agent for single-turn, or custom agent for multi-turn)
• Example: code_gen, instruction_following, math_with_judge

External benchmark — wrapping a 3rd-party library that has its own orchestration:

• Integrate at the agent server level (not resources server)
• Agent's /run endpoint wraps the external library
• Pre-process from Gym schema to library input, post-process back to BaseVerifyResponse
• Reproduce publicly reported numbers with the original repo first, then reproduce again after Gym integration
• Add the dependency in requirements.txt

Workflow