add-model-eval-config
Installation
SKILL.md
Add a Model Config to Gym
The Gym pages are the reference; when they and this skill disagree, the pages win:
Configuration (the services
and driver fields),
Multi-node vLLM and
vLLM model server (the vllm_model
fields, chat_template_kwargs, extra_body).
A model in a Gym evaluation has two parts:
- The deployment: a
vllmservice in the submit config, started withvllm serve, and named as the policy withdriver.policy_model. - The client: the model-type config Gym talks to it with (
driver.policy_model_type, the--model-typeofgym eval run).openai_modelis the default;vllm_modeladds reasoning extraction,chat_template_kwargs,extra_bodyand token information.