neuron-framework-equivalence
Installation
SKILL.md
Model Equivalence Framework
Verify and diagnose functional equivalence between a source (reference) and a target (ported) implementation of the same model.
Required Inputs
Before starting, collect these from the user. Ask for any missing ones.
| Input | Description | Example |
|---|---|---|
SOURCE_MODEL_PATH |
Path to source model weights (HF format) | /path/to/hf_models/Qwen3-0.6B |
COMPILED_MODEL_PATH |
Path to compiled target model | /path/to/neuron_models/Qwen3-0.6B |
TARGET_MODELING_FILE |
Path to target's modeling .py file | /path/to/modeling_qwen3.py |
TARGET_INNER_CLASS |
Inner model class (extends NeuronBaseModel) | NeuronQwen3Model |
TARGET_CAUSAL_CLASS |
ForCausalLM wrapper class | NeuronQwen3ForCausalLM |
TARGET_CONFIG_CLASS |
InferenceConfig class | Qwen3InferenceConfig |
VENV |
Path to Python venv with torch + neuronx | /opt/aws_neuronx_venv_pytorch_2_8_nxd_inference |
EXP_DIR |
Experiment output directory | agent_artifacts/equiv_qwen3 |
VLLM_NEURON_DIR |
vLLM-Neuron targets only. Project root of the vllm-neuron editable install |
/path/to/vllm-neuron |