Optimizing (quantizing) a model with getitune

getitune applies post-training quantization (PTQ) via NNCF to shrink an exported OpenVINO model and speed up inference. Quantization runs on an OpenVINO model (an exported .xml), producing an INT8 version.

Run everything from libraries/getitune/.

Workflow

from getitune.engine import create_engine