Edge Deployment Skill

Overview

Expert skill for optimizing and deploying machine learning models on robot edge devices including NVIDIA Jetson and embedded systems.

Capabilities

• Configure TensorRT optimization for NVIDIA Jetson
• Set up ONNX model conversion and optimization
• Implement INT8 and FP16 quantization
• Configure DeepStream for video analytics
• Set up CUDA graph optimization
• Implement model pruning and distillation
• Configure DLA (Deep Learning Accelerator) deployment
• Set up multi-stream inference
• Implement ROS2 inference nodes
• Profile and benchmark on target hardware