HOT3D - Multi-View 3D Hand & Object Tracking

Overview

State-of-the-art multi-view 3D tracking system for egocentric hand-object interactions from Meta Facebook Research. Designed for Aria smart glasses and Quest VR headsets, HOT3D provides precise 3D world coordinates for hand joints, manipulated objects, and their interactions. The system includes visualization tools for rendering 3D overlays on video frames with joint projections, hand meshes, and object models.

Project page: https://facebookresearch.github.io/hot3d

Best for: Research-grade 3D tracking with multi-camera setups, high-precision applications, and XR device integration.

When to Use This Skill

Use when you need:

• Multi-view 3D tracking with world coordinates
• High-precision hand pose in 3D space (millimeter accuracy)
• Object tracking during manipulation
• Aria/Quest integration for wearable devices
• Research-grade tracking benchmarks
• Hand-object interaction analysis in 3D