so101-calibration
Installation
SKILL.md
SO-101 Stage 5 (Optional · Requires Fixed Camera) — Tabletop Touch-Down & 3D Hand-Eye Calibration
After completing Stages 0–3 in ../so101-bringup/SKILL.md (including optional Stage 4: the USB bandwidth check and reference frames, which R10 drift checks require) and following all safety rules (R1–R16) in safety_rules.md, measure the physical tabletop height z_table and fit the 3D fixed/overhead camera projection matrix using calibration_notes.md:
-
Step 0 — Verify Fixed/Overhead Camera Configuration:
- Check
NOTES.mdandconfig/robot_config.json(get_fixed_camera_role_and_configin so101_common.py). - Stage 5 requires a stationary fixed/overhead camera viewing the arm and tabletop. If the human only set up a wrist camera (minimal 1-camera setup), stop with a clear message explaining that Stage 5 requires a fixed camera and ask whether they want to add one or finish at Stage 3 ("Hello World").
- Check
-
Part A — Two-Cue Gripper Marker Verification (detect_marker.py,
R9,R16):- With motor torque OFF (
R16), ask the human to place a unique high-contrast marker on the gripper after the wrist joint (e.g., a royal-blue triangle sticker or high-contrast Post-it triangle on the flat matte-white wrist camera mount plate) and verify1unique detection with0background false positives:python3 scripts/detect_marker.py --config config/marker_detect.json --image data/stage4/reference_overhead.png - Cue 1 (marker colour & solidity): Filters on chromatic BGR excess (
(B - G) >= min_b_minus_g,(G - R) >= min_g_minus_r,B >= min_b) or customhsv_lower..hsv_upperwith a3×3dilation, bounded area, and convex-hull solidity. - Cue 2 (mount surround contrast): Checks the concentric annulus
r ∈ [10, 32] pxaround each candidate centroid for bright matte-white pixels (white_surround_fraction >= 0.35) or high surround luminance contrast, rejecting background specks.
- With motor torque OFF (