so101-calibration

Installation
SKILL.md

SO-101 Stage 5 (Optional · Requires Fixed Camera) — Tabletop Touch-Down & 3D Hand-Eye Calibration

After completing Stages 0–3 in ../so101-bringup/SKILL.md (including optional Stage 4: the USB bandwidth check and reference frames, which R10 drift checks require) and following all safety rules (R1–R16) in safety_rules.md, measure the physical tabletop height z_table and fit the 3D fixed/overhead camera projection matrix using calibration_notes.md:

  1. Step 0 — Verify Fixed/Overhead Camera Configuration:

    • Check NOTES.md and config/robot_config.json (get_fixed_camera_role_and_config in so101_common.py).
    • Stage 5 requires a stationary fixed/overhead camera viewing the arm and tabletop. If the human only set up a wrist camera (minimal 1-camera setup), stop with a clear message explaining that Stage 5 requires a fixed camera and ask whether they want to add one or finish at Stage 3 ("Hello World").
  2. Part A — Two-Cue Gripper Marker Verification (detect_marker.py, R9, R16):

    • With motor torque OFF (R16), ask the human to place a unique high-contrast marker on the gripper after the wrist joint (e.g., a royal-blue triangle sticker or high-contrast Post-it triangle on the flat matte-white wrist camera mount plate) and verify 1 unique detection with 0 background false positives:
      python3 scripts/detect_marker.py --config config/marker_detect.json --image data/stage4/reference_overhead.png
      
    • Cue 1 (marker colour & solidity): Filters on chromatic BGR excess ((B - G) >= min_b_minus_g, (G - R) >= min_g_minus_r, B >= min_b) or custom hsv_lower..hsv_upper with a 3×3 dilation, bounded area, and convex-hull solidity.
    • Cue 2 (mount surround contrast): Checks the concentric annulus r ∈ [10, 32] px around each candidate centroid for bright matte-white pixels (white_surround_fraction >= 0.35) or high surround luminance contrast, rejecting background specks.
Installs
14
GitHub Stars
161
First Seen
3 days ago