Find Duplicates in FiftyOne Datasets

Overview

Find and remove duplicate or near-duplicate images using FiftyOne's brain similarity operators. Uses deep learning embeddings to identify visually similar images.

Use this skill when:

• Removing duplicate images from datasets
• Finding near-duplicate images (similar but not identical)
• Clustering visually similar images
• Cleaning datasets before training

Prerequisites

• FiftyOne MCP server installed and running
• @voxel51/brain plugin installed and enabled
• Dataset with image samples loaded in FiftyOne

Key Directives