automate-this
Analyze screen recordings of manual processes and generate working automation scripts at multiple complexity tiers.
- Extracts frames and audio narration from video files, reconstructs the step-by-step workflow, and proposes automation tailored to the user's installed tools
- Offers three automation tiers: quick wins (shell aliases, one-liners), standalone scripts (bash, Python, Node), and full scheduled automation with logging and error handling
- Includes application-specific strategies for browser workflows (API-first, then Playwright), spreadsheets (pandas, csvkit), email (osascript, smtplib), file management, and macOS automation
- Requires ffmpeg; Whisper optional for audio transcription if narration is present; verifies environment before proposing solutions to avoid unnecessary dependencies
Automate This
Analyze a screen recording of a manual process and build working automation for it.
The user records themselves doing something repetitive or tedious, hands you the video file, and you figure out what they're doing, why, and how to script it away.
Prerequisites Check
Before analyzing any recording, verify the required tools are available. Run these checks silently and only surface problems:
command -v ffmpeg >/dev/null 2>&1 && ffmpeg -version 2>/dev/null | head -1 || echo "NO_FFMPEG"
command -v whisper >/dev/null 2>&1 || command -v whisper-cpp >/dev/null 2>&1 || echo "NO_WHISPER"
- ffmpeg is required. If missing, tell the user:
brew install ffmpeg(macOS) or the equivalent for their OS. - Whisper is optional. Only needed if the recording has narration. If missing AND the recording has an audio track, suggest:
pip install openai-whisperorbrew install whisper-cpp. If the user declines, proceed with visual analysis only.
Phase 1: Extract Content from the Recording
More from github/awesome-copilot
git-commit
Execute git commit with conventional commit message analysis, intelligent staging, and message generation. Use when user asks to commit changes, create a git commit, or mentions "/commit". Supports: (1) Auto-detecting type and scope from changes, (2) Generating conventional commit messages from diff, (3) Interactive commit with optional type/scope/description overrides, (4) Intelligent file staging for logical grouping
30.2Kgh-cli
GitHub CLI (gh) comprehensive reference for repositories, issues, pull requests, Actions, projects, releases, gists, codespaces, organizations, extensions, and all GitHub operations from the command line.
21.2Kprd
Generate high-quality Product Requirements Documents (PRDs) for software systems and AI-powered features. Includes executive summaries, user stories, technical specifications, and risk analysis.
17.4Kdocumentation-writer
Diátaxis Documentation Expert. An expert technical writer specializing in creating high-quality software documentation, guided by the principles and structure of the Diátaxis technical documentation authoring framework.
17.4Kexcalidraw-diagram-generator
Generate Excalidraw diagrams from natural language descriptions. Use when asked to "create a diagram", "make a flowchart", "visualize a process", "draw a system architecture", "create a mind map", or "generate an Excalidraw file". Supports flowcharts, relationship diagrams, mind maps, and system architecture diagrams. Outputs .excalidraw JSON files that can be opened directly in Excalidraw.
16.4Krefactor
Surgical code refactoring to improve maintainability without changing behavior. Covers extracting functions, renaming variables, breaking down god functions, improving type safety, eliminating code smells, and applying design patterns. Less drastic than repo-rebuilder; use for gradual improvements.
16.1K