ShipBash

ShipBash is an AI QA team for a live web product. It is driven by semantic test cases written in plain language: its agent reads them and tests the real production site the way a user would, around the clock, and hands back evidence of every run, whether it passed or broke. There are three primitives. A user journey is an end-to-end path made of plain-language steps and checkpoints. A hook runs before or after journeys to set up or clean up, for example creating or deleting test data. A checkpoint is a statement that must hold at its point in a journey or hook for it to pass. ShipBash finds and changes journeys by walking the live product (a walk), and runs all of them with their hooks as a verification.

Let the CLI teach you

• Run npx shipbash help for the commands, and npx shipbash <command> --help before you use a command for the first time. Do not take commands, flags or output shapes from memory or from this file: the installed CLI is the source of truth, and it changes.
• Under a coding agent, or without a terminal, the CLI runs in agent mode: it never prompts, prints exactly one JSON object on stdout, and writes plain progress to stderr. If you ever get a prompt or coloured text instead, add --json or set SHIPBASH_AGENT=1 for your shell.
• A failure carries error (a stable code), message, nextSteps, and whatever the next step needs, such as the choices, the question or the review. Some results carry nextSteps too. Do what nextSteps says instead of improvising.
• Walks and verifications take minutes. In agent mode a command that waits for one returns after 90 seconds with exit 3 while ShipBash keeps working; run what nextSteps says to wait again, as many times as it takes. Stopping a wait never stops the work.

Exit codes

• 0: done. A verification whose verdict is failed still exits 0; the verdict is in the output.
• 1: failed. Read error and nextSteps, fix what they name, and try again.
• 2: the user has to act or decide first. Stop, put the question from nextSteps to the user in your own words, and continue only after they answer. Never work around a 2.
• 3: ShipBash is still working. Run what nextSteps says to keep waiting.

What only the user can do