Skip to content

Agent-Driven Testing

Shiplight ships as a single /shiplight skill for your coding agent, backed by the Shiplight MCP server that gives it a real browser to drive. Ask it to verify a UI change on the spot, or set up auth and create YAML tests. From there, Local Testing takes over for running, fixing, and CI. It can also run a broader quality review whenever you need one.

As you work together, Shiplight preserves durable facts learned from your conversations as project knowledge. Future workflows read these project-local notes so you do not have to repeatedly explain the same application quirks, environment constraints, or testing preferences.

Invoking Shiplight

Run /shiplight <subcommand> [context], or just describe what you want in plain language. The agent picks the right workflow:

/shiplight create-yaml-tests for the sign-up flow at http://localhost:3000
/shiplight screenshot the dark mode change    # natural phrasing resolves to `verify`

Run /shiplight alone for the full menu.

Prerequisite

Install the skill and MCP server once per agent. See Quick Start.

Subcommands

GroupSubcommandWhat the agent doesGuide
SetupinitScaffold a Shiplight test project and write specs/context.md
authSet up or repair login and saved storage stateAuthentication
updateRefresh installed Shiplight skills
Authorcreate-yaml-testsWrite YAML E2E tests by walking your app in a real browserCreate Tests
create-agent-verificationAuthor an agent verification — drives a full user journey, then proves the backend state behind it (API, DB, logs)Agent Verification
coverDecide what to test and the strategy, drive the producers, and report coverageDecide what to test
MaintainfixReproduce failing or drifted tests, diagnose root cause, repair the YAML, report app bugsFix a failing test
CheckverifyVisually confirm UI changes in the browser during local developmentVerify a change
ReviewreviewApp-quality review across security, privacy, compliance, design, resilience, performance, SEO, GEOReview your app
ShipciWire CI workflows and the failure-triage pipelineCI/CD
cloudRead Shiplight Cloud (Nova) results: runs, failing/flaky tests, artifacts
HelphelpList or explain subcommands. Never executes

The main workflow for most teams is authoring tests (Create Tests); the rest support it. Task-by-task walkthroughs — verifying changes, mobile emulation, persistent profiles, extensions, attaching to a browser — live in the Guides and apply across all of the above; underlying tool parameters live in MCP Tool Reference.

Released under the MIT License.