MCP Server Tester — Reference Guide

What This Framework Does

@gleanwork/mcp-server-tester is a Playwright-based testing and evaluation framework for Model Context Protocol (MCP) servers. It provides:

• Playwright fixtures for automated MCP tool testing
• Data-driven eval datasets with optional LLM-as-a-judge scoring
• MCP host simulation via real LLM providers (Anthropic, OpenAI, Google, etc.)
• A custom Playwright reporter with an interactive UI

Requires Node.js >= 22.0.0 and Playwright.

Import Paths

The package exposes four entry points: