SIGN IN SIGN UP

chore(evals): Rename workflow evals to MCP agent evals (#1312)

closes #1286 

## What

Renames the harness to say what it evaluates: an agent using the Apify
MCP server.

- `evals/workflows/` → `evals/mcp_agent/`
- `run_workflow_evals.ts` → `run_mcp_agent_evals.ts`,
`workflow_judge.ts` → `mcp_agent_judge.ts`
- `evals:workflow` → `evals:mcp-agent`, `evals:workflow:export-dataset`
→ `evals:mcp-agent:export-dataset`. No aliases kept.
- Symbols and prose: `WORKFLOW_DATASET_NAME` → `MCP_AGENT_DATASET_NAME`,
`parseWorkflowItem` / `toWorkflowTestCase` / `fetchWorkflowCases` →
`…McpAgent…`, `WorkflowItem` / `WorkflowCase` / `WorkflowTaskOutput` /
`WorkflowTaskOptions` → `McpAgent*`, README and help text.
- Langfuse dataset `workflow-evals` → `mcp-agent-evals` (renamed in the
UI; the public API has no rename endpoint).

Pure rename: `dataset_snapshot.json` moves path with zero content
change.

## Beyond the issue's list

The judge score `workflow_judge` is renamed to `mcp_agent_judge`.

Left alone as out of scope: the Langfuse project name `MCP Workflow`,
the `workflow-evals-rubric` dataset, and the case ids
`workflow-mcp-discover-and-execute` /
`workflow-search-fetch-schema-call`.

## Verification

`pnpm run type-check`, `pnpm run lint`, `pnpm run test:unit` (1455
passed), `pnpm run format`, `pnpm run check:agents` all pass.

## AI assistance

Written with Claude Code: file renames and the symbol and documentation
rewrites. Reviewed by me.
R
Robert-George Crupa committed
8d9d096bbd82fc61a4b7ea69912fc377907c92a6
Parent: 59e5380
Committed by GitHub <noreply@github.com> on 9/4/2026, 1:28:31 PM