Service 07 · Phase Two
007 / 08
Planning · evaluation
1 month

Plan the pilot before anyone starts building.

A pilot without a plan is just spending money. One month to define exactly what will be tested, what success looks like, and when to go, change, or stop.

Phase Phase two
Engagement Fixed scope · pilot-ready
§ 01 · Overview
Service AI Pilot Design and Evaluation Plan
Prerequisite Service 06 · Process Analysis and Workflow Design
Phase Phase two
Duration One month
Format Pilot planning + evaluation design
Team Principal consultant
Output Pilot brief for implementation

A pilot without a plan is just spending money. Most AI pilots fail not because the technology does not work, but because nobody defined what success looked like before the test started.

This service takes one AI-ready workflow and designs the pilot that will test it properly. I define exactly what will be tested and what is out of scope, who owns the pilot, which users are involved, what data and systems are required, and what type of AI solution to consider.

The output is a complete pilot brief. Anyone who builds or runs the pilot works from this document. Before the pilot starts, the business knows what result means proceed, what means adjust, and what means stop.

§ 02 · Service map

One pilot.
No ambiguity.

Scope, participants, data, risk, test method, criteria, metrics, and the go/change/stop rule, all defined before the build begins.

Inputs · workflow · data
Outputs · decision · handover
Duration 1 month
Risk controls documented 5 to 10
Acceptance criteria defined 3 to 6
Final artefacts 2
§ 03 · Fit

Right for you if
the design is done.

This layout is for explaining a service as a repeatable operating shape: who it is for, how the work moves, and what the client leaves with.

001

Service 06 is complete.

The workflow specification has been delivered. The redesign is done. Now the business needs a plan for testing it, with defined success criteria, not a vague brief.

002

You need defensible evidence.

Leadership, a board, or a partner group needs to see that the pilot is structured, with clear success criteria, risk controls, and a decision rule that produces a usable answer.

003

Someone is about to build.

An implementation partner or internal team is waiting to start. They need a pilot brief detailed enough to work from, not a slide deck with good intentions.

§ 04 · How it works

One month.
Four stages.

Stage 01

Define the pilot scope.

With leadership, define exactly what the pilot will test: which version of the workflow, which staff cohort, which time period, and what data it will use.

Week 01
Stage 02

Design the test.

Define the test method, the baseline to measure against, the metrics that will be tracked, and the data collection approach.

Week 02
Stage 03

Build the risk and decision frame.

Document the risk controls, human review requirements, escalation rules, acceptance criteria, and the go/change/stop decision rule.

Week 03
Stage 04

Deliver the pilot brief.

Present the complete pilot brief. Confirm it is sufficient to brief the implementation partner or internal team. Introduce them if needed.

Week 04
§ 05 · Outputs

What the client
leaves with.

Pilot Scope Statement

Exactly what is being tested, defined precisely.

Proof

Prevents the pilot from expanding into an undefined build.

Out-of-Scope List

What this pilot does not cover, written clearly to prevent drift.

Proof

Protects the pilot from scope creep.

Pilot Owner and Participant Map

Who runs the pilot, who uses it, and who signs off.

Proof

Makes ownership explicit before testing starts.

Risk and Control List

What could go wrong and what controls are in place.

Proof

Addresses risk before it becomes a reason to cancel.

Human Review Plan

Where people stay in the loop and what they check.

Proof

Keeps judgement and accountability inside the pilot.

Acceptance Criteria

The specific conditions that must be met for the pilot to be considered successful.

Proof

The business knows what a pass looks like before the pilot begins.

Pilot Metrics

What will be measured and how.

Proof

Keeps measurement from shifting halfway through the pilot.

Go, Change, or Stop Decision Rule

The explicit result that means proceed to build, adjust the approach, or stop the pilot entirely.

Proof

Turns the pilot into a decision instead of an experiment with no endpoint.