Why does a pilot need a test plan?
A pilot is the one moment when you can test a tracking supplier on your own vehicles, roads and people. Without a plan it ends with a feeling ("it seemed fine") and a sales conversation. A plan fixes four things before installation: what will be tested, how, what result counts as a pass, and who decides.
This file holds 17 cases in seven areas: position, data delivery, events and alerts, video and driver monitoring, the platform, support and installation. Eight are marked Must. If a Must case fails, the decision cannot be Accept.
How to use the pilot plan
- Fill the Plan sheet. Name the pilot, set the dates, list the vehicle groups and confirm that the drivers are informed.
- Set the two pass rates. The examples are 100% on Must cases and 80% on all cases. Decide now, before any result.
- Record the baseline. Use your own records for the same vehicles and the same number of weeks as the pilot.
- Change each criterion to your number and send the sheet to the supplier. Ask for a written yes before installation.
- Run the cases. Enter the result, the value you observed, the date and who tested. Log every problem on the Issues sheet.
- Read the Results sheet and sign on the Sign-off sheet.
How to write a criterion that can fail
"The position is accurate" cannot fail, so it proves nothing. "On a known route, the platform shows the vehicle within 30 m of the reference at each of 10 checkpoints" can fail. Write what you measure, the number, how you read it and the conditions. The gray criteria in the file are written this way. The numbers are yours to set.
Test the support too
Devices fail on a Friday night, not on a Tuesday morning. Two cases in the file ask you to raise a real ticket outside office hours and to measure the time to the first reply and to a fix. Record the clock times in the Evidence column. A supplier that answers fast during the sales stage and slowly during the pilot is telling you something.
Common mistakes
- Changing a criterion after seeing the results.
- Piloting only on new vehicles and easy routes, then rolling out to the whole fleet.
- Taking the baseline from a different season or a different mix of routes.
- Counting Partly as a pass. The file does not.
- Accepting the supplier's own report as the only source. Take screenshots and exports yourself.
- A pilot too short to show a trend. Size it with the pilot sizing planner.
- Starting before the drivers know what is recorded.
Limits of this template
It is a planning and recording tool. It does not test whether a device holds any regulatory approval, and it is not a legal document. The 17 cases are general, so add your own for special equipment such as fuel probes or temperature sensors. The numbers in the criteria are examples.