Why compare before and during a pilot?
A pilot is an experiment. Without numbers from the period before it, nobody can say what changed. Many pilots end with an opinion, "it feels better", instead of a figure.
Take the before numbers first, from the same vehicles. Run the pilot. Then compare the two on one sheet, KPI by KPI.
How to use the sheet
- Fill in Setup. Enter the dates and the number of vehicles for the period before and for the pilot.
- Enter totals on the KPIs sheet. One value for the period before and one for the pilot. Write where each number came from.
- Check the Better when column. For most KPIs lower is better. For jobs completed, higher is better.
- Read the Result column, then the Summary sheet.
Why per vehicle per week?
The periods may not be the same length, and the number of vehicles may change. Totals are converted to a rate for one vehicle in one week, so the two periods can be compared fairly.
Percentage KPIs, such as the share of alerts you judged false, are used as entered.
A few weeks can show changes in idle time, fuel and overtime, and early changes in harsh events. They are too short to show fewer crashes. Season, routes and workload also change between periods, so write any difference in the source column. The sheet holds no industry figures and no Tracom results. The typical values in Setup, 28 days and 5%, are starting points. Change them to your policy.
Limits of this sheet
It compares numbers you enter. It does not read data from any platform, and it cannot show that tracking caused a change. Check that both periods are comparable before you rely on the Result column.