What is a Pilot?
An experimental or preliminary trial or test of your solution on a limited scale.
- Lower Risk
- Lowers risk of failure by limiting resource usage.
- Assess true performance in controlled-but-live experiments.
- Confirm or disprove expected results and relationships.
- To test and validate the benefit of the proposed solutions before roll out.
- Validate your measurement system.
- Improve Solution
- Identify additional improvements in either the solution or implementation launch itself.
- Improve future projections of benefits of full roll out.
- Stakeholder Relations
- Increase stake-holder buy-in.
- Quickly deliver a version of the solution to a targeted segment of the client population.
When should you Pilot?
- When you want any of the benefits covered in Why.
- The scope is very large and the price of full roll out failure is large.
- The solution could have far-reaching or unintended consequences.
- The solution is difficult or impossible to reverse.
Traits of a Pilot
- Small scale
- Designed to incrementally increased-employee involvement
- Utilize simulations – process improvement may be simulated using mathematical or computer based modeling
Design the Pilot
Similar to the Define phase of DMAIC – what are you trying to do? What do you hope to achieve? What is the definition of success? How are you going to get there? Who is impacted? Whom do you need help from?
What are the 3 keys aspects to a successful pilot? Plan, monitor, evaluate
- Plan Pilot Purpose & Goals
- Define what needs to be piloted / implemented.
- Good idea to reference the Project Charter, especially the Project Benefits & Objectives. Will your pilot be able to demonstrate that achieving these is possible?
- Pilot Scope
- Prioritization matrices can be used to rationally narrow down the focus of the team before detailed implementation planning can happen.
- What is the size or boundaries to what will be measured?
- How will you ensure the pilot is as realistic as possible?
- Identify when & where pilots will be run.
- Activities List
- Clearly articulate the steps & tasks necessary to test the proposed solutions.
- Process it Affects
- Determine how pilots will be conducted and length of time
- Pilots should be run for as long as it takes to understand if the process is stable or not.
- Determine result tracking needs.
- Useful tools.
- Budget and Resources Required
- Identify team members, equipment, and material to be used.
- Plan appropriate training and communications for the pilot.
- Documentation Required
- Monitoring plan and operational definitions of measurements to collect and goals to be met.
- How will you evaluate results?
- Contingency Plans
- How will you monitor and deal with issues during the pilot?
- Ex. Minimize disruptions
Run the Pilot
- Collect data on internal and external factors that may be influencing the process.
- Expose the pilot to as broad of a range of inputs and process conditions as possible.
After the Pilot
- Collect and Evaluate Pilot Results.
- Analyze the gaps between the predicted performance and the actual performance.
- Root cause the gaps to determine why and if solution changes are needed.
- Analyze the pilot plan. What worked? What didn’t? What had to be added or changed?
- Communicate Pilot Results
- o Create a summary of the strategy used to pilot the solution and communicate the results achieved.
- Solicit Stakeholder Feedback:
- Change management is a key part of project success. Soliciting feedback during stakeholder interviews gives you access to thoughts from those impacted by the project.
- Review the original stakeholder analysis to determine how/if anything has changed, and what you may want to do to address those results.
Implementation plan: a summary of the strategy to be used for implementation of the piloted solution.
Should include much of the same type of information as the pilot plan but clearly adjusted to take into account the results of the pilot.
Where & How do we use the Implementation Plan?
Final Process Sigma requires Operational definitions from implementation plan.
Apply lessons learned from the pilot
Adjust the pilot plan for any problems or learnings that occurred during the pilot. Also adjust for the difference in the scale of the roll out.
Account for Barriers to implementation
- Identify forces favoring implementation
- Identify forces opposing implementation
- Recognize implications and risks from failing to address barriers
Good idea to revisit the Charter and review stakeholder feedback from the pilot.
- Include large-scale training for new work methods.
- Fine-tune new process
Sustain & Improve
- Transition to the Control Phase
- Requires the highest level of employee involvement
- Conduct weekly & monthly reviews