Stage 2: Innovation and Assessment Requirements
Stream 2.2 - Assessment
This stream will define the necessary assessment requirements and should be determined once the aims and objectives in Stage 1 have been finalised. It will be carried out in parallel to the innovation requirement analysis and site selection streams. Each of these streams is intrinsically linked and should not be considered in isolation from each other.
Pilots, by their nature, involve novel or innovative ideas and techniques about which there is uncertainty as to their effectiveness and the scope of their application. As a consequence, monitoring and assessment are very important to evaluate the performance and provide evidence to the decision makers to roll-out or terminate.
The identification and definition of the assessment objectives will be based upon the definition of the user needs in Stage 1. This will provide the key questions to which the end users, the decision makers and other stakeholders must have answers. Stakeholders and suppliers should be involved through this stream to review and refine the assessment requirements.
The HA Guidelines for the Monitoring and Evaluation of Pilot Projects [Powell 2001] provides useful guidance to enable the assessment framework development. This guide highlights three impacts of pilots which should be monitored and assessed:
The immediate effects to enable rapid changes to be made to counteract any unforeseen dangerous or other adverse outcomes
Short term impacts to be identified early in the life of the scheme at reasonable cost
Medium to longer term, wider, impacts