Stage 2: Innovation and Assessment Requirements

Strategic Actions associated with this stage. This stream will collate the overall and detailed user needs for the innovation. These will be used to develop the pilot’s functional requirements or viewpoint, its physical context and the associated communication requirements. This step will utilise the user needs, collated within Stage 1 – aims and objectives, to develop a series of statements defining the requirements for the innovation. This step defines the functionality needed by the innovation to fulfil the requirements This step defines how the functionalities can be grouped into physical locations to form implementable innovation to fulfil the requirements This step, developed from the physical viewpoint, describes the communications links needed to provide implementable innovation and fulfil the requirements. This step, developed from the functional, physical and communications viewpoint, estimates the likely cost of implementing the innovation within the trial. Consideration may also be given to the potential total costs of implementing the innovation across the wider HA network following a successful assessment. The purpose of this stream is to determine key performance indicators (KPIs) for the pilot and develop the overall test methodology to assess these indicators. This stream will also consider the various impacts of the innovation and the likely cost of the overall assessment process. The extent and the practicality of the range of data collection issues would also be addressed. This step considers and determines the key performance indicators (KPIs) to be monitored by the pilot against which the impact of the innovation will be assessed. This step defines the methodology that will be used to measure and quantify the performance indicators defined in step 2.2.1. This step considers and estimates the impact that is anticipated through the implementation of the innovation in the pilot. This step estimates the likely cost of the assessment of the innovation within the pilot. The third stream in this stage is site selection. This includes developing the criteria for the consideration of the pilot site, traffic data analysis, health and safety assessment, environmental impact analysis and site identification. This step develops the criteria required to be fulfilled by the pilot site This step applies the criteria defined in step 2.3.1 to locations on the HA network or off road sites to identify the location of the pilot. After the completion of all three streams within Stage 2, consideration must be given to the overall viability and programming of the pilot. This will balance the estimated costs and impacts of the innovation itself, the assessment framework and the pilot location, identifying alternative procurement routes to ensure these provide flexibility for potential enhancements typically needed in pilots. This will be summarised within the full business case validating the assumptions made to support the continued investment within the pilot. Typical outputs that might be expected from this stage. Stage 1 Stage 3 Stage 3 Stage 4 Stage 5 No Yes

Step 2.2.2 - Define assessment framework

Having determined the potential impacts and the range of indicators to assess them consideration must be given to how these impacts are to be quantified and measured. It is possible at this stage that the likely impact of some indicators will be minimal particularly in comparison to the size of the pilot being undertaken. Judgement will be required to assess the risk of eliminating the quantification of some of these potential indicators.

Consideration should also be given here to the potential of combining the measurement of two or more indicators. It is essential at this stage that all the assumptions made in the assessment are recorded. These will prove particularly useful should the completion of the pilot lead to the development and adoption of new standards.

A document to determine the methodology to be adopted to quantify the impacts must be produced. This is a particularly important document which must be updated if new indicators are identified or the overall methodology is subsequently modified.

The design of the methodology must enable a truly independent assessment of the innovation to be determined. To avoid bias, an independent party may be needed to carry out the assessment. It is possible that the requirements for the innovation itself may provide an opportunity, with only minimal changes, for collecting and presenting essential assessment data and information. Close liaison between the assessment stream and the innovation requirements stream is essential at this stage.

A guide and a comprehensive checklist issued by the European Commission in 1998 provides detailed guidance on this [EC 1998B]. It provides a detailed guide and checklist for assessment of transport telematics applications.

The Assessment Strategy developed for the Active Traffic Management Pilot [HA/TRL 2004] and the M1 HOV [TRL 2005B] provides a good example of the considerations that should be made in the development of a pilot’s assessment framework.

An important aspect to consider is to ensure that sufficient representative ‘before data’ is collected. Whilst data collection cannot commence until the pilot has been reviewed and progressed to Stage 3 - Implementation it is strongly recommended that preparation for before data collection is started at the earliest opportunity.