5. PRACTICAL GUIDANCE ON PERFORMANCE INDICATOR SELECTION
5.1. Hierarchical framework
5.1.1. Project delivery
Whereas all the performance indicators within the Fig. 2 hierarchy will be relevant, ‘Project Delivery’ focuses on demonstrating that the project is capable of achieving the required scope to an acceptable quality through the use of a competent team and with risks well managed (see Table 2).
Project
FIG. 2. Hierarchical framework for defining decommissioning performance indicators.
An overall indicator for project success could be a comparison of the completed activities versus the baseline schedule. Further detail could examine the percentage of work completed (by systems and/or rooms) and the number of planned milestones achieved on time. The physical outputs of the project should also be included in the scope of the indicators, for example, the quantity of decommissioning materials dismantled, collected, conditioned, recycled, packed, stored or disposed of — all compared to planned values.
Particular attention should be paid to interdependencies between activities because the potential delay of one activity may lead to delay in any dependent ones. Separate indicators should be developed in such cases to monitor the critical path of the project.
If external contractors are involved in the project, their performance should be subject to assessment both by using their own specialist set of indicators and by suitable indicators designed for this purpose by the project team (see also Section 4.1.3).
Poor performance on compliance with regulations can severely impact the progress and overall success of a decommissioning project. It is prudent to self-assess on such matters so that deficiencies can be detected and resolved at an early stage before any regulatory action. This can also build the confidence of the regulator in the TABLE 2. PROJECT DELIVERY PERFORMANCE INDICATORS
Level 1: Project Delivery
Level 2 Level 3 Example of performance indicators
Implementation of plans Project schedule [17, 29] Milestones met
Estimated date of completion Availability of site for reuse
Backlog Number of corrective maintenances overdue
Quality Amount of rework
Project progress Achievements by area [30, 31] (Annex 1D) Fuel stored/shipped versus plan Waste produced versus plan Waste stored, cleared, disposed Buildings decontaminated/demolished Suspect land remediated (%) Reduction in hazardous areas % of site in higher hazard zones Project risk management Schedule constraints Number of long lead items
Number of critical path items
Quantitative risk management Estimate of technical and budget uncertainty Contingency level
Stakeholder risks Estimate of stakeholder satisfaction
Regulatory risks Licenses/approvals outstanding as % of total required (Annex 1C)
Contract risks Amount of equipment and resource to be provided by external organizations
Labour Staffing [13, 17] Total employed (full-time equivalent)
% subcontractors
Skill/professional requirements
Competency % of roles and responsibilities defined
Training by topic area (Annex 1D)
% training sessions attended
TABLE 3. FINANCIAL PERFORMANCE INDICATORS
Level 1: Financial Performance
Level 2 Level 3 Example of performance indicators
Liability fund management Adequacy of fund % of project cost provided in fund
% decommissioning fund used Actual vs. planned liability discharged Risk management of fund % contingency remaining
Project financial management
Budget conformance [29] Planned versus actual expenditure Rate of spending in remainder of year
% risk monies used [13]
Adequacy of budget [11] Future budget estimates versus plan Savings made
Income generated Cost of financing
Sources of costs Actual versus plan for each area, e.g. waste, dismantling and staffing
Commercial Incentives to project Performance targets [17]
Incentives to subcontractors Performance targets [17]
Value management Earned value measures [11, 17, 29]
Cost Performance Index
Schedule Performance Index Estimate at completion
TABLE 4. HEALTH, SAFETY AND SECURITY PERFORMANCE INDICATORS Level 1: Health, Safety and Security Performance
Level 2 Level 3 Example of performance indicators
Process health and safety Hazard reduction Safety and environmental detriment [32]
Progress vs. significant hazard reduction milestones (Annex 1E)
Incidents Number of nuclear and radiological events recorded Number of nuclear and radiological events reported to the regulator (Annex 1E)
Technical quality of incident and allegation activities [33]
Accident investigations conducted [34]
INES events (level 1 and above) [17, 35]
Number of fire brigade actions
Plant condition Number of safety defects not corrected within the site’s own target time (usually 24 hours) in the month (Annex 1E) Total number of plant defects (Annex 1E)
Number of corrective work orders issued for safety systems [8]
Number of modifications not physically started within 12 months of modification receiving approval (Annex 1E) Number of modifications not closed 12 months after the completion of physical work (Annex 1E)
Challenges to safety systems Number of breaches of conditions and limits necessary in the interests of safety (Operating Rules) (Annex 1E)
Number of fire events
Safety plant out of service Number of safety plant items out of service Number of failures in safety systems [8]
% availability of safety plant
Revealed and unrevealed failures of safety plant Safety system functional failures [36]
Cooling water systems [36]
Emergency preparedness [37] % of adequate emergency exercises completed in the year to date (Annex 1E)
Findings during emergency drills/exercises [8]
Drill/exercise performance [36]
Emergency response organization drill participation [36]
Alert and notification system reliability [36]
Public radiological protection Maximum dose at the site boundary
% of approved limit
Average dose at the site boundary
Radiological effluent technical specifications/offsite dose calculation manual [36]
Worker health and safety Conventional health and safety [29, 34, 35] (Annex 1D)
U.S. Occupational Safety and Health Administration (OSHA) days away case rate
OSHA total recordable incidents rate Time since last lost time accident [17]
Worker radiological protection [17, 35]
(Annex 1E)
Collective dose against plan (Annex 1D)
Average individual dose (contractors and employees) Maximum individual dose (contractors and employees) Number of contamination events
Number of internal contaminations Outcome doses as % of ALARA budgets Occupational exposure control effectiveness [36]
TABLE 4. HEALTH, SAFETY AND SECURITY PERFORMANCE INDICATORS (cont.) Level 1: Health, Safety and Security Performance
Level 2 Level 3 Example of performance indicators
Safety culture Attitude to safety Number of breaches of safety procedures
% of corrective actions overdue (Annex 1E)
% of adverse behavioural observations
% of events due to human error [8]
% of events due to training deficiencies [8]
Number of temporary modifications [8]
Number of findings in configuration management [8]
Percentage of core competency posts vacant (Annex 1E) Striving for improvement The number of investigation reports not issued within six
weeks of the event (Annex 1E)
Number of independent internal safety and QA inspections and audits [8]
Number of findings from internal safety and QA inspections and audits [8]
Average time to clear findings from safety and QA inspections and audits [8]
Number of similar or repeated deviations and failures [8]
Leadership and management % of nominated managers on track with their safety interactions (Annex 1E)
Number of items remaining on senior manager’s watch lists (Annex 1E)
Security Physical protection [36] Not provided “to ensure that potentially useful information is not provided to a potential adversary” [36]
TABLE 5. ENVIRONMENTAL PERFORMANCE INDICATORS Level 1: Environmental Performance
Level 2 Level 3 Example of performance indicators
Environmental management
Implementation of environment plan No. of targets achieved (%)
Maintenance of accreditation achieved (e.g. [38]) Waste and material
management
Incidents Pollution incidents: Annual number of category 1 and category 2 incidents [39]
Breaches of permits: Annual number of category 1 and category 2 breaches of permits [39]
Radioactive Clearance of material (tonnes and % of total dismantled) Waste generated requiring disposal (tonnes and % of total dismantled)
The percentage of intermediate level waste that has been packaged and conditioned according to regulators’ guidance [39]
TABLE 4. HEALTH, SAFETY AND SECURITY PERFORMANCE INDICATORS (cont.) Level 1: Health, Safety and Security Performance
Level 2 Level 3 Example of performance indicators
strength of project systems and processes. Suitably designed performance indicators can be used to communicate compliance performance, not only to regulators, but also to staff and other stakeholders, thereby reassuring them about the adequacy of control of the project. Such indicators include the number of regulatory permissions requested versus those received and the total number of days of delay incurred due to regulatory interface issues (the target being zero).