Key Performance Indicators

In CITI-SENSE, we developed and implemented Key Performance Indicators (KPIs) for project progress evaluation and risk management.

The KPIs covered CITI-SENSE information flow ‘citizens – sensors & platforms – data servers – products & services’.

KPIs score is extracted by questionnaire, and included the following five completion scales and labelled with colours (as showed in Table below):

1: 0 – 60%, If an objective was achieved lowly or relatively poor.
2: 60% – 70%, If an objective was achieved about 60-70%
3: 70% – 80%, If an objective was achieved about 70-80%
4: 80% – 90%, If an objective was achieved mostly.
5: 90 – 100%, If an objective was achieved nealrlya fully.

Flag colours	Project successful level	Score (%)
Blue	Excellent or complete success	90-100%
Green	Very good or very effective pilot studies	80-90%
Yellow	Good or effective pilot studies	70-80%
Orange	Fair or moderate achievement of goals of the pilot studies	60-70%
Red	Low or relatively poor achievement of the objective of the pilot studies	<60%

The KPIs were implemented in CITI-SENSE at both pilot phase and full implementation phase (see underneth examples), and results showed that it is a very practical approach for keeping project on right track.

Table 1. The overall score (%) for pilot’ studies KPIs self-evaluation in cities.

KPIs theme	Barcelona	Belgrade	Edinburgh	Haifa	Ljubljana	Oslo	Ostrava	Vienna
Citizens	75	65	50	65	85	70	85	60
Sensors and sensor platforms	90	80	50	90	50	80	20	80
Data server platforms	60	60	20	80	100	20	20	100
Products and services	64	38	20	69	56	44	73	64
Others	100	80	20	65	80	40	100	80

Table 2. The overall score (%) for pilot’ studies KPIs self-evaluation in schools.

KPIs theme	20.Oktobar (Serbia)	Holy Rood (Edinburgh)	Gimnazija VIČ (Slovenia)	Horten Videregående (Norway)
Citizens	82	70	82	77
Sensors and sensor platforms	50	50	40	40
Data server platforms	100	100	100	60
Products and services	67	58	56	56
Others	87	73	87	73

Table 3. The overall score (%) for pilot’ studies KPIs self-evaluation in public space Vitoria.

KPIs theme	Overall score	Explanation
Citizens	60	Above average, we initiated dialog with CEA and Vitoria municipality, but not engaging citizens yet in the pilot’ studies.
Sensors and sensor platforms	100	Very high, we have chosen commercialized sensors. The thermal levels measured by portable Kestrel 4000 can be considered sufficiently accurate and representative for thermal comfort evaluation. The accuracy of the noise levels measured by the Microphone is not reaching the accuracy of a sonometer class 1, but it gives a global noise level with a difference of ± 2 dB.
Data server platforms	60	Above average, data communication via smartphone is working well, further tuning is needed in the full implementation, and CITI-SENSE data server platform is under development.
Products and services	46	Lower than average, various products and services are under development.
Others	100	Very high, the pilot’ studies are a great experiment and lessons learned for the project team that are very crucial for the full implementation.

For more information about KPIs, e.g., how it is developed, how to use it, etc., please contact Hai-Ying Liu from NILU via email hyl@nilu.no.

Term of Use

If you use our Key Performance Indicators, please refer it to the CITI-SENSE project as follows: The Key Performance Indicators were partly developed by the CITI-SENSE project. CITI-SENSE is a Collaborative Project partly funded by the EU FP7-ENV-2012 under grant agreement no. 308524.