Broadening The Scope of Impact

About this good practice

By project MARIE

Published on 05 September 2018

Ireland

SFI (Ireland's National funding agency for Science & Engineering) developed the Impact Framework to apply to all applications under 3 thematic areas:
1. creating new products, processes policies & behaviour
2. improving efficiency & efficacy of existing practice and
3. research to improve resilience & sustainability

They asses the impacts of these applications under 8 pillars:
1. Economic
2. Societal
3. International engagement
4. Policy & public service
5. Health & wellbeing
6. Environmental
7. Professional Services
8. Human Capacity

Impact Statements form part of the proposal and are assessed during:
• Ex-Anti at the selection of Programme Themes
• pre-Award stage
• Selection stage
• Monitoring & Management of impact arising during the terms of an award

As part of the Impact Statement, SFI awardees are asked to set targets against many Key Performance Indicators (KPIs). The KPIs and targets are viewed to directly support delivery of impacts across many areas and are reviewed periodically by SFI. The impact declarations assist SFI to quantify the types of impacts coming from various SFI Programmes.

These wider Impacts are mapped in a matrix and then reviewed by a Science Review Panel and an Impact Review Panel prior to final selection of projects. KPI's and targets on these wider impacts are monitored throughout the term of the project.

Expert opinion

The practice represents an approach to identifying and measuring the impact of research, development and innovation projects – beyond the main outcomes. Being able to quantify secondary effects can help promote efficient use of public funding, e.g. by prioritising applications with the greatest potential for spill-overs. The potential for transfer should be fair; what is likely of most interest and value to other authorities is to learn what indicators are being used and how they reflect the impact achieved for each of the eight pillars. This is often and challenge, how to best quantify impact that can be of a qualitative nature. However, the long lead time before any evidence of success can be measured may be a barrier to transfer.

Carl Arvid Dahlöf

Resources needed

Time & human resources required to evaluate impact at evaluation of award stage and during annual reporting.

Evidence of success

As this framework involves a long period (which could be in the region of 10 years or more) and has been relatively a recent introduction (since around 2012) the complete evidence of success may not be available at this time.

Potential for learning or transfer

The IMPACT concept fits with the objectives of RRI and the MARIE project. It can be customised or altered, as required to suit partners regions. The framework is based on discussions within the Small Advanced Economies Initiative