REF What we know and thought we knew, in preparation for the next Research Excellence Framework

Transcription

1 REF 2021 What we know and thought we knew, in preparation for the next Research Excellence Framework Dr. Tim Brooks, Research Policy & REF Manager, RDCS Department of Psychology, 19 April 2016

2 About the REF A periodic national assessment of research activity which: Provides benchmarking information Ensures public accountability for investment in research and its benefit Enables the selective allocation of recurrent research grant (QR)

3 The next REF? Three weeks in November 2015: Green Paper Comprehensive Spending Review Nurse Review And then the Stern Review

4 Quality definitions In terms of originality, significance and rigour, quality that is: 4* - world leading 3* - internationally excellent but which falls short of the highest standards 2* - recognised internationally 1* - recognised nationally Unclassified below the standard of nationally recognised work, or which does not meet the published definition of research

5 Quality profiles Anglia REF 2014 UoA 4 39 outputs 4* 3* 2* 1* U/C =4 =24 =10 =1 =0 All submissions and quality profiles on

6 Open Access All journal articles and conference contributions with ISSN accepted for publication on or after 1 April 2016 must be made available via an open access repository (e.g. ARRO) within 3 months of acceptance. Additional credit for exceeding, and supporting the exceeding, of the basic requirements.

7 Impact for REF 2014 Worth 20% of the final score An impact template (20%) describing how the submitting unit had enabled impact from research during the assessment period Case studies (80%) giving examples of specific impacts realised during the assessment period, underpinned by research, at least 2* in quality, produced by the submitting unit in the previous 21 years Number of case studies determined by FTE of staff in the submission.

8 The next REF? Impact Seen as a resounding success in REF 2014 Worth 25% next time? Abandon impact template document or add into research environment requirements? Increase number of case studies required per FTE? Reuse of previously submitted case studies?

9 Defining Impact an effect on, change or benefit to the economy, society, culture, public policy or services, health, the environment or quality of life, beyond academia Impacts within HE excluded unless they extend significantly beyond the submitting HEI.

10 Case Studies (1) Summary: a brief introduction to the specific impact(s) being described Underpinning research: Details of the key research insights or findings, and details of what research was undertaken, when and by whom References to the research, demonstrating 2* quality

11 Case Studies (2) Details of the impact: and explanation of how the research made a distinct, material contribution to the impact; and the nature and extent of that impact. Sources to corroborate the impact: details of reports, reviews, individual users or other beneficiaries supporting the claims made

12 Assessment Threshold test: is the quality of underpinning research at least 2*? Impact case studies scored on their significance and reach Context of the impact all important.

13 RAND findings Links between underpinning research and its contribution to the impact must be very clear It shows if the author doesn t believe in the value of what they re saying Assessors had to take a lot of the content on face value; audit requests more likely if they were unconvinced by language or had prior knowledge of the impact claimed The case study says everything it must assessors will not always follow links

14 Challenges Understanding what constitutes eligible impact Identifying good examples of impact arising from our research Locating sufficiently robust evidence retrospectively but challenges that can be overcome

15 Enabling Impact Who might benefit from the research? How might they benefit from the research? What can be done to communicate the outcomes of the research and engage with potential beneficiaries? What resources will be needed to support this?

16 Next steps Do excellent research, and publish it Embed impact in your activities Identify synergies, and collaborate, internally and externally, inside and across disciplines Develop and follow strategies to support impact and develop the research environment Supervise doctoral students to completion, and win grants

17 More information REF 2014 rules & regulations: REF 2014 results & submissions: results.ref.ac.uk REF impact case study database: impact.ref.ac.uk REF evaluation reports: RCUK Pathways to Impact guide:

18 Thanks for your attention Any questions? Dr. Tim Brooks, Research Policy & REF Manager, RDCS