A report for the Higher Education Funding Council for England (HEFCE) by Digital Science reveals that the scholarly significance of research underpins its societal impact.
The report titled 'Publication patterns in research underpinning impact in REF 2014' is the first report to analyse all research publications submitted for research assessment between 1988 and 2014. The study found that at least 42 per cent of the research cited in impact case studies in the 2014 Research Excellence Framework (REF2014) had been submitted as research outputs to the various prior research assessments. This suggests that research of scholarly significance leads to societal impact, but also emphasises the broad base of research from which impact stems.
The analysis covers almost 1 million submitted research outputs and more than 35,000 impact case study references across 25 years and five assessment exercises. The report considers the relationship between submitted outputs (as evidence of academic research quality) and impact case study references (as evidence of societal and economic impact). It explores what the data says about the selection of research outputs for assessment, and about changes in selection behaviour as a response to assessment.
According to the report, journal articles, over time, have become a more commonly submitted output type (when compared with books, conference proceedings and other media). This is despite the fact that HEFCE analysis comparing quality profile by output type found that monographs were awarded the highest proportion of four star scores (Note 1). In early research assessment cycles, the research outputs submitted tended to be those published towards the end of the publication period. In Science and Engineering recent exercises saw submissions from earlier in the cycle in all relevant disciplines for all institutions.
Of the impact case study references with digital object identifiers, 42 per cent were submitted to Research Assessment Exercises or the 2014 Research Excellence Framework (REF2014) as research outputs; these are evenly spread between publication years from 1996 to 2013. Earliest references are skewed towards recent publications for social science and humanities. In science and engineering, the date of the earliest reference in each impact case study is uniformly spread through the eligible publication period.
The overlap between case study references and submitted outputs for assessment appears to be higher in more applied areas, and lower in the core humanities and pure sciences. For science and engineering, the case study references have highest overlap with the research outputs submitted in early cycles. The overlap between case study references and assessment outputs submitted to REF2014 is higher in social sciences.
Brought to you by Scope e-Knowledge Center, a world-leading provider of metadata services, abstraction, indexing, entity extraction and knowledge organisation models (Taxonomies, Thesauri and Ontologies).
