Knowledge Base Repository
In addition to research papers, the Design Society is developing several valuable resources for those interested in the study of design. These include a repository of PhD theses, a library of case studies and transcripts of design activities, and an archive of our newsletters. Please note that these resources are accessible exclusively to Design Society members.
REVIEWING PEER REVIEW, AN EYE TRACKING EXPERIMENT OF REVIEW BEHAVIOUR
Boa, Duncan R; Hicks, Ben
Type:
Year:
2015
Editor:
Christian Weber, Stephan Husung, Marco Cantamessa, Gaetano Cascini, Dorian Marjanovic, Srinivasan Venkataraman
Author:
Series:
ICED
Institution:
University of Bristol, United Kingdom
Section:
Design Theory and Research Methodology, Design Processes
Page(s):
369-378
ISBN:
978-1-904670-65-0
ISSN:
2220-4334
Abstract:
The quality of peer reviews is a longstanding issue within the Design Society with concerns over the consistency and transparency of reviews raised frequently. Previous research has sought to qualify these concerns by describing the variability of review scores and correlating them with academic’s backgrounds. This paper aims to update and advance the current understanding of peer review within the Design Society by characterising review behaviour through the addition of eye tracking. Seventeen academics attending Design 2014 took part in an experiment. The results of the experiment are discussed in this paper with the aim of answering two research questions: do different review strategies exist and what are they? And, do character traits of reviewers affect reviewer strategy? Results confirm findings from previous research, suggesting little has changed since the topic was last reported and that inconsistency remains a problem. However, some of the cause of review inconsistency is potentially explainable through identified review strategies evident from eye tracking data.
Keywords:
