'Being really confidently wrong': Qualitative researchers’ experiences of methodologically incongruent peer review feedback

Abstract

Although peer review is one of the central pillars of academic publishing, qualitative researchers’ experiences of this process has been largely overlooked. Existing research and commentary have focused on peer reviewers’ comments on qualitative manuscripts, which are often described as indicative of a quantitative mindset or hostility to non-positivist qualitative research. We extend this literature by focusing on qualitative researchers’ experiences of methodologically incongruent reviewer comments – comments that are incommensurate with the conceptual foundations of the reviewed research. Qualitative researchers (N=163) from a range of health and social science disciplines, including psychology, responded to a brief qualitative survey. Most contributors reported that peer reviewers universalized the assumptions and expectations of post-positivist research and reporting. Some also reported that peer reviewers universalized the norms and values particular to specific qualitative approaches. Contributors were concerned that peer reviewers often accept review invitations when they lack relevant methodological expertise. In response to methodologically incongruent comments, many contributors described a process of initially “pushing back” and explaining why these comments were incongruent with their research. When this educative approach was unsuccessful, some knowingly compromised the methodological integrity of their research and acquiesced to reviewer requests. Earlier career researchers especially highlighted the powerlessness they felt in the peer review process in the context of a “publish or perish” academic climate. We end by outlining contributors’ recommendations for improving methodological integrity of the peer review of qualitative research.