Please use this identifier to cite or link to this item:
Appears in Collections:Computing Science and Mathematics Journal Articles
Peer Review Status: Refereed
Title: Let's Talk With Developers, Not About Developers: A Review of Automatic Program Repair Research
Author(s): Winter, Emily Rowan
Nowack, Vesna
Bowes, David
Counsell, Steve
Hall, Tracy
Haraldsson, Saemundur O
Woodward, John
Keywords: Human factors
software development
Automatic Program Repair
Issue Date: 16-Feb-2022
Date Deposited: 10-Mar-2022
Citation: Winter ER, Nowack V, Bowes D, Counsell S, Hall T, Haraldsson SO & Woodward J (2022) Let's Talk With Developers, Not About Developers: A Review of Automatic Program Repair Research. IEEE Transactions on Software Engineering.
Abstract: Automatic program repair (APR) offers significant potential for automating some coding tasks. Using APR could reduce the high costs historically associated with fixing code faults and deliver significant benefits to software engineering. Adopting APR could also have profound implications for software developers daily activities, transforming their work practices. To realise the benefits of APR it is vital that we consider how developers feel about APR and the impact APR may have on developers' work. Developing APR tools without consideration of the developer is likely to undermine the success of APR deployment. In this paper, we critically review how developers are considered in APR research by analysing how human factors are treated in 260 studies from Monperrus's Living Review of APR. Over half of the 260 studies in our review were motivated by a problem faced by developers (e.g., the difficulty associated with fixing faults). Despite these human-oriented motivations, fewer than 7% of the 260 studies included a human study. We looked in detail at these human studies and found their quality mixed (for example, one human study was based on input from only one developer). Our results suggest that software developers are often talked about in APR studies, but are rarely talked with. A more comprehensive and reliable understanding of developer human factors in relation to APR is needed. Without this understanding, it will be difficult to develop APR tools and techniques which integrate effectively into developers' workflows. We recommend a future research agenda to advance the study of human factors in APR.
DOI Link: 10.1109/TSE.2022.3152089
Rights: This work is licensed under a Creative Commons Attribution 4.0 License. For more information, see
Notes: Output Status: Forthcoming/Available Online
Licence URL(s):

Files in This Item:
File Description SizeFormat 
09714799.pdfFulltext - Published Version6.05 MBAdobe PDFView/Open

This item is protected by original copyright

A file in this item is licensed under a Creative Commons License Creative Commons

Items in the Repository are protected by copyright, with all rights reserved, unless otherwise indicated.

The metadata of the records in the Repository are available under the CC0 public domain dedication: No Rights Reserved

If you believe that any material held in STORRE infringes copyright, please contact providing details and we will remove the Work from public display in STORRE and investigate your claim.