Ground truth deficiencies in software engineering : when codifying the past can be counterproductive
Tüzün, Eray; Erdogmus, Hakan; Baldassarre, Maria Teresa; Felderer, Michael; Feldt, Robert; Turhan, Burak (2021-07-20)
E. Tüzün, H. Erdogmus, M. T. Baldassarre, M. Felderer, R. Feldt and B. Turhan, "Ground-Truth Deficiencies in Software Engineering: When Codifying the Past Can Be Counterproductive," in IEEE Software, vol. 39, no. 3, pp. 85-95, May-June 2022, doi: 10.1109/MS.2021.3098670
© 2021 IEEE. Personal use of this material is permitted. Permission from IEEE must be obtained for all other uses, in any current or future media, including reprinting/republishing this material for advertising or promotional purposes, creating new collective works, for resale or redistribution to servers or lists, or reuse of any copyrighted component of this work in other works.
https://rightsstatements.org/vocab/InC/1.0/
https://urn.fi/URN:NBN:fi-fe2021081142744
Tiivistelmä
Abstract
Many software engineering tools build and evaluate their models based on historical data to support development and process decisions. These models help us answer numerous interesting questions, but have their own caveats. In a real-life setting, the objective function of human decision-makers for a given task might be influenced by a whole host of factors that stem from their cognitive biases, subverting the ideal objective function required for an optimally functioning system. Relying on this data as ground truth may give rise to systems that end up automating software engineering decisions by mimicking past sub-optimal behaviour. We illustrate this phenomenon and suggest mitigation strategies to raise awareness.
Kokoelmat
- Avoin saatavuus [31941]