Assessing developer contribution with repository mining-based metrics

• Main Authors: LIMA, Jalerson, TREUDE, Christoph, FIGUEIRA FILHO, Fernando, KULESZA, Uirá
• Format: text
• Language: English
• Published: Institutional Knowledge at Singapore Management University 2015
• Subjects: mining software repositories; Project management; software contribution metrics; Databases and Information Systems; Software Engineering
• Online Access: https://ink.library.smu.edu.sg/sis_research/8847; https://ink.library.smu.edu.sg/context/sis_research/article/9850/viewcontent/icsme15.pdf
• Institution: Singapore Management University

Productivity as a result of individual developers' contributions is an important aspect for software companies to maintain their competitiveness in the market. However, there is no consensus in the literature on how to measure productivity or developer contribution. While some repository mining-based metrics have been proposed, they lack validation in terms of their applicability and usefulness from the individuals who will use them to assess developer contribution: team and project leaders. In this paper, we propose the design of a suite of metrics for the assessment of developer contribution, based on empirical evidence obtained from project and team leaders. In a preliminary evaluation with four software development teams, we found that code contribution and code complexity metrics received the most positive feedback, while participants pointed out several threats of using bug-related metrics for contribution assessment. None of the metrics can be used in isolation, and project leaders and developers need to be aware of the benefits, limitations, and threats of each one. These findings present a first step towards the design of a larger suite of metrics as well as an investigation into the impact of using metrics to assess contribution.