Assessing developer contribution with repository mining-based metrics

Productivity as a result of individual developers' contributions is an important aspect for software companies to maintain their competitiveness in the market. However, there is no consensus in the literature on how to measure productivity or developer contribution. While some repository mining...

Full description

Saved in:
Bibliographic Details
Main Authors: LIMA, Jalerson, TREUDE, Christoph, FIGUEIRA FILHO, Fernando, KULESZA, Uirá
Format: text
Language:English
Published: Institutional Knowledge at Singapore Management University 2015
Subjects:
Online Access:https://ink.library.smu.edu.sg/sis_research/8847
https://ink.library.smu.edu.sg/context/sis_research/article/9850/viewcontent/icsme15.pdf
Tags: Add Tag
No Tags, Be the first to tag this record!
Institution: Singapore Management University
Language: English
id sg-smu-ink.sis_research-9850
record_format dspace
spelling sg-smu-ink.sis_research-98502024-06-13T09:17:39Z Assessing developer contribution with repository mining-based metrics LIMA, Jalerson TREUDE, Christoph FIGUEIRA FILHO, Fernando KULESZA, Uirá Productivity as a result of individual developers' contributions is an important aspect for software companies to maintain their competitiveness in the market. However, there is no consensus in the literature on how to measure productivity or developer contribution. While some repository mining-based metrics have been proposed, they lack validation in terms of their applicability and usefulness from the individuals who will use them to assess developer contribution: team and project leaders. In this paper, we propose the design of a suite of metrics for the assessment of developer contribution, based on empirical evidence obtained from project and team leaders. In a preliminary evaluation with four software development teams, we found that code contribution and code complexity metrics received the most positive feedback, while participants pointed out several threats of using bug-related metrics for contribution assessment. None of the metrics can be used in isolation, and project leaders and developers need to be aware of the benefits, limitations, and threats of each one. These findings present a first step towards the design of a larger suite of metrics as well as an investigation into the impact of using metrics to assess contribution. 2015-10-01T07:00:00Z text application/pdf https://ink.library.smu.edu.sg/sis_research/8847 info:doi/10.1109/ICSM.2015.7332509 https://ink.library.smu.edu.sg/context/sis_research/article/9850/viewcontent/icsme15.pdf http://creativecommons.org/licenses/by-nc-nd/4.0/ Research Collection School Of Computing and Information Systems eng Institutional Knowledge at Singapore Management University mining software repositories Project management software contribution metrics Databases and Information Systems Software Engineering
institution Singapore Management University
building SMU Libraries
continent Asia
country Singapore
Singapore
content_provider SMU Libraries
collection InK@SMU
language English
topic mining software repositories
Project management
software contribution metrics
Databases and Information Systems
Software Engineering
spellingShingle mining software repositories
Project management
software contribution metrics
Databases and Information Systems
Software Engineering
LIMA, Jalerson
TREUDE, Christoph
FIGUEIRA FILHO, Fernando
KULESZA, Uirá
Assessing developer contribution with repository mining-based metrics
description Productivity as a result of individual developers' contributions is an important aspect for software companies to maintain their competitiveness in the market. However, there is no consensus in the literature on how to measure productivity or developer contribution. While some repository mining-based metrics have been proposed, they lack validation in terms of their applicability and usefulness from the individuals who will use them to assess developer contribution: team and project leaders. In this paper, we propose the design of a suite of metrics for the assessment of developer contribution, based on empirical evidence obtained from project and team leaders. In a preliminary evaluation with four software development teams, we found that code contribution and code complexity metrics received the most positive feedback, while participants pointed out several threats of using bug-related metrics for contribution assessment. None of the metrics can be used in isolation, and project leaders and developers need to be aware of the benefits, limitations, and threats of each one. These findings present a first step towards the design of a larger suite of metrics as well as an investigation into the impact of using metrics to assess contribution.
format text
author LIMA, Jalerson
TREUDE, Christoph
FIGUEIRA FILHO, Fernando
KULESZA, Uirá
author_facet LIMA, Jalerson
TREUDE, Christoph
FIGUEIRA FILHO, Fernando
KULESZA, Uirá
author_sort LIMA, Jalerson
title Assessing developer contribution with repository mining-based metrics
title_short Assessing developer contribution with repository mining-based metrics
title_full Assessing developer contribution with repository mining-based metrics
title_fullStr Assessing developer contribution with repository mining-based metrics
title_full_unstemmed Assessing developer contribution with repository mining-based metrics
title_sort assessing developer contribution with repository mining-based metrics
publisher Institutional Knowledge at Singapore Management University
publishDate 2015
url https://ink.library.smu.edu.sg/sis_research/8847
https://ink.library.smu.edu.sg/context/sis_research/article/9850/viewcontent/icsme15.pdf
_version_ 1814047592960491520