BugsInPy: A database of existing bugs in Python programs to enable controlled testing and debugging studies
The 2019 edition of Stack Overflow developer survey highlights that, for the first time, Python outperformed Java in terms of popularity. The gap between Python and Java further widened in the 2020 edition of the survey. Unfortunately, despite the rapid increase in Python's popularity, there ar...
Saved in:
Main Authors: | , , , , , , , , , , , , , , , |
---|---|
Format: | text |
Language: | English |
Published: |
Institutional Knowledge at Singapore Management University
2020
|
Subjects: | |
Online Access: | https://ink.library.smu.edu.sg/sis_research/5630 https://ink.library.smu.edu.sg/context/sis_research/article/6633/viewcontent/BugsInPy_pv.pdf |
Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
Institution: | Singapore Management University |
Language: | English |
id |
sg-smu-ink.sis_research-6633 |
---|---|
record_format |
dspace |
spelling |
sg-smu-ink.sis_research-66332021-01-19T04:05:34Z BugsInPy: A database of existing bugs in Python programs to enable controlled testing and debugging studies WIDYASARI, Ratnadira SIM, Sheng Qin LOK, Camellia QI, Haodi PHAN, Jack TAY, Qijin TAN, Constance WEE, Fiona TAN, Jodie Ethelda YIEH, Yuheng GOH, Brian THUNG, Ferdian KANG, Hong Jin HOANG, Thong David LO, OUH, Eng Lieh The 2019 edition of Stack Overflow developer survey highlights that, for the first time, Python outperformed Java in terms of popularity. The gap between Python and Java further widened in the 2020 edition of the survey. Unfortunately, despite the rapid increase in Python's popularity, there are not many testing and debugging tools that are designed for Python. This is in stark contrast with the abundance of testing and debugging tools for Java. Thus, there is a need to push research on tools that can help Python developers.One factor that contributed to the rapid growth of Java testing and debugging tools is the availability of benchmarks. A popular benchmark is the Defects4J benchmark; its initial version contained 357 real bugs from 5 real-world Java programs. Each bug comes with a test suite that can expose the bug. Defects4J has been used by hundreds of testing and debugging studies and has helped to push the frontier of research in these directions.In this project, inspired by Defects4J, we create another benchmark database and tool that contain 493 real bugs from 17 real-world Python programs. We hope our benchmark can help catalyze future work on testing and debugging tools that work on Python programs. 2020-11-01T07:00:00Z text application/pdf https://ink.library.smu.edu.sg/sis_research/5630 info:doi/10.1145/3368089.3417943 https://ink.library.smu.edu.sg/context/sis_research/article/6633/viewcontent/BugsInPy_pv.pdf http://creativecommons.org/licenses/by-nc-nd/4.0/ Research Collection School Of Computing and Information Systems eng Institutional Knowledge at Singapore Management University Bugs database Python Testing and debugging Software Engineering |
institution |
Singapore Management University |
building |
SMU Libraries |
continent |
Asia |
country |
Singapore Singapore |
content_provider |
SMU Libraries |
collection |
InK@SMU |
language |
English |
topic |
Bugs database Python Testing and debugging Software Engineering |
spellingShingle |
Bugs database Python Testing and debugging Software Engineering WIDYASARI, Ratnadira SIM, Sheng Qin LOK, Camellia QI, Haodi PHAN, Jack TAY, Qijin TAN, Constance WEE, Fiona TAN, Jodie Ethelda YIEH, Yuheng GOH, Brian THUNG, Ferdian KANG, Hong Jin HOANG, Thong David LO, OUH, Eng Lieh BugsInPy: A database of existing bugs in Python programs to enable controlled testing and debugging studies |
description |
The 2019 edition of Stack Overflow developer survey highlights that, for the first time, Python outperformed Java in terms of popularity. The gap between Python and Java further widened in the 2020 edition of the survey. Unfortunately, despite the rapid increase in Python's popularity, there are not many testing and debugging tools that are designed for Python. This is in stark contrast with the abundance of testing and debugging tools for Java. Thus, there is a need to push research on tools that can help Python developers.One factor that contributed to the rapid growth of Java testing and debugging tools is the availability of benchmarks. A popular benchmark is the Defects4J benchmark; its initial version contained 357 real bugs from 5 real-world Java programs. Each bug comes with a test suite that can expose the bug. Defects4J has been used by hundreds of testing and debugging studies and has helped to push the frontier of research in these directions.In this project, inspired by Defects4J, we create another benchmark database and tool that contain 493 real bugs from 17 real-world Python programs. We hope our benchmark can help catalyze future work on testing and debugging tools that work on Python programs. |
format |
text |
author |
WIDYASARI, Ratnadira SIM, Sheng Qin LOK, Camellia QI, Haodi PHAN, Jack TAY, Qijin TAN, Constance WEE, Fiona TAN, Jodie Ethelda YIEH, Yuheng GOH, Brian THUNG, Ferdian KANG, Hong Jin HOANG, Thong David LO, OUH, Eng Lieh |
author_facet |
WIDYASARI, Ratnadira SIM, Sheng Qin LOK, Camellia QI, Haodi PHAN, Jack TAY, Qijin TAN, Constance WEE, Fiona TAN, Jodie Ethelda YIEH, Yuheng GOH, Brian THUNG, Ferdian KANG, Hong Jin HOANG, Thong David LO, OUH, Eng Lieh |
author_sort |
WIDYASARI, Ratnadira |
title |
BugsInPy: A database of existing bugs in Python programs to enable controlled testing and debugging studies |
title_short |
BugsInPy: A database of existing bugs in Python programs to enable controlled testing and debugging studies |
title_full |
BugsInPy: A database of existing bugs in Python programs to enable controlled testing and debugging studies |
title_fullStr |
BugsInPy: A database of existing bugs in Python programs to enable controlled testing and debugging studies |
title_full_unstemmed |
BugsInPy: A database of existing bugs in Python programs to enable controlled testing and debugging studies |
title_sort |
bugsinpy: a database of existing bugs in python programs to enable controlled testing and debugging studies |
publisher |
Institutional Knowledge at Singapore Management University |
publishDate |
2020 |
url |
https://ink.library.smu.edu.sg/sis_research/5630 https://ink.library.smu.edu.sg/context/sis_research/article/6633/viewcontent/BugsInPy_pv.pdf |
_version_ |
1770575546776813568 |