CFP last date
21 April 2025
Call for Paper
May Edition
IJCA solicits high quality original research papers for the upcoming May edition of the journal. The last date of research paper submission is 21 April 2025

Submit your paper
Know more
The week's pick
Responsive image
Attack information gathering from network analysis data during scanning activity

Stephane J. Tamafo Elie Fute Tagne Jaime C. Acosta Charles Kamhoua Rawat Danda
Random Articles
Reseach Article

Support Mechanisms for Conducting Empirical Research in Software Engineering: A Systematic Mapping Study

by Abeer Alarainy, Nora Madi, Arwa Abolkhair, Aljawharah AlMuaythir, Aljohara Alyousef, Zainab Altamimi, Ohud Almeshari, Muna Al-Razgan
journal cover thumbnail

International Journal of Computer Applications
Foundation of Computer Science (FCS), NY, USA
Volume 186 - Number 69
Year of Publication: 2025
Authors: Abeer Alarainy, Nora Madi, Arwa Abolkhair, Aljawharah AlMuaythir, Aljohara Alyousef, Zainab Altamimi, Ohud Almeshari, Muna Al-Razgan
10.5120/ijca2025924542

Abeer Alarainy, Nora Madi, Arwa Abolkhair, Aljawharah AlMuaythir, Aljohara Alyousef, Zainab Altamimi, Ohud Almeshari, Muna Al-Razgan . Support Mechanisms for Conducting Empirical Research in Software Engineering: A Systematic Mapping Study. International Journal of Computer Applications. 186, 69 ( Feb 2025), 1-22. DOI=10.5120/ijca2025924542

@article{ 10.5120/ijca2025924542,
author = { Abeer Alarainy, Nora Madi, Arwa Abolkhair, Aljawharah AlMuaythir, Aljohara Alyousef, Zainab Altamimi, Ohud Almeshari, Muna Al-Razgan },
title = { Support Mechanisms for Conducting Empirical Research in Software Engineering: A Systematic Mapping Study },
journal = { International Journal of Computer Applications },
issue_date = { Feb 2025 },
volume = { 186 },
number = { 69 },
month = { Feb },
year = { 2025 },
issn = { 0975-8887 },
pages = { 1-22 },
numpages = {9},
url = { https://ijcaonline.org/archives/volume186/number69/support-mechanisms-for-conducting-empirical-research-in-software-engineering-a-systematic-mapping-study/ },
doi = { 10.5120/ijca2025924542 },
publisher = {Foundation of Computer Science (FCS), NY, USA},
address = {New York, USA}
}
%0 Journal Article
%1 2025-02-25T22:58:14.528204+05:30
%A Abeer Alarainy
%A Nora Madi
%A Arwa Abolkhair
%A Aljawharah AlMuaythir
%A Aljohara Alyousef
%A Zainab Altamimi
%A Ohud Almeshari
%A Muna Al-Razgan
%T Support Mechanisms for Conducting Empirical Research in Software Engineering: A Systematic Mapping Study
%J International Journal of Computer Applications
%@ 0975-8887
%V 186
%N 69
%P 1-22
%D 2025
%I Foundation of Computer Science (FCS), NY, USA
Abstract

Empirical research plays a crucial role in the evolution of the field of software engineering (SE), as it provides evidence-based insights that help improve the software development life cycle (SDLC). Recognizing its significance, this paper presents a systematic mapping study (SMS), analyzing 195 studies published between 2019 and 2024, selected from three highly reputable sources: IEEE, ACM, and Wiley Digital Libraries. Understanding trends in the different applications of empirical strategies and their associated support mechanisms, as well as the challenges in this context, is a necessary step toward advancing the field of empirical software engineering. The findings of this SMS reveal that empirical techniques are heavily employed in the testing and maintenance phases of SE, which accounted for 42% of the analyzed studies, while the management and deployment phases receive comparatively less attention. Experimental methods emerged as the most commonly used empirical strategies, followed by quantitative and qualitative analyses. Tools and techniques were identified as the most frequently employed support mechanisms, demonstrating their importance in empirical research. This study offers a comprehensive resource for researchers and practitioners, mapping empirical strategies onto specific SDLC phases and illuminating the challenges and possibilities of designing and executing empirical SE research.

References
  1. A. Borges, W. Ferreira, E. Barreiros, A. Almeida, L. Fonseca, E. Teixeira, D. Silva, A. Alencar, and S. Soares, “Support mechanisms to conduct empirical studies in software engineering,” pp. 1–4, 2014.
  2. J. S. Moll´eri, K. Petersen, and E. Mendes, “Cerse-catalog for empirical research in software engineering: A systematic mapping study,” Information and Software Technology, vol. 105, pp. 117–149, 2019.
  3. C. Guevara-Vega, B. Bern´ardez, A. Dur´an, A. Quina-Mera, M. Cruz, and A. Ruiz-Cort´es, “Empirical strategies in software engineering research: A literature survey,” pp. 120– 127, 2021.
  4. M. Felderer and G. H. Travassos, “The evolution of empirical methods in software engineering,” Springer, pp. 1–24, 2020.
  5. C. Wohlin and A. Aurum, “Towards a decision-making structure for selecting a research design in empirical software engineering,” Empirical Software Engineering, vol. 20, pp. 1427–1455, 2015.
  6. K.-J. Stol and B. Fitzgerald, “The abc of software engineering research,” ACM Transactions on Software Engineering and Methodology (TOSEM), vol. 27, no. 3, pp. 1–51, 2018.
  7. J. Melegati, K. Conboy, and D. Graziotin, “Qualitative surveys in software engineering research: Definition, critical review, and guidelines,” IEEE Transactions on Software Engineering, 2024.
  8. L. Zhang, J.-H. Tian, J. Jiang, Y.-J. Liu, M.-Y. Pu, and T. Yue, “Empirical research in software engineering—a literature survey,” Journal of Computer Science and Technology, vol. 33, pp. 876–899, 2018.
  9. B. Kitchenham, “Procedures for performing systematic reviews,” Keele, UK, Keele University, vol. 33, no. 2004, pp. 1–26, 2004.
  10. K. Petersen, R. Feldt, S. Mujtaba, and M. Mattsson, “Systematic mapping studies in software engineering,” in 12th international conference on evaluation and assessment in software engineering (EASE), BCS Learning & Development, 2008.
  11. B. Kitchenham and S. M. Charters, “Guidelines for performing systematic literature reviews in software engineering,” Technical report, Ver. 2.3 EBSE Technical Report. EBSE, no. January 2007, pp. 1–57, 2007.
  12. M. Ouzzani, H. Hammady, Z. Fedorowicz, and A. Elmagarmid, “Rayyan—a web and mobile app for systematic reviews,” Systematic reviews, vol. 5, pp. 1–10, 2016.
  13. C.Wohlin, P. Runeson, M. H¨ost, M. C. Ohlsson, B. Regnell, and A. Wessl´en, Experimentation in software engineering, vol. 236. Springer, 2012.
  14. J. Al Dallal, “Categorisation-based approach for predicting the fault-proneness of object-oriented classes in software post-releases,” IET Software, vol. 14, no. 5, pp. 525–534, 2020.
  15. W. Lam, S. Winter, A. Wei, T. Xie, D. Marinov, and J. Bell, “A large-scale longitudinal study of flaky tests,” Proceedings of the ACM on Programming Languages, vol. 4, no. OOPSLA, pp. 1–29, 2020.
  16. O. Nourry, Y. Kashiwa, W. Shang, H. Shu, and Y. Kamei, “My fuzzers won’t build: An empirical study of fuzzing build failures,” ACM Transactions on Software Engineering and Methodology.
  17. D. Weyns, I. Gerostathopoulos, N. Abbas, J. Andersson, S. Biffl, P. Brada, T. Bures, A. Di Salle, M. Galster, P. Lago, et al., “Self-adaptation in industry: A survey,” ACM Transactions on Autonomous and Adaptive Systems, vol. 18, no. 2, pp. 1–44, 2023.
  18. U. I. Janjua, T. M. Madni, M. F. Cheema, and A. R. Shahid, “An empirical study to investigate the impact of communication issues in gsd in pakistan’s it industry,” IEEE Access, vol. 7, pp. 171648–171672, 2019.
  19. C. Mandrioli and M. Maggio, “Testing self-adaptive software with probabilistic guarantees on performance metrics: extended and comparative results,” IEEE Transactions on Software Engineering, vol. 48, no. 9, pp. 3554–3572, 2021.
  20. F. Palomba, D. Andrew Tamburri, F. Arcelli Fontana, R. Oliveto, A. Zaidman, A. Serebrenik, et al., “Beyond technical aspects: How do community smells influence the intensity of code smells?,” IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, vol. 47, no. 1, pp. 108–129, 2021.
  21. A. C. Oran, N. Valentim, G. Santos, and T. Conte, “Why use case specifications are hard to use in generating prototypes?,” IET Software, vol. 13, no. 6, pp. 510–517, 2019.
  22. H. Ben Braiek and F. Khomh, “Testing feedforward neural networks training programs,” ACM Transactions on Software Engineering and Methodology, vol. 32, no. 4, pp. 1–61, 2023.
  23. X. Tan and M. Zhou, “How to communicate when submitting patches: An empirical study of the linux kernel,” Proceedings of the ACM on Human-Computer Interaction, vol. 3, no. CSCW, pp. 1–26, 2019.
  24. J. Wang, Y. Li, Q. Qi, Y. Lu, and B. Wu, “Multilayered fault detection and localization with transformer for microservice systems,” IEEE Transactions on Reliability, 2024.
  25. Y. Lyu, H. Li, Z. M. Jiang, and A. E. Hassan, “On the model update strategies for supervised learning in aiops solutions,” ACM Transactions on Software Engineering and Methodology, vol. 33, no. 7, pp. 1–38, 2024.
  26. S. K. Pandey, D. Rathee, and A. K. Tripathi, “Software defect prediction using k-pca and various kernel-based extreme learning machine: an empirical study,” IET Software, vol. 14, no. 7, pp. 768–782, 2020.
  27. C.-A. Sun, A. Fu, J. Jia, M. Li, and J. Han, “Improving conformance of web services: A constraint-based model-driven approach,” ACM Transactions on the Web, vol. 17, no. 2, pp. 1–36, 2023.
  28. J. C. Neto, C. H. da Silva, T. E. Colanzi, and A. M. M. M. Amaral, “Are mas profitable to search-based pla design?,” IET Softw., vol. 13, no. 6, pp. 587–599, 2019.
  29. M. Kuhrmann, P. Tell, R. Hebig, J. Kl¨under, J. M¨unch, O. Linssen, D. Pfahl, M. Felderer, C. R. Prause, S. G. Mac- Donell, et al., “What makes agile software development agile?,” IEEE transactions on software engineering, vol. 48, no. 9, pp. 3523–3539, 2021.
  30. E. Kalliamvakou, C. Bird, T. Zimmermann, A. Begel, R. De- Line, and D. M. German, “What makes a great manager of software engineers?,” IEEE Transactions on Software Engineering, vol. 45, no. 01, pp. 87–106, 2019.
  31. J. Liu, Y. Huang, Z.Wang, L. Ma, C. Fang, M. Gu, X. Zhang, and Z. Chen, “Generation-based differential fuzzing for deep learning libraries,” ACM Transactions on Software Engineering and Methodology, vol. 33, no. 2, pp. 1–28, 2023.
  32. A. Gupta, R. Gandhi, N. Jatana, D. Jatain, S. K. Panda, and J. V. N. Ramesh, “A severity assessment of python code smells,” IEEE Access, 2023.
  33. Y. Li, T. Zhang, X. Luo, H. Cai, S. Fang, and D. Yuan, “Do pre-trained language models indeed understand software engineering tasks?,” IEEE Transactions on Software Engineering, 2023.
  34. C. Wang, H. He, U. Pal, D. Marinov, and M. Zhou, “Suboptimal comments in java projects: From independent comment changes to commenting practices,” ACM Transactions on Software Engineering and Methodology, vol. 32, no. 2, pp. 1–33, 2023.
  35. Q. Chen, C. Yu, R. Liu, C. Zhang, Y. Wang, K. Wang, T. Su, and L. Wang, “Evaluating the effectiveness of deep learning models for foundational program analysis tasks,” Proceedings of the ACM on Programming Languages, vol. 8, no. OOPSLA1, pp. 500–528, 2024.
  36. Y. Qu, Q. Zheng, J. Chi, Y. Jin, A. He, D. Cui, H. Zhang, and T. Liu, “Using k-core decomposition on class dependency networks to improve bug prediction model’s practical performance,” IEEE Transactions on Software Engineering, vol. 47, no. 2, pp. 348–366, 2019.
  37. A. Vrankovi´c, T. Galinac Grbac, and ˇ Z. Car, “Software structure evolution and relation to subgraph defectiveness,” Iet software, vol. 13, no. 5, pp. 355–367, 2019.
  38. B. Komal, U. I. Janjua, F. Anwar, T. M. Madni, M. F. Cheema, M. N. Malik, and A. R. Shahid, “The impact of scope creep on project success: An empirical investigation,” IEEE Access, vol. 8, pp. 125755–125775, 2020.
  39. M. Garriga, S. Dalla Palma, M. Arias, A. De Renzis, R. Pareschi, and D. Andrew Tamburri, “Blockchain and cryptocurrencies: A classification and comparison of architecture drivers,” Concurrency and Computation: Practice and Experience, vol. 33, no. 8, p. e5992, 2021.
  40. C. Camacho, P. C. Ca˜nizares, L. Llana, and A. N´u˜nez, “Chaos as a software product line—a platform for improving open hybrid-cloud systems resiliency,” Software: Practice and Experience, vol. 52, no. 7, pp. 1581–1614, 2022.
  41. C. A. Furia, R. Torkar, and R. Feldt, “Applying bayesian analysis guidelines to empirical software engineering data: The case of programming languages and code quality,” ACM Transactions on Software Engineering and Methodology (TOSEM), vol. 31, no. 3, pp. 1–38, 2022.
  42. L. Erazo-Garz´on, P. Cedillo, G. Rossi, and J. Moyano, “A domain-specific language for modeling iot system architectures that support monitoring,” IEEE Access, vol. 10, pp. 61639–61665, 2022.
  43. M. Zhang, A. Belhadi, and A. Arcuri, “Javascript sbst heuristics to enable effective fuzzing of nodejs web apis,” ACM Transactions on Software Engineering and Methodology, vol. 32, no. 6, pp. 1–29, 2023.
  44. F. Ebrahimi, M. Tushev, and A. Mahmoud, “Classifying mobile applications using word embeddings,” ACM Transactions on Software Engineering and Methodology (TOSEM), vol. 31, no. 2, pp. 1–30, 2021.
  45. L. Lavazza, A. Locoro, G. Liu, and R. Meli, “Estimating software functional size via machine learning,” ACM Transactions on Software Engineering and Methodology, vol. 32, no. 5, pp. 1–27, 2023.
  46. T. Chen and M. Li, “The weights can be harmful: Pareto search versus weighted search in multi-objective searchbased software engineering,” ACM Transactions on Software Engineering and Methodology, vol. 32, no. 1, pp. 1–40, 2023.
  47. S. Hussain, J. Keung, M. K. Sohail, A. A. Khan, G. Ahmad, M. R. Mufti, and H. A. Khatak, “Methodology for the quantification of the effect of patterns and anti-patterns association on the software quality,” IET Software, vol. 13, no. 5, pp. 414–422, 2019.
  48. X. Ju, J. Qian, Z. Chen, C. Zhao, and J. Qian, “Mulr4fl: effective fault localization of evolution software based on multivariate logistic regression model,” Ieee Access, vol. 8, pp. 207858–207870, 2020.
  49. C.Wan, Y. Liu, K. Du, H. Hoffmann, J. Jiang, M. Maire, and S. Lu, “Run-time prevention of software integration failures of machine learning apis,” Proceedings of the ACM on Programming Languages, vol. 7, no. OOPSLA2, pp. 264–291, 2023.
  50. Y. Xiang, H. Huang, M. Li, S. Li, and X. Yang, “Looking for novelty in search-based software product line testing,” IEEE Transactions on Software Engineering, vol. 48, no. 07, pp. 2317–2338, 2022.
  51. H. Lu, Z. Liu, S.Wang, and F. Zhang, “Dtd: Comprehensive and scalable testing for debuggers,” Proceedings of the ACM on Software Engineering, vol. 1, no. FSE, pp. 1172–1193, 2024.
  52. X. Chen, Z. Yuan, Z. Cui, D. Zhang, and X. Ju, “Empirical studies on the impact of filter-based ranking feature selection on security vulnerability prediction,” IET Software, vol. 15, no. 1, pp. 75–89, 2021.
  53. A. Agrawal and R. K. Singh, “Predicting co-change probability in software applications using historical metadata,” IET Software, vol. 14, no. 7, pp. 739–747, 2020.
  54. E. Merrill, A. Fern, X. Fern, and N. Dolatnia, “An empirical study of bayesian optimization: Acquisition versus partition,” Journal of Machine Learning Research, vol. 22, no. 4, pp. 1–25, 2021.
  55. J. I. Panach, O´ . Dieste, B. Mar´ın, S. Espan˜a, S. Vegas, O´ . Pastor, and N. Juristo, “Evaluating model-driven development claims with respect to quality: A family of experiments,” IEEE Transactions on Software Engineering, vol. 47, no. 1, pp. 130–145, 2021.
  56. C. Birchler, S. Khatiri, P. Derakhshanfar, S. Panichella, and A. Panichella, “Single and multi-objective test cases prioritization for self-driving cars in virtual environments,” ACM Transactions on Software Engineering and Methodology, vol. 32, no. 2, pp. 1–30, 2023.
  57. Z. Q. Zhou, L. Sun, T. Y. Chen, and D. Towey, “Metamorphic relations for enhancing system understanding and use,” IEEE Transactions on Software Engineering, vol. 46, no. 10, pp. 1120–1154, 2020.
  58. S. Zhang, S. Jiang, and Y. Yan, “A Software Defect Prediction Approach Based on Hybrid Feature Dimensionality Reduction,” Scientific Programming, vol. 2023, no. 1, p. 5585130, 2023.
  59. C. Gavidia-Calderon, F. Sarro, M. Harman, and E. T. Barr, “The assessor’s dilemma: Improving bug repair via empirical game theory,” IEEE Transactions on Software Engineering, vol. 47, no. 10, pp. 2143–2161, 2021.
  60. M. A. Akbar, S. Mahmood, A. Alsanad, M. Shafiq, A. Gumaei, and A. A.-A. Alsanad, “Organization type and size based identification of requirements change management challenges in global software development,” IEEE Access, vol. 8, pp. 94089–94111, 2020.
  61. H. Kahtan, M. Abdulhak, A. S. Al-Ahmad, and Y. I. Alzoubi, “A model for developing dependable systems using a component-based software development approach (mddscbsd),” IET Software, vol. 17, no. 1, pp. 76–92, 2023.
  62. A. Di Sorbo, S. Panichella, C. A. Visaggio, M. Di Penta, G. Canfora, H. C. Gall, et al., “Exploiting natural language structures in software informal documentation,” IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, vol. 47, no. 8, pp. 1587–1604, 2021.
  63. D. Issa Mattos, A. Dakkak, J. Bosch, and H. H. Olsson, “The hurrier process for experimentation in business-to-business mission-critical systems,” Journal of Software: Evolution and Process, vol. 35, no. 5, p. e2390, 2023.
  64. M. Ojdanic, E. Soremekun, R. Degiovanni, M. Papadakis, and Y. Le Traon, “Mutation testing in evolving systems: Studying the relevance of mutants to code evolution,” ACM Transactions on Software Engineering and Methodology, vol. 32, no. 1, pp. 1–39, 2023.
  65. I. Illahi, H. Liu, Q. Umer, and S. A. H. Zaidi, “An empirical study on competitive crowdsource software development: motivating and inhibiting factors,” IEEE Access, vol. 7, pp. 62042–62057, 2019.
  66. P. Ciancarini, M. Farina, S. Masyagin, G. Succi, S. Yermolaieva, and N. Zagvozkina, “Non verbal communication in software engineering–an empirical study,” IEEE Access, vol. 9, pp. 71942–71953, 2021.
  67. J. Cheng, C. Gao, and Z. Zheng, “Hinnperf: Hierarchical interaction neural network for performance prediction of configurable systems,” ACM Transactions on Software Engineering and Methodology, vol. 32, no. 2, pp. 1–30, 2023.
  68. R. Fatima, A. Yasin, L. Liu, J.Wang,W. Afzal, and A. Yasin, “Improving software requirements reasoning by novices: a story-based approach,” IET Software, vol. 13, no. 6, pp. 564– 574, 2019.
  69. A. B. Fuertes, M. P´erez, and J. Meza, “nmorph framework: An innovative approach to transpiler-based multi-language software development,” IEEE Access, vol. 11, pp. 124386– 124429, 2023.
  70. Z. Wang, S. Xu, L. Fan, X. Cai, L. Li, and Z. Liu, “Can coverage criteria guide failure discovery for image classifiers? an empirical study,” ACM Transactions on Software Engineering and Methodology, vol. 33, no. 7, pp. 1–28, 2024.
  71. J. Jiarpakdee, C. Tantithamthavorn, and A. E. Hassan, “The impact of correlated metrics on the interpretation of defect models,” IEEE Transactions on Software Engineering, vol. 47, no. 2, pp. 320–331, 2021.
  72. P. Temple, M. Acher, and J.-M. Jezequel, “Empirical assessment of multimorphic testing,” IEEE Transactions on Software Engineering, vol. 47, no. 07, pp. 1511–1527, 2021.
  73. P. Wang, X. Zhou, T. Yue, P. Lin, Y. Liu, and K. Lu, “The progress, challenges, and perspectives of directed greybox fuzzing,” Software Testing, Verification and Reliability, vol. 34, no. 2, p. e1869, 2024.
  74. A. Souza, B. Ferreira, N. Valentim, L. Correa, S. Marczak, and T. Conte, “Supporting the teaching of design thinking techniques for requirements elicitation through a recommendation tool,” IET Software, vol. 14, no. 6, pp. 693–701, 2020.
  75. S. Meli´a, R. Reyes, and C. Cachero, “The effect of developers’ general intelligence on the understandability of domain models: an empirical study,” IEEE Access, 2023.
  76. F. Zampetti, D. Tamburri, S. Panichella, A. Panichella, G. Canfora, and M. Di Penta, “Continuous integration and delivery practices for cyber-physical systems: An interviewbased study,” ACM Transactions on Software Engineering and Methodology, vol. 32, no. 3, pp. 1–44, 2023.
  77. R. Nadri, G. Rodr´ıguez-P´erez, and M. Nagappan, “On the relationship between the developer’s perceptible race and ethnicity and the evaluation of contributions in oss,” IEEE Transactions on Software Engineering, vol. 48, no. 8, pp. 2955–2968, 2022.
  78. W. Hutiri, A. Y. Ding, F. Kawsar, and A. Mathur, “Tiny, always-on, and fragile: Bias propagation through design choices in on-device machine learning workflows,” ACM Transactions on Software Engineering and Methodology, vol. 32, no. 6, pp. 1–37, 2023.
  79. S. Dashevskyi, A. Brucker, and F. Massacci, “A screening test for disclosed vulnerabilities in foss components,” IEEE Transactions on Software Engineering, vol. 45, no. 10, pp. 945–966, 2019.
  80. D. A. Tamburri and F. Palomba, “Evolving software forges: An experience report from apache allura,” Journal of Software: Evolution and Process, vol. 33, no. 12, p. e2397, 2021.
  81. S. Romano, C. Vendome, G. Scanniello, D. Poshyvanyk, et al., “A multi-study investigation into dead code,” IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, vol. 46, no. 1, pp. 71–99, 2020.
  82. M. M. John, H. H. Olsson, and J. Bosch, “Towards an ai-driven business development framework: A multi-case study,” Journal of Software: Evolution and Process, vol. 35, no. 6, p. e2432, 2023.
  83. E. Dilorenzo, E. Dantas, M. Perkusich, F. Ramos, A. Costa, D. Albuquerque, H. Almeida, and A. Perkusich, “Enabling the reuse of software development assets through a taxonomy for user stories,” IEEE Access, vol. 8, pp. 107285– 107300, 2020.
  84. Q. Hu, Y. Guo, X. Xie, M. Cordy, L. Ma, M. Papadakis, and Y. Le Traon, “Active code learning: Benchmarking sampleefficient training of code models,” IEEE Transactions on Software Engineering, 2024.
  85. E. Edward, A. S. Nyamawe, and N. Elisa, “On the impact of refactorings on software attack surface,” IEEE Access, 2024.
  86. W. Mauerer, M. Joblin, D. Tamburri, C. Paradis, R. Kazman, and S. Apel, “In search of socio-technical congruence: A large-scale longitudinal study,” IEEE Transactions on Software Engineering (TSE), vol. 48, no. 8, pp. 3159– 3184, 2022.
  87. C. Birchler, T. K. Mohammed, P. Rani, T. Nechita, T. Kehrer, and S. Panichella, “How does simulation-based testing for self-driving cars match human perception?,” Proceedings of the ACM on Software Engineering, vol. 1, no. FSE, pp. 929– 950, 2024.
  88. M. Tufano, C. Watson, G. Bavota, M. D. Penta, M. White, and D. Poshyvanyk, “An empirical study on learning bugfixing patches in the wild via neural machine translation,” ACM Transactions on Software Engineering and Methodology (TOSEM), vol. 28, no. 4, pp. 1–29, 2019.
  89. G. Uddin, Y.-G. Gu´eh´enuc, F. Khomh, and C. K. Roy, “An empirical study of the effectiveness of an ensemble of standalone sentiment detection tools for software engineering datasets,” ACM Transactions on Software Engineering and Methodology (TOSEM), vol. 31, no. 3, pp. 1–38, 2022.
  90. A. Almogahed, H. Mahdin, M. Omar, N. H. Zakaria, G. Muhammad, and Z. Ali, “Optimized refactoring mechanisms to improve quality characteristics in object-oriented systems,” IEEE Access, 2023.
  91. W. Pan, H. Ming, C. K. Chang, Z. Yang, and D.-K. Kim, “Elementrank: Ranking java software classes and packages using a multilayer complex network-based approach,” IEEE Transactions on Software Engineering, vol. 47, no. 10, pp. 2272–2295, 2021.
  92. D. Girardi, F. Lanubile, N. Novielli, and A. Serebrenik, “Emotions and perceived productivity of software developers at the workplace,” IEEE Transactions on Software Engineering, vol. 48, no. 09, pp. 3326–3341, 2022.
  93. T. Bi, B. Xia, Z. Xing, Q. Lu, and L. Zhu, “On the way to sboms: Investigating design issues and solutions in practice,” ACM Transactions on Software Engineering and Methodology, vol. 33, no. 6, pp. 1–25, 2024.
  94. R. Torkar, C. A. Furia, R. Feldt, F. G. de Oliveira Neto, L. Gren, P. Lenberg, and N. A. Ernst, “A method to assess and argue for practical significance in software engineering,” 2022.
  95. S. Di Martino, A. R. Fasolino, L. L. L. Starace, and P. Tramontana, “Gui testing of android applications: Investigating the impact of the number of testers on different exploratory testing strategies,” Journal of Software: Evolution and Process, vol. 36, no. 7, p. e2640, 2024.
  96. M. Emmi and C. Enea, “Weak-consistency specification via visibility relaxation,” Proceedings of the ACM on Programming Languages, vol. 3, no. POPL, pp. 1–28, 2019.
  97. C.-a. Sun, H. Dai, H. Liu, T. Y. Chen, and K.-Y. Cai, “Adaptive partition testing,” IEEE Transactions on Computers, vol. 68, no. 02, pp. 157–169, 2019.
  98. F. M. Almansour, R. Alroobaea, and A. S. Ghiduk, “An empirical comparison of the efficiency and effectiveness of genetic algorithms and adaptive random techniques in dataflow testing,” IEEE Access, vol. 8, pp. 12884–12896, 2020.
  99. D. Jayasuriya, V. Terragni, J. Dietrich, and K. Blincoe, “Understanding the impact of apis behavioral breaking changes on client applications,” Proceedings of the ACM on Software Engineering, vol. 1, no. FSE, pp. 1238–1261, 2024.
  100. M. A. Babar, H. Shen, S. Biffl, and D. Winkler, “An empirical study of the effectiveness of software architecture evaluation meetings,” IEEE Access, vol. 7, pp. 79069–79084, 2019.
  101. D. Olewicki, S. Habchi, and B. Adams, “An empirical study on code review activity prediction and its impact in practice,” Proceedings of the ACM on Software Engineering, vol. 1, no. FSE, pp. 2238–2260, 2024.
  102. M. Openja, F. Khomh, A. Foundjem, Z. M. Jiang, M. Abidi, and A. E. Hassan, “An empirical study of testing machine learning in the wild,” ACM Transactions on Software Engineering and Methodology, vol. 34, no. 1, pp. 1–63, 2024.
  103. Y. Wu, Y. Zhang, T. Wang, and H. Wang, “Characterizing the occurrence of dockerfile smells in open-source software: An empirical study,” IEEE Access, vol. 8, pp. 34127–34139, 2020.
  104. D. L´opez-Fern´andez, J. Mayor, J. P´erez, and A. Gordillo, “Learning and motivational impact of using a virtual reality serious video game to learn scrum,” IEEE Transactions on Games, vol. 15, no. 3, pp. 430–439, 2022.
  105. M. Paltenghi and M. Pradel, “Analyzing quantum programs with lintq: A static analysis framework for qiskit,” Proceedings of the ACM on Software Engineering, vol. 1, no. FSE, pp. 2144–2166, 2024.
  106. M. Londschien, P. B¨uhlmann, and S. Kov´acs, “Random forests for change point detection,” arXiv e-prints, pp. arXiv–2205, 2022.
  107. F. Sarro, R. Moussa, A. Petrozziello, and M. Harman, “Learning from mistakes: Machine learning enhanced human expert effort estimates,” IEEE Transactions on Software Engineering, vol. 48, no. 6, pp. 1868–1882, 2022.
  108. A. Katbi, M. Hammad, and W. Elmedany, “Multi-view citybased approach for code-smell evolution visualisation,” IET Software, vol. 14, no. 5, pp. 506–516, 2020.
  109. C. D. Ngo, F. Pastore, and L. Briand, “Testing updated apps by adapting learned models,” ACM Transactions on Software Engineering and Methodology, vol. 33, no. 6, pp. 1–40, 2024.
  110. A. M. Aranda, O´ . Dieste, J. I. Panach Navarrete, and N. Juristo, “Effect of requirements analyst experience on elicitation effectiveness: a family of quasi-experiments,” 2023.
  111. P. Gyimesi, B. Vancsics, A. Stocco, D. Mazinanian, A´ . Besze´des, R. Ferenc, and A. Mesbah, “Bugsjs: a benchmark and taxonomy of javascript bugs,” Software Testing, Verification and Reliability, vol. 31, no. 4, p. e1751, 2021.
  112. S. Xu, Y. Gao, L. Fan, Z. Liu, Y. Liu, and H. Ji, “Lidetector: License incompatibility detection for open source software,” ACM Transactions on Software Engineering and Methodology, vol. 32, no. 1, pp. 1–28, 2023.
  113. A. S. Ghiduk and A. M. Qahtani, “An empirical study of local-decision-making-based software customization in distributed development,” IET Software, vol. 15, no. 2, pp. 174– 187, 2021.
  114. N. Qamar and A. A. Malik, “A quantitative assessment of the impact of homogeneity in personality traits on software quality and team productivity,” IEEE Access, vol. 10, pp. 122092–122111, 2022.
  115. O. Pedreira, F. Silva-Coira, A. S. Places, M. R. Luaces, and L. G. Folgueira, “Applying feature-oriented software development in saas systems: Real experience, measurements, and findings,” Journal of Web Engineering, vol. 18, no. 4– 6, pp. 447–475, 2019.
  116. S. Tahvili, R. Pimentel, W. Afzal, M. Ahlberg, E. Fornander, and M. Bohlin, “sortes: A supportive tool for stochastic scheduling of manual integration test cases,” IEEE Access, vol. 7, pp. 12928–12946, 2019.
  117. M. Dilhara, A. Ketkar, and D. Dig, “Understanding software-2.0: A study of machine learning library usage and evolution,” ACM Transactions on Software Engineering and Methodology (TOSEM), vol. 30, no. 4, pp. 1–42, 2021.
  118. X. Fu, H. Cai, W. Li, and L. Li, “S eads: Scalable and cost-effective dynamic dependence analysis of distributed systems via reinforcement learning,” ACM Transactions on Software Engineering and Methodology, vol. 30, no. 1, 2021.
  119. H. S. Qiu, Y. L. Li, S. Padala, A. Sarma, and B. Vasilescu, “The signals that potential contributors look for when choosing open-source projects,” Proceedings of the ACM on Human-Computer Interaction, vol. 3, no. CSCW, pp. 1–29, 2019.
  120. J. Sandobalin, E. Insfran, and S. Abrahao, “On the effectiveness of tools to support infrastructure as code: Model-driven versus code-centric,” IEEE Access, vol. 8, pp. 17734–17761, 2020.
  121. B. Lin, S. Wang, Z. Liu, X. Xia, and X. Mao, “Predictive comment updating with heuristics and ast-path-based neural learning: A two-phase approach,” IEEE Transactions on Software Engineering, vol. 49, no. 4, pp. 1640–1660, 2023.
  122. P. Yang, Z. Liu, J. Xu, Y. Huang, and Y. Pan, “An empirical study on the ability relationships between programming and testing,” IEEE access, vol. 8, pp. 161438–161448, 2020.
  123. Y. He, J. Huang, H. Yu, and T. Xie, “An empirical study on focal methods in deep-learning-based approaches for assertion generation,” Proceedings of the ACM on Software Engineering, vol. 1, no. FSE, pp. 1750–1771, 2024.
  124. H. Jahanshahi, M. Cevik, K. Mousavi, and A. Bas¸ar, “Adptriage: Approximate dynamic programming for bug triage,” IEEE Transactions on Software Engineering, 2023.
  125. C. A. Furia, R. Feldt, and R. Torkar, “Bayesian data analysis in empirical software engineering research,” IEEE Transactions on Software Engineering, vol. 47, no. 09, pp. 1786– 1810, 2021.
  126. R. M. Shadab, Y. Zou, S. Gandham, A. Awad, and M. Lin, “Hmt: A hardware-centric hybrid bonsai merkle tree algorithm for high-performance authentication,” ACM Transactions on Embedded Computing Systems, vol. 22, no. 4, pp. 1– 28, 2023.
  127. C.-a. Sun, A. Fu, X. Guo, and T. Y. Chen, “Remusse: A redundant mutant identification technique based on selective symbolic execution,” IEEE Transactions on Reliability, vol. 71, no. 1, pp. 415–428, 2020.
  128. X. Zhang, T. F. Stafford, T. Hu, and H. Dai, “Measuring task conflict and person conflict in software testing,” ACM Transactions on Software Engineering and Methodology (TOSEM), vol. 29, no. 4, pp. 1–19, 2020.
  129. M. Chouchen, A. Ouni, and M. W. Mkaouer, “Multicr: Predicting merged and abandoned code changes in modern code review using multi-objective search,” ACM Transactions on Software Engineering and Methodology, vol. 33, no. 8, pp. 1–44, 2024.
  130. T. Bock, N. Alznauer, M. Joblin, and S. Apel, “Automatic core-developer identification on github: a validation study,” ACM Transactions on Software Engineering and Methodology, vol. 32, no. 6, pp. 1–29, 2023.
  131. A. Ahmad, O. Leifler, and K. Sandahl, “Empirical analysis of practitioners’ perceptions of test flakiness factors,” Software Testing, Verification and Reliability, vol. 31, no. 8, p. e1791, 2021.
  132. K.-J. Stol, B. Caglayan, and B. Fitzgerald, “Competitionbased crowdsourcing software development: A multimethod study from a customer perspective,” IEEE Transactions on Software Engineering, vol. 45, no. 03, pp. 237–260, 2019.
  133. E. Rosales, M. Basso, A. Ros`a, and W. Binder, “Large-scale characterization of java streams,” Software: Practice and Experience, vol. 53, no. 9, pp. 1763–1792, 2023.
  134. X. Zhang, Z. Lin, X. Hu, J. Wang, W. Lu, and D. Zhou, “Secon: Maintaining semantic consistency in data augmentation for code search,” ACM Transactions on Information Systems, 2024.
  135. M. Islam, A. K. Jha, I. Akhmetov, and S. Nadi, “Characterizing python library migrations,” Proceedings of the ACM on Software Engineering, vol. 1, no. FSE, pp. 92–114, 2024.
  136. D. Hellhake, J. Bogner, T. Schmid, and S.Wagner, “Towards using coupling measures to guide black-box integration testing in component-based systems,” Software Testing, Verification and Reliability, vol. 32, no. 4, p. e1811, 2022.
  137. N. Qamar and A. A. Malik, “Birds of a feather gel together: Impact of team homogeneity on software quality and team productivity,” IEEE Access, vol. 7, pp. 96827–96840, 2019.
  138. M. Almaliki, “Misinformation-aware social media: A software engineering perspective,” IEEE Access, vol. 7, pp. 182451–182458, 2019.
  139. J. Chen and C. Suo, “Boosting compiler testing via compiler optimization exploration,” ACM Transactions on Software Engineering and Methodology (TOSEM), vol. 31, no. 4, pp. 1–33, 2022.
  140. F. A. Bhuiyan and A. Rahman, “Log-related coding patterns to conduct postmortems of attacks in supervised learningbased projects,” ACM Transactions on Privacy and Security, vol. 26, no. 2, pp. 1–24, 2023.
  141. R. Coppola, T. Fulcini, L. Ardito, M. Torchiano, and E. Al`egroth, “On effectiveness and efficiency of gamified exploratory gui testing,” IEEE Transactions on Software Engineering, vol. 50, no. 2, pp. 322–337, 2024.
  142. Y. Zhang, Z. Qiu, K.-J. Stol, W. Zhu, J. Zhu, Y. Tian, and H. Liu, “Automatic commit message generation: A critical review and directions for future work,” IEEE Transactions on Software Engineering, 2024.
  143. K. M¨uller, C. Koch, D. Riehle, M. Stops, and N. Harutyunyan, “Challenges of working from home in software development during covid-19 lockdowns,” ACM Transactions on Software Engineering and Methodology, vol. 32, no. 5, pp. 1–41, 2023.
  144. K. Liu, D. Kim, T. F. Bissyand´e, S. Yoo, and Y. Le Traon, “Mining fix patterns for findbugs violations,” IEEE Transactions on Software Engineering, vol. 47, no. 1, pp. 165–188, 2021.
  145. C. Karanikolas, G. Dimitroulakos, and K. Masselos, “Simulating software evolution to evaluate the reliability of early decision-making among design alternatives toward maintainability,” ACM Transactions on Software Engineering and Methodology, vol. 32, no. 3, pp. 1–38, 2023.
  146. M. R. Wr´obel, J. Szymukowicz, and P. Weichbroth, “Using continuous integration techniques in open source projects– an exploratory study,” IEEE Access, 2023.
  147. T. Bi, X. Xia, D. Lo, J. Grundy, and T. Zimmermann, “An empirical study of release note production and usage in practice,” IEEE Transactions on Software Engineering, vol. 48, no. 6, pp. 1834–1852, 2022.
  148. Z. Li, Y. Yu, T. Wang, S. Li, and H. Wang, “Opportunities and challenges in repeated revisions to pull-requests: An empirical study,” Proceedings of the ACM on Human-Computer Interaction, vol. 6, no. CSCW2, pp. 1–35, 2022.
  149. X. Wang, A. Muqeet, T. Yue, S. Ali, and P. Arcaini, “Test case minimization with quantum annealers,” ACM Transactions on Software Engineering and Methodology, 2024.
  150. P. Zhu, Y. Li, T. Li, W. Yang, and Y. Xu, “Gui widget detection and intent generation via image understanding,” IEEE Access, vol. 9, pp. 160697–160707, 2021.
  151. X. Zheng, Z.Wan, Y. Zhang, R. Chang, and D. Lo, “A closer look at the security risks in the rust ecosystem,” ACM Transactions on Software Engineering and Methodology, vol. 33, no. 2, pp. 1–30, 2023.
  152. A. Zirak and H. Hemmati, “Improving automated program repair with domain adaptation,” ACM Transactions on Software Engineering and Methodology, vol. 33, no. 3, pp. 1–43, 2024.
  153. P. Rutz, C. Kotthaus, A. F. Pinatti de Carvalho, D. Randall, and V. Pipek, “The relevance of kes-oriented processes for the implementation of erp systems: Findings from an empirical study in german smes,” Proceedings of the ACM on Human-Computer Interaction, vol. 7, no. CSCW2, pp. 1–34, 2023.
  154. Z. Huang, J. Chen, J. Jiang, Y. Liang, H. You, and F. Li, “Mapping apis in dynamic-typed programs by leveraging transfer learning,” ACM Transactions on Software Engineering and Methodology, vol. 33, no. 4, pp. 1–29, 2024.
  155. A. Rahman, S. I. Shamim, D. B. Bose, and R. Pandita, “Security misconfigurations in open source kubernetes manifests: An empirical study,” ACM Transactions on Software Engineering and Methodology, vol. 32, no. 4, pp. 1–36, 2023.
  156. C. Bogart, C. K¨astner, J. Herbsleb, and F. Thung, “When and how to make breaking changes: Policies and practices in 18 open source software ecosystems,” ACM Transactions on Software Engineering and Methodology (TOSEM), vol. 30, no. 4, pp. 1–56, 2021.
  157. A. Javan Jafari, D. E. Costa, E. Shihab, and R. Abdalkareem, “Dependency update strategies and package characteristics,” ACM Transactions on Software Engineering and Methodology, vol. 32, no. 6, pp. 1–29, 2023.
  158. R. Kumar, A. Chaturvedi, and L. Kailasam, “An unsupervised software fault prediction approach using threshold derivation,” IEEE Transactions on Reliability, vol. 71, no. 2, pp. 911–932, 2022.
  159. K. Farias, T. de Oliveira Cavalcante, L. Jos´e Gonc¸ales, and V. Bischoff, “Uml2merge: a uml extension for model merging,” IET Software, vol. 13, no. 6, pp. 575–586, 2019.
  160. D. Rajapaksha, C. Tantithamthavorn, J. Jiarpakdee, C. Bergmeir, J. Grundy, and W. Buntine, “Sqaplanner: generating data-informed software quality improvement plans,” IEEE Transactions on Software Engineering, vol. 48, no. 8, pp. 2814–2835, 2022.
  161. M. Daud and A. A. Malik, “Improving the accuracy of early software size estimation using analysis-to-design adjustment factors (adafs),” IEEE Access, vol. 9, pp. 81986– 81999, 2021.
  162. S.Wagner, D. M. Fern´andez, M. Felderer, A. Vetr`o, M. Kalinowski, R. Wieringa, D. Pfahl, T. Conte, M.-T. Christiansson, D. Greer, et al., “Status quo in requirements engineering: A theory and a global family of surveys,” ACM Transactions on Software Engineering and Methodology (TOSEM), vol. 28, no. 2, pp. 1–48, 2019.
  163. M. M. Hassan, J. Salvador, S. K. K. Santu, and A. Rahman, “State reconciliation defects in infrastructure as code,” Proceedings of the ACM on Software Engineering, vol. 1, no. FSE, pp. 1865–1888, 2024.
  164. B. Kitchenham, L. Madeyski, G. Scanniello, and C. Gravino, “The importance of the correlation in crossover experiments,” IEEE Transactions on Software Engineering, vol. 48, no. 8, pp. 2802–2813, 2022.
  165. S. Ali, P. Arcaini, D. Pradhan, S. A. Safdar, and T. Yue, “Quality indicators in search-based software engineering: An empirical evaluation,” ACM Transactions on Software Engineering and Methodology (TOSEM), vol. 29, no. 2, pp. 1–29, 2020.
  166. E. Zabardast, K. Ebo Bennin, and J. Gonzalez-Huerta, “Further investigation of the survivability of code technical debt items,” Journal of Software: Evolution and Process, vol. 34, no. 2, p. e2425, 2022.
  167. M. Soltani, A. Panichella, and A. van Deursen, “Searchbased crash reproduction and its impact on debugging,” IEEE Transactions on Software Engineering, vol. 46, no. 12, pp. 1294–1317, 2020.
  168. R. Koitz-Hristov, T. Sterner, L. Stracke, and F.Wotawa, “On the suitability of checked coverage and genetic parameter tuning in test suite reduction,” Journal of Software: Evolution and Process, p. e2656, 2024.
  169. M. Joblin and S. Apel, “How do successful and failed projects differ? a socio-technical analysis,” ACM Transactions on Software Engineering and Methodology (TOSEM), vol. 31, no. 4, pp. 1–24, 2022.
  170. A. Bertolino, G. De Angelis, B. Miranda, and P. Tonella, “In vivo test and rollback of java applications as they are,” Software Testing, Verification and Reliability, vol. 33, no. 7, p. e1857, 2023.
  171. M. Chora´s, T. Springer, R. Kozik, L. Lopez, S. Mart´ınez- Fern´andez, P. Ram, P. Rodriguez, and X. Franch, “Measuring and improving agile processes in a small-size software development company,” IEEE access, vol. 8, pp. 78452– 78466, 2020.
  172. W. Behutiye, N. Tripathi, and M. Isomursu, “Adopting scrum in hybrid settings, in a university course project: Reflections and recommendations,” IEEE Access, 2024.
  173. J. N. Qureshi, M. S. Farooq, A. Khelifi, and Z. Atal, “Harnessing the potential of blockchain in chainagileplus framework for the improvement of distributed scrum of scrums agile software development,” IEEE Access, 2024.
  174. S. Gilmer, A. Bhat, S. Shah, K. Cherry, J. Cheng, and J. L. Guo, “Summit: Scaffolding open source software issue discussion through summarization,” Proceedings of the ACM on Human-Computer Interaction, vol. 7, no. CSCW2, pp. 1– 27, 2023.
  175. T. Chen and M. Li, “Do performance aspirations matter for guiding software configuration tuning? an empirical investigation under dual performance objectives,” ACM Transactions on Software Engineering and Methodology, vol. 32, no. 3, pp. 1–41, 2023.
  176. Q. Yu, S. Jiang, J. Qian, L. Bo, L. Jiang, and G. Zhang, “Process metrics for software defect prediction in object-oriented programs,” IET Software, vol. 14, no. 3, pp. 283–292, 2020.
  177. R. Arizon-Peretz, I. Hadar, and G. Luria, “The importance of security is in the eye of the beholder: Cultural, organizational, and personal factors affecting the implementation of security by design,” IEEE Transactions on Software Engineering, vol. 48, no. 11, pp. 4433–4446, 2022.
  178. D. A. A. Tamburri, F. Palomba, and R. Kazman, “Exploring community smells in open-source: an automated approach,” IEEE Transactions on Software Engineering, vol. 47, no. 3, pp. 630–652, 2021.
  179. W. Sun, M. Yan, Z. Liu, X. Xia, Y. Lei, and D. Lo, “Revisiting the identification of the co-evolution of production and test code,” ACM Transactions on Software Engineering and Methodology, vol. 32, no. 6, pp. 1–37, 2023.
  180. M. Nayebi, G. Ruhe, and T. Zimmermann, “Mining treatment-outcome constructs from sequential software engineering data,” IEEE Transactions on Software Engineering, vol. 47, no. 2, pp. 393–411, 2021.
  181. A. Metzger, J. Laufer, F. Feit, and K. Pohl, “A user study on explainable online reinforcement learning for adaptive systems,” ACM Transactions on Autonomous and Adaptive Systems, vol. 19, no. 3, pp. 1–44, 2024.
  182. H. U. Rahman, M. Raza, P. Afsar, and H. U. Khan, “Empirical investigation of influencing factors regarding offshore outsourcing decision of application maintenance,” IEEE Access, vol. 9, pp. 58589–58608, 2021.
  183. C. Wei, X. Yao, D. Gong, and H. Liu, “Test data generation for mutation testing based on markov chain usage model and estimation of distribution algorithm,” IEEE Transactions on Software Engineering, 2024.
  184. S. Yu, C. Fang, Q. Zhang, Z. Cao, Y. Yun, Z. Cao, K. Mei, and Z. Chen, “Mobile app crowdsourced test report consistency detection via deep image-and-text fusion understanding,” IEEE Transactions on Software Engineering, vol. 49, no. 8, pp. 4115–4134, 2023.
  185. R. Khojah, M. Mohamad, P. Leitner, and F. G. de Oliveira Neto, “Beyond code generation: An observational study of chatgpt usage in software engineering practice,” Proceedings of the ACM on Software Engineering, vol. 1, no. FSE, pp. 1819–1840, 2024.
  186. R. Amirova, G. Dlamini, A. Repryntseva, G. Succi, and H. Tarasau, “Attention and concentration for software developers,” IEEE Access, 2023.
  187. G.-I. Trujillo-Tzanahua, U. Ju´arez-Mart´ınez, A.-A. Aguilar- Lasserre, M.-K. Cort´es-Verd´ın, and C. Azzaro-Pantel, “Multiple software product lines to configure applications of internet of things,” IET Software, vol. 14, no. 2, pp. 165–175, 2020.
  188. A. Rahman, M. R. Rahman, C. Parnin, and L. Williams, “Security smells in ansible and chef scripts: A replication study,” ACM Transactions on Software Engineering and Methodology (TOSEM), vol. 30, no. 1, pp. 1–31, 2021.
  189. H. U. Khan, M. Niazi, M. El-Attar, N. Ikram, S. U. Khan, and A. Q. Gill, “Empirical investigation of critical requirements engineering practices for global software development,” IEEE Access, vol. 9, pp. 93593–93613, 2021.
  190. P. Liu, L. Li, K. Liu, S. McIntosh, and J. Grundy, “Understanding the quality and evolution of android app build systems,” Journal of Software: Evolution and Process, vol. 36, no. 5, p. e2602, 2024.
  191. C. Gavidia-Calderon, A. Kordoni, A. Bennaceur, M. Levine, and B. Nuseibeh, “The idea of us: An identity-aware architecture for autonomous systems,” ACM Transactions on Software Engineering and Methodology, 2024.
  192. B. K. Ozkan, R. Majumdar, and S. Oraee, “Trace aware random testing for distributed systems,” Proceedings of the ACM on Programming Languages, vol. 3, no. OOPSLA, pp. 1–29, 2019.
  193. A. Razzaq, A. Ventresque, R. Koschke, A. De Lucia, and J. Buckley, “The effect of feature characteristics on the performance of feature location techniques,” IEEE Transactions on Software Engineering, vol. 48, no. 6, pp. 2066–2085, 2022.
  194. M. Hoffmann, D. M´endez, F. Fagerholm, and A. Luckhardt, “The human side of software engineering teams: an investigation of contemporary challenges,” IEEE TRANSACTIONS ON SOFTWARE ENGINEERING, vol. 49, no. 1, pp. 211– 225, 2023.
  195. M. Leotta, F. Ricca, A. Marchetto, and D. Olianas, “An empirical study to compare three web test automation approaches: Nlp-based, programmable, and capture&replay,” Journal of Software: Evolution and Process, vol. 36, no. 5, p. e2606, 2024.
  196. F. Aizaz, S. U. R. Khan, J. A. Khan, A. Akhunzada, et al., “An empirical investigation of factors causing scope creep in agile global software development context: a conceptual model for project managers,” IEEE Access, vol. 9, pp. 109166–109195, 2021.
  197. A. Ahmad, C. Feng, K. Li, S. M. Asim, and T. Sun, “Toward empirically investigating non-functional requirements of ios developers on stack overflow,” IEEE Access, vol. 7, pp. 61145–61169, 2019.
  198. G. A. Ahmed, J. V. Patten, Y. Han, G. Lu,W. Hou, D. Gregg, J. Buckley, and M. Chochlov, “Nearest-neighbor, bert-based, scalable clone detection: A practical approach for large-scale industrial code bases,” Software: Practice and Experience, 2024.
  199. D. Amara, E. Fatnassi, and L. Ben Arfa Rabai, “An empirical assessment and validation of redundancy metrics using defect density as reliability indicator,” Scientific Programming, vol. 2021, no. 1, p. 8325417, 2021.
  200. S. Sato and T. Nakamaru, “Multiverse notebook: Shifting data scientists to time travelers,” Proceedings of the ACM on Programming Languages, vol. 8, no. OOPSLA1, pp. 754– 783, 2024.
  201. A. Vizca´ıno, F. Garc´ıa, I. G. R. D. Guzma´n, and M. A´ . Moraga, “Evaluating gsd-aware: A serious game for discovering global software development challenges,” ACM Transactions on Computing Education (TOCE), vol. 19, no. 2, pp. 1–23, 2019.
  202. Y. Shao and B. Xiang, “Enhancing bug report summaries through knowledge-specific and contrastive learning pretraining,” IEEE Access, vol. 12, pp. 37653–37662, 2024.
  203. R. Huang, W. Sun, T. Y. Chen, S. Ng, and J. Chen, “Identification of failure regions for programs with numeric inputs,” IEEE Transactions on Emerging Topics in Computational Intelligence, vol. 5, no. 4, pp. 651–667, 2020.
  204. F. Liu, Z. Fu, G. Li, Z. Jin, H. Liu, Y. Hao, and L. Zhang, “Non-autoregressive line-level code completion,” ACM Transactions on Software Engineering and Methodology, 2024.
  205. Z. Liao, X. Huang, B. Zhang, J. Wu, and Y. Cheng, “Bdgoa: A bot detection approach for github oauth apps,” Intelligent and Converged Networks, vol. 4, no. 3, pp. 181–197, 2023.
  206. M. Prudjinski, I. Hadar, and G. Luria, “Exploring the role of team security climate in the implementation of security by design: A case study in the defense sector,” IEEE Transactions on Software Engineering, 2024.
Index Terms

Computer Science
Information Sciences
Empirical Software Engineering
Systematic Mapping Study
Empirical Strategies
Support Mechanisms
Software Development Life Cycle

Keywords

Experiment Survey Case study Tool Technique Testing Maintenance

Powered by PhDFocusTM