Home > Research > Researchers > Professor Tracy Hall > Publications

Professor Tracy Hall

Chair in Software Engineering

  1. 2024
  2. E-pub ahead of print

    The Impact of Hard and Easy Negative Training Data on Vulnerability Prediction Performance

    Debeyan, F., Madeyski, L., Hall, T. & Bowes, D., 31/05/2024, In: Journal of Systems and Software. 211, 112003.

    Research output: Contribution to Journal/MagazineJournal articlepeer-review

  3. 2023
  4. Published

    Fault-insertion and fault-fixing behavioural patterns in Apache Software Foundation Projects

    Ortu, M., Destefanis, G., Hall, T. & Bowes, D., 30/06/2023, In: Information and Software Technology. 158, 21 p., 107187.

    Research output: Contribution to Journal/MagazineJournal articlepeer-review

  5. Published

    How do developers really feel about bug fixing? Directions for automatic program repair

    Winter, E., Bowes, D., Counsell, S., Hall, T., Haraldsson, S., Nowack, V. & Woodward, J., 1/04/2023, In: IEEE Transactions on Software Engineering. 49, 4, p. 1823-1841 19 p., 4.

    Research output: Contribution to Journal/MagazineJournal articlepeer-review

  6. Published

    Let's Talk With Developers, Not About Developers: A Review of Automatic Program Repair Research

    Winter, E., Nowack, V., Bowes, D., Counsell, S., Hall, T., Haraldsson, S. & Woodward, J., 31/01/2023, In: IEEE Transactions on Software Engineering. 49, 1, p. 419-436 18 p.

    Research output: Contribution to Journal/MagazineJournal articlepeer-review

  7. 2022
  8. Published

    Improved Evaluation of Automatic Source Code Summarisation

    Phillips, J., Bowes, D., El-Haj, M. & Hall, T., 7/12/2022, 2nd Wokshop on Natural Language Generation, Evaluation and Metrics: Proceedings of the Workshop. Stroudsberg, PA.: Association for Computational Linguistics (ACL Anthology), p. 326-335 10 p.

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  9. Published

    Improving the Performance of Code Vulnerability Prediction using Abstract Syntax Tree Information

    Debeyan, F., Hall, T. & Bowes, D., 17/11/2022, PROMISE 2022: Proceedings of the 18th International Conference on Predictive Models and Data Analytics in Software Engineering. McIntosh, S., Shang, W. & Perez, G. R. (eds.). New York: ACM, p. 2-11 10 p.

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  10. Published

    Towards Developer-Centered Automatic Program Repair: Findings from Bloomberg

    Winter, E., Nowack, V., Bowes, D., Counsell, S., Hall, T., Haraldsson, S., Woodward, J., Kirbas, S., Windells, E., McBello, O., Atakishiyev, A., Kells, K. & Pagano, M., 9/11/2022, ACM Joint European Software Engineering Conference and Symposium on the Foundations of Software Engineering (ESEC/FSE) . New York: ACM

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  11. Published

    Some automatically generated patches are more likely to be correct than others: an analysis of Defects4J patch features

    Bennett, G., Hall, T. & Bowes, D., 26/10/2022, Proceedings - International Workshop on Automated Program Repair, APR 2022. New York: ACM, p. 46-52 7 p.

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  12. Published

    How Software Developers Mitigate their Errors when Developing Code

    Hall, T., 30/06/2022, In: IEEE Transactions on Software Engineering. 48, 6, p. 1853-1867 15 p., 6.

    Research output: Contribution to Journal/MagazineJournal articlepeer-review

  13. Published

    Expanding Fix Patterns to Enable Automatic Program Repair

    Nowack, V., Bowes, D., Counsell, S., Hall, T., Haraldsson, S., Winter, E. & Woodward, J., 11/02/2022, 2021 IEEE 32nd International Symposium on Software Reliability Engineering (ISSRE). Jin, Z., Li, X., Xiang, J., Mariani, L., Liu, T., Yu, X. & Ivaki, N. (eds.). IEEE Computer Society Press, p. 12-23 12 p. (2021 IEEE 32nd International Symposium on Software Reliability Engineering (ISSRE)).

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  14. 2021
  15. Published

    Using Machine Learning to Recognise Novice and Expert Programmers

    Lee, C. H. & Hall, T., 23/11/2021, Product-Focused Software Process Improvement - 22nd International Conference, PROFES 2021, Proceedings: 22nd International Conference, PROFES 2021, Turin, Italy, November 26, 2021, Proceedings. Ardito, L., Jedlitschka, A., Morisio, M. & Torchiano, M. (eds.). Cham: Springer, p. 199-206 8 p. (Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics); vol. 13126 LNCS).

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  16. Published

    On the Introduction of Automatic Program Repair in Bloomberg

    Kirbas, S., Windels, E., McBello, O., Kells, K., Pagano, M., Szalanski, R., Nowack, V., Winter, E., Counsell, S., Bowes, D., Hall, T., Haraldsson, S. & Woodward, J., 31/07/2021, In: IEEE Software. 38, 4, p. 43-51 9 p.

    Research output: Contribution to Journal/MagazineJournal articlepeer-review

  17. 2020
  18. Published

    Reducing Software Developer Human Errors by Improving Situation Awareness

    Nageria, B. & Hall, T., 1/11/2020, In: IEEE Software. 37, 6, p. 32-37 6 p.

    Research output: Contribution to Journal/MagazineJournal articlepeer-review

  19. Published

    BugVis: Commit slicing for fault visualisation

    Bowes, D., Petric, J. & Hall, T., 5/10/2020, ICPC '20: Proceedings of the 28th International Conference on Program Comprehension. New York: ACM, p. 436-440 5 p.

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  20. Published

    Zones of pain: Visualising the relationship between software architecture and defects

    Petrić, J., Hall, T. & Bowes, D., 31/08/2020, Quality of Information and Communications Technology: 13th International Conference, QUATIC 2020, Faro, Portugal, September 9–11, 2020, Proceedings. Shepperd, M., Brito e Abreu, F., Rodrigues da Silva, A. & Pérez-Castillo, R. (eds.). Cham: Springer Science and Business Media Deutschland GmbH, p. 135-143 9 p. (Communications in Computer and Information Science; vol. 1266).

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  21. Published

    Exploiting fault localisation for efficient program repair: 2020 Genetic and Evolutionary Computation Conference, GECCO 2020

    Nowack, V., Bowes, D., Counsell, S., Hall, T., Haraldsson, S., Winter, E., Woodward, J. & SIGEVO, ACM., 8/07/2020, p. 311-312. 2 p.

    Research output: Contribution to conference - Without ISBN/ISSN Conference paperpeer-review

  22. Published

    Human Factors in the Study of Automatic Software Repair: Future Directions for Research with Industry

    Winter, E., Bowes, D., Counsell, S., Hall, T., Haraldsson, S., Nowack, V. & Woodward, J., 6/07/2020, Proceedings - 2020 IEEE/ACM 42nd International Conference on Software Engineering Workshops, ICSEW 2020. New York: Association for Computing Machinery, Inc, p. 285-286 2 p. (Proceedings - 2020 IEEE/ACM 42nd International Conference on Software Engineering Workshops, ICSEW 2020).

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  23. Published

    Which Software Faults Are Tests Not Detecting?

    Petric, J., Hall, T. & Bowes, D., 15/04/2020, PROCEEDINGS of EASE 2020: Evaluation and Assessment in Software Engineering. New York: ACM, p. 160-169 10 p.

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  24. 2019
  25. Published

    Automatically Identifying Code Features for Software Defect Prediction: Using AST N-grams

    Shippey, T., Bowes, D. & Hall, T., 02/2019, In: Information and Software Technology. 106, p. 142-160 19 p.

    Research output: Contribution to Journal/MagazineJournal articlepeer-review

  26. 2018
  27. Published

    Authors' reply to 'comments on 'researcher bias: The use of machine learning in software defect prediction''

    Shepperd, M., Hall, T. & Bowes, D., 1/11/2018, In: IEEE Transactions on Software Engineering. 44, 11, p. 1129-1131 3 p.

    Research output: Contribution to Journal/MagazineJournal articlepeer-review

  28. Published

    How Effectively Is Defective Code Actually Tested? An Analysis of JUnit Tests in Seven Open Source Systems

    Petric, J., Hall, T. & Bowes, D., 10/10/2018, Proceedings of the 14th International Conference on Predictive Models and Data Analytics in Software Engineering. New York, NY, USA: ACM, p. 42-51 10 p. (PROMISE'18).

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  29. Published

    Mining communication patterns in software development: A GitHub analysis

    Ortu, M., Hall, T., Marchesi, M., Tonelli, R., Bowes, D. & Destefanis, G., 10/10/2018, PROMISE'18 Proceedings of the 14th International Conference on Predictive Models and Data Analytics in Software Engineering. New York: ACM, p. 70-79 10 p.

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  30. Published

    Code cleaning for software defect prediction: A cautionary tale

    Shippey, T., Bowes, D., Counsell, S. & Hall, T., 29/08/2018, 2018 44th Euromicro Conference on Software Engineering and Advanced Applications (SEAA). IEEE, p. 239-243 5 p.

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  31. Published

    Reproducibility and replicability of software defect prediction studies

    Mahmood, Z., Bowes, D., Hall, T., Lane, P. C. R. & Petrić, J., 1/07/2018, In: Information and Software Technology. 99, p. 148-163 16 p.

    Research output: Contribution to Journal/MagazineReview articlepeer-review

  32. Published

    Software defect prediction: do different classifiers find the same defects?

    Bowes, D., Hall, T. & Petrić, J., 1/06/2018, In: Software Quality Journal. 26, 2, p. 525-552 28 p.

    Research output: Contribution to Journal/MagazineJournal articlepeer-review

  33. Published

    The relationship between evolutionary coupling and defects in large industrial software (journal-first abstract)

    Kirbas, S., Caglayan, B., Hall, T., Counsell, S., Bowes, D., Sen, A. & Bener, A., 2/04/2018, 25th IEEE International Conference on Software Analysis, Evolution and Reengineering, SANER 2018 - Proceedings. Institute of Electrical and Electronics Engineers Inc., p. 471 1 p.

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  34. 2017
  35. Published

    Biochar modulates heavy metal toxicity and improves microbial carbon use efficiency in soil

    Xu, Y., Seshadri, B., Sarkar, B., Wang, H., Rumpel, C., Sparks, D., Farrell, M., Hall, T., Yang, X. & Bolan, N., 1/12/2017, In: Science of the Total Environment. 621, p. 148-159 12 p.

    Research output: Contribution to Journal/MagazineJournal articlepeer-review

  36. Published

    Assert use and defectiveness in industrial code

    Counsell, S., Hall, T., Shippey, T., Bowes, D., Tahir, A. & MacDonell, S., 14/11/2017, Proceedings - 2017 IEEE 28th International Symposium on Software Reliability Engineering Workshops, ISSREW 2017. Institute of Electrical and Electronics Engineers Inc., p. 20-23 4 p. 8109241

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  37. Published

    Getting defect prediction into industrial practice: The ELFF tool

    Bowes, D., Counsell, S., Hall, T., Petric, J. & Shippey, T., 14/11/2017, Proceedings - 2017 IEEE 28th International Symposium on Software Reliability Engineering Workshops, ISSREW 2017. Institute of Electrical and Electronics Engineers Inc., p. 44-47 4 p. 8109247

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  38. Published

    How Good Are My Tests?

    Bowes, D., Hall, T., Petrić, J., Shippey, T. & Turhan, B., 3/07/2017, 2017 IEEE/ACM 8th Workshop on Emerging Trends in Software Metrics (WETSoM). IEEE Computer Society, p. 9-14 6 p. 7968009. (2017 IEEE/ACM 8th Workshop on Emerging Trends in Software Metrics (WETSoM)).

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  39. Published

    The relationship between evolutionary coupling and defects in large industrial software

    Kirbas, S., Caglayan, B., Hall, T., Counsell, S., Bowes, D., Sen, A. & Bener, A., 1/04/2017, In: Journal of Software: Evolution and Process. 29, 4, e1842.

    Research output: Contribution to Journal/MagazineJournal articlepeer-review

  40. Published

    Evolutionary coupling measurement: Making sense of the current chaos

    Kirbas, S., Hall, T. & Sen, A., 15/02/2017, In: Science of Computer Programming. 135, p. 4-19 16 p.

    Research output: Contribution to Journal/MagazineJournal articlepeer-review

  41. 2016
  42. Published

    Building an Ensemble for Software Defect Prediction Based on Diversity Selection

    Petrić, J., Bowes, D., Hall, T., Christianson, B. & Baddoo, N., 8/09/2016, ESEM '16 Proceedings of the 10th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement. New York: Association for Computing Machinery, Inc, 10 p. 46

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  43. Published

    So You Need More Method Level Datasets for Your Software Defect Prediction? Voilà!

    Shippey, T., Hall, T., Counsell, S. & Bowes, D., 8/09/2016, ESEM '16 Proceedings of the 10th ACM/IEEE International Symposium on Empirical Software Engineering and Measurement. New York: IEEE Computer Society, 6 p. 12

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  44. Published

    Mutation-aware fault prediction

    Bowes, D., Hall, T., Harman, M., Jia, Y., Sarro, F. & Wu, F., 18/07/2016, ISSTA 2016 Proceedings of the 25th International Symposium on Software Testing and Analysis. New York: Association for Computing Machinery, Inc, p. 330-341 12 p.

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  45. Published

    The Jinx on the NASA software defect data sets

    Petrić, J., Bowes, D., Hall, T., Christianson, B. & Baddoo, N., 1/06/2016, EASE '16 Proceedings of the 20th International Conference on Evaluation and Assessment in Software Engineering. New York: Association for Computing Machinery, Inc, 5 p. 13

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  46. 2015
  47. Published

    Different classifiers find different defects although with different level of consistency

    Bowes, D., Hall, T. & Petrić, J., 21/10/2015, PROMISE '15 Proceedings of the 11th International Conference on Predictive Models and Data Analytics in Software Engineering. New York: Association for Computing Machinery, Inc, 10 p.

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  48. Published

    What is the impact of imbalance on software defect prediction performance?

    Mahmood, Z., Bowes, D., Lane, P. C. R. & Hall, T., 21/10/2015, PROMISE '15 Proceedings of the 11th International Conference on Predictive Models and Data Analytics in Software Engineering. New York: Association for Computing Machinery, Inc, 4

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  49. 2014
  50. Published

    Some code smells have a significant but small effect on faults

    Hall, T., Bowes, D., Sun, Y. & Zhang, M., 08/2014, In: ACM Transactions on Software Engineering and Methodology. 23, 4, 39 p., 33.

    Research output: Contribution to Journal/MagazineJournal articlepeer-review

  51. Published

    Researcher bias: The use of machine learning in software defect prediction

    Shepperd, M., Bowes, D. & Hall, T., 1/06/2014, In: IEEE Transactions on Software Engineering. 40, 6, p. 603-616 14 p., 6824804.

    Research output: Contribution to Journal/MagazineJournal articlepeer-review

  52. Published

    DConfusion: A technique to allow cross study performance evaluation of fault prediction studies

    Bowes, D., Hall, T. & Gray, D., 04/2014, In: Automated Software Engineering. 21, 2, p. 287-313 27 p.

    Research output: Contribution to Journal/MagazineJournal articlepeer-review

  53. Published

    Factors that motivate software engineering teams: A four country empirical study

    Verner, J. M., Babar, M. A., Cerpa, N., Hall, T. & Beecham, S., 25/01/2014, In: Journal of Systems and Software. 92, p. 115-127 13 p.

    Research output: Contribution to Journal/MagazineJournal articlepeer-review

  54. 2013
  55. Published

    The inconsistent measurement of Message Chains

    Bowes, D., Randall, D. & Hall, T., 2013, 2013 4th International Workshop on Emerging Trends in Software Metrics (WETSoM). IEEE, p. 62-68 7 p.

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  56. 2012
  57. Published

    A mapping study of software code cloning

    Shippey, T., Bowes, D., Chrisianson, B. & Hall, T., 2012, 16th International Conference on Evaluation & Assessment in Software Engineering (EASE 2012). IEEE, p. 274-278 5 p.

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  58. Published

    A systematic literature review on fault prediction performance in software engineering

    Hall, T., Beecham, S., Bowes, D., Gray, D. & Counsell, S., 2012, In: IEEE Transactions on Software Engineering. 38, 6, p. 1276-1304 29 p.

    Research output: Contribution to Journal/MagazineJournal articlepeer-review

  59. Published

    Comparing the performance of fault prediction models which report multiple performance measures: Recomputing the confusion matrix

    Bowes, D., Hall, T. & Gray, D., 2012, PROMISE '12 Proceedings of the 8th International Conference on Predictive Models in Software Engineering. ACM, p. 109-118 10 p.

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  60. Published

    SLuRp: A tool to help large complex systematic literature reviews deliver calid and rigorous results

    Bowes, D., Hall, T. & Beecham, S., 2012, EAST'12 - Proceedings of the 2nd International Workshop on Evidential Assessment of Software Technologies. ACM, p. 33-36 4 p.

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  61. Published

    The state of machine learning methodology in software fault prediction

    Hall, T. & Bowes, D., 2012, Proceedings 2012 11th International Conference on Machine Learning and Applications, ICMLA 2012. IEEE, p. 308-313 6 p.

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  62. 2011
  63. Published

    Developing fault-prediction models: What the research can show industry

    Hall, T., Beecham, S., Bowes, D., Gray, D. & Counsell, S., 1/11/2011, In: IEEE Software. 28, 6, p. 96-99 4 p.

    Research output: Contribution to Journal/MagazineJournal articlepeer-review

  64. Published

    Program slicing-based cohesion measurement: The challenges of replicating studies using metrics

    Bowes, D., Hall, T. & Kerr, A., 2011, WETSoM '11 Proceedings of the 2nd International Workshop on Emerging Trends in Software Metrics. ACM, p. 75-80 6 p.

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  65. 2010
  66. Published

    A theoretical and empirical analysis of three slice-based metrics for cohesion

    Counsell, S., Hall, T. & Bowes, D., 2010, In: International Journal of Software Engineering and Knowledge Engineering. 20, 5, p. 609-636 28 p.

    Research output: Contribution to Journal/MagazineJournal articlepeer-review

  67. Published

    An analysis of the 'inconclusive' change report category in OSS assisted by a program slicing metric

    Counsell, S., Hall, T., Nasseri, E. & Bowes, D., 2010, 2010 36th EUROMICRO Conference on Software Engineering and Advanced Applications. IEEE, p. 283-286 4 p.

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  68. Published

    Evaluating three approaches to extracting fault data from software change repositories

    Hall, T., Bowes, D., Liebchen, G. & Wernick, P., 2010, International Conference on Product Focused Software Process Improvement: PROFES 2010: Product-Focused Software Process Improvement. Ali Babar, M., Viermaa, M. & Oivo, M. (eds.). Springer, p. 107-115 9 p.

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

  69. 2009
  70. Published

    Fault analysis in OSS based on program slicing metrics

    Black, S., Counsell, S., Hall, T. & Bowes, D., 2009, 2009 35th Euromicro Conference on Software Engineering and Advanced Applications. IEEE, p. 3-10 8 p.

    Research output: Contribution in Book/Report/Proceedings - With ISBN/ISSNConference contribution/Paperpeer-review

Back to top