Jasmin Jahic
State of Practice: LLMs in Software Engineering and Software Architecture
Jahic, Jasmin; Sami, Ashkan
Authors
Ashkan Sami
Abstract
Large Language Models (LLMs) are finding their way into Software Engineering by assisting with tasks such as code generation. Furthermore, LLMs might have a potential to perform even more complex tasks, such as suggesting architectural design. However, there is a lack of empirical surveys on how software engineering companies use (and plan to use) LLMs and if LLMs truly can provide benefits to software architects. To understand the state of practice considering adoption of LLMs in software engineering, existing challenges, and future trends, we have surveyed 15 different software engineering companies. To understand the ability of LLMs to perform more complex tasks, we report on our experiments with LLM-assisted architectural design. We applied ChatGPT on 5 software projects and in total performed 50 different experiments. Our results capture the state of the practice of LLMs in software engineering and demonstrate how LLMs perform when assisting with (more complex task such as) architectural design. Engineers, architects, and project managers should profit from these results to guide their decision towards targeted adoption of LLMs in their business and engineering domains.
Citation
Jahic, J., & Sami, A. (2024, June). State of Practice: LLMs in Software Engineering and Software Architecture. Paper presented at 21st IEEE International Conference on Software Architecture (ICSA 2024): 3rd International Workshop on Software Architecture and Machine Learning, Hyderabad, India
Presentation Conference Type | Conference Paper (unpublished) |
---|---|
Conference Name | 21st IEEE International Conference on Software Architecture (ICSA 2024): 3rd International Workshop on Software Architecture and Machine Learning |
Start Date | Jun 4, 2024 |
End Date | Jun 8, 2024 |
Deposit Date | Jul 13, 2024 |
Peer Reviewed | Peer Reviewed |
Keywords | Index Terms-Architecture; AI; Design Space Exploration; ChatGPT |
Publisher URL | https://conf.researchr.org/details/icsa-2024/icsa-2024-workshops/19/State-of-Practice-LLMs-in-Software-Engineering-and-Software-Architecture |
This file is under embargo due to copyright reasons.
Contact repository@napier.ac.uk to request a copy for personal use.
You might also like
A Deep Transfer Learning-Powered EDoS Detection Mechanism for 5G and Beyond Network Slicing
(2024)
Presentation / Conference Contribution
Investigating Markers and Drivers of Gender Bias in Machine Translations
(2023)
Presentation / Conference Contribution
A case study of fairness in generated images of Large Language Models for Software Engineering tasks
(2023)
Presentation / Conference Contribution
Application of deep learning in generating structured radiology reports: a transformer-based technique
(2023)
Presentation / Conference Contribution
Downloadable Citations
About Edinburgh Napier Research Repository
Administrator e-mail: repository@napier.ac.uk
This application uses the following open-source libraries:
SheetJS Community Edition
Apache License Version 2.0 (http://www.apache.org/licenses/)
PDF.js
Apache License Version 2.0 (http://www.apache.org/licenses/)
Font Awesome
SIL OFL 1.1 (http://scripts.sil.org/OFL)
MIT License (http://opensource.org/licenses/mit-license.html)
CC BY 3.0 ( http://creativecommons.org/licenses/by/3.0/)
Powered by Worktribe © 2024
Advanced Search