Skip to main content

Research Repository

Advanced Search

An empirical evaluation of a novel domain-specific language – modelling vehicle routing problems with Athos

Hoffmann, Benjamin; Urquhart, Neil; Chalmers, Kevin; Guckert, Michael


Kevin Chalmers

Michael Guckert


Domain-specific languages (DSLs) are a popular approach among software engineers who demand for a tailored development interface. A DSL-based approach allows to encapsulate the intricacies of the target platform in transformations that turn DSL models into executable software code. Often, DSLs are even claimed to reduce development complexity to a level that allows them to be successfully applied by domain-experts with limited programming knowledge. Recent research has produced some scientifically backed insights on the benefits and limitations of DSLs. Further empirical studies are required to build a sufficient body of knowledge from which support for different claims related to DSLs can be derived. In this research study, we adopt current DSL evaluation approaches to investigate potential gains in terms of effectiveness and efficiency, through the application of our DSL Athos, a language developed for the domain of traffic and transportation simulation and optimisation. We compare Athos to the alternative of using an application library defined within a general-purpose language (GPL). We specified two sets of structurally identical tasks from the domain of vehicle routing problems and asked study groups with differing levels of programming knowledge to solve the tasks with the two approaches. The results show that inexperienced participants achieved considerable gains in effectiveness and efficiency with the usage of Athos DSL. Though hinting at Athos being the more efficient approach, the results were less distinct for more experienced programmers. The vast majority of participants stated to prefer working with Athos over the usage of the presented GPL’s API.

Journal Article Type Article
Acceptance Date Jul 13, 2022
Online Publication Date Sep 23, 2022
Publication Date 2022-12
Deposit Date Jun 23, 2022
Publicly Available Date Oct 6, 2022
Journal Empirical Software Engineering
Print ISSN 1382-3256
Publisher Springer
Peer Reviewed Peer Reviewed
Volume 27
Issue 7
Article Number 180
Keywords Domain-specific languages, General-purpose language, Empirical evaluation, Vehicle routing problem
Public URL


You might also like

Downloadable Citations