Skip to main content

Research Repository

Advanced Search

Outputs (121)

What happens if you treat ordinal ratings as interval data? Human evaluations in {NLP} are even more under-powered than you think (2021)
Presentation / Conference Contribution
Howcroft, D. M., & Rieser, V. (2021, November). What happens if you treat ordinal ratings as interval data? Human evaluations in {NLP} are even more under-powered than you think. Presented at 2021 Conference on Empirical Methods in Natural Language Processing

Previous work has shown that human evaluations in NLP are notoriously under-powered. Here, we argue that there are two common factors which make this problem even worse: NLP studies usually (a) treat ordinal data as interval data and (b) operate unde... Read More about What happens if you treat ordinal ratings as interval data? Human evaluations in {NLP} are even more under-powered than you think.

On the Utility of Probing Trajectories for Algorithm-Selection (2024)
Presentation / Conference Contribution
Renau, Q., & Hart, E. (2024, April). On the Utility of Probing Trajectories for Algorithm-Selection. Presented at EvoStar 2024, Aberystwyth, UK

Machine-learning approaches to algorithm-selection typically take data describing an instance as input. Input data can take the form of features derived from the instance description or fitness landscape , or can be a direct representation of the ins... Read More about On the Utility of Probing Trajectories for Algorithm-Selection.

A Hierarchical Approach to Evolving Behaviour-Trees for Swarm Control (2024)
Presentation / Conference Contribution
Montague, K., Hart, E., & Paechter, B. (2024, April). A Hierarchical Approach to Evolving Behaviour-Trees for Swarm Control. Presented at EvoStar 2024, Aberystwyth

Behaviour trees (BTs) are commonly used as controllers in robotic swarms due their modular composition and to the fact that they can be easily interpreted by humans. From an algorithmic perspective, an additional advantage is that extra modules can e... Read More about A Hierarchical Approach to Evolving Behaviour-Trees for Swarm Control.

Learning Descriptors for Novelty-Search Based Instance Generation via Meta-evolution (2024)
Presentation / Conference Contribution
Marrero, A., Segredo, E., León, C., & Hart, E. (2024, July). Learning Descriptors for Novelty-Search Based Instance Generation via Meta-evolution. Presented at ACM GECCO 2024, Melbourne, Australia

The ability to generate example instances from a domain is important in order to benchmark algorithms and to generate data that covers an instance-space in order to train machine-learning models for algorithm selection. Quality-Diversity (QD) algorit... Read More about Learning Descriptors for Novelty-Search Based Instance Generation via Meta-evolution.

Generalized Early Stopping in Evolutionary Direct Policy Search (2024)
Journal Article
Arza, E., Le Goff, L. K., & Hart, E. (online). Generalized Early Stopping in Evolutionary Direct Policy Search. ACM Transactions on Evolutionary Learning and Optimization, https://doi.org/10.1145/3653024

Lengthy evaluation times are common in many optimization problems such as direct policy search tasks, especially when they involve conducting evaluations in the physical world, e.g. in robotics applications. Often when evaluating solution over a fixe... Read More about Generalized Early Stopping in Evolutionary Direct Policy Search.

Synthesising Diverse and Discriminatory Sets of Instances using Novelty Search in Combinatorial Domains (2024)
Journal Article
Marrero, A., Segredo, E., Leon, C., & Hart, E. (online). Synthesising Diverse and Discriminatory Sets of Instances using Novelty Search in Combinatorial Domains. Evolutionary Computation, https://doi.org/10.1162/evco_a_00350

Gathering sufficient instance data to either train algorithm-selection models or understand algorithm footprints within an instance space can be challenging. We propose an approach to generating synthetic instances that are tailored to perform well w... Read More about Synthesising Diverse and Discriminatory Sets of Instances using Novelty Search in Combinatorial Domains.

A spatio-temporal graph convolutional approach to real-time load forecasting in an edge-enabled distributed Internet of Smart Grids energy system (2024)
Journal Article
Liu, Q., Pan, L., Cao, X., Gan, J., Huang, X., & Liu, X. (2024). A spatio-temporal graph convolutional approach to real-time load forecasting in an edge-enabled distributed Internet of Smart Grids energy system. Concurrency and Computation: Practice and Experience, 36(13), Article e8060. https://doi.org/10.1002/cpe.8060

As the edge nodes of the Internet of Smart Grids (IoSG), smart sockets enable all kinds of power load data to be analyzed at the edge, which create conditions for edge calculation and real-time (RT) load forecasting. In this article, an edge-cloud co... Read More about A spatio-temporal graph convolutional approach to real-time load forecasting in an edge-enabled distributed Internet of Smart Grids energy system.

Utilizing the Ensemble Learning and XAI for Performance Improvements in IoT Network Attack Detection (2024)
Presentation / Conference Contribution
Kalutharage, C. S., Liu, X., Chrysoulas, C., & Bamgboye, O. (2023, September). Utilizing the Ensemble Learning and XAI for Performance Improvements in IoT Network Attack Detection. Presented at The 4th International Workshop on Cyber-Physical Security for Critical Infrastructures Protection (CPS4CIP 2023) - in conjunction with ESORICS 2023, The Hague, Netherlands

How Much do Robots Understand Rudeness? Challenges in Human-Robot Interaction (2024)
Presentation / Conference Contribution
Orme, M., Yu, Y., & Tan, Z. (2024, May). How Much do Robots Understand Rudeness? Challenges in Human-Robot Interaction. Presented at The 2024 Joint International Conference on Computational Linguistics, Language Resources and Evaluation (LREC-COLING 2024), Torino, Italy

This paper concerns the pressing need to understand and manage inappropriate language within the evolving human-robot interaction (HRI) landscape. As intelligent systems and robots transition from controlled laboratory settings to everyday households... Read More about How Much do Robots Understand Rudeness? Challenges in Human-Robot Interaction.

Scalability resilience framework using application-level fault injection for cloud-based software services (2022)
Journal Article
Al-Said Ahmad, A., & Andras, P. (2022). Scalability resilience framework using application-level fault injection for cloud-based software services. Journal of cloud computing: advances, systems and applications, 11(1), Article 1. https://doi.org/10.1186/s13677-021-00277-z

This paper presents an investigation into the effect of faults on the scalability resilience of cloud-based software services. The study introduces an experimental framework using the Application-Level Fault Injection (ALFI) to investigate how the fa... Read More about Scalability resilience framework using application-level fault injection for cloud-based software services.

DanceMark: An open telemetry framework for latency sensitive real-time networked immersive experiences (2024)
Presentation / Conference Contribution
Koniaris, B., Sinclair, D., & Mitchell, K. (2024, March). DanceMark: An open telemetry framework for latency sensitive real-time networked immersive experiences. Presented at IEEE VR Workshop on Open Access Tools and Libraries for Virtual Reality, Orlando, FL

DanceMark is an open telemetry framework designed for latency-sensitive real-time networked immersive experiences, focusing on online dancing in virtual reality within the DanceGraph platform. The goal is to minimize end-to-end latency and enhance us... Read More about DanceMark: An open telemetry framework for latency sensitive real-time networked immersive experiences.

Evolving Behavior Allocations in Robot Swarms (2024)
Presentation / Conference Contribution
Hallauer, S., Nitschke, G., & Hart, E. (2023, December). Evolving Behavior Allocations in Robot Swarms. Presented at IEEE Symposium Series on Computational Intelligence (SSCI 2023), Mexico City, Mexico

Behavioral diversity is known to benefit problem-solving in biological social systems such as insect colonies and human societies, as well as in artificial distributed systems including large-scale software and swarm-robotics systems. We investigate... Read More about Evolving Behavior Allocations in Robot Swarms.

Evaluation of Frameworks That Combine Evolution and Learning to Design Robots in Complex Morphological Spaces (2023)
Journal Article
Li, W., Buchanan, E., Goff, L. K. L., Hart, E., Hale, M. F., Wei, B., Carlo, M. D., Angus, M., Woolley, R., Gan, Z., Winfield, A. F., Timmis, J., Eiben, A. E., & Tyrrell, A. M. (online). Evaluation of Frameworks That Combine Evolution and Learning to Design Robots in Complex Morphological Spaces. IEEE Transactions on Evolutionary Computation, https://doi.org/10.1109/tevc.2023.3316363

Jointly optimising both the body and brain of a robot is known to be a challenging task, especially when attempting to evolve designs in simulation that will subsequently be built in the real world. To address this, it is increasingly common to combi... Read More about Evaluation of Frameworks That Combine Evolution and Learning to Design Robots in Complex Morphological Spaces.

DenMerD: A Feature Propagation Enhanced Approach to Beam Blockage Correction in Weather Radar (2023)
Journal Article
Liu, Q., Sun, J., & Liu, X. (in press). DenMerD: A Feature Propagation Enhanced Approach to Beam Blockage Correction in Weather Radar. Journal on Artificial Intelligence,

In the realm of meteorological research, extensive global radar networks serve to detect and provide early warnings for a diverse array of weather phenomena. However, the inherently discontinuous nature of radar observations often results in the pres... Read More about DenMerD: A Feature Propagation Enhanced Approach to Beam Blockage Correction in Weather Radar.

Building a dual dataset of text-and image-grounded conversations and summarisation in Gàidhlig (Scottish Gaelic) (2023)
Presentation / Conference Contribution
Howcroft, D. M., Lamb, W., Groundwater, A., & Gkatzia, D. (2023, September). Building a dual dataset of text-and image-grounded conversations and summarisation in Gàidhlig (Scottish Gaelic). Presented at The 16th International Natural Language Generation Conference

Gàidhlig (Scottish Gaelic; gd) is spoken by about 57k people in Scotland, but remains an under-resourced language with respect to natural language processing in general and natural language generation (NLG) in particular. To address this gap, we deve... Read More about Building a dual dataset of text-and image-grounded conversations and summarisation in Gàidhlig (Scottish Gaelic).

A Comparative Study of Assessment Metrics for Imbalanced Learning (2023)
Presentation / Conference Contribution
Farou, Z., Aharrat, M., & Horváth, T. (2023, September). A Comparative Study of Assessment Metrics for Imbalanced Learning. Presented at European Conference on Advances in Databases and Information Systems (ADBIS 2023), Barcelona, Spain

There are several machine learning algorithms addressing class imbalance problem, requiring standardized metrics for adequete performance evaluation. This paper reviews several metrics for imbalanced learning in binary and multi-class problems. We em... Read More about A Comparative Study of Assessment Metrics for Imbalanced Learning.

PMNet: A Multi-branch and Multi-scale Fusion Convolutional Neural Network for Water Body Extraction of High-resolution Remote Sensing Images (2023)
Journal Article
Liu, Q., Zhang, Z., Liu, X., Zhang, Y., & Du, Z. (in press). PMNet: A Multi-branch and Multi-scale Fusion Convolutional Neural Network for Water Body Extraction of High-resolution Remote Sensing Images. Intelligent Automation and Soft Computing,

Automatic extraction of water body information from high-resolution remote sensing images is one of the core tasks of remote sensing image interpretation. Since the complex multi-scale characteristics of high-resolution remote sensing images, it is d... Read More about PMNet: A Multi-branch and Multi-scale Fusion Convolutional Neural Network for Water Body Extraction of High-resolution Remote Sensing Images.

NCC: Neural concept compression for multilingual document recommendation (2023)
Presentation / Conference Contribution
Tashu, T. M., Lenz, M., & Horváth, T. NCC: Neural concept compression for multilingual document recommendation

In this work, we propose a novel method for generating inter-lingual document representations using neural network concept compression. The presented approach is intended to improve the quality of content-based multilingual document recommendation an... Read More about NCC: Neural concept compression for multilingual document recommendation.

Hyper-parameter initialization of classification algorithms using dynamic time warping: A perspective on PCA meta-features (2022)
Presentation / Conference Contribution
Horváth, T., Mantovani, R. G., & de Carvalho, A. C. Hyper-parameter initialization of classification algorithms using dynamic time warping: A perspective on PCA meta-features

Meta-learning, a concept from the area of automated machine learning, aims at providing decision support for data scientists by recommending a suitable setting (a machine learning algorithm or its hyper-parameters) to be used for a given dataset. Suc... Read More about Hyper-parameter initialization of classification algorithms using dynamic time warping: A perspective on PCA meta-features.