An Evolutionary based Generative Adversarial Network Inspired Approach to Defeating Metamorphic Malware

Babaagba, Kehinde O.; Wylie, Jordan

Abstract

Defeating dangerous families of malware like polymorphic and metamorphic malware have become well studied due to their increased attacks on computer systems and network. Traditional Machine Learning (ML) models have been used in detecting this malware, however they are often not resistant to future attacks. In this paper, an Evolutionary based Generative Adversarial Network (GAN) inspired approach is proposed as a step towards defeating metamorphic malware. This method uses an Evolutionary Algorithm as a generator to create malware that are designed to fool a detector, a deep learning model into classifying them as benign. We employ a personal information stealing malware family (Dougalek) as a testbed, selected based on its malicious payload and evaluate the samples generated based on their adversarial accuracy, measured based on the number of Antivirus (AV) engines they are able to fool and their ability to fool a set of ML detectors (k-Nearest Neighbors algorithm, Support Vector Machine, Decision Trees, and Multi-Layer Perceptron). The results show that the adversarial samples are on average able to fool 63% of the AV engines and the ML detectors are susceptible to the new mutants achieving an accuracy between 60%-77%.

Citation

Babaagba, K. O., & Wylie, J. (2023, July). An Evolutionary based Generative Adversarial Network Inspired Approach to Defeating Metamorphic Malware. Presented at The Genetic and Evolutionary Computation Conference (GECCO) 2023, Lisbon

• Presentation Conference Type: Conference Paper (published)
• Conference Name: The Genetic and Evolutionary Computation Conference (GECCO) 2023
• Start Date: Jul 15, 2023
• End Date: Jul 19, 2023
• Acceptance Date: May 3, 2023
• Online Publication Date: Jul 24, 2023
• Publication Date: 2023
• Deposit Date: May 17, 2023
• Publicly Available Date: Jul 24, 2023
• Publisher: Association for Computing Machinery (ACM)
• Pages: 1753-1759
• Book Title: GECCO '23 Companion: Proceedings of the Companion Conference on Genetic and Evolutionary Computation
• ISBN: 9798400701207
• DOI: https://doi.org/10.1145/3583133.3596362
• Keywords: Metamorphic Malware, Evolutionary Algorithm, Generative Adversarial Network
• Public URL: http://researchrepository.napier.ac.uk/Output/3103311