Antreas Konstantinou
Leveraging LLMs for Non-Security Experts in Threat Hunting: Detecting Living off the Land Techniques
Konstantinou, Antreas; Kasimatis, Dimitrios; Buchanan, William J.; Ullah Jan, Sana; Ahmad, Jawad; Politis, Ilias; Pitropakis, Nikolaos
Authors
Dimitrios Kasimatis
Prof Bill Buchanan B.Buchanan@napier.ac.uk
Professor
Dr Sanaullah Jan S.Jan@napier.ac.uk
Lecturer
Dr Jawad Ahmad J.Ahmad@napier.ac.uk
Visiting Lecturer
Ilias Politis
Dr Nick Pitropakis N.Pitropakis@napier.ac.uk
Associate Professor
Abstract
This paper explores the potential use of Large Language Models (LLMs), such as ChatGPT, Google Gemini, and Microsoft Copilot, in threat hunting, specifically focusing on Living off the Land (LotL) techniques. LotL methods allow threat actors to blend into regular network activity, which makes detection by automated security systems challenging. The study seeks to determine whether LLMs can reliably generate effective queries for security tools, enabling organisations with limited budgets and expertise to conduct threat hunting. A testing environment was created to simulate LotL techniques, and LLM-generated queries were used to identify malicious activity. The results demonstrate that LLMs do not consistently produce accurate or reliable queries for detecting these techniques, particularly for users with varying skill levels. However, while LLMs may not be suitable as standalone tools for threat hunting, they can still serve as supportive resources within a broader security strategy. These findings suggest that, although LLMs offer potential, they should not be relied upon for accurate results in threat detection and require further refinement to be effectively integrated into cybersecurity workflows.
Citation
Konstantinou, A., Kasimatis, D., Buchanan, W. J., Ullah Jan, S., Ahmad, J., Politis, I., & Pitropakis, N. (2025). Leveraging LLMs for Non-Security Experts in Threat Hunting: Detecting Living off the Land Techniques. Machine Learning and Knowledge Extraction, 7(2), Article 31. https://doi.org/10.3390/make7020031
Journal Article Type | Article |
---|---|
Acceptance Date | Mar 23, 2025 |
Online Publication Date | Mar 30, 2025 |
Publication Date | 2025 |
Deposit Date | Mar 30, 2025 |
Publicly Available Date | Mar 31, 2025 |
Journal | Machine Learning and Knowledge Extraction |
Print ISSN | 2504-4990 |
Publisher | MDPI |
Peer Reviewed | Peer Reviewed |
Volume | 7 |
Issue | 2 |
Article Number | 31 |
DOI | https://doi.org/10.3390/make7020031 |
Keywords | LLMs; artificial intelligence; threat hunting; security automation |
Public URL | http://researchrepository.napier.ac.uk/Output/4191811 |
Publisher URL | https://www.mdpi.com/2504-4990/7/2/31 |
Build resilient infrastructure, promote inclusive and sustainable industrialisation and foster innovation
Files
Leveraging LLMs for Non-Security Experts in Threat Hunting: Detecting Living off the Land Techniques
(1.2 Mb)
PDF
You might also like
DID:RING: Ring Signatures Using Decentralised Identifiers For Privacy-Aware Identity Proof
(2024)
Presentation / Conference Contribution
Transforming EU Governance: The Digital Integration Through EBSI and GLASS
(2024)
Presentation / Conference Contribution
Securing IoT: Mitigating Sybil Flood Attacks with Bloom Filters and Hash Chains
(2024)
Journal Article