Safer and Efficient Factory by Predicting Worker Trajectories using Spatio-Temporal Graph Attention Networks

K, Satya Saravan Kumar; Vasantha, Gokula; Corney, Jonathan; Hanson, Jack; Quigley, John; El-Raoui, Hanane; Thompson, Nathan; Sherlock, Andrew

Abstract

Occupational accidents in manufacturing industries pose a significant risk, necessitating advanced strategies to ensure worker safety and enhance operational productivity. The unpredictable nature of worker movements, influenced by varied tasks such as material transportation, machine operation, and collaborative efforts, highlights the critical need for effective trajectory prediction mechanisms. This paper introduces an innovative approach utilizing Spatio-Temporal Graph Attention Networks (STGAT) and Spatio-Temporal Graph Convolutional Neural Networks (STGCNN) to predict worker trajectories with high accuracy and to analyze worker interactions within the manufacturing environment. Our methodology employs qualitative evaluation techniques to reveal intricate worker dynamics during assembly line processes, offering new perspectives on spatial-temporal interplays in a factory setting. By applying this method to movement data from a detailed case study involving six workers on a tribike assembly line, we demonstrate the effectiveness of our proposed algorithm in real-world scenarios. The utilization of advanced Graph Neural Network technologies allows for the precise modeling of complex spatial-temporal relationships, enabling the accurate prediction of worker paths. This research contributes significantly to the fields of occupational safety and industrial efficiency by providing a comprehensive framework for anticipating worker movements and understanding their interactions in intricate manufacturing landscapes. Moreover, it addresses existing challenges in trajectory prediction and outlines potential directions for future research, aiming to broaden the application of predictive analytics in enhancing safety protocols and operational strategies in the manufacturing sector.

Citation

K, S. S. K., Vasantha, G., Corney, J., Hanson, J., Quigley, J., El-Raoui, H., Thompson, N., & Sherlock, A. (2024, August). Safer and Efficient Factory by Predicting Worker Trajectories using Spatio-Temporal Graph Attention Networks. Presented at IDETC-CIE International Design Engineering Technical Conferences & Computers and Information in Engineering Conference, Washington, DC

• Presentation Conference Type: Conference Paper (published)
• Conference Name: IDETC-CIE International Design Engineering Technical Conferences & Computers and Information in Engineering Conference
• Start Date: Aug 25, 2024
• End Date: Aug 28, 2024
• Acceptance Date: May 7, 2024
• Online Publication Date: Nov 13, 2024
• Publication Date: 2024
• Deposit Date: May 30, 2024
• Publicly Available Date: Nov 13, 2024
• Publisher: American Society of Mechanical Engineers
• Peer Reviewed: Peer Reviewed
• Book Title: Proceedings of the IDETC-CIE 2024 International Design Engineering Technical Conferences & Computers and Information in Engineering Conference
• ISBN: 9780791888353
• DOI: https://doi.org/10.1115/DETC2024-143048
• Keywords: Human motion trajectory prediction, Graph Neural Networks, Smart factory, Engineering Informatics, Intelligent Manufacturing
• Publisher URL: https://asmedigitalcollection.asme.org/IDETC-CIE
• External URL: https://event.asme.org/IDETC-CIE