Learning from Collaborative Storytelling: Enhancing Visual Scene Understanding through Human-Robot Interaction

Project Description

The research project aims to revolutionise how robots comprehend and interact with the physical world by combining advanced techniques in video analysis, knowledge acquisition, and collaborative storytelling. In recent years, there has been a growing emphasis on connecting language and the physical environment to improve robots' understanding of human activities. However, providing robots with complete knowledge of a new environment remains a significant challenge. This project seeks to address this challenge through a collaborative storytelling approach. To tackle this challenge, the project is developing a framework wherein robots and humans collaborate in a storytelling task.