HoloJig: Interactive Spoken Prompt Specified Generative AI Environments

Casas, Llogari; Hannah, Samantha; Mitchell, Kenny

Abstract

HoloJig offers an interactive, speech-to-VR, virtual reality experience that generates diverse environments in real-time based on live spoken descriptions. Unlike traditional VR systems that rely on pre-built assets, HoloJig dynamically creates personalized and immersive virtual spaces with depth-based parallax 3D rendering, allowing users to define the characteristics of their immersive environment through verbal prompts. This generative approach opens up new possibilities for interactive experiences, including simulations, training, collaborative workspaces, and entertainment. In addition to speech-to-VR environment generation, a key innovation of HoloJig is its progressive visual transition mechanism, which smoothly dissolves between previously generated and newly requested environments, mitigating the delay caused by neural computations. This feature ensures a seamless and continuous user experience, even as new scenes are being rendered on remote servers.

Citation

Casas, L., Hannah, S., & Mitchell, K. (online). HoloJig: Interactive Spoken Prompt Specified Generative AI Environments. IEEE Computer Graphics and Applications, https://doi.org/10.1109/mcg.2025.3553780

• Journal Article Type: Article
• Acceptance Date: Mar 18, 2025
• Online Publication Date: Mar 21, 2025
• Deposit Date: Mar 25, 2025
• Publicly Available Date: Mar 25, 2025
• Journal: IEEE Computer Graphics and Applications
• Print ISSN: 0272-1716
• Electronic ISSN: 1558-1756
• Publisher: Institute of Electrical and Electronics Engineers
• Peer Reviewed: Peer Reviewed
• DOI: https://doi.org/10.1109/mcg.2025.3553780
• Keywords: Generative AI, Virtual environments, Rendering (computer graphics), Real-time systems, Visualization, Training, Speech to text, Artificial intelligence, Three-dimensional displays, Special issues and sections
• Public URL: http://researchrepository.napier.ac.uk/Output/4185942
• External URL: https://www.llogaricasas.com/pdf/MCG20253553780.pdf