Supporting Iterative Virtual Reality Analytics Design and Evaluation by Systematic Generation of Surrogate Clustered Datasets

Tadeja, Slawomir K.; Langdon, Patrick; Kristensson, Per Ola

Abstract

Virtual Reality (VR) is a promising technology platform for immersive visual analytics. However, the design space of VR analytics interface design is vast and difficult to explore using traditional A/B comparisons in formal or informal controlled experiments-a fundamental part of an iterative design process. A key factor that complicates such comparisons is the dataset. Exposing participants to the same dataset in all conditions introduces an unavoidable learning effect. On the other hand, using different datasets for all experimental conditions introduces the dataset itself as an uncontrolled variable, which reduces internal validity to an unacceptable degree. In this paper, we propose to rectify this problem by introducing a generative process for synthesizing clustered datasets for VR analytics experiments. This process generates datasets that are distinct while simultaneously allowing systematic comparisons in experiments. A key advantage is that these datasets can then be used in iterative design processes. In a two-part experiment, we show the validity of the generative process and demonstrate how new insights in VR-based visual analytics can be gained using synthetic datasets.

Citation

Tadeja, S. K., Langdon, P., & Kristensson, P. O. (2021). Supporting Iterative Virtual Reality Analytics Design and Evaluation by Systematic Generation of Surrogate Clustered Datasets. In 2021 IEEE International Symposium on Mixed and Augmented Reality (ISMAR) (376-385). https://doi.org/10.1109/ismar52148.2021.00054

• Conference Name: 2021 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
• Conference Location: Bari, Italy
• Start Date: Oct 4, 2021
• End Date: Oct 8, 2021
• Online Publication Date: Nov 13, 2021
• Publication Date: 2021
• Deposit Date: Mar 17, 2022
• Publisher: Institute of Electrical and Electronics Engineers
• Pages: 376-385
• Series ISSN: 1554-7868
• Book Title: 2021 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)
• DOI: https://doi.org/10.1109/ismar52148.2021.00054
• Keywords: Human-centered computing, Visualization, Visualization design and evaluation methods, Human-centered computing, Visualization, Visualization application domains, Visual Analytics, Computing methodologies, Computer graphics, Graphics systems and interfaces
• Public URL: http://researchrepository.napier.ac.uk/Output/2855256