Duration: 01.01.2022-31.12.2023

Goals: Multi-criteria evaluation of extended reality (XR) applications with a focus on sustainable technology use

As part of the project, TU Wien evaluated the use cases developed at the participating companies and conducted a study for a representative use case. A web-based tool was developed for the evaluation, which can also be used independently by the companies after the project. A workshop was held to familiarise interested company representatives with the use of the tool. A manual also supports the independent use of the tool. In addition, another tool was developed in Excel for the RoI calculation and a guide for changing the general training setting to virtual reality (VR) was created at the request of the company partners.

 

Results:

The requirements and expectations for a multi-criteria evaluation model of the company partners were recorded at the start of the project. On this basis, the existing evaluation model was expanded to include company-specific criteria. Due to the large number of different use cases and the resulting diverse requirements, the model was structured on a modular basis. The companies can choose from the criteria to be evaluated and weight them as required. The following figure shows the criteria, the importance rated by the companies and the assignment to the use cases (Holly et al., 2022):

Eight of the use cases were tested and evaluated with the company partners on site in the application area. Depending on requirements, a quantitative and/or qualitative evaluation was carried out. All evaluation results were made available to the companies.

In addition to the use cases evaluated by TU Wien, an evaluation tool was developed for the independent evaluation of XR use cases. The requirements of the company partners for an evaluation tool were recorded. As part of a dissertation workshop, the tool was introduced to the company partners for independent use. In addition to the web-based evaluation tool, a RoI tool for determining the return on investment was developed and made available, as was a guide for the introduction of VR training.

 

IMPACT-sXR

Overview of the multi-criteria IMPACT-sXR evaluation model.

Publications

  • Zigart, T., Stürzl, F., Niedermayr, D., Wolfartsberger, J. (2023). Comparative Evaluation of Virtual Reality and In-Person Onboarding for Assembly Trainings in Manufacturing, 22nd IEEE International Symposium on Mixed and Augmented Reality Adjunct (ISMAR), 10.1109/ISMAR-Adjunct60411.2023.00041
  • Zigart, T. (2022). Entwicklung eines multikriteriellen Evaluierungsmodells für industrielle Assistenzsysteme, Dissertation, TU Wien
  • Holly, F.,  Zigart, T., Maurer, M., Wolfartsberger, J., Brunnhofer, M., Sorko, S. R., Moser, T., Schlager, A. (2022), Gaining Impact with Mixed Reality in Industry – A Sustainable Approach, 8th International Conference on Computer Technology Applications, ICCTA 2022

 

Prototype application: The RoI tool is available for use by corporate partners. If you are interested, please contact Prof. Sebastian Schlund.