Designing and evaluation of a mixed reality system for crime scene investigation training: a hybrid approach

• Published in: Virtual reality : the journal of the Virtual Reality Society Vol. 28; no. 3; p. 127
• Main Authors: Albeedan, Meshal, Kolivanda, Hoshang, Hammady, Ramy
• Format: Journal Article
• Language: English
• Published: London Springer London 25.06.2024; Springer Nature B.V
• Subjects: Artificial Intelligence; Commercialization; Computer Graphics; Computer Science; Cost effectiveness; Crime; Crime scenes; Criminal investigations; Education; Image Processing and Computer Vision; Image reconstruction; Learning theory; Mixed reality; Negative feedback; Original Article; Photogrammetry; Police; Positive feedback; Questionnaires; Students; Three dimensional models; Training; User experience; User interfaces; User Interfaces and Human Computer Interaction; User interaction; Mixed reality; 3D scanning; User experience; Crime scene; Investigation training; Photogrammetry
• ISSN: 1434-9957; 1359-4338; 1434-9957
• DOI: 10.1007/s10055-024-01018-8

Police investigation in real-life crime scenes is an essential aspect of forensic science education. However, the practicality of bringing young investigators to actual crime scenes is often hindered by the costs and challenges involved. In order to overcome these obstacles, new technologies such as mixed reality (MR) are being explored as potential solutions. MR technology offers an interactive and cost-effective way to simulate real-life crime scenes, providing a valuable training experience for young investigators. This paper presents a novel design of a MR system using Microsoft HoloLens 2.0, which is tailored to work in a spatial 3D scanned and reconstructed crime scene using FARO point cloud 3D scanner X130 blended with photogrammetry techniques. The system was developed through the lens of Experiential Learning Theory and designed using a participatory approach, providing a cost-effective solution to help trained Kuwaiti police officers enhance their investigative skills. In order to evaluate the system’s user experience and user interaction, the Questionnaire of User Interaction Satisfaction and User Experience Questionnaire were utilised. Forty-four young police officers evaluated the system. Police students showed positive levels of satisfaction with user interaction and overall user experience with minimal negative feedback. Female students showed higher satisfaction with the overall impression compared to male students. Based on the positive feedback regarding the system expansion, the system will be taken into the commercialisation stage in the future to be provided as an essential tool for crime scene education and investigation practices.