Research on the Applicability of Touchscreens in Manned/Unmanned Aerial Vehicle Cooperative Missions

• Published in: Sensors (Basel, Switzerland) Vol. 22; no. 21; p. 8435
• Main Authors: Xue, Hongjun, Zhang, Qingpeng, Zhang, Xiaoyan
• Format: Journal Article
• Language: English
• Published: Basel MDPI AG 01.11.2022; MDPI
• Subjects: Aircraft; Aviation; Decision making; Design; Experiments; Interactive computer systems; manned/unmanned; perceived workload; Pilots; Surveillance; task difficulty; time pressure; touchscreen; Unmanned aerial vehicles; Workloads
• ISSN: 1424-8220; 1424-8220
• DOI: 10.3390/s22218435

The suitability of touchscreens for human–computer interaction in manned/unmanned aerial vehicle cooperative missions remains uncertain, especially in situations that are time-sensitive with variations in difficulty levels. The purpose of this study is to determine the feasibility of touchscreen applications in manned/unmanned aerial vehicle cooperative missions and the magnitude of the effects of time pressure and task difficulty. In contrast to previous studies, a combination of performance and perceptual load measures was used to divide errors into disposition errors, undetected errors, and miscalculation errors to explore specific error mechanisms, set up typical manned/unmanned aerial vehicle cooperative human–computer interaction tasks, and set up antecedent features for potential factors. Thirty subjects participated in an experiment that required the use of touchscreens or keyboards to perform a human–computer interaction task in a simulated manned/unmanned aerial vehicle cooperative mission. Experiments were set at three task difficulties: low, medium, and high, and were matched to a set time pressure or no time pressure for two seconds for low difficulty, three seconds for medium difficulty, and four seconds for high difficulty. The results showed that the touchscreens improved the participants’ response speed at a time pressure of 2 s or less compared with the use of a general input device; however, the task error rate also increased significantly. The higher the task difficulty was, the worse the performance was and the greater the perceived workload of the participants. The application of touchscreens in dynamic environments subjected the participants to greater physical demands. The performance of participants using a keyboard was no better than that when touchscreens were used during the experiment. Moreover, touchscreens did not significantly improve participant performance. The results support the possibility of using touchscreens in manned/unmanned aerial vehicle cooperative missions.