A deep learning-based worker assistance system for error prevention: Case study in a real-world manual assembly

• Published in: Advances in production engineering & management Vol. 16; no. 4; pp. 393 - 404
• Main Authors: Riedel, A., Gerlach, J., Dietsch, M., Herbst, S., Engelmann, F., Brehm, N., Pfeifroth, T.
• Format: Journal Article
• Language: English
• Published: Maribor University of Maribor, Faculty of Mechanical Engineering, Production Engineering Institute 01.12.2021
• Subjects: Architecture; Assembly; Case studies; Computer vision; Deep learning; Employees; Error analysis; Explosions; Human error; Manufacturing; Methods; Object recognition; Prevention; Product quality; Productivity; Quantitative analysis; Sensors; Task complexity; Workers
• ISSN: 1854-6250; 1855-6531
• DOI: 10.14743/apem2021.4.408

Modern assembly systems adapt to the requirements of customised and short-lived products. As assembly tasks become increasingly complex and change rapidly, the cognitive load on employees increases. This leads to the use of assistance systems for manual assembly to detect and avoid human errors and thus ensure consistent product quality. Most of these systems promise to improve the production environment but have hardly been studied quantitatively so far. Recent advances in deep learning-based computer vision have also not yet been fully exploited. This study aims to provide architectural, and implementational details of a state-of-the-art assembly assistance system based on an object detection model. The proposed architecture is intended to be representative of modern assistance systems. The error prevention potential is determined in a case study in which test subjects manually assemble a complex explosion-proof tubular lamp. The results show 51 % fewer assembly errors compared to a control group without assistance. Three of the four considered types of error classes have been reduced by at least 42 %. In particular, errors by omission are most likely to be prevented by the system. The reduction in the error rate is observed over the entire period of 30 consecutive product assemblies, comparing assisted and unassisted assembly. Furthermore, the recorded assembly data are found to be valuable regarding traceability and production improvement processes.