A deep learning-based worker assistance system for error prevention: Case study in a real-world manual assembly
Modern assembly systems adapt to the requirements of customised and short-lived products. As assembly tasks become increasingly complex and change rapidly, the cognitive load on employees increases. This leads to the use of assistance systems for manual assembly to detect and avoid human errors and...
Saved in:
Published in | Advances in production engineering & management Vol. 16; no. 4; pp. 393 - 404 |
---|---|
Main Authors | , , , , , , |
Format | Journal Article |
Language | English |
Published |
Maribor
University of Maribor, Faculty of Mechanical Engineering, Production Engineering Institute
01.12.2021
|
Subjects | |
Online Access | Get full text |
Cover
Loading…
Abstract | Modern assembly systems adapt to the requirements of customised and short-lived products. As assembly tasks become increasingly complex and change rapidly, the cognitive load on employees increases. This leads to the use of assistance systems for manual assembly to detect and avoid human errors and thus ensure consistent product quality. Most of these systems promise to improve the production environment but have hardly been studied quantitatively so far. Recent advances in deep learning-based computer vision have also not yet been fully exploited. This study aims to provide architectural, and implementational details of a state-of-the-art assembly assistance system based on an object detection model. The proposed architecture is intended to be representative of modern assistance systems. The error prevention potential is determined in a case study in which test subjects manually assemble a complex explosion-proof tubular lamp. The results show 51 % fewer assembly errors compared to a control group without assistance. Three of the four considered types of error classes have been reduced by at least 42 %. In particular, errors by omission are most likely to be prevented by the system. The reduction in the error rate is observed over the entire period of 30 consecutive product assemblies, comparing assisted and unassisted assembly. Furthermore, the recorded assembly data are found to be valuable regarding traceability and production improvement processes. |
---|---|
AbstractList | Modern assembly systems adapt to the requirements of customised and short-lived products. As assembly tasks become increasingly complex and change rapidly, the cognitive load on employees increases. This leads to the use of assistance systems for manual assembly to detect and avoid human errors and thus ensure consistent product quality. Most of these systems promise to improve the production environment but have hardly been studied quantitatively so far. Recent advances in deep learning-based computer vision have also not yet been fully exploited. This study aims to provide architectural, and implementational details of a state-of-the-art assembly assistance system based on an object detection model. The proposed architecture is intended to be representative of modern assistance systems. The error prevention potential is determined in a case study in which test subjects manually assemble a complex explosion-proof tubular lamp. The results show 51 % fewer assembly errors compared to a control group without assistance. Three of the four considered types of error classes have been reduced by at least 42 %. In particular, errors by omission are most likely to be prevented by the system. The reduction in the error rate is observed over the entire period of 30 consecutive product assemblies, comparing assisted and unassisted assembly. Furthermore, the recorded assembly data are found to be valuable regarding traceability and production improvement processes. |
Author | Brehm, N. Riedel, A. Engelmann, F. Dietsch, M. Herbst, S. Pfeifroth, T. Gerlach, J. |
Author_xml | – sequence: 1 givenname: A. surname: Riedel fullname: Riedel, A. – sequence: 2 givenname: J. surname: Gerlach fullname: Gerlach, J. – sequence: 3 givenname: M. surname: Dietsch fullname: Dietsch, M. – sequence: 4 givenname: S. surname: Herbst fullname: Herbst, S. – sequence: 5 givenname: F. surname: Engelmann fullname: Engelmann, F. – sequence: 6 givenname: N. surname: Brehm fullname: Brehm, N. – sequence: 7 givenname: T. surname: Pfeifroth fullname: Pfeifroth, T. |
BookMark | eNo1kM1PwzAMxSM0JMbYmWskzt3y4aYtt2niS5rEBc5R2rqo0CYlaUH97wkbXGzLen5P_l2ShXUWCbnmbMMhA7k1A_aCCb6BDbD8jCx5nqaJSiVfHGdIlEjZBVmH0JYM4h4KKZbE7WiNONAOjbetfUtKE7Cm385_oKcmqsNobIU0zGHEnjbOU_Q-1sHjF9qxdfaW7uMRDeNUz7S11FCPpkuiR1fT3tjJdL9O2JfdfEXOG9MFXP_1FXm9v3vZPyaH54en_e6QVJKzMSkqkEyIssw4KKPqtIEGRCagwEoqwXgNuYGCM5nWeVkoKblhWMWfS26ynMsVuTn5Dt59ThhG_e4mb2OkFoqrvADBIaq2J1XlXQgeGz34tjd-1pzpI1j9D1aDjmDlDzk_bb0 |
CitedBy_id | crossref_primary_10_1155_2022_8559153 crossref_primary_10_1007_s00170_023_12506_7 crossref_primary_10_1109_ACCESS_2023_3340310 crossref_primary_10_1155_2022_1381464 crossref_primary_10_1080_09544828_2023_2290925 crossref_primary_10_1155_2022_3915467 |
ContentType | Journal Article |
Copyright | Copyright University of Maribor, Faculty of Mechanical Engineering, Production Engineering Institute Dec 2021 |
Copyright_xml | – notice: Copyright University of Maribor, Faculty of Mechanical Engineering, Production Engineering Institute Dec 2021 |
DBID | AAYXX CITATION 7TA 7TB 8FD 8FE 8FG ABJCF ABUWG AFKRA BENPR BGLVJ BYOGL CCPQU DWQXO FR3 HCIFZ JG9 L6V M7S PQEST PQQKQ PQUKI PRINS PTHSS |
DOI | 10.14743/apem2021.4.408 |
DatabaseName | CrossRef Materials Business File Mechanical & Transportation Engineering Abstracts Technology Research Database ProQuest SciTech Collection ProQuest Technology Collection Materials Science & Engineering Collection ProQuest Central (Alumni) ProQuest Central UK/Ireland AUTh Library subscriptions: ProQuest Central Technology Collection East Europe, Central Europe Database ProQuest One Community College ProQuest Central Engineering Research Database SciTech Premium Collection Materials Research Database ProQuest Engineering Collection Engineering Database ProQuest One Academic Eastern Edition (DO NOT USE) ProQuest One Academic ProQuest One Academic UKI Edition ProQuest Central China Engineering Collection |
DatabaseTitle | CrossRef Materials Research Database Engineering Database Technology Collection Technology Research Database Mechanical & Transportation Engineering Abstracts ProQuest One Academic Eastern Edition East Europe, Central Europe Database ProQuest Central (Alumni Edition) SciTech Premium Collection ProQuest One Community College ProQuest Technology Collection ProQuest SciTech Collection ProQuest Central China Materials Business File ProQuest Central ProQuest Engineering Collection ProQuest One Academic UKI Edition ProQuest Central Korea Materials Science & Engineering Collection Engineering Research Database ProQuest One Academic Engineering Collection |
DatabaseTitleList | CrossRef Materials Research Database |
Database_xml | – sequence: 1 dbid: 8FG name: ProQuest Technology Collection url: https://search.proquest.com/technologycollection1 sourceTypes: Aggregation Database |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Engineering Architecture |
EISSN | 1855-6531 |
EndPage | 404 |
ExternalDocumentID | 10_14743_apem2021_4_408 |
GroupedDBID | 3V. 8FE 8FG AAYXX ABDBF ABJCF ABUWG ACIWK AFKRA ALMA_UNASSIGNED_HOLDINGS BENPR BGLVJ BPHCQ BYOGL CCPQU CITATION ESX FRP HCIFZ I-F L6V M7S MK~ PQQKQ PROAC PTHSS TUS 7TA 7TB 8FD DWQXO FR3 JG9 PQEST PQUKI PRINS |
ID | FETCH-LOGICAL-c310t-9c43022bb7146a6d5f4f427249ec36201d48a491035d8b96331a0ec855b1a7813 |
IEDL.DBID | 8FG |
ISSN | 1854-6250 |
IngestDate | Thu Oct 10 17:58:41 EDT 2024 Fri Aug 23 02:28:36 EDT 2024 |
IsDoiOpenAccess | false |
IsOpenAccess | true |
IsPeerReviewed | true |
IsScholarly | true |
Issue | 4 |
Language | English |
LinkModel | DirectLink |
MergedId | FETCHMERGED-LOGICAL-c310t-9c43022bb7146a6d5f4f427249ec36201d48a491035d8b96331a0ec855b1a7813 |
OpenAccessLink | https://apem-journal.org/Archives/2021/Abstract-APEM16-4_393-404.pdf |
PQID | 2616894214 |
PQPubID | 1466335 |
PageCount | 12 |
ParticipantIDs | proquest_journals_2616894214 crossref_primary_10_14743_apem2021_4_408 |
PublicationCentury | 2000 |
PublicationDate | 2021-12-01 |
PublicationDateYYYYMMDD | 2021-12-01 |
PublicationDate_xml | – month: 12 year: 2021 text: 2021-12-01 day: 01 |
PublicationDecade | 2020 |
PublicationPlace | Maribor |
PublicationPlace_xml | – name: Maribor |
PublicationTitle | Advances in production engineering & management |
PublicationYear | 2021 |
Publisher | University of Maribor, Faculty of Mechanical Engineering, Production Engineering Institute |
Publisher_xml | – name: University of Maribor, Faculty of Mechanical Engineering, Production Engineering Institute |
SSID | ssib045314932 ssj0000329383 ssib003134525 |
Score | 2.3117886 |
Snippet | Modern assembly systems adapt to the requirements of customised and short-lived products. As assembly tasks become increasingly complex and change rapidly, the... |
SourceID | proquest crossref |
SourceType | Aggregation Database |
StartPage | 393 |
SubjectTerms | Architecture Assembly Case studies Computer vision Deep learning Employees Error analysis Explosions Human error Manufacturing Methods Object recognition Prevention Product quality Productivity Quantitative analysis Sensors Task complexity Workers |
Title | A deep learning-based worker assistance system for error prevention: Case study in a real-world manual assembly |
URI | https://www.proquest.com/docview/2616894214 |
Volume | 16 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1LS8QwEA4-LiqIT3yTgwcv0T6mLy-yiqsIioiCt5KkExF2u3VdD_57Z7oprhcvhVKSw3Qy3zdJ5hshjl1hXJAgqsxxC7MAA2U0FsoaiEzorEsdJ4r3D-ntC9y9Jq9-w-3TX6vsYmIbqKuR5T3yM2L6aV5AFMJF86G4axSfrvoWGvNiMWQlPK4U79_M-GvMx3bdO5C_QeHrKNtIHRPYtUqdhFqgKBUIvPoPELCe6QaHEWHgKZwCt5-cBa6_cbsFo_6aWPUsUvamv31dzGG9IVZ6M4cCG2J5RmpwU4x6skJspO8S8aYYvirJ17JwLIlBM48kB5BTaWdJXFbieEzPxos8jepzeUWDZKtIK99rqSUxzoFqRVflULO4Kc-EQzP43hIv_evnq1vlmy0oSwxvogoLMeG5MRnFTp1WiQMHUUbZGVoCuSCsINdA5CJOqtzQso1DHaDNk8SEOsvDeFss1KMad7gMXBNvQIzBReBogSdZgHGUW1ekLrB2V5x0liybqaZGybkIG73sjF5CSUbfFQedpUu_uD7LX1fY-__zvljiqaa3Tw7EwmT8hYfEISbmqHWUI7F4ef3w-PQDCwPD3w |
link.rule.ids | 315,786,790,12792,21416,27955,27956,33406,33777,43633,43838,74390,74657 |
linkProvider | ProQuest |
linkToHtml | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1LT9wwELZgOQCVKh5FQCn4wIGLIY_Jqxe0RaDltUIIJG6R7YwREpsNy3Lg33cm64jtpZdIUWQfJuP5vrHH3whx6ArjggRRZY5bmAUYKKOxUNZAZEJnXeo4UbwdpoNHuHpKnvyG27svq-xiYhuoq7HlPfITYvppXkAUwmnzprhrFJ-u-hYai2KJJTfznlj6cz68u5_z2JgP7rp3II-Dwt-kbGN1THDXanUSboGiZCDw-j9A0HqiGxxFhILHcAzcgHIeuv6N3C0cXayJ755Hyv7sx6-LBaw3xLf-3LHAhlidExvcFOO-rBAb6ftEPCsGsEpyYRZOJHFoZpLkAnIm7iyJzUqcTOjZeJmncf1bntEg2WrSypdaakmc81W1sqtypFnelGfCkXn9_CEeL84fzgbKt1tQljjeVBUWYkJ0YzKKnjqtEgcOoozyM7QEc0FYQa6B6EWcVLmhhRuHOkCbJ4kJdZaH8Zbo1eMat_kiuCbmgBiDi8DREk-yAOMot65IXWDtjjjqLFk2M1WNkrMRNnrZGb2Ekoy-I_Y6S5d-eb2XX86w-__PB2J58HB7U95cDq9_ihWedlaLsid608kH_iJGMTX73m3-AqOkxpw |
linkToPdf | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwfV1Nb9NAEF3RICGKhCAFNbSFPXDoZRN_jL-4VFFpSAuNOLRSbtbuehZVShw3TQ_998w4axEuvViyLO9h9HbeG-_4jRBfXWFckCCqzPEIswADZTQWyhqITOisSx0XitezdHoLV_Nk7vufHnxbZZcT20RdrSx_Ix-R0k_zAqIQRs63Rfz-Pjlr7hVPkOKTVj9OY0-8ZJHNYxzyyY8d7MZ8hNfdA2EPCv9PZZu1YyK-1rWTGAwUlQWBdwICWm6kG1xGxIdDGAKPotwlsf9zeEtMk3firVeUcryFwHvxAuu-eDPeOSDoi_0d28EDsRrLCrGRfmLEH8VUVklu0cK1JDXNmpLAILc2z5J0rcT1mq6NN3xa1d_kOb0kW3daeVdLLUl9LlRrwCqXmo1OeSVcmsXTB3E7ubg5nyo_eEFZUnsbVViIiduNySiP6rRKHDiIMqrU0BLhBWEFuQYSGnFS5Ya2cBzqAG2eJCbUWR7GH0WvXtV4yL-Ea9IQiDG4CBxt9iQLMI5y64rUBdYOxGkXybLZ-muUXJdw0Msu6CWUFPSBOO4iXfqN9lD-g8Wn5x9_Ea8IL-Wvy9nPI_GaV902pRyL3mb9iCckLTbmc4uZv3xwyWI |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=A+deep+learning-based+worker+assistance+system+for+error+prevention%3A+Case+study+in+a+real-world+manual+assembly&rft.jtitle=Advances+in+production+engineering+%26+management&rft.au=Riedel%2C+A.&rft.au=Gerlach%2C+J.&rft.au=Dietsch%2C+M.&rft.au=Herbst%2C+S.&rft.date=2021-12-01&rft.issn=1854-6250&rft.eissn=1855-6531&rft.volume=16&rft.issue=4&rft.spage=393&rft.epage=404&rft_id=info:doi/10.14743%2Fapem2021.4.408&rft.externalDBID=n%2Fa&rft.externalDocID=10_14743_apem2021_4_408 |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1854-6250&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1854-6250&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1854-6250&client=summon |