Hand Symbol Classification for Human-Computer Interaction Using the Fifth Version of YOLO Object Detection
Human-Computer Interaction (HCI) nowadays mostly uses physical contact, such as people using the mouse to choose something in an application. However, there are certain problems that people face in using conventional HCI. The research tries to overcome some problems when people use conventional HCI...
Saved in:
Published in | CommIT (Communication and Information Technology) Journal Vol. 17; no. 1; pp. 43 - 50 |
---|---|
Main Authors | , |
Format | Journal Article |
Language | English |
Published |
17.03.2023
|
Online Access | Get full text |
Cover
Loading…
Abstract | Human-Computer Interaction (HCI) nowadays mostly uses physical contact, such as people using the mouse to choose something in an application. However, there are certain problems that people face in using conventional HCI. The research tries to overcome some problems when people use conventional HCI using the computer vision method. The research focuses on creating and evaluating the object detection model for classifying hand symbols. The research applies the fifth version of YOLO with the architecture of YOLOv5m to classify hand symbols in real time. The methods are divided into three steps. Those steps are dataset creation consisting of 100 images in each class, training phase, and performance evaluation of the model. The hand gesture classes made in the research are ‘ok’, ‘cancel’, ‘previous’, ‘next’, and ‘confirm’, the dataset is made by the researchers custom. After the training phase, the validation results show 93% for accuracy, 99% for precision, 100% for recall, and 99% for F1 score. Meanwhile, in real-time detection, the performance of the model for classifying hand symbols is 80% for accuracy, 95% for precision, 84% for recall, and 89% for F1 score. Although there are differences, it still acceptable for the research and can be improved in future research. |
---|---|
AbstractList | Human-Computer Interaction (HCI) nowadays mostly uses physical contact, such as people using the mouse to choose something in an application. However, there are certain problems that people face in using conventional HCI. The research tries to overcome some problems when people use conventional HCI using the computer vision method. The research focuses on creating and evaluating the object detection model for classifying hand symbols. The research applies the fifth version of YOLO with the architecture of YOLOv5m to classify hand symbols in real time. The methods are divided into three steps. Those steps are dataset creation consisting of 100 images in each class, training phase, and performance evaluation of the model. The hand gesture classes made in the research are ‘ok’, ‘cancel’, ‘previous’, ‘next’, and ‘confirm’, the dataset is made by the researchers custom. After the training phase, the validation results show 93% for accuracy, 99% for precision, 100% for recall, and 99% for F1 score. Meanwhile, in real-time detection, the performance of the model for classifying hand symbols is 80% for accuracy, 95% for precision, 84% for recall, and 89% for F1 score. Although there are differences, it still acceptable for the research and can be improved in future research. |
Author | Wibowo, Sugiarto Sugiarto, Indar |
Author_xml | – sequence: 1 givenname: Sugiarto surname: Wibowo fullname: Wibowo, Sugiarto – sequence: 2 givenname: Indar surname: Sugiarto fullname: Sugiarto, Indar |
BookMark | eNotkEFPwkAUhDcGExH5A572DxTf225pezQoQkLSg2LiqXm73ZUltEu6iwn_XileZpKZzBy-ezbqfGcYe0SYCcxQPGnfti7OfjB3OCsyATdsLOQckhwQRmyMZV4mQhbyjk1D2AMAlgIkpmO2X1HX8Pdzq_yBLw4UgrNOU3S-49b3fHVqqUsWvj2eoun5uvtT0kO9Da775nFn-NLZuOOfpg-X3Fv-VW0qXqm90ZG_mGiGwQO7tXQIZvrvE7Zdvn4sVsmmelsvnjeJRkxjgop0I-aqyDNqLGWyyItSq7JUWaZJgipIpAiZ1Y2FNAWShHMlqRC5gQZlOmHi-qt7H0JvbH3sXUv9uUaoB2D1FVg9AKsvwNJfZAtjqA |
ContentType | Journal Article |
DBID | AAYXX CITATION |
DOI | 10.21512/commit.v17i1.8520 |
DatabaseName | CrossRef |
DatabaseTitle | CrossRef |
DatabaseTitleList | CrossRef |
DeliveryMethod | fulltext_linktorsrc |
Discipline | Engineering |
EISSN | 2460-7010 |
EndPage | 50 |
ExternalDocumentID | 10_21512_commit_v17i1_8520 |
GroupedDBID | 5VS AAYXX ADBBV ALMA_UNASSIGNED_HOLDINGS BCNDV CITATION GROUPED_DOAJ OK1 |
ID | FETCH-LOGICAL-c113t-1bacd26b875adfa548789cb99b55ca40b8a23105fcdf0330a4a16b4a827e0d143 |
ISSN | 1979-2484 |
IngestDate | Fri Aug 23 01:14:46 EDT 2024 |
IsPeerReviewed | true |
IsScholarly | true |
Issue | 1 |
Language | English |
LinkModel | OpenURL |
MergedId | FETCHMERGED-LOGICAL-c113t-1bacd26b875adfa548789cb99b55ca40b8a23105fcdf0330a4a16b4a827e0d143 |
PageCount | 8 |
ParticipantIDs | crossref_primary_10_21512_commit_v17i1_8520 |
PublicationCentury | 2000 |
PublicationDate | 2023-03-17 |
PublicationDateYYYYMMDD | 2023-03-17 |
PublicationDate_xml | – month: 03 year: 2023 text: 2023-03-17 day: 17 |
PublicationDecade | 2020 |
PublicationTitle | CommIT (Communication and Information Technology) Journal |
PublicationYear | 2023 |
SSID | ssj0001920413 ssib044733333 |
Score | 2.2688432 |
Snippet | Human-Computer Interaction (HCI) nowadays mostly uses physical contact, such as people using the mouse to choose something in an application. However, there... |
SourceID | crossref |
SourceType | Aggregation Database |
StartPage | 43 |
Title | Hand Symbol Classification for Human-Computer Interaction Using the Fifth Version of YOLO Object Detection |
Volume | 17 |
hasFullText | 1 |
inHoldings | 1 |
isFullTextHit | |
isPrint | |
link | http://utb.summon.serialssolutions.com/2.0.0/link/0/eLvHCXMwnV1Lb9QwELaWcoFDxVO85QO3VRbHcez4iBDVUgF72UrlFNlOAovoBlWpKvgf_F_GHm_itiBR9hBtrGgU5_s0nhnPeAh5KUAtMmd01skKHBSwKTKjqi5zZWNK5azKw_HFHz7K5ZE4PC6PZ7NfSdbS2WAX7ucf60r-B1UYA1x9lew1kB2FwgD8B3zhCgjD9Z8wXoa8yx8ntv-G3S193s-UPRgC9NmubwMG_2JrcMwU8EbnwaYbvsxj2Mybjp9W71fzlfXxGdBGQ0jV2qY2rK8pebcO279pdUnMLB6rIZOovQ89HCYTCnEe25_3mBf0eQNz66ftKbxH7dWY0zQwwQufmYV1mFGXauU3b7AD3KINY1xIlikWM1l3ClhdIRpqUzzAKa7LeD7tZY0fLBbACUA82YDEXG3yRVVyNq1vuz39S8vemIwIblCQUqOMOsiovYwb5CZXulSJpw5qSghV-N8UytOcidCIe5wylmcFsa-uvFpiAiW2zPoO2Y9Q0NfIqLtk1m7vkdvJ0ZT3yVfPLYrcohe5RQFiepFbNOEWDdyiwC0auEUjt2jfUc8tityiI7cekKODt-s3yyz25chcnhdDllvjGi4tuLqm6Yz3eSvtrNa2LJ0RzFbGew1l55qOFQUzwuTSClNx1bIGDPSHZG_bb9tHhFrWgIlv4etxI6TWpnWSOwniwHMQTj4m892nqr_j8Sv13_F6cq2nn5JbE22fkb3h9Kx9DhbmYF8EvH8DoVx-LA |
link.rule.ids | 315,786,790,870,27957,27958 |
linkProvider | Directory of Open Access Journals |
openUrl | ctx_ver=Z39.88-2004&ctx_enc=info%3Aofi%2Fenc%3AUTF-8&rfr_id=info%3Asid%2Fsummon.serialssolutions.com&rft_val_fmt=info%3Aofi%2Ffmt%3Akev%3Amtx%3Ajournal&rft.genre=article&rft.atitle=Hand+Symbol+Classification+for+Human-Computer+Interaction+Using+the+Fifth+Version+of+YOLO+Object+Detection&rft.jtitle=CommIT+%28Communication+and+Information+Technology%29+Journal&rft.au=Wibowo%2C+Sugiarto&rft.au=Sugiarto%2C+Indar&rft.date=2023-03-17&rft.issn=1979-2484&rft.eissn=2460-7010&rft.volume=17&rft.issue=1&rft.spage=43&rft.epage=50&rft_id=info:doi/10.21512%2Fcommit.v17i1.8520&rft.externalDBID=n%2Fa&rft.externalDocID=10_21512_commit_v17i1_8520 |
thumbnail_l | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/lc.gif&issn=1979-2484&client=summon |
thumbnail_m | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/mc.gif&issn=1979-2484&client=summon |
thumbnail_s | http://covers-cdn.summon.serialssolutions.com/index.aspx?isbn=/sc.gif&issn=1979-2484&client=summon |