Hearthstone Helper - Using Optical Character Recognition Techniques for Cards Detection

• Published in: Artificial Intelligence: Methodology, Systems, and Applications Vol. 9883; pp. 192 - 201
• Main Authors: Chiru, Costin-Gabriel, Oprea, Florin
• Format: Book Chapter
• Language: English
• Published: Switzerland Springer International Publishing AG 2016; Springer International Publishing
• Series: Lecture Notes in Computer Science
• Subjects: Artificial intelligence; Cards logger; Hearthstone game; Histogram; Image recognition; Key point matching; Optical character recognition
• ISBN: 3319447475; 9783319447476
• ISSN: 0302-9743; 1611-3349
• DOI: 10.1007/978-3-319-44748-3_19

In this paper we address the problem of capturing, processing and analyzing images from the video stream of the Hearthstone game in order to obtain relevant information on the conduct of parties in this game. Since the information needs to be presented to the user in real-time, we needed to find the most suitable methods of extracting this information. Therefore, techniques such as background subtraction, histograms comparisons, key points matching, optical character recognition were investigated. Driven by the required processing speed, we ended up using optical character recognition on limited areas of interest from the captured image. After developing the application, we tested it in real-world context, while real games were played and presented the obtained results. In the end, we also provided two examples where the application would prove useful for better decision making during the game.