Building Segmentation Based Human-Friendly Human Interaction Proofs (HIPs)

• Published in: Human Interactive Proofs pp. 1 - 26
• Main Authors: Chellapilla, Kumar, Larson, Kevin, Simard, Patrice Y., Czerwinski, Mary
• Format: Book Chapter Conference Proceeding
• Language: English
• Published: Berlin, Heidelberg Springer Berlin Heidelberg 2005; Springer
• Series: Lecture Notes in Computer Science
• Subjects: Applied sciences; Baseline Setting; Computer science; control theory; systems; Convolutional Neural Network; Exact sciences and technology; High Accuracy Rate; Memory and file management (including protection and security); Memory organisation. Data processing; Optical Character Recognition; Software; User Study; Segmentation; Image processing; Electronic trade; Internet; Pattern recognition; Character recognition; Clutter; Artificial intelligence; Computer security; Message authentication; Computer attack
• ISBN: 9783540260011; 3540260013
• ISSN: 0302-9743; 1611-3349
• DOI: 10.1007/11427896_1

Human interaction proofs (HIPs) have become common place on the internet due to their effectiveness in deterring automated abuse of online services intended for humans. However, there is a co-evolutionary arms race in progress and these proofs are becoming more difficult for genuine users while attackers are getting better at breaking existing HIPs. We studied various popular HIPs on the internet to understand their strength and human friendliness. To determine HIP strength, we adopted a direct approach of building computer attacks using image processing and machine learning techniques. To understand human-friendliness, a sequence of users studies were conducted to investigate HIP character recognition by humans under a variety of visual distortions and clutter commonly employed in reading-based HIPs. We found that many of the online HIPs are pure recognition tasks that can be easily broken using machine learning. The stronger HIPs tend to pose a combination of segmentation and recognition challenges. Further, the HIP user studies show that given correct segmentation, computers are much better at HIP character recognition than humans. In light of these results, we propose that segmentation-based reading challenges are the future for building stronger human-friendly HIPs. An example of such a segmentation-based HIP is presented with a preliminary assessment of its strength and human-friendliness.