about_customblogCreated with Sketch.blog_customclosedocumentelieCreated with Sketch.menuphotos_custompublications_customsearch_newsmiletoolsvideos_custom
close-normalfacebookgoogleinstagramlinkedinlocationmailredditCreated with Sketch.tagtwitteryoutube

How Good are Humans at Solving CAPTCHAs A Large Scale Evaluation

Captchas are designed to be easy for humans but hard for machines. However, most recent research has focused only on making them hard for machines. In this paper, we present what is to the best of our knowledge the first large scale evaluation of captchas from the human perspective, with the goal of assessing how much friction captchas present to the average user. For the purpose of this study we have asked workers from Amazon's Mechanical Turk and an underground captcha-breaking service to solve more than 318 000 captchas issued from the 21 most popular captcha schemes (13 images schemes and 8 audio scheme). Analysis of the resulting data reveals that captchas are often difficult for humans, with audio captchas being particularly problematic. We also find some demographic trends indicating, for example, that non-native speakers of English are slower in general and less accurate on English-centric captcha schemes. Evidence from a week's worth of eBay captchas (14,000,000 samples) suggests that the solving accuracies found in our study are close to real-world values, and that improving audio captchas should become a priority, as nearly 1% of all captchas are delivered as audio rather than images. Finally our study also reveals that it is more effective for an attacker to use Mechanical Turk to solve captchas than an underground service.

Security and Privacy 2010
captcha - study - web security - data mining

Discuss this paper on your favorite social network.

Recent

Keep in touch with Elie's blog

Enter your email to receive new blog posts in your inbox

Elie Bursztein © 2015
Papers
Blog
Tools
Photos
About Me

Recent entries