IEEE Access (Jan 2024)

Image CAPTCHAs: When Deep Learning Breaks the Mold

  • Morteza Moradi,
  • Mohammad Moradi,
  • Simone Palazzo,
  • Francesco Rundo,
  • Concetto Spampinato

DOI
https://doi.org/10.1109/ACCESS.2024.3442976
Journal volume & issue
Vol. 12
pp. 112211 – 112231

Abstract

Read online

While text-based CAPTCHAs have been the predominant type of human interaction proofs (HIPs) for many years, image recognition challenges have also gained significant attention. This trend is due, on one hand, to groundbreaking advancements in solving text CAPTCHAs and, on the other hand, to the intrinsic weakness of machines in dealing with cognitive tasks such as those presented in image CAPTCHAs. In addition to classic and even human-centric image CAPTCHA solvers, deep learning has recently emerged as a significant player, providing two unprecedented and, at the same time, contradictory advantages for designers and adversaries. Designers benefit from deep learning techniques to make CAPTCHAs as hard to break as possible, while adversaries utilize deep learning algorithms to attack novel and complicated image-based challenges. Given these premises, this paper presents an analytical study on the applications of deep learning for and against image CAPTCHAs. This study aims to provide a comprehensive overview of the latest advancements in the field, assisting researchers and practitioners in designing image CAPTCHAs that are both user-friendly and resilient against modern attacks.

Keywords