Nature Communications (Apr 2024)

Frequency-encoded eye tracking smart contact lens for human–machine interaction

  • Hengtian Zhu,
  • Huan Yang,
  • Siqi Xu,
  • Yuanyuan Ma,
  • Shugeng Zhu,
  • Zhengyi Mao,
  • Weiwei Chen,
  • Zizhong Hu,
  • Rongrong Pan,
  • Yurui Xu,
  • Yifeng Xiong,
  • Ye Chen,
  • Yanqing Lu,
  • Xinghai Ning,
  • Dechen Jiang,
  • Songtao Yuan,
  • Fei Xu

DOI
https://doi.org/10.1038/s41467-024-47851-y
Journal volume & issue
Vol. 15, no. 1
pp. 1 – 13

Abstract

Read online

Abstract Eye tracking techniques enable high-efficient, natural, and effortless human-machine interaction by detecting users’ eye movements and decoding their attention and intentions. Here, a miniature, imperceptible, and biocompatible smart contact lens is proposed for in situ eye tracking and wireless eye-machine interaction. Employing the frequency encoding strategy, the chip-free and battery-free lens successes in detecting eye movement and closure. Using a time-sequential eye tracking algorithm, the lens has a great angular accuracy of <0.5°, which is even less than the vision range of central fovea. Multiple eye-machine interaction applications, such as eye-drawing, Gluttonous Snake game, web interaction, pan-tilt-zoom camera control, and robot vehicle control, are demonstrated on the eye movement model and in vivo rabbit. Furthermore, comprehensive biocompatibility tests are implemented, demonstrating low cytotoxicity and low eye irritation. Thus, the contact lens is expected to enrich approaches of eye tracking techniques and promote the development of human-machine interaction technology.