Advanced Science (Apr 2021)

Tactile Avatar: Tactile Sensing System Mimicking Human Tactile Cognition

  • Kyungsoo Kim,
  • Minkyung Sim,
  • Sung‐Ho Lim,
  • Dongsu Kim,
  • Doyoung Lee,
  • Kwonsik Shin,
  • Cheil Moon,
  • Ji‐Woong Choi,
  • Jae Eun Jang

DOI
https://doi.org/10.1002/advs.202002362
Journal volume & issue
Vol. 8, no. 7
pp. n/a – n/a

Abstract

Read online

Abstract As a surrogate for human tactile cognition, an artificial tactile perception and cognition system are proposed to produce smooth/soft and rough tactile sensations by its user's tactile feeling; and named this system as “tactile avatar”. A piezoelectric tactile sensor is developed to record dynamically various physical information such as pressure, temperature, hardness, sliding velocity, and surface topography. For artificial tactile cognition, the tactile feeling of humans to various tactile materials ranging from smooth/soft to rough are assessed and found variation among participants. Because tactile responses vary among humans, a deep learning structure is designed to allow personalization through training based on individualized histograms of human tactile cognition and recording physical tactile information. The decision error in each avatar system is less than 2% when 42 materials are used to measure the tactile data with 100 trials for each material under 1.2N of contact force with 4cm s−1 of sliding velocity. As a tactile avatar, the machine categorizes newly experienced materials based on the tactile knowledge obtained from training data. The tactile sensation showed a high correlation with the specific user's tendency. This approach can be applied to electronic devices with tactile emotional exchange capabilities, as well as advanced digital experiences.

Keywords