工程科学学报 (Nov 2017)

Capture of microexpressions based on the entropy of oriented optical flow

  • LI Dan,
  • XIE Lun,
  • LU Ting,
  • HAN Jing,
  • HU Bo,
  • WANG Zhi-liang,
  • REN Fu-ji

DOI
https://doi.org/10.13374/j.issn2095-9389.2017.11.016
Journal volume & issue
Vol. 39, no. 11
pp. 1727 – 1734

Abstract

Read online

This paper proposes an algorithm that is effective in detecting the key frame of microexpression based on the entropy of oriented optical flow. Initially, this paper used an improved Horn-Schunck optical flow to extract the motion features of adjacent frames. Then, the threshold algorithm was used to filter the optical flow vectors with high-projective modulus. To capture the key frame of microexpression, the paper used information entropy to count the direction of optical flow vectors and analyzed the changing of microexpressions using an entropy vector of video sequences. Finally, the algorithm in this paper was verified with microexpression database SMIC (Oulu University) and CASME (the Director of the Institute of Psychology at the Chinese Academy of Sciences, Fu Xiaolan). Compared with traditional frame differences, experiments show that the algorithm is good not only in expressing the trend of the microexpression but also in providing the basis for microexpression recognition.

Keywords