Scientific Reports (Sep 2024)

Research on fatigue detection of flight trainees based on face EMF feature model combination with PSO-CNN algorithm

  • Lei Shang,
  • Haiqing Si,
  • Haibo Wang,
  • Ting Pan,
  • Haibo Liu,
  • Yixuan Li,
  • Jingxuan Qiu,
  • Mengyue Xu

DOI
https://doi.org/10.1038/s41598-024-71192-x
Journal volume & issue
Vol. 14, no. 1
pp. 1 – 11

Abstract

Read online

Abstract Even though the capability of aircraft manufacturing has improved, human factors still play a pivotal role in flight accidents. For example, fatigue-related accidents are a common factor in human-led accidents. Hence, pilots’ precise fatigue detections could help increase the flight safety of airplanes. The article suggests a model to recognize fatigue by implementing the convolutional neural network (CNN) by implementing flight trainees' face attributions. First, the flight trainees’ face attributions are derived by a method called the land-air call process when the flight simulation is run. Then, sixty-eight points of face attributions are detected by employing the Dlib package. Fatigue attribution points were derived based on the face attribution points to construct a model called EMF to detect face fatigue. Finally, the proposed PSO-CNN algorithm is implemented to learn and train the dataset, and the network algorithm achieves a recognition ratio of 93.9% on the test set, which can efficiently pinpoint the flight trainees’ fatigue level. Also, the reliability of the proposed algorithm is validated by comparing two machine learning models.

Keywords