The International Archives of the Photogrammetry, Remote Sensing and Spatial Information Sciences (Aug 2020)

KNOWLEDGE DISTILLATION USING GANS FOR FAST OBJECT DETECTION

  • E. Finogeev,
  • E. Finogeev,
  • V. Gorbatsevich,
  • A. Moiseenko,
  • Y. Vizilter,
  • O. Vygolov

DOI
https://doi.org/10.5194/isprs-archives-XLIII-B2-2020-583-2020
Journal volume & issue
Vol. XLIII-B2-2020
pp. 583 – 588

Abstract

Read online

In this paper, we propose a new method for knowledge distilling based on generative adversarial networks. Discriminator CNNs is used as an adaptive knowledge distilling loss. In experiments, single shot multibox detector SSD based on MobileNet v2 and ShuffleNet v1 are used as student networks. Our tests showed AP and mAP improvement of more than 3% on PascalVOC and 1% on MS Coco datasets compared with the baseline algorithm without any architecture or dataset changes. The proposed approach is general and can be used not only with SSD but also with any type of object detection algorithms.