Sleep-like unsupervised replay reduces catastrophic forgetting in artificial neural networks

Abstract

Artificial neural networks are known to perform well on recently learned tasks, at the same time forgetting previously learned ones. The authors propose an unsupervised sleep replay algorithm to recover old tasks synaptic connectivity that may have been damaged after new task training.