Neuromorphic Implementation of a Continuous Attractor Neural Network With Various Synaptic Dynamics

Abstract

A continuous attractor neural network (CANN) configured with various synaptic dynamics can implement many brain cognitive functions. Corresponding neuromorphic implementation can be beneficial to carry out these cognitive computations in real-time. Herein, we present a neuromorphic implementation of the CANN of spiking neurons on the field-programmable gate array (FPGA), in which the synaptic strength of local excitation and global inhibition can be configured to achieve winner-take-all (WTA) competition. In contrast to previously reported neuromorphic CANN, in addition to fast-linear synapses, recurrent connections can also be implemented with slow-nonlinear synapses. This endows the proposed CANN on the FPGA with the capability of performing neural computations that require slow and nonlinear temporal dynamics, such as decision making and working memory. Circuit simulations on the hardware reproduced gradually ramping neural activities observed in decision-making experiments and multiple sustained activities observed during the delay in working memory experiments, especially the fade-out and merging of activity bumps in the latter task. Theoretical analysis illuminated the underlying mechanisms of decision making and working memory on the FPGA. The unstable two-bump steady state of the CANN is responsible for the two-alternative decision making, similar to the saddle-node structure in the reduced two-variable decision model. Meanwhile, the stable uniformly distributed N-bump steady states account for the multiple-item working memory, similar to the multistability in previous mean-field models. Furthermore, the asymmetrical N-bump unstable steady states exhibit attractor dynamics underlying the fade-out and merging of activity bumps. The consistency between simulations on the hardware and the theoretical analysis demonstrated that the neuromorphic CANN is endowed with attractor dynamics relating to slow and nonlinear neural computations and has the potential to implement sophisticated cognitive functions by configuring various synaptic dynamics. This implementation shows promise for integrating the cognitive platform due to its characteristics of various dynamics and flexible configurations.

Keywords

• Neuromorphic engineering
• continuous attractor neural network
• attractor dynamics
• decision making
• working memory