Nature Communications (Feb 2025)
The neurobench framework for benchmarking neuromorphic computing algorithms and systems
- Jason Yik,
- Korneel Van den Berghe,
- Douwe den Blanken,
- Younes Bouhadjar,
- Maxime Fabre,
- Paul Hueber,
- Weijie Ke,
- Mina A. Khoei,
- Denis Kleyko,
- Noah Pacik-Nelson,
- Alessandro Pierro,
- Philipp Stratmann,
- Pao-Sheng Vincent Sun,
- Guangzhi Tang,
- Shenqi Wang,
- Biyan Zhou,
- Soikat Hasan Ahmed,
- George Vathakkattil Joseph,
- Benedetto Leto,
- Aurora Micheli,
- Anurag Kumar Mishra,
- Gregor Lenz,
- Tao Sun,
- Zergham Ahmed,
- Mahmoud Akl,
- Brian Anderson,
- Andreas G. Andreou,
- Chiara Bartolozzi,
- Arindam Basu,
- Petrut Bogdan,
- Sander Bohte,
- Sonia Buckley,
- Gert Cauwenberghs,
- Elisabetta Chicca,
- Federico Corradi,
- Guido de Croon,
- Andreea Danielescu,
- Anurag Daram,
- Mike Davies,
- Yigit Demirag,
- Jason Eshraghian,
- Tobias Fischer,
- Jeremy Forest,
- Vittorio Fra,
- Steve Furber,
- P. Michael Furlong,
- William Gilpin,
- Aditya Gilra,
- Hector A. Gonzalez,
- Giacomo Indiveri,
- Siddharth Joshi,
- Vedant Karia,
- Lyes Khacef,
- James C. Knight,
- Laura Kriener,
- Rajkumar Kubendran,
- Dhireesha Kudithipudi,
- Shih-Chii Liu,
- Yao-Hong Liu,
- Haoyuan Ma,
- Rajit Manohar,
- Josep Maria Margarit-Taulé,
- Christian Mayr,
- Konstantinos Michmizos,
- Dylan R. Muir,
- Emre Neftci,
- Thomas Nowotny,
- Fabrizio Ottati,
- Ayca Ozcelikkale,
- Priyadarshini Panda,
- Jongkil Park,
- Melika Payvand,
- Christian Pehle,
- Mihai A. Petrovici,
- Christoph Posch,
- Alpha Renner,
- Yulia Sandamirskaya,
- Clemens J. S. Schaefer,
- André van Schaik,
- Johannes Schemmel,
- Samuel Schmidgall,
- Catherine Schuman,
- Jae-sun Seo,
- Sadique Sheik,
- Sumit Bam Shrestha,
- Manolis Sifalakis,
- Amos Sironi,
- Kenneth Stewart,
- Matthew Stewart,
- Terrence C. Stewart,
- Jonathan Timcheck,
- Nergis Tömen,
- Gianvito Urgese,
- Marian Verhelst,
- Craig M. Vineyard,
- Bernhard Vogginger,
- Amirreza Yousefzadeh,
- Fatima Tuz Zohora,
- Charlotte Frenkel,
- Vijay Janapa Reddi
Affiliations
- Jason Yik
- Harvard University
- Korneel Van den Berghe
- Harvard University
- Douwe den Blanken
- Delft University of Technology
- Younes Bouhadjar
- Forschungszentrum Jülich
- Maxime Fabre
- University of Groningen
- Paul Hueber
- Delft University of Technology
- Weijie Ke
- SynSense
- Mina A. Khoei
- SynSense
- Denis Kleyko
- Örebro University
- Noah Pacik-Nelson
- Accenture Labs
- Alessandro Pierro
- Intel Labs
- Philipp Stratmann
- Intel Labs
- Pao-Sheng Vincent Sun
- City University of Hong Kong
- Guangzhi Tang
- imec
- Shenqi Wang
- imec
- Biyan Zhou
- City University of Hong Kong
- Soikat Hasan Ahmed
- Forschungszentrum Jülich
- George Vathakkattil Joseph
- Innatera Nanosystems B.V.
- Benedetto Leto
- Politecnico di Torino
- Aurora Micheli
- Delft University of Technology
- Anurag Kumar Mishra
- Forschungszentrum Jülich
- Gregor Lenz
- NeuroBus
- Tao Sun
- Centrum Wiskunde & Informatica
- Zergham Ahmed
- Harvard University
- Mahmoud Akl
- SpiNNcloud Systems GmbH
- Brian Anderson
- Intel Labs
- Andreas G. Andreou
- Johns Hopkins University
- Chiara Bartolozzi
- Istituto Italiano di Tecnologia
- Arindam Basu
- City University of Hong Kong
- Petrut Bogdan
- Innatera Nanosystems B.V.
- Sander Bohte
- Centrum Wiskunde & Informatica
- Sonia Buckley
- National Institute of Standards and Technology
- Gert Cauwenberghs
- UCSD
- Elisabetta Chicca
- University of Groningen
- Federico Corradi
- Eindhoven University of Technology
- Guido de Croon
- Delft University of Technology
- Andreea Danielescu
- Accenture Labs
- Anurag Daram
- UTSA
- Mike Davies
- Intel Labs
- Yigit Demirag
- University of Zurich
- Jason Eshraghian
- UCSC
- Tobias Fischer
- Queensland University of Technology
- Jeremy Forest
- Cornell University
- Vittorio Fra
- Politecnico di Torino
- Steve Furber
- University of Manchester
- P. Michael Furlong
- U Waterloo
- William Gilpin
- University of Texas at Austin
- Aditya Gilra
- Centrum Wiskunde & Informatica
- Hector A. Gonzalez
- SpiNNcloud Systems GmbH
- Giacomo Indiveri
- University of Zurich
- Siddharth Joshi
- University of Notre Dame
- Vedant Karia
- UTSA
- Lyes Khacef
- Sony Semiconductor Solutions Europe
- James C. Knight
- University of Sussex
- Laura Kriener
- University of Zurich
- Rajkumar Kubendran
- University of Pittsburgh
- Dhireesha Kudithipudi
- UTSA
- Shih-Chii Liu
- University of Zurich
- Yao-Hong Liu
- imec
- Haoyuan Ma
- CentraleSupélec
- Rajit Manohar
- Yale University
- Josep Maria Margarit-Taulé
- Instituto de Microelectrónica de Barcelona
- Christian Mayr
- Technische Universität Dresden
- Konstantinos Michmizos
- Rutgers University
- Dylan R. Muir
- SynSense
- Emre Neftci
- Forschungszentrum Jülich
- Thomas Nowotny
- University of Sussex
- Fabrizio Ottati
- Politecnico di Torino
- Ayca Ozcelikkale
- Uppsala University
- Priyadarshini Panda
- Yale University
- Jongkil Park
- Korea Institute of Science and Technology
- Melika Payvand
- University of Zurich
- Christian Pehle
- Heidelberg University
- Mihai A. Petrovici
- University of Bern
- Christoph Posch
- Prophesee
- Alpha Renner
- Forschungszentrum Jülich
- Yulia Sandamirskaya
- Intel Labs
- Clemens J. S. Schaefer
- University of Notre Dame
- André van Schaik
- Western Sydney University
- Johannes Schemmel
- Heidelberg University
- Samuel Schmidgall
- Johns Hopkins University
- Catherine Schuman
- University of Tennessee
- Jae-sun Seo
- Cornell Tech
- Sadique Sheik
- SynSense
- Sumit Bam Shrestha
- Intel Labs
- Manolis Sifalakis
- imec
- Amos Sironi
- Prophesee
- Kenneth Stewart
- Forschungszentrum Jülich
- Matthew Stewart
- Harvard University
- Terrence C. Stewart
- National Research Council Canada
- Jonathan Timcheck
- Intel Labs
- Nergis Tömen
- Delft University of Technology
- Gianvito Urgese
- Politecnico di Torino
- Marian Verhelst
- imec
- Craig M. Vineyard
- Sandia National Laboratories
- Bernhard Vogginger
- Technische Universität Dresden
- Amirreza Yousefzadeh
- imec
- Fatima Tuz Zohora
- UTSA
- Charlotte Frenkel
- Delft University of Technology
- Vijay Janapa Reddi
- Harvard University
- DOI
- https://doi.org/10.1038/s41467-025-56739-4
- Journal volume & issue
-
Vol. 16,
no. 1
pp. 1 – 24
Abstract
Abstract Neuromorphic computing shows promise for advancing computing efficiency and capabilities of AI applications using brain-inspired principles. However, the neuromorphic research field currently lacks standardized benchmarks, making it difficult to accurately measure technological advancements, compare performance with conventional methods, and identify promising future research directions. This article presents NeuroBench, a benchmark framework for neuromorphic algorithms and systems, which is collaboratively designed from an open community of researchers across industry and academia. NeuroBench introduces a common set of tools and systematic methodology for inclusive benchmark measurement, delivering an objective reference framework for quantifying neuromorphic approaches in both hardware-independent and hardware-dependent settings. For latest project updates, visit the project website ( neurobench.ai ).