Training a Dataset Simulated Using RGB Images for an End-to-End Event-Based DoLP Recovery Network

Abstract

Event cameras are bio-inspired neuromorphic sensors that have emerged in recent years, with advantages such as high temporal resolutions, high dynamic ranges, low latency, and low power consumption. Event cameras can be used to build event-based imaging polarimeters, overcoming the limited frame rates and low dynamic ranges of existing systems. Since events cannot provide absolute brightness intensity in different angles of polarization (AoPs), degree of linear polarization (DoLP) recovery in non-division-of-time (non-DoT) event-based imaging polarimeters is an ill-posed problem. Thus, we need a data-driven deep learning approach. Deep learning requires large amounts of data for training, and constructing a dataset for event-based non-DoT imaging polarimeters requires significant resources, scenarios, and time. We propose a method for generating datasets using simulated polarization distributions from existing red–green–blue images. Combined with event simulator V2E, the proposed method can easily construct large datasets for network training. We also propose an end-to-end event-based DoLP recovery network to solve the problem of DoLP recovery using event-based non-DoT imaging polarimeters. Finally, we construct a division-of-time event-based imaging polarimeter simulating an event-based four-channel non-DoT imaging polarimeter. Using real-world polarization events and DoLP ground truths, we demonstrate the effectiveness of the proposed simulation method and network.

Keywords

• event camera
• dynamic vision sensor
• polarimeter
• simulation dataset
• degree of linear polarization