Object-Level Hybrid Spatiotemporal Fusion: Reaching a Better Tradeoff Among Spectral Accuracy, Spatial Accuracy, and Efficiency

Abstract

Spatiotemporal fusion (STF) is a cost-effective way to complement the spatiotemporal resolution of multisource images, which has been employed in various applications requiring image sequences. In real-world applications, the spectral accuracy, spatial accuracy, and efficiency of STF play a critical role. Despite this, most STF methods focus on improving spectral accuracy, whereas the challenges of spatial information loss and low efficiency have received limited attention. In addition, the improvements in spectral accuracy, spatial accuracy, and efficiency in STF are contradictory, and existing STF methods cannot balance them well, which limits their reliability and applicability for various STF tasks. To solve the above-mentioned issues, this study proposes an object-level hybrid STF method (OL-HSTFM), which incorporates the efficiency advantage of the object-level fusion strategy, spectral accuracy advantage of the three-step method (Fit-FC), and the spatial accuracy advantage of the spatial and temporal adaptive reflectance fusion model. The performance of OL-HSTFM was compared with two classic STF methods and eight state-of-the-art STF methods at two sites. The experimental results indicate that OL-HSTFM outperforms the other ten methods in overall performance and has excellent efficiency. Furthermore, this study proposes a new metric that can assess the accuracy of both spatial and spectral domains in STF, which provides a more comprehensive and intuitive measurement of the quality of fused images compared to commonly used metrics.

Keywords

• Object-level processing
• spatiospectral accuracy metric (SSAM)
• spatiotemporal fusion (STF)