Semantic Labeling of Globally Distributed Urban and Nonurban Satellite Images Using High-Resolution SAR Data

Abstract

While the analysis and understanding of multispectral (i.e., optical) remote sensing images have made considerable progress during the last decades, the automated analysis of synthetic aperture radar (SAR) satellite images still needs some innovative techniques to support nonexpert users in the handling and interpretation of these big and complex data. In this article, we present a survey of existing multispectral and SAR land cover image datasets. To this end, we demonstrate how an advanced SAR image analysis system can be designed, implemented, and verified that is capable of generating semantically annotated classification results (e.g., maps) as well as local and regional statistical analytics such as graphical charts. The initial classification is made based on Gabor features and followed by class assignments (labeling). This is followed by inclusion. This can be accomplished by the inclusion of expert knowledge via active learning with selected examples, and the extraction of additional knowledge from public databases to refine the classification results. Then, based on the generated semantics, we can create new topic models, find typical country-specific phenomena and distributions, visualize them interactively, and present significant examples including confusion matrices. This semiautomated and flexible methodology allows several annotation strategies, the inclusion of dedicated analytics procedures, and can generate broad as well as detailed semantic (multi-)labels for all continents, and statistics or models for selected countries and cities. Here, we employ knowledge graphs and exploit ontologies. These components could already be validated successfully. The proposed methodology can also be adapted to other SAR instruments with different resolutions as well as to multispectral images.

Keywords

• Active learning (AL)
• datasets
• high-resolution satellite images
• knowledge extraction
• ontologies
• semantic classes