Robust Hippocampus Localization From Structured Magnetic Resonance Imaging Using Similarity Metric Learning

Abstract

Accurate demarcation of anatomical landmarks in 3D medical imaging is a safety-critical and challenging task. State-of-the-art approaches formulate landmark localization either as a classification or as a regression problem. In this study, feature classification is performed as a verification step in a cascaded Hough regression networks (HRNs) for hippocampus localization in the structured magnetic resonance images of the brain. Global and local features of the landmarks are learned with coarse prediction and fine-tuning convolutional neural networks for coarse-to-fine localization. Siamese network was trained to learn a deep metric for verifying the roughly estimated locations. Feature verification with the Siamese network drops the outlier predictions and increase the robustness in prediction. Three-view patches(TVPs) with a size of $64\times 64\times 3$ are fed for rough estimation while the TVP sizes for Siamese-based verification and Hough regression network (HRN)-based fine-grained estimations are $32\times 32\times 3$ and $16\times 16\times 3$ , respectively. The experiment was performed on the Gwangju Alzheimer’s and Related Dementia’s (GARD) cohort data set. The proposed approach demonstrated better performance with the errors of 1.70±0.50 millimeters(mm) and 1.66±0.49 mm for localizing the left and right hippocampi in the GARD data set. In Alzheimer’s Disease Neuroimaging Initiative (ADNI) data set, the observed errors were 1.79 ± 0.83 mm and 1.55 ± 0.61 mm for localizing left and right hippocampus, respectively. Our results are comparable to those obtained by the state-of-the-art methods.

Keywords

• Landmark-localization
• hippocampus
• Hough CNN
• Siamese network