Improved Open World Object Detection Using Class-Wise Feature Space Learning

Abstract

Open-world object detection is a challenging set of tasks in the realm of computer vision. In these tasks, the object detection model processes the input image or video and undergoes inference to identify objects or features present in the image or video. The main objective of the model is to identify the seen and unseen classes rather than identifying only the classes that that were introduced to it during training. The challenging task is to create instance-level true bounding boxes tightly around the true objects and classify and localize them with their true class labels, without missing any of the true object or assigning false positive labels to them. Motivated by the pressing need to advance the capabilities of open-world object detection we present a novel clustering technique called margin-based latent space clustering and deployed it in the classification head of the Faster RCNN. Furthermore, we propose a novel loss function called margin-based loss coupled with regularization parameters aiming to optimize the outlier identification. The proposed method is also capable of incremental learning. Overall, all four incremental tasks are assessed by employing benchmark evaluation metrics. The proposed method outperforms the existing state-of-the-art method, with significant improvements in mean average precision (mAP). We improved the mAP by 4.49% on task 1, 3.71% on task 2, 6.19% on task 3 and 2.81% on task 4. We also reduced the ‘Wilderness Impact and Absolute Open-Set Error’ metrics (For assessing the false positive detection, both metrics are employed), on every task.

Keywords

• Regional proposal network
• region of interest
• region convolutional neural network