Reverse Image Search for Collage: A Novel Local Feature-Based Framework

Abstract

Collage, a popular form of visual-content summarization technique is commonly used by internet users and digital artists. Social media usage is a rising trend that significantly affects the increasing demand for collages. The primary source of collage generation is social media, but other sources also generate it. Searching for a required query image in this corpus is a crucial demand and also valuable. The query image can be retrieved using Reverse Image Search (RIS), either in its exact form or with a small variation. Well-known search engines like Google and Yandex have this functionality, but their method has not been made public. In this research, we propose a consolidated framework for reverse image searching for the problem of collage. Essentially, the local features of collage images are extracted by using SIFT, SURF, and ORB algorithms. These features undergo the localization of the region of interest (ROI) process which handles by binning technique. We propose to use the Manhattan distance to calculate the similarity. The proposed model is extensively evaluated on standard databases and is shown to always have good results using SIFT algorithm. The proposed model is entirely generic and attains 90.96%, accuracy using the SIFT algorithm. The proposed approach is also evaluated on flip and scale variant college and achieves a result of 83% and 78% respectively, using SIFT algorithm.

Keywords

• Collage
• collage detection
• computer vision
• machine learning
• reverse image search (RIS)