IEEE Access (Jan 2023)

Reverse Image Search for Collage: A Novel Local Feature-Based Framework

  • Muhammad Zubair,
  • Muhammad Affan Alim,
  • Imran Naseem,
  • Muhammad Mansoor Alam,
  • Mazliham Mohd Su'ud

DOI
https://doi.org/10.1109/ACCESS.2023.3289759
Journal volume & issue
Vol. 11
pp. 78182 – 78191

Abstract

Read online

Collage, a popular form of visual-content summarization technique is commonly used by internet users and digital artists. Social media usage is a rising trend that significantly affects the increasing demand for collages. The primary source of collage generation is social media, but other sources also generate it. Searching for a required query image in this corpus is a crucial demand and also valuable. The query image can be retrieved using Reverse Image Search (RIS), either in its exact form or with a small variation. Well-known search engines like Google and Yandex have this functionality, but their method has not been made public. In this research, we propose a consolidated framework for reverse image searching for the problem of collage. Essentially, the local features of collage images are extracted by using SIFT, SURF, and ORB algorithms. These features undergo the localization of the region of interest (ROI) process which handles by binning technique. We propose to use the Manhattan distance to calculate the similarity. The proposed model is extensively evaluated on standard databases and is shown to always have good results using SIFT algorithm. The proposed model is entirely generic and attains 90.96%, accuracy using the SIFT algorithm. The proposed approach is also evaluated on flip and scale variant college and achieves a result of 83% and 78% respectively, using SIFT algorithm.

Keywords