An Application for Aesthetic Quality Assessment in Photography with Interpretability Features

Abstract

Automatic aesthetic quality assessment is a computer vision problem in which we quantify the attractiveness or the appealingness of a photograph. This is especially useful in social networks, where the amount of images generated each day requires automation for processing. This work presents Aesthetic Selector, an application able to identify images of high aesthetic quality, showing also relevant information about the decisions and providing the use of the most appropriate filters to enhance a given image. We then analyzed the main proposals in the aesthetic quality field, describing their strengths and weaknesses in order to determine the filters to be included in the application Aesthetic Selector. This proposed application was tested, giving good results, in three different scenarios: image selection, image finding, and filter selection. Besides, we carried out a study of distinct visualization tools to better understand the models’ behavior. These techniques also allow detecting which areas are more relevant within the images when models perform classification. The application also includes this interpretability module. Aesthetic Selector is an innovative and original program, because in the field of aesthetic quality in photography, there are no applications that identify high-quality images and also because it offers the capability of showing information about which parts of the image have affected this decision.

Keywords

• aesthetic
• application software
• deep learning
• fine-tuning
• image quality
• transfer learning