Categorizing Color Appearances of Image Scenes Based on Human Color Perception for Image Retrieval

Abstract

Institutions that possess certain collections of digital image libraries, such as museums, are progressively interested in making such collections accessible anytime and anywhere for any Image Retrieval (IR) activities namely browsing and searching. Many researchers have shown that IR methods, in filtering images based on their features such as colors, would provide better indexing and can be able to deliver/provide more accurate results. The color composition of an image, e.g. color histogram has proven to be a powerful feature that can be analyzed and used for image indexing because of its robust standardization of image transformation such as scaling and orientation. In this research, the efforts in narrowing the gap between low relevancy human text descriptions for Malaysian users and image scene color appearances have been brought into attention. The methods are first, to investigate the color concepts and color appearance descriptions of a scene and secondly, to identify a set of ground-truth images for each color appearance category. Psychophysical experiments are conducted to determine a collection of ground-truth images that effectively match five color appearance descriptions for image scenes in accordance with human judgement and perception. The results of the experiments are presented together with the inter-rater agreement analysis. These descriptions that are commonly queried by humans are the following keywords, Bright, Pastel, Dull, Pale, and Dark. The agreement analysis indicates that the Bright category is the most comprehensible by humans and subsequently followed by the Pastel and Dark categories. Dull and Pale categories, on the other hand are fairly understood by humans. All the images involved in this research are landscape painting collections from the internet and they are used for academic purposes only. The results show the top ten ground-truth images for each category that encapsulates a high level of agreeability between humans.

Keywords

• Color appearance description
• color concept
• color features
• human judgement
• human agreement analysis
• psychophysical experiments