Contextual image annotation via projection and quantum theory inspired measurement for integration of text and visual features

Kaliciak, Leszek; Wang, Lei; Song, Dawei; Zhang, Peng and Hou, Yuexian (2011). Contextual image annotation via projection and quantum theory inspired measurement for integration of text and visual features. In: 5th International Symposium on Quantum Interactions (QI2011), 26-29 Jun 2011, Aberdeen, UK.

DOI: https://doi.org/10.1007/978-3-642-24971-6_23

URL: http://cs.tju.edu.cn/faculty/dsong/papers/fulltext...

Abstract

Multimedia information retrieval suffers from the semantic gap, a difference between human perception and machine representation of images. In order to reduce the gap, a quantum theory inspired theoretical framework for integration of text and visual features has been proposed. This article is a followup work on this model. Previously, two relatively straight forward statistical approaches for making associations between dimensions of both feature spaces were employed, but with unsatisfactory results. In this paper, we propose to alleviate the problem regarding unannotated images by projecting them onto subspaces representing visual context and by incorporating a quantum-like measurement. The proposed principled approach extends the traditional vector space model (VSM) and seamlessly integrates with the tensor-based framework. Here,we experimentally test the novel association methods in a small-scale experiment.

Viewing alternatives

Metrics

Item Actions

Export

You can export this page using these formats Digital Object Identifier - DOI