Contextual image annotation via projection and quantum theory inspired measurement for integration of text and visual features

Kaliciak, Leszek; Wang, Lei; Song, Dawei; Zhang, Peng and Hou, Yuexian (2011). Contextual image annotation via projection and quantum theory inspired measurement for integration of text and visual features. In: 5th International Symposium on Quantum Interactions (QI2011), 26-29 Jun 2011, Aberdeen, UK.

DOI: https://doi.org/10.1007/978-3-642-24971-6_23

URL: http://cs.tju.edu.cn/faculty/dsong/papers/fulltext...

Abstract

Multimedia information retrieval suffers from the semantic gap, a difference between human perception and machine representation of images. In order to reduce the gap, a quantum theory inspired theoretical framework for integration of text and visual features has been proposed. This article is a followup work on this model. Previously, two relatively straight forward statistical approaches for making associations between dimensions of both feature spaces were employed, but with unsatisfactory results. In this paper, we propose to alleviate the problem regarding unannotated images by projecting them onto subspaces representing visual context and by incorporating a quantum-like measurement. The proposed principled approach extends the traditional vector space model (VSM) and seamlessly integrates with the tensor-based framework. Here,we experimentally test the novel association methods in a small-scale experiment.

Viewing alternatives

Look up in Google Scholar

Metrics

Public Attention

Altmetrics from Altmetric

Number of Citations

Citations from Dimensions

Item Actions

Export

About

CORE (COnnecting REpositories)

Recommendations