The Open UniversitySkip to content
 

Combining visual and textual systems within the context of user feedback

Kaliciak, Leszek; Song, Dawei; Wiratunga, Nirmalie and Pan, Jeff (2013). Combining visual and textual systems within the context of user feedback. In: 19th International Conference on MultiMedia Modeling (MMM2013), 5-7 January, 2013, Huangshan, China, pp. 445–455.

Full text available as:
[img]
Preview
PDF (Accepted Manuscript) - Requires a PDF viewer such as GSview, Xpdf or Adobe Acrobat Reader
Download (177Kb) | Preview
URL: http://mmm2013.org/apl.htm
DOI (Digital Object Identifier) Link: http://dx.doi.org/10.1007/978-3-642-35725-1_41
Google Scholar: Look up in Google Scholar

Abstract

It has been proven experimentally, that a combination of textual and visual representations can improve the retrieval performance ([20], [23]). It is due to the fact, that the textual and visual feature spaces often represent complementary yet correlated aspects of the same image, thus forming a composite system.

In this paper, we present a model for the combination of visual and textual sub-systems within the user feedback context. The model was inspired by the measurement utilized in quantum mechanics (QM) and the tensor product of co-occurrence (density) matrices, which represents a density matrix of the composite system in QM. It provides a sound and natural framework to seamlessly integrate multiple feature spaces by considering them as a composite system, as well as a new way of measuring the relevance of an image with respect to a context. The proposed approach takes into account both intra (via co-occurrence matrices) and inter (via tensor operator) relationships between features’ dimensions. It is also computationally cheap and scalable to large data collections. We test our approach on ImageCLEF2007photo data collection and present interesting findings.

Item Type: Conference Item
Copyright Holders: 2013 Springer-Verlag
Academic Unit/Department: Mathematics, Computing and Technology
Mathematics, Computing and Technology > Computing & Communications
Related URLs:
Item ID: 35155
Depositing User: Dawei Song
Date Deposited: 07 Nov 2012 11:12
Last Modified: 09 Oct 2013 14:57
URI: http://oro.open.ac.uk/id/eprint/35155
Share this page:

Altmetrics

Scopus Citations

Actions (login may be required)

View Item
Report issue / request change

Policies | Disclaimer

© The Open University   + 44 (0)870 333 4340   general-enquiries@open.ac.uk