Magalhães, João; Ciravegna, Fabio and Rüger, Stefan
Exploring multimedia in a keyword space.
In: The 16th ACM International Conference on Multimedia (2008), 26-31 Oct 2008, Vancouver, BC, Canada, p. 101.
Full text available as:
Due to copyright restrictions, this file is not available for public download
We address the problem of searching multimedia by semantic similarity in a keyword space. In contrast to previous research we represent multimedia content by a vector of keywords instead of a vector of low-level features. This vector of keywords can be obtained through user manual annotations or computed by an automatic annotation algorithm. In this setting, we studied the influence of two aspects of the search by semantic similarity process: (1) accuracy of user keywords versus automatic keywords and (2) functions to compute semantic similarity between keyword vectors of two multimedia documents. We consider these two aspects to be crucial in the design of a keyword space that can exploit social-media information and can enrich applications such as Flickr and YouTube. Experiments were performed on an image and a video dataset with a large number of keywords, with different similarity functions and with two annotation methods. Surprisingly, we found that multimedia semantic similarity with automatic keywords performs as good as or better than 95% accurate user keywords.
||search; multimedia; user keyword annotations; automatic
keyword annotations; keyword spaces
||Knowledge Media Institute
||04 Jan 2011 11:54
||24 Oct 2012 04:04
Actions (login may be required)