The Open UniversitySkip to content

On the duality of specific early and late fusion strategies

Kaliciak, Leszek; Myrhaug, Hans; Goker, Ayse and Song, Dawei (2014). On the duality of specific early and late fusion strategies. In: 17th International Conference on Information Fusion (FUSION 2014), 7-10 Jul 2014, Salamanca, Spain, IEEE.

Google Scholar: Look up in Google Scholar


In this paper, we prove that specific early and specific late fusion strategies are interchangeable. In the case of the late fusion, we consider not only linear but also nonlinear combinations of scores. Our findings are important from both theoretical and practical (applied) perspectives. The duality of specific fusion strategies also answers the question why in the literature the experimental results for both early and late fusion are often similar.

The most important aspect of our research is, however, related to the presumable drawbacks of the aforementioned fusion strategies. It is an accepted fact that the main drawback of the early fusion is the curse of dimensionality (generation of high dimensional vectors) whereas the main drawback of the late fusion is its inability to capture correlation between feature spaces. Our proof on the interchangeability of specific fusion schemes undermines this belief. Only one of the possibilities exists: either the late fusion is capable of capturing the correlation between feature spaces or the interaction between the early fusion operators and the similarity measurements decorrelates feature spaces.

Item Type: Conference or Workshop Item
Copyright Holders: 2014 ISIF
Keywords: information and data fusion; early fusion; late fusion; content-based image retrieval; information retrieval; multimedia retrieval; textual representation; visual representation
Academic Unit/School: Faculty of Science, Technology, Engineering and Mathematics (STEM)
Faculty of Science, Technology, Engineering and Mathematics (STEM) > Computing and Communications
Related URLs:
Item ID: 42211
Depositing User: Dawei Song
Date Deposited: 06 Mar 2015 09:45
Last Modified: 07 Dec 2018 10:29
Share this page:

Actions (login may be required)

Policies | Disclaimer

© The Open University   contact the OU