Spatial Natural Language Generation for Location Description in Photo Captions

Hall, Mark; Jones, Christopher B. and Smart, Philip (2015). Spatial Natural Language Generation for Location Description in Photo Captions. In: Fabrikant, Sara Irina; Raubal, Martin; Bertolotto, Michaela; Davies, Claire; Freundschuh, Scott and Bell, Scott eds. Spatial Information Theory. Lecture Notes in Computer Science, 9368. Springer International Publishing, pp. 196–223.

DOI: https://doi.org/10.1007/978-3-319-23374-1_10

Abstract

We present a spatial natural language generation system to create captions that describe the geographical context of geo-referenced photos. An analysis of existing photo captions was used to design templates representing typical caption language patterns, while the results of human subject experiments were used to create field-based spatial models of the applicability of some commonly used spatial prepositions. The language templates are instantiated with geo-data retrieved from the vicinity of the photo locations. A human subject evaluation was used to validate and to improve the spatial language generation procedure, examples of the results of which are presented in the paper.

Viewing alternatives

Download history

Metrics

Public Attention

Altmetrics from Altmetric

Number of Citations

Citations from Dimensions

Item Actions

Export

About

Recommendations