End-to-End Quantum-like Language Models with Application to Question Answering

Zhang, Peng; Niu, Jiabin; Su, Zhan; Wang, Benyou; Ma, Liqun and Song, Dawei (2018). End-to-End Quantum-like Language Models with Application to Question Answering. In: 32nd AAAI Conference on Artificial Intelligence (AAAI-18), 2-7 Feb 2018, New Orleans, Louisiana, USA, Association for the Advancement of Artificial Intelligence.

URL: https://aaai.org/Conferences/AAAI-18/

Abstract

Language Modeling (LM) is a fundamental research topic ina range of areas. Recently, inspired by quantum theory, a novel Quantum Language Model (QLM) has been proposed for Information Retrieval (IR). In this paper, we aim to broaden the theoretical and practical basis of QLM. We develop a Neural Network based Quantum-like Language Model (NNQLM) and apply it to Question Answering. Specifically, based on word embeddings, we design a new density matrix, which represents a sentence (e.g., a question or an answer) and encodes a mixture of semantic subspaces. Such a density matrix, together with a joint representation of the question and the answer, can be integrated into neural network architectures (e.g., 2-dimensional convolutional neural networks). Experiments on the TREC-QA and WIKIQA datasets have verified the effectiveness of our proposed models.

Viewing alternatives

Item Actions

Export

You can export this page using these formats