Currently browsing: Items authored or edited by Jacopo Amidei https://orcid.org/0000-0002-8846-252X

Amidei, Jacopo; Piwek, Paul and Willis, Alistair (2020). Identifying Annotator Bias: A new IRT-based method for bias identification. In: Proceedings of The 28th International Conference on Computational Linguistics (COLING), 8-13 Dec 2020, Barcelona, Spain, pp. 4787–4797.

• Download Accepted Manuscript (PDF / 346kB)

Amidei, Jacopo; Andrews, Uri; Pianigiani, Duccio; San Mauro, Luca and Sorbi, Andrea (2019). Trial and error mathematics: Dialectical systems and completions of theories. Journal of Logic and Computation, 29(1) pp. 157–184.

• Download Accepted Manuscript (PDF / 528kB)

Amidei, Jacopo; Piwek, Paul and Willis, Alistair (2019). Agreement is overrated: A plea for correlation to assess human evaluation reliability. In: Proceedings of the 12th International Conference on Natural Language Generation, 29 Oct - 1 Nov 2019, Tokyo, Japan.

• Download Version of Record (PDF / 543kB)

Amidei, Jacopo; Piwek, Paul and Willis, Alistair (2019). The use of rating and Likert scales in Natural Language Generation human evaluation tasks: A review and some recommendations. In: Proceedings of the 12th International Conference on Natural Language Generation, 29 Oct - 1 Nov 2019, Tokyo, Japan.

• Download Version of Record (PDF / 354kB)

Amidei, Jacopo; Piwek, Paul and Willis, Alistair (2018). Evaluation methodologies in Automatic Question Generation 2013-2018. In: Proceedings of The 11th International Natural Language Generation Conference, 5-8 Nov 2018, Tilburg, The Netherlands, pp. 307–317.

• Download Version of Record (PDF / 267kB)

Amidei, Jacopo; Piwek, Paul and Willis, Alistair (2018). Rethinking the Agreement in Human Evaluation Tasks. In: Proceedings of the 27th International Conference on Computational Linguistics, 20-26 Aug 2018, Santa Fe, New Mexico, pp. 3318–3329.

• Download Version of Record (PDF / 170kB)