An Evaluation Methodology Applied to Trust-Based Adapted Systems for e-Assessment: Connecting Responsible Research and Innovation with a Human-Centred Design Approach

Okada, Alexandra and Whitelock, Denise (2019). An Evaluation Methodology Applied to Trust-Based Adapted Systems for e-Assessment: Connecting Responsible Research and Innovation with a Human-Centred Design Approach. In: Besora, David; Guerrero Roldán, Ana Elena and Rodríguez González, M. Elena eds. Engineering Data-Driven Adaptive Trust-based e-Assessment System: Challenges and Infrastructure Solutions. Lecture Notes on Data Engineering and Communications Technologies, 34. Springer, pp. 239–265.

DOI: https://doi.org/10.1007/978-3-030-29326-0_11

Abstract

This chapter describes a novel evaluation methodology designed, deployed and refined during the development of the EU-funded TeSLA system which was produced to check student authentication and authorship. This methodology was underpinned by a Responsible Research and Innovation approach combined with human-centred design. Participants were 4,058 students, which included 330 with special needs, together with 54 teaching staff and 21 institutional members from seven universities who completed consultation, focus groups, questionnaires and interviews. The findings suggest that the evaluation methodology was able to identify a broadly positive acceptance of and trust in e-authentication for online assessments by both women and men, with neither group finding the e-authentication tools to be either particularly onerous or stressful. The methodology facilitated the development of a framework with five features related to “trust”: 1. The system will not fail, 2. be compromised, 3. data will be kept safely and privately, 4. the system will not affect students’ performance and 5. the system will ensure fairness.

Viewing alternatives

Metrics

Public Attention

Altmetrics from Altmetric

Number of Citations

Citations from Dimensions

Item Actions

Export

About

Recommendations