An Evaluation Methodology Applied to Trust-Based Adapted Systems for e-Assessment: Connecting Responsible Research and Innovation with a Human-Centred Design Approach

Okada, Alexandra and Whitelock, Denise (2019). An Evaluation Methodology Applied to Trust-Based Adapted Systems for e-Assessment: Connecting Responsible Research and Innovation with a Human-Centred Design Approach. In: Besora, David; Guerrero Roldán, Ana Elena and Rodríguez González, M. Elena eds. Engineering Data-Driven Adaptive Trust-based e-Assessment System: Challenges and Infrastructure Solutions. Lecture Notes on Data Engineering and Communications Technologies, 34. Springer, pp. 239–265.

DOI: https://doi.org/10.1007/978-3-030-29326-0_11

Abstract

This chapter describes a novel evaluation methodology designed, deployed and refined during the development of the EU-funded TeSLA system which was produced to check student authentication and authorship. This methodology was underpinned by a Responsible Research and Innovation approach combined with human-centred design. Participants were 4,058 students, which included 330 with special needs, together with 54 teaching staff and 21 institutional members from seven universities who completed consultation, focus groups, questionnaires and interviews. The findings suggest that the evaluation methodology was able to identify a broadly positive acceptance of and trust in e-authentication for online assessments by both women and men, with neither group finding the e-authentication tools to be either particularly onerous or stressful. The methodology facilitated the development of a framework with five features related to “trust”: 1. The system will not fail, 2. be compromised, 3. data will be kept safely and privately, 4. the system will not affect students’ performance and 5. the system will ensure fairness.

Viewing alternatives

Metrics

Item Actions

Export

You can export this page using these formats Digital Object Identifier - DOI

About

• Item ORO ID
• 66371
• Item Type
• Book Section
• ISBN
• 3-030-29325-4, 978-3-030-29325-3
• Project Funding Details

• Funded Project Name	Project ID	Funding Body
  TeSLA	Not Set	European Commission

• Keywords
• Evaluation methodology; Trust-based adapted systems; Responsible research and innovation; Human-centred design approach; Academic integrity
• Academic Unit or School
• Faculty of Wellbeing, Education and Language Studies (WELS) > Education, Childhood, Youth and Sport > Education
  Faculty of Wellbeing, Education and Language Studies (WELS) > Education, Childhood, Youth and Sport
  Faculty of Wellbeing, Education and Language Studies (WELS)
  Institute of Educational Technology (IET)
• Research Group
• Centre for Research in Computing (CRC)
• Copyright Holders
• © 2020 Springer Nature Switzerland AG
• Depositing User
• Alexandra Okada