Perspectives on the challenges of generalizability, transparency and ethics in predictive learning analytics

Simple item page
dc.citation.volume2
dc.contributor.authorMathrani A
dc.contributor.authorSusnjak T
dc.contributor.authorRamaswami G
dc.contributor.authorBarczak A
dc.date.accessioned2023-11-20T01:37:59Z
dc.date.available2021-11-20
dc.date.available2023-11-20T01:37:59Z
dc.date.issued2021-11-20
dc.description.abstractEducational institutions need to formulate a well-established data-driven plan to get long-term value from their learning analytics (LA) strategy. By tracking learners’ digital traces and measuring learners’ performance, institutions can discern consequential learning trends via use of predictive models to enhance their instructional services. However, questions remain on how the proposed LA system is suitable, meaningful, and justifiable. In this concept paper, we examine generalizability and transparency of the internals of predictive models, alongside the ethical challenges in using learners’ data for building predictive capabilities. Model generalizability or transferability is hindered by inadequate feature representation, small and imbalanced datasets, concept drift, and contextually un-related domains. Additional challenges relate to trustworthiness and social acceptance of these models since algorithmic-driven models are difficult to interpret by themselves. Further, ethical dilemmas are faced in engaging with learners’ data while developing and deploying LA systems at an institutional level. We propose methodologies for apprehending these challenges by establishing efforts for managing transferability and transparency, and further assessing the ethical standing on justifiable use of the LA strategy. This study showcases underlying relationships that exist between constructs pertaining to learners’ data and the predictive model. We suggest the use of appropriate evaluation techniques and setting up research ethics protocols, since without proper controls in place, the model outcome would not be portable, transferable, trustworthy, or admissible as a responsible outcome. This concept paper has theoretical and practical implications for future inquiry in the burgeoning field of learning analytics.
dc.description.confidentialfalse
dc.identifierhttps://www.sciencedirect.com/science/article/pii/S2666557321000318
dc.identifier100060
dc.identifier.citationComputers and Education Open, 2021, 2
dc.identifier.doi10.1016/j.caeo.2021.100060
dc.identifier.elements-id450271
dc.identifier.harvestedMassey_Dark
dc.identifier.issn2666-5573
dc.identifier.urihttps://hdl.handle.net/10179/16830
dc.publisherElsevier Ltd
dc.publisher.urihttps://www.sciencedirect.com/science/article/pii/S2666557321000318
dc.relation.isPartOfComputers and Education Open
dc.relation.urihttps://www.sciencedirect.com/science/article/pii/S2666557321000318
dc.rightsCC BY 4.0
dc.subjectLearning analytics
dc.subjectGeneralizability
dc.subjectInterpretability
dc.subjectTransparency
dc.subjectEthics protocol
dc.titlePerspectives on the challenges of generalizability, transparency and ethics in predictive learning analytics
dc.typeJournal article
massey.relation.uri-descriptionPublished version
pubs.notesNot known
pubs.organisational-group/Massey University
pubs.organisational-group/Massey University/College of Sciences
pubs.organisational-group/Massey University/College of Sciences/School of Mathematical and Computational Sciences
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
1-s2.0-S2666557321000318-main (1).pdf
Size:
820.19 KB
Format:
Adobe Portable Document Format
Description:
Download
Collections
Journal Articles