Evaluation of an Adaptive Practice System for Learning Geography Facts
Authors | |
---|---|
Year of publication | 2016 |
Type | Article in Proceedings |
Conference | Proceedings of the Sixth International Conference on Learning Analytics & Knowledge |
MU Faculty or unit | |
Citation | |
Web | http://doi.acm.org/10.1145/2883851.2883884 |
Doi | http://dx.doi.org/10.1145/2883851.2883884 |
Field | Informatics |
Keywords | attrition bias; computerized adaptive practice; engagement; evaluation; learning curve; survival analysis |
Description | Computerized educational systems are increasingly provided as open online services which provide adaptive personalized learning experience. To fully exploit potential of such systems, it is necessary to thoroughly evaluate different design choices. However, both openness and adaptivity make proper evaluation difficult. We provide a detailed report on evaluation of an online system for adaptive practice of geography, and use this case study to highlight methodological issues with evaluation of open online learning systems, particularly attrition bias. To facilitate evaluation of learning, we propose to use randomized reference questions. We illustrate application of survival analysis and learning curves for declarative knowledge. The result provide an interesting insight into the impact of adaptivity on learner behaviour and learning. |
Related projects: |