Experimental Evaluation of Similarity Measures for Educational Items
| Authors | |
|---|---|
| Year of publication | 2021 |
| Type | Article in Proceedings |
| Conference | Proceedings of the 14th International Conference on Educational Data Mining |
| MU Faculty or unit | |
| Citation | |
| web | https://educationaldatamining.org/EDM2021/EDM2021Proceedings.pdf |
| Keywords | item similarity; evaluation; generalizability |
| Description | Measuring similarity of educational items has several applications in the development of adaptive learning systems, and previous research has already proposed a wide range of similarity measures. In this work, we provide an experimental evaluation of selected similarity measures using a large dataset. The used items are alternate-choice questions for the practice of English grammar for second language learners; the dataset contains thousands of items and over 10 million student answers. Our results provide warnings about the generalizability of results presented in EDM works: 1) the results vary significantly between knowledge components and 2) the size of available data is an important factor. |
| Related projects: |