A machine learning-based usability evaluation method for eLearning systems

Oztekin A., Delen D., Turkyilmaz A., Zaim S.

DECISION SUPPORT SYSTEMS, cilt.56, ss.63-73, 2013 (SCI-Expanded) identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 56
  • Basım Tarihi: 2013
  • Doi Numarası: 10.1016/j.dss.2013.05.003
  • Dergi Adı: DECISION SUPPORT SYSTEMS
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus
  • Sayfa Sayıları: ss.63-73
  • Anahtar Kelimeler: eLearning (web-based learning/distance learning), Usability engineering, Severity index, Information fusion, Sensitivity analysis, Machine learning, SOFTWARE, QUALITY, SATISFACTION, DESIGN, DSS
  • Marmara Üniversitesi Adresli: Evet

Özet

The research presented in this paper proposes a new machine learning-based evaluation method for assessing the usability of eLearning systems. Three machine learning methods (support vector machines, neural networks and decision trees) along with multiple linear regression are used to develop prediction models in order to discover the underlying relationship between the overall eLearning system usability and its predictor factors. A subsequent sensitivity analysis is conducted to determine the rank-order importance of the predictors. Using both sensitivity values along with the usability scores, a metric (called severity index) is devised. By applying a Pareto-like analysis, the severity index values are ranked and the most important usability characteristics are identified. The case study results show that the proposed methodology enhances the determination of eLearning system problems by identifying the most pertinent usability factors. The proposed method could provide an invaluable guidance to the usability experts as to what measures should be improved in order to maximize the system usability for a targeted group of end-users of an eLearning system. (C) 2013 Elsevier B.V. All rights reserved.