An Examination of Parametric and Nonparametric Dimensionality Assessment Methods with Exploratory and Confirmatory Mode


Creative Commons License

Koğar H.

Journal of Education and Learning, vol.7, no.3, pp.148-158, 2018 (Peer-Reviewed Journal)

  • Publication Type: Article / Article
  • Volume: 7 Issue: 3
  • Publication Date: 2018
  • Doi Number: 10.5539/jel.v7n3p148
  • Journal Name: Journal of Education and Learning
  • Journal Indexes: ERIC (Education Resources Information Center)
  • Page Numbers: pp.148-158
  • Akdeniz University Affiliated: Yes

Abstract

The aim of the present research study was to compare the findings from the nonparametric MSA, DIMTEST and DETECT and the parametric dimensionality determining methods in various simulation conditions by utilizing exploratory and confirmatory methods. For this purpose, various simulation conditions were established based on number of dimensions, number of items, item discrimination levels, sample size and correlation between dimensions values. The performance of dimensionality determining methods based on MSA and factor analysis are similar, yet MSA is more effective in determining the number of dimensions. However, the method of DETECT has displayed a more powerful performance when compared with the other dimensionality methods. Particularly the confirmatory DETECT method could reveal the true dimensionality in conditions of both low discrimination and high discrimination methods. On the other hand, the exploratory DETECT method was affected by discrimination and, thus, could perform well only with high-discrimination items. In conditions where the exploratory dimensionality reduction methods are used to determine the number of dimensions, it is beneficial to confirm this structure by using confirmatory dimensionality reduction methods. For this purpose, using confirmatory DETECT is particularly recommended.