Research Information System
Journal of Education and Learning, vol.7, no.3, pp.148-158, 2018 (Peer-Reviewed Journal)
The aim of the present research study was to compare the findings from the nonparametric MSA, DIMTEST and DETECT and the parametric dimensionality determining methods in various simulation conditions by utilizing exploratory and confirmatory methods. For this purpose, various simulation conditions were established based on number of dimensions, number of items, item discrimination levels, sample size and correlation between dimensions values. The performance of dimensionality determining methods based on MSA and factor analysis are similar, yet MSA is more effective in determining the number of dimensions. However, the method of DETECT has displayed a more powerful performance when compared with the other dimensionality methods. Particularly the confirmatory DETECT method could reveal the true dimensionality in conditions of both low discrimination and high discrimination methods. On the other hand, the exploratory DETECT method was affected by discrimination and, thus, could perform well only with high-discrimination items. In conditions where the exploratory dimensionality reduction methods are used to determine the number of dimensions, it is beneficial to confirm this structure by using confirmatory dimensionality reduction methods. For this purpose, using confirmatory DETECT is particularly recommended.