Abstract

MENDOZA RAMOS, Arturo. The Use of Many-Facet Rasch Measurement to Examine the Quality of Evaluating Performance Assessments. RMIE [online]. 2018, vol.23, n.77, pp.597-625. ISSN 1405-6666.

Performance assessments are criticized for the assumed lack of consistency in the results delivered by evaluators. However, statistical tools such as the Many-Facet Rasch Measurement (MFRM) are useful for examining the quality of the assessment process in tests with multiple facets of variability. The objective of this article is to present the functioning and contributions of MFRM on performance assessments. The study was carried out with non-Spanish-speaking university students who completed a written test of Spanish with academic ends. The results showed adequate levels of severity and indulgence among the evaluators, as well as in task difficulty and the analytical rubric employed to evaluate the texts. The conclusion is that MFRM is useful for examining the process of evaluating performance assessments.

Keywords : statistical analysis; quantitative evaluation; academic evaluation; examinations and certification.