J4 ›› 2012, Vol. 11 ›› Issue (2): 40-43.

Previous Articles     Next Articles

Influence of Rater Orientation on Rating in Paired Oral Test

Many-Facet Rasch Model （MFRM）was adopted to investigate whether rater personality types had observable effect on the severity and internal self-consistency of rating. Four experienced raters and 10 paired candidates were selected and evaluation data were analyzed by SPSS and MFRM. The results showed that raters with different personality types had rated differently:introverted raters were more severe than extroverted ones; and in terms of the self-consistency in rating, there were no significant difference between them.   

  1. Department of Foreign Languages, Fujian University of Technology, Fuzhou 350108, China
  • Received:2011-12-10 Online:2012-02-15 Published:2012-02-15

PDF (PC)

521

Abstract:

Many-Facet Rasch Model （MFRM）was adopted to investigate whether rater personality types had observable effect on the severity and internal self-consistency of rating. Four experienced raters and 10 paired candidates were selected and evaluation data were analyzed by SPSS and MFRM. The results showed that raters with different personality types had rated differently:introverted raters were more severe than extroverted ones; and in terms of the self-consistency in rating, there were no significant difference between them.

Key words: Many-Facet Rasch Model, paired oral scoring, rating bias

CLC Number: