Crossed Random-Effect Modeling: Examining the Effects of Teacher Experience and Rubric Use in Performance Assessments


KAN A., Bulut O.

EURASIAN JOURNAL OF EDUCATIONAL RESEARCH, sa.57, ss.1-27, 2014 (ESCI) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Basım Tarihi: 2014
  • Doi Numarası: 10.14689/ejer.2014.57.4
  • Dergi Adı: EURASIAN JOURNAL OF EDUCATIONAL RESEARCH
  • Derginin Tarandığı İndeksler: Emerging Sources Citation Index (ESCI), Scopus, TR DİZİN (ULAKBİM)
  • Sayfa Sayıları: ss.1-27
  • Anahtar Kelimeler: Performance assessment, rubric, teaching experience, reliability, rater effects, crossed random effects model
  • Gazi Üniversitesi Adresli: Evet

Özet

Problem Statement: Performance assessments have emerged as an alternative method to measure what a student knows and can do. One of the shortcomings of performance assessments is the subjectivity and inconsistency of raters in scoring. A common criticism of performance assessments is the subjective nature of scoring procedures. The effectiveness of the performance assessment procedure depends highly on the quality and coordination of teacher and rubric. To gain a better understanding of the interaction between teachers and performance assessments, it is crucial to examine the effects of teacher-related factors and how teachers interact with scoring rubrics when grading performance assessments. One of these factors is teachers' work and scoring experience. When grading performance assessments, the experienced teachers may be expected to grade student performances more objectively through their experience in instruction and evaluation than the teachers with less teaching and scoring experience.