Kansas State Department of Education KSDE FaceBook link KSDE Twitter link Contact KSDE

Interrater Agreement

Inter-rater Agreement is the degree to which two raters using the same scale give the same rating in identical situations.
  • Reliable raters agree with the "official" rating of an evaluation example.
  • Reliable raters agree with each other about the exact ratings to be awarded.
  • Reliable raters agree about which evaluation example is better and which is worse.
Inter-rater Agreement are essential to:
  • Bridge the credibility gap.
  • Train raters.
  • Monitor system performance.
  • Link professional development to evaluation results.
Within the evaluation process, Inter-rater Agreement are used during:
  • Teacher and Building Leader observations.
  • Teacher and Building Leader artifact reviews.
  • Teacher and Building Leader summary ratings #1 and #2.
  • Teacher and Building Leader final summative evaluation ratings.
 Inter-rater Agreement trainings at the district level need to include:
  • Team discussions and agreements about Inter-rater Reliability and Inter-rater Agreement.
  • Team review of data collection and analysis.
  • Training design at preservice and inservice levels.
  • Regular training check-ups.
  • Coaching and observation.
  • Monitoring ratings.

IRA FACT SHEET.pdf

Inter-rater Agreement In Kansas Abilene 7-15-2014.pptx 

Educator Evaluation Contacts

Teacher Licensure and Accreditation
@KSDE_TLA
@KSDELicense

Team Director
Dr. Scott Myers

Assistant Director
Bill Bagshaw
785-296-2198
bbagshaw@ksde.org
@bbagshaw1

Education Program Consultant
Ann Yates
evaluation@ksde.org
785-296-5140
Copyright 2016 by Kansas State Department of Education | 900 SW Jackson St. | Topeka, KS 66612 Privacy Statement  |  Terms Of Use  |  System Maintenance Notices  |  Open Records (PDF)
The Kansas State Department of Education does not discriminate on the basis of race, color, national origin, sex, disability, or age in its programs and activities. (more information...)