Kansas State Department of Education KSDE FaceBook link KSDE Twitter link Contact KSDE

Interrater Agreement

Inter-rater Agreement is the degree to which two raters using the same scale give the same rating in identical situations.
  • Reliable raters agree with the "official" rating of an evaluation example.
  • Reliable raters agree with each other about the exact ratings to be awarded.
  • Reliable raters agree about which evaluation example is better and which is worse.
Inter-rater Agreement are essential to:
  • Bridge the credibility gap.
  • Train raters.
  • Monitor system performance.
  • Link professional development to evaluation results.
Within the evaluation process, Inter-rater Agreement are used during:
  • Teacher and Building Leader observations.
  • Teacher and Building Leader artifact reviews.
  • Teacher and Building Leader summary ratings #1 and #2.
  • Teacher and Building Leader final summative evaluation ratings.
 Inter-rater Agreement trainings at the district level need to include:
  • Team discussions and agreements about Inter-rater Reliability and Inter-rater Agreement.
  • Team review of data collection and analysis.
  • Training design at preservice and inservice levels.
  • Regular training check-ups.
  • Coaching and observation.
  • Monitoring ratings.


Inter-rater Agreement In Kansas Abilene 7-15-2014.pptx 

Educator Evaluation Contacts

Teacher Licensure and Accreditation

Team Director
Dr. Scott Myers

Assistant Director
Bill Bagshaw

Education Program Consultant
Ann Yates
Copyright 2016 by Kansas State Department of Education | 900 SW Jackson St. | Topeka, KS 66612 Privacy Statement  |  Terms Of Use  |  System Maintenance Notices  |  Open Records
The Kansas State Department of Education does not discriminate on the basis of race, color, national origin, sex, disability, or age in its programs and activities. (more information...)