잠시만 기다려 주세요. 로딩중입니다.

채점자 조정(calibration) 교육 제안을 위한 평가자 신뢰도 분석

Analysis of Evaluator Reliability for the Raters’ Calibration Training

대한치과의사협회지 2020년 58권 5호 p.284 ~ 291
김주아 ( Kim Joo-Ah ) - Yonsei University College of Dentistry Department of Dental Education

신유석 ( Shin Yoo-Seok ) - Yonsei University College of Dentistry Department of Conservative Dentistry
서정택 ( Seo Jeong-Taeg ) - Yonsei University College of Dentistry Department of Oral Biology

Abstract


This study analyzed the change in the rater reliability based on the student's practice evaluation process conducted at Yonsei University College of Dentistry. Through this, we suggest the significance of the rater calibration training in the student's practical evaluation of dental college. Nine professors from the department of Conservative Dentistry, Yonsei University College of Dentistry, analyzed the results of class II restoration cases twice in 2017 and once in 2018. Intra Class Correlation (ICC) which is a statistic used to determine the consistency of raters with three or more scores, was also calculated. ICC values increased as raters participated in rater calibration meetings and grading experiences. This shows that the rater reliability is related to the grading experience and feedback from calibration meeting. Based on the results of previous studies that grading experiences and rater calibration training can cause a meaningful change in rater behavior, we propose to conduct rater calibration training to ensure the evaluator reliability

키워드

reliability; rater calibration; intra-class correlation
원문 및 링크아웃 정보
등재저널 정보