Inter-Rater and IntraRater Reliability of Videotaped Performance of the Movement Competency Screen - 2 (MCS-2)

Abstract

The purpose of this study was to determine the intrarater and interrater reliability of the Movement Competency Screen—2 (MCS-2) in seven college female volleyball athletes (age = 17.7, ±1.39 yrs; height = 163.1 cm, ± 5.09 cm; and weight = 58.1, ±6.11 kg). The subjects were videotaped performing the ten (10) movements of MCS-2. The videos were then independently analyzed and scored by three separate raters of different backgrounds for two separate sessions with an interval of five days. Interrater reliability was calculated for each movement. Data were presented using mean ± standard deviation. Typical error was represented by %CV to establish absolute reliability. Intraclass correlation coefficient (ICC) was determined to indicate relative reliability. Smallest
worthwhile change (SWC) was computed using 0.2 × between-subject standard deviation. Results showed that the %CV of 16.0, 16.9, and 32.8 was seen in raters 1, 2, and 3, respectively. The ICC was 0.75 for rater 1 while 0.50 ICC was posted by rater 2 and ICC = 0.40 for rater 3. The SWC was 0.58 for rater 1, 0.62 for rater 2, and 1.77 for rater 3. For interrater values, day 1 delivered %CV = 18.1, ICC = −0.52, and SWC = 1.48. For day 2, MCS-2 %CV was 20.8 with ICC = 0.47 and SWC = 0.60. In conclusion, intrarater absolute and relative reliability for MCS-2 was poor. Test usefulness was also low for all raters. In addition, interrater absolute and relative reliability for MCS-2 was poor. Test usefulness for day 1 and day 2 was marginal.