reliability of second clinical skills OSCE in Mashhad by use of Generalizability theory

OSCE is a combination of simulation tasks to assess medical students'' skills in diagnosis and treatment of diseases. it is vital to measure the quality of an OSCE. One of the important steps in assessing the quality of a test is to determine it''s reliability. This study aimed to determine the reliability coefficient of the second clinical skills test in Mashhad by using generalizability theory.
Subjects & The OSCE was conducted in two days and consists of 15 parallel stations. 75 students and 30 examiners participated in this test. Check lists collected and recorded in Excel. Variances and mean squares (MS) calculated by using SPSS. Variance for stations¡ students and examiners and generalizability and reliability coefficients calculated by using EDUG. Mann-Whitney U and Chi square tests were used for assessing relation between students’ gender and score¡ raters’ gender and score and relation between students gender and raters gender.
There was no significant relationship between gender of students and their scores¡ gender of examiners and students’ scores¡ and between gender of students and gender of examiners. Reliability coefficient was calculated 0/98 and interaction between students¡ examiners and station component had the largest effect on creating measurement error.
this exam had a good reliability coefficient and according to results we can say¡ using Generalizability Theory for estimating the reliability coefficient¡ measurement error¡ and to identify impact of any facets on measurement error is a logical way. However¡ more research needs to be done.