Assessment of the resident's promotion exam: One step to validity of competency measurement in Arak University of Medical Sciences

Designing a tool for measuring of residents’competency with attention to their main role in ducation and practice of university. This study aims to assess the residents’ promotion tests of clinical epartments at Arak University of Medicals Sciences. This cross- sectional study that was undertook in 2010 at Arak University of Medical Sciences. even hundred and fifty multiple choice questions related to resident promotion tests in surgery, internal edicine, pediatrics, gynecology and anesthesiology was compared. Questionnaire of each department ontained 150 questions. hese questions were evaluated in the following domains: structure, Blum taxonomy, discrimination and ifficulty index of questions and compliance to the core curriculums. Data gathering tool were: Millmen tandard check list for evaluating questions’ structure and check list for evaluating Blum taxonomy and core urriculum and OMR system for evaluating discrimination and difficulty index. The validity and reliability f tools was confirmed and data were analyzed using by ANOVA and X2 tests. Results showed gynecology department had structural problem (4.5±4.2) compared with other epartments. Internal medicine department had the highest Blum domain (40% application and 47% omprehension), surgery department had the highest learning aims (90.7%) and was assessed as the most suitable questions from difficulty index (67.3%) and discrimination index (73.5%). There was significant difference between structural problem, core curriculum and rate of standard questions in various clinical epartments (P=0.001). This study confirmed the necessity of test assessment in universities, to form effective educational workshops, control of questions before exams and incentives for clinical departments to design standard questions. Development of electronic question analysis system is recommended.