Designing and Psychometry of the Evaluation Checklist for the Registration and Labeling Guidelines of Anesthetic Drugs in the Operating Room

The correct registration and labeling of anesthetic drugs in the operating room are the basic and important principles in order to maintain patient safety, reduce the wastage of drugs and their subsequent costs, and reduce environmental pollution. Therefore, the present study was conducted with the aim of designing and psychometry of evaluation checklist for the registration and labeling guidelines of anesthetic drugs in the operating room.

This descriptive-analytical research was conducted in 2022 in the Iran University of Medical Sciences. In order to design the checklist, the latest and most reliable scientific sources in the field of anesthesia were examined and the opinions of experts of the university's Department of Anesthesia were used. To determine the validity of the checklist, face and content validity (content validity index and content validity ratio) were calculated. In order to determine the reliability of the checklist, two methods of test-retest reliability and inter-rater reliability were used. The research results were analyzed using SPSS 22 software.

All the examined items in the checklist had good status in terms of face validity index and terms of the obtained importance score in comparison with the optimal level of effect (1.5 and more) (Table 1). Based on this, all items on the checklist obtained the necessary criteria for face validity and remained on the checklist. The evaluation results of the content validity index and value of the content validity index showed that most of the items had the desired statistical limits in the field of content validity, and their validity was confirmed in this respect; in other words, the measurement of the content validity ratio (CVR) showed that the score of 15 of the 19 initial items of the checklist was greater than the value of the Lawshe table (0.62) and these items remained in the checklist. This indicated that essential and important items were used in this checklist (Table 2). The score of the item of "the method of writing capital letters is used for drugs with similar names" was obtained as 0.60; due to the closeness of this number to the optimal level and due to the high content validity index of this item which was obtained as 1, and using the opinion of experts, this item was retained. Also, based on the research findings, the content validity index (CVI) in all items was more than 0.79; therefore, the mentioned items were recognized as suitable, and there was no change in the appearance of the items. Finally, using the results of CVR and CVI and considering the optimal level for these indicators, three items were removed from the checklist, and the final checklist with 16 items was designed and psychometrically evaluated (Table 2).The results of the retest method using the intraclass correlation coefficient are presented in Table 3. In this method, ICC value was 0.992 (95% confidence interval). Also, Cronbach's alpha was 0.912 for the preliminary test and 0.992 for the second test (retest), which results showed that the checklist designed in terms of reliability over time (using the test-retest or test-retest validity method) has good reliability.The results of the inter-rater agreement method using the intraclass correlation coefficient to check the reliability are presented in Table 4. In this method, the ICC rate was 0.987 (with a 95% confidence interval), which indicated that the checklist designed with the method of an inter-rater agreement had good reliability.

The research findings show the checklist's face and content validity and good reliability. Therefore, it can be used to evaluate the level of observance of the guidelines for registering and labeling anesthetic drugs.