RELIABILITY OF “OBJECTIVE STRUCTURED ASSESSMENT OF CATARACT SURGICAL SKILL (OSACSS)”

Objective Structured Assessment of Cataract Surgical Skill

Abstract

Objective: To estimate the reliability of Objective Structured Assessment of Cataract Surgical Skill (OSACSS)
Study Design: Co-relational reliability.
Place and Duration of Study: Department of Ophthalmology, Lahore General Hospital (LGH) 1st Nov 2015 to 30th Jan 2016.
Material and Methods: Eleven operations performed by trainees and surgeons were recorded. Three raters/ observers (including one very experienced, one having comparatively less experience and one novice) observed the recordings and rated on the Objective Structured Assessment of Cataract Surgical Skill (OSACSS) checklist. The same checklist was filled three weeks later by each observer. Inter and intra rater reliability was assessed.
Results: Inter rater reliability (Cronbach’s Alpha) was 0.681 (Questionable) in the first test and 0.878 (Good) in the Intrarater reliability (Cronbach’s Alpha) was 0.918 (Excellent) for the rater A, 0.844 (Good) for rater B and 0.662 (Questionable) for rater C.
Conclusion: Objective Structured Assessment of Cataract Surgical Skill (OSACSS) had excellent intra rater reliability in experienced hands and intra rater reliability decreases as the experience of the observer/rater decreases. Inter rater reliability increased in the retest indicating more experience of the observers/raters would make the instrument more reliable.