PAKISTAN ARMED FORCES
MEDICAL JOURNAL (Category Y)

A Journal of Army Medical & Dental Corps

Being published since 1956

ISSN (online) 2411-8842
ISSN (print) 0030-9648

VOL 67, No. 5, OCTOBER 2017

RELIABILITY OF “OBJECTIVE STRUCTURED ASSESSMENT OF CATARACT SURGICAL SKILL (OSACSS)”

Khawaja Khalid Shoaib, Muhammad Moin

Abstract

Objective: To estimate the reliability of Objective Structured Assessment of Cataract Surgical Skill (OSACSS)
Study Design: Co-relational reliability.
Place and Duration of Study: Department of Ophthalmology, Lahore General Hospital (LGH) 1st Nov 2015 to 30th Jan 2016.
Material and Methods: Eleven operations performed by trainees and surgeons were recorded. Three raters/ observers (including one very experienced, one having comparatively less experience and one novice) observed the recordings and rated on the Objective Structured Assessment of Cataract Surgical Skill (OSACSS) checklist. The same checklist was filled three weeks later by each observer. Inter and intra rater reliability was assessed.
Results: Inter rater reliability (Cronbach’s Alpha) was 0.681 (Questionable) in the first test and 0.878 (Good) in the Intrarater reliability (Cronbach’s Alpha) was 0.918 (Excellent) for the rater A, 0.844 (Good) for rater B and 0.662 (Questionable) for rater C.
Conclusion: Objective Structured Assessment of Cataract Surgical Skill (OSACSS) had excellent intra rater reliability in experienced hands and intra rater reliability decreases as the experience of the observer/rater decreases. Inter rater reliability increased in the retest indicating more experience of the observers/raters would make the instrument more reliable.

Keywords : Objective structured assessment of cataract surgical skill (OSACSS), Reliability.



Creative Commons License
This is an Open Access article distributed under the terms of the Creative Commons Attribution License Creative Commons Attribution License , which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.