Validation of Assessment-of-Clinical-Exodontia-Skill (ACES) Rating Scale for Assessment of Exodontia in Undergraduate Dental Students

Muhammad Usman Khalid; Abid Ashar; Tanzeela Khalid

doi:10.51253/pafmj.v76i1.10868

Authors

Muhammad Usman Khalid Department of Oral & Maxillofacial Surgery, PMC Dental Institute, Faisalabad Medical University, Faisalabad Pakistan
Abid Ashar Department of Oral & Maxillofacial Surgery, Fatima Memorial Hospital, College of Medicine & Dentistry, Lahore Pakistan
Tanzeela Khalid Department of Dermatology, University Medical & Dental College, The University of Faisalabad Pakistan

DOI:

https://doi.org/10.51253/pafmj.v76i1.10868

Keywords:

Assessment, Dental students, Educational measurements, Tooth extraction, Validation

Abstract

Objective: To validate assessment-of-clinical-exodontia-skill (ACES) rating scale for formative and summative assessment of undergraduate dental students’ exodontia skill.

Study Design: Validation study.

Place and Duration of Study: Department of Oral and Maxillofacial Surgery, Faisalabad Medical University, Faisalabad, Pakistan, from Feb to Sep 2022.

Methodology: Two forms were used for data collection: ACES form and feedback form. Two consultant oral and maxillofacial surgeons assessed each student simultaneously while extraction on live patients was performed and scores were recorded. This was done after one month and after completion (2 months) of oral surgery rotation. Both students and consultants filled in a feedback form and results were analyzed.

Results: Fifty (n=50) students participated in study and validity was measured in terms of construct validity where all variables of ACES rating scale had a p-value of >0.05 for both observers while reliability was measured in terms of internal consistency and inter-rater reliability. Internal consistency was 0.88±0.01 and 0.83±0.08 for Observer 1 and 2 respectively. Inter-rater reliability of overall score was 0.69 and 0.75 for formative and summative assessment respectively. ACES rating scale was a fair instrument (48.10%) and it provided adequate feedback to the students regarding their competence level (59.60%). Overall students and examiners thought that ACES rating scale should be used for assessment of exodontia skills (61.50%).

Conclusion: ACES was found to be acceptable and feasible by students and assessors as a validated tool for formative and summative assessment of exodontia skills in terms of construct validity, internal consistency and inter-rater reliability

Downloads

Download data is not yet available.

References

1. Macluskey M, Hanson C, Kershaw A, Wight AJ, Ogden GR. Development of a structured clinical operative test (SCOT) in the assessment of practical ability in the oral surgery undergraduate curriculum. Br Dent J 2004; 196: 225-228.

https://doi.org/10.1038/sj.bdj.4810946

2. Jaibaji R, Dominic C, Raja A, Aldabbagh Y. Exposure and awareness of oral and maxillofacial surgery for first degree medical undergraduates in the United Kingdom. Br J Oral Maxillofac Surg 2023; 61: 165-170.

https://doi.org/10.1016/j.bjoms.2022.09.005

3. Macluskey M, Durham J. Oral surgery undergraduate teaching and experience in the United Kingdom: a national survey. Eur J Dent Educ 2009; 13: 52-57.

https://doi.org/10.1111/j.1600-0579.2008.00531.x

4. Redford R, Durkan C, Sivarajasingam V, Emanuel C. Students' perceptions of exodontia competency assessment in a UK dental school. Eur J Dent Educ 2018; 22: 92-100.

https://doi.org/10.1111/ejed.12284

5. Cabbar F, Burdurlu MC, Ozcakir Tomruk C, Bank B, Atalay B. Students' perspectives on undergraduate oral surgery education. BMC Med Educ 2019; 19: 304.

https://doi.org/10.1186/s12909-019-1746-3

6. 6. Shah S, Halai T. Perceived confidence and experience in oral surgery among final year undergraduate students in a UK dental school. Br Dent J 2018; 224: 177-182.

https://doi.org/10.1038/sj.bdj.2018.82

7. Fatemeh K, Alavinia SM. Students' perception about logbook: advantages, limitations and recommendations - a qualitative study. J Pak Med Assoc 2012; 62: 1184-1186.

8. Janjua OS, Ashar A, Khalid T. Developing an assessment-of-clinical-exodontia-skills (ACES) rating scale for undergraduate dental students. J Coll Physicians Surg Pak 2019; 29: 463-468.

https://doi.org/10.29271/jcpsp.2019.05.463

9. Balkany T, Lo K, Francis H, Angeli S, Novak M, Luxford W, et al. Development and validation of the cochlear implant surgical competency assessment instrument. Otol Neurotol 2017; 38: 504-509.

https://doi.org/10.1097/MAO.0000000000001344

10. Anziani H, Durham J, Moore U. The relationship between formative and summative assessment of undergraduates in oral surgery. Eur J Dent Educ 2008; 12: 233-238.

https://doi.org/10.1111/j.1600-0579.2008.00517.x

11. Majid OW. Assessment of clinical ability in the removal of teeth among undergraduate dental students: a longitudinal comparative study. Br J Oral Maxillofac Surg 2018; 56: 870-876.

https://doi.org/10.1016/j.bjoms.2018.07.013

12. Durham J, Balmer C, Bell A, Cowan G, Cowpe J, Crean SJ, et al. A generic consensus assessment of undergraduate competence in forceps exodontia in the United Kingdom. Eur J Dent Educ 2010; 14: 210-214.

https://doi.org/10.1111/j.1600-0579.2009.00599.x

13. Brand HS, van der Cammen CCJ, Roorda SME, Baart JA. Tooth extraction education at dental schools across Europe. BDJ Open 2015; 1: 15002.

https://doi.org/10.1038/bdjopen.2015.2

14. Kamal M, Abdulwahab M. Self-confidence in oral and maxillofacial surgery: a cross-sectional study of undergraduate dental students at Kuwait University. BMC Med Educ 2021; 21: 577. https://doi.org/10.1186/s12909-021-02990-3

15. Soh TC, Lim ZZ, Yip HM. Does the UK undergraduate medical curriculum prepare students in oral and maxillofacial surgery? A scoping review. Br J Oral Maxillofac Surg 2020; 58: 1229-1234. https://doi.org/10.1016/j.bjoms.2020.06.015

16. Raina K, Poojary D, Shetty P, Khalid I, Rashmi KS, Chandana RD. Simulation based training in dental education-a review. Multicultural Education 2021; 7: 238-243.

17. Rehman U, Sarwar MS, Brennan PA. Attitude of clinical medical students to oral and maxillofacial surgery as a career: a perspective from two English medical schools. Br J Oral Maxillofac Surg 2022; 60: 448-453.

https://doi.org/10.1016/j.bjoms.2021.11.006

18. Behardien N, Brijlal P, Roman NV. Exodontia skills acquisition: focusing on clinical teaching and training. PLoS One 2023; 18: e0286737.https://doi.org/10.1371/journal.pone.0286737