Validation and Reliability of Hidden Informal Curriculum Assessment Tool In Pakistani Preceptive

Faisal Hanif; Rehan Ahmed  Khan; Rahila  Yasmeen

doi:10.51253/pafmj.v75i1.11568

Authors

Faisal Hanif Department of Microbiology, Army Medical College Rawalpindi/National University of Medical Sciences (NUMS) Pakistan
Rehan Ahmed Khan Department of Medical Education, Riphah International UniversityRawalpindi Pakistan
Rahila Yasmeen Department of Microbiology, Army Medical College Rawalpindi/National University of Medical Sciences (NUMS) Pakistan

DOI:

https://doi.org/10.51253/pafmj.v75i1.11568

Keywords:

Confirmatory Factor Analysis, Construct Validity, Hicat Tool, Hidden Curriculum

Abstract

Objective: To establish construct validity of the Hidden Informal Curriculum Assessment Tool(HICAT) among Pakistani medical students.

Study Design: Quantitative Instrument validation study

Place and Duration of Study: Army Medical College, National University of Medical Sciences, Rawalpindi, Pakistan from Jan to Jun 2023.

Methodology: Data collection for was done using manually printed forms, with a minimum of thirty participants per session. A total of 271 participants were involved. The first phase of the study involved response process validity, Six individuals—four medical students and two teachers—reviewed the HICAT tool. feedback on clarity, relevance, and comprehensibility of the items was obtained. A mix of verbal probing and think-aloud techniques was used to assess content validity. The tool was revised to reduce bias by mixing positive and negative items. The participants rated the items on a five-point scale.The second phase focused on data collection from 3rd, 4th, and 5th-year students. After the collection of data, analysis was done by doing a Confirmatory factor analysis.

Results: After rerunning confirmatory factor analysis, items that had low loading in each component were removed, and modification indices were established to obtain a goodness-of-fit model. In summary, the construct validity analysis of the HICAT tool resulted in the removal of one item from positive traits and three items from negative traits, leaving a total of sixteen items.

Conclusion: The HICAT tool demonstrates satisfactory construct validity in the Pakistani culture and context for assessing the hidden informal curriculum among medical educational institutions.

Downloads

References

Lawrence C, Mhlaba T, Stewart KA, Moletsane R, Gaede B, Moshabela M. The Hidden Curricula of Medical Education: A Scoping Review. Academic Med 2018; 93(4): 648–656.

https://doi.org/10.1097/acm.0000000000002004

McGurgan PM, Carmody D, Tregonning A. Measuring the “Iceberg”- Quantifying the hidden and informal curriculum in clinical rotations using the Hidden Informal Curriculum Assessment Tool (HICAT). Med Ed Publish 2015; 5: 2 http://doi.org/10.15694/mep.2015.005.0002

Hafferty FW. Beyond curriculum reform: confronting medicine’s hidden curriculum. Acad Med 1998; 73(4): 403–407.

https://doi.org/10.1097/00001888-199804000-00013

Cronbach LJ, Meehl PE. Construct validity in psychological tests. Psychol Bull 1955; 52(4): 281–302. https://psycnet.apa.org/doi/10.1037/h0040957

Sambell K, McDowell L. The Construction of the Hidden Curriculum: messages and meanings in the assessment of student learning. Assess Eval High Educ 1998; 23(4): 391–402.

https://doi.org/10.1080/0260293980230406

Schumacker R, Lomax R. A Beginner’s Guide to Structural Equation Modeling. Routledge; 2012.

Rubio DM, Berg-Weger M, Tebb SS, Lee ES, Rauch S. Objectifying content validity: Conducting a content validity study in social work research. Soc Work Res 2003; 27(2): 94–104. http://www.jstor.org/stable/42659521

Meekosha H, Shuttleworth R. What’s so ‘critical’ about critical disability studies? Australian Journal of Human Rights 2009; 15(1): 47–75.

http://doi.org/10.1080/1323238X.2009.11910861

Streiner DL. Figuring out factors: The use and misuse of factor analysis. Can J Psychiatry 1994; 39(3): 135-140.

https://doi.org/10.1177/070674379403900303

Gorsuch RL. Factor Analysis. 2nd edition. Hillsdale: NJ: Erlbaum.; 1983.

Jackson DL, Gillaspy JA, Purc-Stephenson R. Reporting Practices in Confirmatory Factor Analysis: An Overview and Some Recommendations. Psychol Methods 2009; 14(1).

https://doi.org/10.1037/a0014694

Andarvazh MR, Afshar L, Yazdani S. Hidden Curriculum: An Analytical Definition.J Med Edu 2017: 16(4)e105592.

http://doi.org/10.22037/jme.v16i4.18061

Yazdani S, Momeni S, Afshar L, Abdolmaleki M. A comprehensive model of hidden curriculum management in medical education. J Adv Med Educ Prof 2019; 7(3): 123–130.

http://www.ncbi.nlm.nih.gov/pubmed/31528646

Ewen S, Mazel O, Knoche D. Exposing the hidden curriculum influencing medical education on the health of Indigenous people in Australia and New Zealand: the role of the Critical Reflection Tool. Acad Med 2012; 87(2): 200–205.

https://doi.org/10.1097/acm.0b013e31823fd777

Mulder H, Ter Braak E, Chen HC, Ten Cate O. Addressing the hidden curriculum in the clinical workplace: A practical tool for trainees and faculty. Med Teach 2019; 41(1): 36–43.

https://doi.org/10.1080/0142159x.2018.1436760

Akçakoca B, Orgun F. Developing a measurement tool for evaluating the hidden curriculum in nursing education. Nurse Educ Today 2021; 97: 104688.https://doi.org/10.1016/j.nedt.2020.104688

Rauf A, Fatima F, Gilani R, Shabnam N. Development and validation of a questionnaire about hidden curriculum in medical institutes: A pilot study. Front Med 2023; 9-10. https://doi.org/10.3389/fmed.2023.996759

Rauf A, Fatima F, Tayyab A, Qamar K, Masrur A, Ayub R, et al. Exploring the Elements of Hidden Curriculum in Medical Institutes: An Ethnographic Approach. Multicultural Educ 2021; 7(10)544-554 http://doi.org/10.5281/zenodo.5579345

Ahmed F, Afridi A, Sethi A, Kashif L. Assessment of hidden curriculum during clinical rotations of year 4 MBBS students using informal curriculum assessment tool (HICAT) J Med Sci 2020; 28(4): 352-355.http://doi.org/10.52764/jms.20.28.4.10

Sharma S, Mukherjee S, Kumar A, Dillon WR. A simulation study to investigate the use of cutoff values for assessing model fit in covariance structure models. J Bus Res 2005; 58(7): 935–943.

http://doi.org/10.1016/j.jbusres.2003.10.007

Miles J, Shevlin M. A time and a place for incremental fit indices. Pers Individ Dif 2007; 42(5).http://doi.org/10.1016/j.paid.2006.09.022