Process Evaluation of introducing Online Faculty Evaluation by Residents at a Tertiary Care Hospital in Pakistan
Khadija N Humayun, Farah N Qamar, Sana Saeed, Fozia Memon, Asif R Khowaja
Citation Information :
Humayun KN, Qamar FN, Saeed S, Memon F, Khowaja AR. Process Evaluation of introducing Online Faculty Evaluation by Residents at a Tertiary Care Hospital in Pakistan. J Postgrad Med Edu Res 2018; 52 (1):16-21.
Faculty evaluation by resident physicians is uncommon in postgraduate medical education. This study is designed to conduct process evaluation of an online faculty evaluation by postgraduate residents at Aga Khan University Hospital in Karachi, Pakistan.
Materials and methods
Action research design was utilized, and qualitative assessments were conducted between April and May 2013 at a private tertiary care hospital in the city of Karachi, Pakistan. Data were collected from the pediatric faculty and residents through focus group discussions (FGDs). The transcribed data were analyzed using computer software QSR NVivo version 10.0, and themes and subthemes were drawn.
Results
A total of five FGDs were conducted, three with faculty members and two with residents. The participants agreed that faculty evaluation is a critical element of the residency program, as it not only facilitates in identifying areas of improvement, but also contributes toward faculty's professional growth. However, ambiguity about the purpose of evaluation, lack of understanding of the components of the online evaluation form, and problems with rating scale and review process were reported. A large majority of participants recommended arranging motivation sessions for faculty and residents, ensuring privacy of rating by residents, modifying the rating scale and analysis, and defining the process of reviewing and sharing the feedback with faculties.
Conclusion
Process evaluation was an important exercise and it helped to understand and improve the online faculty evaluation in the pediatric residency program.
How to cite this article
Humayun KN, Qamar FN, Saeed S, Memon F, Khowaja AR. Process Evaluation of introducing Online Faculty Evaluation by Residents at a Tertiary Care Hospital in Pakistan. J Postgrad Med Edu Res 2018;52(1):16-21.
Redesigning residency education in internal medicine: a position paper from the Association of Program Directors in Internal Medicine. Ann Intern Med 2006 Jun;144(12):920-926.
A continuous quality improvement curriculum for residents: addressing core competency, improving systems. Acad Med 2004 Oct;79(Suppl 10):S65-S67.
Trends in the physician workforce, 1980-2000. Health Aff (Millwood) 2002 Feb;21(5):165-173.
There's a shortage of specialists: is anyone listening? Acad Med 2002 Aug;77(8):761-766.
The “Culture OSCE”—introducing a formative assessment into a postgraduate program. Educ Health (Abingdon) 2007 May;20(1):11.
Techniques for evaluating residents and residency programs. Pediatrics 1996 Dec;98(6 Pt 2):1277-1283; discussion 1289-1292.
Global rating scales in residency education. Acad Med 1996 Jan;71(1 Suppl):S55-S63.
Global health training in pediatric residency programs. Pediatrics 2008 Jul;122(1):28-33.
How residents perceive their teaching role in the clinical setting: a qualitative study. Med Teach 2002 Jan;24(1):57-61.
Strategies for improving teaching practices: a comprehensive approach to faculty development. Acad Med 1998 Apr;73(4):387-396.
Generation X: implications for faculty recruitment and development in academic health centers. Acad Med 2005 Mar;80(3):205-210.
Residents-as-teachers training in U.S. residency programs and offices of graduate medical education. Acad Med 2001 Oct;76(10 Suppl):S1-S4.
Stress management in medical education: a review of the literature. Acad Med 2000 Jul;75(7):748-759.
A review of the evaluation of clinical teaching: new perspectives and challenges. Med Educ 2000 Oct;34(10):862-870.
Improvement of faculty teaching performance: efficacy of resident evaluations. Acad Radiol 1996 Jan;3(1):63-67.
An instrument designed for faculty supervision evaluation by anesthesia residents and its psychometric properties. Anesth Analg 2008 Oct;107(4):1316-1322.
Professionalism in residency training. J Coll Physicians Surg Pak 2009 Nov;19(11):675-677.
Postgraduate trainee performance with structured assessment techniques in competency-based model of training. J Coll Physicians Surg Pak 2011 Jun;21(6):338-341.
Issues and priorities of medical education research in Asia. Ann Acad Med Singapore 2004 Mar;33(2):257-263.
A systematic review of faculty development initiatives designed to improve teaching effectiveness in medical education: BEME Guide No. 8. Med Teach 2006 Sep;28(6):497-526.
'Best practice' in focus group research: making sense of different views. J Adv Nurs 2006 Dec;56(5):491-497.
“Researcher saturation”: the impact of data triangulation and intensive-research practices on the researcher and qualitative research process. Qual Health Res 2007 Dec;17(10):1392-1402.
; Huberman, AM. Qualitative data analysis: an expanded sourcebook. 2nd ed. Thousand Oaks (CA): Sage Publications; 1994.
Faculty development for teaching and evaluating professionalism: from programme design to curriculum change. Med Educ 2005 Feb;39(2):127-136.
Professionalism in medical education: an institutional challenge. Acad Med 2006 Oct;81(10):871-876.
Are anonymous evaluations a better assessment of faculty teaching performance? A comparative analysis of open and anonymous evaluation processes. Fam Med 2005 Jan;37(1):43-47.
Online evaluations of teaching: an examination of current practice and considerations for the future. New Dir Teach Learn 2003 Dec;2003(96):103-112.
Development and implementation of a web-based evaluation system for an internal medicine residency program. Acad Med 2001 Jan;76(1):92-95.
Assessment of a 360-degree instrument to evaluate residents' competency in interpersonal and communication skills. Acad Med 2004 May;79(5):458-463.
