Developing counseling skills through pre-recorded videos and role play: a pre- and post-intervention study in a Pakistani medical school
© Ahsen et al; licensee BioMed Central Ltd. 2010
Received: 10 June 2009
Accepted: 26 January 2010
Published: 26 January 2010
Interactive methods like role play, recorded video scenarios and objective structured clinical exam (OSCE) are being regularly used to teach and assess communication skills of medical students in the western world. In developing countries however, they are still in the preliminary phases of execution in most institutes. Our study was conducted in a naïve under resourced setup to assess the impact of such teaching methodologies on the counseling skills of medical students.
Fifty four 4th year MBBS students were identified to be evaluated for communication skills by trained facilitators in a pre-intervention OSCE. The same group of students was given a demonstration of ideal skill level by means of videos and role playing sessions in addition to real life interaction with patients during hospital and community rotations. A post-intervention evaluation was carried out six months later through OSCE and direct observation through structured checklist (DOS) in hospital and community settings. The combined and individual performance levels of these students were analyzed.
There was a statistically significant difference in the communication skills of students when assessed in the post-intervention OSCE (p = 0.000). Individual post-intervention percentages of study participants displayed improvement as well (n = 45, p = 0.02). No difference was observed between the scores of male and female students when assessed for two specific competencies of antenatal care and breast feeding counseling (p = 0.11). The mean DOS (%) score of 12 randomly selected students was much lower as compared to the post-intervention (%) score but the difference between them was statistically non significant, a result that may have been affected by the small sample size as well as other factors that may come into play in real clinical settings and were not explored in this study (59.41 ± 7.8 against 82.43 ± 22.08, p = 0.88).
Videos and role play in combination with community and clinical exposure are effective modes of teaching counseling skills to medical students. They can be successfully utilized even in a limited resource setup, as demonstrated by our trial.
Counseling on health promotion, disease prevention and cure is a fundamental part of any medical consultation. It has a direct impact on patient health and an overall impact on the burden of disease in the community. In a third world country like Pakistan where malnutrition, lack of infant immunization and diarrheal diseases are still significant problems , it is imperative for doctors to be able to effectively counsel their patients about common primary health issues . This is only possible if the doctor possesses adequate knowledge on the topic and is able to transmit that information to the patients satisfactorily.
There is evidence that good communication translates into increased patient satisfaction and compliance resulting in better outcomes [3, 4]. Although traditionally centered on paternalism, healthcare in Pakistan is gradually evolving into a more individual centered model. This change has been a recipient of mixed response from both care-givers as well as seekers in our setup. In a system where physician-patient communication is invariably hampered by factors like illiteracy, ignorance, poverty, hierarchical family structure and male dominance, an immediate switch to complete patient autonomy is not possible. In the transitory phase most doctors are trying to maintain a balance between autonomy and paternalism [5, 6].
Meanwhile medical educators in the developed countries are striving to incorporate communication skills training in the undergraduate and postgraduate curricula [7, 8]. Recently, there has been a change in many institutions from the traditional didactic methods towards more interactive methods like role-playing and screening of video-recorded doctor-patient interactions to the students [4, 7–9]. The perceived benefits of these methodologies are based on the work of Kolb & Fry who described four learning environments in their theory of experiential learning . They proposed that learning is greatly facilitated when all four 'learning environments' are simultaneously employed: affectively-oriented (feeling), symbolically-oriented (thinking), perceptually-oriented (watching) and behaviorally-oriented (doing). Role-playing and video-recorded scenarios, when combined with actual practice on patients, include all four and are thus currently in vogue for communication skills training .
While many schools in the West have introduced formal communication skills training, such a trend has not yet picked up in Pakistan. This study was carried out keeping in mind the need to introduce counseling skills training using interactive methods in Pakistan, followed by its practical application through student-patient encounters. Finally, the objective assessment of the impact of such curricular changes was also addressed in this study.
The study was carried out at FMH College of Medicine and Dentistry, a private medical college in Lahore, Pakistan. The college admits an average of 75 students in every class and follows the typical five year curriculum as determined by the Pakistan Medical and Dental Council (PMDC), and the University of Health Sciences (UHS). The first two years are devoted entirely to Basic Health Sciences while clinical rotations are part of the curriculum for the next three years. This study involved fourth year medical students during the session 2006-07.
Before the intervention, students had not received any formal training in communication skills in the medical college. The curriculum did not provide a designated slot for a rotation in Community Medicine as well. Our intervention included a two-week rotation with the Community Medicine Department and four video-recorded scenarios depicting an ideal doctor-patient encounter. Four instructors of the department were trained to counsel for vaccination of infants, diarrhea management, breast feeding and antenatal care. The same instructors were also trained to act as patients. The instructors alternated between acting as patients and physicians to produce videos on these four topics of counseling, each lasting about 15 minutes. The same facilitators also observed and evaluated the students later on, in test as well as real clinical settings.
The videos covered the essential elements of physician-patient communication including the ways to open a consultation, use of open and close ended questions, clarifications, facilitation, reflection and assessment of patient understanding . The videos were prepared completely in Urdu (the national language of Pakistan) since the local community in Pakistan mostly does not understand English. To the best of our knowledge, these are the first such video scenarios recorded in Urdu for the undergraduate level. All videos were reviewed by a family physician and a psychologist for adequacy of content.
The checklists used had been pretested on students passing through fourth year in the previous year, to ascertain the feasibility of the study design. This group of students on an average scored similar to the pre-intervention group of the study. They were subsequently utilized in the actual study without any change.
Each participant of the trial underwent an initial assessment at the beginning of the two week rotation in the four selected categories through role playing by trained instructors. Students were made to practice these counseling skills on real patients encountered during their visits to community clinics. These encounters were observed by the same facilitators using guidelines similar to the items inclusive in the assessment checklists. On-the-spot feedback was provided to the students. The post-intervention OSCE was repeated after six months and the results of the two were compared in order to objectively document the effect of the intervention provided . Moreover, one actual real-time student-patient interaction in a clinical or community setting was randomly selected out of the post intervention group for each counseling topic and graded with the same checklist that had been used earlier in the OSCEs (Direct Observation through structured checklist DOS).
Data was entered and analyzed using SPSS 12.0. Paired t-test was performed with the one-tailed probability set at 0.05.
The project was approved by the Institutional Review Board and Ethical committee of FMH College of Medicine & Dentistry, Lahore. The study was in compliance with the 'Ethical Principles for Medical Research Involving Human Subjects' as laid down in the Helsinki Declaration . Since the rotation was part of their curriculum and approved by the academic council of the college, individual informed consent was not required from every student.
Fifty-four out of 75 fourth year MBBS students (41 females and 13 males) were selected to complete the exercise in twelve batches. Twenty-one had to be excluded from the study as they failed to meet the selection criteria of being regular students who had been promoted at the beginning of the session after passing the university professional examination.
Mean pre- and post intervention OSCE scores of male and female students in four selected competencies
Students distribution according to gender
(Total N = 54)
Mean % Pre-intervention OSCE score
Mean % Post-intervention OSCE score
N = 41
N = 13
Comparison of mean post-intervention OSCE and DOS scores of selected students in each competency
Mean % Post-intervention OSCE score
Mean % DOS score
Mean post-intervention OSCE and DOS scores of male and female students in selected competencies
Students distribution according to gender
(Total N = 12)
Mean % Post-intervention OSCE score
Mean % DOS score
N = 2
N = 10
Medical education in Pakistan requires a mandatory upgrading to the new methods of teaching, particularly in areas less addressed in the past. It is unanimously agreed amongst members of international graduate medical education and physician licensing boards that good counseling skills of health care providers will not only result in high-quality care provision through accurate flow of information between healthcare individuals, teams and patients but increased physician and patient satisfaction as well .
A variety of teaching and evaluation tools, are being developed to effectively incorporate CIS into physicians training and standardized assessments . While simulated patient (SP) based evaluation is being widely implemented globally as a method of CIS assessment in regular and high stake medical examinations, most medical institutes in this part of the world do not have the finances and man-power to execute it [17, 19, 20]. It is due to this missing link in our medical education that students face difficulties in foreign licensing exams. Studies have indicated that international medical graduates (IMGs) are more likely to feel pressed for time in clinical skills examination in comparison to the US graduates . Furthermore, about 17% of the IMGs fail the United States Medical Licensing Exam (USMLE) Step 2 Clinical Skills (CS) component mostly due to inadequate interpersonal skills as opposed to only 4% US graduates .
Lack of resources to execute performance-based assessment may be one of the reasons that some medical institutes in Pakistan have not taken this initiative. Prerecorded videotapes and objective assessment through role playing by trained facilitators are simple and cost effective alternatives. In addition, the successful incorporation of OSCE in the undergraduate medical curriculum by the faculty of National University at Cuyo, Mendoza, Argentina, despite the deficiency of technological and staffing resources, demonstrates that initiatives can be taken in resource-limited environments as well . Our trial in similar circumstances showed a very encouraging outcome albeit with certain limitations.
Due to the ethical concern of depriving students of an exercise that had been officially made part of the curriculum it was not possible to establish a true control group. The selected students, before intervention served as their own control. Being an independently planned and funded study, the ideal randomized control multi-centric trial could not be executed. The findings from this study are invaluable still, and can serve as the basis of conducting a more elaborate one in the future.
The unsatisfactory performance of students in real patient encounters is probably due to multiple factors that were not explored in this study, the leading ones being: a careless attitude when in a non-testing environment, language barrier (different local dialects), difficulty in adapting to hospital and outpatient departments, unease when dealing with non-familiar people etc. More importantly, the small sample size and limited number of encounters observed per student has also had an impact on the outcome. It is not possible to predict conclusively, the magnitude of the effect our intervention has had on the CIS of the selected students without a more robust experimental study. The next step should be to revise our medical schools curricula to include a regular CIS course and observe its effect on the performance level of students when all other confounding factors have been accounted for.
Based on this study, we suggest that medical schools of the developing world particularly Pakistan, should take initiatives to not only revise their curricula but train the facilitators to improvise teaching methodologies as well. This can be achieved with some effort on the part of the medical education departments and administration and does not necessarily imply the investment of multiple resources. Introduction of formal courses in communication skills and subsequent assessment can serve to build the competence level of the medical students . Significant evidence is available of the utility of such initiatives and their potential contribution to producing more effective health care providers .
Pre-recorded videos and role play are simple, cost effective tools for demonstrating counseling skills to medical students in addition to clinical and community exposure. The exact magnitude of the impact of intervention on the communication skills of students cannot be predicted in view of the limitations. However, it still offers significant evidence towards successful implementation of a formal communication skills development initiative, under resource limited circumstances.
NFA- FCPS (Community Medicine), Fellow Health Professions Education FHPE (FAIMER, USA) Professor of Community Health Sciences, FMH College of Medicine and Dentistry, Lahore, Pakistan.
SAB- MBBS, M.D Instructor Community Health Sciences, FMH College of Medicine and Dentistry, Lahore, Pakistan
ANA- FCPS (Surgery), Additional Director Accident and Emergency Jinnah Hospital, Lahore, Pakistan; Member of the Medical Education Council Allama Iqbal Medical College, Lahore, Pakistan
SZI- MBBS, M.D Instructor Community Health Sciences, FMH College of Medicine and Dentistry
HI-MBBS, M. Phil (Community Medicine) Senior Instructor Community Health Sciences, FMH College of Medicine and Dentistry, Lahore, Pakistan
KS- MBBS Instructor Community Health Sciences, FMH College of Medicine and Dentistry, Lahore, Pakistan
HA- MBBS Instructor Community Health Sciences, FMH College of Medicine and Dentistry, Lahore, Pakistan.
This study would not have been possible without the support and guidance of Dr. William Burdick and Dr. Page Morahan from the FAIMER Institute (Foundation for Advancement of International Medical Education and Research), Philadelphia, USA. The authors would also like to acknowledge the contributions of Dr. Amir Omair, Dr. Abdul Basit Saeed and Mr. Tipu Sultan of the Department of Community Health Sciences and Center for Health Research, FMH College of Medicine & Dentistry, Lahore, Pakistan.
- WHO|Pakistan: [Online]. [cited 2009 Jun 8], [http://www.who.int/countries/pak/en]
- Akhtar T: Counseling: The big gap in disease management in Pakistan. J Pak Med Assoc. 1995, 45: 146-7.Google Scholar
- Stewart M, Brown JB, Boon H, Galajda J, Meredith L, Sangster M: Evidence on patient-doctor communication. Cancer Prev Control. 1999, 3: 25-30.View ArticleGoogle Scholar
- Deveugele M, Derese A, De Maesschalk S, Willems S, Van Driel M, De Maeseneer J: Teaching communication skills to medical students, a challenge in the curriculum?. Patient Educ Couns. 2005, 58: 265-70. 10.1016/j.pec.2005.06.004.View ArticleGoogle Scholar
- Qidwai W: Patient autonomy: reflections from a developing country. Am Fam Physician. 2005, 71 (7): 1261.Google Scholar
- Jafarey AM: Informed consent in research and clinical situations. J Pak Med Assoc. 2003, 53 (5).
- Saab BR, Usta J, Major S, Musharrafieh U, Ashkar K: Communication skills in a Lebanese medical school: from movie theaters to medical classrooms. Fam Med. 2005, 37: 90-2.Google Scholar
- Barney C, Shea SC: The art of effectively teaching clinical interviewing skills using role-playing: a primer. Psychiatr Clin N Am. 2007, 30: e31-50. 10.1016/j.psc.2007.03.001.View ArticleGoogle Scholar
- Yedidia MJ, Gillespie CC, Kachur E, Schwartz MD, Ockene J, Chepaitis AE, Snyder CW, Lazare A, Lipkin M: Effect of communications training on medical student performance. JAMA. 2003, 290: 1157-65. 10.1001/jama.290.9.1157.View ArticleGoogle Scholar
- Kolb DA, Fry R, Cooper C, Wiley J: Towards an applied theory of experiential learning. 1975, In Theories of Group Process LondonGoogle Scholar
- Nestel D, Tierney T: Role-play for medical students learning about communication: guidelines for maximizing benefits. BMC Med Educ. 2007, 7 (3).
- Bayer-Fetzer Conference on Physician-Patient Communication in Medical Education: Essential elements of communication in medical encounters. Acad Med. 2001, 76: 390-393.View ArticleGoogle Scholar
- USMLE®: Test content and Practice Materials. Scoring the Step 2 CS Examination. [Online]. [cited 2009 Jun 8], [http://www.usmle.org/examinations/step2/cs/2009CSinformationmanual.pdf]
- UMDNJ-Robert Wood Johnson Medical School Internal Medicine Residency Program [Booklet]: Objective Structured Clinical Exam/Exercise. 2006Google Scholar
- United Way of America's Task Force on Impact: Measuring Program Outcomes: A Practical Approach. [Manual]. 1996, United Way of America Publishing Service, 15Google Scholar
- The World Medical Association: World Medical Association Declaration of Helsinki: Ethical principles of medical research involving human subjects. [Online]. [cited 2009 Jun 8], [http://www.wma.net/en/30publications/10policies/b3/index.html]
- Board of Medical Education, British Medical Association: Communication skills education for doctors: An update. 2004, London, BMAGoogle Scholar
- Duffy FD, Gordon GH, Whelan G, Cole-Kelly K, Frankel R, Buffone N, Lofton S, Wallace M, Goode L, Langdon L, Participants in the American Academy on Physician and Patient's Conference on Education and Evaluation of Competence in Communication and Interpersonal Skills: Assessing competence in communication and interpersonal skills: The Kalamazoo II report. Acad Med. 2004, 79 (6): 95-507. 10.1097/00001888-200406000-00002.View ArticleGoogle Scholar
- Boulet JR, Ben-David MF, Ziv A, Burdick WP, Curtis M, Peitzman S, Gary NE: Using standardized patients to assess the interpersonal skills of physicians. Acad Med. 1998, 73 (10 Suppl): S94-6.View ArticleGoogle Scholar
- van Zanten M, Boulet JR, McKinley D: Using standardized patients to assess the interpersonal skills of physicians: six years' experience with a high-stakes certification examination. Health Commun. 2007, 22 (3): 195-205.View ArticleGoogle Scholar
- Ben-David MF, Klass DJ, Boulet J, De Champlain A, King AM, Pohl HS, Gary NE: The performance of foreign medical graduates on the National Board of Medical Examiners (NBME) standardized patient examination prototype: a collaborative study of the NBME and the Educational Commission for Foreign Medical Graduates (ECFMG). Med Educ. 1999, 33 (6): 439-46. 10.1046/j.1365-2923.1999.00368.x.View ArticleGoogle Scholar
- Scoles PV, Gardner LB: National Board of Medical Examiners High Stakes Assessment of Professional Competence. [Online]. [cited 2009 Jun 8], [http://www.moex.gov.tw/public/Attachment/7112314572871.ppt]
- Vargas AL, Boulet JR, Errichetti A, van Zanten M, Lopez MJ, Reta AM: Developing performance-based medical school assessment programs in resource-limited environments. Med Teach. 2007, 29 (2-3): 192-8. 10.1080/01421590701316514.View ArticleGoogle Scholar
- Kimberlain CL: Communicating with Patients: skills assessment in US Colleges of Pharmacy. Am J Pharm Educ. 2006, 70 (3): 67.View ArticleGoogle Scholar
- Yedidia MJ, Gillespie CC, Kachur E, Schwartz MD, Ockene J, Chepaitis AE, Snyder CW, Lazare A, Lipkin M: Effect of Communications Training on Medical Student Performance. JAMA. 2003, 290: 1157-65. 10.1001/jama.290.9.1157.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6920/10/7/prepub