Skip to main content
Download PDF

It’s what you do, not the way you do it – online versus face-to-face small group teaching in first year medical school

BMC Medical Education volume 21, Article number: 541 (2021) Cite this article

Abstract

Background

Major disruptions imposed on medical education by the COVID-19 pandemic and the rapid shift to online teaching in medical programs, necessitated need for evaluation of this format. In this study we directly compared knowledge outcomes, social outcomes, and wellbeing of first year student small group teaching in either face to face (f2f) or online format.

Methods

At the end of the first course of our medical program, students were invited to participate in an online questionnaire with 10 quantitative items and 1 qualitative item. These were analysed using Factor Analysis Pattern Matrix and linear regression to group items and assess relatedness. Qualitative responses were thematized using Qualtrics software (Qualtrics, Provo, UT, USA). Summative assessment results were compared, both between current cohorts to historical cohorts.

Results

From a cohort of 298 students there was a 77% response rate. Overall, there were no differences in knowledge gains, either between groups or when compared to historical cohorts. Questionnaire items fell reliably into groups that related to either learning outcomes, social outcomes, or wellbeing. Independent T tests showed that format for teaching (online versus f2f) had an impact on social outcomes but no direct impact on learning outcomes. Linear regression revealed that the social outcomes have a direct impact on wellbeing and almost the double the impact on learning outcomes than mode of learning i.e.. F2f or online (β = .448 and β = .232 respectively).

Conclusion

In this study, we were able to show with statistical strength that social outcomes for students such as engaging with peers and facilitator, contributing to the group, and making friends have a direct impact on wellbeing and indirectly impact learning outcomes (such as motivation, satisfaction, integration of knowledge). In a rapidly changing educational landscape, in our opinion, it is vital that these aspects are a focus of design and delivery of medical education. The data from this study supports the notion that activity design and the expertise of the teacher in facilitating the small group activities, has greater impact than the mode of educational delivery itself on students’ learning processes.

Peer Review reports

Background

Like many other medical faculties, during the COVID-19 pandemic, campus-based courses in the junior years of our medical program were transitioned online. Prior to the COVID-19 pandemic, very little of our medical program was online, even for the junior, primarily campus-based years. There were some self-directed, interactive, online learning activities built into practical classes and clinical disciplines, but other than that, learning activities were essentially delivered in face to face (f2f) mode. This all changed in 2020 in response to campus rapidly closing, then, as our campus re-opened, these changes were reviewed and the cornerstone learning unit of junior years of our medical program, our scenario learning groups [1], were re-established as face to face activities for all students, except those that were still offshore due to ongoing international travel restrictions. It is likely that more disruptions will occur throughout the ebbs and flows of this pandemic. To minimise disruption of medical education, educators will need to continue to build resilience into the way they deliver medical education, evaluate, and produce data around contemporary ‘best practice’ and how this looks in a pandemic-constrained environment [2].

During the first 2 years of our (undergraduate) medical program, the courses are all inter-disciplinary and contain a variety of learning activities including lectures, practical classes, clinical and communication skills sessions, and scenario-group sessions (SGs). The SGs have a variety of names such as problem-based learning. This approach is commonly used in medical programs [3]. SGs are considered to be key learning sessions in medical training programs for many reasons, largely because the students are developing skills in small groups for self-directed and lifelong learning, which include problem solving, critical thinking, team-based learning and reflection, as well as delivery of content [4, 5]. The SGs are essentially designed to enable students to learn and revise course content and develop learning skills, using active learning principles such as self-directed learning, problem solving, teamwork and reflection, under the direction of a facilitator. This session is thought to be the most important in the junior years of the course, both for the development of skills such as these learning skills and also for the establishment of relationships with other students, friendships and relationships with teachers [6, 7]. It is during these SG sessions that students generally have the most opportunity to develop learning skills and also for collaborative learning, sharing knowledge and what can be called communal ‘constructivism’ in relation to learning [8]. For this reason, we undertook this study to assess the impact of these SGs being taught online as opposed to face to face (f2f).

In 2021, almost one third of our first-year student cohort were still offshore, unable to physically enter Australia due to international travel restrictions. All educational activities in the first course of the medical program were still being conducted online at that time, apart from the SGs. This allowed us to directly compare impact of the two formats of this key learning activity. We conducted a study to examine the impact of the mode of delivery (online versus f2f) on learning outcomes, learning outcomes, social outcomes, and wellbeing.

Methods

At the end of the Foundations course in the undergraduate medical program, all enrolled students (298) were invited to participate in a web-based survey (Additional file 1: Appendix A) which was created using Qualtrics software (Qualtrics, Provo, Utah, United States) and distributed to all students via internal notification in April 2021. The survey featured Likert scale questions about students’ experience of learning outcomes, social engagement, and wellbeing. This survey was adapted from the Perceived Utility of Learning Technologies Scale (PULTS) which was previously developed and validated within the UNSW Faculty of Medicine’s Blended Learning Project. The PULTS survey assesses perceptions of and engagement with learning resources to gather student feedback. There were 10 quantitative items in total, which could be grouped into categories of either learning outcomes or social outcomes and one on wellbeing (summarised in Table 1). Qualitative data was also collected about the best features of these learning sessions. The responses were then filtered according to whether the student was in a f2f or online group and responses of the two cohorts were compared. Objective knowledge gains of students were also assessed by summative end of course assessments were compared between the two current cohorts and compared to historical cohorts 2019 and 2020).

Table 1 Factor Analysis Pattern Matrixa: Student perception of their learning experiences
Full size table

Statistical analysis

Exploratory Factor analysis (Maximum Likelihood, using Oblimin Rotation with Kaiser Normalization) was employed to identify the underlying factors of student perceptions. Independent t-tests were used to measure the differences in student perceptions between the f2f and online groups. A multiple linear regression model was used to identify the predictors of learning outcomes, and path analysis, using structural equation modelling, was used to identify direct and indirect impacts on student wellbeing. Analyses were conducted by SPSS v22 and R [9,10,11].

Results

From a cohort of 298 students there were 213 respondents (77% response rate) with a total completion rate of 97.7%. Of participants that completed the survey, 143 were f2f and 65 were online which represented very good and equitable sampling across both groups. The raw results of the Likert questions are shown in Additional file 2: Appendix B.

Impact of f2f versus online learning on learning and social outcomes

An exploratory factor analysis was done to assess the contribution of the factors to learning outcomes and social outcomes (Table 1).

This table shows the significant groupings of questionnaire items into those that relate to the learning outcomes (bold) and those that relate to the social outcomes (italic). We were able to use these groups for factor analysis and assess their impact on each other. The reliability of each factor is high, apart from items 2 and 10 in this analysis.

An independent T test was performed to see if the format for teaching (online versus f2f) had an impact on these outcomes. They show a significant impact on the social outcomes but not the learning outcomes as shown in Table 2.

Table 2 Independent Samples Test: Impact of teaching format on learning and social outcomes
Full size table

The impact of format on learning and social outcomes is also shown in Fig. 1, which graphically shows the better social outcomes in students who had face to face scenario group teaching, with no significant difference between the groups in terms of their perceived learning outcomes.

Fig. 1
figure 1

Impact of learning mode (online/F2F). Note: Z and Y-axes do not intersect at zero

Full size image

When we used linear regression to examine the impact of both mode of learning and social outcomes on the learning outcomes, there was a high degree of reliability (as shown by the Pattern Matrix in Table 1). Linear regression revealed that the social outcomes have almost the double the impact on learning outcomes than mode of learning i.e.. f2f or online (Table 3, β = .45 and β = .23 respectively).

Table 3 Linear regression analysis of impact of mode of learning and social outcomes on perceived learning outcomes
Full size table

Summative assessment of knowledge gains

No differences were found in relation to performance at end of course exams between offshore (international students), onshore international students and domestic students in 2021. There was also no difference when compared with historical cohorts (2020 was taught entirely online and 2019 was taught entirely face to face).

Impact on wellbeing

In order to assess the impact of these factors (learning outcomes, social outcomes and mode of learning) on student wellbeing, we looked at both the direct and indirect impact of these variables using path analysis is illustrated in Fig. 2 [9].

Fig. 2
figure 2

Direct and indirect impact of factors on wellbeing

Full size image

A positive rating of the learning outcomes had the most significant positive correlation with ratings of wellbeing. Importantly, mode of learning did not have any direct impact on student wellbeing (Table 4). The impact of the mode of learning on wellbeing was insignificant.

Table 4 Effect of variables (factors) on Wellbeing (Path Analysis)
Full size table

Qualitative results

Thematic text extracts were automatically produced by Qualtrics with inherent sentiment analysis and were similar across both groups in relation to the themes and best aspects of the SGs. This showed us that the best thing reported by the most students were the facilitators (teachers) of the groups. Other positive themes that emerged included: learning in small groups, revisiting lecture content, creation of a safe environment, interacting with peers, sharing ideas and making friends.

Discussion

As medical educators reflect on and evaluate the rapid changes that occurred out of necessity during 2020 and 2021 [12,13,14,15,16,17], it will be important to evaluate what changes can and should remain, what the impact of various changes is on student learning and how these changes affect other parts of the student experience, such as wellbeing and engagement. This is particularly relevant to the teaching in the junior campus-based years of medical programs, where there can be many benefits of shifting educational activities to an online format. These include flexibility (geographical and time-related), scalability, interactivity, and quality control [12, 18]. Students have given us feedback that all these things are better in the online environment, if appropriate effort is put into the design of educational resources [12, 19]. Online teaching in medical programs is not new, but has been expedited during COVID-19 [20]. One very important finding in our data set is that the mode of learning (online versus f2f) did not actually have an impact on learning outcomes of students either from the student’s perception or objectively measured via the summative end-of-course examinations. This major finding has also been reported elsewhere [21, 22]. Two meta-analyses that have examined learning knowledge gains, skill gains and satisfaction of medical students have also found no difference between learning in a f2f environment and slightly better performance in the online environment for some parametres [23, 24].

Our study found that the mode of teaching was much less important than the social outcomes (engagement with peers and facilitators, making friends) on both learning outcomes and student wellbeing. Learning outcomes and knowledge gains can be maintained and optimised if appropriate work is put into educational design [24]. In fact, the opportunity (and need) to develop learning materials for online delivery of healthcare education, may have enhanced these activities by supporting instructional design and embedding opportunity for rapid feedback [25, 26]. One of the challenges in e-learning is that not all activities work well in the online environment and this needs to be taken into consideration, when designing the activities [18]. Other studies have also highlighted the fact that many teaching formats do not translate well ‘online’ and that this mode may be more suited to junior rather than senior (clinical) years of most programs [27].

Our study found that the social processes which include engagement with peers and facilitators and making friends was affected by the mode of delivery. This is not surprising, given that the small group learning such as SGs are the main learning activity during which these social processes can occur for the students. The group work arising out of SGs often require students to organise study sessions in addition to formal timetabled ones, allowing friendships to flourish and more informal communication. This is more constrained when all these activities must occur online [28].

Wellbeing was affected by both learning outcomes and social outcomes but not independently by mode of learning. The impact of social outcomes such as making friends and engaging with peers and facilitators had double the impact of the learning outcomes. It has also been shown elsewhere that the development of supportive relationships with peers and staff is very important for student wellbeing [29, 30] . Issues which impact the building of peer relationships and friendships, such as the constraints of an entirely online environment, have a negative impact on wellbeing [12, 18, 29]. Other studies have also shown that stress relating to academic performance has also been shown to have a negative impact on mental health in medical students and many medical programs are now being proactive in efforts to address this [29, 31].

Our qualitative data also tells us that in both environments, the impact of the facilitator on the student experience is very important. In the online environment, the facilitator has an even greater role in keeping students engaged and focused [32]. It is also likely that facilitators benefit from specific training on how to best teach in this environment, as there are issues to manage that do not arise in the f2f environment, such as the online etiquette, building physically-distanced community for collaborative learning, and the use of specific online tools [14, 33, 34].

Limitations of this study

It was beyond the scope of this study to assess the impact of mode of delivery on the development of a range of individual skills and competencies taught across courses in medical programs and gradually developed by students, that may be more affected by mode of learning such as teamwork, communication, professionalism, and cultural safety. As mentioned in the meta-analysis by Pei [21] there are many items and factors that could be used in the analysis of online learning, in this study we have only looked at a limited number of items. This study was undertaken in first year students and so the findings relate to teaching in junior years in medical programs. They may not be generalisable to learning in the senior years or in the clinical environment. It is also important to acknowledge that this study was undertaken during the ‘COVID pandemic’ which may have impacted on the student responses in some ways which would be different in a non-pandemic time.

Conclusion

Ultimately the findings of our study support the idea that educational design and delivery has a greater impact, than the mode of delivery on both learning outcomes and processes (such as motivation, satisfaction, self-perceived knowledge gains) and social processes (engagement with peers and facilitators). Social processes are more impacted than the learning ones by mode and this can have an impact on student wellbeing. This study highlights the need for educators and students to put additional thought into how to address these aspects in the online learning environment. This data emphasises the need for high quality educational design and iterative improvement whatever format is used [24, 35] as well as support and development of highly competent educators who are environment ambidextrous, so that student engagement is optimised [36]. Putting energy into the development of contemporary educational resources and the development of our facilitators also builds resilience into our programs, our staff and our students, improves equity and will set medical programs up well against future disruptions.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

f2f:

Face to face

SG:

Scenario group

COVID-19:

SARS-CoV-2 virus

References

  1. McNeil HP, Hughes CS, Toohey SM, Dowton SB. An innovative outcomes-based medical education program built on adult learning principles. Med Teach. 2006;28(6):527–34.

    Article  Google Scholar 

  2. Ashokka B, Ong SY, Tay KH, Loh NHW, Gee CF, Samarasekera DD. Coordinated responses of academic medical centres to pandemics: sustaining medical education during COVID-19. Med Teach. 2020;42(7):762–71.

    Article  Google Scholar 

  3. Aarnio M, Nieminen J, Pyörälä E, Lindblom-Ylänne S. Motivating medical students to learn teamwork skills. Med Teach. 2010;32(4):e199–204.

    Article  Google Scholar 

  4. Neville AJ. Problem-based learning and medical education forty years on. A review of its effects on knowledge and clinical performance. Med Princ Pract. 2009;18(1):1–9.

    Article  Google Scholar 

  5. Thistlethwaite JE, Davies D, Ekeocha S, Kidd JM, MacDougall C, Matthews P, et al. The effectiveness of case-based learning in health professional education. A BEME systematic review: BEME guide no. 23. Med Teach. 2012;34(6):e421–44.

    Article  Google Scholar 

  6. Schmidt HG, Rotgans JI, Yew EH. The process of problem-based learning: what works and why. Med Educ. 2011;45(8):792–806.

    Article  Google Scholar 

  7. Tolsgaard MG, Kulasegaram KM, Ringsted CV. Collaborative learning of clinical skills in health professions education: the why, how, when and for whom. Med Educ. 2016;50(1):69–78.

    Article  Google Scholar 

  8. Servant-Miklos VFC, Woods NN, Dolmans D. Celebrating 50 years of problem-based learning: progress, pitfalls and possibilities. Adv Health Sci Educ Theory Pract. 2019;24(5):849–51.

    Article  Google Scholar 

  9. RCTRfhcr-poRprfMs. R: A Language and environment for statistical computing. (Version 4.0) [Computer software]. (R packages retrieved from MRAN snapshot). https://www.r-project.org/ Accessed 24 Aug 2020.

  10. Rosseel Y. Lavaan: An R Package for Structural Equation Modeling. J Stat Software. 3012;48(2):1–36.

    Google Scholar 

  11. Field A. Discovering Statistics Using IBM SPSS Statistics. 5th ed; 2018.

    Google Scholar 

  12. Torda A. How COVID-19 has pushed us into a medical education revolution. Intern Med J. 2020;50(9):1150–3.

    Article  Google Scholar 

  13. Alsoufi A, Alsuyihili A, Msherghi A, Elhadi A, Atiyah H, Ashini A, et al. Impact of the COVID-19 pandemic on medical education: medical students' knowledge, attitudes, and practices regarding electronic learning. PLoS One. 2020;15(11):e0242905.

    Article  Google Scholar 

  14. Cridland C, Drape T, Marine S, Gillaspy G. Ten best practices for taking experiential learning online. Biochem Mol Biol Educ. 2021;49(1):9–14.

    Article  Google Scholar 

  15. Gordon M, Patricio M, Horne L, Muston A, Alston SR, Pammi M, et al. Developments in medical education in response to the COVID-19 pandemic: a rapid BEME systematic review: BEME guide no. 63. Med Teach. 2020;42(11):1202–15.

    Article  Google Scholar 

  16. Kim JW, Myung SJ, Yoon HB, Moon SH, Ryu H, Yim JJ. How medical education survives and evolves during COVID-19: our experience and future direction. PLoS One. 2020;15(12):e0243958.

    Article  Google Scholar 

  17. Li W, Gillies R, He M, Wu C, Liu S, Gong Z, et al. Barriers and facilitators to online medical and nursing education during the COVID-19 pandemic: perspectives from international students from low- and middle-income countries and their teaching staff. Hum Resour Health. 2021;19(1):64.

    Article  Google Scholar 

  18. Dost S, Hossain A, Shehab M, Abdelwahed A, Al-Nusair L. Perceptions of medical students towards online teaching during the COVID-19 pandemic: a national cross-sectional survey of 2721 UK medical students. BMJ Open. 2020;10(11):e042378.

    Article  Google Scholar 

  19. Torda AJ, Velan G, Perkovic V. The impact of the COVID-19 pandemic on medical education. Med J Aust. 2020;213(4):188–e1.

    Article  Google Scholar 

  20. Cheng SO, Liu A. Using online medical education beyond the COVID-19 pandemic - a commentary on "the coronavirus (COVID-19) pandemic: adaptations in medical education". Int J Surg. 2020;84:159–60.

    Article  Google Scholar 

  21. Pei L, Wu H. Does online learning work better than offline learning in undergraduate medical education? A systematic review and meta-analysis. Med Educ Online. 2019;24(1):1666538.

    Article  Google Scholar 

  22. Kronenfeld JP, Ryon EL, Kronenfeld DS, Hui VW, Rodgers SE, Thorson CM, et al. Medical student education during COVID-19: electronic education does not decrease examination scores. Am Surg. 2020;29:3134820983194. https://doi.org/10.1177/0003134820983194. Epub ahead of print.

  23. George PP, Papachristou N, Belisario JM, Wang W, Wark PA, Cotic Z, et al. Online eLearning for undergraduates in health professions: a systematic review of the impact on knowledge, skills, attitudes and satisfaction. J Glob Health. 2014;4(1):010406.

    Article  Google Scholar 

  24. Sandars J, Patel R. The challenge of online learning for medical education during the COVID-19 pandemic. Int J Med Educ. 2020;11:169–70.

    Article  Google Scholar 

  25. Lewis KO, Cidon MJ, Seto TL, Chen H, Mahan JD. Leveraging e-learning in medical education. Curr Probl Pediatr Adolesc Health Care. 2014;44(6):150–63.

    Article  Google Scholar 

  26. McCutcheon K, Lohan M, Traynor M, Martin D. A systematic review evaluating the impact of online or blended learning vs. face-to-face learning of clinical skills in undergraduate nurse education. J Adv Nurs. 2015;71(2):255–70.

    Article  Google Scholar 

  27. Pokryszko-Dragan A, Marschollek K, Nowakowska-Kotas M, et al. What can we learn from the online learning experiences of medical students in Poland during the SARS-CoV-2 pandemic? BMC Med Educ. 2021;21:450.

    Article  Google Scholar 

  28. Takizawa PA, Honan L, Brissette D, Wu BJ, Wilkins KM. Teamwork in the time of COVID-19. FASEB Bioadv. 2020;3(3):175–81.

    Article  Google Scholar 

  29. Byrnes C, Ganapathy VA, Lam M, Mogensen L, Hu W. Medical student perceptions of curricular influences on their wellbeing: a qualitative study. BMC Med Educ. 2020;20(1):288.

    Article  Google Scholar 

  30. McNeill KG, Kerr A, Mavor KI. Identity and norms: the role of group membership in medical student wellbeing. Perspect Med Educ. 2014;3(2):101–12.

    Article  Google Scholar 

  31. Hill MR, Goicochea S, Merlo LJ. In their own words: stressors facing medical students in the millennial generation. Med Educ Online. 2018;23(1):1530558.

    Article  Google Scholar 

  32. Coiado OC, Yodh J, Galvez R, Ahmad K. How COVID-19 Transformed Problem-Based Learning at Carle Illinois College of Medicine. Med Sci Educ. 2020;30(4):1–2. https://doi.org/10.1007/s40670-020-01063-3. Epub ahead of print.

  33. de Nooijer J, Schneider F, Verstegen DM. Optimizing collaborative learning in online courses. Clin Teach. 2021;18(1):19–23.

    Article  Google Scholar 

  34. Abbasi MS, Ahmed N, Sajjad B, Alshahrani A, Saeed S, Sarfaraz S, et al. E-learning perception and satisfaction among health sciences students amid the COVID-19 pandemic. Work. 2020;67(3):549–56.

    Article  Google Scholar 

  35. Loda T, Löffler T, Erschens R, Zipfel S, Herrmann-Werner A. Medical education in times of COVID-19: German students' expectations - a cross-sectional study. PLoS One. 2020;15(11):e0241660.

    Article  Google Scholar 

  36. Jiang Z, Wu H, Cheng H, Wang W, Xie A, Fitzgerald SR. Twelve tips for teaching medical students online under COVID-19. Med Educ Online. 2021;26(1):1854066.

    Article  Google Scholar 

Download references

Acknowledgements

Not applicaAble.

Funding

There was no funding for this research.

Author information

Authors and Affiliations

  1. Faculty of Medicine and Health, UNSW Sydney, Randwick, Australia

    Adrienne Torda & Boaz Shulruf

Authors
  1. Adrienne Torda
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Boaz Shulruf
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

AT was responsible for the study concept, design, collection and writing of the manuscript; BS was responsible for the statistical approach, analysis and writing of the manuscript. All authors have read and approved the manuscript.

Corresponding author

Correspondence to Adrienne Torda.

Ethics declarations

Ethics approval and consent to participate

This study approval ethics approval from the UNSW Sydney Human Research Ethics Committee on, Ethics approval: UNSW HC210117 on 9/3/21. This included approval of the participant information and consent forms. Consent from study participants was in written form. All methods were carried out in accordance with relevant guidelines and regulations.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Torda, A., Shulruf, B. It’s what you do, not the way you do it – online versus face-to-face small group teaching in first year medical school. BMC Med Educ 21, 541 (2021). https://doi.org/10.1186/s12909-021-02981-5

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-021-02981-5

Keywords

BMC Medical Education

ISSN: 1472-6920

Contact us