- Research article
- Open access
- Published:
Implementation of team-based learning in year 1 of a PBL based medical program: a pilot study
BMC Medical Education volume 16, Article number: 49 (2016)
Abstract
Background
A traditional and effective form of teaching within medical education has been Problem Based Learning (PBL). However, this method of teaching is resource intensive, normally requiring one tutor for every ten students. Team-based learning (TBL) has gained recent popularity in medical education, and can be applied to large groups of up to 100 students. TBL makes use of the advantages of small group teaching and learning, but in contrast to PBL, does not need large numbers of teachers. This study sought to explore the efficacy of using TBL in place of PBL in Year 1 of a medical program.
Methods
In Year 1 of the medical program, two iterations of TBL, with 20 students, were run following four iterations of PBL within the Cardiology teaching block. Student feedback following PBL and TBL was collected by questionnaire, using closed and open ended questions. Additionally, individual and team tests were held at the beginning of each TBL class, and results of each week were compared.
Results
All students (n = 20) participated in the test in week 1, and 18/20 students participated in week 2. In total, 19/20 (95 %) of students completed the questionnaires regarding their PBL and TBL experiences. The use of small groups, the readiness assurance tests, immediate feedback from an expert clinician, as well as time efficiency were all aspects of the TBL experience that students found positive. The clinical problem-solving activity, however, was considered to be less effective with TBL. There was a significant improvement (p = 0.004) in students’ score from the week 1 assessment (median = 2) to the week 2 (median = 3.5) assessment. Interestingly, all teams but one (Team 1) achieved a lower score on their second week assessment than on their first. However, the lowest performing team in week 1 outperformed all other teams in week 2.
Conclusion
Students favoured many aspects of the TBL process, particularly motivation to do the pre-reading, and better engagement in the process. Additionally, the application of TBL principles meant the sessions were not reliant upon a large teacher to student ratio. Students, however, highlighted the need for more time within TBL for clinical problem-solving.
Background
Challenges within tertiary education include reductions in university funding, increasing student numbers and decreasing academic staff numbers. Additionally, within medicine, the teaching of medical students relies heavily on public hospital medical practitioners who also have large clinical demands [1]. Moreover, workforce data indicates that many medical practitioners and educators will retire over the next 20 years, leaving a shortage in medical teachers [2, 3]. An obvious resource saving measure would be to increase student class size. However, large group lectures are not conducive to effective learning experiences for students, particularly within medical education, where small group active learning is optimal. There is a need to explore how traditional educational modalities might be modified to fit changing resource and workforce dynamics, as well as best practice in education.
A traditional and effective form of teaching within medical education has been Problem Based Learning (PBL). However, this method of teaching is resource intensive, normally requiring one tutor for every ten students. Team-based learning (TBL) has gained recent popularity in medical education [4]. TBL offers “an active learning and small group instructional strategy that provides students with opportunities to apply conceptual knowledge through a sequence of activities that includes individual work, team-work and immediate feedback” [5]. In its traditional format, TBL remains highly structured, with core design elements, and specific steps [5]. TBL has the potential to engage students in learning, develop a deep understanding of concepts, develop a sense of responsibility towards their teammates, and improve course performance [6, 7]. Generally involving multiple ‘teams’ of five to seven students, TBL can be applied to large groups of up to 100 students. In short, TBL makes use of the advantages of small group teaching and learning, but in contrast to PBL, does not need large numbers of tutors.
Currently, Sydney Medical School offers a four year graduate entry medical program, with a problem-based learning curriculum. During Year 1 and Year 2 of the program, students attend weekly PBL tutorials on university campus. Our study aimed to explore the efficacy of TBL in Year 1 of this medical program in terms of students’ perception of their experience in both PBL and TBL, and student test performance in TBL.
Methods
Participants
Convenience sampling was used, with 20 Year 1 medical students from two PBL groups participating in the study.
Structure and content of the TBL
Students completed four weeks of Cardiology PBLs in traditional PBL format with the same tutor (one student facilitated 1.5 h PBL, plus one tutor facilitated 1.5 h PBL per week). Following this, two iterations of PBL were converted to TBL format. The same two PBL groups of 10 students each were combined to form one TBL class, consisting of four teams of five students. The TBL sessions were 1.5 h each in duration, with one session held each week. The TBL format consisted of [5]:
-
1.
Team formation
-
2.
Assigned Pre-reading
-
3.
Individual Test (IRAT)
-
4.
Team test (TRAT) using Immediate Feedback Assessment Technique, with ‘scratch’ cards
-
5.
Immediate feedback from the supervisor who went through each question, guided by test results and student needs.
-
6.
Problem-solving activity
Within the TBL sessions, the intent was to spend approximately 30 min on Steps 3–5 (IRAT, TRAT and Immediate feedback), and approximately 60 min of STEP 6 (Problem-solving activity).
The specific cardiology cases used for the TBL problem solving activities were:
Week 1: Infant with Down Syndrome and congenital heart disease.
Week 2: Young adult with sudden cardiac arrest from prolonged QT interval.
Student feedback
A questionnaire was distributed to all participants immediately following the first two iterations Cardiology PBLs, and then immediately following two iterations of Cardiology TBL sessions. The questionnaires included nine closed items, using a likert-scale of 1 to 5, with 1 being ‘strongly disagree’, and 5 being ‘strongly agree’. Additionally, two open-ended questions were included. The questionnaire was adapted from a validated questionnaire designed by Thompson and colleagues (2009), to measure the quality of team processes in medical education [8].
Quantitative data were analysed using descriptive statistics. Thematic analysis was used to code and categorise qualitative data into themes. Once data had been coded and categorised into themes, the data within each theme were quantified in order to measure thematic prevalence [9].
Student assessment (Readiness assurance tests)
Individual Readiness Assurance Test (IRAT)
An Individual Readiness Assurance Test (IRAT) was held at the beginning of each class in week 1 and week 2 of TBL. This test was in Multiple Choice Question (Single Best Answer) format, and consisted of 10 questions, each with five options. These assessments were analysed using the Wilcoxon Signed Rank Test.
Team Readiness Assurance Test (TRAT)
In their allocated teams, students undertook the same test as the Team Readiness Assurance Test (TRAT). However, this test (TRAT) was administered on a scratch card, with students instructed to stop once they had guessed the correct answer. Each team completed one scratch card together as a team. Teams who answered the question correctly on the first attempt received a score of 4, and those who answered correctly on the fifth attempt scored zero. These scores were then summed across the items to obtain a total score ranging from 0 to 40.
Ethics approval was gained from the University of Sydney Human Research Ethics Committee.
Results
Student feedback
In total, 19/20 (95 %) of students completed the questionnaires regarding their PBL and TBL experiences. The comparative results of these questionnaires are displayed in Fig. 1, which highlights students’ perceived advantages to TBL, and students’ perceived advantages to PBL. Table 1 displays the key performance statistics for PBL and TBL evaluation survey questionnaires.
Table 2 illustrates students’ perceived best features of the PBL, and Table 3 illustrates students’ perceived worst features of the PBL. Table 4 illustrates students’ perceived best features of the TBL, and Table 5 illustrates students’ perceived worst features of the TBL.
Student assessment (Readiness Assurance Tests)
Individual Readiness Assurance Test (IRAT)
20 students participated in the two week Team Based Learning (TBL) program. All students (100 %) participated in the individual 10-item assessment during Week 1 and 18/20 of these 20 (90 %) took the Week 2 assessment.
Figures 2 and 3 show the difference between students’ total score on Week 1 and Week 2 assessments analysed using the Wilcoxon Signed Rank Test. There was a significant improvement (p = 0.004, n = 18) in students’ score from the Week 1 assessment (median = 2) to the Week 2 assessment (median = 3.5), with a median difference in score of 1.5. Twelve (12) students improved their scores from the 1st and 2nd week by 1 to 6 points. Four students showed no improvement, 3 with scores of 2 on both assessments, and one with a score of 3. Finally, two students scored lower on their 2nd week assessment than their first (by 2 and 1 points, for scores of 2 and 1, respectively).
Team Readiness Assurance Test (TRAT)
Interestingly, all teams but one (Team 1) achieved a lower score on their 2nd week assessment than on their 1st (Fig. 4). Teams 2 and 3 each scored 32 (80 %) on their 1st week assessment, the equal highest team scores, but both scored 28 (70 %) on their second week assessment. Team 4 scored the same each week: 30 (75 %) in 1st week assessment and 29 (73 %) on second. However, Team 1, managed to improve their score from 27 (67.5 %) on their 1st week assessment to 29 (72.5 %) on their second week. Nevertheless, this team remained the lowest scoring team overall.
Discussion
This study sought to explore students’ perceptions of their experience in both PBL and TBL. Students perceived both negative and positive elements to their experience of each educational modality. Students found working in smaller groups (of five) during the TBL more ‘conducive to learning’ and ‘participation’ than PBL (group size 10). Although they found the readiness assurance tests difficult, they also found the tests motivating and engaging. Students would have liked more specific reading material to assist in preparation. Students found immediate feedback from an expert tutor beneficial to their learning. The most notable negative aspect in TBL was it lacked the opportunity to work through the clinical aspects of a case. Although students found the TBLs to be ‘time efficient’, they commented that these sessions ‘felt a bit rushed’. Key elements of the TBL structure offer a useful framework to elaborate on these findings.
Team dynamics
Reducing student numbers from ten (with PBL) to five (with TBL) appeared to be effective. Students commented that this enabled greater participation, collaboration and discussion. It has been suggested that student teams should be large enough to promote discussion yet small enough to maximise collaboration and team dynamics [10, 11]. Notably, responses to items 2 and 5 displayed in Fig. 1 indicate that team dynamics within TBL promoted greater student participation and discussion in TBL compared to PBL.
Assigned pre-reading readiness assurance tests
In keeping with the current popularity of the ‘flipped classroom’, designated pre-class reading for essential knowledge acquisition for TBL shifts the burden of learning content during class [12]. Individual student accountability was fostered by the use of the individual assessment (IRAT), which also promoted effective teamwork. Students felt a sense of competitiveness among teams, which motivated them to come to class well prepared. A further indication of students’ motivation to prepare is that as individuals, most students improved their performance from week 1 to week 2 of the TBL. Notably, the poorest performing team (‘Team 1’) in week 1 was the best performing team in week 2. Perhaps this indicates that students from ‘Team 1’ felt challenged by their initial poor performance.
Facilitator feedback
Students find it beneficial to receive immediate feedback from an expert tutor [13], and indicated that this is not always the case with PBL. Immediate feedback has the ability to provide students with an understanding of their content knowledge and ability to apply this [14]. Immediate feedback also contributed to the competition between teams. Provision of immediate feedback is well known to be crucial to knowledge acquisition and retention [15, 16].
Problem-solving activity
Team learning in both PBL and TBL is promoted through implementation of the problem-solving activity [17]. During TBL, the small size of groups meant that all students were forced to contribute to the activity, increasing student engagement with the content. However, students noted that the teaching material and the lack of time meant that they were “unable to go through the clinical aspects of the case, management and mechanisms”. This issue is consistent with recent literature, suggesting that within health sciences education, the “problem-solving activity” step in TBL raises some difficulties. This difficulty with TBL needs careful consideration, and perhaps deviation from ‘classical’ TBL practice in medical education [18, 19].
Limitations
A small sample size was used in this study, with only 20 students participating. It should also be noted that this was a pilot study, with only two iterations of TBL.
Conclusion
The use of smaller groups, the readiness assurance tests, immediate feedback from an expert clinician, as well as time efficiency, were all aspects of the TBL experience that students found positive. Additionally, the application of TBL principles meant the sessions were not reliant upon a large teacher to student ratio. The clinical application to the problem-solving activity, however, appeared to be deficit in our experience with TBL. If TBL were to be implemented at Sydney Medical School in place of PBL, this step within the TBL process would need to be carefully designed.
Abbreviations
- TBL:
-
Team-based learning
- PBL:
-
Problem based learning
- IRAT:
-
Individual Readiness Assurance Test
- TRAT:
-
Team Readiness Assurance Test
References
Swanwick T. Informal learning in postgraduate medical education: from cognitivism to “culturism”. Med Educ. 2005;39(8):859–65.
Hawthorne L. International medical migration: what is the future for Australia? MJA Open. 2012;1 Suppl 3:18–21.
Health Workforce Australia. Health Workforce 2025 – Doctors, Nurses and Midwives. Volume 1. Adelaide, Australia: Health Workforce Australia; 2012.
Burgess A, McGregor D, Mellis C. Applying guidelines in a systematic review of team-based learning in medical schools. Acad Med. 2014;89:4.
Parmelee D, Michaelsen LK, Cook S, Hudes PD. Team-based learning: A practical guide: AMEE guide no. 65. Med Teach. 2012;34:e275–87.
Burgess AW, Ramsey-Stewart G, May J, Mellis C. Team-based learning methods in teaching topographical anatomy by dissection. ANZ J Surg. 2012;82:457–60.
McCormack W, Garvan CW. Team-based learning instruction for responsible conduct of research positively impacts ethical decision-making. Washington, DC: National Institutes of Health; 2014.
Thompson BM, Levine RE, Kennedy F, Naik AD, Foldes CA, Coverdale JH, et al. Evaluating the quality of learning-team processes in medical education: development and validation of a new measure. Acad Med. 2009;84:10.
Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77–101.
Michaelsen L, Parmelee D, McMahon KK, Levine RE, editors. Team-Based Learning for Health professions Education. Sterling, Va: Stylus; 2007.
Wiener H, Plass H, Marz R. Team-based learning in intensive course format for first-year medical students. Croat Med J. 2009;50:69–76.
Hunt DP, Haidet P, Coverdale JH, Richards B. The effect of using team learning in an evidence-based medicine course for medical students. Team Learn Med. 2003;15:131–9.
Michaelsen L, Richards B. Drawing conclusions from the team-learning literature in health-sciences education: a commentary. Teach Learn Med. 2005;17:85–8.
Sweet M, Michaelsen LK. Team-based learning in the social sciences and humanities: Group work that works to generate critical thinking and engagement. Sterling, VA: Stylus; 2012.
Hattie J, Timperley H. The power of feedback. Rev Educ Res. 2007;77(1):81–112.
Burgess A, Mellis C. Feedback and assessment during clinical placements: achieving the right balance. Adv Med Educ Pract. 2015;6:373–81.
Dunaway GA. Adaptation of team learning to an introductory graduate pharmacology course. Teach Learn Med. 2005;17:56–62.
Badgett RG, Stone J, Collins TC. The importance of Free-text Responses in Team-Based Learning Design. Acad Med. 2014;89(12):1578.
Burgess A, Mellis C. Letter to the Editor. In Reply to Badgett et al. Acad Med 2014, 89 (12) 1578.
Acknowledgements
We wish to thank Tyler Clark, Associate Lecturer, Education Office, Sydney Medical School assisted with statistical analysis and graphs.
Author information
Authors and Affiliations
Corresponding author
Additional information
Competing interests
The authors declare that they have no competing interests.
Authors’ contributions
AB was responsible for the concept of the study, data collection and analysis and the first draft of the paper and further manuscript. TA was responsible for data collection and analysis, contributing to the writing of the paper. CM was responsible for overseeing the design of the study and the writing of the paper. All authors read and approved the final version of the manuscript.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Burgess, A., Ayton, T. & Mellis, C. Implementation of team-based learning in year 1 of a PBL based medical program: a pilot study. BMC Med Educ 16, 49 (2016). https://doi.org/10.1186/s12909-016-0550-3
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12909-016-0550-3