- Research article
- Open Access
- Open Peer Review
Meta-analysis on the effectiveness of team-based learning on medical education in China
BMC Medical Educationvolume 18, Article number: 77 (2018)
Team-based learning (TBL) has been adopted as a new medical pedagogical approach in China. However, there are no studies or reviews summarizing the effectiveness of TBL on medical education. This study aims to obtain an overall estimation of the effectiveness of TBL on outcomes of theoretical teaching of medical education in China.
We retrieved the studies from inception through December, 2015. Chinese National Knowledge Infrastructure, Chinese Biomedical Literature Database, Chinese Wanfang Database, Chinese Scientific Journal Database, PubMed, EMBASE and Cochrane Database were searched. The quality of included studies was assessed by the Newcastle-Ottawa scale. Standardized mean difference (SMD) was applied for the estimation of the pooled effects. Heterogeneity assumption was detected by I2 statistics, and was further explored by meta-regression analysis.
A total of 13 articles including 1545 participants eventually entered into the meta-analysis. The quality scores of these studies ranged from 6 to 10. Altogether, TBL significantly increased students’ theoretical examination scores when compared with lecture-based learning (LBL) (SMD = 2.46, 95% CI: 1.53–3.40). Additionally, TBL significantly increased students’ learning attitude (SMD = 3.23, 95% CI: 2.27–4.20), and learning skill (SMD = 2.70, 95% CI: 1.33–4.07). The meta-regression results showed that randomization, education classification and gender diversity were the factors that caused heterogeneity.
TBL in theoretical teaching of medical education seems to be more effective than LBL in improving the knowledge, attitude and skill of students in China, providing evidence for the implement of TBL in medical education in China. The medical schools should implement TBL with the consideration on the practical teaching situations such as students’ education level.
To improve the education effectiveness, the integrated implementing of traditional lecture-based learning (LBL) pedagogy and new pedagogical approaches as supplementary teaching methods has been a trend in Chinese medical teaching in recent years. Therefore, there is a great need to explore new pedagogical approach which could be introduced in medical education in China based on scientifically validation of its teaching effectiveness.
Team-based learning (TBL), a pedagogical model of small-group learning, was originally developed by Dr. Larry Michaelsen for use in business schools . TBL was an increasingly popular style of active learning pedagogical approach around the world . In traditional LBL pedagogy, students mainly memorize the content from the class lecturer, while TBL is a pedagogical method of active learning. TBL enhances students’ learning motivation, and then impels students to apply these knowledge materials to solve problem and combine theory with practice [2, 3]. At present, multiple medical schools have adopted TBL pedagogical approach globally [4, 5]. For example, some medical schools in Japan, Korea, India, Singapore, Oman, the USA, Lebanon and Australia already have adopted TBL pedagogical approach [6,7,8,9,10,11,12].
In China, the most commonly used teaching method in medical education is still LBL. In the past decade, the health and medical education system in China has been developing rapidly. The introduction of active learning pedagogical approach into medical education attracts attention. TBL has many significant advantages fitting for the status of Chinese medical education. TBL is an active learning pedagogical approach, and it permits a large student-teacher ratio, which greatly fits for the status of Chinese medical education with the lack of teachers and classrooms . In recent years, TBL as an emerging pedagogical approach has also been introduced in some medical schools in China. There are also studies regarding the teaching effectiveness of TBL in medical education. Notably, in China, besides exercitation period, the medical teaching is divided into theory course and laboratory course, which are helpful for the improvement of students theoretical knowledge and practical ability, respectively. Theoretical teaching is the basis for practice. In medical education in China, theory course often occupies the most teaching time with the largest proportion of learning contents in the final examination. The only method is often LBL in theory course in China, while the current teaching method in laboratory course is more complex. Students are often divided into groups to practice and do experiment together in the laboratory course. In addition, the theoretical examination is often conducted by an standardized written test which is objective, while some practical examinations for laboratory course still need to be standardized to avoid subjectivity. Given the significance and educational situation in China, in the published studies, the comparison on teaching effectiveness was mostly conducted between TBL and LBL based on theoretical examination. The above information indicates the opportunity and the importance to compare the teaching effectiveness between TBL and LBL in theoretical teaching of medical education.
However, there are still differences in the findings about teaching effectiveness of TBL in the published studies, and the sample size in these studies was relatively small. A pooled analysis of these studies using meta-analysis can solve above problems, and can provide new insights into the implementation of TBL and an important scientific basis for improving medical education in China. However, until now, there are no studies or reviews summarizing the effectiveness of TBL on medical education in China by meta-analysis.
In present study, a summary analysis of 13 studies was conducted to obtain an overall estimation of the effectiveness of TBL on outcomes of theoretical teaching of medical education in China. Because the paper on TBL in medical education in China was mostly published in Chinese which cannot be accessed by non-Chinese-speaking researchers, this meta-analysis can also disseminate TBL implement significance in medical education in China to international education researchers. Moreover, the findings of the meta-analysis in China can provide the first-hand overall understanding of the teaching effectiveness of TBL in medical education, which may also be referable for other countries especially those countries having similar pedagogical structures as China.
In this study, we planned and conducted meta-analysis following the guidelines of preferred reporting items for systematic review and meta-analysis protocols 2015 statement recommendations .
We retrieved the studies from inception through December, 2015. Chinese National Knowledge Infrastructure (CNKI), Chinese Biomedical Literature Database (CBM), Chinese Wanfang Database, Chinese Scientific Journal Database (VIP) were searched. English databases including PubMed, EMBASE and Cochrane Database were also searched. The following key words were used: team-based learning, TBL, theory, theoretical, China, Chinese, medicine, medical, disease, health, healthy, biology, biological, hygiene, hygienic, pharmacology, pharmacological. Additionally, all articles were included by manual operation, and studies matching the eligible criteria were retrieved for further data extraction and quality assessment.
Eligible studies were required to meet the following explicit inclusion criteria: 1) TBL pedagogy courses should be medicine professional disciplines; 2) the study should be designed as a randomized or nonrandomized trial; 3) the study should compare the effectiveness of TBL and LBL methods by theoretical examination based on the centesimal system; 4) the study had detailed quantitative results for TBL group and LBL group, and data should be available. In this study, data for meta-analysis were available from 13 studies, including 1545 participants.
Data extraction and quality assessment
According to the inclusion criteria listed above, two investigators independently extracted the data. The two investigators compared their results of data extraction to determine whether there was a disagreement. In cases of disagreement, the third investigator reviewed the study, and a consensus was reached by conference among the 3 investigators. The following information was extracted from all eligible studies: first author’s name, year of publication, the discipline, total number of participants in TBL group and LBL group, source of participants, and the outcome assessment.
Many nonrandomized trials were included. Therefore, the quality of included studies was assessed by the Newcastle-Ottawa scale in the meta-analysis, which was judged in the following items: participant number (1–3), randomization (0–1), blinding (0–1), allocation concealment (0–1), control for important factors (0–2), control for incomplete data bias (0–1), and outcome assessment (0–2). The full score was 11 points, while study of 5 or more points was judged as a high-quality study.
Statistical pooling and evaluation of heterogeneity
For continuous data, standardized mean difference (SMD) was applied for the estimation of the pooled effects on learning outcomes. Heterogeneity assumption was detected by I2 statistics. While a P-value ≤0.10 in the I2 test, the random-effects model (DerSimonian and Laird method) was employed . Otherwise, we adopted the fixed-effects model (the Mantel-Haenszel method) . The heterogeneity was further explored by meta-regression analysis based on restricted maximum likelihood . Quality scores and student numbers were modeled as continuous variables; randomization, allocation concealment, control for important factors, source of participants (medical college or undergraduate students), discipline (or curricula) and gender were treated as categorical variables. Subgroup analysis was conducted based on the results of meta-regression analysis.
In order to evaluate the statistical robustness of the results, a single study in the meta-analysis was deleted each time to show the effect of the individual data set on the pooled results, and we also used fixed-effects model to assess the stability of the results.
Publication bias evaluation
Publication bias was assessed using a funnel plot and Begg’s test according to previous reports . All analyses were carried out with Stata statistical software (version 11.0, StataCorp LP-College Station, TX, USA).
Study characteristics and quality assessment
The inclusion process of all studies is shown in Fig. 1. A total of 1210 records in Chinese or English were retrieved based on the search strategy, and 909 duplicate records were next removed. After reviewing the title/abstract, 55 articles were retained for further examination. According to the inclusion criteria, 42 articles were excluded (20 were reviews or editorials; 8 included no comparison with LBL; 14 had no available quantitative outcomes). A total of 13 articles including 1545 participants eventually entered into the meta-analysis [19,20,21,22,23,24,25,26,27,28,29,30,31], and they were all written in Chinese. Table 1 shows the study characteristics of the 13 studies. Most of the studies (12/13) reported the admission years of the students ranging from 2008 to 2011. Only 2 out of the 13 studies reported the study years in 2010 and 2013 for Xu et al.  and Tao et al. , respectively.
Table 2 shows the methodological quality of the 13 included studies. All these articles were published in peer-reviewed journals. The quality scores ranged from 6 to 10. Bias protection approaches including allocation concealment, control for important factors as well as control for incomplete data bias were often applied in these studies. However, whether the outcome assessors and data collectors were blinded to subjects’ assignments was not mentioned in these studies, and only two studies applied randomization. All studies measured the outcomes by both theoretical examination scores and questionnaire surveys.
The effectiveness of TBL on medical education was assessed by pooling theoretical examination scores, and the results on the learning attitude and self-directed learning skill are shown in the present study (Fig. 2, Table 3).
As the effectiveness of TBL on theoretical examination scores was reported in all the 13 studies, the data on the examination scores of the 13 studies were pooled into the meta-analysis. We found that TBL significantly increased students’ examination scores when compared with LBL in random-effects model (SMD = 2.46, 95% CI: 1.53–3.40, I2 = 98.0%, Pheterogeneity < 0.001) (Fig. 2, Table 3). This pooled analysis with heterogeneity was similar to previous published meta-analysis . Begg’s test did not reveal funnel plot asymmetry (P = 0.059), making publication bias unlikely . Four and five studies reported the learning attitude and learning skill, respectively. The pooled TBL effects on learning attitude and learning skill were significant in random-effects models (for learning attitude, SMD = 3.23, 95% CI: 2.27–4.20, I2 = 92.1%, Pheterogeneity < 0.001; for learning skill, SMD = 2.70, 95% CI: 1.33–4.07, I2 = 97.4%, Pheterogeneity < 0.001) (Table 3).
Test of heterogeneity
We used meta-regression method to explore the sources of heterogeneity. Table 4 shows that the total methodological quality could not explain the source of heterogeneity (P = 0.975). We found the heterogeneity could be partially explained by the randomization (P = 0.021) (Table 4), which was supported by the decreased heterogeneity in the randomized designed group (for randomized designed group: I2 = 93.9%, Pheterogeneity < 0.001; for nonrandomized designed group: I2 = 98.1%, Pheterogeneity < 0.001). Meta-regression analysis further showed that education classification might be a contributing factor of heterogeneity in nonrandomized group (P = 0.073) (Table 5). Figure 3 shows that the heterogeneity was dramatically decreased in nonrandomized studies of undergraduate students (5-year program) (I2 = 57.5%, Pheterogeneity = 0.052, Table 5). In addition, in the pooled analysis of this group, we found TBL significantly increased examination scores in random-effects model (SMD = 4.39, 95% CI: 3.92–4.87, I2 = 57.5%, Pheterogeneity = 0.052) (Fig. 3) (Table 5). Meta-regression was next used in the medical college students (3-year program) to find the source of heterogeneity, which identified gender as a potential source of heterogeneity (P = 0.059) (Table 5). There was no heterogeneity in the pooled analysis of the medical college students of only females (I2 = 9.4%, Pheterogeneity = 0.332, Fig. 4, Table 5), in which we also found TBL significantly increased female students’ examination scores in fixed-effects model (SMD = 0.47, 95% CI: 0.24–0.70, I2 = 9.4%, Pheterogeneity = 0.332).
When any research was removed from the model, the significant results of TBL effect on the students’ examination scores were unchanged in these models (SMD: 2.26–2.67, 95% CI: 1.32–3.67, n = 13) (Fig. 5). Consistent results of TBL effect on the students’ examination scores in fixed-effects model (SMD = 1.63, 95% CI: 1.51–1.76, I2 = 98.0%, Pheterogeneity < 0.001) were also observed (Additional file 1: Figure S1). All the above results indicated that the findings were robust.
Reports reveals that learning is more effective when students are actively involved in TBL, and TBL results in high student satisfaction in the USA [33,34,35]. TBL as an active learning pedagogical approach fits for the status of Chinese medical education, such as permission of a large student-teacher ratio to solve the problem of lack of teachers and classrooms . However, TBL is still in its infancy in medical school in China, and its effectiveness still needs to be scientifically verified. This study is the first to evaluate the effectiveness of TBL on medical education in China by meta-analysis. We found that TBL improved student theoretical examination scores, learning attitude and learning skill compared to LBL pedagogy in the pooled analysis, and the positive effect of TBL on theoretical examination scores was also verified in sub-grouping analysis and sensitivity analysis, indicating the importance of the implement of TBL in China. Notably, these findings about TBL and traditional LBL were also supported by studies conducted in Japan and the USA [36,37,38], indicating the positive effectiveness of TBL in the present study may be not country-specific. As the topic about TBL and LBL continues to be studied globally, a detailed comparison of the effectiveness of TBL in medical education among different countries is required to be conducted in the future.
In China, undergraduate course (5-year program) focuses on theoretical and practical teaching, and its students often have better learning basis, while medical college course (3-year program) focuses on practical teaching. The students’ theoretical examination scores appeared positively related to education levels (meta-regression for all studies, Coefficient = 2.69, 95% CI:0.16–5.21, P = 0.041) (Fig. 3) (Tables 4-5), indicating the learning basis and learning objective may impact the effect of TBL on medical education. In addition, in the nonrandomized studies of undergraduate students with lower heterogeneity (I2 = 57.5%, Pheterogeneity = 0.052), significant effect was observed in the pooled analysis (Fig. 3), providing the evidence about the positive effect of TBL on medical education in undergraduate students in China.
We found in the medical college students of only females, the homogeneity was reached (I2 = 9.4%, Pheterogeneity = 0.332). The significant improvement of examination scores of TBL was observed when compared with LBL in the pooled analysis, verifying the positive effect of TBL on medical education in the medical college students in China.
Limitations and future studies
However, limitations need to be addressed in our meta-analysis. There were only two randomized designed studies included in the present study [19, 28], and the sample size of one study was less than 100 . In China, most educational studies were conducted based on the comparison of different classes for convenience. However, we should notice that this nonrandomized design may compromise the findings. In this meta-analysis, we observed that the randomization appeared to change the study results (meta-regression for all studies, Coefficient = − 4.28, 95% CI:-7.61--0.95, P = 0.021), emphasizing the importance of improving the educational study quality by using randomized study design. To better study the effect of TBL on medical education, well-designed and strictly controlled studies with established performing criterion including randomized controlled trials (RCTs) are still required.
Another limitation of this study is that, for the feasibility of meta-analysis due to the limited published studies, we didn’t include the comparison between TBL and other pedagogical approaches in this study. However, LBL is still the most commonly used pedagogy in theoretical teaching of medical education in China. Therefore, the effectiveness of any new pedagogical approach should be compared with LBL as a reference, which has a great practical significance. With the development of other new pedagogical approaches in the medical education in China, a more comprehensive comparison of different pedagogical approaches to test the effectiveness of TBL is required in the future.
The third limitation of current study is that, although this meta-analysis covered the major and overall results of teaching effectiveness in current published studies, the study was still limited in theoretical examination in those studies which might test memorization rather than measuring higher cognitive levels as well as the objectivity of measures of learning attitude and skill by student survey. Additionally, some other aspects of medical education are required to be investigated in the future. The included articles did not adopt standardized questionnaire survey, making the pooled analysis could not be conducted in some detailed aspects of teaching effect such as the effect on team spirit and oral expression. Therefore, more studies on this topic including both theory course and laboratory course are required which are performed with standardized study design and outcome assessment.
In conclusion, the meta-analysis shows that TBL in theoretical teaching of medical education is more effective than LBL in improving learning knowledge, attitude and skills in China, providing evidence for the implement of TBL in medical education in China. TBL should be further gradually introduced into medical teaching programs. A future meta-analysis needs to be conducted to determine if the results from this meta-analysis continue to hold true with larger sample sizes. Medical schools should implement TBL with the consideration on the practical teaching situations such as students’ learning basis and objective which have been identified in this study. Furthermore, to improve the teaching quality in medical education in China, the effective way of integrating LBL and TBL as well as other pedagogical approaches needs to be further explored.
Chinese biomedical literature database
Chinese national knowledge infrastructure
Standardized mean difference
Chinese scientific journal database
Burgess AW, McGregor DM, Mellis CM. Applying established guidelines to team-based learning programs in medical schools: a systematic review. Acad Med. 2014;89(4):678–882.
Wiener H, Plass H, Marz R. Team-based learning in intensive course format for first-year medical students. Croat Med J. 2015;50(1):69–76.
Morrison G, Goldfarb S, Lanken PN. Team training of medical students in the 21st century: would Flexner approve? Acad Med. 2010;85(2):254–9.
Searle NS, Haidet P, Kelly PA, Schneider VF, Seidel CL, Richards BF. Team learning in medical education: initial experiences at ten institutions. Acad Med. 2003;78:S55–8.
Parmelee DX, Michaelsen LK. Twelve tips for doing effective team-based learning (TBL). Med Teach. 2010;32(2):118–22.
Borges NJ, Kirkham K, Deardorff AS, Moore JA. Development of emotional intelligence in a team-based learning internal medicine clerkship. Med Teach. 2012;34(10):802–6.
Burgess AW, Ramsey-Stewart G, May J, Mellis C. Team-based learning methods in teaching topographical anatomy by dissection. ANZ J Surg. 2012;82(6):457–60.
Inuwa IM. Perceptions and attitudes of first-year medical students on a modified team-based learning (TBL) strategy in anatomy. Sultan Qaboos Univ Med J. 2012;12(3):336–43.
Shankar N, Roopa R. Evaluation of a modified team based learning method for teaching general embryology to 1st year medical graduate students. Sultan Qaboos Univ Med J. 2009;63(1):4–12.
Tai BC, Koh WP. Does team learning motivate students' engagement in an evidence-based medicine course? Ann Acad Med Singap. 2008;37(12):1019–23.
Zgheib NK, Simaan JA, Sabra R. Using team-based learning to teach clinical pharmacology in medical school: student satisfaction and improved performance. J Clin Pharmacol. 2011;51(7):1101–11.
Okubo Y, Ishiguro N, Suganuma T, Nishikawa T, Takubo T, Kojimahara N, et al. Team-based learning, a learning strategy for clinical reasoning, in students with problem-based learning tutorial experiences. Tohoku J Exp Med. 2012;227(1):23–9.
Wang B, Min S. Usage of team-based learning (TBL) in medical education. China High Med Educ. 2012;4:112–3.
Moher D, Shamseer L, Clarke M, Ghersi D, Liberati A, Petticrew M, et al. Preferred reporting items for systematic review and meta-analysis protocols (PRISMA-P) 2015 statement. Syst Rev. 2015;4:1.
Mantel N, Haenszel W. Statistical aspects of the analysis of data from retrospective studies of disease. J Natl Cancer Inst. 1959;22:719–48.
DerSimonian R, Laird N. Meta-analysis in clinical trials. Control Clin Trials. 1986;7(3):177–88.
Baker WL, White CM, Cappelleri JC, Kluger J, Coleman CI, Health O, et al. Understanding heterogeneity in meta-analysis: the role of meta-regression. Int J Clin Prac. 2009;63(10):1426–34.
Meune C, Touzé E, Trinquart L, Allanore Y. Trends in cardiovascular mortality in patients with rheumatoid arthritis over 50 years: a systematic review and meta-analysis of cohort studies. Rheumatol (Oxford). 2009;48(10):1309–13.
Wu Y, Ren S, Tang W, Li N, Wu J, Li L. The application of team based learning teaching method in periodontic teaching. China High Med Educ. 2015;12:107–8.
Yuan Y. The application of team based learning teaching method in medical English education. Chinese Med Res. 2014;15(6):68–70.
Zhu X. Practice and exploration of TBL teaching mode in teaching of regional anatomy. J Clin Med Literatore. 2014;1(4):577–8.
Chao H, Chen J, Qian X, Jin B. The application of team based learning teaching method in the preventive medicine teaching. China. Mod Med. 2013;20(7):130–1.
Huang N, Fan Z, Hu Q, Chen Y, Pan Y. Design and evaluation of team-based learning teaching method in the teaching of foreign nursing. J Xi’an Int Stud Univ. 2013;21(4):90–2.
Liu J, Zhang Z. Application of team-based learning teaching method in the teaching of theory courses of obstetrics and gynecology. Chinese Med Res. 2013;14(12):61–3.
Mi W, Qu W, Lian W, Yi W, Han W. Research on application of team-based learning teaching method in nutrition and food hygiene. Chinese Health Serv Man. 2013;11:855–8.
Tao L. Application of team-based learning to teaching of pathology in higher vocational school. China Pr Med. 2013;8(27):259–60.
Huang H, Lin J, Xu X. Comparison and experience of team-based learning to teaching of the histological and embryological. Sichuan. J Anat. 2012;20(2):79–81.
Li X. Application of team-based learning to teaching of the medical microbiology course. Chinese J Aes Med. 2012;21(12):802–3.
Xu J, Lu H, Liu G. Application of team-based learning to teaching of the critical care course. J Nurs Sci. 2012;27(13):62–5.
Zhang Q, Ling B, Liao J, Liao G, Zhang Y. Application of team-based learning to teaching of the obstetrics in higher vocational college. Health Vocat Educ. 2012;30(22):47–8.
Wan N. Application of team-based learning to teaching of the pathology. China High Med Educ. 2011;8:106–7.
Eduardo R, Myers DD Jr, Wrobleski SK, Deatrick KB, Londy FJ, Rectenwald JE, et al. P-selectin/PSGL-1 inhibitors versus enoxaparin in the resolution of venous thrombosis: a meta-analysis. Thromb Res. 2010;125(4):e138–42.
Haidet P, Levine RE, Parmelee DX, Crow S, Kennedy F, Kelly PA, et al. Perspective: guidelines for reporting team-based learning activities in the medical and health sciences education literature. Acad Med. 2012;87(3):292–9.
Mody SK, Kiley J, Gawron L, Garcia P, Hammond C. Team-based learning: a novel approach to medical student education in family planning. Contraception. 2013;88(2):239–42.
Thompson BM, Haidet P, Borges NJ, Carchedi LR, Roman BJ, Townsend MH, et al. Team cohesiveness, team size and team performance in team-based learning teams. Med Educ. 2015;49(4):379–85.
Wakabayashi N. Flipped classroom as a strategy to enhance active learning. Kokubyo Gakkai Zasshi. 2015;81(3)-82(1):1–7.
Bleske BE, Remington TL, Wells TD, Klein KC, Guthrie SK, Tingen JM, et al. A randomized crossover comparison of team-based learning and lecture format on learning outcomes. Am J Pharm Educ. 2016;80(7):120.
Remington TL, Bleske BE, Bartholomew T, Dorsch MP, Guthrie SK, Klein KC, et al. Qualitative analysis of student perceptions comparing team-based learning and traditional lecture in a Pharmacotherapeutics course. Am J Pharm Educ. 2017;81(3):55.
This study was supported by the Project of Medical Education Research in 2016 of Society of Medical Education and Specialized Committee of Medical Education of China Association of Higher Education (2016B-FF061), the “13th Five-Year” Educational Research Project (Key Fund) of Nanjing Medical University (ZD2017006), the “12th Five-Year” Educational Research Project (Youth Fund) of Nanjing Medical University (JYQ2015131), the Jiangsu Province Key Research Projects in Higher Education (2013JSJG038), the Priority Academic Program Development of Jiangsu Higher Education Institutions (PAPD), the Top-notch Academic Programs Project of Jiangsu Higher Education Institutions (TAPP, PPZY2015A067). The funding bodies had no role in the study design, collection, analysis, or interpretation of data, or manuscript writing.
Availability of data and materials
All raw data used in this systematic review were extracted from available published articles.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Figure S1. Forest plot for the effect of TBL on examination scores compared with LBL (fixed-effects model). (DOC 2145 kb)