We’re sorry, something doesn't seem to be working properly.
Please try refreshing the page. If that doesn't work, please contact support so we can address the problem.
Team-based learning pedagogy enhances the quality of Chinese pharmacy education: a systematic review and meta-analysis
BMC Medical Educationvolume 19, Article number: 286 (2019)
Recent years have witnessed the wide application of team-based learning(TBL) pedagogy in Chinese pharmacy education. However, the relevant systematic review evaluating the effects of such new pedagogical approach has not been established. The present study was designed to examine systematically the effect of using TBL approach in pharmacy education in China.
Six databases were searched from the inception to January 2019. The studies reporting the performance of pharmacy students in Chinese university or college receiving TBL pedagogy compared to those receiving traditional lecture-based learning (LBL) were enrolled to be analyzed. Scores of the objective theoretical test were considered as the primary outcome, and the results from questionnaires about the number of students who approved the effects of TBL pedagogy on improving their learning enthusiasm, self-study ability, thinking ability, and communication skills were considered as the secondary outcome. A meta-analysis was conducted following the guidelines of the Cochrane Reviewer’s Handbook and the Preferred Reporting Items for Systematic Reviews and Meta Analyses statement.
A total of 1271 students in 12 studies published from 2013 to 2018 were enrolled in present analysis. Compared with traditional LBL pedagogy, TBL pedagogy exhibited more effectiveness in developing the objective tests scores of pharmacy students from both universities (SMD = 1.69, 95% CI [1.10, 2.28], p < 0.00001) and colleges (SMD = 4.37, 95% CI [1.33, 7.40], p < 0.00001), and such pedagogy applied well in experiments-oriented courses (SMD = 2.14, 95% CI [0.86, 3.43], p < 0.00001) and theory-oriented courses (SMD = 2.77, 95% CI [1.41, 4.14], p < 0.00001). In addition, it developed students’ learning enthusiasm, students’ self-study ability, thinking ability, and enhanced students’ communication skills.
TBL pedagogy has developed rapidly and applied widely in Chinese pharmacy education during the last decade. The results indicated that such novel pedagogy is compatible with the present situation of Chinese pharmacy education. And it could be considered as an effective method to enhance both the theoretical test scores and various abilities of Chinese pharmacy students.
The past few decades have witnessed the dramatic developments and reforms in teaching approaches around the world. Compared with the traditional lecture-based learning (LBL), these innovated teaching methods are more emphatic in the students’ innovative consciousness, active communication and creative ability. As one innovative and interactive pedagogical approach, Team-based learning (TBL) expanded beyond its initial business domain into medical school around the world [1,2,3,4,5,6,7]. The introduction of such pedagogical approach enlightens students’ learning motivation and tendency to think autonomously. More importantly, it creates a positive atmosphere in classroom for students to communicate mutually and to solve the problems cooperatively.
However, owing to imbalance and shortage of teaching resources, and the restriction of traditional teaching conceptions, LBL is still the mainstream in the Chinese medical education system. Thus, the long period of simplex and cramming teaching brought Chinese students introverted, quiet personality, and passive study habits. Fortunately, although unknown and hardship existed constantly, the reformation and innovation of Chinese medical education has been proceeding in last ten years .
As a latecomer, TBL pedagogy has emerged and developed rapidly during the recent decades in medical education of China. It has been applied in various universities and colleges, and its effectiveness on improving the educational quality has been proved . Compared with the medical curricula, pharmacy teaching in China places emphasis on the theoretical tests of factual knowledge and the performance of laboratory practice. But shortage of educational materials (classrooms and equipment) and enormous number of students made the classroom still teacher-oriented . Notably, TBL approach provides the advantage that ensuring the effectiveness of small-group learning with high student faculty ratios , which considerably fits for the understaffed condition of pharmacy education in China. Recently, increasing studies have revealed the efficacy of using TBL pedagogy in improving the teaching quality of various pharmacy curricula in China, however, the relevant systematic review has not been established. Therefore, the present meta-analysis was performed with the aim to evaluate systematically the effectiveness of TBL pedagogy adopted in Chinses pharmacy education. We hope that the present study can not only verify the availability of TBL in Chinese pharmacy education system, but also provide some useful information for other regions with similar pedagogical structures in China.
This meta-analysis was conducted consistent with the recommendations in the Preferred Reporting Items for Systematic Reviews and Meta Analyses statement  and the guidelines described in the Cochrane Handbook.
Two independent reviewers (BL and LH) performed the literature search. The databases included China National Knowledge Infrastructure (CNKI), Chinese VIP database, Chinese Wanfang Database, PubMed, Embase, and Cochrane Library were searched. The last literature search was performed on January 11, 2019 using the following search terms: “TBL”, “Team-based learning”, “pharmac*”, “pharmac* education”, “pharmac* students”. The details are shown in Additional file 1: Search strategy.
The studies under the following properties were enrolled:
Participants: Students from Chinese pharmacy institutions.
Intervention: Using TBL pedagogy in pharmacy curricula teaching.
Comparison: Using traditional LBL in pharmacy curricula teaching.
Outcomes: Theoretical test scores (Primary outcome); The incidence of students who accepted the effects of TBL pedagogy on improving their abilities (e.g. learning enthusiasm, self-study ability, thinking ability, and communication skills) from the questionnaires (Secondary outcome).
Study design: Randomized controlled studies with no language limitations.
Literature screening and data extraction
Literature screening and data extraction were carried out by two independent reviewers (BL and LH) and then they cross checked with each other. Full articles were obtained when details from titles and abstracts could not be clarified. The information about general characteristics of studies was collected in a designed table (Table 1). Disagreements were resolved by consensus through discussion among all authors.
Following the Cochrane Collaboration tool for assessing risk of bias , two reviewers (BL and LH) independently evaluated the methodological quality of the enrolled studies. Seven items including allocation concealment, blinding of participants and personnel, blinding of outcome assessment, incomplete outcome data, selective reporting and other bias were checked and graded by high, low, or unclear risk of bias .
Statistical analyses were conducted with Review Manager 5.0 software (The Cochrane Collaboration, London, UK). The risk ratio (RR) with 95% CI and the Mantel–Haenszel method (fixed or random models) were used to analyze dichotomous data (such as the outcome of questionnaires for assessing the effects of pedagogies on students’ qualities and abilities); and for continuous data (for instance, the tests scores), standardized mean difference (SMD) was chosen for the estimation. The impact of heterogeneity on results was weighed by using the I-squared (I2) test. According to Cochrane review guidelines, the fixed-effects model was employed to pool data if there was no heterogeneity (I2 < 50%); Otherwise, the random-effects model was adopted when severe heterogeneity was present at I2 > 50% (or the value of I2 was closed to 50%). Then, sensitivity analysis was performed by excluding each study individually to reassess the quality and consistency of the results. Subgroup analyses were used to explore the diversity among different studies and source of heterogeneity, and we used two variables: students from colleges (3-year program) versus students from universities (4-year program) and experiments-oriented courses versus theory-oriented courses. And we used Begg’s test and Egger’s test to evaluate the publication bias when at least ten studies were enrolled in analysis. A p value less than 0.05 was deemed to be statistically significant.
Literature search results
After searching of databases, 472 items were identified, and 46 of them were excluded by duplicate removing. Of 391 articles excluding in title and abstract review, 172 were not related to theme of our present study, 11 were not performed in the pharmacy institutions, 189 were not performed in mainland of China, 10 were focused the uncorrelated comparison (for instance, the comparison between using the combination of TBL and Case-based learning pedagogy versus using only Case-based learning pedagogy), and 9 were introductions or commentaries. After full-text review, 23 articles were excluded (6 were owing to the absence of control group, 8 were on account of the noncommittal outcome, and 9 of them were not randomized controlled studies. Eventually, 12 studies were enrolled in further analysis [13,14,15,16,17,18,19,20,21,22,23,24]. The procedure of eligible articles screen is described in Fig. 1.
Basic characteristics of enrolled studies
The included studies were published from 2013 to 2018 in Chinese. And the relevant pharmacy curricula including: Pharmacotherapeutics, Drug evaluation and research, Pharmacy administration, Analytical chemistry, Pharmaceutical chemistry, Pharmaceutic experiments, Medical functional experiments, Processing of traditional Chinese medicine, Pharmacology, Physical Chemistry, Medical biology experiments and Biochemistry. All studies reported the outcome of test scores for evaluating the effectiveness of two pedagogy methods. The questionnaires to assess students’ qualities and abilities were performed in four studies [13, 17, 23, 24], all of them mentioned the effects of pedagogies on developing students’ learning enthusiasm and self-study ability, 3 of them mentioned their effects on developing thinking ability, and 2 studies described their effects on enhancing communication skills. The general characteristics of the enrolled studies are shown in Table 1.
Allocation concealment, blinding of participants and personnel, blinding of outcome assessment, incomplete outcome data, selective reporting and other bias were evaluated in accordance with Cochrane Collaboration tool for assessing risk of bias. 40% (5/12) of studies employed an adequate method of random sequence generation [15, 16, 19, 20, 23], and only two studies reported blinding procedure of outcome assessment [23, 24]. On account of the characteristics of two pedagogy methods, the participants and personnel could not be blinded in any of these studies. The overview of risk of bias assessment are shown in Fig. 2.
Effects of two pedagogies on theoretical scores
All studies involving 1271 participants were included, 631 of them were receiving the TBL pedagogy in various pharmacy curricula learning. Owing to the existence of heterogeneity (I2 = 98%), the random-effects model was chosen. Compared with the ones receiving traditional LBL pedagogy, students receiving TBL pedagogy were tend to get higher marks in objective theoretical tests (SMD = 2.55, 95% CI [1.56, 3.55], p < 0.00001). For the substantial heterogeneity between studies was observed, the sensitivity analysis was performed to reevaluate the quality and consistency of the results by omitting individual study sequentially. However, the source could not be clearly attributed to a single study. The results from subgroup analyses including two variables (different education background and different types of curricula) indicated that TBL pedagogy was beneficial to both students who experienced 4-year program education from universities (SMD = 1.69, 95% CI [1.10, 2.28], p < 0.00001) and the ones who received 3-year program education from colleges (SMD = 4.37, 95% CI [1.33, 7.40], p < 0.00001), and TBL pedagogy also applied well in experiments-oriented courses (SMD = 2.14, 95% CI [0.86, 3.43], p < 0.00001) and theory-oriented courses (SMD = 2.77, 95% CI [1.41, 4.14], p < 0.00001). However, high level of I2 in subgroup analyses indicated the heterogeneity still existed. The results are shown in Fig. 3a and b. The results of Egger’s (p = 0.049) tests indicated publication bias was existed (Fig. 4). Then the Duval’s trim and fill method was performed to estimate and adjust for the number and outcomes of missing studies . Although the existence of publication bias, results from sensitivity analyses of trim and fill method (no new studies added) exhibited that the result was reliable.
The incidence of students who accepted the effects of TBL pedagogy on improving their abilities
Effects on developing students’ learning enthusiasm
Four studies involving 567 participants were analyzed, and 288 of them were receiving TBL pedagogy. Compared with the application of traditional LBL pedagogy method, the results from questionnaires indicated that the introduction of TBL pedagogy developed more students’ learning enthusiasm (the ratio of students thinking the pedagogy method had great influence on developing learning enthusiasm: 95.49% in TBL group vs 64.87% in LBL group, RR = 1.38 with 95% CI [1.13,1.69], p < 0.0001, I2 = 83%). The substantial heterogeneity cannot be resolved by deleting a single study, thus, the random effect was performed (Fig. 5a).
Effects on developing students’ self-study ability
A total of 567 students from four studies were included, and 288 of them were receiving TBL pedagogy. The results from questionnaires indicated that the introduction of TBL pedagogy also developed more students’ self-study ability compared to LBL (the ratio of students thinking the pedagogy method had great influence on developing self-study ability: 93.40% in TBL group vs 70.97% in LBL group, RR = 1.32 with 95% CI [1.21,1.43], p < 0.0001, I2 = 32%). The statistical heterogeneity did not exist among the study results; thus, a fixed-effects model was employed to perform the analysis (Fig. 5b).
Effects on developing students’ thinking ability
Three studies involving a total of 405 students were enrolled, and 206 of them were receiving TBL pedagogy method. The responses of questionnaires revealed that the application of TBL significantly developed students’ thinking ability compared to LBL (the ratio of students thinking the pedagogy method had great influence on developing thinking ability: 93.69% in TBL group vs 58.79% in LBL group, RR = 1.45 with 95% CI [1.04,2.02], p < 0.0001, I2 = 88%). The heterogeneity was resolved after removing the Luo study  (I2 = 0%), and the summary estimate was unchanged essentially (the ratio of students thinking the pedagogy method had great influence on developing thinking ability: 92.68% in TBL group vs 74.39% in LBL group, RR = 1.24 with 95% CI [1.08,1.43], p < 0.0001). The result is shown in Fig. 5c.
Effects on enhancing students’ communication skills
Two studies involving 262 students were analyzed, and 132 of them were receiving TBL method. The I2 of 0% indicated that there was no substantial heterogeneity, thus the fixed effect model was chosen. The results from the questionnaires demonstrated that TBL method enhanced students’ communication skills obviously (the ratio of students thinking the pedagogy method had great influence on enhancing communication skills: 93.18% in TBL group vs 76.15% in LBL group, RR = 1.22 with 95% CI [1.10,1.36], p < 0.0001). The result is shown in Fig. 5d.
For restrictions of traditional teaching conceptions, the lecture-based learning was dominated in Chinese education structure. Nevertheless, the condition of domestic education has been changed as the introduction of the innovative pedagogical approaches over the recent years. For instance, problem-based learning (PBL) was an educational innovation developed in recent decades especially in China. Many Chinese pharmacy institutions have made tentative steps in practicing such novel pedagogy. Zhou et al. have performed the analysis systematically to verify the effectiveness of such novel pedagogy methods in domestic pharmacy education . As a pedagogical model of small-group learning, TBL also has been approved and highly praised in health science education  for its efficiency in improving teaching quality and for its high satisfaction in students. The effectiveness of TBL pedagogy was also supported by similar studies performed in some developed countries, and the scope of its application covered medical, nursing, and pharmacy education [29,30,31]. Compared with the application of TBL in Chinese medical education , it started even later in pharmacy education of China. The present study was the first meta-analysis to evaluate the effectiveness of TBL on Chinese pharmacy education. We also would like to explore more useful information about the applicability of such pedagogical method in domestic educational institutions at different levels and in different types of curricula (pure theory-oriented courses/experiments-oriented courses). In addition, we expected to learn which aspects of students’ quality would be improved by application of TBL.
By summarizing the relevant studies about the application of TBL in Chinese pharmacy education, the present study demonstrated that such pedagogy has been introduced and even applied widely during last decade in China. The time range of published literatures (2013–2018) means it is still in an embryonic stage, but it has served Chinese pharmacy education well in various institutions at different hierarchical level. We are encouraged by the results of analysis that students receiving TBL process gained higher scores in theoretical tests compared to the students receiving traditional LBL process. Considering the substantial heterogeneity, we performed sensitivity analysis and chose the random-effects model, and the positive effects were also verified.
To assess the effects of two pedagogies on students’ qualities and abilities, according to the descriptions in some articles, the questionnaires were sent to the participants. The ratio of students thinking the pedagogy method had great influence on developing various qualities and abilities was analyzed in our study. We obtained more positive feedbacks from the students who receiving TBL pedagogy, and they were manifested by the developments of students’ learning enthusiasm, self-study ability, thinking ability, and the enhance of students’ communication skills.
Chinese pharmacy institutions are divided into different levels. Compared with the students from colleges (3-year program), the students from universities (4-year program) have higher scores of entrance examination and stronger continuous learning capability. Remarkably, the results of present study indicated that both the students from universities and those from colleges experienced considerable developments after receiving TBL teaching method, which represents the adaptability of TBL pedagogy in Chinese pharmacy education. It also appears that such pedagogy should be generalized in more Chinese classrooms.
Limitations and future studies
The current research’s limitations derived from the methodological quality and design of the enrolled studies. Firstly, owing to the open environment of teaching process, allocation concealment and blinding of participants were difficult to be practiced. Secondly, as the search strategies were strictly delimited to the areas in Chinese classrooms, plenty of literatures published in Chinese were analyzed in present research. The results of Egger’s (p = 0.049) tests indicated the existence of publication bias, however, there was no indications of publication with the trim and fill method (no new studies added), which demonstrated that the result was reliable. Furthermore, to explore the reasons for substantial the heterogeneity found in the main analysis, subgroup analyses were conducted for two variables (1. Scores of students from colleges versus students from universities; 2. Scores of students experienced experiments-oriented courses versus theory-oriented courses). However, the major cause of heterogeneity is still uncertain. The source of heterogeneity may be resulted from unreported factors (e.g. teaching resources).
In addition, the published literatures indicated that the number of methods to evaluate the effectiveness of pedagogy were limited. We collected and analyzed two sorts of outcomes including the theoretical scores and the responses of questionnaires. However, there were different types of questionnaires during data collection, thus, we performed data combination only for the studies containing the same items, and the effects investigation of TBL pedagogy focuses on the following four aspects: learning enthusiasm, self-study ability, thinking ability, and communication skills of students. Actually, to comprehensive evaluate the effectiveness of TBL pedagogy in depth, high-quality evidences with multiple and standardized evaluation methods are necessary.
The results of our study indicated the gratifying effectiveness of TBL application in Chinese pharmacy institution during last decade. It enhanced the theoretical scores and various abilities of Chinese pharmacy students. To evaluate the effectiveness of TBL pedagogy comprehensively, it calls for more high-quality studies and more standardized evaluation methods in future. Overall, TBL pedagogy is compatible with the present Chinese pharmacy education, and it should be generalized in more classrooms.
Availability of data and materials
The data analyzed in our study were collected from available published articles.
Chinese national knowledge infrastructure
Standardized mean difference
Burgess AW, McGregor DM, Mellis CM. Applying established guidelines to team-based learning programs in medical schools: a systematic review. Acad Med. 2014;89(4):678–882.
Hunt DP, Haidet P, Coverdale JH, Richards B. The effect of using team learning in an evidence-based medicine course for medical students. Teach Learn Med. 2003;15:131–9.
Seidel CL, Richards BF. Application of team learning in a medical physiology course. Acad Med. 2001;76:533–4.
Wiener H, Plass H, Marz R. Team-based learning in intensive course format for first-year medical students. Croat Med J. 2015;50(1):69–76.
Borges NJ, Kirkham K, Deardorff AS, Moore JA. Development of emotional intelligence in a team-based learning internal medicine clerkship. Med Teach. 2012;34(10):802–6.
Inuwa IM. Perceptions and attitudes of first-year medical students on a modified team-based learning (TBL) strategy in anatomy. Sultan Qaboos Univ Med J. 2012;12(3):336–43.
Okubo Y, Ishiguro N, Suganuma T, Nishikawa T, Takubo T, Kojimahara N, et al. Team-based learning, a learning strategy for clinical reasoning, in students with problem-based learning tutorial experiences. Tohoku J Exp Med. 2012;227(1):23–9.
Xu D, Sun B, Wan X, Ke Y. Reformation of medical education in China. Lancet. 2010;375(9725):1502–4.
Chen M, Ni C, Hu Y, Wang M, Liu L, Ji X, et al. Meta-analysis on the effectiveness of team-based learning on medical education in China. BMC Med Educ. 2018;18:77.
Zhou J, Zhou S, Huang C, Xu R, Zhang Z, Zeng S, et al. Effectiveness of problem-based learning in Chinese pharmacy education: a meta-analysis. BMC Med Educ. 2016;16:23.
Zgheib NK, Simaan JA, Sabra R. Using team-based learning to teach pharmacology to second year medical students improves student performance. Med Teach. 2010;32(2):130–5.
Moher D, Liberati A, Tetzlaff J, Altman DG, PRISMA Group. Preferred reporting items for systematic reviews and meta-analyses. The PRISMA statement. BMJ. 2009;339:b2535.
Shang Z. Evaluation of the application effect of TBL method in pharmacotherapeutics teaching. Med Front. 2018;8(13) Chinese.
Mao Y, Zhang X, Ma X, Gong X, Yuan B, Lu G. Application of TBL teaching method in drug research and evaluation. Basic Med Educ. 2013;15(10) Chinese.
Feng X, Huang H, Chen W, Tao C, Li G. Study on the application of TBL method in the teaching of pharmacy administration. Med Front. 2016;6(12) Chinese.
Yan J, Liao G, Yang X, Yao M, Liu Z. Application of TBL method in analytical chemistry teaching. J Mod Med Health. 2016;32(22) Chinese.
Luo X. Exploration of TBL teaching method in pharmaceutical chemistry curriculum teaching of secondary technical college. Guangdong Tech Educ Res. 2017;5 Chinese.
Gao M, Tian Y, Li L, Li Z. Application of TBL model in experimental teaching of pharmaceutics. Health Vocational Educ. 2015;21 Chinese.
Zhang H, Yi G, Chen K, Tan J, Zeng Y, Jiang Z. Application of TBL teaching model in medical function experiment. Basic Med Educ. 2014;16(4) Chinese.
Xie Z, Wang M, Hu Y, Dai X. TBL teaching model in the processing technology of exploration in the practice teaching reform. J North Pharmacy. 2015;4 Chinese.
Wu X, Zhang H, Xue Q. Practice of TBL teaching in pharmacology teaching for foreign students. Chin J Med Edu Res. 2017;16(2) Chinese.
Yang T, Zhao L. Application and discussion of TBL teaching method in physical chemistry teaching of pharmacy students in independent medical colleges. Sci Educ Article Collects. 2018;1 Chinese.
Yang X, Li G, Zhao Q, Yin J, Lei X. Practice of flipped classroom integrated with TBL teaching methodology in teaching medical biology experiments. J Biol. 2018;35(1) Chinese.
Yi T, Li S, Zhang C, Wang H, Guo H. The application of TBL teaching method combined with mind mapping in the teaching of biochemistry. China Continuing Med Educ. 2018;10(15) Chinese.
Higgins JP, Altman DG, Gøtzsche PC, et al. Cochrane statistical methods group. The Cochrane Collaboration’s tool for assessing risk of bias in randomised trials. BMJ. 2011;343:d5928.
Higgins JP, Altman DG, Sterne JA. Chapter 8: assessing risk of bias in included studies. In: Cochrane handbook for systematic reviews of interventions. London: The Cochrane Collaboration; 2008. p. 187–241.
Duval S, Tweedie R. Trim and fill: a simple funnel-plot–based method of testing and adjusting for publication bias in meta-analysis. Biometrics. 2000;56(2):455–63.
Kalaian SA, Kasim RM. Effectiveness of various innovative learning methods in health science classrooms: a meta-analysis. Adv in Health Sci Educ. 2017;22:1151.
Searle NS, Haidet P, Kelly PA, Schneider VF, Seidel CL, Richards BF. Team learning in medical education: initial experiences at ten institutions. Acad Med. 2003;78:S55–8.
Clark MC, Nguyen HT, Bray C, Levine RE. Team-based learning in an undergraduate nursing course. J Nurs Educ. 2008;47:111–7.
Bleske BE, Remington TL, Wells TD, Klein KC, Guthrie SK, Tingen JM, et al. A randomized crossover comparison of team-based learning and lecture format on learning outcomes. Am J Pharm Educ. 2016;80(7):120.
Ethics approval and consent to participate
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Search Strategy. Details of search strategy in different databases. (DOCX 16 kb)