Skip to main content

Evidence-based practice confidence and behavior throughout the curriculum of four physical therapy education programs: a longitudinal study

Abstract

Background

Evidence-based practice (EBP) is a foundational process taught in health professional education, yet it is unclear when EBP confidence and skills are obtained. Increases in EBP confidence and behaviors from the start of physical therapy programs to post graduation have been reported in studies that evaluated a single program or used non-valid questionnaires. This study aimed to describe changes in EBP confidence and behavior using validated questionnaires of students from four physical therapy education programs throughout their curriculum and one year post graduation.

Methods

One hundred and eighty-one students from a potential pool of 269 (67.3%) consented to participate. Students completed the Evidence-Based Practice Confidence (EPIC) Scale and the Evidence-Based Practice Implementation Scale (EBPIS) at 6 timepoints: start of the program, prior to first clinical experience, after first clinical experience, at the end of classroom instruction, graduation, and one year post. Medians (Mdn) and 25th and 75th percentiles (P25, P75) were calculated for 42 (23.2%) students with complete data across all timepoints. Change between timepoints was assessed using Friedman’s test and Wilcoxon signed rank test with a Bonferroni correction for post hoc analysis.

Results

There were significant changes in EPIC scores (p < 0.001) from enrollment (Mdn 50.0, P25, P75 35.5, 65.9) to prior to first clinical experience (Mdn 65.5, P25, P75 57.3, 72.5) and after the first clinical experience (Mdn 67.3, P25, P75, 58.9, 73.2) to the end of classroom instruction (Mdn 78.6, P25, P75, 72.0, 84.1). Significant increases on the EBPIS (p < 0.01) were only seen from after the first year of training (Mdn 15, P25, P75, 10.0, 22.5) to end of the first clinical experience (Mdn 21.5, P25, P75 12.0, 32.0).

Conclusions

EBP confidence increased significantly after classroom instruction but remained the same after clinical experiences and at one year post graduation. EBP behavior significantly increased only after the first clinical experience and remained the same through graduation. Confidence and behavior scores were higher than were previously reported in practicing professionals. Ongoing assessment of EBP confidence and behavior may help instructors build appropriate curricula to achieve their outlined EBP objectives.

Peer Review reports

Background

Evidence-Based Practice (EBP) is the integration of best available evidence, clinical expertise, and patient preferences [1]. EBP can improve quality of health care and patient outcomes and is a foundational skill taught in health care professional education [2, 3]. Despite the over 30 years of focus on teaching EBP in professional education, inconsistencies in the curricular content remain and lack of effective methods to change attitude, knowledge, confidence, skill, and behavior have been reported [4, 5]. Educators emphasize the first 3 steps of EBP (ask, search, appraise) and may not formally teach steps 4 and 5 (integrate and evaluate) [2, 5]. These omissions may lead to barriers such as lack of confidence and lack of skills, that are commonly reported to interfere with using evidence in practice [2, 6, 7].

To improve teaching and learning of EBP, core competencies [2] and curricular guidelines [3] have been created. Health care profession educators developed 68 competencies that align with the 5 steps of EBP and suggested levels of comprehension for each [2]. The Academy of Physical Therapy Research of the American Physical Therapy Association, also developed EBP Curricular Guidelines for physical therapy educators [3]. This consensus document was intended to standardize the skills taught in EBP education and has 33 terminal behavioral objectives arranged by the 5 steps of EBP. It provided suggestions for content evaluation, content mapping, student assessment, and faculty preparation. The developers further proposed that EBP skills be continually taught with increasing complexity throughout professional education, so they can more easily be integrated in practice.

The Sicily statement recommended valid and reliable standardized assessment tools to evaluate student EBP attitudes, knowledge, self-efficacy, skill, and behavior [8]. These recommendations complement the EBP Curricular Guidelines. [3] The need to use psychometrically sound assessment tools that accurately evaluate EBP education has been previously highlighted [1, 2, 4, 9]. The assessment tools recommended measure both EBP self-efficacy and behavior. The social cognitive theory suggests there is a link between self-efficacy or confidence and behavior [10]. Self-efficacy refers to people’s judgement (confidence) that they have the capacity and skills to perform certain activities [10]. For example, the social cognitive theory would suggest that if a student has confidence and self-efficacy to perform EBP, they may be more likely to engage in EBP.

Several studies in rehabilitation have measured changes in self-efficacy and behavior following evidence based educational interventions for both students and practicing rehabilitation professionals [11,12,13,14,15]. Findings on the relationship between self-efficacy and behavior have been mixed [11,12,13,14,15]. Tilson et al. [11, 14, 15] reported increases in practicing physical therapists’ self-efficacy and behavior following training in evidence-based practice that was sustained over 2 years. McEvoy et al. 2011 [12] found physical therapy graduates confidence remained the same one-year post graduation while EBP behaviors decreased. Petzold et al. 2012 [13] found a weak negative correlation between self-efficacy and evidence-based behaviors following training on unilateral spatial neglect of practicing occupational therapists.

To date, few studies have considered the social cognitive theory to report changes in physical therapy students EBP knowledge, confidence, and behavior across their professional education [12]. Other studies report on knowledge and behavior without measuring confidence [16, 17] Limitations of those studies included use of unvalidated questionnaires [16] and assessment of a single cohort of students or students from a single university [17]. Studies that have assessed EBP knowledge and behaviors immediately post-graduation have found behaviors remain the same or decrease after graduation [12, 16]. A cross-sectional study found that most graduates used clinical experience as their primary source of EBP decision making [18]. A longitudinal, mixed methods study on physical therapy and occupational therapy graduates found a decline in the use of EBP overtime and that EBP was influenced by personal and peer experiences, client needs and resources [19].

Questions remain about when EBP confidence is acquired, the frequency of EBP behaviors, and if they are retained after graduation. Further, comparisons across different curricula, public and private institutions, and countries are not reported in the literature. The purpose of this study was to describe changes in EBP confidence and behavior among students from the time of enrollment in four university-based physical therapy education programs up to one year post graduation.

Methods

Participants

The aim of this four-year longitudinal study was to describe changes in EBP confidence and behaviors among physical therapy students and graduates. Physical therapy students enrolled in entry-level physical therapy education programs at four universities in 2014 were invited to participate. At three universities, we described the protocol during recruitment presentations and interested students signed informed consent forms. At one university, students consented via completion of the first survey questionnaire after receiving an introductory email. The Institutional Review Boards at Chatham University, Rutgers University (ID# Pro20140000413) and Sacred Heart University (#140722A) and the Research Ethics Board at University of Toronto (#30,645) approved this study.

Setting

The universities, their location, characteristics, and number of students were as follows:

  • University A (American, Private, Doctorate, Problem Based, Small Cohort Size 42).

  • University B (American, Public, Doctorate, Traditional, Medium Cohort Size 65).

  • University C (American, Private, Doctorate, Problem Based, Medium Cohort Size 67).

  • University D (Canadian, Public, Master’s, Traditional, Large Cohort Size 95).

Problem based curricula is a student-centered approach, where students are presented with a messy, real-world problem that doesn’t have a single correct answer [20]. At Universities A and C, the problems are presented to small student groups in the form of a patient case. Students must research, apply their knowledge and skill, and then collaborate to define the problem and determine a solution, such as, analysis of examination results or development of a plan of care. An instructor (tutor) facilitates the learning process, debriefs after each case, but does not “lecture.” [20] Traditional curricula is instructor-led, uses a lecture-based format, and may use patient cases, small group work and class discussion [20]. Additional details of each university curriculum can be found in Supplementary 1.

University A had five dedicated EBP courses, starting with portions of Principles of Practice I and II, leading to Research I-III. Weekly article presentations that included searching, appraising, and determining levels of evidence are required during small group discussion and in didactic courses that include problem-based learning. Small student groups complete a systematic review of the literature as a final project. This program encouraged students to present evidence-based in-services during full-time clinical experiences.

University B had four dedicated clinical inquiry courses combining evidence-based practice with clinical reasoning, as well as EBP integrated experiences in other courses. Two foundation courses teach students how to read Clinical Practice Guidelines, Systematic Reviews, Randomized Controlled and cohort studies, using a case-based approach. In the third course groups use a PICO (Patient, Intervention, Comparison, Outcome) format to systematically review and appraise the literature, with a goal of becoming effective and efficient with the process. A poster presentation with a submitted abstract is the final product of the course. The fourth course is on Outcome Assessment. Clinical experiences encourage students to present evidence-based in-services. Integration of evidence with clinical content occurs throughout the program.

University C had four dedicated evidence in practice courses. One foundational course taught students how to search and appraise the literature. Two courses used a case-based approach to teach students to ask, search, appraise and integrate the literature. The final course included a capstone experience where students designed a research protocol with literature review and plan for data analysis without project implementation. EBP is integrated in the problem-based learning course work through twice weekly article presentations based on patient cases. Clinical experiences required students to complete an evidence-based case presentation as well as encourage an evidence-based in-service. Integration of evidence with clinical content is throughout the program.

University D had three dedicated research courses as well as EBP content (e.g., overview of EBP steps, levels of evidence) and activities (e.g., acquiring, appraising, summarizing, and applying literature on clinical topics) integrated throughout the program. By the end of the program students complete a capstone research project with faculty facilitation, involving protocol development, Research Ethics Board application, data collection and analysis, manuscript drafting and poster presentation. Students complete an evidence-based case study report based on one of their clinical internships.

Data collection

Students’ EBP confidence and behavior were measured using the Evidence Based Practice Confidence (EPIC) Scale [21, 22] and the Evidence Based Practice Implementation Scale (EBPIS), respectively [23]. These scales were recommended as valid and reliable EBP assessment tools by delegates at the 2009 International Conference of Evidence Based Health Care Teachers and Developers in the Sicily Statement [8]. Health care professionals and students use the 11-item EPIC scale to rate their perceived confidence in implementing steps of EBP on an ordinal response scale that ranges from 0% (no confidence) to 100% (completely confident). Item-level scores are averaged to determine a total score of 0-100% [21, 22]. Validity and reliability has been established in physical therapy [21, 22]. The EBPIS is an 18-item scale that measures the extent to which EBP is implemented. The EBPIS is scored on a 5-point frequency scale by indicating how often in the past 8 weeks the item was performed. The scale ranges from 0 meaning “0 times” to 4 meaning “greater than 8 times.” The score is totaled and can range from 0 to 72, 0 meaning no times over the past 8 weeks and 72 meaning greater than 8 times in all questions in the past 8 weeks. Validity and reliability have been established in nursing [23].

Demographic questions and the EPIC and EBPIS were uploaded into Survey Monkey® and sent to participants via email. The questionnaires were completed at the start of the physical therapy program (T0), just prior to the first full-time clinical experience (T1), after their first clinical experience (T2), at the end of the classroom instruction (T3), at graduation (T4) and one year after graduation (T5). The EBPIS was not completed at the start of the program (T0) as implementation of EBP was not anticipated prior to the start of their professional degree. The effect of classroom instruction was captured T1 and T3 and clinical experiences was captured at T2 and T4. Each timepoint differed across universities and is highlighted in Supplementary 1. The end of classroom instruction (T3) varied the most across universities. Universities A-C completed classroom instruction in the beginning or middle of the third year, while university D completed classroom instruction near the end of year 2.

Data analysis

Participants who completed all questionnaires at all five times points were included in the analysis. A Mann Whitney U was completed to compare sex, age, prior research experience and scores at all timepoints for the EPIC and EPBIS to determine any differences between the included participants who completed questionnaires across all timepoints (“completers”) and those who did not (“non-completers”).

For the participants who completed all questionnaires, the total EPIC and EBPIS scores were summarized using medians and 25th and 75th percentiles within and across universities as data did not meet assumptions of normality. Friedman’s tests were used to determine significant changes across classroom instruction and clinical experiences as well as one year post graduation respectively within and across all universities for both the EPIC and EBPIS. Post hoc analyses were conducted using a Wilcoxon signed rank test with Bonferroni’s correction. Data were compared to the previous timepoint. The Bonferroni’s Correction for the EPIC scale was alpha < 0.0083 (p = 0.05/6) and for the EBPIS was alpha < 0.01 (p = 0.05/5) based on the number of times the questionnaires were completed. The percentage of participants achieving the Minimal Detectable Change (MDC) at the 95% confidence level (MDC95) of the EPIC scale of 6.1% was evaluated at each timepoint by each university and between all universities to determine if observed changes exceeded measurement error [22, 24]. MDC has not been established for the EBPIS. A Spearman rank order correlation was run to determine if there was a relationship between evidence-based confidence and behavior using the EPIC and EBPIS.

Results

One hundred and eighty-one students from a potential pool of 269 (67.3%) consented to participate. A total of 42 (23.2%) students completed the EPIC and 44 (24.3%) completed the EBPIS at all timepoints. Regarding completion of questionnaires at all 5 timepoints, University A retained 6/28 (21%), University B 8/42 (19%), University C 15/54 (28%) and University D 13/57 (23%) individuals (“completers”). The total number of students with EPIC scores at each timepoint was T0 n = 139, T1 n = 129, T2 n = 111, T3 n = 107, T4 n = 85, T5 n = 60. Those with EBPIS scores at each timepoint was: T1 n = 126, T2 n = 107, T3 n = 105, T4 n = 84, T5 n = 59.

The median age of the participants at baseline was 22 years (P25, P75. 21, 24). The majority of students were female (n = 35, 80%), held a bachelor’s degrees (n = 40, 91%) and had previous research experience (n = 23, 52%) (Table 1).

Table 1 Participant Characteristics at Baseline by University

There were no differences between the participants who completed all five questionnaires (“completers”) and those who did not complete all five questionnaires (“non-completers”) for age (U = 1918.5, p = 0.226), previous research experience (U = 2008.0, p = 0.410) and across all timepoint for the EPIC and EBPIS (p > 0.05) (EPIC T0 U = 1772.5, p = 0.225, T1 U = 1791.5, p = 0.858, T2 U = 1351.1, p = 0.559, T3 U = 1142.5, p = 0.156, T4 = 781.0, p = 0.283, T5 U = 369.5, p = 0.891, EBPIS T1, U = 1612.5, p = 0.433, T2 U = 1326.0, p = 0.803, T3 U = 1098.0, p = 0.160, T4 U = 800.5, p = 0.367, T5 U = 374.0, p = 0.805). There was a significant difference in sex between completers and non-completers, (U = 1776.5, p = 0.022) as there was a lower percentage of females in the non-completing group (completers 81%, non-completers 51%).

Table 2 shows the differences across timepoints on the EPIC scores among pooled completers, by university, and the percentage of completers that achieved the MDC95 (6.1%) [22, 24].

Table 2 Scores on the Evidence-Based Practice Confidence Scale (EPIC) by Timepoint and University (n = 42)

Figure 1 shows the individual items on the EPIC at start of the program (T0), graduation (T4) and one year post (T5). There was a statistically significant difference in EBPIS scores for pooled universities at T1-T2 only (after their first clinical experience) (chi square (4) = 22.611, p < 0.01, Z=-4.145, p < 0.001) (Table 3).

Fig. 1
figure 1

Median Scores on Evidence-Based Practice Confidence Scale (EPIC) Items by Timepoint. T0: Timepoint 0, start of program; T1: Timepoint 1, prior to first clinical experience; T2: Timepoint 2, after first clinical experience; T3: Timepoint 3, end of classroom instruction; T4: Timepoint 4, graduation; T5: Timepoint 5, one year after graduation

Table 3 Scores on the Evidence Based Practice Implementation Scale (EBPIS) by timepoint and university (n = 44)

When comparing within the universities on the EBPIS, none of the universities had significant differences when compared to their previous timepoint. Table 4 shows the median scores of individual items on the EBPIS prior to their first clinical experience, graduation and one year post graduation. There were weak positive correlations [25] between EPIC and EBPIS at T1 (rho = 0.245, p = 0.006) and T2 (rho=. 210, p = 0.03).

Table 4 Median Item and Total Score on the Evidence Based Practice Implementation Scale (EBPIS) prior to first clinical experience, Graduation and One Year Post Graduation (n = 44)

Discussion

This longitudinal study on the EBP confidence and behaviors of physical therapy students and graduates across four physical therapy education programs found improvements in both EBP confidence and behavior. Specifically, EBP confidence increased significantly throughout the programs and remained the same at one year post graduation. EBP behavior increased the greatest after their first clinical experience and remained the same through graduation. This study assessed EBP confidence and behavior using recommended standardized tools throughout the curriculum. These results provide a basis for assessment throughout the curriculum as it can enhance planning to better prepare students to enact EBP.

Median EBP confidence generally increased from around 50–80% across the four universities. Both the pooled and individual programs had the highest percentage (> 50%) of participants exceeding the MDC95 after classroom instruction (T0 to T1 and T2 to T3). The 30% increase in confidence found in this study is similar to articles reporting on changes in occupational therapy and speech language pathology students following didactic and clinical education [26,27,28,29]. The occupational therapy and speech language pathology students started their programs with mean EPIC scores of 44% that increased to 78% at graduation [26,27,28,29]. Comparison with physical therapy education programs is not possible as the EPIC has not been previously reported in physical therapy students. Other authors have discussed increased confidence following didactic and clinical education using alternative scales throughout physical therapy programs and in didactic training in physical therapy practice [12, 16, 17].

The graduates in the present study generally rated their confidence on the EPIC higher (78–81%) than practicing rehabilitation professionals (53–70%) [14, 22, 30, 31]. This may be due to the lack of time that has elapsed since the participants completed their entry level EBP training. Similar to practicing rehabilitation professionals, participants in this study reported the highest confidence on the EPIC with EBP steps 1, 2, 4, and 5 and less confidence with appraisal (step 3) [22]. Salbach [22] reported scores higher than 70% on EPIC items 1–3 focused on asking and searching and EPIC items 8–11 on integration and evaluation. The participants in our study reported median scores 80% or greater on items 1–3 and 8–11. Median scores on items such as interpreting a t-test or a regression, in this study were 65%. Salbach [22] also reported low averages (35–39%) on these items.

The median EBP behaviors using the EBPIS had a significant increase between the end of the first year of classroom training (15/72) and the end of their first clinical experience (21.5/72). The improvement after clinical experience was unexpected as other authors have reported wide variations in EBP beliefs of clinical instructors, [32] multiple barriers’ to using EBP in the clinic [7] and the lack of communication between programs and clinical site regarding EBP and EBP Curricular Guidelines [5]. More research is needed to determine if clinical instructors are supporting students in their EBP behaviors.

Although there was an increase in EBPIS scores after the first clinical experience, these scores were low (15-21.5/72) and did not significantly change at subsequent timepoints through graduation and one year post. The low EBP behaviors reported in our study have been previously reported in nursing and occupational therapy students with total scores ranging from 14.5-25.34/72 [5, 33,34,35]. The EBPIS behaviors reported in our study were slightly higher than those reported among nurses and physical therapists with total scores ranging from 7.7–15/72 [36,37,38]. The most frequently reported behaviors (3–4 times over 8 weeks) of the students and graduates included using evidence to inform decision making, evaluating the outcome of practice, and sharing research with a patient or family. Participants, including graduates, reported never completing the following: Accessing the National Guidelines Clearinghouse, evaluating a care initiative by collecting patient outcome data, and sharing outcome data collected with classmates/instructors/colleagues. These behaviors align with step 5 of EBP and have been reportedly under-emphasized in education [2, 5].

In this study, each university differed in their methods of EBP content delivery and patterns of improvement, yet confidence and behaviors started and ended similarly across universities. Confidence improved the greatest across programs after classroom instruction (T0 to T1 and T2 to T3) and behavior improved after clinical experiences (T1 to T2 and T3 to T4). Confidence and behavior remained the same one-year post graduation. Chen [5] reported that the number of EBP credits, length of program, and number of program credits correlated with the number of EBP objectives and the expected mastery of the objectives in the EBP curricular guidelines. Class size inversely correlated with objectives and mastery. Interestingly, the four programs in this study varied in size, number of credits, and length, curricular structure and timing of didactic instruction and clinical placements yet EBP confidence and behaviors were similar. Future research should compare objectives and mastery with confidence and behavior.

Although the scales were scored differently, this study found relatively high confidence yet low frequency of EBP behaviors. There were weak positive correlations between EBP confidence and behavior at 2 timepoints, just prior to the first main clinical experience (T1) and after their first clinical experience (T2). Previous authors have reported the lack of relationship between evidence-based beliefs/confidence and evidence-based implementation using the Evidence Based Practice Belief Scale and the Evidenced Based Practice Implementation Scale for nursing students, [33, 35] occupational therapy students, [34] and practicing physical therapists [36]. Tilson et al. [15] provided a 6 month multi-component evidence based practice training to practicing physical therapists and found significant improvements pre- and post- with both the EPIC and the EBPIS scales, but did not report if there was a relationship between the two. The relationship between confidence and behavior using EPIC and EBPIS needs further investigation.

Many factors can influence EBP confidence and behavior that have not been captured in this study. These may include previous research experience, the emphasis (or lack thereof) on evidence in “non-EBP” (i.e. clinical management) courses, and the focus (or lack thereof) on EBP by clinical instructors during clinical experiences. These factors hint at the challenge of teaching the foundational EBP content and the potential need to emphasize integration of evidence across the curriculum as recommended by the curricular guidelines [3]. Future research should explore the most effective methods for delivering EBP content for professional health care students.

The acceptable level of EBP confidence and behavior among students, physical therapists, and rehabilitation professionals remains unclear. Physicians have reported they do not use all 5 steps of EBP in clinical practice [1]. Educators primarily teach steps 1–3 [2, 5]. Expecting graduate physical therapy students to be 100% confident in interpreting statistical analyses is likely not a reasonable goal for entry level practice education. Additionally, the low frequency of data collection reported on the EBPIS may not be a behavior we expect from students and rehabilitation professionals. The question remains about what evidence-based behaviors should be frequently completed. Such a determination may revise the weights of the scale items based on the ideal EBP practitioner behavior. Finally, relationships between EBP confidence and behavior, and patient outcomes, should be elucidated.

Limitations

There were several limitations in this study. The response rate was low which reduces the generalizability of these findings. There was a high drop-out (attrition) rate (“non-completers”) that occurred across time, though this was similar to other previously reported longitudinal studies [16, 17, 19]. The highest level of drop-out occurred at one-year post graduation (T5). The between-school differences were reported descriptively and must be compared with caution due to the low number of completers. Participants at the university with the highest retention rate, and the highest EBPIS score, University C, were emailed the questionnaire at each timepoint from a familiar instructor (WR). This familiarity may have also biased these results.

Conclusion

Evidence-based confidence and behavior improved and remained the same post-graduation following training in four physical therapy programs. A longitudinal comparison among several graduate physical therapy programs found greatest improvements in confidence after classroom instruction and greatest improvements in behavior after clinical experiences. Clinical experiences appear to improve the frequency of EBP behaviors, but this overall frequency remained low and remained low through the first year of practice. Assessment of EBP confidence and behavior may help instructors build appropriate curricula to achieve outlined EBP objectives. The acceptable level of EBP confidence and behavior across the five steps of EBP among rehabilitation professionals needs further investigation.

Data Availability

The datasets supporting the conclusion of this article are available in the Harvard Dataverse repository at: https://dataverse.harvard.edu/dataset.xhtml?persistentId=doi:10.7910/DVN/WWAU7E [39].

Abbreviations

EBP:

Evidence based practice

EPIC:

Evidence-Based Practice Confidence

EBPIS:

Evidence based practice implementation scale

Medians:

Mdn, 25th and 75th Percentiles:P25, P75

PICO:

Patient, Intervention, Comparison, Outcome

MDC:

Minimal Detectable Change

References

  1. Straus S, Richardson W, Glasziou P, Haynes R. Evidence-based Medicine: how to practice and teach EBM. 3rd ed. Edinburgh: Churchill Livingstone; 2005.

    Google Scholar 

  2. Albarqouni L, Hoffmann T, Straus S, Olsen NR, Young T, Ilic D, et al. Core competencies in evidence-based practice for health professionals: Consensus statement based on a systematic review and Delphi survey. JAMA Netw Open. 2018;1(2):e180281. https://doi.org/10.1001/jamanetworkopen.2018.0281.

    Article  Google Scholar 

  3. Kaplan SL, Tilson JK, Levine D, George SZ, Fay D, Hack L, et al. Strategies for using the APTA section on research evidence-based practice curriculum guidelines. J Phys Ther Educ. 2016;30(2):23–31. https://doi.org/10.1097/00001416-201630020-00006.

    Article  Google Scholar 

  4. Howard B, Diug B, Ilic D. Methods of teaching evidence-based practice: a systematic review. BMC Med Educ. 2022;22(1):742. https://doi.org/10.1186/s12909-022-03812-x.

    Article  Google Scholar 

  5. Chen Y, Selby-Silverstein L, Greenberger HB, Gobert D, Levine D, Kaplan SL. Evidence-based practice doctor of physical therapy curricular guideline utilization: a convergent parallel mixed methods study. J Phys Ther Educ. 2023;37(1):9. https://doi.org/10.1097/JTE.0000000000000256.

    Article  Google Scholar 

  6. Kume J, Tandel R, Indelicato J. Application of the evidence-based practice model by physical therapy clinical practitioners. J Allied Health. 2019;48(3):e79–85.

    Google Scholar 

  7. Paci M, Faedda G, Ugolini A, Pellicciari L. Barriers to evidence-based practice implementation in physiotherapy: a systematic review and meta-analysis. Int J Qual Health Care. 2021;33(2):mzab093. https://doi.org/10.1093/intqhc/mzab093.

    Article  Google Scholar 

  8. Tilson JK, Kaplan SL, Harris JL, Hutchinson A, Ilic D, Niederman R, et al. Sicily statement on classification and development of evidence-based practice learning assessment tools. BMC Med Educ. 2011;11(1):78. https://doi.org/10.1186/1472-6920-11-78.

    Article  Google Scholar 

  9. Kumaravel B, Hearn JH, Jahangiri L, Pollard R, Stocker CJ, Nunan D. A systematic review and taxonomy of tools for evaluating evidence-based medicine teaching in medical education. Syst Rev. 2020;9(1):91. https://doi.org/10.1186/s13643-020-01311-y.

    Article  Google Scholar 

  10. Bandura A. Self-efficacy: toward a unifying theory of behavioral change. Psychol Rev. 1977;84(2):191–215.

    Article  Google Scholar 

  11. Tilson JK, Mickan S. Promoting physical therapists’ of research evidence to inform clinical practice: part 1 - theoretical foundation, evidence, and description of the PEAK program. BMC Med Educ. 2014;14(1):125. https://doi.org/10.1186/1472-6920-14-125.

    Article  Google Scholar 

  12. McEvoy MP, Williams MT, Olds TS, Lewis LK, Petkov J. Evidence-based practice profiles of physiotherapists transitioning into the workforce: a study of two cohorts. BMC Med Educ. 2011;11(1):100. https://doi.org/10.1186/1472-6920-11-100.

    Article  Google Scholar 

  13. Petzold A, Korner-Bitensky N, Salbach N, Ahmed S, Menon A, Ogourtsova T. Increasing knowledge of best practices for occupational therapists treating post-stroke unilateral spatial neglect: results of a knowledge-translation intervention study. J Rehabil Med. 2012;44(2):118–24. https://doi.org/10.2340/16501977-0910.

    Article  Google Scholar 

  14. Tilson JK, Mickan S, Sum JC, Zibell M, Dylla JM, Howard R. Promoting physical therapists’ use of research evidence to inform clinical practice: part 2–a mixed methods evaluation of the PEAK program. BMC Med Educ. 2014;14:126. https://doi.org/10.1186/s12909-016-0654-9.

    Article  Google Scholar 

  15. Tilson JK, Mickan S, Howard R, Sum JC, Zibell M, Cleary L, et al. Promoting physical therapists’ use of research evidence to inform clinical practice: part 3–long term feasibility assessment of the PEAK program. BMC Med Educ. 2016;16:144. https://doi.org/10.1186/s12909-016-0654-9.

    Article  Google Scholar 

  16. Connolly BH, Lupinnaci NS, Bush AJ. Changes in attitudes and perceptions about research in physical therapy among professional physical therapist students and new graduates. Phys Ther. 2001;81(5):1127–34.

    Article  Google Scholar 

  17. Long K, McEvoy M, Lewis L, Wiles L, Williams M, Olds T. Entry-level evidenced-based practice training in physiotherapy students: Does it change knowledge, attitudes, and behaviours? A longitudinal study. IJAHSP [Internet]. 2011 Accessed March 1, 2022. https://nsuworks.nova.edu/ijahsp/vol9/iss3/5/.

  18. Manns PJ, Norton AV, Darrah J. Cross-sectional study to examine evidence-based practice skills and behaviors of physical therapy graduates: is there a knowledge-to-practice gap? Phys Ther. 2015;95(4):568–78. https://doi.org/10.2522/ptj.20130450.

    Article  Google Scholar 

  19. Iqbal MS, Rochette A, Mayo NE, Valois M-F, BUssieres AE, Ahmed S, et al. Exploring if and how evidence-based practice of occupational and physical therapists evolves over time: a longitudinal mixed methods national study. PLoS ONE. 2023 March;18(3):e0283860. https://doi.org/10.1371/journal.pone.0283860.

  20. Savery JR. Overview of problem-based learning: definitions and distinctions. IJPBL [Internet]. 2006;1(1):9–20. https://doi.org/10.7771/1541-5015.1002.

    Article  Google Scholar 

  21. Salbach NM, Jaglal SB. Creation and validation of the evidence-based practice confidence scale for health care professionals: evidence-based practice confidence scale. J Eval Clin Pract. 2011;17(4):794–800. https://doi.org/10.1111/j.1365-2753.2010.01478.x.

    Article  Google Scholar 

  22. Salbach NM, Jaglal SB, Williams JI. Reliability and validity of the evidence-based practice confidence (EPIC) scale. J Contin Educ Health Prof. 2013;33(1):33–40. https://doi.org/10.1002/chp.21164.

    Article  Google Scholar 

  23. Melnyk BM, Fineout-Overholt E, Mays MZ. The evidence-based practice beliefs and implementation scales: psychometric properties of two new instruments. Worldviews Evid Based Nurs. 2008;5(4):208–16. https://doi.org/10.1111/j.1741-6787.2008.00126.x.

    Article  Google Scholar 

  24. Salbach NM, Williams JL, Jaglal SB. Replay to Dr. Bland: despite error in formula, EPIC scale still precise. J Contin Edu Health Prof. 2014;33(4):283.

    Article  Google Scholar 

  25. Portney LG, Watkins MP, editors. Foundations of clinical research: applications to practice, 3e. Philadelphia: McGraw Hill; 2017. https://fadavispt.mhmedical.com/content.aspx?bookid=1987&sectionid=149502242.

    Google Scholar 

  26. Thomas A, Han L, Osler B, Turnbull E, Douglas E. Students’ attitudes and perceptions of teaching and assessment of evidence-based practice in an occupational therapy professional Master’s curriculum: a mixed methods study. BMC Med Educ. 2017;17. https://doi.org/10.1186/s12909-017-0895-2.

  27. DeCleene Huber KE, Nichols A, Bowman K, Hershberger J, Marquis J, Murphy T et al. The correlation between confidence and knowledge of evidence-based practice among occupational therapy students. Open J Occup Ther [Internet]. 2015 Jan 1. Accessed March 18, 2022. https://scholarworks.wmich.edu/ojot/vol3/iss1/5.

  28. Doble M, Short K, Murray E, Bogaardt H, McCabe P. Evidence-based practice self-efficacy of undergraduate speech pathology students following training. Disabil Rehabil. 2019;41(12):1484–90. https://doi.org/10.1080/09638288.2018.1430174.

    Article  Google Scholar 

  29. Baarends E, Van der Klink M, Thomas A. An exploratory study on the teaching of evidence-based decision making. Open J Occup Ther [Internet]. 2017 Jul 1. Accessed March 18, 2022. https://scholarworks.wmich.edu/ojot/vol5/iss3/8.

  30. Widyahening IS, Findyartini A, Ranakusuma RW, Dewiasty E, Harimurti K. Evaluation of the role of near-peer teaching in critical appraisal skills learning: a randomized crossover trial. Int J Med Educ. 2019;10:9–15. https://doi.org/10.5116/ijme.5c39.b55b.

    Article  Google Scholar 

  31. Mickan S, Hilder J, Wenke R, Thomas R. The impact of a small-group educational intervention for allied health professionals to enhance evidence-based practice: mixed methods evaluation. BMC Med Educ. 2019;19(1):131. https://doi.org/10.1186/s12909-019-1567-1.

    Article  Google Scholar 

  32. Bierwas D, Leafman J, Shaw D. The evidence-based practice beliefs and knowledge of physical therapy clinical instructors. IJAHSP [Internet] 2016 Access April 4, 2023. https://nsuworks.nova.edu/ijahsp/vol14/iss3/10/.

  33. Abu-Baker NN, AbuAlrub S, Obeidat RF, Assmairan K. Evidence-based practice beliefs and implementations: a cross-sectional study among undergraduate nursing students. BMC Nurs. 2021;20(1):13. https://doi.org/10.1186/s12912-020-00522-x.

    Article  Google Scholar 

  34. Johnson SG, Bruset EB, Hjelle KM, Mongs M, Sveen U. An exploration of evidence-based practice work files for occupational therapy students during clinical placements: a descriptive cross-sectional study. BMC Med Educ. 2020;20(1):255.

    Article  Google Scholar 

  35. Cruz JP, Colet PC, Alquwez N. Evidence-based practice beliefs and implementation among the nursing bridge program students of a Saudi University. Int J Health Sci. 2016;10(3):387–95.

    Google Scholar 

  36. Olsen NR, Bradley P, Espehaug B, Nortvedt MW, Lygren H, Frisk B et al. Impact of a multifaceted and clinically integrated training program in evidence-based practice on knowledge, skills, beliefs and behaviour among clinical instructors in physiotherapy: A non-randomized controlled study. Baradaran HR, editor. PLoS ONE. 2015;10(4):e0124332. https://doi.org/10.1371/journal.pone.0124332.

  37. Yoo JY, Kim JH, Kim JS, Kim HL, Ki JS. Clinical nurses’ beliefs, knowledge, organizational readiness and level of implementation of evidence-based practice: the first step to creating an evidence-based practice culture. PLoS ONE. 2019;14(12):e0226742. https://doi.org/10.1371/journal.pone.0226742.

    Article  Google Scholar 

  38. Perruchoud E, Fernandes S, Verloo H, Pereira F. Beliefs and implementation of evidence-based practice among nurses in the nursing homes of a Swiss canton: an observational cross-sectional study. J Clin Nurs. 2021;30(21–22):3218–29. https://doi.org/10.1111/jocn.15826.

    Article  Google Scholar 

  39. Romney W. All items EBPIS and EPIC. Harvard Dataverse Data Set. 2023. https://dataverse.harvard.edu/dataset.xhtml?persistentId=doi:10.7910/DVN/WWAU7E.

Download references

Acknowledgements

Not applicable.

Funding

WR was funded by the Pre-Doctoral Fellowship in the School of Health Professions at Rutgers University, the Ellen C Ross Memorial Scholarship, and the RIVERS lab at Rutgers University. NMS holds the Toronto Rehabilitation Institute Chair at the University of Toronto.

Author information

Authors and Affiliations

Authors

Contributions

WR: Conception, Design, Data collection, Analysis, Interpretation, Drafted manuscript. NS: Conception, Design, Interpretation, Edited manuscript. SP: Conception, Design, Interpretation, Edited manuscript. JED: Conception, Design, Analysis, Interpretation, Draft and Edited manuscript. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Wendy Romney.

Ethics declarations

Ethics approval and consent to participate

All methods were carried out in accordance with relevant guidelines and regulations. This study was approved by the Institutional Review Boards at Chatham University, Rutgers University (ID# Pro20140000413) and Sacred Heart University (#140722A) and the Research Ethics Board at University of Toronto (#30645). Informed consent forms were signed by students involved in the study.

Consent for publication

Not applicable.

Competing interests

The author declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Electronic supplementary material

Below is the link to the electronic supplementary material.

Supplementary Material 1

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Romney, W., Salbach, N.M., Perry, S.B. et al. Evidence-based practice confidence and behavior throughout the curriculum of four physical therapy education programs: a longitudinal study. BMC Med Educ 23, 839 (2023). https://doi.org/10.1186/s12909-023-04821-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-023-04821-0

Keywords