- Research article
- Open Access
Predictors of research productivity among physical therapy programs in the United States: an observational study
BMC Medical Education volume 20, Article number: 216 (2020)
This study targeted the association of program characteristics of 203 Doctor of Physical Therapy (DPT) programs in the United States (US) reported by the Commission on Accreditation in Physical Therapy Education (CAPTE) in their 2017 Annual Accreditation Report (AAR) with measures of core faculty research volume. The association of institutional, program, and faculty characteristics of an institution with core faculty research volume was investigated.
This observational study analyzed data provided in the AAR about program research volume. Predictor variables included institutional, program and faculty characteristics. Research volume was measured as a ratio of 1) number of peer-reviewed publications, 2) National Institutes of Health (NIH) funding, and 3) faculty with grants, per number of core faculty. Research volume was stratified by quartiles and analyzed using logistic regression analyses. The highest 25% were analyzed against the lowest 75%.
In the multivariate logistic regression analyses, research Carnegie classification was positively associated with NIH funding (OR = 4.04; 95% CI = 1.92, 8.48) and number of peer reviewed publications (OR = 7.63; 95% CI = 3.39, 17.14). Square footage of research space was positively associated with number of peer reviewed publications (OR = 4.58; 95% CI = 2.08, 10.11). Private status was negatively associated with NIH funding (OR = 0.37; 95% CI = 0.17, 0.83) and faculty holding grants (OR = 0.38; 95% CI = 0.19, 0.76).
There is strong evidence that research culture (e.g., research Carnegie status and dedicated research space) is related to research productivity in DPT programs in the US. Private status was indicative of a non-research intensive environment, which may be reflective of a current trend of small, non-research based private institutions initiating DPT programs.
An entry-level physical therapy program of education prepares the students to the point of being able to practice as physical therapists in the country of education . Entry requirements, length of education, and the final qualifications obtained vary across countries. In the United States (US), all new graduates are conferred a Doctor of Physical Therapy (DPT) degree. Physical therapists are primary care clinicians in the US with direct access to patient care, and thus, a clinical doctoral-level degree is viewed by the governing body as warranted . The doctoral degree is mandatory in the US to foster lifelong learning, independence, collaboration, and development of the practice. Details of entry to practice requirements may be accessed from the relevant World Confederation for Physical Therapy (WCPT) member organization . Because the data analyzed reflects US DPT programs, the background will be specific to the governing bodies within the US.
The Commission on Accreditation in Physical Therapy Education (CAPTE)  collects data annually from all accredited DPT programs in the US and their territories in their Annual Accreditation Report (AAR). They publish a public document with this information, the Aggregate Program Data . CAPTE requires a minimum standard for scholarship for faculty within a DPT program that at least 50% of a program’s core faculty hold an advanced academic doctoral degree beyond a clinically-based DPT . Beyond CAPTE, scholarly activity is a common program requirement for all academic faculty members used to determine the qualitative strength and ranking of a program [6,7,8,9,10,11]. Scholarly activity refers to much more than traditional research. The APTA has described it as, “creative, communicated, peer-validated intellectual work (scholarship) in any of its several forms (discovery, development, integration, and artistry)” .
Scholarly activity is historically low among physical therapy programs , although a program’s level of productivity does not seem to influence a program’s National Physical Therapy Examination (NPTE) pass rate in a recent study . To date, the NPTE pass rates are most notably influenced by student-level factors such as mean undergraduate GPA . An older dataset identified a relationship between a non-research Carnegie classification and lower NPTE pass rate , but physical therapy programs may have changed significantly in this time and a larger sample is needed to validate the findings. Despite this, programmatic investments have been shown to have a positive effect on NPTE pass rate , suggesting that other factors reported in the AAR may differentiate the successes of physical therapy programs beyond NPTE pass rate.
Scholarly activity is a focus of both CAPTE and the American Physical Therapy Association (APTA) in order to provide evidence-based care [5, 14]. Evidence-based care has been thought to reduce unnecessary variability and improve patient care . Evidence that elucidates relationships between program characteristics and magnitude of scholarly activity may be useful to guide DPT programs to align with the APTA’s vision for physical therapy . This study aimed to investigate the association of institutional, program, and faculty characteristics reported in CAPTE’s AAR with standardized research volume by DPT programs within the US.
This study was an observational design. The REporting of studies Conducted using Observational Routinely-collected Data (RECORD) Checklist was utilized to guide the reporting of this study.
The data used in the study, the most recently organized results from the CAPTE AAR, was obtained from CAPTE-accredited DPT programs that graduated students in 2017. The CAPTE AAR provided institutional and general information about the accredited DPT programs, including characteristics pertaining to the institution, program, and faculty. The Institutional Review Board of the University of North Carolina (ID #18–3059) determined that the data does not constitute human subjects research. Thus, informed consent was waived under federal regulations [45 CFR 46.102 (d or f) and 21 CFR 56.102 (c)(e)(l)].
The institutional data comprised the 203 DPT programs within the US that were accredited at the time of the study. Identifiers were masked for the institutions in the data set to conceal their identities, such that investigators could not link an entry to a specific institution. Selective data about each institution was provided based on the core faculty for the DPT program, defined by the AAR as “those individuals appointed to and employed primarily in the program … with the responsibility and the authority related to the curriculum” . The AAR includes the number of peer reviewed publications, amount of NIH funding (to include the total across all departments receiving money and years), and number of faculty members holding grants, all of which represent research productivity. All data was program-level information, as no individual student data was provided.
Variables used in the modeling
The CAPTE AAR provided a comprehensive list of variables that had the possibility to be included in this analysis. However, because we were interested in the variables that could be indicators of research productivity, only those reflective of institutional, program, and faculty characteristics were considered. An additional glossary describes these terms in more detail (see Additional file 1 [2, 17]).
Variables were chosen that were a) reflective of the institutions, b) reflective of the institutions’ program format, and c) reflective of faculty characteristics. These variables were separated into institutional, program and faculty characteristics for interpretation of the analyses.
The institutional characteristics included four variables: Carnegie classification (research universities/doctorate and research, all others [other health professional schools, medical schools, and medical centers and masters colleges and universities]), private status, traditional institution type, and student body size (whole institution). All variables were reported as categorical data, dichotomized as follows: a) Carnegie classification (research universities/doctorate and research versus all others), b) private status (private versus public), c) traditional institution status (traditional [Academic Health Science Center, Liberal Arts College (4-year), and Liberal Arts University] versus all others [Proprietary, Osteopathic Medical School, Professional and Technological University]) and d) student body size (> 10,000 versus < 10,000).
The program characteristics included nine variables: > 6 year program format, number of terms, total program length, number of credits, classroom education hours, hybrid curriculum, operating budget, total number of courses, and square footage of research space. Program format, operating budget and type of curriculum were reported as categorical data, dichotomized as follows: a) > 6 year program format (> 6 years, 6 years), b) operating budget (interquartile range upper 25%, interquartile range lower 75%) and c) curriculum model (traditional versus all others [hybrid, systems-based, problem-based, modified problem-based, guide-based]). Number of terms, total program length, number of credits, classroom education hours, total number of courses and square footage of research space were reported as continuous data by mean and standard deviation (SD).
The faculty characteristics included four variables: total number of vacancies, faculty turnover, faculty to student ratio, and total full-time equivalents. All four variables were reported as continuous data by mean and SD.
Dependent variables (outcome variables of interest)
In order to describe the scholarly culture of the institutions in the dataset from CAPTE, the outcomes representing a proxy for productivity were considered, including peer reviewed publications, National Institutes of Health (NIH) funding, and total number of faculty within the DPT program who reported they had grants were each standardized per core faculty member. Stratification was performed for these three outcomes to separate the top 25% from the bottom 75%, with the intent to capture the highest performing research-intensive institutions in the upper quartile . To our knowledge, no single value in the literature provides a meaningful cutoff to represent research productivity. Indeed, only a few physical therapy programs report high productivity, and within the AAR a median score of ‘zero’ is present for publications and NIH funding. Consequently, instead of splitting the variables at the median [19, 20], we elected the same method (quartile rank/25–75%) used in previous medical research [21,22,23]. These three outcomes were used to associate research productivity to variables in the dataset that might modify the outcomes.
Statistical analysis methods
All of the analysis used in this study was performed in using Statistical Package for the Social Sciences (SPSS) version 25.0 (IBM Corp. Armonk, NY, USA). Descriptive statistics (mean/SD and frequencies) were used to summarize the institutional, program and faculty characteristics (both for dependent and independent variables). To assess multicollinearity in the modelling a correlation analyses were performed between the 17 independent variables. Correlation was defined as a negligible positive or negative correlation (r = 0.00 to 0.30), low positive or negative correlation (r ≥ 0.30 to 0.50), moderate positive or negative correlation (r ≥ 0.50 to 0.70), high positive or negative correlation (> 0.70 to 0.90) and very high positive or negative correlation (> 0.90 to 1.0) [24, 25]. We decided to remove variables with correlations ≥0.70 to not influence models. A p-value < 0.05 was considered significant.
A comparative analysis was performed to relate the independent variables with the outcomes reflective of research productivity. Univariate logistic regression analyses were performed between the three outcome measures and each of the 17 independent variables. For each univariate analysis of the independent variables, p-values, odds ratios (OR), 95% confidence intervals (CI) and the percentage of explained variance (Nagelkerke’s R2 values) were reported. An OR measures the association between an outcome and exposure to a particular variable, with values > 1.0 indicating that exposure is associated with higher odds of the outcome . Nagelkerke’s R2 values are similar to an R-squared value and indicate the power of the model . Associations in univariate analyses with significant p-values were considered in a multivariate backward stepwise logistic regression analyses for each of the three outcome measures of research productivity. In each of these three multivariate models, a p-value < 0.05 was considered significant. We adopted the criterion proposed to Harrell et al., equivalent to a minimum of 10 to 20 events per variable for logistic regression [28, 29].
Institutional, program and faculty characteristics
Institutional, program and faculty characteristics of 203 DPT programs are shown in Table 1. Although there were significant associations among many independent variables, none of the associations were near the predefined threshold of 0.7 (please see Additional file 2 at the end of the document). For these reasons, we did not remove or combine any of the independent variables.
Research productivity - number of peer reviewed publications per core faculty member
Four of the 17 independent variables displayed significance (p-values < 0.05) when associated with the number of peer reviewed publications per core faculty member in the univariate logistic regression analysis (Table 2).
These four variables were entered into the backward multivariate model. Only Carnegie classification and square footage of research space remained predictors for this outcome. The presence of high number of peer reviewed publications per core faculty member was associated with a research Carnegie classification (OR = 7.63, 95% CI 3.39, 17.14, p = < 0.01) and square footage of research space (OR = 4.58, 95% CI 2.08, 10.11, p = < 0.01) (Table 3).
Research productivity - NIH funding per core faculty member
Four of the 17 independent variables displayed significance against NIH funding per core faculty member in the univariate logistic regression analysis (Table 2). The presence of high NIH funding per core faculty member was associated with a research Carnegie classification (OR = 4.04, 95% CI 1.92, 8.48, p = < 0.01) (Table 3). The presence of low NIH funding per core faculty member was associated with private status (OR = 0.37, 95% CI 0.17, 0.83, p = 0.02) (Table 3).
Research productivity - faculty with grants per core faculty member
Three of the 17 independent variables displayed significance against faculty with grants per core faculty member in the univariate logistic regression analysis (Table 2). The presence of low faculty with grants per core faculty member was associated with private status (OR = 0.38, 95% CI 0.19, 0.76, p = < 0.01) (Table 3).
Summary of findings
This study investigated the association of institutional, program, and faculty characteristics reported in CAPTE’s AAR with standardized research volume by DPT programs within the US. The data in this study demonstrates the higher affinity for scholarly activity in physical therapy within research intensive parent institutions. This is evidenced by the positive relationships of research Carnegie classification and square footage of research space with scholarly activity. In addition, greater full-time equivalents in a program has a positive relationship with scholarly activity in the univariate regression but this did not remain significant in the multivariate regression. This suggests that, when accounting for confounding variables such as employing a greater number of faculty to support a larger PT program, full-time equivalents are not inherently research specific.
CAPTE places minimal standards on scholarly activity present in physical therapy programs; accredited programs are required to employ at least 50% of faculty holding an advanced academic doctoral degree . An institutional culture of research and investment in the students and faculty reflects in increased research productivity . Growth in private, non-research intensive institutions does not appear to add to such productivity . Using the best available evidence is a core pillar of utilizing evidence-based practice in physical therapy, as noted by the APTA . That is, research advances the field of physical therapy, developing more effective patient management strategies for future clinicians. Building a culture of research within the physical therapy profession can begin in physical therapy schooling. It is worth noting, however, that research productivity does not completely ensure students adopt evidence-based practice. As well, it is unclear by the data provided in the AAR whether the scholarly activity conducted by physical therapy program faculty involves or does not involve the practice. Further research is needed to clarify this relationship. The NIH has previously warned of the extinction of the clinical scientist , citing the recent increase in clinical training requirements, duration and associated cost. Physical therapy, a clinical practice, must overcome this challenge of engaging more physical therapists in clinical research to drive the practice forward [14, 15]. Certain characteristics have been defined among academic institutions outside of physical therapy that result in an increase of scholarly productivity, most notably collaboration between faculty, time to dedicate to research and leadership in a research environment . Creating an environment that fosters research at the institution level and connecting the students to this environment has been proposed to build student interest in research . As such, creating an environment that fosters research at the DPT programmatic level could then build a future of DPT clinical scientists.
The number of private physical therapy programs has grown from 109 in 2013 to 140 in 2018 (28.44%), despite the more muted growth from 110 to 120 public physical therapy programs (9.09%) over that time . Given the relationship found in this study, there is concern that the steeper growth in private institutions is not significantly adding to the evidence in physical therapy practice. Riley et al. noted that the majority of these new private programs are not housed within research intensive environments . As per CAPTE’s position on scholarship, faculty should serve as role models for students and bridge the connection between research and practice . We find the proliferation of non-research based private institutions intriguing and feel this deserves further exploration.
This study was completed with limitations in the dataset. There are certainly other factors which affect scholarly activity and could not be captured as a variable in this study. As well, creating categorical variables from continuous data always leads to a loss of sensitivity in the data due to loss of information analyzed. It also risks leaving confounding variables present. It is difficult to quantify the impact of scholarly activity within the programs, and this is a prohibitive limitation of the AAR variables. Whether or not this increased research productivity results in encouragement for the student body to pursue conducting research in physical therapy remains to be seen. As well, there is no clarification as to the type of research generated, whether or not this is specific to the field of physical therapy, and the clinical application of such research.
Suggestions for future studies
With the ongoing increase in programs accredited by CAPTE, future studies should examine the changes in scholarly activity by program characteristics over time. It also remains to be investigated as to how the scholarly activity of a physical therapy program affects the students’ future affinity for research.
This study found that certain characteristics exist within physical therapy programs which build a research-intensive environment. These characteristics suggest that physical therapy research, which is suggested to advance the profession forward [14, 15], is conducted at a higher level within public institutions built around research collection. This raises the point that research-intensive institutions further the profession by creating a culture of research among the faculty of the physical therapy program.
Availability of data and materials
The data that support the findings of this study are available from CAPTE but restrictions apply to the availability of these data, which were used under license for the current study, and so are not publicly available. Data are however available from the authors upon reasonable request and with permission of CAPTE.
Doctor of Physical Therapy
World Confederation for Physical Therapy
Commission on Accreditation in Physical Therapy Education
Annual Accreditation Report
National Institutes of Health
National Physical Therapy Examination
REporting of studies using Observational Routinely-collected Data
Statistical Package for the Social Sciences
American Physical Therapy Association
Therapy WCfP. Entry level physical therapy education programmes 2020. Available from: https://www.wcpt.org/education/Entry-level-physical-therapy-education-programmes.
Association APT. Physical Therapist (PT) Education Overview 2020. Available from: https://www.apta.org/For_Prospective_Students/PT_Education/Physical_Therapist_(PT)_Education_Overview.aspx.
Number of PT and PTA Programs [Internet]. Alexandria, VA: Commission on Accreditation in Physical Therapy Education; 2019. updated 2019. Available from: http://www.capteonline.org/uploadedFiles/CAPTEorg/About_CAPTE/Resources/Aggregate_Program_Data/NumberofPTPTAPrograms.pdf.
Aggregate Program Data [Internet]. Alexandria, VA: Commission on Accreditation in Physical Therapy Education; 2018. updated October 23, 2018. Available from: http://www.capteonline.org/uploadedfiles/capteorg/about_capte/resources/aggregate_program_data/aggregateprogramdata_ptprograms.pdf.
Evaluative Criteria PT Programs [Internet]. Alexandria, VA: Commission on Accreditation in Physical Therapy Education; 2014. updated Aug 2014. Available from: http://www.capteonline.org/uploadedFiles/CAPTEorg/About_CAPTE/Resources/Accreditation_Handbook/EvaluativeCriteria_PT.pdf.
Richter RR, Schlomer SL, Krieger MM, Siler WL. Journal publication productivity in academic physical therapy programs in the United States and Puerto Rico from 1998 to 2002. Phys Ther. 2008;88(3):376–86.
Cook CE, Landry MD, Covington JK, McCallum C, Engelhard C. Scholarly research productivity is not related to higher three-year licensure pass rates for physical therapy academic programs. BMC Med Educ. 2015;15:148.
Dickson T, Chen PD, Taylor B. Impact of funding allocation on physical therapist research productivity and DPT student graduates: an analysis using panel data. Adv Health Sci Educ Theory Pract. 2019;24(2):269–85.
Riley SP, Covington K, Landry MD, McCallum C, Engelhard C, Cook CE. Selectivity of physiotherapist programs in the United States does not differ by institutional funding source or research activity level. J Educ Eval Health Prof. 2016;13:17.
Cook C, Engelhard C, Landry MD, McCallum C. Modifiable variables in physical therapy education programs associated with first-time and three-year National Physical Therapy Examination pass rates in the United States. J Educ Eval Health Prof. 2015;12:44.
Riddle DL, Utzman RR, Jewell DV, Pearson S, Kong X. Academic difficulty and program-level variables predict performance on the National Physical Therapy Examination for licensure: a population-based cohort study. Phys Ther. 2009;89(11):1182–91.
Little TL, Davenport TE. Should we be expert clinicians or scholars? The answer is yes. J Man Manip Ther. 2012;20(1):3–4.
Covington K, McCallum C, Engelhard C, Landry MD, Cook C. Do differences in programmatic resource investments result in different 3-year pass rates on the U.S. National Physical Therapy Examination? J Allied Health. 2016;45(1):27–32.
Vision Statement for the Physical Therapy Profession and Guiding Principles to Acheive Vision [Internet]. Alexandria, VA: American Physical Therapy Association; 2018. updated Mar 20, 2018. Available from: http://www.apta.org/Vision/.
Evidence-Based Practice & Research [Internet]. Alexandria, VA: American Physical Therapy Association; 2017. updated Dec 11, 2017. Available from: http://www.apta.org/EvidenceResearch/.
Standards and Required Elements for Accreditation of Physical Therapist Education Programs [Internet]. Alexandria, VA: Commission on Accreditation in Physical Therapy Education; 2016. updated Dec 2017. Available from: http://www.capteonline.org/uploadedFiles/CAPTEorg/About_CAPTE/Resources/Accreditation_Handbook/CAPTE_PTStandardsEvidence.pdf.
Education TCCoIoH. News and Announcements 2020. Available from: https://carnegieclassifications.iu.edu/.
Smith G. Essential Statistics, Regression and Econometrics. Waltham: Academic Press; 2012.
Altman DG, Royston P. The cost of dichotomising continuous variables. BMJ. 2006;332(7549):1080.
MacCallum RC, Zhang S, Preacher KJ, Rucker DD. On the practice of dichotomization of quantitative variables. Psychol Methods. 2002;7(1):19–40.
Cook CE, Learman KE, O'Halloran BJ, Showalter CR, Kabbaz VJ, Goode AP, et al. Which prognostic factors for low back pain are generic predictors of outcome across a range of recovery domains? Phys Ther. 2013;93(1):32–40.
Clewley D, Rhon D, Flynn T, Koppenhaver S, Cook C. Health seeking behavior as a predictor of healthcare utilization in a population of patients with spinal pain. PLoS One. 2018;13(8):e0201348.
Cohen SB. The Concentration of Health Care Expenditures and Related Expenses for Costly Medical Conditions, 2012. Rockville: Statistical Brief (Medical Expenditure Panel Survey (US)); 2001.
Mukaka MM. Statistics corner: a guide to appropriate use of correlation coefficient in medical research. Malawi Med J. 2012;24(3):69–71.
Hinkle DE, Wiersma W, Jurs SG. Boston: Applied statistics for the behavioral sciences; 1988.
Szumilas M. Explaining odds ratios. J Can Acad Child Adolesc Psychiatry. 2010;19(3):227–9.
Nagelkerke NJD. A note on a general definition of the coefficient of determination. Biometrika. 1991;78:691–2.
Peduzzi P, Concato J, Kemper E, Holford TR, Feinstein AR. A simulation study of the number of events per variable in logistic regression analysis. J Clin Epidemiol. 1996;49(12):1373–9.
Harrell FE Jr, Lee KL, Califf RM, Pryor DB, Rosati RA. Regression modelling strategies for improved prognostic prediction. Stat Med. 1984;3(2):143–52.
Havnaer AG, Chen AJ, Greenberg PB. Scholarly concentration programs and medical student research productivity: a systematic review. Perspect Med Educ. 2017;6(4):216–26.
Physician-Scientist Workforce (PSW) Report 2014 [Internet]. Bethesda, MD: National Institutes of Health; 2014. updated June 30, 2018. Available from: https://report.nih.gov/Workforce/PSW/index.aspx.
Ajjawi R, Crampton PES, Rees CE. What really matters for successful research environments? A realist synthesis. Med Educ. 2018;52(9):936–50.
Elsen M, Visser-Wijnveen GJ, Van der Rijst RM, Van Driel JH. How to strengthen the connection between research and teaching in undergraduate university education. High Educ Q. 2009;63(1):64–85.
Position Papers Alexandria, VA: Commission on Accreditation in Physical Therapy Education; 2015. updated Jan 2018. Available from: http://www.capteonline.org/uploadedFiles/CAPTEorg/About_CAPTE/Resources/Accreditation_Handbook/PositionPapers.pdf.
Ethics approval and consent to participate
This study was approved and expedited by the Institutional Review Board of the University of North Carolina (ID# 18–3059). This study was determined to not constitute human subjects research as defined under federal regulations [45 CFR 46.102 (d or f) and 21 CFR 56.102 (c)(e)(l)] and so consent was waived.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Rowland, D.M., Murphy, A.A., Manik, H.R. et al. Predictors of research productivity among physical therapy programs in the United States: an observational study. BMC Med Educ 20, 216 (2020). https://doi.org/10.1186/s12909-020-02133-1
- Education, medical
- Logistic models
- Physical therapists