The importance of soft skills development in a hard data world: learning from interviews with healthcare leaders
BMC Medical Education volume 21, Article number: 147 (2021)
Learning healthcare systems have invested heavily in training primary care staff to provide care using patient-centered medical home models, but less is known about how to effectively lead such teams to deliver high quality care. Research is needed to better understand which healthcare leadership skills are most utilized or in need of development through additional training.
Semi-structured telephone interviews with healthcare leaders familiar with Patient-Aligned Care Teams (PACT) implementation in the U.S. Department of Veterans Affairs (VA). We interviewed sixteen (N = 16) physician, nursing, and administrative leaders at VA facilities located in the upper Midwestern United States. Content analysis of interviews transcripts using template techniques.
Participants described instrumental challenges that they perceived hindered leadership effectiveness, including the supervisory structure; pace of change; complexity of the clinical data infrastructure; an over-reliance on technology for communication; and gaps in available leadership training. Factors perceived as facilitating effective leadership included training in soft skills, face-to-face communication, and opportunities for formal training and mentorship. A cross-cutting theme was the importance of developing “soft skills” for effective PACT leadership.
Although formal leadership training and development were perceived as beneficial, healthcare leaders familiar with PACT implementation in the VA described a mismatch between the skills and knowledge PACT leaders need to succeed and the training available to them. Closing this gap could improve retention of skilled and knowledgeable healthcare leaders, thereby reducing the costs associated with training and leading to improvements in healthcare delivery.
Patient Aligned Care Teams (PACT), the Veterans Health Administration’s (VA) patient centered medical home model, has been implemented in more than 900 primary care clinics nationwide . Successful medical home implementation has been associated with a reduction in use of specialty care, hospitalizations for ambulatory care sensitive conditions, and an increase in patient satisfaction with care [2,3,4] and thus a considerable amount of scholarship has sought to identify barriers to PACT implementation and function. Leadership support and skills have been identified as critical organizational resources to assure PACT implementation function. Because individual PACT members often report to different leaders within the clinic, PACT members rely upon local healthcare leadership to assist with resolution of within-team conflict resultion . Notably, leadership support of the PACT model has been associated with: better recruitment and retention of PACT members ; stronger PACT teamwork ; greater sense of team member accountability to the PACT ; and better patient-reported access to care .
While some research has examined the role of primary care providers as de facto leaders of individual PACTs , less attention has been directed toward the needs, capacities, and role of healthcare leaders who oversee PACTs. Additionally, while many healthcare organizations provide leadership training, we know little about the types of training that are most effective or the specific skills that healthcare leaders need to develop to be effective . This knowledge gap not only creates inefficiencies, but impedes the application of evidence-based principles to improve healthcare delivery [10, 11]. Thus, the objective of this study was to help close this gap by identifying healthcare leaders’ perspectives on the training and skills needed to effectively oversee and manage PACTs.
The research team consisted of two doctorally trained medical anthropologists (THA, SLS) who were health services researchers in the VA and an organizational psychologist (GLS). Our overall approach focused on obtaining descriptive data that could be used to inform clinical practice (i.e., identifying how to develop more effective healthcare leaders in clinical environments that have implemented PACT). To these ends, we analyzed interviews using template analysis, an approach derived from the tenants of content analysis with an emphasis on data synthesis and reduction, rather than interpretation . Template domains were thus defined a priori by the goals of the study rather than a theoretical framework. This project was approved by the Institutional Review Board at the Iowa City VA Health Care System prior to data collection.
Interviews were conducted by telephone with healthcare leaders located at VA facilities in the upper Midwestern United States. Sampling was purposive . Regional executive leaders were asked to identify potential facility-level healthcare leaders to interview for the study. Twenty-four leaders with no prior relationship to the research team were invited to participate based in their role in the VA and knowledge of PACT implementation. Sixteen leaders (N = 16) agreed to an interview and none dropped out of the study. Recruitment occurred by e-mail and included an Information Sheet describing the project, project aims, and data collection procedures. Individuals in physician, nursing, and administrative leadership positions were sent an invitation to ensure that a diversity of experiences and perspectives were sampled.
Data were collected from April to May 2019 by THA using a semi-structured interview guide developed for this study to ensure consistency across interviews. Interview guide domains were informed by the goals of the study, and included: healthcare leader’s organization, role and perception of VA policies that create barriers to effective leadership; critical skills and knowledge of PACT leaders; resources that help healthcare leaders be effective; resources critical in participant’s own leadership role; and additional resource and training needs. A preliminary interview guide was piloted with initial participants; adjustments were made to questions and probes as needed. Interview guide available upon request. Interviews ranged from 30 to 60 min, were audio recorded with participants’ permission, and transcribed for analysis.
Data from the interviews was analyzed from June to September 2019. The template contained the following a priori domains: role and responsibilities in organizational context; skills, knowledge, abilities and resources of effective leaders; and professional development. Inductive categories were developed by summarizing interview content within these a priori domains. To utilize each researcher’s analytic strengths, the team adopted a layered approach to templating the remaining interviews. THA developed an initial summary template for each interview, which was then audited for accuracy and completeness by SLS. Any questions about templated content or edits were resolved through discussion during team meetings. Although the aim of this study was to collect a broad range of experiences and perspectives, data collection was limited to leaders who volunteered to participate. We therefore cannot guarantee that saturation was reached. Data are available on request from the authors.
Rigor was established during the analytic process. A template rubric was developed by THA with domain names and definitions to control analytic drift. The process of independently templating the first two interviews permitted the identification of discrepancies in how domains and categories were interpreted by the two analysts. Finally, all templates developed by THA were audited for accuracy and completeness by SLS. To further ensure the accuracy of interpretation, primary results were disseminated to participants for feedback via report briefs.
Sixteen (N = 16) VA healthcare leaders expressed their interest in participating by contacting the study coordinator to schedule a telephone interview. Table 1 summarizes participant characteristics. Participants described both challenges to effective PACT leadership and the resources and skills needed to overcome those challenges. In the following sections, we summarize lessons learned from interviews.
Barriers to effective PACT leadership
Participants described different instrumental challenges that made it difficult to be effective healthcare leaders both in the VA and in a PACT clinic environment. The primary challenges cited included: the pace of change within the VA; the supervisory structure for clinical personnel; complexity of the clinical data infrastructure; an over-reliance on technology-mediated communication, and gaps in available leadership training. Table 2 provides an overview of the primary challenges along with excerpts from the interviews to provide additional context, nuance or detail when needed.
One significant challenge was the organization of team members into silo-ed supervisory structures, or service lines (e.g., Primary Care, Nursing). This structure made it difficult to develop and advance shared priorities within the PACT and hindered communication. Organizing services within independent service lines sometimes led to “silo-ing” (i.e., a communication breakdown). Silo-ing furthermore superseded other, more tangible barriers to effective leadership. In this respect, one participant stated: “When you’re siloed, it doesn’t come down to resources or time or any of these other things. If all the members of the PACT team have different supervisors, it’s really hard for the PACT leader if those supervisors are not on the same page” (P11).
Another challenge was the pace of change within a learning healthcare system dedicated to providing evidence-based healthcare. The pace of change was seen to outpace development of implementation guidance for new clinical policies, processes or practices. For example, one participant observed with trepidation: “The [new program] is gonna be one of them where there’s gonna be huge changes, and we don’t have clear guidance about what we need to be working on” (P08).
Data infrastructure also hindered effective leadership, including both the fragmentation and volume of data available to leaders at the VA. Some participants described challenges locating the data they needed to make key decisions stemming from a fragmented data infrastructure. These challenges were compounded by the sheer volume of data available to leaders.
An additional barrier was a perceived over-reliance on technology in place of face-to-face communication. Technologically medicated communication was perceived by participants as limited “open” communication. Some participants also expressed that it increased the likelihood of miscommunication and thus errors.
A final challenge observed by leaders was gaps in the training available to them that hindered the development of effective PACT leaders. Participants most often cited a need for additional training in interpersonal, or “soft skills,” such as conflict management, teambuilding, motivating staff, and delivering bad news. Participants noted that physician leaders, in particular, often required supplemental training to help them better communicate with direct reports. Participants also recommended developing a more formal mentorship program for healthcare leaders. Additional gaps described less often included instruction in how to complete administrative tasks, including managing contracts, completing payroll forms, and personnel actions (e.g., performance appraisals, disciplinary procedures) and guidance in how to connect the tools at their disposal to daily practice, especially in respect to informatics training.
Facilitators of effective PACT leadership
Participants also described facilitators which made healthcare leaders more effective. Current resources and skills identified as facilitating effective leadership, such as training programs and informal mentoring, highlighted existing supports used in overcoming leadership challenges. Participants also emphasized the importance of soft skills and face-to-face communication in the ability of PACT leaders to be effective. Table 3 provides an overview of the primary facilitators along with exemplars from the interviews which provide contextual, nuanced detail.
Leaders described soft skills as particularly important for PACT leaders. Primary among soft skills was an ability to communicate, which helped PACT leaders coordinate clinic staff and create a common culture or mission amongst PACT team members. One participant explained: “You’re trying to get a lot of disciplines that aren’t inter-related to work together towards the common goal of taking care of patients. Nurses approach things differently than techs, than docs, than administrators. So, first and foremost, is communication and being a good conductor or a team builder” (P03). Participants also described soft skills related to mediation and conflict management as critical for PACT leaders. Responding positively and/or proactively to adversity and stress, referred to as “adaptability,” “resilience” or “flexibility,” was also cited as an important soft skill which helped healthcare leaders to overcome the challenges cited above. For example, one participant responded when asked to describe skills possessed by effective leaders: “Flexibility, ‘cause there are lots of changes that go through PACT and the ability to adapt is very much needed” (P05). A final soft skill of effective healthcare leaders was an ability to listen, which were described as important for overcoming challenges posed by an overreliance on technology for communication.
Leaders also cited face-to-face interactions as facilitating effective PACT leadership. In-person meetings were often described as vital to day-to-day decision-making and furthermore helped leaders build a cohesive PACT clinic culture. Face-to-face interactions also provided opportunities to interact with peers and develop a support network that could be drawn upon to fill gaps in formal leadership training.
Leaders also described formal training programs as having helped them acquire some of the skills and knowledge they needed to be effective, particularly in a PACT clinic environment. Amongst the trainings deemed helpful was a comprehensive national leadership effectiveness, accountability, and development program, and specific training related to team development and facilitation. Local training initiatives were also cited as effective, including an informal shadowing program for mid-level clinic managers focused on helping new leaders form a “buddy system” with more experienced healthcare leaders. A final facilitator was informal mentoring. In this respect, both opportunities for ongoing mentoring and having an ability to travel to another clinic and receive hands-on mentoring were cited as helpful.
During telephone interviews, VA healthcare leaders described the instrumental challenges involved in leading within an organizational environment of rapid change and a complex, potentially silo-ed supervisory structure in which a fragmented and deep data infrastructure made it difficult to make informed decisions. These challenges were compounded by gaps in training and an over-reliance on technology in place of face-to-face interaction. The importance of interpersonal, or “soft skills,” in overcoming the challenges they encountered in their everyday practice emerged as a cross-domain theme. Analysis thus identified a disconnect between the challenges faced by healthcare leaders, both in PACT and in general, the expertise they typically associated with effective leadership, and the training available to leaders.
Emerging scholarship examining the impact of effective healthcare leaders suggests that physician leaders may produce better quality care than non-clinically trained healthcare executives . There is, however, a paucity of evidence demonstrating a relationship between specific leadership skills and clinical outcomes. Lacking an evidence base to guide investment in specific leadership training foci, our study’s findings, derived from interviews with senior healthcare leaders, signal a need to develop interpersonal skills in healthcare leaders both in PACT clinical environments and in general to help them be more effective at overcoming the challenges they encounter in their practice.
Participants reported that a significant barrier to effective healthcare leadership was gaps in the formal training available to them. As a result of these gaps, leaders relied upon their relationships with colleagues and informal mentoring to obtain knowledge and skills. Participants also noted a mismatch between their formal training and the skills needed to be effective in their everyday practice. Their experiences are not unusual, as other research has demonstrated that clinician’s leadership training is infrequent and relies heavily on peer mentoring [14, 15], with formal training prioritizing managerial rather than leadership skills [16, 17].
Although healthcare leaders in this study reported a need for managerial skills development, consistent with other research, they emphasized the importance of leadership or “soft skills” in their everyday practice . ,including leading interdisciplinary PACT teams . Participants described how communication, conflict resolution, listening, and collaborative skills helped them to overcome some of the challenges they encountered as leaders, such as an over-reliance on technology for communication. They also reported having used interpersonal skills to build relationships with colleagues, overcome the limitations of their managerial skills, and navigate within inflexible organizational structures (i.e., silo-ed service lines). Finally, participants observed that soft skills were fundamental to creating a common culture and sense of mission among PACT clinicians from different disciplines that is fundamental to delivering high quality healthcare.
The interview data we present here thus lend support to the growing attention to developing physician leader capacity for communication and collaboration [15, 17, 20]. The need to more purposively develop leaders’ interpersonal skills will only become more urgent as the use of technology to facilitate communication occurs ever more frequently. The emerging consensus that soft skills are fundamental for effective healthcare leadership is concomitant with the surfacing of research gaps pertaining to the impact of those skills on clinical or other outcomes . Results from this study thus signal a need to close the knowledge gap between healthcare leader skills and clinical or other outcomes to support the development of evidence-based principles to improving healthcare.
Our findings suggest that closing the gap between the skills needed to be effective and available formal training could improve retention of skilled healthcare leaders, thereby reducing the costs associated with training. Evidence suggests that effective healthcare leaders furthermore decrease burnout and increase job satisfaction among physicians whom they oversee . As participants both explicitly and implicitly referenced the importance of soft skills for being effective in clinical environments in which PACT has been implemented, we assert that providing leaders with training in soft skills could also enhance PACT functioning and thereby improve healthcare delivery. These findings align with the principles of complexity leadership, which highlights leadership as a complex relational process which occurs between people within an organization .
Strengths and limitations
This small study allowed VA healthcare leaders to describe, in their own words, factors which they perceived as affecting their effectiveness. Findings from this exploratory study provide preliminary data which can be used to inform the development of larger studies, both within the VA and in private sector healthcare systems, leading to more generalizable findings. Our findings are limited in that they result from interviews with healthcare leaders in clinics located in a specific geographical area of the U.S. (i.e., the Upper Midwest). Additionally, analytic results reflect the experiences and perspectives of healthcare leaders in the VA, which is structured and organized differently from other healthcare systems in the U.S. and elsewhere.
Although learning healthcare systems, such as the VA, have invested heavily in training primary care staff, gaps remain in our knowledge of which leadership skills are most utilized or in need of development. To begin to fill this gap, we interviewed sixteen (N = 16) VA physician, nursing, and administrative leaders. Healthcare leaders described instrumental challenges which they perceived hindered their effectiveness (e.g., the VA supervisory structure), as well as factors which they perceived as facilitating effective leadership (e.g., soft skills training). In general, VA healthcare leaders described a mismatch between the skills and knowledge they needed to succeed and the training available to them. Closing this gap could improve retention of skilled and knowledgeable healthcare leaders, reduce the costs associated with training, and lead to improvements in healthcare delivery.
Availability of data and materials
The datasets generated and/or analyzed during the current project are publicly available upon written request to the lead author.
Patient-Aligned Care Teams
U.S. Department of Veterans Affairs
Helfrich CD, Sylling PW, Gale RC, Mohr DC, Stockdale SE, Joos S, Brown EJ, Grembowski D, Asch SM, Fihn SD. Nelson KM the facilitators and barriers associated with implementation of a patient-centered medical home in VHA. Implement Sci. 2016;11(1):24.
Hebert PL, Liu CF, Wong ES, Hernandez SE, Batten A, Lo S, Lemon JM, Conrad DA, Grembowski D, Nelson K, Fihn SD. Patient-centered medical home initiative produced modest economic results for veterans health administration, 2010-12. Health Aff. 2014;33(6):980–7.
Nelson KM, Helfrich C, Sun H, Hebert PL, Liu CF, Dolan E, Taylor L, Wong E, Maynard C, Hernandez SE, Sanders W. Implementation of the patient-centered medical home in the veterans health administration: associations with patient satisfaction, quality of care, staff burnout, and hospital and emergency department use. JAMA Intern Med. 2014;174(8):1350–8.
Stewart KR, Stewart GL, Lampman M, Wakefield B, Rosenthal G, Solimeo SL. Implications of the patient-centered medical home for nursing practice. J Nurs Admin. 2015;45(11):569–74.
Giannitrapani KF, Rodriguez H, Huynh AK, Hamilton AB, Kim L, Stockdale SE, Needleman J, Yano EM, Rubenstein LV. How middle managers facilitate interdisciplinary primary care team functioning. Healthc. 2019;7(2):10–5.
Stout S, Zallman L, Arsenault L, Sayah A, Hacker K. Developing high-functioning teams: factors associated with operating as a “real team” and implications for patient-centered medical home development. Inquiry. 2017;54:0046958017707296.
Schuttner L, Gunnink E, Sylling P, Taylor L, Fihn SD, Nelson K. Components of the patient-centered medical home associated with perceived access to primary care. J Gen Intern Med. 2020;35(6):1736–42.
Stewart GL, Astrove SL, Reeves CJ, Crawford ER, Solimeo SL. Those with the most find it hardest to share: exploring leader resistance to the implementation of team-based empowerment. Acad Manag J. 2017;60(6):2266–93.
Geerts JM, Goodall AH, Agius S. Evidence-based leadership development for physicians: a systematic literature review. Soc Sci Med. 2020;246:112709.
Avolio B, Avey J, Quisenberry D. Estimating return on leadership development investment. Leadersh Q. 2020;21(4):633–44.
Rousseau DM, Barends E, Rynes SL, Lub XD, Briner RB, Walshe ND. Change the world: teach evidence-based practice! In Academy of Management Learning and Education Annual Meeting; 2015.
Hamilton A. Qualitative methods in rapid turn-around health services research [Cyberseminar]. U. S: Department of Veterans Affairs, Health Services Research & Development; 2013. Available at: https://www.hsrd.research.va.gov/for_researchers/ cyber_seminars/archives/780-notes.pdf. Accessed September 25, 2020
Palinkas L, Horwitz S, Green C, Wisdom J, Duan N, Hoagwood K. Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Admin Pol Ment Health. 2015;42(5):533–44.
Blumenthal DM, Bernard K, Bohnen J, Bohmer R. Addressing the leadership gap in medicine: residents' need for systematic leadership development training. Acad Med. 2012;87(4):513–22.
Arroliga CA, Courtland H, Myers JD, Dieckert JP, Wesson D. Leadership in health care for the 21st century: challenges and opportunities. Am J Med. 2014;127(3):246–9.
Warshaw G. Providing quality primary care to older adults. J Am Board Fam Med. 2009;22(3):239–41.
Frich JC, Brewster AL, Cherlin EJ, Bradley EH. Leadership development programs for physicians: a systematic review. J Gen Intern Med. 2015;30(5):656–74.
Stoller J. Developing physician-leaders: a call to action. J Gen Intern Med. 2009;24(7):876–8.
Giannitrapani KF, Rodriguez H, Huynh AK, Hamilton AB, Kim L, Stockdale SE, Needleman J, Yano EM, Rubenstein LV. How middle managers facilitate interdisciplinary primary care team functioning. Healthc (Amst). 2019 Jun;7(2):10–5.
Crabtree BF, Howard J, Miller WL, Cromp D, Hsu C, Coleman K, Austin B, Flinter M, Tuzzio L, Wagner EH. Leading innovative practice: leadership attributes in LEAP practices. Milbank Q. 2020;98(2):399–445.
Shanafelt TD, Gorringe G, Menaker R, Storz KA, Reeves D, Buskirk SJ, Sloan JA, Swensen SJ. Impact of organizational leadership on physician burnout and satisfaction. Mayo Clin Proc. 2015;90:432–40.
Davidson S. Hard Science and “Soft” Skills: Complex Relational Leading. Nurs Adm Q. 2020;44(2):101–8.
The authors received technical assistance for recruitment from the VISN 23 Primary and Specialty Medicine Leadership, Sharon Myllenbeck, Larry L Brown, and Ian Merkel. Instrumental support for transcription was provided by the Center for Access & Delivery Research and Evaluation personnel, Monica Paez, Vu-Thuy Nguyen, and Elizabeth Newbury. THA, GLS, SLS received support for this research from the Primary Care Analytics Team-Iowa City, Iowa City VA Health Care System, Iowa City, IA, funded by the VA Office of Patient Care Services. SLS is a VA HSR&D Career Development awardee at the Iowa City VA (Award #CDA 13-272) and received partial support for this work from the Center for Access & Delivery Research and Evaluation (CADRE), Department of Veterans Affairs, Iowa City VA Health Care System (Award # CIN 13-412) and the Veterans Rural Health Resource Center Iowa City, VA Office of Rural Health. The opinions expressed are those of the authors and not necessarily those of the Department of Veterans Affairs or the U. S. government.
The research was funded by the Department to Veterans Affairs Office of Patient Care Services through an award to the Primary Care Analytics Team-Iowa City. The funders had no role in the design, conduct, or dissemination of this research.
Ethics approval and consent to participate
This project was approved by the Institutional Review Board at the Iowa City VA Health Care System prior to data collection, including permission to obtain consent verbally. Healthcare leaders provided verbal consent to participate in the study and to be audio recorded before each telephone interview was initiated. Verbal consent was necessary as participants (and researchers) were geographically dispersed.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
About this article
Cite this article
Abraham, T.H., Stewart, G.L. & Solimeo, S.L. The importance of soft skills development in a hard data world: learning from interviews with healthcare leaders. BMC Med Educ 21, 147 (2021). https://doi.org/10.1186/s12909-021-02567-1