Skip to main content

Core sepsis-related competencies for medical students: an international consensus by Delphi technique

Abstract

Background

Sepsis is a life-threatening condition which may arise from infection in any organ system and requires early recognition and management. Healthcare professionals working in any specialty may need to manage patients with sepsis. Educating medical students about this condition may be an effective way to ensure all future doctors have sufficient ability to diagnose and treat septic patients. However, there is currently no consensus on what competencies medical students should achieve regarding sepsis recognition and treatment. This study aims to outline what sepsis-related competencies medical students should achieve by the end of their medical student training in both high or upper-middle incomes countries/regions and in low or lower-middle income countries/regions.

Methods

Two separate panels from high or upper-middle income and low or lower-middle income countries/regions participated in a Delphi method to suggest and rank sepsis competencies for medical students. Each panel consisted of 13–18 key stakeholders of medical education and doctors in specialties where sepsis is a common problem (both specialists and trainees). Panelists came from all continents, except Antarctica.

Results

The panels reached consensus on 38 essential sepsis competencies in low or lower-middle income countries/regions and 33 in high or upper-middle incomes countries/regions. These include competencies such as definition of sepsis and septic shock and urgency of antibiotic treatment. In the low or lower-middle income countries/regions group, consensus was also achieved for competencies ranked as very important, and was achieved in 4/5 competencies rated as moderately important. In the high or upper-middle incomes countries/regions group, consensus was achieved in 41/57 competencies rated as very important but only 6/11 competencies rated as moderately important.

Conclusion

Medical schools should consider developing curricula to address essential competencies, as a minimum, but also consider addressing competencies rated as very or moderately important.

Peer Review reports

Introduction

Sepsis is characterized by life-threatening organ dysfunction resulting from the body’s response to infection, estimated to affect 48.9 million patients and account for 11 million deaths each year [1]. The emergence of the coronavirus disease 2019 (COVID-19) pandemic also accentuates the disease burden of sepsis, as sepsis is a frequent complication resulting in high morbidity and mortality [2]. Early recognition and treatment is vital to increase survival and reduce morbidity. As sepsis may result from infection in any organ system, healthcare professionals working in any specialty may need to manage septic patients [3]. Thus, improving survival from sepsis requires all healthcare workers to be educated in its recognition and management.

In 2017 the World Health Assembly adopted a resolution to improve the prevention, diagnosis and management of sepsis and suggested educational development for health care workers [3]. More recently, the development of a core competency framework on sepsis for health care workers was identified as a priority at a WHO Sepsis Technical Expert Meeting [4]. Teaching medical students about sepsis may be an effective way of ensuring that all future doctors have sufficient ability to diagnose and treat septic patients. Medical school curricula are increasingly designed using the competency-based medical education framework [5]. However, there is currently no consensus on what competencies medical students should achieve regarding sepsis recognition and treatment. Determining appropriate competencies is a crucial first step for development of appropriate curricula and for evaluating adequacy of training. Although previous studies have investigated the knowledge of medical students and junior doctors regarding sepsis, the usefulness of these data are limited by the absence of external criteria to judge adequacy [6,7,8,9]. Furthermore, a MedLine search using the medical subject headings “sepsis” and “students, medical” and “curriculum” revealed no publications that addressed the issue of what should be included in medical student sepsis curricula.

Most studies of sepsis and recent management guidelines have focused on high income countries/regions but most of the worlds’ population lives in low and middle income countries/regions [10]. In 2017 85% of sepsis cases occurred in areas with low, low-middle or middle standard development index (SDI). Furthermore, the highest age-standardised sepsis-related mortality occurred in areas with the lowest SDI, highlighting the high burden of sepsis in low and middle income countries/regions [1]. The challenges to providing high quality sepsis care likely differ substantially between high income and low/ middle income healthcare systems. For example, 15% of Latin American intensivists reported inadequate conditions to manage patients with septic shock due to insufficient technology, laboratory support, imaging and drug resources [11]. In Africa, only 1.5% of respondents to a survey in 2011, felt they had resources to implement the entire Surviving Sepsis Campaign guidelines [12]. Consequently, it is likely that training requirements for medical students should also differ [9].

We therefore carried out a study, using a Delphi technique, to determine what sepsis-related competencies medical students should achieve by the end of their medical student training in both high or upper-middle incomes countries/regions (HUMIC) and in low or lower-middle income countries/regions (LLMIC) [12]. This study is intended to be the first step in a multi-stage process. Obtaining consensus on what should be included in a sepsis medical school curriculum is the first stage. Further work and studies are required to design and implement a curriculum, develop assessment tools and validate the competencies/ curriculum suggested by this study.

Method

Approval to carry out the study was obtained from the Survey and Behavioral Research Ethics Committee of The Chinese University of Hong Kong (SBRE 221-17).

An initial search of EMBASE and PubMed using the medical subject headings “sepsis” and “students, medical” and “curriculum” was conducted to identify studies for determining medical student sepsis curricula. No studies were found.

A Delphi method was used to determine sepsis-related competencies which medical students should have achieved by the end of their undergraduate training. The Delphi process involved several stages [13]. Firstly, panels of experts were assembled: one consisting of panelists from HUMIC (as defined by the World Bank for the 2018 fiscal year) and one consisting of panelists from LLMIC [14]. When forming the panel the following factors were considered. First, there should be a balance between panelists with and without a specific interest in sepsis. Second, panelists should come from a range of geographical areas and specialties that commonly manage patients with sepsis. Third, the panel should include doctors who had recently qualified and not yet completed specialist training. Finally, the panel should include members with responsibility for the overall medical school curriculum at their institution. Medical students were not included as panelists as they were deemed to lack sufficient experience and insight regarding sepsis education. However, we believe that recent graduates retain an appreciation of the scope and volume of the whole medical curriculum while understanding the aspects of medical education necessary for patient care. Digital written informed consent to participate was given by all panelists, who volunteered their time without funding.

During the second stage, panelists were asked to individually suggest a broad list of up to 20 competencies that they thought final year medical students should have regarding sepsis. From these suggestions a list of competencies from each of the two panels was compiled. Two researchers (GELM and LL) then individually eliminated duplicates from these lists, with disagreement between the two researchers being resolved by discussion.

During the third stage, the lists of competencies were circulated to the respective panelists, who independently rated the importance of each competency, without awareness of other participant’s ratings, on a numeric scale of 1 to 5 as essential (1), very important (2), moderately important (3), slightly important (4) or unimportant (5) [15].

During the fourth stage, the collated results for each panel were sent to all members of that panel. Panelists were shown their own rating and the distribution of ratings by all other panelists for each competency. Participants were able to change their rating with the understanding that the purpose of the round was to achieve consensus. Consensus was defined as ≥ 75% of participants rating the importance within two adjacent categories; e.g. 75% of participants rating a competency as either essential or very important [16]. After this fourth stage the results were examined by three investigators and an independent adjudicator to determine whether discussion of the precise wording of the competency followed by a further round of voting was likely to result in consensus. This process was completed by 9th May 2020. To facilitate translation and adoption into medical school curricula, competencies were classified according to the 8 commonly accepted competency domains in competency-based medical education: patient care, knowledge for practice, practice-based learning and improvement, interpersonal and communication skills, professionalism, systems-based practice, interprofessional collaboration, and personal and professional development [17]. Median was used to summarize importance ratings.

Submission of suggestions, rating of competencies and revision of ratings were all carried out electronically using REDCap electronic data capture tools hosted at the Department of Anaesthesia & Intensive Care, The Chinese University of Hong Kong [18, 19]. There was no direct face to face discussion between panelists, who all worked independently.

Results

We invited 19 participants from HUMIC and 15 participants from LLMIC. All HUMIC invitees accepted but one did not respond to any further correspondence leaving 18 panelists. One of the LLMIC invitees did not respond to our invitation and one accepted the invitation but did not respond to any further correspondence, leaving 13 panelists. In the HUMIC group, 14 panelists were from high income countries/regions and four from upper-middle income countries/regions: six from North America, one from South America, four from Asia, four from Europe, two from Oceania and one from Africa. In the LLMIC group, five were from low-income countries/regions and eight from lower-middle income countries/regions: one from North America, three from Asia, one from Oceania and eight from Africa. The specialty areas for which the panelists were invited are given in Table 1. Members of the panel included representatives from World Health Organization (WHO), Global Sepsis Alliance, Latin American Institute of Sepsis, Chinese Society of Critical Care Medicine, African Sepsis Alliance, Asia Pacific Sepsis Alliance, and panelists with overall responsibility for medical school curricula.

Table 1 Number of participants representing various specialties in high income and low/ middle income countries/regions

Panelists in the HUMIC group made 239 suggestions, which were reduced to 109 after removing duplicates. Panelists in the LLMIC group suggested 195, which were subsequently reduced to 88.

After two rounds of rating, consensus was reached for all but one competency in the LLMIC group and all competencies with a median rating greater than very important in the HUMIC group (Table 2). Examination of the distribution of the ratings (by JGM, GCD, LL and GELM) for those competencies for which consensus was not achieved (Supplementary Table 1) suggested that re-wording of the competency was unlikely to achieve consensus if subjected to another round of rating. Competencies rated below moderately important are given in Supplementary Table 2. There was no missing data.

Table 2 Competencies rated moderately important or above with consensus

Discussion

Our study is the first study to identify sepsis-related competencies that medical students should achieve by graduation. This is in line with the priority identified at the WHO Sepsis Expert Technical meeting in 2018 to develop core competency frameworks on sepsis for health care workers. We identified 38 and 33 essential competencies which medical students should achieve in LLMIC and HUMIC, respectively. Consensus was reached for all essential competencies. In the LLMIC group, complete consensus was also achieved for competencies ranked as very important and was achieved in 4/5 competencies rated as moderately important. In the HUMIC group, consensus was achieved in 41/57 competencies rated as very important but only 6/11 competencies rated as moderately important. These competencies have been endorsed by the Global Sepsis Alliance to guide development of sepsis curricula for medical students.

Given the burden of sepsis and the need for early intervention, doctors working in all specialties should have the basic competencies required for diagnosing and managing septic patients. It therefore behoves medical schools to provide training in sepsis recognition and management. Indeed, it has been suggested that member states of the WHO should mandate this training for all healthcare workers [4].

We believe the competencies identified in this study provides a useful framework on which to develop sepsis training for medical students. The aim of modern competency-based medical education is to train “health-professionals that can practice medicine at a defined level of proficiency” [20]. Most of the identified competencies were within the domains of patient care, knowledge for practice and interpersonal and communication skills [17]. This reflects the objective of this study which was to identify core competencies that medical students should achieve by graduation to care for patients with sepsis.

While we understand that different medical schools will have different priorities for teaching, we strongly suggest that, as a minimum, training to achieve the competencies rated essential be incorporated into the curriculum of all medical schools. We also suggest that medical students should achieve competencies rated very important or moderately important for which consensus was obtained (Table 2). For example, both LLMIC and HUMIC panels ranked “know the definition of sepsis” and “know that early recognition of sepsis is important” as essential competencies. Meanwhile, “know the SIRS criteria and recognize them when present in a patient”, “know how to calculate and utilize qSOFA score” and “know rationale to justify revising definitions of sepsis from previous SIRS based definition” were only ranked as very important rather than essential. Whilst these seemingly similar competencies resulted in different importance rankings, the need to know the definition of sepsis and importance of early sepsis recognition are key concepts of sepsis management. Instead, SIRS or qSOFA criteria are imperfect tools for sepsis recognition which may be updated or replaced over time. Indeed, differences in use of SIRS and qSOFA to diagnose and prognosticate sepsis when compared to Sepsis-3 criteria based on SOFA has been well documented [21]. This distinction in ranking may help medical schools prioritize essential learning objectives in curriculum development.

A guiding principle of competency based-medical education is to achieve competencies that are “in accord with local conditions to meet local needs [20]”. We anticipated that LLMIC would have different priorities and requirements for medical students compared with HUMIC. Therefore, LLMIC and HUMIC had separate panels and thus separate results. While many of the suggested competencies overlapped, there were some suggestions that differed between the groups (Table 2 and Supplementary Table 1). For example, an essential competency for LLMIC is to know how to diagnose malaria, while this was not even suggested HUMIC group. In addition, some basic skills such as being able to measure blood pressure and blood glucose were included by the LLMIC panel but not the HUMIC panel. Furthermore, an essential competency included by the LLMIC but not HUMIC panel was to be able to prioritize patients needing critical care when resources are scarce. While we attempted to address heterogeneity by having separate LLMIC and HUMIC panels, this does not address the heterogeneity in diseases and resources within LLMIC or HUMIC.

Studies based on Delphi methodology are entirely dependent on the opinion of their expert panels [22]. By their very nature these panels are not randomly selected and the selection process may introduce bias. We used specific criteria to determine the composition of the panels to minimize bias. In particular, we deliberately included panelists who did not have a particular interest in sepsis and panelists whose professional position allowed them an overview of their entire medical school curriculum. There was, perhaps, an over-representation of Intensive Care specialists in the HUMIC group, but the inclusion of life-threatening organ dysfunction in sepsis criteria means that Intensive Care specialists are inevitably major stakeholders. Furthermore, the relatively high proportion of Intensive Care specialists on the panel does not appear to have been reflected in those competencies considered essential, none of which are specific to Intensive Care practice. In retrospect, the failure to include public health specialists was a weakness, which may have resulted in an absence of suggestions for public health interventions such as vaccination.

We defined consensus as 75% of panelists rating the importance of a competency within two adjacent categories. Percentage agreement is the most common method of defining consensus and the median threshold for agreement in 25 Delphi studies that were recently reviewed was 75%, with a reported threshold agreement range of 50–97% [16]. There is no consensus on the number of panelists required, but our number of panelists falls within the commonly used range. In a review of 76 healthcare related Delphi studies the median number of individuals invited to participate was 17 (interquartile range of 11–31), and in a review of 100 studies the most common number of panelists in the final round was between 11 and 25 [23, 24].

While the Delphi method is a widely used method for developing guidelines and curricula, there are no published data to demonstrate that Delphi-based curricula improve students’ learning outcomes. This is partly due to difficulties in separating the effects of curriculum and curriculum content.

Another potential limitation is that panelists didn’t meet to discuss results. It is possible that consensus wasn’t achieved for some competencies because panelists weren’t able to discuss the reasoning behind their suggestions. In contrast, an advantage of the panelists not meeting was the absence of social pressure to agree with a suggestion that they fundamentally did not agree with, thus avoiding false consensus.

It is possible that greater consensus would have been achieved if a further round of rating had been undertaken after discussion on re-wording competency statements. However, after careful assessment, the adjudicating group believed that this was unlikely, and that considering the level and nature of competencies for which consensus was not reached, greater consensus would not substantially increase the usefulness of this document.

The results of this study were collected prior to the 2021 update to the Surviving Sepsis Campaign International Guidelines for the management of sepsis. While it is possible that these newer guidelines might have altered the panelists’ recommendations, the relatively non-specific nature of the recommendations mean it is unlikely that they would be significantly impacted by changes in guidelines regarding the specific management of sepsis [25].

As mentioned above, the results of the study are based on expert opinion not high level evidence. However, we are not aware of any high level evidence on which to base a medical student sepsis curriculum. Once a curriculum and assessment based on these competencies has been developed, further research to validate our data as a tool to strengthen medical students’ experience and clinical performance may be possible.

Conclusion

We have identified essential sepsis-related competencies for medical students in both LLMIC and HUMIC. Consensus on their importance was achieved for all these competencies. We suggest that medical schools develop curricula to address these competencies, as a minimum, but also consider addressing competencies rated as very or moderately important.

Availability of data and materials

All data generated or analysed during this study are included in this published article [and its supplementary information files].

References

  1. Rudd KE, Johnson SC, Agesa KM, et al. Global, regional, and national sepsis incidence and mortality, 1990–2017: analysis for the Global Burden of Disease Study. Lancet. 2020;395(10219):200–11. Epub 2020/01/20.

    Article  Google Scholar 

  2. da Silva Ramos FJ, de Freitas FGR, Machado FR. Sepsis in patients hospitalized with coronavirus disease 2019: how often and how severe? Curr Opin Crit Care. 2021;27(5):474–4792.

    Article  Google Scholar 

  3. Reinhart K, Daniels R, Kissoon N, et al. Recognizing sepsis as a global health priority - a WHO resolution. N Engl J Med. 2017;377(5):414–7. Epub 2017/06/29.

    Article  Google Scholar 

  4. WHO Sepsis Technical Expert Meeting - Meeting Report. Geneva: World Health Organization; 2018.

  5. Ryan MS, Blood AD, Park YS, et al. Competency-based frameworks in medical school education programs: a thematic analysis of the academic medicine snapshots. Acad Med. 2022;97(11S):63–70.

    Article  Google Scholar 

  6. Marshall-Brown P, Namboya F, Pollach G. Evaluating sepsis training for medical students and nonphysicians in Malawi. J Clin Anesth. 2016;34:352–7. Epub 2016/10/01.

    Article  Google Scholar 

  7. Hansel M, Winkelmann AM, Hardt F, et al. Impact of simulator training and crew resource management training on final-year medical students’ performance in sepsis resuscitation: a randomized trial. Minerva Anestesiol. 2012;78(8):901–9. Epub 2012/04/17.

    Google Scholar 

  8. Nguyen HB, Daniel-Underwood L, Van Ginkel C, et al. An educational course including medical simulation for early goal-directed therapy and the severe sepsis resuscitation bundle: an evaluation for medical student training. Resuscitation. 2009;80(6):674–9. Epub 2009/04/28.

    Article  Google Scholar 

  9. Ziglam HM, Morales D, Webb K, Nathwani D. Knowledge about sepsis among training-grade doctors. J Antimicrob Chemother. 2006;57(5):963–5. Epub 2006/03/15.

    Article  Google Scholar 

  10. Shrestha GS, Kwizera A, Lundeg G, et al. International Surviving Sepsis Campaign guidelines 2016: the perspective from low-income and middle-income countries. Lancet Infect Dis. 2017;17(9):893–5. Epub 2017/08/29.

    Article  Google Scholar 

  11. Castro R, Nin N, Rios F, et al. The practice of intensive care in Latin America: a survey of academic intensivists. Crit Care. 2018;22(1):39. Epub 2018/02/22.

    Article  Google Scholar 

  12. Baelani I, Jochberger S, Laimer T, et al. Availability of critical care resources to treat patients with severe sepsis or septic shock in Africa: a self-reported, continent-wide survey of anaesthesia providers. Crit Care. 2011;15(1):10. Epub 2011/01/12.

    Article  Google Scholar 

  13. Jones J, Hunter D. Consensus methods for medical and health services research. BMJ. 1995;311(7001):376–80. Epub 1995/08/05.

    Article  Google Scholar 

  14. World Bank Operational Income Category. The World Bank; 2018.

  15. Brown S. Likert scale examples for surveys. 2010. Available from: https://www.extension.iastate.edu/Documents/ANR/LikertScaleExamplesforSurveys.pdf.

  16. Diamond IR, Grand RC, Feldman BM, et al. Defining consensus: a systematic review recommends methodologic criteria for reporting of Delphi studies. J Clin Epidemiol. 2014;67(4):401–9. Epub 2014/03/04.

    Article  Google Scholar 

  17. Englander R, Cameron T, Ballard AJ, et al. Toward a common taxonomy of competency domains for the health professions and competencies for physicians. Acad Med. 2013;88(8):1088–94.

    Article  Google Scholar 

  18. Harris PA, Taylor R, Thielke R, et al. Research electronic data capture (REDCap)–a metadata-driven methodology and workflow process for providing translational research informatics support. J Biomed Inform. 2009;42(2):377–81. Epub 2008/10/22.

    Article  Google Scholar 

  19. Harris PA, Taylor R, Minor BL, et al. The REDCap consortium: building an international community of software platform partners. J Biomed Inform. 2019;95:103208. Epub 2019/05/13.

    Article  Google Scholar 

  20. McGaghie WC, Miller GE, Sajid AW, Telder TW. Competency-based curriculum development in medical education - an introduction. Genf: WHO; 1978.

    Google Scholar 

  21. Li A, Ling L, Arabi YM, et al. Prognostic evaluation of quick sequential organ failure assessment score in ICU patients with sepsis across different income settings. Crit Care. 2024;28(1):30.

    Article  Google Scholar 

  22. Shang Z. Use of Delphi in health sciences research: a narrative review. Medicine (Baltimore). 2013;102(7):e32829.

    Article  Google Scholar 

  23. Boulkedid R, Abdoul H, Loustau M, et al. Using and reporting the Delphi method for selecting healthcare quality indicators: a systematic review. PLoS One. 2011;6(6):e20476. Epub 2011/06/23.

    Article  Google Scholar 

  24. Smith AG, Brainard JC, Campbell KA. Development of an undergraduate medical education critical care content outline utilizing the Delphi method. Crit Care Med. 2020;48(1):98–103.

    Article  Google Scholar 

  25. Evans L, Rhodes A, Alhazzani W, et al. Executive summary: surviving sepsis campaign: international guidelines for the management of sepsis and septic shock 2021. Crit Care Med. 2021;49(11):1974–82.

    Article  Google Scholar 

Download references

Acknowledgements

The authors would like to thank Bryan Ng and Charles David Gomersall, Department of Anaesthesia and Intensive Care, The Chinese University of Hong Kong for their help with the study. Mr Ng set up and maintained the data collection system and Professor Gomersall critiqued the study design and manuscript and helped adjudicate the need for another Delphi round. The authors would also like to thank Professor Simon Finfer for providing feedback on the manuscript.

Funding

This study was not funded.

Author information

Authors and Affiliations

Authors

Contributions

GELM, LL and JGM conceived the study and wrote the first draft of the manuscript. GELM, LL and JGM reviewed the submitted competencies and decided on the need for further Delphi rounds. All other authors were panelists who suggested and ranked competencies, revised and approved the final manuscript and agreed to be accountable for all aspects of the work.

Corresponding authors

Correspondence to Elanor Lian Mary Gomersall or Lowell Ling.

Ethics declarations

Ethics approval and consent to participate

Approval to carry out the study was obtained from the Survey and Behavioral Research Ethics Committee of The Chinese University of Hong Kong (SBRE 221-17). Digital written informed consent to participate was given by all panelists, who volunteered their time without funding.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Gomersall, E.L.M., Ling, L., Reinhart, K. et al. Core sepsis-related competencies for medical students: an international consensus by Delphi technique. BMC Med Educ 24, 653 (2024). https://doi.org/10.1186/s12909-024-05525-9

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-024-05525-9

Keywords