Skip to main content
Download PDF

A prospective randomized study to compare standard versus intensive training strategies on long-term improvement in critical care ultrasonography proficiency

BMC Medical Education volume 22, Article number: 732 (2022) Cite this article

Abstract

Background

Critical care ultrasonography (CCUS) has become a daily diagnostic tool for intensivists. While the effective training measures for ultrasound novices are discussed widely, the best curriculum for the novices to retain a long-term proficiency is yet to be determined.

Methods

Critical care medicine fellows who underwent an introductory CCUS workshop were randomly allocated into the standard training (ST) or the intensive training (IT) group. The IT group received an 8-h training besides the standardized fellowship education that the ST group received. Participant improvement in CCUS proficiency tests (maximum score, 200) after a 6-month training intervention was compared between the groups. CCUS examinations performed in patient care were observed over 2 years.

Results

Twenty-one fellows were allocated into the ST (n = 10) or the IT (n = 11) group. No statistically significant difference was observed in the median (interquartile range [IQR]) improvement in CCUS proficiency tests between the ST group and the IT group: 18 (3.8–38) versus 31 (21–46) (P = .09). Median (IQR) test scores were significantly higher in postintervention than preintervention for both groups: ST, 103 (87–116) versus 124 (111–143) (P = .02), and IT, 100 (87–113) versus 143 (121–149) (P < .01). Participating fellows performed 226 examinations over the 2 years of observation.

Conclusions

Fellows improved their CCUS proficiency significantly after 6-month training intervention. However, an additional 8-h training did not provide further benefits.

Peer Review reports

Introduction

Critical care ultrasonography (CCUS) is goal-oriented ultrasonography performed and interpreted by intensivists at the bedside [1,2,3]. It has been used increasingly in the careof critically ill patients. Previous studies have demonstrated that the clinical utility of ultrasonography depends on the experience and skills of the operator [4,5,6,7,8,9,10,11,12]. Operator training is essential for ultrasonographic examination to be a beneficial tool, and general agreement exists that training must include basic knowledge of ultrasonography physics and supervised image acquisition and interpretation practice [2, 7, 8, 13,14,15,16,17]. Several studies have shown that basic CCUS skills can be taught efficiently in an organized workshop with the primary aim of short-term improvement [18,19,20,21,22].

Long-term sustainment or improvement in procedures is a mandatory but challenging mission for practicing physicians. For instance, intensivists undergo advanced cardiovascular life support certification every 2 years; yet, cardiovascular resuscitation knowledge and skill start to regress before recertification [23,24,25,26,27,28]. Especially, psychomotor skills represented in chest compressions are more difficult to retain than resuscitation knowledge [24, 29]. Similarly, a recent study on cardiac ultrasonography reported that examination skills deteriorate markedly within 2 years of nonuse [30]. A study on learning trajectory of novice ultrasound learners revealed that the image acquisition skill decayed as early as 4 weeks from the initial training [31]. Despite concern about sustainment of CCUS skills, a limited number of reports describe a medium to long-term outcome of CCUS educational effort. A study evaluating a 14-week simulation-based training for fellows resulted in comparable or greater knowledge and confidence in CCUS, relative to experts and apprentice learners [32]. Another study demonstrated that a 1-year training curriculum consisting of didactic lectures and subsequent self-paced scanning resulted in improved time to attain adequate cardiac ultrasonography images [33].

Our crucial goal was to develop a high-quality, continuous ultrasonography education program for intensivists. In the present study, we aimed to investigate the effect of a CCUS refresher training program for critical care medicine fellows who underwent an introductory workshop at the beginning of their academic year. Fellows were randomly assigned to intensive training (IT) or standard training (ST). We hypothesized that the IT group, who received CCUS refresher training, would improve in CCUS proficiency significantly more than the ST group, who received the standard CCUS training outlined in the fellowship education curriculum at our institution. Our primary end point was improvement in CCUS proficiency test scores at completion of a 6-month study intervention. At its end, the groups were crossed over, and all participating fellows received the refresher training program in the same academic year. We also hypothesized that our long-term CCUS educational effort would result in a notable learning transfer to clinical practice. We surveyed indications, types, and findings of CCUS examinations performed by fellows, along with the training program’s influence on patient care management.

Methods

The study consisted of 1) a prospective randomized section to compare 2 training strategies (6-month ST vs IT) on improvement in CCUS proficiency and 2) a prospective section on CCUS examination surveys in the medical intensive care unit (MICU). It was conducted at the Mayo Clinic Hospital in Rochester, Minnesota, during the academic year July 2012 through June 2014. The Mayo Clinic Institutional Review Board approved the study (study ID 12–005,095).

Comparison of 2 training strategies

Study participants were recruited among the entering critical care medicine fellows who underwent a multimedia CCUS workshop on 2 half-days in July 2012 or July 2013. This workshop was specifically designed for entering fellows as part of fellowship education. It consisted of didactic lectures and hands-on training. All 4 components of CCUS examination—cardiac, thoracic, abdominal, and vascular—were taught during the workshop.

All the participating fellows provided written informed consent to research enrollment. Then, the fellows took a baseline survey about their previous CCUS experience and a CCUS proficiency test within 2 weeks of the CCUS workshop. The proficiency test consisted of knowledge and skill portions. The knowledge portion measured participant knowledge on ultrasonography physics and image interpretation in 100 multiple-choice questions (maximum score, 100). Five questions were about machine knobology and ultrasonography physics; 10 questions were about vascular; 15 questions, thoracic; 55 questions, cardiac; and 15 questions, abdominal CCUS. The skill portion measured machine operation and image acquisition skills in simulated clinical scenarios (Additional file 1) with a maximum score of 100. This portion was video-recorded for subsequent scoring on 23 checklist items (Additional file 1) by 2 independent reviewers (R.S. and H.S.; scores by H.S. were used in the subsequent analysis). A total score of the CCUS proficiency test was calculated by combining the scores of knowledge and skill portions, with a maximum of 200 points.

Participants were first stratified into 2 groups on the basis of their total scores of the CCUS proficiency test, in high- (above the median) versus low-scoring groups. Subsequently, participants in each stratification group were randomly allocated into the ST or IT group.

The ST group received standardized CCUS education outlined in the Mayo Clinic critical care medicine fellowship education curriculum for 6 months—self-paced online learning modules, in-class lectures, and hands-on training at the bedside. The IT group received 8-h, additional training sessions during 1 of their 4-week MICU rotations. Several participants had 2 MICU rotations during the 6-month intervention. For these participants, 1 MICU rotation month was conveniently chosen as an IT month to avoid allocating too many learners in a particular month. Of the 8 h, the first hour was dedicated to performing CCUS examinations on a “standardized” patient, 6 h were spent at bedside examining MICU patients, and 1 h was spent for online image interpretation. The sessions were conducted hourly with prescheduled appointments, supervised by a staff intensivist or a certified sonographer according to their availability. The instructor to participant ratio was 1:1 in all training sessions.

At completion of the 6-month intervention, participants were asked to undergo the CCUS proficiency test. Contents were the same as the baseline CCUS proficiency test except for the order of the knowledge questions. After the 6 months, the group assignment was crossed over, and all learners initially in the ST group underwent additional 8-h training sessions as the IT group had done in the intervention period.

CCUS examination survey

Study participants were recruited among the entering critical care medicine fellows who underwent a multimedia CCUS workshop on 2 half-days in July 2012 or July 2013. Study participants were asked to complete a survey each time they performed a CCUS examination in actual patient care in the MICU. The survey was intended to describe indications, types, and findings of CCUS examination performed by the participants, the influence of the examination on patient care management, and subjective confidence levels of the participants on image acquisition, interpretation, and overall management. The survey was collected from July 2012 through June 2014.

Statistical analysis

In a prospective randomized study comparing 2 CCUS training strategies, no reasonable estimate of standard deviation (SD) of the CCUS proficiency test was available from the literature since the test was created specifically for this study. On the basis of previous similar CCUS education projects [18, 19], we anticipated that the SD would be approximately 6.5. For a clinically significant minimum improvement difference of 10 points between ST and IT groups, 8 participants in each group had 80% power to detect the difference in score improvements, with an α level of 0.05.

An association between the participant baseline ultrasonography experience and the group allocation was analyzed with Fisher exact test for each examination category. Quantitative parameters were expressed as median (interquartile range [IQR]), and Wilcoxon rank sum test was used to compare individual score improvements between the 2 groups. Improvement in test scores within each group was analyzed with Wilcoxon signed rank test. For scoring the skill portion of CCUS proficiency test, a Bland–Altman plot was used to analyze agreement between 2 independent reviewers (R.S. and H.S.). Only the participants able to complete both baseline and postintervention CCUS proficiency tests were included in the analysis.

In a prospective study on CCUS surveys, categorical variables such as examination type were presented with frequency and proportions. Binary variables, such as unexpected findings and change in management, were compared among types of CCUS examinations with χ2 test.

All statistical analyses were conducted with JMP Pro Version 10 software (SAS Institute Inc). P less than 0.05 (2-sided) was determined as statistically significant.

Results

Prospective randomized study comparing the 2 training strategies

A total of 32 fellows initially agreed to participate in the study. However, 11 fellows withdrew from the study because of scheduling conflicts or inability to complete the knowledge or skill portion, or both, of the CCUS proficiency test. Hence, 21 participants—10 in the ST group and 11 in the IT group—were included in the analysis. Table 1 summarizes the participants’ previous experience in point-of-care ultrasonographic examinations. Most fellows had 20 or fewer examinations in each category, and no statistically significant association was found between group allocation and prior ultrasonography experience (cardiac, P = 0.71; vascular, P = 0.67; thoracic, P = 0.42; and abdominal, P = 0.27).

Table 1 Participant Baseline Critical Care Ultrasonography Experience
Full size table

Table 2 shows test scores in the pre- and postintervention periods. No statistically significant difference was determined between the ST and IT groups in median total CCUS proficiency test scores in the preintervention period (P = 0.97). Figure 1 shows the individual improvement in total CCUS test scores at the end of the 6-month intervention. In this parameter as well, no statistically significant difference was observed between the 2 groups (Fig. 2): knowledge, median (IQR), 8.5 (2.5–15) versus 14 (5–21), P = 0.26; skill, 11 (0.5–19) versus 16 (2–30), P = 0.20; and total score, 18 (3.8–38) versus 31(21–46), P = 0.09.

Table 2 Critical Care Ultrasonography Proficiency Test Scores in Preintervention and Postintervention
Full size table
Fig. 1
figure 1

Individual Improvement in Critical Care Ultrasonographic Proficiency Scores of ST and IT Groups. IT indicates intensive training; pre, preintervention; post, postintervention; ST, standard training

Full size image
Fig. 2
figure 2

Improvement in Critical Care Ultrasound Proficiency Scores by Test Domain. Comparison was made between ST and IT training groups. IT indicates intensive training; ST, standard training

Full size image

Total CCUS test scores were significantly higher postintervention than preintervention in both groups (ST, 103 [87–116] vs 124 [111–143], P = 0.02; IT, 100 [87–113] vs 143 [121–149], P < 0.01). The Bland–Altman plot presented an acceptable level of agreement in scoring CCUS proficiency tests between the 2 reviewers (Fig. 3). Mean bias was − 0.38 with limits of agreement − 5.2 to 4.5 in the preintervention CCUS proficiency test; mean bias was 0.38 with limits of agreement − 4.1 to 4.9 in the postintervention CCUS proficiency test.

Fig. 3
figure 3

Bland–Altman Plots of Pre- and Postintervention Periods on Critical Care Ultrasonography Proficiency Test Scoring by 2 Independent Reviewers

Full size image

Prospective study of CCUS examination survey

During the 2-year study, 38 fellows conducted 580 CCUS examinations, among which 400 examinations (69%) were properly documented in the survey. Among them, 226 examinations (57%) were performed by the 32 critical care medicine fellows who participated in the prospective randomized study comparing 2 training strategies. The common indications (including multiple indications per examination) were cardiovascular failure or shock (n = 272, 68%), respiratory failure or distress (n = 108, 27%), abdominal pain or discomfort (n = 30, 8%), and extremity abnormality (n = 27, 8%). Up to 73% of examinations (n = 292) were limited to 1 of these 4 common types of CCUS examination per patient, whereas the other examinations (n = 118, 30%) were combinations of those 4 types. Among single-type CCUS examinations, cardiac CCUS was most frequently conducted (n = 195, 67%), followed by thoracic (n = 50, 17%), abdominal (n = 33, 11%), and vascular CCUS (n = 14, 5%). Among combined CCUS examinations, the cardiac and thoracic combination was performed most commonly (34/118, 29%), followed by cardiac and abdominal (n = 27, 23%) and cardiac and vascular (n = 18, 15%).

Unexpected findings were seen in 120 examinations (30%)—most commonly seen in single cardiac exams (n = 52), followed by combined cardiac and thoracic (n = 13), single thoracic (n = 13), and combined cardiac and abdominal exams (n = 12). Patient care plan changed in 227 cases (57%) after CCUS examinations—95 (49%) among the single cardiac, 35 (70%) among single thoracic, and 21 (64%) among single abdominal. Median (IQR) confidence level on image acquisition was 8 (7–9) on a 10-point Likert scale. Median (IQR) confidence level on image interpretation was 8 (7–9). CCUS examination increased subjective confidence levels in patient care of 382 cases (96%).

Discussion

Our study demonstrated that critical care medicine fellows have significantly improved CCUS proficiency in image acquisition and interpretation after a 6-month training intervention. This finding supports the effectiveness of the ultrasonography education program at our institution. However, no additional advantage was observed in IT group participants, who took an additional 8-h refresher training compared with the ST group. Many CCUS examinations were performed by fellows directly involved in the care of critically ill patients, which led to identification of unexpected findings, changes in patient management plans, and an increase in subjective confidence level in patient care.

This study represents the complexity of CCUS training, its optimal timing, and the contents of its reinforcement. Important for maximally effective training, a training program needs to be an integrated process rather than a discrete training opportunity [34,35,36]. A learning experience is maximized when the process is longitudinal, consisting of phases before, during, and after training [35]. We used a previously reported multimedia CCUS workshop as an initial introduction in the pretraining phase [18, 19]. This workshop was intended not only to enhance but also to standardize the learner’s baseline CCUS proficiency. The ST and IT programs were compared to pursue an optimal learning strategy during the training phase. Lastly, we conducted CCUS examination surveys to monitor learning transfer in the post-training phase.

The IT group took 8-h refresher sessions in addition to the CCUS education program outlined in our fellowship program. In general, a refresher training program is characterized by the type, frequency, and intensity of reinforcement [24]. Our refresher program was distinctive in that it was conducted in a month of MICU rotation, which occurred randomly during the study because of learners’ rotation schedules. Our study did not show a statistically significant difference in learner improvement between the ST and IT groups. However, it is difficult to conclude which components of reinforcement (type, frequency, and intensity) can be modified to further improve CCUS proficiency significantly beyond the level already attained through the fellowship education curriculum. Many academic societies have published training and practice guidelines on CCUS; those guidelines define CCUS education frameworks, such as the duration of the training and/or the number of proctored examinations to attain CCUS proficiency [7, 8, 13, 16, 37,38,39,40]. However, the methods to build a specific strategy to achieve those goals and incorporate it into the existing training curriculum are left to the discretion of each residency or fellowship training program. This is likely because every training program has a unique educational background with different teaching priorities. The literature remains scarce on the optimal components of CCUS education reinforcement, and the list of potential revisions is endless. Yet, we believe that the lessons learned from this study still remain valid and relevant to the current landscape of CCUS education, despite its rapidly evolving clinical practice over the last decade. This study revealed challenges in further enhancing a level of an existing education program and serves as a valuable resource to educators and learners who strive to improve CCUS education in a limited training period and finite resources.

Although we used a newly developed CCUS proficiency test as a surrogate to measure training effectiveness, the final goal of CCUS training is the use of CCUS examination in patient care. Through our study, we intended to observe learning transfer—to learn the extent of training that can be transferred to clinical work beyond 6 months of training strategy comparison. During 2 years of observation, 580 CCUS examinations (excluding central line insertion) were performed by critical care medicine fellows. CCUS resulted in a change of more than 50% in patient management plans, which is comparable to previous studies demonstrating 18% to 67% change in physicians’ management plans [41,42,43]. We do not have institutional data on the exact number of CCUS examinations before our study. However, given that most participants were novice learners of CCUS, this result suggests that our educational efforts successfully led to learning transfer.

Our study has several limitations. First, as many as 34% of fellows withdrew from the study, which may have caused a selection or attrition bias among participating fellows. This suggests that only the learners eager to improve their CCUS proficiency were able to complete the postintervention CCUS test or an additional refresher training if assigned in the IT group, or both the test and the training. This detail likely affected our study results, and the effect of our refresher program may have been underestimated since participants in the ST group may have been highly motivated at baseline. Second, participating fellows were not prevented from taking an ultrasonography-elective month or participating in an educational workshop outside our institution. Furthermore, our 8-h intervention could have impacted the quality and quantity of the other self-directed learning on CCUS after the study intervention. Unfortunately, we do not have data on the hours that each learner had spent on ultrasound education outside of the intervention, which may have affected our study results. Third, the timing of our refresher program differed among participants because it was conducted at the time of the learner’s MICU month. This likely affected learner scores of a CCUS proficiency test in the IT group. Fourth, the response rate of the CCUS survey was only 69%, and possibly learners completed the survey only when CCUS findings were critical or when patient care was changed, in which cases the clinical influence of CCUS may have been overestimated. Fifth, our CCUS proficiency test was designed specifically for this study and its content has not been validated. Various assessment modalities have been published over the last decade, and it is possible that the use of a different modality in assessing the intervention effectiveness might have produced a different interpretation of our study outcomes.

In conclusion, our study demonstrated that fellows in critical care medicine improved their CCUS proficiency significantly after a 6-month training program; however, the additional 8-h refresher training did not provide further benefit. Many CCUS examinations performed by fellows led to changes in patient care plans, a detail that suggests successful learning transfer in our educational program. The optimal type, frequency, or intensity of CCUS refresher training as part of continuous education is an important yet challenging theme to pursue for CCUS educators.

Availability of data and materials

The datasets generated and/or analyzed during the current study are available from the corresponding author on reasonable request.

Abbreviations

CCUS:

Critical care ultrasonography

IT:

Intensive training

IQR:

Interquartile range

MICU:

Medical intensive care unit

SD:

Standard deviation

ST:

Standard training

References

  1. Mayo PH, Beaulieu Y, Doelken P, et al. American College of Chest Physicians/La Societe de Reanimation de Langue Francaise statement on competence in critical care ultrasonography. Chest. 2009;135(4):1050–60.

    Article  Google Scholar 

  2. Frankel HL, Kirkpatrick AW, Elbarbary M, et al. Guidelines for the appropriate use of bedside general and cardiac ultrasonography in the evaluation of critically ill patients: Part I General ultrasonography. Crit Care Med. 2015;43(11):2479–502.

    Article  Google Scholar 

  3. Levitov A, Frankel HL, Blaivas M, et al. Guidelines for the appropriate use of bedside general and cardiac ultrasonography in the evaluation of critically Ill patients-part II: cardiac ultrasonography. Crit Care Med. 2016;44(6):1206–27.

    Article  Google Scholar 

  4. Kanji HD, McCallum JL, Bhagirath KM, Neitzel AS. Curriculum development and evaluation of a hemodynamic critical care ultrasound: a systematic review of the literature. Crit Care Med. 2016;44(8):e742–50.

    Article  Google Scholar 

  5. Weiner RB, Wang F, Hutter AM Jr, et al. The feasibility, diagnostic yield, and learning curve of portable echocardiography for out-of-hospital cardiovascular disease screening. J Am Soc Echocardiogr. 2012;25(5):568–75.

    Article  Google Scholar 

  6. Carrie C, Biais M, Lafitte S, Grenier N, Revel P, Janvier G. Goal-directed ultrasound in emergency medicine: evaluation of a specific training program using an ultrasonic stethoscope. Eur J Emerg Med. 2015;22(6):419–25.

    Article  Google Scholar 

  7. Fagley RE, Haney MF, Beraud AS, et al. Society of Critical Care Anesthesiologists. critical care basic ultrasound learning goals for American anesthesiology critical care trainees: recommendations from an expert group. Anesth Analg. 2015;120(5):1041–53.

    Article  Google Scholar 

  8. Price S, Via G, Sloth E, et al. World Interactive Network Focused On Critical UltraSound Echo- ICU Group 2008 Echocardiography practice, training and accreditation in the intensive care: document for the World Interactive Network Focused on Critical Ultrasound (WINFOCUS). Cardiovasc Ultrasound. 2008;6:49.

  9. Schnobrich DJ, Gladding S, Olson AP, Duran-Nelson A. Point-of-care ultrasound in internal medicine: a national survey of educational leadership. J Grad Med Educ. 2013;5(3):498–502.

    Article  Google Scholar 

  10. Geria RN, Raio CC, Tayal V. Point-of-care ultrasound: not a stethoscope, a separate clinical entity. J Ultrasound Med. 2015;34(1):172–3.

    Article  Google Scholar 

  11. Schnobrich DJ, Olson AP, Broccard A, Duran-Nelson A. Feasibility and acceptability of a structured curriculum in teaching procedural and basic diagnostic ultrasound skills to internal medicine residents. J Grad Med Educ. 2013;5(3):493–7.

    Article  Google Scholar 

  12. Solomon SD, Saldana F. Point-of-care ultrasound in medical education: stop listening and look. N Engl J Med. 2014;370(12):1083–5.

    Article  Google Scholar 

  13. Via G, Hussain A, Wells M, International Liaison Committee on Focused Cardiac UltraSound, International Conference on Focused Cardiac UltraSound, et al. International evidence-based recommendations for focused cardiac ultrasound. J Am Soc Echocardiogr. 2014;27(7):683.

    Article  Google Scholar 

  14. Spencer KT, Kimura BJ, Korcarz CE, Pellikka PA, Rahko PS, Siegel RJ. Focused cardiac ultrasound: recommendations from the American Society of Echocardiography. J Am Soc Echocardiogr. 2013;26(6):567–81.

    Article  Google Scholar 

  15. Marin JR, Lewiss RE. Point-of-care ultrasonography by pediatric emergency medicine physicians. Pediatr Emerg Care. 2015;31(7):525.

    Article  Google Scholar 

  16. Ayuela Azcarate JM, Clau-Terre F, Vicho Pereira R, et al. Grupo de Trabajo de Cuidados Intensivos Cardiologicos y RCP de la Semicyuc. [Consensus document on ultrasound training in Intensive Care Medicine. Care process, use of the technique and acquisition of professional skills]. [Article in Spanish] Med Intensiva. 2014;38(1):33–40. https://doi.org/10.1016/j.medin.2013.07.003. Epub 2013 Dec 4.

  17. American Institute of Ultrasound in Medicine, American College of Emergency Physicians. AIUM practice guideline for the performance of the focused assessment with sonography for trauma (FAST) examination. J Ultrasound Med. 2014;33(11):2047–56.

    Article  Google Scholar 

  18. Sekiguchi H, Suzuki J, Gharacholou SM, et al. A novel multimedia workshop on portable cardiac critical care ultrasonography: a practical option for the busy intensivist. Anaesth Intensive Care. 2012;40(5):838–43.

    Article  Google Scholar 

  19. Sekiguchi H, Bhagra A, Gajic O, Kashani KB. A general critical care ultrasonography workshop: results of a novel web-based learning program combined with simulation-based hands-on training. J Crit Care. 2013;28(2):217.

    Article  Google Scholar 

  20. Chalumeau-Lemoine L, Baudel JL, Das V, et al. Results of short-term training of naive physicians in focused general ultrasonography in an intensive-care unit. Intensive Care Med. 2009;35(10):1767–71.

    Article  Google Scholar 

  21. Melamed R, Sprenkle MD, Ulstad VK, Herzog CA, Leatherman JW. Assessment of left ventricular function by intensivists using hand-held echocardiography. Chest. 2009;135(6):1416–20.

    Article  Google Scholar 

  22. Vignon P, Mucke F, Bellec F, et al. Basic critical care echocardiography: validation of a curriculum dedicated to noncardiologist residents. Crit Care Med. 2011;39(4):636–42.

    Article  Google Scholar 

  23. Smith KK, Gilcreast D, Pierce K. Evaluation of staff’s retention of ACLS and BLS skills. Resuscitation. 2008;78(1):59–65.

    Article  Google Scholar 

  24. Stross JK. Maintaining competency in advanced cardiac life support skills. JAMA. 1983;249(24):3339–41.

    Article  Google Scholar 

  25. Woollard M, Whitfield R, Newcombe RG, Colquhoun M, Vetter N, Chamberlain D. Optimal refresher training intervals for AED and CPR skills: a randomised controlled trial. Resuscitation. 2006;71(2):237–47.

    Article  Google Scholar 

  26. Nishiyama C, Iwami T, Murakami Y, et al. Effectiveness of simplified 15-min refresher BLS training program: a randomized controlled trial. Resuscitation. 2015;90:56–60.

    Article  Google Scholar 

  27. Monsieurs KG, De Regge M, Schelfout S, et al. Efficacy of a self-learning station for basic life support refresher training in a hospital: a randomized controlled trial. Eur J Emerg Med. 2012;19(4):214–9.

    Article  Google Scholar 

  28. De Regge M, Calle PA, De Paepe P, Monsieurs KG. Basic life support refresher training of nurses: individual training and group training are equally effective. Resuscitation. 2008;79(2):283–7.

    Article  Google Scholar 

  29. O’Steen DS, Kee CC, Minick MP. The retention of advanced cardiac life support knowledge among registered nurses. J Nurs Staff Dev. 1996;12(2):66–72.

    Google Scholar 

  30. Kimura BJ, Sliman SM, Waalen J, Amundson SA, Shaw DJ. Retention of ultrasound skills and training in “point-of-care” cardiac ultrasound. J Am Soc Echocardiogr. 2016;29(10):992–7.

    Article  Google Scholar 

  31. Rappaport CA, McConomy BC, Amold NR, Vose AT, Schmidt GA, Nassar B. A prospective analysis of motor and cognitive skill retention in novice learners of point of care ultrasound. Crit Care Med. 2019;47(12):e948–52.

    Article  Google Scholar 

  32. Turner EE, Fox JC, Rosen M, Allen A, Rosen S, Anderson C. Implementation and assessment of a curriculum for bedside ultrasound training. J Ultrasound Med. 2015;34(5):823–8.

    Article  Google Scholar 

  33. Beraud AS, Rizk NW, Pearl RG, Liang DH, Patterson AJ. Focused transthoracic echocardiography during critical care medicine training: curriculum implementation and evaluation of proficiency. Crit Care Med. 2013;41(8):e179–81.

    Article  Google Scholar 

  34. Salas E, Tannenbaum SI, Kraiger K, Smith-Jentsch KA. The science of training and development in organizations: what matters in practice. Psychol Sci Public Interest. 2012;13(2):74–101.

    Article  Google Scholar 

  35. Salas E, Cannon-Bowers JA. The science of training: a decade of progress. Annu Rev Psychol. 2001;52:471–99.

    Article  Google Scholar 

  36. Aguinis H, Kraiger K. Benefits of training and development for individuals and teams, organizations, and society. Annu Rev Psychol. 2009;60:451–74.

    Article  Google Scholar 

  37. Neskovic AN, Edvardsen T, Galderisi M, et al. Focus cardiac ultrasound: the European Association of Cardiovascular Imaging viewpoint. Eur Heart J Cardiovasc Imaging. 2014;15(9):956–60. https://doi.org/10.1093/ehjci/jeu081.

    Article  Google Scholar 

  38. Expert Round Table on Echocardiography in ICU. International consensus statement on training standards for advanced critical care echocardiography. Intensive Care Med. 2014;40(5):654–66. https://doi.org/10.1007/s00134-014-3228-5.

    Article  Google Scholar 

  39. Dietrich CF, Goudie A, Chiorean L, et al. Point of Care Ultrasound: A WFUMB Position Paper. Ultrasound Med Biol. Jul 26 2016;doi:https://doi.org/10.1016/j.ultrasmedbio.2016.06.021

  40. Wong A, Galarza L, Forni L, et al. Recommendations for core critical care ultrasound competencies as a part of specialist training in multidisciplinary intensive care: a framework proposed by the European Society of Intensive Care Medicine (ESICM). Crit Care. 2020;24(1):393. https://doi.org/10.1186/s13054-020-03099-8.

    Article  Google Scholar 

  41. Arntfield R, Pace J, Hewak M, Thompson D. Focused transesophageal echocardiography by emergency physicians is feasible and clinically influential: observational results from a novel ultrasound program. J Emerg Med. 2016;50(2):286–94.

    Article  Google Scholar 

  42. Xirouchaki N, Kondili E, Prinianakis G, Malliotakis P, Georgopoulos D. Impact of lung ultrasound on clinical decision making in critically ill patients. Intensive Care Med. 2014;40(1):57–65. https://doi.org/10.1007/s00134-013-3133-3. Epub 2013 Oct 25.

  43. Manno E, Navarra M, Faccio L, et al. Deep impact of ultrasound in the intensive care unit: the “ICU-sound” protocol. Anesthesiology. 2012;117(4):801–9.

    Article  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

This publication was made possible by funding from the Mayo Clinic Lucille Nelson Clinician Career Development Award.

Author information

Authors and Affiliations

  1. Division of Pulmonary and Critical Care Medicine, Mayo Clinic, Rochester, MN, 55905, USA

    Reina Suzuki, Mio Kanai, Kazumasa Oya, Yohei Harada, Ryohei Horie & Hiroshi Sekiguchi

  2. Department of Critical Care Medicine, Mayo Clinic, Phoenix, AZ, 85054, USA

    Reina Suzuki & Hiroshi Sekiguchi

Authors
  1. Reina Suzuki
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Mio Kanai
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Kazumasa Oya
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Yohei Harada
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Ryohei Horie
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Hiroshi Sekiguchi
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

RS evaluated the data of skill test, analyzed the data, and wrote the manuscript. MK and RH assisted in conducting the knowledge test and the skill test implementation. RH, YH, and KO contributed to study designing with support from HS. HS designed the study, evaluated the skill test data, and finalized the manuscript. The author(s) read and approved the final manuscript.

Corresponding author

Correspondence to Hiroshi Sekiguchi.

Ethics declarations

Ethics approval and consent to participate

The Mayo Clinic Institutional Review Board approved the study (study ID 12–005095). All the methods were carried out in accordance with the guidelines and regulations by the Mayo Clinic Institutional Review Board. Written informed consent for study participation including videotaping was obtained from each participant at the multi-media CCUS workshop conducted in July 2012 and July 2013. Oral consent for videotaping proficiency skill test session was obtained from the examinee at each test session.

Consent for publication

Not applicable.

Competing interests

The authors have no competing interests to declare.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

Skill Portion of the Critical Care Ultrasonography (CCUS) Proficiency Test.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Suzuki, R., Kanai, M., Oya, K. et al. A prospective randomized study to compare standard versus intensive training strategies on long-term improvement in critical care ultrasonography proficiency. BMC Med Educ 22, 732 (2022). https://doi.org/10.1186/s12909-022-03780-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-022-03780-2

Keywords

BMC Medical Education

ISSN: 1472-6920

Contact us