Skills acquisition for novice learners after a point-of-care ultrasound course: does clinical rank matter?
BMC Medical Education volume 18, Article number: 202 (2018)
Few studies have compared the effectiveness of brief training courses on point-of-care ultrasound (POCUS) skill acquisition of novice attending physicians vs. trainees. The purpose of this study was to evaluate the change in POCUS image interpretation skills and confidence of novice attending physicians vs. trainees after a 1-day POCUS training course.
A 1-day POCUS training course was held in March 2017 in Japan. A standardized training curriculum was developed that included online education, live lectures, and hands-on training. The pre-course assessment tools included a written examination to evaluate baseline knowledge and image interpretation skills, and a physician survey to assess confidence in performing specific ultrasound applications. The same assessment tools were administered post-course, along with a course evaluation. All learners were novices and were categorized as trainees or attending physicians. Data were analyzed using two-way analysis of variance.
In total, 60 learners attended the course, and 51 learners (85%) completed all tests and surveys. The 51 novice learners included 29 trainees (4 medical students, 9 PGY 1–2 residents, 16 PGY 3–5 residents) and 22 attending physicians (6 PGY 6–10 physicians, and 16 physicians PGY 11 and higher). The mean pre- and post-course test scores of novice trainees improved from 65.5 to 83.9% while novice attending physicians improved from 66.7 to 81.5% (p < 0.001). The post-course physician confidence scores in using ultrasound significantly increased in all skill categories for both groups. Both trainees and attending physicians demonstrated similar improvement in their post-course test scores and confidence with no statistically significant differences between the groups. The course evaluation scores for overall satisfaction and satisfaction with faculty members’ teaching skills were 4.5 and 4.6 on a 5-point scale, respectively.
Both novice trainees and attending physicians showed similar improvement in point-of-care ultrasound image interpretation skills and confidence after a brief training course. Although separate training courses have traditionally been developed for attending physicians and trainees, novice learners of point-of-care ultrasound may acquire skills at similar rates, regardless of their ranking as an attending physician or trainee. Future studies are needed to compare the effectiveness of short training courses on image acquisition skills and determine the ideal course design.
Point-of-care ultrasound (POCUS) is defined as ultrasonography at the patient’s bedside that is performed in real-time by a physician caring for the patient . In contrast to traditional comprehensive ultrasound examinations that involve multiple providers and steps, diagnostic POCUS examinations involve the same physician determining the need for a focused examination, acquiring and interpreting the images, and incorporating the findings into the immediate management of the patient. POCUS use has been increasing in emergency medicine, critical care medicine, and internal medicine over the past two decades [1,2,3,4,5,6,7].
Multiple studies have demonstrated the effectiveness of POCUS training courses on knowledge and skills acquisition by different learner groups. These courses have varied in duration, content, delivery, and target audience [7, 8, 12]. Traditionally, POCUS training courses, similar to other medical courses, have targeted specific learner groups with similar levels of clinical experience, such as medical students, residents, fellows, and attending physicians. POCUS training, however, challenges this traditional training paradigm for a couple of reasons. First, POCUS use is relatively new in patient care, and most attending physicians have not yet received any POCUS training. Second, POCUS training has not yet been universally nor uniformly incorporated into undergraduate and graduate medical education [9,10,11]. Thus, medical students, residents, and fellows are graduating with varying levels of POCUS experience. Therefore, given the paucity of trained physicians, most POCUS training courses are geared toward novice learners, and currently, novice learners range from new medical students to experienced attending physicians.
Even though POCUS ultrasound training courses have been proven to be effective, [7, 8, 12] the effect of the same POCUS training course on skill acquisition of novice learners with different levels of clinical experience, namely trainees versus attending physicians, has not been compared. If both novice trainees and attending physicians can acquire a similar level of POCUS knowledge and skills after participating in the same beginner course, then novice trainees and attending physicians can learn side-by-side and POCUS training expenditures can be conserved. The purpose of this study was to examine the effect of the same POCUS training course on skill acquisition and confidence of novice trainees compared to novice attending physicians.
As a preparatory step, a 2-day train-the-trainer course was conducted in November 2016 to standardize the educational curriculum for a future POCUS training course in March 2017. The train-the-trainer course curriculum was based on the principles shown to be effective for POCUS skills training [13,14,15]. The train-the-trainer session was led by two expert POCUS faculty from the United States. POCUS faculty were recruited from different parts of Japan based on their prior experience in teaching ultrasound and recognition as experts at their institutions. The train-the-trainer course allowed faculty an opportunity to practice, discuss, and agree upon standard techniques to teach each POCUS examination. At the conclusion of the train-the-trainer course, each faculty member’s POCUS hands-on skills were assessed to ensure standardization of skills. From November 2016 until March 2017, faculty engaged in internet-based discussions about different POCUS applications. In March 2017, a one-day review course was held just before the actual POCUS course to ensure all faculty had a clear understanding of the teaching points and techniques for each POCUS examination.
The same twelve POCUS faculty that participated in the train-the-trainer course in November 2016 served as the faculty for a 1-day POCUS training course in March 2017 at the 14th Japanese Society of Hospital General Medicine Semi-Annual Meeting. The 1-day POCUS course was a separate session from the main conference and the enrollment cap was 60 participants. The 1-day POCUS course was geared toward novices learners and included pre-course internet-based modules, live lectures (3.5 h), and hands-on skills training with live models (1.5 h) (Fig. 1). Pre- and post-course written tests to evaluate learners’ POCUS knowledge and image interpretation skills were administered (Additional file 1) . Learners also completed a pre- and post-course self-evaluation survey to assess their confidence in performing POCUS examinations using a five-point Likert scale (Additional file 2). Learners’ satisfaction with the training course was assessed using a post-course evaluation (Additional file 3).
The study protocol was approved by the Institutional Review Board of the Tokyo Bay Urayasu Ichikawa Medical Center. Written informed consent was obtained from all study subjects before participation.
The 1-day POCUS training course included six hands-on sessions. Each session took 15 min (1.5 h in total) and included three focused cardiac ultrasound (FOCUS) sessions, and one session each for deep vein thrombosis, lung/diaphragm, and abdominal ultrasound. The faculty-to-learner ratio was 1:3 during these hands-on sessions. Learning objectives were displayed, and faculty used standardized printed materials as teaching aids at each station (Table 1). Three course directors monitored all stations to ensure standard delivery of educational content by faculty.
Novice POCUS users were recruited to participate in the 1-day POCUS training course through marketing materials for the main conference of the Japanese Society of Hospital General Medicine. All conference attendees could participate but pre-registration was required. Subjects included senior medical students in their fifth or sixth year, residents, and attending physicians from different hospitals across Japan. All attending physicians were either trained in internal medicine or emergency medicine in Japan.
Learners completed a pre-course written examination and self-evaluation survey at the start and conclusion of the 1-day course. They also completed a post-course satisfaction survey prior to departing from the course. The written examination was modeled after similar examinations utilized by national professional society courses offered in the United States. All questions were presented in Japanese. The faculty teaching the hands-on skills were blinded to the written examination. Data were collected using printed materials, and answer sheets were collected at the conclusion of the pre- and post-course testing sessions.
We divided learners into two groups: trainees and attending physicians. In Japan, after completing medical school, graduates must participate in the two-year National Obligatory Initial Postgraduate Clinical Training Program [16, 17]. Afterwards, physicians participate in a minimum of 3 years of residency training to become board-certified in a specialty. Thus, a minimum of 5 years of postgraduate training is needed before becoming an attending physician. Therefore, we defined the trainee learner group as students and residents that were in the postgraduate years (PGY) 1–5. The attending physician learner group consisted of physicians who were PGY 6 and higher.
Written examination and self-evaluation survey scores were analyzed with two-way analysis of variance (ANOVA). We analyzed differences in examination and survey scores between the trainees and attending physicians. Data analyses were performed using R statistical software (R version 3.1.3.)
In total, 60 learners attended the course, and 51 learners (85%) completed all tests and surveys. The 51 novice learners included 29 trainees (four medical students, nine PGY 1–2 residents, 16 PGY 3–5 residents) and 22 attending physicians (six PGY 6–10 physicians, and 16 physicians PGY11 and higher) (Table 2). All participants were novices and had never received any POCUS training.
Image interpretation skills
The mean pre- and post-course written examination scores for all learners were 66.0% (standard deviation [SD] 12.9) and 82.8% (SD 9.0), respectively. The mean pre-course examination scores of trainees vs. attending physicians were 65.5% (SD 13.0) and 66.7 (SD 13.0), respectively. The mean post-course examinations scores of trainees vs. attending physicians were 83.9% (SD 9.0) and 81.5% (SD 9.0), respectively. Post-course examination scores were significantly improved compared with pre-course examination scores in both groups (p < 0.001). However, there was no statistically significant difference between the pre-course examination scores (p = 0.80) nor the post-course examination scores (p = 0.43) between trainees vs. attending physicians. Descriptive statistics and an ANOVA table of the examination scores for each application are shown in Additional file 4. Figure 2 shows a box plot of test results.
The mean confidence scores for all learners in the pre-course vs. post-course self-evaluation surveys were: general ultrasound skills, 2.37 (SD 0.90) vs. 3.32 (SD 0.71); focused cardiac ultrasound, 2.56 (SD 0.84) vs. 3.60 (SD 0.71); vascular diagnostics, 1.94 (SD 0.90) vs. 3.55 (SD 0.70); lung/diaphragm ultrasound, 1.77 (SD 0.76) vs. 3.30 (SD 0.70); and abdominal ultrasound, 2.95 (SD 0.97) vs 3.81 (SD 0.75). Post-course confidence scores were significantly higher compared with pre-course scores in all categories for both groups (p < 0.001). However, there were no significant differences in improvement of post-course confidence scores between the trainees vs. attending physicians in all categories (general ultrasound skills, p = 0.60; focused cardiac ultrasound, p = 0.68; vascular, p = 0.74, lung/diaphragm, p = 0.42; abdomen, p = 0.32). The pre- and post-course self-evaluation survey results are shown in Additional files 5 and 6. Figure 3 shows a box plot of self-evaluation survey results for trainees vs. attending physicians.
The course evaluation scores for overall satisfaction, satisfaction with faculty members’ teaching skills, and satisfaction with time management were 4.5, 4.6, and 3.7 on a 5-point scale, respectively.
Our study has three key findings. First, both novice trainees and novice attending physicians demonstrated similar improvement in POCUS knowledge, image interpretation skills, and confidence after a brief training course. Second, although shorter than other courses, a 1-day POCUS course is effective in improving POCUS skills of novice learners. Finally, we have identified a need to develop standardized POCUS training curricula for both trainees and attending physicians throughout Japan.
After physicians have access to a portable ultrasound machine, lack of training is the greatest barrier to POCUS use in clinical practice, especially for attending physicians [18,19,20,21,22]. However, it is unknown how to effectively train novice users of POCUS. Traditionally, POCUS training courses have been taught separately for trainees and attending physicians. But our study challenges this traditional training paradigm because both novice trainees and attending physicians had similar uptake of POCUS skills after participating in the same training course. Perhaps, categorizing POCUS learners by their baseline POCUS skill level, rather than their clinical ranking, is more important when designing POCUS training courses. Further, because integration of POCUS in undergraduate and graduate medical educational curricula has increased in recent years, [23, 24] it is possible that medical students and residents facile in POCUS could teach novice attending physicians the fundamentals of POCUS,  similar to peer-to-peer POCUS training that has been previously described among medical students [26,27,28,29].
The optimal duration of POCUS training courses for novice attending physicians has not been well studied. Most POCUS training courses offered by medical professional societies are typically 2 or 3 days in duration. A 3-day course offered by the American College of Chest Physicians has demonstrated improvement in POCUS knowledge, image interpretation skills, and image acquisition skills . Our study is the first to demonstrate that a focused 1-day POCUS course can improve POCUS knowledge and image interpretation skills of novice attending physicians, particularly those specializing in internal medicine. For training internal medicine attending physicians, there is only one previously published study describing a 10-week institutional training program that demonstrated improvement in POCUS knowledge, image interpretation skills, and confidence.
Given the relatively low pre-course examination and confidence scores, we have identified a need to develop standardized POCUS curricula to train both trainees and attending physicians in Japan. Most primary care and subspecialty physicians in Japan have access to an ultrasound machine and can perform ultrasound examinations on their patients with minimal opposition from physicians specializing in diagnostic imaging. However, despite this favorable environment for POCUS use, no standardized POCUS training curricula have been developed for trainees or attending physicians in Japan. Therefore, to fill this important educational gap, POCUS training curricula need to be developed and integrated into undergraduate and graduate medical education for trainees, and offered as continuing medical education for attending physicians in Japan.
Our study has some limitations. We evaluated the change in learners’ POCUS image interpretation skills and confidence; however, we did not directly evaluate their image acquisition skills. Although the learners’ confidence in POCUS skills improved significantly in each category, it is not known whether or not this improvement correlates with actual improvement in image acquisition skills. Second, even though an improvement in POCUS skills was demonstrated, our sample size was small because our results are from a single training course. We recognize that our findings need to be validated using data from future courses. Additionally, a power calculation was not performed a priori, and the number of course participants was limited by the availability of instructors, equipment, and space. Last, we did not compare our 1-day POCUS training course to other courses of different lengths, such as the half-day point-of-care ultrasound pre-course offered by the Society of Hospital Medicine or the 3-day course offered by the American College of Chest Physicians [8, 30]. Therefore, although our results indicate improvement after a 1-day course, the ideal course length to maximize efficiency of POCUS skill acquisition is unknown.
Both novice trainees and attending physicians showed similar improvement in point-of-care ultrasound image interpretation skills and confidence after a brief training course. Although separate training courses have traditionally been developed for attending physicians and trainees, novice learners of point-of-care ultrasound may acquire skills at similar rates, regardless of their clinical ranking as an attending physician or trainee. Future studies are needed to compare the effectiveness of short training courses on point-of-care ultrasound skills and determine the ideal course duration.
Two-way analysis of variance
Focused cardiac ultrasound
Point of care ultrasound
Moore CL, Copel JA. Point-of-care ultrasonography. The N Engl J Med. 2011;364(8):749–57.
Soni NJ, Lucas BP. Diagnostic point-of-care ultrasound for hospitalists. J Hosp Med. 2015;10(2):120–4.
Blanco P, Volpicelli G. Common pitfalls in point-of-care ultrasound: a practical guide for emergency and critical care physicians. Crit Ultrasound J. 2016;8(1):15.
Frankel HL, Kirkpatrick AW, Elbarbary M, Blaivas M, Desai H, Evans D, Summerfield DT, Slonim A, Breitkreutz R, Price S, et al. Guidelines for the appropriate use of bedside general and cardiac ultrasonography in the evaluation of critically ill patients-part I: general ultrasonography. Crit Care Med. 2015;43(11):2479–502.
Blanco P. Physical examination along with point-of-care echocardiography: an indisputable right path. Am J Emerg Med. 2016;34(3):673.
Kameda T, Taniguchi N. Overview of point-of-care abdominal ultrasound in emergency and critical care. J Intensive Care. 2016;4:53.
Maw A, Jalali C, Jannat-Khah D, Gudi K, Logio L, Evans A, Anderson S, Smith J. Faculty development in point of care ultrasound for internists. Med Educ Online. 2016;21(1):33287.
Greenstein YY, Littauer R, Narasimhan M, Mayo PH, Koenig SJ. Effectiveness of a critical care ultrasonography course. Chest. 2017;151(1):34–40.
Bahner DP, Adkins EJ, Hughes D, Barrie M, Boulger CT, Royall NA. Integrated medical school ultrasound: development of an ultrasound vertical curriculum. Crit Ultrasound J. 2013;5(1):6.
Feilchenfeld Z, Dornan T, Whitehead C, Kuper A. Ultrasound in undergraduate medical education: a systematic and critical review. Med Educ. 2017;51(4):366–78.
Rempell JS, Saldana F, DiSalvo D, Kumar N, Stone MB, Chan W, Luz J, Noble VE, Liteplo A, Kimberly H, et al. Pilot point-of-care ultrasound curriculum at Harvard Medical School: early experience. West J Emerg Med. 2016;17(6):734–40.
Alba GA, Kelmenson DA, Noble VE, Murray AF, Currier PF. Faculty staff-guided versus self-guided ultrasound training for internal medicine residents. Med Educ. 2013;47(11):1099–108.
Lewiss RE, Hoffmann B, Beaulieu Y, Phelan MB. Point-of-care ultrasound education: the increasing role of simulation and multimedia resources. Journal of ultrasound in medicine: J Ultrasound Med. 2014;33(1):27–32.
Breitkreutz R, Uddin S, Steiger H, Ilper H, Steche M, Walcher F, Via G, Price S. Focused echocardiography entry level: new concept of a 1-day training course. Minerva Anestesiol. 2009;75(5):285–92.
Price S, Via G, Sloth E, Guarracino F, Breitkreutz R, Catena E, Talmor D. Echocardiography practice, training and accreditation in the intensive care: document for the world interactive network focused on critical ultrasound (WINFOCUS). Cardiovasc Ultrasound. 2008;6:49.
Yoshimura H, Kitazono H, Fujitani S, Machi J, Saiki T, Suzuki Y, Ponnamperuma G. Past-behavioural versus situational questions in a postgraduate admissions multiple mini-interview: a reliability and acceptability comparison. BMC Med Educ. 2015;15:75.
Kozu T. Medical education in Japan. Academic medicine: J Assoc Am Med Coll. 2006;81(12):1069–75.
Ailon J, Mourad O, Nadjafi M, Cavalcanti R. Point-of-care ultrasound as a competency for general internists: a survey of internal medicine training programs in Canada. Can Med Educ J. 2016;7(2):e51–69.
Eisen LA, Leung S, Gallagher AE, Kvetan V. Barriers to ultrasound training in critical care medicine fellowships: a survey of program directors. Crit Care Med. 2010;38(10):1978–83.
Buchanan MS, Backlund B, Liao MM, Sun J, Cydulka RK, Smith-Coggins R, Kendall J. Use of ultrasound guidance for central venous catheter placement: survey from the American Board of Emergency Medicine Longitudinal Study of emergency physicians. Acad Emerg Med: official journal of the Society for Academic Emergency Medicine. 2014;21(4):416–21.
Soni NJ, Reyes LF, Keyt H, Arango A, Gelfond JA, Peters JI, Levine SM, Adams SG, Restrepo MI. Use of ultrasound guidance for central venous catheterization: a national survey of intensivists and hospitalists. J Crit Care. 2016;36:277–83.
Stowell JR, Kessler R, Lewiss RE, Barjaktarevic I, Bhattarai B, Ayutyanont N, Kendall JL. Critical care ultrasound: a national survey across specialties. J Clin Ultrasound. 2018;46(3):167–77.
Dinh VA, Dukes WS, Prigge J, Avila M. Ultrasound integration in undergraduate medical education: comparison of ultrasound proficiency between trained and untrained medical students. J Ultrasound Med: official journal of the American Institute of Ultrasound in Medicine. 2015;34(10):1819–24.
Schnobrich DJ, Gladding S, Olson AP, Duran-Nelson A. Point-of-care ultrasound in internal medicine: a National Survey of educational leadership. J Grad Med Educ. 2013;5(3):498–502.
Lee JB, Tse C, Keown T, Louthan M, Gabriel C, Anshus A, Hasjim B, Lee K, Kim E, Yu L, et al. Evaluation of a point of care ultrasound curriculum for Indonesian physicians taught by first-year medical students. World J Emerg Med. 2017;8(4):281–6.
Garcia-Casasola G, Sanchez FJ, Luordo D, Zapata DF, Frias MC, Garrido VV, Martinez JV, de la Sotilla AF, Rojo JM, Macho JT. Basic abdominal point-of-care ultrasound training in the undergraduate: students as mentors. J Ultrasound Med: official journal of the American Institute of Ultrasound in Medicine. 2016;35(11):2483–9.
Garcia de Casasola Sanchez G, Gonzalez Peinado D, Sanchez Gollarte A, Munoz Aceituno E, Pena Vazquez I, Torres Macho J. Teaching of clinical ultrasonography to undergraduates: students as mentors. Rev Clin Esp. 2015;215(4):211–6.
Ahn JS, French AJ, Thiessen ME, Kendall JL. Training peer instructors for a combined ultrasound/physical examination curriculum. Teach Learn Med. 2014;26(3):292–5.
Jeppesen KM, Bahner DP. Teaching bedside sonography using peer mentoring: a prospective randomized trial. J Ultrasound Med: official journal of the American Institute of Ultrasound in Medicine. 2012;31(3):455–9.
The authors wish to thank Fumio Otsuka and Hiroko Ogawa for supporting the course during the 14th Japanese Society of Hospital General Medicine Semi-Annual Meeting. The authors also wish to thank Hiraku Funakoshi, Hiroki Isono, Jun Ehara, Keita Endo, Ken Emoto, Shintaro Kosaka, Syunpei Yoshino, Tadayuki Hashimoto, Takahiko Tsutsumi, Takahiro Nada, Yuka Kitano for serving as course faculty and helping with data collection.
Nilam J. Soni: Department of Veterans Affairs, Quality Enhancement Research Initiative (QUERI) Partnered Evaluation Initiative Grant (HX002263-01A1). There was no role of the funding body in the design of the study or collection, analysis, and interpretation of data. The contents of this publication do not represent the views of the U.S. Department of Veterans Affairs or the United States Government.
Availability of data and materials
The datasets used and analyzed in this study are available from the corresponding author upon request.
Ethics approval and consent to participate
The study protocol was approved by the Institutional Review Board of the Tokyo Bay Urayasu Ichikawa Medical Center. Written informed consent was obtained from all study subjects before participation.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Pre- and post-course written examinations. (DOCX 14 kb)
Pre- and post-course physicians survey. (DOCX 17 kb)
Post-course satisfaction surveys. (DOCX 15 kb)
Descriptive statistics and an ANOVA table of the test scores for pre- and post-course written examinations. (DOCX 19 kb)
Descriptive statistics for the pre- and post-course self-evaluation survey. (DOCX 19 kb)
Analysis of variance table for pre- and post-course self-evaluation survey. (DOCX 22 kb)
About this article
Cite this article
Yamada, T., Minami, T., Soni, N.J. et al. Skills acquisition for novice learners after a point-of-care ultrasound course: does clinical rank matter?. BMC Med Educ 18, 202 (2018). https://doi.org/10.1186/s12909-018-1310-3
- Point-of-care ultrasound
- Attending physician