- Research
- Open access
- Published:
Development and evaluation of a point-of-care ultrasound curriculum for paramedics in Germany – a prospective observational study and comparison
BMC Medical Education volume 24, Article number: 811 (2024)
Abstract
Background
Point-of-care ultrasound (POCUS) is steadily growing in use in prehospital emergency medicine. While currently used primarily by emergency physicians, POCUS could also be employed by paramedics to support diagnosis and decision-making. Yet to date, no paramedicine-targeted POCUS curricula exist in Germany. Furthermore, given time and resource constraints in paramedic training, it is unclear whether paramedics could feasibly learn POCUS for prehospital deployment. Hence, this study outlines the development and implementation of a comprehensive POCUS curriculum for paramedics. Through this curriculum, we investigate whether paramedics can attain proficiency in POCUS comparable to other user groups.
Methods
In this prospective observational study, we first developed a blended learning-based POCUS curriculum specifically for paramedics, focusing on basic principles, the RUSH-Protocol and ultrasound guided procedures. Participants underwent digital tests to measure their theoretical competence before (T1) and after the digital preparation phase (T2), as well as at the end of the on-site phase (T3). At time point T3, we additionally measured practical competence using healthy subjects and simulators. We compared the theoretical competence and the practical competence on a simulator with those of physicians and medical students who had also completed ultrasound training. Furthermore, we carried out self-assessment evaluations, as well as evaluations of motivation and curriculum satisfaction.
Results
The paramedic study group comprised n = 72 participants. In the theoretical test, the group showed significant improvement between T1 and T2 (p < 0.001) and between T2 and T3 (p < 0.001). In the practical test on healthy subjects at T3, the group achieved high results (87.0% ± 5.6). In the practical test on a simulator at T3, paramedics (83.8% ± 6.6) achieved a lower result than physicians (p < 0.001), but a comparable result to medical students (p = 0.18). The results of the study group’s theoretical tests (82.9% ± 9.2) at time point T3 were comparable to that of physicians (p = 0.18) and better than that of medical students (p < 0.01). The motivation and attitude of paramedics towards the prehospital use of POCUS as well as their self-assessment significantly improved from T1 to T3 (p < 0.001). The overall assessment of the curriculum was positive (92.1 ± 8.5).
Conclusion
With our tailored curriculum, German paramedics were able to develop skills in POCUS comparable to those of other POCUS learners. Integration of POCUS into paramedics’ training curricula offers opportunities and should be further studied.
Introduction
Background
Emergency ultrasound has become integral to the diagnosis of critically ill patients [1]. In emergency situations, important clinical questions can be answered quickly based on ultrasound findings to enable targeted follow-up diagnostics and treatments [2]. Ultrasound performed and interpreted directly at the bedside is known as point-of-care ultrasound (POCUS) [3].
With technical advances in handheld ultrasound devices, POCUS is now increasingly used in prehospital emergency medicine, where it may improve patient care, especially for trauma patients [4,5,6,7]. In Germany’s physician-based emergency medical service (EMS) system, emergency physicians are making increasing use of POCUS [8,9,10,11]. POCUS training for this user group usually takes place during residency through participation in certified courses. The training curricula of these courses are based on recommendations of the relevant professional associations [8, 12]. Meanwhile, medical schools are increasingly also teaching a fundamental understanding of sonographic anatomy and POCUS skills based on national and international recommendations [13,14,15,16,17,18]. These developments have made POCUS much more accessible for emergency physicians.
By contrast, the use of POCUS by paramedics is less well-established and is the subject of current research [19,20,21,22,23]. Despite the heterogeneous definition of the term paramedic, existing studies have shown that the use of POCUS by paramedics is feasible for the most part, although the influence on patient outcomes remains uncertain [24, 25]. In Germany, paramedics lack the authorisation to perform POCUS either independently or in cooperation with emergency physicians due to a lack of equipment, training curricula, and for medico-legal reasons. However, POCUS training for paramedics would enable them to support emergency physician colleagues in critical situations. Equally, paramedics trained to use POCUS unaided could optimize decision-making in patient care without physicians [21, 22, 25, 26]. Given the ongoing debate about academization of the existing three-year paramedic training programme in Germany and the expansion of skillsets to reduce reliance on prehospital emergency physicians, training paramedics in POCUS seems extremely promising. It offers a significant possible enhancement of diagnostic procedures, healthcare system efficiency, and patient care [27].
Research question and hypothesis
Several studies have dealt with the use of POCUS by paramedics, yet only a handful have focussed on the didactic curricula required for effective implementation [23, 28,29,30]. Generally, these didactic studies centre on specific forms of sonography (e.g. e-FAST or thoracic sonography) and vary considerably in course content, scope of learning, duration of training, and didactic approach [31]. The courses developed were often not explicitly directed at the training of paramedics nor accounted for limited prior knowledge of ultrasound-related basic principles such as anatomy and physiology; instead, they mainly targeted physicians [32]. This study is therefore concerned with the development and evaluation of a target group-specific curriculum for paramedics, covering anatomy and ultrasound basics as well as practical training of different applications (e.g. eFAST, RUSH, ultrasound guided procedures). It asks whether theoretical and practical skills in POCUS can be developed through this curriculum by comparing measurable learning outcomes with those from other user groups. A further aim of the study is to ascertain curriculum satisfaction and explore the future prospects of POCUS teaching in paramedicine. The study’s primary hypothesis posits that the participants, after working through the target group-specific curriculum, will improve their theoretical and practical skills in POCUS and achieve a level of competence on par with other user groups. Additionally, we anticipate that paramedics will embrace the curriculum, exhibit high motivation and a positive attitude, and envision future prospects for integrating POCUS into their professional practice.
Materials and methods
Study procedure and endpoints
This prospective observational study took place in Mainz, Germany, from January 2022 to December 2022. After developing a comprehensive POCUS curriculum for paramedics, we measured theoretical and practical skill acquisition and acceptance of the curriculum (Fig. 1). To do this, at three time points (T1: before the start of the preparation phase, T2: at the end of the preparation phase, T3: at the end of the on-site phase) we used theoretical tests (TestT1, TestT2, TestT3), practical tests (P-SimT3, P-RUSHT3), and evaluations (EvaluationT1, EvaluationT3) [33]. With the aid of two control groups consisting of physicians and medical students, we compared theoretical and practical skills at time point T3 and analysed possible influencing factors. The primary study outcome is the significant gain in theoretical competence of paramedics and the comparability of their competence with the control groups. Secondary outcomes are the significant subjective improvement in competence, acceptance of the curriculum, high motivation, and positive attitude towards the preclinical use and future implementation of POCUS.
Recruitment and inclusion criteria
Through online advertisements, we invited paramedics throughout Germany to participate in the curriculum and the study. The inclusion criteria for the study group were completion of paramedic training, fully completing the curriculum and its assessment tools at the appropriate time points, and consent to participate in the study. The defined inclusion criteria for the control groups were full participation in the training, full completion of the assessment tools, and consent to participate in the study.
Curriculum
Curriculum development and implementation
Based on established practices in medical curriculum development, we first created a target group-specific curriculum (Fig. 1) to address the individual needs of paramedics and to deduce suitable teaching strategies [34]. The learning objectives and content (Table 1) were defined by emergency physicians, paramedics, educators, and ultrasound experts based on the paramedic training curriculum, the DEGUM [German Society of Ultrasound in Medicine and Biology] curriculum for basic training in emergency sonography, and previously published studies [28, 32, 35, 36]. The curriculum comprised a total of 25 h and was divided into a digital preparation phase (live webinar and e-learning), an on-site phase (theory units and practice units), and a digital follow-up phase (live webinar and e-learning). Key didactic elements were the use of blended learning [37], the integration of case-based learning using five case scenarios (Supplement 1), and the development and use of a structured approach to an ultrasound examination with the help of the mnemonic “iPOCUS” [38]. The individual letters stand for Indication (I), Positioning (P), Orientation (O), Correction (C), Ultrasound examination (U) and Save & Speak (S).
In the preparation phase, the participants attended a webinar, then worked through 70 short videos and 42 single-choice questions in a specially designed e-learning program. The on-site phase involved a brief repetition of basics, discussion of pathologies, and practice of the examinations at workstations (Supplement 2a). One tutor for each four participants gave instruction at the workstations using a pre-defined checklist. Each participant had at least 84 min of personal practice time on the ultrasound machine (+ 30 min of practical assessments) during the entire on-site phase (Supplement 2b). Different stationary and handheld ultrasound devices as well as an ultrasound simulator (Vimedix, CAE Healthcare, USA) were employed. For the course follow-up, participants could access the e-learning program and had the option of attending a follow-up webinar to repeat and consolidate their knowledge. The lecturers and tutors were physicians and paramedics who had practical and teaching experience in ultrasound diagnostics and training. They had received additional training in preparation for their educational activity.
Assessment tools
Evaluations
EvaluationT1 and EvaluationT3 measured baseline characteristics, prior experience, motivation and attitude, personal learning objectives, and required self-assessment. The evaluations consisted of categorical (free text, drop-down menu) and continuous items. EvaluationT3 additionally assessed participants’ satisfaction with the curriculum.
Theoretical tests
TestT1 and TestT2 were conducted in order to measure the development of theoretical competence. Each involved 30 tasks for a maximum of 66 assessment points (AP) over 45 min. The tasks involved texts, images and video clips and allowed single-choice or free-text answers on smartphones or tablets. Participants were tested on anatomy (17 AP), basic ultrasound principles (17 AP), orientation (5 AP), and structure detection (27 AP). The final TestT3 additionally contained ten tasks (40 AP) on pathology detection with a total maximum time of 60 min and 106 achievable APs (Supplement 3).
Practical tests
The practical test forms were specially developed from the Direct Observation of Procedural Skills (DOPS) test [33, 39]. We used these forms to test three focused organ examinations on an ultrasound simulator (P-SimT3, 66 AP). The assessment was based on the previously taught iPOCUS mnemonic. At least one correct indication (i), selection of the correct landmark for positioning (P), proper orientation with the transducer (O), adequate image correction with depth, gain, focus (C), thorough ultrasound examination (U) and saving of an image or clip (S) were measured. We additionally assessed the subjects’ use of a modified Rapid Ultrasound for Shock and Hypotension (RUSH) protocol on a healthy subject (P-RUSHT3, max. 315 AP, performance time 10 min; see Supplement 4) [40]. All practical tests were conducted by one examiner per participant, with a total of five practical examiners being involved in the study.
Control groups
The physician control group comprised participants from two DEGUM-certified basic ultrasound courses. The student control group consisted of two semesters of third-year medical students completing a peer-to-peer ultrasound course [41]. The course curricula used for both groups were similar to the curriculum for paramedics in terms of structure, duration, and content. Participants of both control groups underwent a baseline survey on baseline characteristics and prior experience, then completed TestT3 or P-SimT3 at the end of their courses (Supplement 5a).
Data collection and statistical methods
Data collection was carried out using the survey tool LimeSurvey (LimeSurvey GmbH, Germany) and written questionnaires. All statistical analyses were performed in Rstudio (R 4.0.3). Binary and categorical baseline variables were given as absolute numbers and percentages. Continuous data were given as median and interquartile range (IQR) or as mean and standard deviation (SD). Continuous items (Likert scales 1–7) were mathematically (using the 'min–max scale') transformed to a scale from 0 to 1 and multiplied by 100 to obtain data in per cent. The max scale was used, which means that 1 is the lowest and 100 is the highest score. Categorical variables were compared using Fisher’s exact test and continuous variables using the T-test or the Mann–Whitney U test. Additionally, parametric (ANOVA) and non-parametric (Kruskall-Wallis) analyses of variance were calculated and further explored with pairwise post hoc tests (T-test or Mann–Whitney U). Prior to the inference statistics, we conducted pairwise correlations of variables and plotted the correlations’ effect sizes and significances. Multivariate linear regression models were constructed to compare the influence of individual factors on the results of the tests. P-values < 0.05 were considered statistically significant.
Results
Baseline characteristics
In total, our analysis included data from n = 337 participants. This figure comprised the paramedic study group (n = 72) and the two control groups consisting of physicians (n = 132) and students (n = 133). The in- and exclusion process is illustrated in Supplement 5b. The mean age in the study group was 31.6 ± 9.5 (physicians: 31.8 ± 5.5, students: 24.6 ± 3.9) and 18.1% were female (physicians: 59.1%, students: 67.7%). Among the study group, 20.8% had previously attended one or more ultrasound courses (physicians: 32.6%, students: 15.0%), and 37.5% (physicians: 99.2%, students: 29.6%) reported experience of independently performing ultrasound examinations. In the study group, 65 participants (90.3%) were qualified as paramedics and seven (9.7%) were emergency medical technicians (EMTs). Supplements 6 and 7 show the detailed characteristics of the study and control groups.
Results of the subjective evaluation
The total evaluation score (Likert scale 1–7, transformed into percentages) for motivation and general attitude to the subject of POCUS in EMS was already high at the start of the training and showed further significant improvement during the training (EvaluationT1: 81.6 ± 11.5; EvaluationT3: 87.8 ± 11.4; p < 0.01) (Supplement 8). The future integration of POCUS into the training and work of paramedics garnered approval (EvaluationT3: mean 94.4). The self-assessment of personal skills was initially low but improved significantly (EvaluationT1: 29.7 ± 20.1; EvaluationT3: 70.9 ± 14.5; p < 0.01). This improvement was observed across the theoretical and practical self-assessments, and across all the sub-items queried. Furthermore, participants achieved their defined learning objectives as a result of the training (EvaluationT3: 82.0 ± 11.4). In the study group’s evaluation of the curriculum, all the items queried were rated highly (> 87.2%). Table 2 presents the assessment of the curriculum in detail.
Results of the objective tests
Competence comparison
Figure 2 and Supplement 9 show the detailed results of the competence comparison. In the total score for the theoretical TestT3, paramedics (82.9 ± 9.2) achieved a comparable result to physicians (81.0 ± 8.7; p = 0.55) without a significant difference. Paramedics achieved a significantly higher result than the group of students (76.7 ± 8.5; p < 0.001). In the practical test on the simulator (P-SimT3) all groups achieved high percentage ranges (> 80%). Paramedics (83.8 ± 6.6) achieved a significantly lower result than physicians (88.3 ± 6.1, p < 0.001), but a non-significantly different result compared to medical students (84.1 ± 6.2, p = 0.86).
Development of theoretical competence by paramedics
Figure 3 shows the development of theoretical competence in the study group over various time points. The results improved significantly (p < 0.001) over the observation period from T1 (41.3 ± 16.0) over T2 (76.5 ± 14.5) to T3 (T3: 82.7 ± 9.7). This improvement was consistent across all the individual skill areas assessed in the tests. At time point T1, results were lower than 60% in all the skill areas except anatomy. At time point T2, paramedics achieved results of at least 68%. At time point T3, the group achieved results greater than 82% in all the individual skill areas. The most substantial increase throughout the observation period occurred in the skill area of structure detection (T1: 21.5 ± 23.0; T3: 82.9 ± 14.5; p < 0.001).
Practical competence of paramedics
In the practical testing of the RUSH protocol (P-RUSHT3), paramedics achieved total score results in high percentage ranges (87.0 ± 5.6). This strong performance extended to all the tested individual sonographic views and iPOCUS skills (> 83%). The best results were achieved in the views “Lung” (91.6 ± 7.0), “Heart (subxiphoid)” (88.3 ± 8.9), and “Right Upper Quadrant (RUQ) pleural cavity” (88.4 ± 6.6). The results were lower for the tests of “Left upper quadrant (LUQ) Koller Pouch” (84.4 ± 9.6) and “Suprapubic view” (83.0 ± 12.5). Figure 4 shows the detailed results of the examinations.
Results of the practical testing P-RUSHT3. The boxplots visualize the results of a simplified RUSH protocol on a healthy subject in terms of total score (a), individual examination steps by the iPOCUS approach (b), aspects additionally assessed by the examiner (c) and the individual views (d). RUQ = right upper quadrant, LUQ = left upper quadrant. Red dot = mean
Analysis of influencing factors (regression) and correlations
In a multivariate linear regression analysis of the performance of the study group for the total score of TestT1, “prior attendance of at least one ultrasound course” was identified as a significant influencing factor for a better test result (β = 11.2; p = 0.034). We observed no significant influencing factors for the results of TestT2, TestT3 and P-SimT3. A high score in TestT3 was established as an influencing factor for a better result in P-RUSHT3 (β = 0.24; p = 0.002).
A regression model incorporating all groups and baseline characteristics tended to detect “belonging to the group of physicians” as an influencing factor for a high result in P-SimT3 (β = 3.53; p = 0.068).
The “number of prior POCUS examinations done” was a significant influencing factor for a high result in TestT3 over all groups (β = 1.02; p = 0.046). Furthermore, “belonging to the group of students” was found to be an influencing factor for a significantly worse result in TestT3 (β = -7.34; p < 0.01).
In the correlation calculations, there were moderate to strong correlations among the objective theoretical and practical performances (r = 0.3–0.43; p < 0.001). However, the subjective and objective results only correlated strongly with each other at time point T1 (r = 0.43; p < 0.01).
Discussion
This is the first prospective observational study focusing on the development and evaluation of a tailored point-of-care ultrasound curriculum for German paramedics that also compares the competence outcomes of paramedics with those of other user groups. After completing the curriculum, paramedics demonstrated proficiency in POCUS that was comparable to physicians and medical students who had also completed similar ultrasound training. Furthermore, paramedics participated in the curriculum with enthusiasm, displaying motivation and a positive attitude towards future POCUS training and application.
Relevance of the study
The significance of this study stems from its departure from previous research focussed primarily on paramedics’ direct use of POCUS on patients [19, 21, 22, 25, 29, 42,43,44,45,46,47,48,49]. Other prior studies focused on POCUS education for paramedics have relied on established curricula aimed at physicians, overlooking paramedics’ unfamiliarity and inexperience with POCUS in prehospital settings [23, 28, 30,31,32]. Since it has not yet been conclusively shown that paramedics can learn POCUS, we assumed that the achievement of proficiency can only be developed on the basis of a specific curriculum. Therefore, our study developed a tailored curriculum for paramedics, carried out a comprehensive analysis of skill acquisition, and, for the first time, compared this with other POCUS learners. This approach furnished detailed information about the development of competence among paramedics in POCUS.
Discussion of the competence comparison and competence development
Measuring the level of competence was an important endpoint in several studies published to date [23, 30]. Our study measured competence by conducting theoretical and practical tests. While other studies mainly observed and interpreted the absolute results of paramedics [23], our study managed to show that the final theoretical and practical skills were at a similar level to those of physician and medical student POCUS learners. Although the interpretation of the competence comparison is limited by the different curricula that the control groups completed, our competence comparison makes it possible to classify the results achieved by paramedics. Only one other study by Brook et al. has so far used a similar methodology, finding that paramedics achieved a higher competence level in the area of image interpretation than n = 2 ultrasound experts [50]. While the implications of Brook et al.’s results are difficult to classify, our comparative methodology, involving a significantly higher number of participants, also suggests that paramedics constitute a suitable target group for learning POCUS.
Previous studies have employed theoretical tests to demonstrate paramedics’ ability to develop theoretical skills after completing a curriculum [23, 30, 42, 50,51,52,53,54,55,56,57]. In our study, we also observed a significant development in theoretical competence, reaching a substantial level of final theoretical proficiency. While most studies conducted two measurements of theoretical competence, usually before and after completing a curriculum [30, 55, 56, 58], our study design, with a total of three assessment time points, enabled us to gain detailed information about competence development. Given the low test results observed before studying the curriculum, we can assume our study group had limited prior experience with POCUS [30]. Despite the internationally heterogeneous training and definition of “paramedics”, our initial results do coincide with those of other studies [30, 56, 57]. Furthermore, our study showed that paramedics could achieve a significant gain in theoretical competence through the digital preparation phase [30]. The final test results (approx. 83%) coincide with the results of other studies, although our study looks at a much larger population [23, 30, 56]. We can conclude that it is possible for paramedics to build up competence with a tailored POCUS curriculum, and a blended learning-based approach is appropriate in this teaching context.
In addition to theoretical tests, we also conducted practical tests in which paramedics achieved high results (approx. 87%). This finding is in line with the results of previous studies using practical testing formats [23, 29, 30, 50, 51, 54, 56, 59, 60]. While most studies used ultrasound experts to assess the image quality achieved [23, 54, 56], only a few studies used structured testing protocols. Some studies assessed image quality according to a scoring system based on an Objective Structured Clinical Examination (OSCE), though they gave no information about when participants were deemed to have passed this test or the tools used were not described in a differentiated way [29, 47, 50]. Other studies used the Cardiac Ultrasound Structural Assessment Scale (CUSAS) score, others their own checklists, and still others measured the duration of the examination [23, 54, 56, 61]. However, all observed the result alone and provided no information about the processes of the examinations or difficulties encountered. To address these limitations, we adopted an assessment system based on DOPS, which enabled us to make a differentiated observation of sub-areas of competence [33, 39]. With this approach, we observed that one of the most common errors was poor image optimization. Furthermore, paramedics demonstrated greater proficiency in examining thoracic structures (lung, heart) compared to left-sided abdominal sections and the pelvis, consistent with findings from prior studies [22, 47, 51]. Our findings underscore the need for future training to prioritize certain sub-areas, such as thoracic sonography or image optimization.
A realistic self-assessment of skills is important for the safe use of POCUS. We therefore also recorded participants’ subjective views on their theoretical and practical skills. These increased significantly over the observation period, which is in line with other studies [56]. Our study additionally showed that the subjective skills before the start of the curriculum correlated strongly with the objective skills, which suggests subjects initially assessed themselves accurately. However, this correlation was no longer observed at the end of the curriculum. This finding could be well explained by the Dunning-Kruger effect [62]. It also highlights the importance of qualitative feedback at the end of a curriculum to promote a realistic self-assessment. These results also call for a long-term assessment of participants' retention of skills (e.g. after one year), which is a commonly used methodology in ultrasound education studies [63]. Follow-up results should be related to participants' clinical exposure and self-assessment.
Our study also used regression models to obtain more information about the influence of prior knowledge. The physician study group had performed a high number of ultrasound exams prior to their course, which would be expected in a clinical setting requiring regular encounters with sonographic scans and findings as part of study and work. This prior experience had an influence on the results of the theoretical and practical tests. Prior experience also affected the other two study groups, in which subjects exhibited less familiarity with POCUS and other forms of ultrasound. We suggest that integration of POCUS into paramedic training, and a regular use of POCUS in their work environment, can help future paramedics build up and maintain a basic understanding of the technique and thereby increase their general competence level even before specific training. Within the paramedic study group, prior attendance at a POCUS training course had a positive influence on results before the start of the curriculum. At the end of the curriculum, however, this influence was no longer measurable, which is an indication of the efficacy of the tailored curriculum.
Discussion and acceptance of the developed curriculum
The high evaluation results for our curriculum indicate that the paramedic group embraced it willingly. This acceptance was also reflected in published studies that have evaluated POCUS curricula for paramedics [64, 65].
When medical curricula are being developed, appropriate content, duration, and a tailored design are essential factors for successful competence development [34]. Existing curricula for paramedics are extremely heterogeneous in terms of content and duration and are mostly based on training curricula for physicians [32]. Prior studies have concentrated on isolated aspects of POCUS (e.g. thoracic ultrasound, echocardiography, or the e-FAST protocol) for their course content, whereas we integrated several areas of application within our study. This enabled us to gain a differentiated view of the strengths and weaknesses of different POCUS aspects relevant to EMS. Furthermore, the duration of previously published curricula varied between two minutes and two months [32], with extremely brief curricula likely contributing to the failure to achieve primary endpoints in some studies [43, 44, 46, 59].
To compensate for paramedics’ lower level of prior knowledge and ultrasound experience, the duration of the curriculum in our study was extended in comparison with existing curricula [12]. Taking into account time efficiency, we incorporated a blended learning strategy [37]. This is employed with increasing frequency in ultrasound training and has already been used successfully to develop paramedics’ POCUS skills [30, 57, 65], but mostly utilizing Free Open Access Medical Education (FOAMed) content [23, 57]. The positive feedback about our blended learning approach, especially the webinar and the self-developed e-learning, highlights the future importance of this teaching strategy for paramedic ultrasound training. In this context, video-based training is a particularly good way of supporting the teaching of ultrasound skills [66, 67]. Furthermore, the use of blended learning meant that the duration of on-site sessions could be reduced to an acceptable minimum. This permitted greater focus on practical training, which is an important foundation for broad implementation in EMS [30, 57, 68, 69]. Apart from blended learning, the two remaining core didactic elements, “Case-based learning” and the “iPOCUS approach”, received positive evaluations from the participants and provided paramedics with a familiar learning atmosphere, which coincides with results from prior studies of other user groups [70].
The positive results of the evaluation and the associated acceptance of the curriculum indicate that future curricula are developed explicitly according to paramedics’ needs. This may enhance paramedics’ engagement with the learning and additionally result in standardization of the heterogeneous curricula [31, 32].
Future prospects
The high motivation and positive attitude that paramedics exhibited towards POCUS as measured in our study indicate the need for further investigation of POCUS’ role and ideal implementation in paramedicine. Primarily, studies should consider how to implement POCUS in paramedic training. In addition, existing or newly created curricula should undergo certification procedures by professional associations for the purposes of quality assurance. Future curricula should focus on consolidating practical skills through clinical attachments in emergency or ultrasound departments, and should emphasise POCUS for prehospital use, preferably under qualified supervision and with the support of studies. Pre-existing or newly created institutions or committees of professional associations should address POCUS for paramedics directly, and, in dialogue with paramedics themselves, should consider possible strategies for best implementing POCUS in paramedicine.
Limitations
This study did not include a control group without intervention, which is why randomization was not possible. Interpretation of the competence comparison is limited by the non-uniform curricula which the control groups had undergone. In addition, the practical competences between the groups were tested on a simulator, which increases comparability, but only allows limited conclusions to be drawn about the actual POCUS competence of the groups on humans. Furthermore, the practical application within the study group was only tested on healthy volunteers under training conditions, which also limits the translation to real patients. We developed the measuring instruments used (tests and DOPS) on the basis of recommendations and in consultation with experts, but they were not conclusively validated. Furthermore, we cannot exclude a relevant motivation bias within the study group in view of their voluntary participation in the curriculum and the study. A lack of long-term follow-up means we cannot make any assertion about the sustainability of the skills acquisition. The very small subgroups limit our analysis of influencing factors, which is why it is only possible to assume trends. Furthermore, we cannot exclude the possibility that other factors not recorded in the study had an influence on the results. Given that we did not implement a field trial involving the use of POCUS on patients, future studies are needed to evaluate the informative value of this study with regard to safety, practicability, and transferability to real-world use on patients.
Conclusion
The results of this study deliver valuable evidence that, after completing a tailored curriculum, German paramedics can develop basic skills in POCUS that are comparable to those of other POCUS learners. These findings demand that more scientific attention be given to POCUS training for paramedics. The future implementation of ultrasound-specific teaching content in paramedic training offers opportunities to promote the inter-professional prehospital application of POCUS.
Availability of data and materials
Data cannot be shared publicly because of institutional and national data policy restrictions imposed by the Ethics committee since the data contain potentially identifying study participants’ information. Data are available upon request from the Johannes Gutenberg University Mainz Medical Center (contact via weimer@uni-mainz.de) for researchers who meet the criteria for access to confidential data (please provide the manuscript title with your enquiry).
References
Whitson MR, Mayo PH. Ultrasonography in the emergency department. Crit Care. 2016;20(1):227.
Netherton S, Milenkovic V, Taylor M, Davis PJ. Diagnostic accuracy of eFAST in the trauma patient: a systematic review and meta-analysis. CJEM. 2019;21(6):727–38.
James M, Daniels RAH. Practical point-of-care medical ultrasound. Cham: Springer International Publishing; 2016. p. 191.
von Foerster N, Radomski MA, Martin-Gill C. Prehospital ultrasound: a narrative review. Prehosp Emerg Care. 2024;28(1):1–13.
van der Weide L, Popal Z, Terra M, Schwarte LA, Ket JCF, Kooij FO, et al. Prehospital ultrasound in the management of trauma patients: systematic review of the literature. Injury. 2019;50(12):2167–75.
Gamberini L, Scquizzato T, Tartaglione M, Chiarini V, Mazzoli CA, Allegri D, et al. Diagnostic accuracy for hemoperitoneum, influence on prehospital times and time-to-definitive treatment of prehospital FAST: a systematic review and individual participant data meta-analysis. Injury. 2023;S0020-1383(23):00280–2.
Byhahn C, Bingold TM, Zwissler B, Maier M, Walcher F. Prehospital ultrasound detects pericardial tamponade in a pregnant victim of stabbing assault. Resuscitation. 2008;76(1):146–8.
Michels G, Greim CA, Krohn A, Ott M, Feuerstein D, Mockel M, et al. Recommendations for Education in Sonography in Prehospital Emergency Medicine (pPOCUS): Consensus paper of DGINA, DGAI, BAND, BV-ALRD, DGU, DIVI and DGIIN. Med Klin Intensivmed Notfmed. 2023;118(Suppl 1):39–46.
Bergmann I, Büttner B, Teut E, Jacobshagen C, Hinz J, Quintel M, et al. Pre-hospital transthoracic echocardiography for early identification of non-ST-elevation myocardial infarction in patients with acute coronary syndrome. Crit Care. 2018;22(1):29.
Weilbach C, Kobiella A, Rahe-Meyer N, Johanning K. Introduction of prehospital emergency ultrasound into an emergency medical service area. Anaesthesist. 2017;66(1):21–7.
Weimer JM, Kuhn E, Ludwig M, Malle GL, Kapipi G, Schäfer VS, et al. Effectiveness of an ultrasound basic cancer training program through on-site training and virtual case discussions in rural Tanzania: a proof-of-concept study. Ecancermedicalscience. 2024;18:18.
Osterwalder JMG. 3-Länderübergreifende Basisausbildung und Curriculum Notfallsonografie. Ultraschall Med - Eur J Ultrasound. 2011;32(02):218–20.
Dietrich CF, Hoffmann B, Abramowicz J, Badea R, Braden B, Cantisani V, et al. Medical student ultrasound education: a WFUMB position paper. Part I Ultrasound Med Biol. 2019;45(2):271–81.
Blechschmidt V, Recker F. Representation of sonographic learning objectives in the NKLM 2.0. Ultraschall Med. 2022;43(S 01):30.
Neubauer R, Bauer CJ, Dietrich CF, Strizek B, Schäfer VS, Recker F. Evidence-based ultrasound education? – A systematic literature review of undergraduate ultrasound training studies. Ultrasound Int Open. 2024;10:a22750702. (continuous publication).
Weimer J, Rolef P, Müller L, Bellhäuser H, Göbel S, Buggenhagen H, et al. FoCUS cardiac ultrasound training for undergraduates based on current national guidelines: a prospective, controlled, single-center study on transferability. BMC Med Educ. 2023;23(1):80.
Weimer J, Ruppert J, Vieth T, Weinmann-Menke J, Buggenhagen H, Künzel J, et al. Effects of undergraduate ultrasound education on cross-sectional image understanding and visual-spatial ability - a prospective study. BMC Med Educ. 2024;24(1):619.
Prosch H, Radzina M, Dietrich CF, Nielsen MB, Baumann S, Ewertsen C, et al. Ultrasound curricula of student education in Europe: summary of the experience. Ultrasound Int Open. 2020;6(1):E25-e33.
Kreiser MA, Hill B, Karki D, Wood E, Shelton R, Peterson J, et al. Point-of-care ultrasound use by EMS providers in out-of-hospital cardiac arrest. Prehosp Disaster Med. 2022;37(1):39–44.
Donovan JK, Burton SO, Jones SL, Phillips LM, Anderson D, Meadley BN. Use of point-of-care ultrasound by intensive care paramedics to assess respiratory distress in the out-of-hospital environment: a pilot study. Prehosp Emerg Care. 2023;27(6):800–6.
Schoeneck JH, Coughlin RF, Baloescu C, Cone DC, Liu RB, Kalam S, et al. Paramedic-performed prehospital point-of-care ultrasound for patients with undifferentiated dyspnea: a pilot study. West J Emerg Med. 2021;22(3):750–5.
Pietersen PI, Mikkelsen S, Lassen AT, Helmerik S, Jørgensen G, Nadim G, et al. Quality of focused thoracic ultrasound performed by emergency medical technicians and paramedics in a prehospital setting: a feasibility study. Scand J Trauma Resusc Emerg Med. 2021;29(1):40.
Guy A, Bryson A, Wheeler S, McLean N, Kanji HD. A blended prehospital ultrasound curriculum for critical care paramedics. Air Med J. 2019;38(6):426–30.
Donovan JK, Burton SO, Jones SL, Meadley BN. Use of point-of-care ultrasound by non-physicians to assess respiratory distress in the out-of-hospital environment: a scoping review. Prehosp Disaster Med. 2022;37(4):520–8.
Nadim G, Laursen CB, Pietersen PI, Wittrock D, Sørensen MK, Nielsen LB, et al. Prehospital emergency medical technicians can perform ultrasonography and blood analysis in prehospital evaluation of patients with chronic obstructive pulmonary disease: a feasibility study. BMC Health Serv Res. 2021;21(1):290.
Mercer CB, Ball M, Cash RE, Rivard MK, Chrzan K, Panchal AR. Ultrasound use in the prehospital setting for trauma: a systematic review. Prehosp Emerg Care. 2021;25(4):566–82.
Ninth statement and recommendation of the German Government Commission: Reform of emergency and acute care: Emergency medical services and financing. 2023 [Available from: https://www.bundesgesundheitsministerium.de/fileadmin/Dateien/3_Downloads/K/Krankenhausreform/BMG_Stellungnahme_9_Rettungsdienst_bf.pdf.
Micheller D, Peterson WJ, Cover M, Smith G, Chapman M, Theyyunni N, et al. Defining a theory-driven ultrasound curriculum for prehospital providers. Air Med J. 2019;38(4):285–8.
Cover M, Tafoya C, Long B, Cranford J, Burkhardt J, Huang R, et al. Creation of a flight nurse critical care ultrasound program. Air Med J. 2019;38(4):266–72.
Press GM, Miller SK, Hassan IA, Blankenship R, del Junco D, Camp E, et al. Evaluation of a training curriculum for prehospital trauma ultrasound. J Emerg Med. 2013;45(6):856–64.
McCallum J, Vu E, Sweet D, Kanji HD. Assessment of paramedic ultrasound curricula: a systematic review. Air Med J. 2015;34(6):360–8.
Meadley B, Olaussen A, Delorenzo A, Roder N, Martin C, St Clair T, et al. Educational standards for training paramedics in ultrasound: a scoping review. BMC Emerg Med. 2017;17(1):18.
Höhne E, Recker F, Dietrich CF, Schäfer VS. Assessment methods in medical ultrasound education. Front Med (Lausanne). 2022;9:871957.
Thomas PA, Kern DE, Hughes MT, Tackett SA, Chen BY. Curriculum development for medical education: a six-step approach. Johns Hopkins University Press; 2015. p. 300.
Training and examination regulations for German paramedics (NotSan-APrV) 2014. Available from: https://www.gesetze-im-internet.de/notsan-aprv/BJNR428000013.html.
Curriculum for emergency sonography (basic course) by the working group „emergency sonography“ of the German Society for Ultrasound in Medicine 2023. Available from: https://www.degum.de/fachgebiete/arbeitskreise/notfallsonografie/kurscurriculum/grundkurs.html.
Vallée A, Blacher J, Cariou A, Sorbets E. Blended learning compared to traditional learning in medical education: systematic review and meta-analysis. J Med Internet Res. 2020;22(8):e16504.
Thistlethwaite JE, Davies D, Ekeocha S, Kidd JM, MacDougall C, Matthews P, et al. The effectiveness of case-based learning in health professional education. A BEME systematic review: BEME Guide No. 23. Med Teach. 2012;34(6):e421-44.
Weimer JM, Rink M, Muller L, Dirks K, Ille C, Bozzato A, et al. Development and integration of DOPS as formative tests in head and neck ultrasound education: proof of concept study for exploration of perceptions. Diagnostics (Basel). 2023;13(4):661.
Seif D, Perera P, Mailhot T, Riley D, Mandavia D. Bedside ultrasound in resuscitation and the rapid ultrasound in shock protocol. Crit Care Res Pract. 2012;2012:503254.
Weimer J, Dionysopoulou A, Strelow KU, Buggenhagen H, Weinmann-Menke J, Dirks K, et al. Undergraduate ultrasound training: prospective comparison of two different peer assisted course models on national standards. BMC Med Educ. 2023;23(1):513.
Heegaard W, Hildebrandt D, Spear D, Chason K, Nelson B, Ho J. Prehospital ultrasound by paramedics: results of field trial. Acad Emerg Med. 2010;17(6):624–30.
Roline CE, Heegaard WG, Moore JC, Joing SA, Hildebrandt DA, Biros MH, et al. Feasibility of bedside thoracic ultrasound in the helicopter emergency medical services setting. Air Med J. 2013;32(3):153–7.
Rooney KP, Lahham S, Lahham S, Anderson CL, Bledsoe B, Sloane B, et al. Pre-hospital assessment with ultrasound in emergencies: implementation in the field. World J Emerg Med. 2016;7(2):117–23.
Reed MJ, Gibson L, Dewar A, Short S, Black P, Clegg GR. Introduction of paramedic led Echo in Life Support into the pre-hospital environment: the PUCA study. Resuscitation. 2017;112:65–9.
Becker TK, Martin-Gill C, Callaway CW, Guyette FX, Schott C. Feasibility of paramedic performed prehospital lung ultrasound in medical patients with respiratory distress. Prehosp Emerg Care. 2018;22(2):175–9.
Strony R, Slimmer K, Slimmer S, Corros P, Davis R, Zhu B, et al. Helicopter emergency medical services performed extended focused assessment with sonography: training, workflow, and sustainable quality. Air Med J. 2022;41(2):209–16.
Burton SO, Donovan JK, Jones SL, Phillips LM, Anderson DJ, Meadley BN. Use of point of care ultrasound (POCUS) by intensive care paramedics to achieve peripheral intravenous access in patients predicted to be difficult: an out-of-hospital pilot study. Australas Emerg Care. 2023;26(2):164–8.
Shaw MR, Godzdanker I, Hawbaker N, McManis BG. Guiding emergency treatment with extended focused assessment with sonography in trauma by emergency responders (GET eFASTER). Air Med J. 2023;42(1):42–7.
Brooke M, Walton J, Scutt D, Connolly J, Jarman B. Acquisition and interpretation of focused diagnostic ultrasound images by ultrasound-naive advanced paramedics: trialling a PHUS education programme. Emerg Med J. 2012;29(4):322–6.
Heegaard W, Plummer D, Dries D, Frascone RJ, Pippert G, Steel D, et al. Ultrasound for the air medical clinician. Air Med J. 2004;23(2):20–3.
Raio CC, Modayil V, Cassara M, Dubon M, Patel J, Shah T, et al. Can emergency medical services personnel identify pneumothorax on focused ultrasound examinations?. Crit Ultrasound J. 2009;1(2):65–8.
Lyon M, Walton P, Bhalla V, Shiver SA. Ultrasound detection of the sliding lung sign by prehospital critical care providers. Am J Emerg Med. 2012;30(3):485–8.
Chin EJ, Chan CH, Mortazavi R, Anderson CL, Kahn CA, Summers S, et al. A pilot study examining the viability of a Prehospital Assessment with UltraSound for Emergencies (PAUSE) protocol. J Emerg Med. 2013;44(1):142–9.
Bhat SR, Johnson DA, Pierog JE, Zaia BE, Williams SR, Gharahbaghian L. Prehospital evaluation of effusion, pneumothorax, and standstill (PEEPS): point-of-care ultrasound in emergency medical services. West J Emerg Med. 2015;16(4):503–9.
Booth KL, Reed MJ, Brady S, Cranfield KR, Kishen R, Letham K, et al. Training paramedics in focussed echo in life support. Eur J Emerg Med. 2015;22(6):430–5.
Luckey-Smith K, King B, Boyd JS. Is E-learning education effective in increasing the ability of nonphysician medical flight crewmembers to accurately interpret point-of-care lung and cardiac ultrasound examinations?. Air Med J. 2021;40(2):119–23.
Paddock MT, Bailitz J, Horowitz R, Khishfe B, Cosby K, Sergel MJ. Disaster response team FAST skills training with a portable ultrasound simulator compared to traditional training: pilot study. West J Emerg Med. 2015;16(2):325–30.
West B, Cusser A, Etengoff S, Landsgaard H, LaBond V. The use of FAST scan by paramedics in mass-casualty incidents: a simulation study. Prehosp Disaster Med. 2014;29(6):576–9.
Dewar ZE, Ko S, Rogers C, Oropallo A, Augustine A, Pamula A, et al. Prehospital portable ultrasound for safe and accurate prehospital needle thoracostomy: a pilot educational study. Ultrasound J. 2022;14(1):23.
Backlund BH, Bonnett CJ, Faragher JP, Haukoos JS, Kendall JL. Pilot study to determine the feasibility of training Army National Guard medics to perform focused cardiac ultrasonography. Prehosp Emerg Care. 2010;14(1):118–23.
Kruger J, Dunning D. Unskilled and unaware of it: how difficulties in recognizing one’s own incompetence lead to inflated self-assessments. J Pers Soc Psychol. 1999;77(6):1121–34.
Weimer JM, Widmer N, Strelow KU, Hopf P, Buggenhagen H, Dirks K, et al. Long-term effectiveness and sustainability of integrating peer-assisted ultrasound courses into medical school-a prospective study. Tomography. 2023;9(4):1315–28.
Hempel D, Haunhorst S, Sinnathurai S, Seibel A, Recker F, Heringer F, et al. Social media to supplement point-of-care ultrasound courses: the “sandwich e-learning” approach a randomized trial. Crit Ultrasound J. 2016;8(1):3.
Weimer AM, Berthold R, Schamberger C, Vieth T, Balser G, Berthold S, et al. Digital transformation in musculoskeletal ultrasound: acceptability of blended learning. Diagnostics (Basel). 2023;13(20):3272.
Weimer AM, Weimer JM, Berthold S, Stein S, Müller L, Buggenhagen H, Balser G, Stankov K, Sgroi M, Schmidmaier G, Kloeckner R, Schamberger C. Shoulder and knee arthroscopy access point: prospective comparison of sonographic and palpatory detection - which method is better for novices? Ultrasound Int Open. 2024;10:a22710098.
Altersberger M, Pavelka P, Sachs A, Weber M, Wagner-Menghin M, Prosch H. Student perceptions of instructional ultrasound videos as preparation for a practical assessment. Ultrasound Int Open. 2019;5(3):E81–8.
Hempel D, Sinnathurai S, Haunhorst S, Elansari T, Heringer F, Breitkreutz R. Kann Fall-basiertes E-Learning in Notfallsonografie Präsenzzeiten der Ausbildung reduzieren? Ultraschall Med. 2014;35:P2_3.
Hempel D, Sinnathurai S, Haunhorst S, Seibel A, Michels G, Heringer F, et al. Influence of case-based e-learning on students’ performance in point-of-care ultrasound courses: a randomized trial. Eur J Emerg Med. 2016;23(4):298–304.
Weimer MA, Kuon S, Müller L, Weinmann-Menke J, Strelow KU, Horn L, et al. Haltung und Nutzung zu/von digitalen Lehrmedien und Fallbeispielen in der klinischen Sonographie-Ausbildung. Ultraschall Med. 2022;43(S 01):53.
Acknowledgements
This study includes parts of the doctoral thesis of one of the authors (C.J.). We thank all participating students and lecturers for supporting our study. We would like to also thank C. Christe for her help in revising the figures. We would like to express our gratitude to Kay Stankov for his contributions to this publication. His dedicated efforts in consulting, supervising, and meticulously reviewing all statistical aspects have been instrumental in ensuring the rigor and accuracy of our research findings.
Funding
Open Access funding enabled and organized by Projekt DEAL. This research received no external funding.
Author information
Authors and Affiliations
Contributions
Conceptualization: C.J., H.B., T.P, and J.M.W.; methodology and software: C.J., C.I., H.B. and J.M.W. ; validation: C.J., W.H., R.K., T.P. and J.M.W.; formal analysis: C.J. and J.M.W.; investigation: C.J. A.M.W., H.B., T.P. and J.M.W.; resources: H.B., T.P. and J.M.W., data curation: C.J., A.M.W., B.F., D.M., H.F., C.I. and J.M.W; writing—original draft preparation: C.J., A.M.W. and J.M.W; writing—review and editing: C.J., A.M.W., B.F., W.H., D.M., H.F:, C.I., R.K., H.B., T.P. and J.M.W. visualization: C.J. C.I. and J.M.W. supervision: R.K., H.B., T.P. and; project administration: C.J. and J.M.W.; All authors have read and agreed to the published version of the manuscript.
Authors' information
J. M. W. is resident and coordinator of the student ultrasound education program of the University Medical Center Mainz. He has more than 10 years of experience in the didactic field and has also worked on the topic of ultrasound training methods in his doctoral thesis. He is a member of the DEGUM and GMA.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
The approval for the study was waived by the local ethics committee of the State medical association of Rhineland-Palatinate (“Ethik-Kommission der Landesärztekammer Rheinland-Pfalz”, Mainz, Germany). All procedures performed in studies involving human participants were in accordance with the ethical standards of the institutional and national research committee and with the 1964 Helsinki declaration and its later amendments or comparable ethical standards. Informed written consent was obtained from all the participants.
Consent for publication
Not Applicable.
Competing interests
The authors declare no competing interests.
Additional information
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Jonck, C., Weimer, A.M., Fundel, B. et al. Development and evaluation of a point-of-care ultrasound curriculum for paramedics in Germany – a prospective observational study and comparison. BMC Med Educ 24, 811 (2024). https://doi.org/10.1186/s12909-024-05816-1
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12909-024-05816-1