Skip to main content

Identification of critical quality factors and critical satisfaction gaps in emergency training courses for new nurses by the multi-criteria network structure model

Abstract

Objective

To identify critical quality factors and critical satisfaction gaps in emergency training courses for new nurses through a systematic decision-making model.

Methods

Firstly, the service quality (SERVQUAL) was used in the evaluation index system of this study. Then, the decision-making trial and evaluation laboratory (DEMATEL) method was used to analyze the relationship structure and the corresponding weights between the indicators. Finally, the importance-performance analysis (IPA) method was used to identify the categories of all indicators and the corresponding strategic directions. Fifteen new nurses in Taizhou Hospital of Zhejiang Province were selected as participants in this study.

Results

The IPA results showed that “(C13),” “(C22),” “(C52),” “(C53),” “(C54),” “(C55),” “(C56),”and “(C57)” are critical satisfaction gaps. From the results of influence network and weight, empathy (C5) was the critical quality factor of the entire training course. The influence network relationship structure and weight had a 98.1% significant confidence level, indicating good stability.

Conclusion

Teachers’ empathy is key to the learning outcomes of new nurses in emergency nursing training courses. Hence, teachers should be attentive to the empathetic quality of their teaching methods to help new nurses gain knowledge and experience in emergency care, especially when they come from different professions and departments.

Peer Review reports

Introduction

Previous studies have paid little attention to the knowledge and skill readiness of new nurses in emergency nursing care environments [1]. For new nurses to be effective in the emergency department, it is necessary for them to receive professional nursing training on emergency knowledge and corresponding skills. Many studies have explored training course evaluations, such as emergency medicine undergraduate simulation training [2], advanced diploma courses [3], and psychiatric nursing [4]. However, few studies have evaluated the satisfaction of new nurses with the quality of emergency training courses.

Evaluating the satisfaction and quality improvement in training courses involves multiple criteria. Incorporating the practical experience of experts and managers can improve the accuracy of standard assessments and help identify the most influential criteria in their respective fields [5,6,7,8]. Multi-criteria decision-making (MCDM) is a modern scientific method used to evaluate, select, and improve alternatives based on an evaluation system that includes a set of qualitative and quantitative factors [5, 9,10,11]. Additionally, MCDM helps experts and managers balance and weigh factors to simplify their decision-making process [12, 13]. MCDM has also been widely used in decision-making problems in the medical and nursing fields, such as hospital performance [14], clinical decision-making [15], shared decision-making [16, 17], and nurses’ job satisfaction [9, 18]. The MCDM method is advantageous because it is based on the knowledge of experts. It also systematically provides evaluation and improvement to compensate for the limitations of decision-making in the evaluation and improvement of emergency training courses.

This study aimed to construct a hybrid multi-criteria decision-making model to assist hospital decision-makers and managers in evaluating the satisfaction with emergency training courses and systematically improving training quality during public health emergencies.

Materials and methods

Research design and modeling description

The decision model used in this study was based on three components. First, the evaluation model was designed based on the service quality (SERVQUAL) model. Then, we used the decision-making trial and evaluation laboratory (DEMATEL) method to construct the relationship structure between the criteria and their corresponding weights and further identify the critical quality factor. Finally, the importance-performance analysis (IPA) method was used to analyze the critical satisfaction gaps in emergency training courses. The research flow is illustrated in Fig. 1.

Fig. 1
figure 1

Decision modeling process

The satisfaction and quality evaluation system

Parasuraman et al. formally proposed the SERVQUAL model theory in 1988 based on the research and development of the concept of service quality for measuring consumers’ perception of services [19]. The development process of this evaluation model was based on several theoretical models related to service quality and applies statistical analysis methods to analyze four survey objects/samples. The final version of the model consisted of five dimensions and 22 corresponding criteria, and its overall reliability was close to 0.9. Subsequently, the model was modified over time and applied to several service industries, such as retail, healthcare, e-commerce, tourism services, and other service sectors [20]. Additionally, a research review found that the model played a key role in research on medical service quality [21].

This study was based on the SERVQUAL model and constructed a quality assessment model for training course service combined with expert interviews and surveys, also known as The Satisfaction and Quality Evaluation System. Cronbach’s alpha values were 0.944 (goal), 0.856 (Tangibles C1), 0.881 (Reliability C2), 0.731 (Responsiveness C3), 0.753 (Assurance C4), and 0.923 (Empathy C5). Both the original scale and the results of this study show that the evaluation model has good reliability and can be used as the evaluation model in this study. In our model, the corresponding descriptions of the five dimensions are stated below, and the corresponding criteria are shown in Table 1.

  • Tangibles (C1): Training courses provide corresponding tangible teaching facilities and equipment. This dimension includes four criteria.

  • Reliability (C2): Provides a reliable teaching plan and corresponding training content to implement the promised training service accurately. This dimension includes five criteria.

  • Responsiveness (C3): Teachers can provide timely training services and corresponding answers to questions. This dimension includes four criteria.

  • Assurance (C4): Teachers’ knowledge and attitudes can earn students’ trust and confidence. This dimension includes four criteria.

  • Empathy (C5): Teachers can provide care and personalized needs for students. This dimension includes seven criteria.

Table 1 Satisfaction and quality evaluation system of emergency training courses

The DEMATEL technique

DEMATEL is an analytical technique developed by the Geneva Research Centre in 1973 to analyze the structure of influence relations among complex factors [22]. DEMATEL uses a structural modeling approach and represents the causal criteria [23], thus enabling decision-makers to obtain the causal relationships between criteria and use them as the main tool for problem-solving [24, 25]. The DEMATEL calculations are summarized as follows [26, 27]:

Step 1: Creating an average direct impact relationship matrix

Here, \(k\)th represented each participant. The \(k\)th respondent assessed the extent to which criterion i affected criterion j through a set of 5-point Likert scales (0 = no impact to 4 = very high impact). Next, an \(n \times n\) matrix \({\varvec{A}}\) of non-negative values was obtained from the overall average, as shown in Eq. (1). Finally, the significant confidence level of the matrix \({\varvec{A}}\) can be confirmed by Eq. (2), with higher values representing higher stability/confidence results, where the threshold must exceed 95% (i.e., the average gap ratio is less than 5%).

$${\varvec{A}} = [a_{ij} ]_{n \times n} = \left[ {\frac{1}{Q}\sum\limits_{q = 1}^{Q} {d_{ij}^{q} } } \right]_{n \times n} , \, i,j \in \{ 1,2,...,n\}$$
(1)
$$\frac{1}{n(n - 1)}\sum\limits_{i = 1}^{k} {\sum\limits_{j = 1}^{k} {\frac{{\left| {a_{ij}^{k} - a_{ij}^{k - 1} } \right|}}{{a_{ij}^{k} }} \times 100\% } }$$
(2)

Step 2: Creating the normalized initial direct relation matrix

The initial direct-relation matrix \({\varvec{A}}\) can be normalized using Eq. (3) and (4) to obtain the normalized initial direct-relation matrix, \({\varvec{U}}\).

$$\rho = \mathop {\max }\limits_{i,j} \left[ {\max\nolimits_{i} \sum\nolimits_{j = 1}^{n} {a_{ij} } ,\max\nolimits_{j} \sum\nolimits_{i = 1}^{n} {a_{ij} } } \right]$$
(3)
$${\varvec{U}} = \frac{{\varvec{A}}}{\rho }$$
(4)

Here, the values of the matrix \({\varvec{U}}\) are all ratios between 0 and 1.

Step 3: Creating the total relation matrix

The total relation matrix \({\varvec{T}}\) is obtained using the normalized initial direct-relation matrix \({\varvec{U}}\) using Eq. (5).

$${\varvec{T}} = {\varvec{U}} + {\varvec{U}}^{2} + \cdots + {\varvec{U}}^{\Delta } = {\varvec{U}}({\varvec{I}} - {\varvec{U}})^{ - 1} ,{\text{when}}\mathop {\lim }\limits_{\Delta \to \infty } {\varvec{U}}^{\Delta } = [0]_{n \times n}$$
(5)

Here, the matrix \({\varvec{I}}\) is a unit matrix with diagonal of 1, and the rest are 0.

Step 4: Obtain the influential network relation map

The “exerted influence (\(r_{i}\))” and “received influence (\(s_{i}\))” of each criterion were obtained through Eqs. (6) and (7), respectively:

$$r_{i} = \left( {r_{i} } \right)_{{_{n \times 1} }} = (r_{1} ,...,r_{i} ,...,r_{n} ) = \left[ {\sum\nolimits_{j = 1}^{n} {t_{ij} } } \right]_{n \times 1}^{{}}$$
(6)
$$s_{i} = \left( {s_{i} } \right)_{{_{n \times 1} }} = \left( {s_{j} } \right)_{1 \times n}^{^{\prime}} = (s_{1} ,...,s_{j} ,...,s_{n} )^{^{\prime}} = \left[ {\sum\nolimits_{i = 1}^{n} {t_{ij} } } \right]_{1 \times n}^{^{\prime}}$$
(7)

The “significance (\(r_{i} + s_{i}\))” of each criterion represented the degree of significance of the relative influence of that criterion in relation to other criteria, where higher values represented a more significant influence caused to the system. In contrast, the “relationship (\(r_{i} - s_{i}\))” represented the nature of the criterion’s significant influence within the system, where a positive value meant that the criterion is of the nature of “exerting influence” (\(r_{i}\)) on others. These criteria were grouped together and were called the positive group. On the other hand, a negative value meant that the criterion was of the nature of “receiving influence” (\(s_{i}\)), which was also called the negative group.

Step 5: Determining the influence relation weights for the criteria

The influence relation weight of each criterion was obtained through Eq. (8).

$$w_{i} = \frac{{\left( {r_{i} + s_{i} } \right)}}{{\sum\nolimits_{i = 1}^{n} {\left( {r_{i} + s_{i} } \right)} }}$$
(8)

The IPA method

Martilla and James developed IPA in 1997 to identify key performance criteria for a product or service [28,29,30]. The method helps decision-makers easily understand the performance and importance of all criteria and further identify the critical ones. This method categorizes all criteria into the following four categories based on performance and importance scores [31, 32]. In this study, the weight results of the DEMEL method was used as the importance (i.e., x-axis). Then, during the questionnaire, the satisfaction obtained was used as performance (i.e., y-axis). The average of both these weights and satisfaction was used as the central point to assist in the classification of all criteria. The four categories and their corresponding decisions are described below.

  • Category I: Highly relevant (high importance and high performance). These criteria are important for teaching content, services, and training courses. They are essential for training courses, and the performance evaluation after courses is high. Hospital administrators can be assured of these criteria for the time being.

  • Category II: May be excessive (low importance and high performance). These criteria are less important for teaching content, services, or training courses. They are not important for training courses, and the performance evaluation after courses is high. Hospital administrators may ignore these criteria for the time being.

  • Category III: Low priority (low importance and low performance). These criteria are the least important factors for teaching content, services, and training courses. They are not important for training courses, and their performance evaluation after courses is very low. Compared with other categories, hospital administrators may not need to address these criteria for the time being.

  • Category IV: Administratively prioritized (high importance and low performance). These criteria are the most important improvement factors for teaching content, services, and training courses. These are important for training courses; however, their performance evaluations after the courses are very low. Compared with other categories, it is most important for hospital administrators to prioritize these criteria. This category was also called critical satisfaction gaps in this study.

Ethical approval

All courses were conducted following the guidelines of our institution’s ethics committee and according to the principles of the Declaration of Helsinki. All participant data were anonymous. Institutional Review Board (IRB) of Taizhou University, Taizhou, China (ID: TZYXY2021-423) approved the oral informed consent procedure of this study and the whole study.

Data collection and description

The recruitment was conducted after approval from the Institutional Review Board (IRB) of Taizhou University, and the head of the hospital and department. The participants were recruited through referrals from the department head. Before conducting the research, we explained all the procedures and criteria to participants, and stated that their information would be confidential. The investigation period of this study was from April 11, 2021, to April 20, 2021. In total, 15 new nurses (i.e., working service years less than 1 year) participated. All participants provided informed consent.

The content of the questionnaire was divided into three parts: first, the degree of interaction between the estimation criteria; second was to investigate the satisfaction level of the course; and third was the background of the interviewees. The data of this study were calculated by excel and SPSS; the former was to calculate the results (i.e., structure and weight) of the DEMTEL method, and the latter was to calculate the results of the IPA method. All participants were under 30 years of age. Among them, 87% were women, 60% had bachelor’s degrees, and their participating majors were distributed in the emergency, internal medicine, surgery, and nursing departments. The background and descriptions of the respondents in this study are shown in Table 2.

Table 2 Background and characteristics of respondents in this study

Results

Results of influence structure

Table 3 shows the structure of the influence relationship between criteria from the clinical experience of 15 participants and forms an average direct influence impact matrix. For this matrix, the mean ratio of the variance was 0.0451 (i.e., 4.52%, less than 5%), and the significance level was 95.48% (i.e., more than 95%). This result also shows that the experience gap of this group of respondents was within the acceptable range, and that the network structure results had good stability. In other words, the matrix represents a common empirical consensus among this group of experts. Subsequent additions of relevant experts showed little change in results.

Table 3 Average direct impact matrix of 15 respondents

The average direct influence matrix (\({\varvec{A}}\)) further obtained four indicators for all dimensions/criteria through the calculation of a series of mathematical equations (i.e., Eqs. (3, 4, 5, 6, 7)). Table 4 shows “exerted influence” (\(r_{i}\)), “received influence” (\(s_{i}\)), “significance” (\(r_{i} + s_{i}\)), and “relation” (\(r_{i} - s_{i}\)) data for all dimensions and criteria. In the dimension level, the “significance” (\(r_{i} + s_{i}\)) from high to low was \(C_5\;\mathrm f\;C_4\;\mathrm f\;C_3\;\mathrm f\;C_2\;\mathrm f\;C_1\). In addition, from the perspective of “relation” (\(r_{i} - s_{i}\)), the dimensions belonging to the positive group were “(\(C_{1}\))” and “(\(C_{5}\)).” In contrast, “(\(C_{2}\)),” “(\(C_{3}\)),” and “(\(C_{4}\))” belonged to the negative group. In the criteria of “(C1),” “significance” (\(r_{i} + s_{i}\)) from high to low was \(C_{13}\;\mathrm f\;C_{14}\;\mathrm f\;C_{12}\;\mathrm f\;C_{11}\). In addition, from the perspective of the “relation” (\(r_{i} - s_{i}\)), the criteria belonging to the positive group were “(\(C_{11}\))” and “(\(C_{13}\)).” In contrast, “(\(C_{12}\))” and “(\(C_{14}\))” belonged to the negative group.

Table 4 The influence structure for dimensions and criteria

In the criteria of “(\(C_{2}\)),” “significance” (\(r_{i} + s_{i}\)) from high to low was \(C_{22}\;\mathrm f\;C_{25}\;\mathrm f\;C_{24}\;\mathrm f\;C_{23}\;\mathrm f\;C_{21}\). In addition, from the perspective of the “relation” (\(r_{i} - s_{i}\)), the criterion belonging to the positive group was “(\(C_{22}\)).” The other criteria were assigned to the negative group. In the criteria of “(\(C_{3}\)),” “significance” (\(r_{i} + s_{i}\)) from high to low was \(C_{32\;}\mathrm f\;C_{33}\;\mathrm f\;C_{34}\;\mathrm f\;C_{31}\). In addition, from the perspective of the “relation (\(r_{i} - s_{i}\)),” the criteria belonging to the positive group were “(C31)” and “(\(C_{32}\)).” In contrast, “(\(C_{33}\))” and “(\(C_{34}\))” belonged to the negative group.

In the criteria of “(\(C_{4}\)),” “significance” (\(r_{i} + s_{i}\)) from high to low was \(C_{42}\;\mathrm f\;C_{41}\;\mathrm f\;C_{44}\;\mathrm f\;C_{43}\). In addition, from the perspective of the “relation” (\(r_{i} - s_{i}\)), the criteria belonging to the positive group were “(C42)” and “(\(C_{43}\)).” In contrast, “(\(C_{41}\))” and “(\(C_{44}\))” belonged to the negative group. In the criteria of “(\(C_{5}\)),” “significance” (\(r_{i} + s_{i}\)) from high to low was \(C_{53}\;\mathrm f\;C_{56}\;\mathrm f\;C_{54}\;\mathrm f\;C_{51}\;\mathrm f\;C_{57}\;\mathrm f\;C_{55}\;\mathrm f\;C_{52}\). In addition, from the perspective of the “relation” (\(r_{i} - s_{i}\)), the criterion belonging to the negative group was “(\(C_{55}\)).” The other criteria were assigned to the positive group.

Results of influence weights

The “significance” (\(r_{i} + s_{i}\)) of dimensions and criteria was transformed into a set of influence weights by Eq. (8). Table 5 shows the influence weights of all dimensions and the corresponding criteria, which represent the degree of influence weight of this factor in the entire evaluation system. The weight can be further divided into local point of view and overall point of view. Local weight and ranking referred to the relative importance of the dimensions/criteria in local views and the corresponding ranking. Global weight and ranking referred to the relative importance of the criterion in all criteria (regardless of local views) and the corresponding ranking.

Table 5 The influence weights for dimensions and criteria

The higher the value, the more attention should be paid to the dimension or criterion in subsequent IPA analysis. The dimensions “(\(C_{5}\)),” “(\(C_{4}\)),” and “(\(C_{3}\))” were the top three with the highest weight compared with other dimensions. In each dimension, “(\(C_{13}\)),” “(\(C_{22}\)),” “(\(C_{32}\)),” “(\(C_{42}\)),” and “(\(C_{53}\))” were the criteria with the highest weight. In addition, from the overall perspective, “(\(C_{42}\)),” “(\(C_{53}\))” and “(\(C_{32}\)),” were the top three criteria.

Results of IPA evaluation

Table 6 shows the importance-satisfaction analysis of the emergency training courses for the 15 respondents. All criteria can be roughly classified into four categories using the IPA. The criteria in Category I (Highly relevant) were “(\(C_{32}\))”, “(\(C_{33}\))”, “(\(C_{34}\))”, “(\(C_{41}\))”, “(\(C_{42}\))”, “(\(C_{44}\))”, and “(\(C_{51}\))”. The criteria in Category II (May be excessive) were “(\(C_{21}\))”, “(\(C_{24}\))”, “(\(C_{31}\))”, and “(\(C_{43}\))”. The criteria in Category III (Low priority) were “(\(C_{11}\))”, “(\(C_{12}\))”, “(\(C_{14}\))”, “(\(C_{23}\))”, and “(\(C_{25}\))”. The criteria in Category IV (Administratively prioritized) were “(\(C_{13}\))”, “(\(C_{22}\))”, “(\(C_{52}\))”, “(\(C_{53}\))”, “(\(C_{54}\))”, “(\(C_{55}\))”, “(\(C_{56}\))”, and “(\(C_{57}\))”.

Table 6 The importance-satisfaction analysis of the emergency training courses

Discussions

Influential structure analysis

Figure 2 shows the structure of the influence relations between all dimensions and criteria levels.

Fig. 2
figure 2

Influential network-relation map

In the dimensions, “(\(C_{5}\))” was the main source of influence on the other dimensions. An empathic teacher would consider the students’ perspectives to understand the work situation and learning constraints of new nurses from different departments and thus design an appropriate training curriculum and teaching plan [19]. Additionally, the teacher should be able to use the teaching facilities and environment during the teaching process. In turn, the teacher would maintain a good professional image and inspire new nurses’ interest and confidence in learning. Ultimately, new nurses who participated in the revised training course may find the content and process of this training course reliable.

In the criteria of “(\(C_{1}\)),” “(\(C_{11}\))” was the main influence criterion. Good physical facilities are essential elements of a teaching and learning environment. Usually, hospitals invite renowned external scholars or experts to conduct training, and the training venue and teaching resources are located in the hospital. Moreover, most of the training are scheduled outside working hours, such as weekday evenings, Saturdays, and Sundays. Therefore, good teaching facilities in the hospital facilitated teachers’ provision of professional emergency knowledge and training. It created an attractive teaching environment and motivated new nurses to attend training courses during their time off from work and enjoy the atmosphere of the learning environment.

The results of a past study [33] also point out that proper facility management creates a favorable learning environment. For the instructor, good care management helps coordinate classroom activities; for the students, it effectively instills maintenance skills.

In the criteria of “(\(C_{2}\)),” “(\(C_{22}\))” was the main influence criterion. All the nurses in the study were at the hospital for 1 year or less. When a teacher is willing to help new nurses with difficulties during the training process, they pay attention to the learning status of each new nurse to provide appropriate teaching content and properly assess the student’s learning performance. The teacher should also ensure that the content is scientifically sound and effective and that the lesson plan is completed on time.

In the criteria of “(\(C_{3}\)),” “(\(C_{32}\))” was the main influence criterion. New nurses who started learning emergency nursing faced difficulties and problems in learning at the beginning. If teachers could answer new nurses’ questions promptly, start and end classes on time, and appropriately arrange the teaching schedule, it may be easier to help students achieve their learning goals with a smooth training process.

In the criteria of “(\(C_{4}\)),” “(\(C_{43}\))” was the main influence criterion. A polite teacher respects the learning status of each new nurse and communicates and discusses the content with them. During the teaching process, new nurses can express themselves confidently and feel assured of the teacher’s teaching capabilities. This teaching atmosphere helps teachers to deliver complete content and services successfully.

In the criteria of “(\(C_{5}\)),” “(\(C_{56}\))” was the main influence criterion. Enthusiasm for learning is an essential element for completing the learning process. Teachers should be concerned about each new nurse’s learning status and provide the same teaching services and care. Teachers should also understand the learning needs, progress, and outcomes of new nurses. Finally, teachers should be able to schedule classes that are acceptable to new nurses.

Influential weight analysis

Table 5 shows that the dimension with the highest weight was “(\(C_{5}\)).” A teacher with empathy can better consider trainees’ learning needs from their perspectives, observe the benefits of their learning, and dynamically monitor their learning progress. When new nurses encounter conflicts between training and work, teachers should be able to adjust their schedules to offer a class time that is acceptable to trainees on time. During the process of nursing training, new nurses may encounter many learning obstacles that require teachers to pay special attention to their learning status and assist them in solving their learning problems in a timely manner. Ultimately, new nurses would be more willing to learn and complete the training course in emergency nursing. Moreover, this study had the same results as those of a previous study, [34] in which empathy had a positive impact on students’ professional development and learning environment in nursing. Because of this, faculty should be strongly encouraged to place more emphasis on the principles of empathy and care in nursing, which would involve good communication with students.

From the perspective of criteria in each dimension, the criterion with the highest weight in “(\(C_{1}\))” was “(\(C_{13}\)).” A teaching team with extensive expertise and experience can better use modern teaching tools, provide a better quality of teaching, and make the content better accepted by new nurses to ensure the quality of teaching altogether.

In “(\(C_{2}\)),” “(\(C_{22}\))” was the highest weighted criterion. New nurses come from different departments with different learning capabilities and might encounter difficulties during the learning process. Teachers should accurately understand students’ specific difficulties and then, appropriately arrange the teaching content and design a reasonable evaluation system that is achievable through the trainees’ efforts to ensure the quality of learning of new nurses.

In “(\(C_{3}\)),” “(\(C_{32}\))” was the criterion with the highest weight. When learners encounter learning problems, the teacher should be able to answer them promptly, allowing the teaching progress to proceed as scheduled. Since students can grasp the key points in class and review them thoroughly after class, the teaching and learning activities proceed smoothly.

In the “(\(C_{4}\)),” “(\(C_{42}\))” was the highest weighted criterion. New nurses were still getting familiar with the hospital, were unfamiliar with the teacher, and had even less knowledge about emergency care. Consequently, new nurses often fear that they will not be able to meet the learning objectives of the training course, causing worry. Therefore, teachers should inform new nurses about the learning objectives and trajectory and provide learning methods in advance. Meanwhile, daily communication with trainees should be increased to gain trust and reassure them about the training process of this emergency nursing course.

Finally, in “(\(C_{5}\)),” “(\(C_{53}\))” was the highest-weighted criterion. New nurses from different departments might have had different clinical nursing experiences and learning needs. The teacher should understand the learning needs of each trainee on time and schedule the lecture time appropriately based on the work schedule of new nurses so that each trainee can attend the lecture. During the training process, teachers should monitor new nurses’ learning progress and learning outcomes and promptly encourage students who lack confidence. All of the above are necessary measures and behaviors.

Systematic improvement strategy from the influential network perspective

Table 6 shows that Category IV included “(\(C_{13}\))”, “(\(C_{22}\))”, “(\(C_{52}\))”, “(\(C_{53}\))”, “(\(C_{54}\))”, “(\(C_{55}\))”, “(\(C_{56}\))”, and “(\(C_{57}\))”. Thus, the main problem with this training course was that teachers lack empathy for new nurses. In the training process, teachers failed to consider the learning needs, learning conditions, and learning difficulties from their point of view. The primary reason is that they come from different nursing majors, and everyone had different abilities regarding emergency nursing content.

Further, from the perspective of the influence network in Fig. 3, “(\(C_{5}\))” was the most important influence dimension in the entire training course. Hence, to improve the service quality of the first aid training class for new nurses, the nursing department should focus on transitioning to teaching from the perspective of students, in addition to their professional knowledge and practical experience. Teachers’ professionalism is the foundation; however, effective teaching is based on a demonstration of empathy.

Fig. 3
figure 3

Importance-performance analysis for case hospital

Limitations

This study had certain limitations. First, it was based on the SERVQUAL theoretical model to design a service evaluation model, thus skewing the perspective. Different research evaluations focus on different viewpoints, and the design of the evaluation index system also differs. Future researchers could study the index system more deeply from different theoretical viewpoints.

Additionally, the results of this study were based on the participants of the case hospital and may not be applicable to other courses or hospitals. In the future, researchers can collect more survey data and explore the operation mechanism behind more realistic phenomena using statistical analysis or machine learning methods. Furthermore, assumptions about experience and empathy are usually difficult to measure accurately by quantitative methods [35, 36], and future researchers can combine qualitative theory with data for in-depth analysis.

Conclusion

Teachers’ empathy is vital to the learning outcomes of new nurses in emergency nursing training courses. The main reason is that new nurses come from different specialties and lack knowledge and clinical experience in emergency nursing. Therefore, new nurses may encounter many learning obstacles and issues during emergency nursing training. Therefore, teachers should pay special attention to the learning status of new nurses to help them gain knowledge and experience in emergency nursing. Ultimately, each new nurse in the emergency department will be able to complete the training process. When the country faces a major public health emergency in the future, registered nurses and new nurses in the emergency department will be well-equipped to address the needs and problems of local emergency care as quickly as possible.

Availability of data and materials

The study data and materials are in the custody of the corresponding author and can be made available on reasonable request.

References

  1. Jerome-D’Emilia B, Suplee PD, Linz S. Challenges faced by new nurses during the COVID-19 pandemic. J Nurs Scholarsh. 2022;54(6):772–86.

    Article  Google Scholar 

  2. Zargaran A, et al. Emergency medicine undergraduate simulation training during the COVID-19 pandemic: a course evaluation. Injury. 2022;53(10):3191–4.

    Article  Google Scholar 

  3. Daubman BR, et al. Furthering palliative care training in Latin America: development and assessment of an advanced diploma course in palliative care in Chile. J Pain Symptom Manage. 2022;64(2):128–36.

    Article  Google Scholar 

  4. Pereira MO, et al. Overcoming the challenges to offer quality training in psychiatric nursing. Rev Bras Enferm. 2020;73(1):e20180208.

    Article  Google Scholar 

  5. Zare M, et al. Multi-criteria decision making approach in E-learning: A systematic review and classification. Appl Soft Comput. 2016;45:108–28.

    Article  Google Scholar 

  6. Dzemyda G, Šaltenis V. Multiple criteria decision support system: methods, user’s interface and applications. Informatica. 1994;5(1):31–42.

    Google Scholar 

  7. Kurilovas E, Dagienė V. Multiple criteria comparative evaluation of E-Learning systems and components. Informatica. 2009;20(4):499–518.

    Article  Google Scholar 

  8. Zavadskas EK, Turskis Z. A new additive ratio assessment (ARAS) method in multicriteria decision-making. Ukio Technol Ekon Vystymas. 2010;16(2):159–72.

    Google Scholar 

  9. Liu C, et al. Application of a hybrid multi-criterion decision-making model for evaluation and improvement of nurses’ job satisfaction. Front Public Health. 2022;10:896061.

    Article  Google Scholar 

  10. HeidaryDahooie J, et al. Competency-based IT personnel selection using a hybrid SWARA and ARAS-G methodology. Hum Fact Ergonom Manufact Serv Industr. 2018;28(1):5–16.

    Article  Google Scholar 

  11. Alguliyev RM, Aliguliyev RM, Mahmudova RS. Multicriteria personnel selection by the modified fuzzy VIKOR method. ScientificWorldJournal. 2015;2015:612767.

    Article  Google Scholar 

  12. Kahraman C. Fuzzy multi-criteria decision making: theory and applications with recent developments. 2008.

  13. Fandel G, Spronk J. Multiple criteria decision methods and applications. 1985.

  14. Zou T, et al. The DEMATEL method explores the interdependent relationship structure and weights for diagnosis-related groups system. Front Public Health. 2022;10:872434.

    Article  Google Scholar 

  15. Chuang YC, et al. Exploration of the relationship among key risk factors of acute kidney injury for elderly patients considering Covid-19. Front Med (Lausanne). 2021;8:639250.

    Article  Google Scholar 

  16. Chuang Y-C, Zhu Z, Jin Y, Chien C-W, Tung T-H. Using hybrid consistent fuzzy preference relations–importance-performance analysis model to improve shared decision-making quality based on orthopaedic nurses' perceptions. J Clin Nurs. 2022;00:1–8. https://doi.org/10.1111/jocn.16427.

  17. Jin Y, et al. Exploring the key factors of shared decision-making through an influential network relation map: the orthopedic nurse’s perspective. Front Med (Lausanne). 2021;8:762890.

    Article  Google Scholar 

  18. Wang Y, et al. The hybrid multiple-criteria decision-making model for home healthcare nurses’ job satisfaction evaluation and improvement. Int J Public Health. 2022;67:1604940.

    Article  Google Scholar 

  19. Parasuraman A, Zeithaml V, Berry LL. SERVQUAL: a multiple-item scale for measuring consumer perceptions of service quality. J Retail. 1988;64:12–40.

    Google Scholar 

  20. Shi Z, Shang H. A Review on Quality of Service and SERVQUAL Model. In: HCI in Business, Government and Organizations. Cham: Springer International Publishing. 2020.

  21. Jonkisz A, Karniej P, Krasowska D. SERVQUAL method as an “Old New” tool for improving the quality of medical services: a literature review. Int J Environ Res Public Health. 2021;18(20):10758.

  22. Muhammad MN, Cavus N. Fuzzy DEMATEL method for identifying LMS evaluation criteria. Proc Comput Sci. 2017;120:742–9.

    Article  Google Scholar 

  23. Li Y, Diabat A, Lu C-C. Leagile supplier selection in Chinese textile industries: a DEMATEL approach. Ann Oper Res. 2020;287(1):303–22.

    Article  Google Scholar 

  24. Kumar A, Dash MK. Using DEMATEL to construct influential network relation map of consumer decision-making in e-marketplace. Int J Bus Inform Syst. 2015;21(1):48–72.

    Google Scholar 

  25. Kumar A, et al. Construction of capital procurement decision making model to optimize supplier selection using Fuzzy Delphi and AHP-DEMATEL. Benchmarking. 2018;25(5):1528–47.

    Article  Google Scholar 

  26. Cheng F, et al. A hybrid MADM model for newly graduated nurse’s competence evaluation and improvement. J Healthc Eng. 2021;2021:6658538.

    Article  Google Scholar 

  27. Hsu W-CJ, Liou JJH, Lo H-W. A group decision-making approach for exploring trends in the development of the healthcare industry in Taiwan. Decis Support Syst. 2021;141:113447.

    Article  Google Scholar 

  28. Martilla JA, James JC. Importance-performance analysis. J Mark. 1977;41(1):77–9.

    Article  Google Scholar 

  29. Abalo J, Varela J, Manzano V. Importance values for importance-performance analysis: a formula for spreading out values derived from preference rankings. J Bus Res. 2007;60(2):115–21.

    Article  Google Scholar 

  30. Frauman E, Banks S. Gateway community resident perceptions of tourism development: incorporating importance-performance analysis into a limits of acceptable change framework. Tour Manage. 2011;32(1):128–40.

    Article  Google Scholar 

  31. Cohen JF, Coleman E, Kangethe MJ. An importance-performance analysis of hospital information system attributes: a nurses’ perspective. Int J Med Inform. 2016;86:82–90.

    Article  Google Scholar 

  32. Ho L-H, et al. Using modified IPA to evaluate supplier’s performance: multiple regression analysis and DEMATEL approach. Expert Syst Appl. 2012;39(8):7102–9.

    Article  Google Scholar 

  33. Okeke FN. Management of facilities in the classroom. J Emerg Trends Educ Res Policy Stud. 2013;4:100–4.

    Google Scholar 

  34. Mikkonen K, Kyngäs H, Kääriäinen M. Nursing students’ experiences of the empathy of their teachers: a qualitative study. Adv Health Sci Educ. 2015;20(3):669–82.

    Article  Google Scholar 

  35. DiCicco-Bloom B, Crabtree BF. The qualitative research interview. Med Educ. 2006;40(4):314–21.

    Article  Google Scholar 

  36. Chowdhury NZ, Shahed FH. Impact of teachers’ empathy towards adult learners’ struggles in acquiring EFL. Celebes J Lang Stud. 2021;1(1):10–22. https://doi.org/10.51629/cjls.v1i1.30.

Download references

Acknowledgements

The authors appreciate Taizhou University for supporting this research.

Funding

This research received no subsidy from any public, commercial or non-profit sector.

Author information

Authors and Affiliations

Authors

Contributions

W.L. Hu, Y.C. Chuang, ZL-J and T. H. Tung conducted the study and drafted the manuscript. W.L. Hu and Y.C. Chuang, ZL-J participated in the design of the study and performed statistical analyses. T. H. Tung conceived the study and participated in its design and coordination. All of the authors read and approved the final manuscript.

Corresponding authors

Correspondence to Yen-Ching Chuang, Zhu Liduzi Jiesisibieke or Tao-Hsin Tung.

Ethics declarations

Ethics approval and consent to participate

All courses were conducted following the guidelines of our institution’s ethics committee and according to the principles of the Declaration of Helsinki. All participant data were anonymous. Institutional Review Board (IRB) of Taizhou University, Taizhou, China (ID: TZYXY2021-423) approved oral informed consent procedure of this study and the whole study. The recruitment was conducted after approval from the Institutional Review Board (IRB) of Taizhou University.

Consent for publication

Not applicable.

Competing interests

The authors declare no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Hu, WL., Chuang, YC., Jiesisibieke, Z.L. et al. Identification of critical quality factors and critical satisfaction gaps in emergency training courses for new nurses by the multi-criteria network structure model. BMC Med Educ 23, 346 (2023). https://doi.org/10.1186/s12909-023-04330-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-023-04330-0

Keywords