Skip to main content
Download PDF

Quality-assured training in the evaluation of cochlear implant electrode position: a prospective experimental study

BMC Medical Education volume 22, Article number: 386 (2022) Cite this article

Abstract

Background

The objective of this study was to demonstrate the utility of an approach in training predoctoral medical students, to enable them to measure electrode-to-modiolus distances (EMDs) and insertion-depth angles (aDOIs) in cochlear implant (CI) imaging at the performance level of a single senior rater.

Methods

This prospective experimental study was conducted on a clinical training dataset comprising patients undergoing cochlear implantation with a Nucleus® CI532 Slim Modiolar electrode (N = 20) or a CI512 Contour Advance electrode (N = 10). To assess the learning curves of a single medical student in measuring EMD and aDOI, interrater differences (senior–student) were compared with the intrarater differences of a single senior rater (test–retest). The interrater and intrarater range were both calculated as the distance between the 0.1th and 99.9th percentiles. A “deliberate practice” training approach was used to teach knowledge and skills, while correctives were applied to minimize faulty data-gathering and data synthesis.

Results

Intrarater differences of the senior rater ranged from − 0.5 to 0.5 mm for EMD and − 14° to 16° for aDOI (respective medians: 0 mm and 0°). Use of the training approach led to interrater differences that matched this after the 4th (EMD) and 3rd (aDOI) feedback/measurement series had been provided to the student.

Conclusions

The training approach enabled the student to evaluate the CI electrode position at the performance level of a senior rater. This finding may offer a basis for ongoing clinical quality assurance for the assessment of CI electrode position.

Peer Review reports

Background

Intracochlear positioning of the cochlear implant (CI) electrode is essential for successful placement of the CI adjacent to the modiolus with minimum intracochlear trauma. The electrode’s position is determined post-operatively, routinely by radiographic imaging techniques such as computer tomography (CT) or digital volume tomography (DVT). Therefore, measurements of electrode-to-modiolus distance (EMD) and angular depth of insertion (aDOI) are of clinical interest.

Within the framework of university education, these parameters are also measured by predoctoral medical students, and their inexperience may lead to diagnostic errors (missing findings or misinterpretation of findings) [1, 2]. Diagnostic errors are due primarily to cognitive bias, sources of which are, in radiology, usually associated with problems of visual perception (scanning, recognition or interpretation) [1, 3]. According to Graber et al. (2018) [3], sources of cognitive bias include inadequate knowledge or skill on the part of the rater, faulty data-gathering (i.e., gathering and measuring information on relevant variables) and faulty information synthesis (i.e., processing and verification) [1, 3]. In medicine, the most common sources of bias are linked to poor information synthesis, and this can be subdivided into further factors [3, 4].

The weight of these cognitive factors depends on the expertise of the rater. While experienced raters are especially vulnerable to drawing premature conclusions (fast or type 1 thinking) [5], the major problems in decision-making by medical students are inadequate knowledge and skills, faulty context generation, faulty triggering, misidentification and premature conclusions [4]. However, an inexperienced rater will have a more analytical approach to decision-making, even though this (type 2) thinking needs more time. Type 2 thinking by medical students can thus provide a basis for careful CI image evaluation. For this, the student must be given the specific knowledge and skills on the one hand, while correctives are applied to minimize faulty data collection and information synthesis on the other.

Therefore, the aim of this work was (1) to use “deliberate training” (in the sense of Ericsson et al. [6, 7]), to prepare a single student for this task while also reducing cognitive bias; (2) to analyze the student’s learning curves in measuring EMD and aDOI.

Our results lead us to hypothesize that it is possible to train a student such that he/she can measure EMD and aDOI at the level of an experienced senior rater.

Methods

Training approach

Deliberate practice to improve knowledge and skills

We assumed that the student had sufficient basic knowledge about the anatomy of the ear while still lacking specific skills, i.e., techniques for evaluating the intracochlear electrode position, software handling and knowledge about the influence of image-processing on the measurement results (especially effects of contrast enhancement and filtering). To teach these skills and bring the student up to the target performance level of an experienced senior rater, “deliberate practice” as defined by Ericsson et al. [6, 7] was conducted, including adequate access to training resources, a well-qualified trainer, learning goals to be achieved by the student, immediate feedback from the trainer and repeated fresh attempts by the student to achieve the goals gradually [6, 7].

Correctives to reduce faulty data-gathering and faulty information synthesis

As mentioned above, faulty context generation is a principal factor in diagnostic errors by medical students. However, decision-making by students may be affected by other cognitive biases, as noted in the background section. Therefore, our training approach addresses the following most common factors in information synthesis performed by medical students [4]. To reduce such bias, the following correctives, based on the taxonomy of Graber et al. (2018) [3], were implemented.

Faulty data-gathering

  • Structured gathering of valid position parameters to describe the intracochlear electrode position (EMD, aDOI);

  • Use of a consensual universal co-ordinate system of the cochlea to allow comparisons between raters.

Faulty information synthesis

  • Considering several image reformations of the inner ear to detect the critical cochlear co-ordinates (e.g., round window, modiolar axis);

  • Rater’s freedom from expectations regarding the electrode position;

  • Performance benchmark (target performance level) with continuous feedback of the rater’s results; feedback when rater exceeds control limits;

  • Awareness of current evidence in cochlear-implant-imaging evaluation (recurring feedback, constructive criticism, suggestions and support);

  • Masking of relevant case information that allows conclusions about the electrode position, e.g. surgical report.

Following the idea of linear sequential unmasking (LSU) in nuclear physics [8] and forensics [9, 10], our clinical workflow in assessing the CI electrode position (EMD and aDOI measurements) was sequenced linearly as follows:

  1. (1).

    Fitting a section plane to the basal cochlear turn within the sagittal plane;

  2. (2).

    On the basis of this plane, reconstruction of the “cochlear view” (a two-dimensional cross-sectional image perpendicular to the modiolus and coplanar with the basal turn of the cochlea [11,12,13,14,15]);

  3. (3).

    Optimizing the visualization of the electrode contacts by image-filtering and adjusting the image contrast;

  4. (4).

    Applying a universal co-ordinate system with the helicotrema as center of the modiolus [12];

  5. (5).

    Detecting required landmarks (helicotrema, round window; Fig. 1);

  6. (6).

    Measuring the EMD from the center of the modiolus (helicotrema) to the center of each of the electrode contacts E1, E6, E11, E16 and E22 [16];

  7. (7).

    Defining a line from the round window through the modiolus to the lateral wall of the cochlear as reference for measuring the aDOI;

  8. (8).

    Measuring the aDOI at electrode contacts E1 and E22. The round window was set as zero degree angle [12].

Fig. 1
figure 1

Schematic illustration of the electrode-to-modiolus distance (EMD) and angular depth of insertion (aDOI) to be measured. Applying the cochlear view, EMD was measured from the center of the modiolus “M” (helicotrema) to the center of an electrode contact “E”. A line from the round window “RW” through the modiolus to the lateral wall of the cochlear was the reference for measuring aDOI

Full size image

Each of these steps was presented (unmasked) as a learning goal to the student in a sequential manner; irrelevant case information was masked as far as possible.

Design and setting of the study

The performance of the student during training (repeated feedback/measurement series) was compared with the target performance level achieved by a single senior rater. A prospective experimental study design was chosen. The study was located at a tertiary referral medical center with a cochlear-implant program.

Subjects

Imaging analysis was done within a clinical training dataset (N = 30) consisting two (repeated) EMD and aDOI measurement series of the senior rater. Subjects within this training dataset underwent cochlear implantation with a Nucleus® CI532 Slim Modiolar electrode (N = 20) or CI512 Contour Advance electrode (N = 10). Median age at implantation was 48 years (interquartile range, IQR: 30 years) and median preoperative PTA4AC was 96 dB (IQR 18 dB). PTA4AC indicated air-conduction pure-tone average threshold (0.5, 1, 2, 4 kHz) measured monaurally with circumaural headphones. Further demographic and CI-related characteristics of the subjects are given in Table 1. All subjects met the following inclusion criteria: round-window approach for intracochlear electrode insertion; absence of tip-foldovers and buckles of the electrode; absence of repeated insertions of the electrode; no anatomical abnormalities of the cochlear and auditory nerve. Furthermore, only tomography results with adequate image quality were analyzed, reducing system-related errors in distance and aDOI measurements. Adequate image quality was defined as the absence of artifacts due to motion and/or beam hardening.

Table 1 Demographic, CI-related and imaging characteristics of the subjects
Full size table

Imaging analysis

Imaging was performed during the first week after cochlear implantation as part of our clinical routine. Within the training data set, computer tomography (CT) was used for all CI512 implants and digital volume tomography (DVT) was used for all CI532 implants. Imaging parameters were consistent with respect to an imaging voltage of 70–120 kV, a tube current of 1.1–5 mA/frame with pulsed X-ray emission and an exposure time of 7 s. Resolution and isotropic voxel size are given in Table 1. EMD and aDOI values were extracted from the “cochlear view” (Fig. 1) as previously described. In order to avoid confounding bias, the influence of the type of imaging and the resolution (matrix and voxel size) on the EMD/aDOI interrater differences under investigation was analyzed. For this, statistical tests mentioned in the following section were used to compare the central tendencies of two or more samples.

The software “KaVo eXam Vision” (KaVo Dental GmbH) was available for reconstructing the cochlear view and measuring the distances directly. Each cochlear-view image was further converted to JPEG format for measurement of aDOI using the software “ImageJ” (National Institutes of Health, Bethesda, MD). The lines drawn in this sectional view (EMD) served as the basis for the angle measurements.

Data analysis

All statistical analyses were performed using the MATLAB™ software (The MathWorks, Inc., Natick, Massachusetts). The measurable variables are EMD and aDOI interrater differences (single senior rater – single student rater) in comparison of the senior’s intrarater differences (test–retest of each image by the single rater). Shewhart charts were used to check whether interrater differences appeared to be within the target range (interpercentile range of the senior rater’s intrarater differences). The interpercentile range (IPR) was defined as the distance between the 0.1th and 99.9th percentiles (P0.1 and P99.9). Since the data were not normally distributed, these percentiles were used here as control limits equivalent to ±3 standard deviation as originally defined by Shewhart [17]. Thus, results by the student are “out of control” if interrater differences exceed the IPR of the senior rater’s intrarater differences.

The Shapiro–Wilk test was applied for testing whether the data were normally distributed. Since normal distribution did not apply to all variables, the Wilcoxon test was used to compare the central tendencies of two samples, and Friedman’s test was used for comparing the central tendencies of several samples. Multiple-comparison post-hoc corrections using Dunn’s test were applied to determine which samples differed from each other. The Brown–Forsythe test was applied to compare the variance of two samples. Statistical significance was defined as p < 0.05.

Intrarater reliability was analyzed by intraclass correlation and Bland–Altman analysis. Intraclass correlation coefficient (ICC) was also used to calculate the strength of agreement between the two raters. Following the convention for intraclass correlation by McGraw and Wong [18], a 2-way mixed-effects model, multiple raters/measurements type with absolute agreement definition was chosen.

Results

Analysis of target performance

Intrarater reliability was calculated as the difference from two EMD and aDOI measurement series (test–retest) made by a single senior rater served as target performance level for the student. To present results clearly, EMD was summarized across all five electrode contacts measured (EMD5). Neither central tendencies (p = 0.77) nor variances (p = 0.24) of the senior’s intrarater EMD5 differences differed statistically among these five electrode contacts. However, statistically significant differences were found in the variances of aDOI measurement series differences between contacts E1 and E22 (p < 0.001); therefore, these results were further analyzed, separately, for each of those contacts.

Sufficient intrarater reliability of the senior rater was ensured by means of intraclass correlation and Bland–Altman analysis. For EMD5, the intraclass correlation coefficient ranged from 0.98 to 0.99, corresponding to an excellent intrarater reliability [19]. Intrarater reliability ranged from good to excellent for aDOI at electrode contacts E1 and E22, with ICC ranging from 0.82 to 0.96 and from 0.91 to 0.98, respectively.

As the intraclass correlation coefficient is expected to be high in repeated measurements by a single rater, intraclass correlation was supplemented by a Bland–Altman analysis. For EMD5, the median difference (median bias) was 0 mm for the senior rater (Fig. 2; percentiles P0.1/P99.9 = ± 0.5 mm). Analyzing the aDOI at electrode contacts E1 and E22 revealed a median difference of − 1° and 0°, respectively (Fig. 3). The percentiles P0.1 and P99.9 were found to be − 5° and 8° for E1 and − 14° and 16° for E22. Median bias and spread did not vary with the average of the two measurement series, for all three variables (EMD5, aDOI at E1, aDOI at E22).

Fig. 2
figure 2

Differences versus averages of two EMD measurement series made by a senior rater (N = 30). Applying the cochlear view, EMD was measured from the center of the modiolus (helicotrema) to the center of each of the electrode contacts E1, E6, E11, E16 and E22. A bold solid line indicates the median value (bias) of the senior rater’s intrarater differences; both dotted lines cover the 0.1th to 99.9th interpercentile range

Full size image
Fig. 3
figure 3

Differences versus averages of two aDOI measurement series made by a senior rater (N = 30). Applying the cochlear view, a line from the round window through the modiolus to the lateral wall of the cochlear was the reference for measuring the aDOI at electrode contacts E1 (left panel) and E22 (right panel). A bold solid line indicates the median value (bias) of the senior rater’s intrarater differences; both dotted lines cover the 0.1th to 99.9th interpercentile range

Full size image

Learning curves of the student rater

The Shewhart control chart for EMD5 is shown in Fig. 4. In each measurement series by the student, interrater EMD5 differences (average of two series by the senior rater relative to the student) were plotted. Error bars cover the IPR of these interrater differences, according to the control limits given by the (intrarater) IPR of the senior rater. Interrater differences did not differ from senior intrarater differences in any of the four measurement series when central tendencies were compared (p = 0.46). However, a learning effect was observed with respect to the scatter of the interrater differences. This scatter became smaller with successive measurement series; the target performance level was achieved in the 4th series. The intraclass correlation coefficient for the interrater IPR of this final series and the intrarater IPR of the senior rater ranged from 0.98 to 0.99.

Fig. 4
figure 4

Shewhart chart of a student measuring EMD (N = 30). In each measurement series, interrater EMD differences (average of two series by a senior rater – student) are plotted. Error bars cover the 0.1th to 99.9th interpercentile range (IPR) of these interrater differences, according to the control limits given by the senior rater’s intrarater IPR (dotted lines). A bold solid line indicates the median value of the senior rater’s intrarater differences. Median interrater differences are linked across the four measurement series by a thin solid line

Full size image

Analysis of interrater aDOI differences at electrode contacts E1 and E22 also showed a reduction in their scatter along the measurement series (Fig. 5). Compared with the EMD5 results, however, an interrater IPR less than or equal to the senior rater’s intrarater IPR was already achieved with the third measurement series. Intraclass correlation coefficient for the interrater IPR of this final series and the intrarater IPR of the senior rater ranged from 0.71 to 0.93 (E1) and from 0.88 to 0.97 (E22).

Fig. 5
figure 5

Shewhart chart of the student measuring the aDOI at electrode contact E1 (left panel) and E22 (right panel). In each of the student’s measurement series, interrater EMD differences (average of two series by a senior rater – student; N = 30) are plotted. Error bars show the 0.1th to 99.9th interpercentile range (IPR) of these interrater differences, according to the control limits given by the intrarater IPR of the senior rater (dotted lines). A bold solid line indicates the median value of the senior rater’s intrarater differences. Median interrater differences are linked across the three measurement series by a thin solid line

Full size image

In both electrode types (CI512, CI532) and electrode contacts (E1, E22) tested, Friedman’s test indicated significant differences between the four data samples (interrater differences in measurement series 1 to 3; senior intrarater differences; p < 0.05). Post-hoc analysis revealed statistically significant differences between the student’s first series and all others (for E1) and between this first series and the senior’s intrarater differences (E22; Dunn’s test, p < 0.05). Thus, in contrast to the EMD5 findings, the aDOI results in the first measurement series differed from the target range not only in scatter, but also in central trend.

Confounding analysis

We identified the type of implant and imaging technique, and also image resolution and voxel size, as potential confounding variables in measuring the EMD and aDOI. Since CT was used for all CI512 implants and DVT was used for all CI532 implants, confounder analysis for type was done only once (CI512/CT versus CI532/DVT). Similarly for the image resolution, where the matrix and voxel size were linked: resolution low (640 × 640 and 0.25 mm), medium (800 × 600 and 0.2 mm) and high (1280 × 1280 and 0.125 mm). For both confounding variables, we investigated whether there were statistically significant differences in interrater differences between the characteristics.

Considering the EMD5, no significant differences were found for type (p = 0.99) or resolution (p = 0.86).

In contrast, aDOI measurements at electrode contact E22 revealed a significant difference for type (p < 0.01). Interrater differences for C512/CT measurements were lower than for CI532/DVT (median − 9° versus 1°, IPR 28° versus 17°) – i.e., the student reported greater aDOI values in CI512/CT than the senior rater. However, at electrode contact E1, interrater aDOI differences did not differ significantly between the two types (p = 0.06).

Considering the image resolution for interrater aDOI differences at electrode contacts E1 and E22, Friedman’s test indicated significant differences between the resolution categories (low/medium/high; p < 0.05). Post-hoc analyses revealed significantly different mean ranks for the low- and high-resolution samples (Dunn’s test, p < 0.05). The median of the aDOI differences was shifted to more negative values for the low resolution (E1: –4° with IPR 7 degree; E22: –8°, IPR 17°) than for the high resolution (E1: 0°, IPR 10°; E22: 3°, IPR 28°). This resulted from larger measured aDOI values of the student in images with low resolution compared with those of high resolution.

Nevertheless, confounding effects of implant/imaging type and resolution on aDOI were within the intrarater IPR of the senior rater, so no further allowance was made for them.

Discussion

Even with the introduction of automated tools for analyzing post-operative CI images [20,21,22,23,24], the manual evaluation of CI electrode position is still of general interest in clinical practice. However, findings can be missing or misinterpreted. For such diagnostic errors, sources of cognitive bias are of great importance, and can influence both experienced and inexperienced raters [4, 5]. Therefore, clinical quality assurance should both address the training of inexperienced raters and monitor continuously the performance of experienced raters.

To the best of our knowledge, no quality–assurance methods exist to train inexperienced raters in clinical evaluation of the CI electrode position. In this study, we introduce an approach that enabled a medical student to measure electrode-to-modiolus distances and angular insertion depth, both at the performance level of an experienced rater. This training approach requires time, staff and material resources, but is in line with international demands on clinical quality assurance [25, 26].

Moreover, the performance data within this training approach can be used as a benchmark to establish an ongoing clinical quality control. Benchmarking diagnostic performance is a key corrective strategy for reducing cognitive bias and has already been described as useful for quality control in radiology [1, 27, 28]. This seems reasonable, as raters are apparently vulnerable to heuristic failures, even when their learning process is complete [5].

Owing to the simplicity of this process, especially with regard to the small number of measurement series made by the student, we decided to use a Shewhart chart (an established statistical control tool in economics) to monitor training success [17]. However, Shewhart analysis is inefficient in detecting small changes (up to ±2 standard deviations) of the variable being monitored [29]. Thus, further clinical benchmarking could combine a Shewhart control chart with an analysis of cumulative sums (CUSUM) [30, 31]. A CUSUM chart is more efficient in detecting small changes in the process mean, as the control limits are more complex in design than with Shewhart (mostly V-mask design versus constant terms). Although the design of a CUSUM control chart may be complex, it has already been shown useful in evaluating competence in clinical procedures [32,33,34,35].

Use of even reference (target) data obtained by a single senior rater may limit their representativeness compared with a benchmark with data from several experienced raters. However, this work was to test only the general procedure, as a proof of concept. The measurable variables (EMD and aDOI differences between student and senior rater) were therefore compared with the latter’s intrarater differences for independence of the EMD and aDOI magnitude: the senior rater’s intrarater reliability in measuring EMD and aDOI was conformed by both correlations and by a Bland–Altman analysis. Nevertheless, our results simply demonstrate successful learning curves in measuring EMD and aDOI for a single student compared with a single senior rater.

For the last measurement series of both EMD and aDOI, the median was close to zero for intrarater differences of the senior rater as well as for interrater differences. However, we also analyzed the scatter. Following common practice in Shewhart analysis, this scatter covered 99.8% of data (± 3 standard deviations as defined by Shewhart [17]). Intrarater EMD differences (± 0.5 mm), on the one hand, were greater than the resolution used here (≤ 0.25 mm) and are thus clinically relevant. Nonetheless, the literature lacks comparative data for intrarater and interrater EMD differences. In several studies electrode-to-modiolus distances in cochlear implants was measured [16, 36,37,38,39,40,41,42,43,44]. However, information on intrarater or interrater differences is omitted, or simply the agreement between two raters is calculated; this was found to be similar to our results (ICC for EMD between 0.77 and 1 [40]).

In contrast to EMD, Fernandes et al. (2018) [45] measured aDOI and found a mean difference of − 0.9° with a standard deviation of 43°. Since interrater differences were calculated for several raters, a greater scatter seems reasonable compared with the intrarater dispersion (up to 16°) for the single rater in the present study. Svrakic et al. (2015) [46] observed average intrarater aDOI differences within 10°, but provide no data on dispersion. Furthermore, without reporting intrarater or interrater differences, Escudé et al. (2006) [47] stated that aDOI measurements were performed by highly experienced radiologists. As cognitive bias can lead to diagnostic errors even for experienced raters, we suggest always quantifying the error made by the rater(s) when interpreting measurements in CI imaging. The central tendency and the scatter of intrarater/interrater differences should be indicated.

Conclusions

Evaluating CI electrode position by subjective image-processing may be affected by cognitive bias. The training of inexperienced raters marks the first step toward quality-assured evaluation of CI images. By the training approach presented here, a single medical student became able to measure electrode-to-modiolus distances and insertion-depth angles at the performance level of a single senior rater. This approach should allow systematic teaching of knowledge and skills while applying corrective strategies to reduce faulty data-gathering and synthesis. Shewhart control charts can be used to monitor individual learning curves. Benchmarking the performance as a key corrective strategy can provide a basis for ongoing clinical quality assurance in evaluating the CI electrode position. This should also include quantifying the error made by rater(s) in interpreting measurements in CI imaging.

Availability of data and materials

All data obtained and analyzed during this study are included in this published article and its supplementary information files.

Abbreviations

EMD:

Electrode-to-Modiolus Distance

aDOI:

Angular Depth Of Insertion

CI:

Cochlear Implant

CT:

Computer Tomography

DVT:

Digital Volume Tomography

LSU:

Linear Sequential Unmasking

IQR:

Interquartile Range

PTA4AC:

Air-Conduction Pure-Tone Average threshold (0.5, 1, 2, 4 kHz)

IPR:

Interpercentile Range

ICC:

Intraclass Correlation Coefficient

CUSUM:

Analysis of Cumulative Sums

References

  1. Lee CS, Nagy PG, Weaver SJ, Newman-Toker DE. Cognitive and system factors contributing to diagnostic errors in radiology. Am J Roentgenol. 2013;201(3):611–7.

    Article  Google Scholar 

  2. Busby LP, Courtier JL, Glastonbury CM. Bias in radiology: the how and why of misses and misinterpretations. Radiographics. 2018;38(1):236–47.

    Article  Google Scholar 

  3. Graber ML, Franklin N, Gordon R. Diagnostic error in internal medicine. Arch Intern Med. 2005;165(13):1493–9.

    Article  Google Scholar 

  4. Braun LT, Zwaan L, Kiesewetter J, Fischer MR, Schmidmaier R. Diagnostic errors by medical students: results of a prospective qualitative study. BMC Med Educ. 2017;17(1):1–7.

    Article  Google Scholar 

  5. Kahneman D. Thinking, fast and slow. New York: Farrar, Straus & Giroux; 2011. p. 19–89.

    Google Scholar 

  6. Ericsson KA, Krampe RT, Tesch-Römer C. The role of deliberate practice in the acquisition of expert performance. Psychol Rev. 1993;100(3):363–406.

    Article  Google Scholar 

  7. Ericsson KA, Harwell KW. Deliberate practice and proposed limits on the effects of practice on the acquisition of expert performance: why the original definition matters and recommendations for future research. Front Psychol. 2019;10:2396.

    Article  Google Scholar 

  8. Klein JR, Roodman A. Blind analysis in nuclear and particle physics. Annu Rev Nucl Part Sci. 2005;55:141–63.

    Article  Google Scholar 

  9. Dror IE, Thompson WC, Meissner CA, Kornfield I, Krane D, Saks M, et al. Letter to the editor- context management toolbox: a linear sequential unmasking (LSU) approach for minimizing cognitive bias in forensic decision making. J Forensic Sci. 2015;60(4):1111–2.

    Article  Google Scholar 

  10. Krane DE, Ford S, Gilder JR, Inman K, Jamieson A, Koppl R, et al. Sequential unmasking: a means of minimizing observer effects in forensic DNA interpretation. J Forensic Sci. 2008;53(4):1006–7.

    Article  Google Scholar 

  11. Cohen LT, Xu J, Xu SA, Clark GM. Improved and simplified methods for specifying positions of the electrode bands of a cochlear implant array. Am J Otol. 1996;17(6):859–65.

    Google Scholar 

  12. Verbist BM, Skinner MW, Cohen LT, Leake PA, James C, Boëx C, et al. Consensus panel on a cochlear coordinate system applicable in histologic, physiologic, and radiologic studies of the human cochlea. Otol Neurotol. 2010;31(5):722–30.

    Article  Google Scholar 

  13. Xu J, Xu SA, Cohen LT, Clark GM. Cochlear view: postoperative radiography for cochlear implantation. Am J Otol. 2000;21(1):49–56.

    Article  Google Scholar 

  14. Eisenhut F, Lang S, Taha L, Doerfler A, Iro H, Hornung J. Merged volume rendered flat-panel computed tomography for postoperative cochlear implant assessment. Clin Neuroradiol. 2020;30(4):721–8.

    Article  Google Scholar 

  15. Struffert T, Hertel V, Kyriakou Y, Krause J, Engelhorn T, Schick B, et al. Imaging of cochlear implant electrode array with flat-detector CT and conventional multislice CT: comparison of image quality and radiation dose. Acta Otolaryngol. 2010;130(4):443–52.

    Article  Google Scholar 

  16. Mewes A, Brademann G, Hey M. Comparison of perimodiolar electrodes: imaging and electrophysiological outcomes. Otol Neurotol. 2020;41(7):e934–44.

    Article  Google Scholar 

  17. Shewhart WA. Economic control of quality of manufactured product. New York: Van Nostrand; 1931.

    Google Scholar 

  18. McGraw KO, Wong SP. Forming inferences about some Intraclass correlation coefficients. Psychol Methods. 1996;1(1):30–46.

    Article  Google Scholar 

  19. Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15(2):155–63.

    Article  Google Scholar 

  20. Noble JH, Schuman TA, Wright CG, Labadie RF, Dawant BM. Automatic identification of cochlear implant electrode arrays for post-operative assessment. In: Med Imaging 2011 Image Process, vol. 7962; 2011. p. 796217.

    Chapter  Google Scholar 

  21. Zhao Y, Dawant BM, Labadie RF, Noble JH. Automatic localization of cochlear implant electrodes in CT. Med Image Comput Comput Assist Interv. 2014;17(Pt 1):331–8.

    Google Scholar 

  22. Noble JH, Dawant BM. Automatic graph-based localization of cochlear implant electrodes in CT. Med Image Comput Comput Assist Interv. 2015;9350:152–9.

    Google Scholar 

  23. Bennink E, Peters JPM, Wendrich AW, Jan Vonken E, Van Zanten GA, Viergever MA. Automatic localization of cochlear implant electrode contacts in CT. Ear Hear. 2017;38(6):e376–84.

    Article  Google Scholar 

  24. Zhao Y, Labadie RF, Dawant BM, Noble JH. Validation of automatic cochlear implant electrode localization techniques using μCTs. J Med Imaging. 2018;5(03):1.

    Article  Google Scholar 

  25. EN ISO 9000:2015, Quality management systems - Fundamentals and vocabulary.

    Google Scholar 

  26. EN ISO 9001:2015: Quality management systems - Requirements.

    Google Scholar 

  27. Soffa DJ, Lewis RS, Sunshine JH, Bhargavan M. Disagreement in interpretation: a method for the development of benchmarks for quality assurance in imaging. J Am Coll Radiol. 2004;1(3):212–7.

    Article  Google Scholar 

  28. Ruutiainen AT, Scanlon MH, Itri JN. Identifying benchmarks for discrepancy rates in preliminary interpretations provided by radiology trainees at an academic institution. J Am Coll Radiol. 2011;8(9):644–8.

    Article  Google Scholar 

  29. Montgomery DC. Introduction to statistical quality control. New York: Wiley; 1996.

    Google Scholar 

  30. Wald A. Sequential Analysis. New York: Wiley; 1947.

    Google Scholar 

  31. Page ES. Continous inspection schemes. Biometrika. 1984;41(1–2):100–15.

    Google Scholar 

  32. Van Rij AM, McDonald JR, Pettigrew RA, Putterill MJ, Reddy CK, Wright JJ. Cusum as an aid to early assessment of the surgical trainee. Br J Surg. 1995;82(11):1500–3.

    Google Scholar 

  33. Hammond EJ, McIndoe AK. Cusum: a statistical method to evaluate competence in practical procedures. Br J Anaesth. 1996;77(4):562.

    Article  Google Scholar 

  34. Novick RJ, Stitt LW. The learning curve of an academic cardiac surgeon: use of the CUSUM method. J Card Surg. 1999;14(5):312–20.

    Article  Google Scholar 

  35. Bolsin S, Colson M. The use of the cusum technique in the assessment of trainee competence in new procedures. Int J Qual Heal Care. 2000;12(5):433–8.

    Article  Google Scholar 

  36. Balkany TJ, Eshraghi AA, Yang N. Modiolar proximity of three perimodiolar cochlear implant electrodes. Acta Otolaryngol. 2002;122(4):363–9.

    Article  Google Scholar 

  37. Husstedt HW, Aschendorff A, Richter B, Laszig R, Schumacher M. Nondestructive three-dimensional analysis of electrode to modiolus proximity. Otol Neurotol. 2002;23(1):49–52.

    Article  Google Scholar 

  38. Saunders E, Cohen L, Aschendorff A, Shapiro W, Knight M, Stecker M, et al. Threshold, comfortable level and impedance changes as a function of electrode-modiolar distance. Ear Hear. 2002;23(Suppl 1):28–40.

    Article  Google Scholar 

  39. Van Wermeskerken GKA, Van Olphen AF, Graamans K. Imaging of electrode position in relation to electrode functioning after cochlear implantation. Eur Arch Oto-Rhino-Laryngology. 2009;266(10):1527–31.

    Article  Google Scholar 

  40. Verbist BM, Joemai RMS, Briaire JJ, Teeuwisse WM, Veldkamp WJH, Frijns JHM. Cochlear coordinates in regard to cochlear implantation: a clinically individually applicable 3 dimensional CT-based method. Otol Neurotol. 2010;31(5):738–44.

    Article  Google Scholar 

  41. Esquia Medina GN, Borel S, Nguyen Y, Ambert-Dahan E, Ferrary E, Sterkers O, et al. Is electrode-modiolus distance a prognostic factor for hearing performances after cochlear implant surgery? Audiol Neurotol. 2015;18(6):406–13.

    Article  Google Scholar 

  42. Long CJ, Holden TA, McClelland GH, Parkinson WS, Shelton C, Kelsall DC, et al. Examining the electro-neural interface of cochlear implant users using psychophysics, CT scans, and speech understanding. J Assoc Res Otolaryngol. 2014;15(2):293–304.

    Article  Google Scholar 

  43. Davis TJ, Zhang D, Gifford RH, Dawant BM, Labadie RF, Noble JH. Relationship between electrode-to-modiolus distance and current levels for adults with cochlear implants. Otol Neurotol. 2016;37(1):31–7.

    Article  Google Scholar 

  44. Van Der Beek FB, Briaire JJ, Van Der Marel KS, Verbist BM, Frijns JHM. Intracochlear position of cochlear implants determined using CT scanning versus fitting levels: higher threshold levels at basal turn. Audiol Neurotol. 2016;21(1):54–67.

    Article  Google Scholar 

  45. Fernandes V, Wang Y, Yeung R, Symons S, Lin V. Effectiveness of skull X-RAY to determine cochlear implant insertion depth. J Otolaryngol Head Neck Surg. 2018;47(1):1–7.

    Article  Google Scholar 

  46. Svrakic M, Friedmann DR, Berman PM, Davis AJ, Roland JT, Svirsky MA. Measurement of cochlear implant electrode position from intraoperative post-insertion skull radiographs. Otol Neurotol. 2015;36(9):1486–91.

    Article  Google Scholar 

  47. Escudé B, James C, Deguine O, Cochard N, Eter E, Fraysse B. The size of the cochlea and predictions of insertion depth angles for cochlear implant electrodes. Audiol Neurotol. 2006;11(Suppl 1):27–33.

    Article  Google Scholar 

Download references

Acknowledgements

Not applicable.

Funding

Open Access funding enabled and organized by Projekt DEAL.

Author information

Authors and Affiliations

  1. Universitätsklinikum Schleswig-Holstein (UKSH), Campus Kiel, Department of Otorhinolaryngology, Head and Neck Surgery, Kiel, Germany

    Alexander Mewes, Goetz Brademann, Jan Andreas Dambon & Matthias Hey

  2. Christian-Albrechts-Universität (CAU) zu Kiel, Faculty of Medicine, Kiel, Germany

    Sebastian Burg

Authors
  1. Alexander Mewes
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Sebastian Burg
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Goetz Brademann
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Jan Andreas Dambon
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Matthias Hey
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

The study was designed by AM and MH. AM and SB collected the data. AM analyzed and interpreted the data. The manuscript was written by AM. All authors read and approved the final manuscript.

Corresponding author

Correspondence to Alexander Mewes.

Ethics declarations

Ethics approval and consent to participate

The Ethics Committee at the Faculty of Medicine of Kiel University (CAU) approved all experimental protocols (reference: D457/20). Informed consent was obtained from all subjects as part of a general declaration of consent in clinical research. We confirm that all methods were carried out in accordance with relevant guidelines and regulations.

Consent for publication

Not applicable.

Competing interests

AM, GB, JAD and MH declare general financial support by Cochlear Ltd. (research grant to institution). Cochlear Ltd. was not involved in the study design, data collection and analysis, decision to publish, or preparation of this manuscript. JAD receives financial support within the framework of the clinician-scientist program of Kiel University’s faculty of medicine. SB received no financial support for the research, authorship or publication of this article.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

The raw aDOI and EMD data collected from imaging for analysis. M1 indicates measurement series no. 1, M2 series no. 2, etc.

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Mewes, A., Burg, S., Brademann, G. et al. Quality-assured training in the evaluation of cochlear implant electrode position: a prospective experimental study. BMC Med Educ 22, 386 (2022). https://doi.org/10.1186/s12909-022-03464-x

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-022-03464-x

Keywords

BMC Medical Education

ISSN: 1472-6920

Contact us