- Research
- Open access
- Published:
Learning curves of novice residents on cataract surgery simulator: the E3CAPS pedagogic study
BMC Medical Education volume 24, Article number: 1078 (2024)
Abstract
Introduction
Training novice ophthalmology residents on the EyeSi® simulator increases cataract surgery safety. However, there is no consensus regarding how much training residents should perform before their first time on patients. We evaluated the French national training program through the analysis of the learning curves of novice residents.
Methods
This prospective multicentric pedagogic study was conducted with French novice residents. Each resident completed the recommended four two-hour training sessions and performed a standardized assessment simulating standard cataract surgery before the first session (A0), at the end of the first (A1), second (A2), third (A3) and fourth (A4) sessions. For each surgical step of each attempt, the following data were collected: score, odometer, completion time, posterior capsular rupture and cumulative energy delivered (ultrasounds) during phacoemulsification. A performance threshold was set at a score of 80/100 for each surgical step, 400/500 for the overall procedure. Only descriptive statistics were employed.
Results
Sixteen newly nominated ophthalmology residents were included. Median score progressively increased from 95 [IQR 53; 147]) at A0 to 425 [IQR 411; 451] at A4. Despite a significant progression, the “emulsification” step had the lowest A4 scores 86 [IQR 60; 94] without reduction in completion time, odometer or ultrasounds delivered. The rate of posterior capsular rupture decreased linearly from 75% at A0 to 13% at A4 during “emulsification” and from 69 to 0% during “irrigation and aspiration”. At A4, only 25% [8; 53] of residents had > 80 at each step and only 75% [47; 92] had > 400/500 overall.
Conclusion
A training program consisting of four two-hour sessions on the EyeSi simulator over four consecutive days effectively enhances the surgical skills of novice ophthalmology residents. Undergoing more training sessions may improve scores and decrease the incidence of surgical complications, particularly at the emulsification step of cataract surgery. The learning curves presented here can reassure residents who are progressing normally and help identify those who need a further personalized training program.
Trial registration
ClinicalTrials registration number: NCT05722080 (first submitted 22/12/2022, first posted 10/02/2023).
Introduction
Cataract surgery is the most frequent surgical procedure worldwide: approximately 1 million procedures are performed in France each year [1] and about 80 million people have moderate or severe distance vision impairment or blindness due to cataract [2]. This procedure under operating microscope demands a high level of expertise due to the risk of surgical complications, notably rupture of the posterior capsule, which is the main vision-threatening intraoperative complication [3]. In fact, the incidence of posterior capsular rupture is higher in patients operated on by ophthalmology residents (5 to 19%) [4,5,6,7,8,9,10] than by experienced surgeons (0.5 to 3.5%) [11]. While these complication rates seem relatively minor, they finally impact many patients. This partly explains the difficulties in accessing real-life surgical training. In two surveys involving hundreds of residents from more than 30 European countries, 42% were completely dissatisfied with the surgical skills achieved and more than 25% had not undergone any live cataract surgery training by the end of residency [12, 13]. Many residents must therefore continue their training after the end of their residency. Alternative teaching methods for cataract surgery are: theoretical learning, observation of surgeons in real life and manipulation of porcine eyes or artificial eyes. Rehearsing surgical steps on porcine eyes or artificial eyes is useful but insufficient because of significant differences in tissue thickness and texture and resistance compared to human eye. In France, cataract surgery is taught throughout the 4-year residency, in successive stages: theoretical training, practical work on pig’s eyes, artificial eyes and virtual simulator, then gradual training in real life one surgical step at a time, under the supervision of a senior surgeon. Full surgeries are then performed under supervision once each step has been mastered individually, and unsupervised surgeries are possible after the end of the 4-year residency.
Using cataract surgery simulators is a valuable approach to moderate the risks associated with training and support the “never the first time on a patient” principle set by the French National Health Agency (ANSM) [14]. The EyeSi® surgical simulator (VRMagic, Mannheim, Germany) holds the highest usage rate in France: it enables to virtually execute the majority of the steps involved in cataract surgery, adjusting the complexity level and providing the student with both qualitative and quantitative evaluations for each surgical step. The benefits of using the EyeSi® in resident training have been shown: the score achieved on the simulator correlates with various real-life surgical skill scores; the simulator distinguishes between skilled and novice operators, enhances surgical skill scores of both novice and experienced surgeons and decreases the occurrence of surgical complications [9, 15,16,17,18,19,20,21,22].
However, access to the simulator is hampered by many factors: expensive and limited equipment, travel time and cost, limited availability of the residents and teachers also taken up by other essential learning activities [23,24,25]. Organizing rigorous simulation training in all residency training centers before the first surgery on a patient is needed but challenging: determining the minimum number of training sessions is needed to lay the foundations of an effective and realistic resident training program. In France, the “Collège des Ophtalmologistes Universitaires de France” (COUF) recommends undergoing 4 simulation sessions, each lasting 2 h, during the initial year of residency.
The aim of the present study is to evaluate the relevance of the French training program through analysis of the learning curve of novice ophthalmology residents undergoing 4 simulation sessions. We hypothesize that it will improve the training program by determining whether additional training sessions are needed and which surgical steps are the most difficult for students to master.
Methods
Design and intervention
This prospective interventional study corresponds to Axis 1 of the E3CAPS pedagogic study (ClinicalTrials registration number: NCT05722080 (first submitted 22/12/2022, first posted 10/02/2023). The methodology of the study and the technical specifications of the EyeSi simulator have been previously described in detail [26]. Briefly, The EyeSi surgical simulator is a high-fidelity virtual reality simulator that includes a platform on which a patient’s head dummy is placed. The resident inserts two handpieces into a digital box positioned in place of the eye and uses a realistic two-axis phaco foot pedal to interact with the virtual operating field created by stereoscopy via operating microscope eyepieces placed above the platform. This installation provides a highly immersive reproduction of real-life conditions. Training modules include navigation training exercises and most steps of cataract surgery: capsulorhexis, hydromaneuver, phacoemulsification, irrigation and aspiration, intraocular lens (IOL) insertion and posterior capsular rupture management. Throughout the simulation, a digital interface provides real-time feedback and assigns positive points for completed tasks and negative points for errors, inappropriate or dangerous gestures, eye tissue injury or eye shift. Finally, the simulator provides a score for each attempt.
Each resident completed four two-hour training sessions over a period of 4 consecutive days under the supervision of an experienced cataract surgery educator. To increase the session’s relevance and manage resident fatigue, each two-hour session was divided into four 30-minute training periods, followed by four 30-minute recovery or observation periods, alternating with another resident. To measure the learning curve, each resident performed a standardized assessment at the beginning of the first session (A0), then repeated at the end of the first (A1), second (A2), third (A3) and fourth (A4) sessions. Additional assessments of the capsulorhexis step alone were performed at the beginning of the second (pre-A2), third (pre-A3) and fourth (pre-A4) sessions: this served to assess any loss since the end of the previous session. To avoid inducing fatigue or reducing the length of the training session, the capsulorhexis step was chosen because it is short, difficult to master and responsible for critical surgical complications.
The following data were collected for each resident: age, sex and dominant hand. To account for any population heterogeneity, real-life surgical practice experience was assessed using the number of attempts of any task performed in the operating room (incision, capsulorhexis, hydromaneuver, phaco-emulsification, irrigation and aspiration, IOL insertion, viscous removal, stromal hydratation for incision closure).
This clinical study was approved by the Ethics Committee of Nantes University on October 17th, 2022. The clinical study was conducted in accordance with the French Public Health Code, national and international Good Clinical Practice (GCP) guidelines, and the Declaration of Helsinki, each in the applicable version.
Participant and sample size
Given the exploratory nature of this study, the sample selected was a convenience sample, represented by the 16 newly nominated ophthalmology residents in the participating University Hospitals of Nantes, Tours, Angers and Rennes. All study participants provided written informed consent to participate. The only exclusion criterion was the absence of written consent.
Outcomes
A standardized assessment took approximately 20–30 min and consisted of the following exercises: capsulorhexis level 1, hydromaneuver level 2, phacoemulsification divide and conquer level 6, irrigation and aspiration level 3 and IOL insertion level 3. Exercises were chosen and placed in the correct order to simulate a complete standard cataract surgery. For each attempt, the following data were collected: EyeSi score (ranging from 0 to 100), distance traveled in the eye by the instruments (odometer in millimeters), completion time, posterior capsular rupture (during phacoemulsification and irrigation and aspiration) and amount of energy delivered by ultrasounds (during phacoemulsification). To ensure that the same instructions were given to all residents, standardized instructions were given orally by a Senior Surgeon Investigator (JBD) based on a written document. Assessments were performed without any student present in the room to avoid competition bias. The results of each attempt remained anonymous and confidential. They were given privately to each resident after the completion of the Axis 1 study.
Data analysis
Quantitative variables were described by their median and interquartile range (IQR). For categorical variables, the frequencies and percentages for each modality were displayed. A learning curve was derived from the plot of the score against the number of sessions. The percentage of residents reaching the performance threshold (success defined as: 80/100 for each surgical step, 400/500 for the overall procedure) at the end of each attempt and its 95% confidence interval were estimated. To assess the impact of previous real-life surgical practice experience, overall scores of residents with more than 10 real-life attempts of any surgical step were compared to the scores of residents with strictly less than 10 at A0 and A4 (Wilcoxon rank-sum test for independent data). An alpha risk of 5% was used. Statistical analyses were performed using R (version 4.0.2) [27]. Figures were drawn using the ggplot2 package [28].
Results
Study population
All sixteen newly appointed ophthalmology residents in November 2022 were included during their third month of residency. The first resident was enrolled on January 9th, 2023, and the last resident ended their training program on January 30th, 2023. Residents’ median age was 25.5 [25.0; 26.0] and the proportion of women was 44% (Table 1). Surgical practice experience was low: fifteen (94%) had never performed real-life corneal incisions, capsulorhexis, hydromaneuver and phacoemulsification. Some had made a few attempts at irrigation and aspiration (4/16, 25%) and IOL insertion (6/16, 37%).
EyeSi scores
The multidimensional curves of overall progression show a linear increase in score and decrease in completion time and odometer, associated with a decrease in variance without a plateau (Fig. 1). Throughout the training sessions, the median score increased progressively from 95 [IQR 53; 147] at A0 to 425 [411; 451] at A4 (E-Table 1). No significant difference in overall score was observed between residents who had more than 10 real-life attempts of any surgical step and residents with fewer than 10 at A0 (100 [IQR 86.5; 152] versus 69 [IQR 39; 141] respectively, p = 0.60) and A4 (445 [IQR 400; 454] versus 422 [IQR 418; 444] respectively, p = 0.63).
The “capsulorhexis” step showed a linear increase in score with reduction in variance without reaching a plateau. Completion time and odometer decreased linearly without a plateau or reduction in variance. Additional “capsulorhexis” assessments at the beginning of each training session revealed high inter-individual and intra-individual variability during the first 3 sessions with a tendency to decrease compared with the previous session (E-Figure 1).
The “hydromaneuver” step had the least valid learning curve (E-Figure 2). The score at the first assessment before any training (A0) was unusually high and represented the only step for which the median A0 score was higher than 0 (36 [0; 75]).
The scores for the “emulsification” step were the lowest with a lower interquartile < 80 (86 [60; 94] at A4. While the increase in score for the “emulsification” step was linear, it did not reach a plateau and was not associated with a reduction in completion time and odometer of ultrasounds delivered.
The learning curves of the “irrigation and aspiration” step had a negative exponential shape and reached a plateau with the highest decrease in variance. This was the step for which the residents had the highest final scores (median 98 [96; 100]).
The “IOL insertion” step showed a linear increase in score with reduction in variance without reaching a plateau. Completion time and odometer did not decrease throughout the training program (E-Figure 2).
Success rates
The overall average success rate progressively increased throughout the training sessions from 0.0% [0.0; 24.1] at A0 to 75.0% [47.4; 91.7] at A4 (Fig. 2 and E-Table 2). Although the residents’ scores progressed for the 5 steps, progression was found to be heterogeneous: slow for the “emulsification” step for which the success rate at A4 was 56.2% [30.6; 79.2] and rapid for “irrigation and aspiration”, for which the success rate was 87.5% [60.4; 97.8] at A3 and 93.8% [67.7–99.7] at A4. Moreover, the percentage of residents who consecutively succeeded each of the 5 steps at A4 was 25.0% [8.3; 52.6].
Posterior capsular rupture
The average rates of posterior capsular rupture decreased from 75% (12/16) at A0 to 12% (2/16) at A4 during the “emulsification” step and from 69% (11/16) at A0 to 0% at A4 during the “irrigation and aspiration” step (E-Table 1). The decrease was linear and continuous throughout the training program (Fig. 3).
Discussion
In the present study, we provide valid and valuable learning curves of residents during a training program including four two-hour EyeSi simulator sessions, conducted over four consecutive days. First, “irrigation and aspiration” was the only step mastered by residents at the end of the training program. Given the risk of posterior capsular rupture during this surgical step, the learning curve for “irrigation and aspiration” is particularly reassuring for skill transfer in the operating room. Second, the “emulsification” step was the most difficult to perform for students who had a large number of insufficient scores at the end of the training program (i.e. 56.2% success rate, for more information see E-Table 3) with no reduction in completion time and odometer. Third, because the “hydromaneuver” step has the least valid learning curve, it cannot be used to assess a student’s progression. Fourth, the rate of posterior capsular rupture decreased linearly throughout the training program, but remained abnormally high at the end when compared to the incidence reported in the literature [10]. The dynamics of the curves and capsular rupture rate suggest that more than four EyeSi training sessions would be beneficial for obtaining better scores and fewer surgical complications.
Aditya et al. analyzed heart rate variations in residents during real-life cataract surgery and discovered that emulsification was the most stressful step for residents and therefore should benefit from special preparation [29], as we also observed. Belyea et al. found that resident training on the Eyesi Surgical Simulator resulted in a reduction in time to perform phacoemulsification with a reduction in the use of ultrasound power. As we did not observe reduction in emulsification completion time or in ultrasound power used, this result supports our conclusion that more than four training sessions are required to observe further progression [30]. Al-Jindan et al. assessed 200 real-life surgeries performed by 22 residents: the steps that most frequently required assistance, in descending order, were emulsification, capsulorhexis, and irrigation and aspiration. Conversely, the steps where surgical complications most commonly occurred were, in descending order, capsulorhexis, irrigation and aspiration, and emulsification [8]. Taken together, these findings support the strong need for preparation with respect to the following steps: capsulorhexis, irrigation and aspiration, and emulsification. Therefore, the current training program could be of particular benefit to the “capsulorhexis” and “irrigation and aspiration” steps for which the final scores were high, with a decrease in the occurrence of posterior capsular rupture.
A growing effort is being made to define the best way to integrate the EyeSi simulator into surgical training programs. Thomsen et al. aimed to define the proficiency level required before surgery by evaluating the ability of all EyeSi modules to discriminate between novice and expert surgeons: capsulorhexis and emulsification discriminated the best, whereas hydromaneuver did not discriminate at all, with similar mean scores between novices and experts [31]. In total, they selected the 7 most discriminating training exercises (capsulorhexis, emulsification and five navigation training exercises) to be part of an evaluation for which the pass/fail threshold was the discriminating score between novice and experts (422/700). This pass/fail score was probably underestimated because expert surgeons only had 10 min to familiarize themselves with the EyeSi simulator, so we can assume that their score would have been higher with more training. The number of training sessions required to reach this threshold was not determined, but Bergkvist et al. demonstrated that repeated training with EyeSi simulator improved scores: ten novice residents with four training sessions outperformed ten other residents with only two training sessions [32]. They were unable to determine how many sessions there should be in a training program and advised further research into learning curves, as we did in our study.
The EyeSi simulator comprises a standard training program divided into four modules, which include navigation training exercises and surgical steps (A, B, C for fundamental skills and standard cataract surgery and module D for complex cases and complication management): before moving to the next task the resident must achieve the minimum score three times in a row at each step (minimum score of 50 for category A, 70 for category B and 85 for category C). Montrisuksirikun et al. found that completing modules A, B and C prior to the first surgery decreases the total rate of complications of resident-performed phacoemulsification and shortens the learning curve for cataract surgery training. However no data on the time required to complete the simulation program was available [18]. As recommended, modules A and B must be completed before the first surgery in the United Kingdom [33, 34]. McClay and Lockington analyzed 103 resident accounts on the EyeSi simulator in Scotland: the average time to complete each module was 2h18m ± 1h08 for module A, 3h40m ± 1h37m for module B and 6h03m ± 3h48m for module C [34]. The number of training sessions required to complete modules A, B and C was not available: it was certainly spread over more than four sessions while these times are only related to “time in the eye” and do not include set-up times and time spent reading instructions. Even though these modules and minimum scores are not comparable to our standardized assessments, these data corroborate our results, which suggest that more than 4 training sessions are necessary to obtain sufficiently high scores on the simulator.
The main limitations of our study were related to external constraints and the need to produce a realistic study: the relatively small sample size was due to the need for a homogenous population of novice residents without surgical experience. Including additional undergraduate students or residents from other specialties would have induced a significant bias due to differences in age and motivation. Extending the study over several years would have delayed dissemination of the results and monopolized major research efforts on the part of students and teachers. Despite the precaution of including novices during their third month of residency, some had already performed several surgical steps in the operating room: in the hypothesis that this bias artificially improved their scores and progression, it would reinforce our findings that more than 4 sessions would be beneficial for novice residents.
The rigor of our methodology, combined with the properties of the EyeSi simulator, resulted in valid learning curves that are in line with the state of the art [35]. The validity of the y-axis (score, completion duration and odometer) is supported by the extensive literature available relating to the benefits for residents and patients of using the EyeSi simulator, the reproducibility and the correlation of score with real-life skills [9, 15,16,17,18,19,20,21]. The high consistency of the methodology supports the validity of the x-axis, which measures the learning effort of residents: each resident was given strictly equal units of time spent practicing on the same simulator with a homogeneous group of instructors and the assessments were standardized and consistent over time. The curves had the expected shape with a negative exponential relationship (progressively decreasing slope), a decrease in variance and no ceiling or floor effect which would have indicated overly easy or hard assessments [35]. We conducted the study under reproducible and immersive conditions during a single month with a homogenous population. Fatigue bias was avoided by multiple breaks during the half-day training session and a half-day’s rest before the next session. Competition bias was prevented by conducting confidential assessments, with no other resident present, and by keeping the results anonymous, even after the study was completed.
In conclusion, our study finds that a training program, consisting of four two-hour sessions on the EyeSi simulator over four consecutive days, effectively enhances the surgical skills of ophthalmology residents. However, the high incidence of complications and low performance scores, particularly at the emulsification step, indicate that the skills acquired may not yet be at an acceptable level for performing surgery in the operating room. This suggests a need for further research to optimize the training program. The learning curves that we provided can be a valuable tool in daily practice for a personalized training perspective. They can reassure ophthalmology residents who are progressing normally and help identify those who require additional, tailored training. These findings could serve as a basis for the development of a national certification or ‘license to operate’ in the field.
Availability of data and materials
All data generated or analyzed during this study are included in this published article/as supplementary information files.
References
Bigoteau M, Grammatico-Guillon L, Massot M, Baudet JM, Cook AR, Duroi Q, et al. Ambulatory surgery centers: possible solution to improve cataract healthcare in medical deserts. J Cataract Refract Surg. 2021;47:352–7.
Steinmetz JD, Bourne RRA, Briant PS, Flaxman SR, Taylor HRB, Jonas JB, et al. Causes of blindness and vision impairment in 2020 and trends over 30 years, and prevalence of avoidable blindness in relation to VISION 2020: the right to sight: an analysis for the global burden of disease study. Lancet Global Health. 2021;9:e144-60.
Segers MHM, Behndig A, van den Biggelaar FJHM, Brocato L, Henry YP, Nuijts RMMA, et al. Outcomes of cataract surgery complicated by posterior capsule rupture in the European Registry of Quality Outcomes for cataract and refractive surgery. J Cataract Refract Surg. 2022;48:942–6.
Melega MV, Pessoa Cavalcanti Lira R, da Silva IC, Ferreira BG, Assis Filho HLG, Martini AAF, et al. Comparing resident outcomes in cataract surgery at different levels of experience. Clin Ophthalmol. 2020;14:4523–31.
Clarke C, Ali SF, Murri M, Patel SN, Wang L, Tuft M, et al. Outcomes and complication rates of primary resident-performed cataract surgeries at a large tertiary-care county hospital. J Cataract Refract Surg. 2017;43:1563–70.
Cruz OA, Wallace GW, Gay CA, Matoba AY, Koch DD. Visual results and complications of phacoemulsification with intraocular lens implantation performed by ophthalmology residents. Ophthalmology. 1992;99:448–52.
Tarbet KJ, Mamalis N, Theurer J, Jones BD, Olson RJ. Complications and results of phacoemulsification performed by residents. J Cataract Refract Surg. 1995;21:661–5.
Al-Jindan M, Almarshood A, Yassin SA, Alarfaj K, Mahmood AA, Sulaimani NM. Assessment of learning curve in phacoemulsification surgery among the Eastern Province ophthalmology program residents. OPTH. 2020;14:113–8.
Lucas L, Schellini SA, Lottelli AC. Complications in the first 10 phacoemulsification cataract surgeries with and without prior simulator training. Arq Bras Oftalmol. 2019;82:289–94.
Aggarwal S, Wisely CE, Pepin MJ, Bryan W, Raghunathan K, Challa P. Resident involvement in cataract surgery at the Veterans Health Administration: complications, case complexity, and the role of experience. J Cataract Refract Surg. 2023;49:259–65.
Chakrabarti A, Nazm N. Posterior capsular rent: prevention and management. Indian J Ophthalmol. 2017;65:1359–69.
Anaya-Alaminos R, Rassmussen ML, Fung SSM, Potic J, González-Andrades M. Comparative analysis of European residency programs: benchmarking and harmonizing ophthalmology training in Europe. Eye (Lond). 2023;37:725–31.
Dhubhghaill SN, Sanogo M, Lefebvre F, Aclimandos W, Asoklis R, Atilla H, et al. Cataract surgical training in Europe: a European Board of Ophthalmology survey. J Cataract Refractive Surg. 2022. https://doi.org/10.1097/j.jcrs.0000000000001280.
Etat de l'art national et international en matière de pratiques de simulation dans le domaine de la santé. Rapport de mission. France: Haute Autorité de Santé. https://www.has-sante.fr/upload/docs/application/pdf/2012-01/simulation_en_sante_-_rapport.pdf.
Ahmed TM, Hussain B, Siddiqui MAR. Can simulators be applied to improve cataract surgery training: a systematic review. BMJ Open Ophthalmol. 2020;5:e000488.
Staropoli PC, Gregori NZ, Junk AK, Galor A, Goldhardt R, Goldhagen BE, et al. Surgical simulation training reduces intraoperative cataract surgery complications among residents. Simul Healthc. 2018;13:11–5.
Lin JC, Yu Z, Scott IU, Greenberg PB. Virtual reality training for cataract surgery operating performance in ophthalmology trainees. Cochrane Database Syst Rev. 2021;12:CD014953.
Montrisuksirikun C, Trinavarat A, Atchaneeyasakul LO. Effect of surgical simulation training on the complication rate of resident-performed phacoemulsification. BMJ Open Ophthalmol. 2022;7:e000958.
Ferris JD, Donachie PH, Johnston RL, Barnes B, Olaitan M, Sparrow JM. Royal College of Ophthalmologists’ National Ophthalmology Database study of cataract surgery: report 6. The impact of EyeSi virtual reality training on complications rates of cataract surgery performed by first and second year trainees. Br J Ophthalmol. 2020;104:324–9.
Thomsen ASS, Bach-Holm D, Kjærbo H, Højgaard-Olsen K, Subhi Y, Saleh GM, et al. Operating room performance improves after proficiency-based virtual reality cataract surgery training. Ophthalmology. 2017;124:524–31.
Saleh GM, Lamparter J, Sullivan PM, O’Sullivan F, Hussain B, Athanasiadis I, et al. The international forum of ophthalmic simulation: developing a virtual reality training curriculum for ophthalmology. Br J Ophthalmol. 2013;97:789–92.
Lowater SJ, Grauslund J, Vergmann AS. Modern educational simulation-based tools among residents of ophthalmology: a narrative review. Ophthalmol Ther. 2022;11:1961–74.
Lockington D, Saleh GM, Spencer AF, Ferris J. Cost and time resourcing for ophthalmic simulation in the UK: a Royal College of Ophthalmologists’ National Survey of regional simulation leads in 2021. Eye (Lond). 2022;36:1973–6.
Lockington D, Saleh GM, Spencer AF, Ferris J. Dedicated time and resources are required to address variable engagement with ophthalmic simulation opportunities. Eye (Lond). 2022;36:2363.
Ong WH, Hind J, Lockington D. Attitudes of ophthalmic trainees in Scotland towards surgical simulation engagement. Eye (Lond). 2023;37:2358–9.
Ducloyer J-B, Poinas A, Duchesne L, Caillet P, Ivan C, Lejus-Bourdeau C, et al. Educational concerns about the safety of cataract surgery during residency: the E3CAPS pedagogic study. Ophthalmol Ther. 2023;12:2801–12.
R Core Team (2022). R: A language and environment for statistical computing. 2022.
Wickham H. ggplot2: Elegant graphics for data analysis. 2016.
Rali A, Fontus J, Ward L, Aaron M, Jones J, Moore E, et al. Resident stress level during steps of cataract surgery. J Acad Ophthalmol. 2018;10:e179–84.
Belyea DA, Brown SE, Rajjoub LZ. Influence of surgery simulator training on ophthalmology resident phacoemulsification performance. J Cataract Refract Surg. 2011;37:1756–61.
Thomsen ASS, Kiilgaard JF, Kjaerbo H, la Cour M, Konge L. Simulation-based certification for cataract surgery. Acta Ophthalmol. 2015;93:416–21.
Bergqvist J, Person A, Vestergaard A, Grauslund J. Establishment of a validated training programme on the Eyesi cataract simulator. A prospective randomized study. Acta Ophthalmol. 2014;92:629–34.
Campbell S, Hind J, Lockington D. Engagement with ophthalmic simulation training has increased following COVID-19 disruption—the educational culture change required? Eye. 2021;35:2660–1.
McClay T, Lockington D. Time requirements for mandatory cataract simulation modules. Eye (Lond). 2024;38(2):404. https://doi.org/10.1038/s41433-023-02700-y.
Pusic MV, Boutis K, Hatala R, Cook DA. Learning curves in health professions education. Acad Med. 2015;90:1034.
Acknowledgements
We thank the investigators (E3CAPS group) who supervised the training sessions. E3CAPS group: Lucas BELLOT; Victor BIELEFELD; Florian BODENES; Angelique CAIGNARD; Jérôme CHARTIER; Charlène CORNEE; Lucile GITTON; Adam MAINGUY; Driss MAZHAR; Benoist MENARDAIS; Isabelle ORIGNAC; Marion SERVANT; Michel WEBER.
We thank the Alcon® Training Centre (ATC) that loaned an EyeSi® simulator, and our sponsor (CHU Nantes).
We thank the “Groupement Interrégional de Recherche Clinique et d’Innovation (GIRCI) du Grand Ouest” (Simulation research 2021 Western Interregional group on clinical research and Innovation) that set a competitive regional call for proposals “Recherche en simulation – 2021” that our project won.
Funding
The trial “Improving the safety of cataract surgery training on the Eyesi simulator – Learning curve and impact of sleep deprivation on ophthalmology residents: E3CAPS” is funded by an interregional academic body, GIRCI – GO, which is not involved in the study, data analysis, or interpretation, but does cover, publication costs, biostatisticians, intern compensation etc.
Author information
Authors and Affiliations
Consortia
Contributions
Jean-Baptiste Ducloyer and Raoul Kanav Khanna designed the trial. Jean-Baptiste Ducloyer, Raoul Kanav Khanna, Alexandra Poinas and Pierre Lebranchu wrote the protocol. Alexandra Poinas, Jean-Baptiste Ducloyer and Raoul Kanav Khanna coordinated the submission and the follow up of (1) GIRCI tender and (2) the regulatory authorities and are coordinating the trial. Pascal Caillet and Léa Duchesne wrote the methodological/statistical analyses section in the protocol and performed the analyses. Jean-Baptiste Ducloyer wrote the manuscript, Raoul Kanav Khanna, Léa Duchesne, Pascal Caillet, Corinne Lejus-Bourdeau, Guylène Le Meur, Michel Weber, Catherine Ivan, Frédérick Mouriaux Nadège Limousin, Thomas Desmidt, , Patrick Pladys, Pierre-Jean Pisella, Anne Bernard, Hubert Lardy, Philippe Gohier, Ludovic Martin, Pierre Lebranchu and Alexandra Poinas assisted with the drafting of the manuscript. Jean-Baptiste Ducloyer enrolled participants and monitored evaluations. All authors read and approved the final manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
This clinical study was approved by the Ethics Committee of Nantes University on October 17th, 2022. The clinical study was conducted in accordance with the French Public Health Code, national and international Good Clinical Practice (GCP) guidelines, and the Declaration of Helsinki, each in the applicable version.
Consent for publication
Not applicable - no identifying images or other personal or clinical details of participants are presented here or will be presented in reports of the trial results.
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
12909_2024_6064_MOESM1_ESM.docx
Supplementary Material 1: E-Table 1. Scores, completion time, odometer throughout the training program. E-Table 2. Posterior capsular rupture throughout the training program. E-Table 3. Success rate for each step throughout the training program.
12909_2024_6064_MOESM2_ESM.tiff
Supplementary Material 2: E-Figure 1. Overlaid individual learning curves for the capsulorhexis step. The grey lines represent the score changes for each resident. The dotted horizontal line indicates the performance threshold (80/100). The bold black line shows the evolution of the median score.
12909_2024_6064_MOESM3_ESM.tiff
Supplementary Material 3: E-Figure 2. Multidimensional learning curves showing changes in score, completion time and odometer for the hydromaneuver and intraocular lens insertion steps. In the box plots (columns 1, 3 and 4), the edge of the box indicates the 25th and 75th percentiles, the black line within the box indicates the median. The upper whiskers extend from the edges of the box to the highest and lowest values up to 1.5 times the IQR. Data beyond the end of the whiskers are plotted individually as grey circles. The blue lines connect the medians across sessions. In column 2, the individual overlaid curves show each ophthalmology resident’s score changes across sessions (grey lines). The bold black line shows the evolution of the median score across sessions.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License, which permits any non-commercial use, sharing, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if you modified the licensed material. You do not have permission under this licence to share adapted material derived from this article or parts of it. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by-nc-nd/4.0/.
About this article
Cite this article
Ducloyer, JB., Poinas, A., Duchesne, L. et al. Learning curves of novice residents on cataract surgery simulator: the E3CAPS pedagogic study. BMC Med Educ 24, 1078 (2024). https://doi.org/10.1186/s12909-024-06064-z
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12909-024-06064-z