Usage of 3D models of tetralogy of Fallot for medical education: impact on learning congenital heart disease
© The Author(s). 2017
Received: 30 June 2016
Accepted: 20 February 2017
Published: 11 March 2017
Congenital heart disease (CHD) is the most common human birth defect, and clinicians need to understand the anatomy to effectively care for patients with CHD. However, standard two-dimensional (2D) display methods do not adequately carry the critical spatial information to reflect CHD anatomy. Three-dimensional (3D) models may be useful in improving the understanding of CHD, without requiring a mastery of cardiac imaging. The study aimed to evaluate the impact of 3D models on how pediatric residents understand and learn about tetralogy of Fallot following a teaching session.
Pediatric residents rotating through an inpatient Cardiology rotation were recruited. The sessions were randomized into using either conventional 2D drawings of tetralogy of Fallot or physical 3D models printed from 3D cardiac imaging data sets (cardiac MR, CT, and 3D echocardiogram). Knowledge acquisition was measured by comparing pre-session and post-session knowledge test scores. Learner satisfaction and self-efficacy ratings were measured with questionnaires filled out by the residents after the teaching sessions. Comparisons between the test scores, learner satisfaction and self-efficacy questionnaires for the two groups were assessed with paired t-test.
Thirty-five pediatric residents enrolled into the study, with no significant differences in background characteristics, including previous clinical exposure to tetralogy of Fallot. The 2D image group (n = 17) and 3D model group (n = 18) demonstrated similar knowledge acquisition in post-test scores. Residents who were taught with 3D models gave a higher composite learner satisfaction scores (P = 0.03). The 3D model group also had higher self-efficacy aggregate scores, but the difference was not statistically significant (P = 0.39).
Physical 3D models enhance resident education around the topic of tetralogy of Fallot by improving learner satisfaction. Future studies should examine the impact of models on teaching CHD that are more complex and elaborate.
KeywordsCongenital heart disease 3D printing Resident education
Congenital heart disease (CHD) is the most common human birth defect, with an estimated incidence of 8 per 1,000 live births . Each defect has a wide spectrum of severity. The clinical impact and subsequent management of the CHD largely depends on anatomy. Given the need for pediatricians to direct and coordinate healthcare delivery for patients with CHD, a basic understanding of common CHD is necessary . However, the subspecialization in pediatric cardiology limits the clinical exposure of pediatric residents to CHD , creating knowledge gaps in the clinical management of CHD . Furthermore, the standard technique of visualizing CHD, such as echocardiography, cardiac catheterization, or cross-sectional CT/MRI, requires mentally reconstructing multiple planes of 2D images into a 3D object. This technique is difficult to learn, and often disorienting considering the heart’s complex anatomy.
Three-dimensional (3D) models may be useful in improving the understanding of CHD, without requiring a mastery of cardiac imaging. Previous studies in other medical disciplines have shown that digital 3D models can supplement traditional instructional methods, and are superior to 2D images in the teaching of complex anatomy (such as larynx  or the knee joint ). In Bigilio et al’s study, printed 3D models from children with recent cardiac MRIs were used during outpatient clinic discussions of CHD with family members . Printed 3D models of ventricular septal defects have previously been utilized in ICU simulation-based instructions, to teach postoperative critical care management of ventricular septal defects [8, 9]. Experiences from such case studies suggest that utilizing physical CHD models help with physicians’ understanding of congenital heart disease.
The objective of this study is to evaluate the impact of 3D models on how pediatric residents understand tetralogy of Fallot during a teaching session. Tetralogy of Fallot was selected as the topic, as this common lesion is frequently encountered by general pediatricians. The dynamic nature of physiology in tetralogy of Fallot, specifically the contribution of infundibular narrowing during a “tet spell,” is not accurately represented by conventional 2D drawings. We hypothesize that the use of 3D models will improve residents’ knowledge acquisition and their overall satisfaction during the teaching session.
With institutional review board approval and written informed consent, a prospective, randomized trial was conducted to compare the effectiveness of instruction to second year pediatric residents (PL-2 s) regarding tetralogy of Fallot, using a standard 2D depiction of the defect compared to using a 3D model of the defect. All other aspects of the teaching session, including content, teaching slides and didactic methods, were identical. Pre-session and post-session questionnaires were used to assess knowledge acquisition, learner satisfaction and self-efficacy ratings.
PL-2 s rotating through a 4-week block inpatient Cardiology rotation were recruited in groups of 2–3 at Children’s National Health System. There were 13 blocks per year. Participants were primarily from the affiliated pediatric residency programs. The teaching session is part of the standard morning curriculum the residents receive during their rotation. Other cardiology team members covered the PL-2 s’ patients by answering pages and interacting with nurses as required. Half the total participants received teaching sessions using 3D models, while the other half receiving sessions with 2D images were designated as control. Before each session, the participants filled out a questionnaire relating to their background and previous clinical exposure to patients with tetralogy of Fallot.
During the education session, PL-2 s were led through a lecture discussing several aspects related to tetralogy of Fallot – embryology, anatomical features, physiology, natural history, surgical approach and medical management of patients undergoing a cyanotic “Tet spell”. All teaching sessions were conducted by one of 2 co-investigators (ASH and LJO) with a standardized presentation. Each session was approximately 1 h in length. For the control group, 2D drawings were used during the session.
Educational session with physical 3D models
Learner satisfaction and self-efficacy— (Kirkpatrick level One )
Knowledge acquisition— (Kirkpatrick level Two )
Before the session, the participants were first given a pre-session knowledge test (in multiple choice question format, comprised of 9 questions). The questions tested the residents’ knowledge of the anatomy, physiology of tetralogy of Fallot, as well as the acute management of a patient with a “Tet spell”. After the teaching session, the participants were given the same knowledge test post-session. Correctly scored items were given a value of 1 and incorrect given values of 0. Pre-test and post-test scores were reported based on cumulative points (ranging from 0 to 9).
Comparisons between the test scores, learner satisfaction and self-efficacy questionnaires for the two groups were assessed. All data analyses were performed using statistical software (MedCalc 184.108.40.206, MedCalc Software, Bruges, Belgium). Knowledge acquisition was measured by the improvement in pre-test and post-test multiple choice questions. Paired t-test was used to compare pre-test and post-test score differences. T-test was also used to compare differences in learner satisfaction and self-efficacy between the two groups. Cronbach-alpha scores were conducted to assess for internal consistency, with results of 0.90 and 0.86 respectively.
Thirty-five pediatric residents enrolled into the study, with no significant differences in background characteristics, including previous clinical exposure to Tetralogy of Fallot
Previous Exposure to # of ToF patients
Previous sources of knowledge for ToF
Impact of 3D heart models on knowledge acquisition. The pre-test and post-test comprised of 9 questions in multiple choice format. Both 2D image and 3D model groups show the same effect of knowledge acquisition
Mean pre-test score
Mean post-test score
3.8 ± 1.5
6.3 ± 1.2
4.3 ± 1.9
6.0 ± 1.6
Given the complexity of CHD, physical models are useful in demonstrating the relative locations of anatomic structures of interest, particularly with learners as demonstrated in this study. 3D models allow for easy manipulation and clear visualization of such structures. Anatomical and physiologic concepts of congenital heart disease can be demonstrated in a hands-on, interactive environment. Depth and spatial relationships can be expressed and elaborated. Printed 3D models have been previously used as an adjunct for cardiovascular surgeons in providing useful information such as spatial localization of coronary arteries , pre-operative planning for ventricular septal defects, and intra-operative orientation of complex vascular rings . 3D models have also been helpful in guiding stent placements in complex CHD patients . In tetralogy of Fallot, the use of a 3D model helps to specifically elaborate on the anterior deviation of the infundibular septum and how the shape of the right ventricular outflow tract can create different clinical presentations (whether a patient is predisposed to having an increased likelihood of a “tet spell”).
To our knowledge, this study is the first attempt to quantify the impact of 3D models in medical education of CHD in comparison to a control intervention. The use of 3D heart models has been previously applied in small curriculums for premedical, medical students and residents . Interactive 3D models of the heart have also been used in education of transesophageal echocardiography . Our study incorporated a control comparison with conventional 2D images. We found that 3D models helped improve residents’ satisfaction during the teaching sessions. The feedback forms also showed that residents found the models to be useful and engaging, similarly to Biglinio et al’s study. Being able to hold the heart and visualize the ventricular septal defect from different angles allowed residents to appreciate the size and location of the defect relative to the great vessels.
For learners in the clinical setting, increased satisfaction ratings are linked to increased long-term knowledge gains. A meta-analysis from Yammine et al. demonstrated that 3D physical models can improve long-term knowledge outcomes in understanding spatial arrangements of anatomic organs . Previous educational studies have suggested that interactive educational techniques would help with facilitating resident learning as well as long-term retention of material [17–19]. Allowing hands-on learning with physical models inherently increases the interactivity of a session, potentially increasing learner’s knowledge retention of CHD. While long-term knowledge retention was not specifically assessed in this study, learner satisfaction was significantly different in the 3D model group and is known to correlate with retention in adult learners in other fields. Long-term knowledge retention will be formally assessed in future studies.
We did not find improvement in factual knowledge acquisition when using 3D models, a finding also demonstrated in Yammine et al’s meta-analysis. While the two groups didn’t have a significant difference in knowledge-based test scores, this is probably an appropriate outcome, as the learners are responsible for the material presented regardless of presentation with 2D or 3D teaching aids. Interestingly, Yammine’s meta-analysis distinguishes factual knowledge vs. spatial knowledge, which was not captured well with the knowledge acquisition testing. This is further compounded by the confounding factor of trainee level. Pediatric residents have limited exposure to patient with tetralogy of Fallot. Their previous knowledge of tetralogy of Fallot is mainly derived from lectures in medical school, where the physiology of tetralogy of Fallot is elaborated, but less so the spatial significance of an anterior malalignment ventricular septal defect. Understanding the complexities and nuances behind the adage “anatomy defines physiology” is still a roadblock, as reflected by the lower-than-expected post-test scores of both groups. This equipoise in knowledge acquisition was similarly demonstrated in Biglinio et al., which also did not show improvement in short term understanding of the child’s condition . The potential benefit in knowledge acquisition may be better seen in medical trainees within the field of Pediatric Cardiology (pediatric cardiology fellows, critical care nurses and nurse practitioners) who utilize relevant spatial knowledge in the day-by-day management of congenital heart disease.
Creation of the 3D heart models via software segmentation can be effectively performed by a clinician familiar with both cardiac imaging and 3D software. For 3D echocardiogram datasets, low-gain acquisitions and post-processing filtering to remove speckling noise is required . Additionally, 3D reconstructions should be optimized by manually segmenting respective atria, ventricles and great vessels as separate masks (with clear definition of the ventricular septal defect between masks)  and reconstructing the heart via Boolean function. Typically, software segmentation takes approximately 2 h for each model. Fabrication of physical models, however, remains quite resource and time-dependent. The models used in this study are fabricated with Objet500 Connex3 (Stratasys, Minnesota, USA), a multi-material 3D printer that utilizes PolyJet photopolymer materials. Materials with a rubbery consistency (Tango Black and Tango Clear) were used with an average cost of 1 US Dollar per gram of material. The overall cost for each model was approximately $200, although depending on the printer type this cost can range from about $15 to $300. The time to print each model was approximately 12 h. As a means of improving the cost-effectiveness of using 3D models for education, use of conventional digital display technologies (for example, a tablet with a 3D model viewer app that has the ability to manipulate, rotate and zoom in on a digital 3D heart) could dramatically reduce this cost.
There are several limitations to the study. This was a single center study with limited number of participants. As previously mentioned, the study was limited to teaching sessions involving pediatric residents only. Further studies should involve trainees in Cardiology, where there may be potential benefit in knowledge acquisition when learning more complex CHD. Knowledge acquisition was only reflected by a small number of multiple-choice questions. Follow-up testing was not performed in study participants to assess for knowledge retention or effect on patient care (Kirkpatrick Level Four) . Assessment of learner satisfaction and self-efficacy were based on subjective Likert-scale ratings and not objective evaluation measures.
Future studies should examine the impact of models on teaching CHD that are more complex and elaborate, such as hypoplastic left heart syndrome. This critical CHD requires multiple surgeries with anatomic variation after each surgery, such that learners are faced with learning four different anatomies instead of just one . Feedback forms will include questions related to the “most favorite model” in order to investigate the effectiveness in 3D models’ ability to communicate spatial information (and relevant anatomical details in CHD). Future work will also include impact of 3D models on education of male and female learners, given the published differences in spatial reasoning abilities between these two groups . In light of the limitations of encountered in this study, more nuanced testing of trainee knowledge base should be used (such as incorporating free text answers or detailed use of the classroom critical incident questionnaire)  to fully assess understanding of spatial knowledge and specific anatomical variations.
Our study shows that physical 3D models enhance resident education around the topic of congenital heart disease, specifically with tetralogy of Fallot, by improving learner satisfaction.
Congenital heart disease
Special acknowledgments are extended to all residents who participated in the study.
There was no funding for the study.
Availability of data and materials
Additional data and materials can be made available upon request to the corresponding author.
YHL designed and fabricated the 3D cardiac models, analyzed the participant data, and wrote the manuscript. LJO and AK respectively provided clinical and technical input into the creation of the models. ASH contributed to the study questionnaire designs. LJO and ASH conducted the teaching sessions. All authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
This research was reviewed and approved by Children’s National Health System’s Institutional Review Board (Pro00003567).
Written informed consent to participate in the research was obtained from all participants.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Bernier PL, Stefanescu A, Samoukovic G, Tchervenkov CI. The challenge of congenital heart disease worldwide: epidemiologic and demographic facts. Semin Thorac Cardiovasc Surg Pediatr Card Surg Annu. 2010;13(1):26–34. doi:10.1053/j.pcsu.2010.02.005.View ArticleGoogle Scholar
- Fernandes SM, Sanders LM. Patient-centered medical home for patients with complex congenital heart disease. Curr Opin Pediatr. 2015;27(5):581–6. doi:10.1097/MOP.0000000000000258.View ArticleGoogle Scholar
- Su L, Munoz R. Isn’t It the Right Time to Address the Impact of Pediatric Cardiac Intensive Care Units on Medical Education? October. 2008;120(4). doi:10.1542/peds.2006-2487.
- Garg A, Arora A, Hand IL. Pediatric Resident Attitudes and Knowledge of Critical Congenital Heart Disease Screening. Pediatr Cardiol. 2016:6–9. doi:10.1007/s00246-016-1407-6.
- Hu A, Wilson TD, Ladak H, Haase P, Fung K. Three-dimensional educational computer model of the larynx. Head Neck. 2011;135(7):677–81. doi:10.1001/archoto.2009.68.Google Scholar
- Knobe M, Carow JB, Ruesseler M, et al. Arthroscopy or ultrasound in undergraduate anatomy education: a randomized cross-over controlled trial. BMC Med Educ. 2012;12(1):85. doi:10.1186/1472-6920-12-85.View ArticleGoogle Scholar
- Biglino G, Capelli C, Wray J, et al. 3D-manufactured patient-specific models of congenital heart defects for communication in clinical practice: feasibility and acceptability. BMJ Open. 2015;5(4):e007165. doi:10.1136/bmjopen-2014-007165.View ArticleGoogle Scholar
- Sodian R, Weber S, Markert M, et al. Stereolithographic models for surgical planning in congenital heart surgery. Ann Thorac Surg. 2007;83(5):1854–7. doi:10.1016/j.athoracsur.2006.12.004.View ArticleGoogle Scholar
- Costello JP, Olivieri LJ, Krieger A, Thabit O, Marshall MB, Yoo SJ, Kim PC, Jonas RA, Nath DS. Utilizing three-dimensional printing technology to assess the feasibility of high-fidelity synthetic ventricular septal defect models for simulation in medical education. World J Pediatr Congenit Heart Surg. 2014;5(3):4210426.View ArticleGoogle Scholar
- Loke Y-H, Krieger A, Sable C, Olivieri L. Novel uses for three-dimensional printing in congenital heart disease. Curr Pediatr Rep. 2016. doi:10.1007/s40124-016-0099-y.Google Scholar
- Kirkpatrick D. Four steps to measuring training effectiveness. Personnel Administrator. 1983.Google Scholar
- Mottl-Link S, Hübler M, Kühne T, et al. Physical models aiding in complex congenital heart surgery. Ann Thorac Surg. 2008;86(1):273–7. doi:10.1016/j.athoracsur.2007.06.001.View ArticleGoogle Scholar
- Olivieri L, Krieger A, Chen MY, Kim P, Kanter JP. 3D heart model guides complex stent angioplasty of pulmonary venous baffle obstruction in a Mustard repair of D-TGA. Int J Cardiol. 2014;172(2):e297–8. doi:10.1016/j.ijcard.2013.12.192.View ArticleGoogle Scholar
- Costello J, Olivieri L, Su L, et al. Incorporating Three-dimensional Printing into a Simulation-based Congenital Heart Disease and Critical Care Training Curriculum for Resident Physicians. 2015:185–190.
- Jerath A, Vegas A, Meineri M, et al. An interactive online 3D model of the heart assists in learning standard transesophageal echocardiography views. Can J Anesth. 2011;58(1):14–21. doi:10.1007/s12630-010-9410-5.View ArticleGoogle Scholar
- Yammine K, Violato C. The effectiveness of physical models in teaching anatomy: a meta-analysis of comparative studies. Adv Heal Sci Educ. 2015. doi:10.1007/s10459-015-9644-7.Google Scholar
- Rubio EI, Bassignani MJ, White MA, Brant WE. Effect of an audience response system on resident learning and retention of lecture material. Am J Roentgenol. 2008;190(6):319–22. doi:10.2214/AJR.07.3038.View ArticleGoogle Scholar
- Sisson SD, Rastegar DA, Hughes MT, Bertram AK, Yeh H. Learner feedback and educational outcomes with an internet-based ambulatory curriculum: a qualitative and quantitative analysis. BMC Med Educ. 2012;12(1):55. doi:10.1186/1472-6920-12-55.View ArticleGoogle Scholar
- Costa ML, Van Rensburg L, Rushton N. Does teaching style matter? A randomised trial of group discussion versus lectures in orthopaedic undergraduate teaching. Med Educ. 2007;41(2):214–7. doi:10.1111/j.1365-2929.2006.02677.x.View ArticleGoogle Scholar
- Olivieri L, Krieger A, Loke Y-H, Nath DS, Kim PCW, Sable CA. Three-dimensional printing of intracardiac defects from three-dimensional echocardiographic images: feasibility and relative accuracy. J Am Soc Echocardiogr. 2015;28(4):392–7. doi:10.1016/j.echo.2014.12.016.View ArticleGoogle Scholar
- Angelica MD, Fong Y. Age group and sex differences in performance on a computerized neurocognitive battery in children age 8–21. Neuropsychology. 2012;26(2):251–65. doi:10.1016/j.surg.2006.10.010.Use.View ArticleGoogle Scholar
- The Classroom Critical Incident Questionnaire. http://www.stephenbrookfield.com/s/CIQ.pdf. Accessed 25 Feb 2017.