Skip to main content
  • Research article
  • Open access
  • Published:

Constructing an experiential education model in undergraduate radiology education by the utilization of the picture archiving and communication system (PACS)

Abstract

Background

Medical education in China is in a transitional period, from passive learning models to experiential education. We modified an experiential education method for radiology education. The aim of this study is to evaluate the effect of this method on undergraduate radiology education.

Method

With the help of the picture archiving and communication system (PACS) and RadiAnt DICOM Viewer, we modified an experiential education method that simulates similar working conditions for undergraduate medical students to formulate radiology diagnosis similar to clinical radiologists. A total of 101 students were allocated into either the experiential education group or the control group. The final examination scores and a 5-point Likert scale self-assessment questionnaire of radiologic skills were collected from all the students as an objective assessment and a subjective assessment respectively. A questionnaire was also used to assess the satisfaction with the experiential model in the experiential education group. Mann-Whitney U test was used to compare the ranked data, and t-tests were used to compare the numeric data.

Results

The experiential education group demonstrated significantly higher scores (7.4 ± 1.3) compared to the control group (6.7 ± 1.5, p < 0.05) in the question type “description and diagnosis”. The self-assessment questionnaire indicated that the experiential education was related to increased familiarity with the diagnosis thinking principle and the sequences and reconstruction methods of computer tomography (CT) imaging, which also strengthen participants’ self-confidence to perform future clinical work (p < 0.05). The self-assessment questionnaire in the experiential education group showed that the majority of students were satisfied with the organization (82.5%), interactivity (85%) and quality (85%) of the learning activity. Most students found this model of learning to be helpful for studying radiology (85%) and for understanding anatomy (90%).

Conclusion

Compared with the traditional radiology education approach, the experiential education method showed greater efficacy in improving students’ analysis and diagnostic skills and their self-confidence.

Peer Review reports

Background

Radiology is one of the key components in basic medical education, which serves as a bridge between anatomy and the clinic. Like the other areas of medical education, radiology education is facing a challenge of transitioning from passive learning to both interactive teaching and experiential learning [1, 2].

As the field of radiology expanded, radiology education experienced a revolution. Doctors used to carry plain films and teach using projectors or view boxes as plain films were the main diagnostic method in Radiology during the 1970s. Since the introduction of computed tomography (CT) and magnetic resonance (MR) imaging in the late 1980s, the increase in image data volume associated with these imaging modalities led to greater demands for compatible data storage platforms. Thus, the picture archiving and communication system (PACS), which can store, retrieve, distribute, analyse and digitally process medical images, has become an indispensable tool in today’s clinical work [3,4,5]. However, limited by the hardware and software conditions, the use of PACS in radiology training has remained somewhat limited [6, 7].

Currently, most radiology education continues to rely heavily on textbooks and traditional computer media such as PowerPoint or Word documents, both of which are lacking in student interactions [8]. There is little chance for a medical student to read the whole images like a real radiologist in class. It is often a challenge for them to grasp the concept of 3-dimensional (3D) gross anatomy, as well as a holistic view of diseases [9]. As a result, some students may struggle to independently identify abnormal findings and to analyse and formulate radiologic diagnoses. Previously, only limited final-year medical students demonstrated satisfactory basic radiology interpretive skills, which urged us to look for a more effective method [10].

A variety of radiology education methods have been previously reported, including problem-based learning, case-based learning, and team-based learning [11,12,13]. Unlike these previously studied conventional methods, under the concept of learning from experience, we modified a new experiential education method that enables students to practice radiology interpretation and diagnosis by taking on the radiologist’s role in a simulated environment. The whole typical cases instead of specific layers are shown to the student by using the PACS. Students are allowed to read the whole images as well as doing some basic reconstruction freely and find out the specific image characteristics by themselves. During this process, students can access the PACS and the clinical information, integrating both clinical knowledge and 3D reconstruction ability, which is essential for formulating radiological diagnoses. It is our first time to introduce the concept of experiential education into radiology education. We try to evaluate the effect of this method on undergraduate radiology education.

Methods

Image acquisition

Raw CT and MR data were copied directly from each machine or the PACS. Data were stored in DICOM (Digital Imaging and Communication in Medicine) format, which is a standard international multi-vendor format. To protect patients’ privacy, patient information was de-identified where their name and medical record numbers was removed. Digital images were then transferred into a teaching file.

Hard- and software

Each student had a personal computer connected to the web server to download a case. The RadiAnt DICOM Viewer (version 4.0.3) was used as the teaching software. The software is user friendly, which enabled students to read images freely on their own computers.

Subjects

All fourth year medical students with clinical medicine major (eight-year program) from the Medical School of Sun Yat-sen University were included in this study. One of three classes was randomly chosen as the experiential class and received experiential education. The control group consisted of students in the remaining two classes.

Experiential education model

Following theoretical courses for a specific system, all students in the experiential education group and control group underwent a practical course of similar contact hours. The ratio of theoretical and practical courses is 3:2. An average of 4–5 cases for each system, altogether 60 cases were presented to students in the experiential education group, along with the corresponding medical history, physical examination results and laboratory test results. These cases are all the typical cases of each system. For example, typical CT images of lobar pneumonia and hematogenous pulmonary tuberculosis would be chosen when teaching the respiratory system. Students were allowed to read images freely and provided image descriptions and diagnoses within approximately one hour. The software enabled students to do basic operations with the images, such as adjusting the window width and level, comparing different sequences, and performing multiple planar reconstruction (MPR) or 3D reconstruction, just as what the radiologist could do in the medical PACS system. Students have received essential training for the software to ensure the exercise. Students then shared their findings and diagnoses in open discussions. It was then the role of the lecturer and the 3 teaching assistants to guide students in making complete and detailed image descriptions and correct diagnosis. In the last session of the class, the lecturer would summarize the reading points of the cases and the knowledge points of this system.

Meanwhile, the students in the control group still received the teaching by reading the typical imaging layers with the traditional computer media including PowerPoint and Word documents. The basic skills of reading images like the the reconstruction method and choosing the proper window width and level are taught only in theory. The students in the control group also had the opportunity to receive the guidance by the teacher if they had any questions.

Assessment

After one semester of class, final examination was taken, which combining 30 multi-choice questions and 10 “image description and diagnosis” short answer type questions. The scores were collected as objective assessments. To provide a subjective assessment of radiologic skills, all of the students were invited to complete a self-assessment radiologic skills questionnaire (Additional file 1). The students in the experiential education group were also invited to complete a questionnaire assessing their satisfaction with the experiential learning condition (Additional file 2). Both of the self-made questionnaires used a 5-point Likert scale. The questionnaire used in the study was developed for this study and has not previously been published elsewhere.

Data analysis

All data were analysed using the Statistical Package for Social Science (SPSS) software (version 22.0, IBM, New York, NY, USA).

The Mann-Whitney U test was used to compare ranked data between different groups. Student’s t-test was used for comparison of numeric data. The significance level was set at p < 0.05.

Results

A total of 101 students in three classes were included in this study; 40 students were enrolled in the experiential education group and 61 in the control group. All three classes were comparable in terms of students’ age, gender and grade point average (p>0.05) (Table 1).

Table 1 The age, gender and GPA of the two groups

Assessment result

The final examination was attended by a total of 99 students (the other 2 student delay the exam due to personal reasons), including 38 students in the experiential education group and 61 students in the control group. There were no significant differences in baseline grade averages between the two groups (Mann- Whitney U test, U = 1240.5, p = 0.614).

The average score of the experiential education group was 81.5 ± 10.3, which was not significantly different from the control group (79.2 ± 7.5, p > 0.05) (Fig. 1). However, sub-domain analyses indicated a significant (p < 0.05) difference between the scores in “image description and diagnosis” short answer type questions. The experiential education group demonstrated significantly higher scores than the control group ((7.4 ± 1.3 and 6.7 ± 1.5, respectively, p < 0.05). In comparison, there were no significant differences in the scores for multi-choice questions (MCQs) between the two groups. (34.0 ± 4.8 in the experiential education group and 33.0 ± 3.4 in the control group, p > 0.05) (Fig. 2).

Fig. 1
figure 1

Comparison of total scores in final examination between the experiential education group and the control group

Fig. 2
figure 2

Comparison of scores in “Image Description and diagnosis” short-answer type questions between the experiential education group and the control group

Feedback results

Responses to the Likert scale statement are presented in Tables 2 and 3. All experiential education group participants and 47 control participants completed the self-assessment questionnaire. In comparison to the control group, the experiential education group had increased familiarity with each of the following: the DICOM viewer, the sequences and reconstruction methods of CT imaging, the diagnosis thinking principle, and anatomy. These findings serve to strengthen students’ self-confidence in their ability to perform future clinical work. (Table 2).

Table 2 Self-assessment Likert scale responses for the experiential education group and the control group
Table 3 The Likert scale questionnaire on learner satisfaction

All 40 students in the experiential education group provided feedback via additional self-assessment questionnaire specific to the experiential education. The analysis demonstrated that the majority of students were satisfied with the organization (82.5%) and interactivity (85%) of the learning activity. Most students found this kind of learning activity to be helpful for both learning radiology (85%) and understanding anatomy (90%). More importantly, a large proportion of students (85%) found that the experiential education encouraged better personal interest in radiology, as well as satisfaction with the quality of learning (85%). (Table 3).

Many students also reported benefitting from the experiential education via the free text responses on the questionnaire.

Discussion

Traditional hands-on radiology education that continues to be used today only displays typical imaging layers rather than the whole images. While this teaching method may be useful for helping students handle typical imaging features, it may be insufficient for learning anatomy [14]. Hence, students may remain unable to provide quality image readings when they were expected to perform independently during clinical practice [15]. Although a variety of radiology education models such as problem-based learning [16] and the use of dynamic images can solve part of this problem, we believe the original working environment represents the most ideal learning method. Thus, we have introduced the experiential education method into our radiology teaching.

The theory of experiential education was first proposed by John Dewey in 1938. He initiated the topic of experiential education in his work entitled Experience and Education. Unlike hands-on education, this educational philosophy emphasizes the process of learning through experience [17]. Based on this educational concept, students should be responsible for their own learning. As such, students are able to acquire relative knowledge in the real world by discovering both questions and proactive solutions. This kind of learning method has the potential to motivate students’ autonomy while also elevating their interest of knowledge [17]. Outdoor education, cooperative and environmental learning each represents different practice models of experimental education. In a sense, the intern and resident rotation is also a kind of experiential education. This educational concept is increasing in popularity at all levels of education [18, 19].

During this study, we created an experiential education course by applying the PACS and DICOM viewer software to simulate a working environment mirroring our typical clinical work. The study results indicated the experiential education approach allows better clinical guidance necessary in assisting students to form a holistic point of view in both anatomy and pathology. Most importantly, this teaching method allows better guidance for students to develop critical thinking and systematic approach to formulate imaging interpretation and differential diagnosis, which may be partly thanks to the free inquisitive space of the experiential education mode.

Apart from objective improvement in imaging descriptions and interpretations, subjective improvements in self-confidence were also seen from the student feedback obtained during self-assessment questionnaires. Such skills included determining the order in which to read an imaging sequence, choosing the proper window width and level, as well as the choice of the reconstruction method. That might the result affected by the intervention of the trainer during the activity as well as the open discussion training. Moreover, following the experiential courses, the experiential approach allows better interactions which encouraged better interest in radiology which is vital for the future development of radiology [20].

Our study shows the efficacy of experiential education mode in the study of imaging anatomy. Anatomy is the basis for radiology education. In theory, reading CT and MR images is a good way to study anatomy because the contiguous scanning helps students to form three-dimensional concepts of relative locations of organs [21, 22]. It was globally concluded that imaging anatomy enhanced the quality and efficiency in human anatomy education [23]. However, it is hard to recognize the whole anatomical structure from a single cross-sectional image, which tends to increase student confusion [22]. Our study results provide evidence that reading a contiguous scan improves students’ comprehensive understanding of anatomy. Additionally, by utilizing multiple reconstruction methods, three dimensional images are more comprehensively visualized by students, which is a finding that has also been proven by other studies [24].

Much effort is needed to bring experiential education into practice. The PACS and a proper DICOM viewer represent the basic software requirements for experiential education. To protect patients’ privacy, we chose to copy the DICOM data from the PACS rather than to link to the original PACS. In this way, the development of a simulation PACS for undergraduate medical education similar to that of the University of Colorado School of Medicine is an ideal method for forming a simulation software environment [6]. In addition, teacher guidance is an especially critical element in education. At least 3 teaching assistants with standardized radiology training experience are needed in one class, as team-based discussion is a component in our experiential courses. Students need the teaching assistants to both guide image reading as well as to answer questions. Therefore, teaching assistants need specific experience working in a radiology department. Thus, we chose the junior radiology specialists as teaching assistant. Nevertheless, a shortage of teachers hinders the use of this teaching model on a wider scale, which serves as a limitation of the experiential education approach.

There are several limitations to the study. Firstly, due to the limited number of supervisors, the sample size was similarly limited. Secondly, this was a single centre study. Thirdly, due to the limitation of actual operation, only 47 of 61 students completed the questionnaire in the control group. Though the probability is very small, it still has a chance to lead to the bias of the result. Fourthly, though we have control the faculty and the teaching standard between the two groups, the bias caused by human factor still can not be fully avoided in practice. Fifthly, although we utilized objective evaluation measurements, this study also exposed the weakness of our evaluation system within radiology education. The study measures consisted of paper-and-pencil tests, with most questions consisting of objective items that test memory such as multiple choice questions and short answer questions. Furthermore, the subjective items that are used to test application ability are limited. Consequently, only a small part of the final exam reflected the difference between the experiential education group and the control group. Other test forms such as bedside examinations and multi-station examinations should be used in the future for better assessment of application ability [25, 26].

As stated in the students’ recommendations, this model of experimental teaching can still be improved. For example, at Dartmouth-Hitchcock Medical Center, students are required to attend a radiology triage programme to work with on-call radiology residents [27]. Such students have reported this to be a valuable clinical learning experience, as well as a good way to relieve the workflow of residents. In our questionnaire, some students also requested to take the internship in the radiology department. This kind of programme can be brought into practice as an important aspect of experiential education. Additional forms of education, such as integrative teaching, may also be applied in future radiology education courses [28].

Conclusion

In conclusion, our study found that experiential education shows some advantages than traditional education model in improving analysis and diagnostic skills, as well as students’ self-confidence. As an attempt to bring the experiential education mode into undergraduate radiology education, we hope it will pave a new way for the education evolution.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

3D:

3-dimensional

CT:

Computed tomography

DICOM:

Digital Imaging and Communication in Medicine

MPR:

Multiple planar reconstruction

MR:

Magnetic resonance

PACS:

Picture archiving and communication system

References

  1. Bhogal P, Booth TC, Phillips AJ, Golding SJ. Radiology in the undergraduate medical curriculum -- who, how, what, when, and where? Clin Radiol. 2012;67(12):1146–52.

    Article  Google Scholar 

  2. Naeger DM, Webb EM, Zimmerman L, Elicker BM. Strategies for incorporating radiology into early medical school curricula. J Am Coll Radiol. 2014;11(1):74–9.

    Article  Google Scholar 

  3. Forsberg D, Rosipko B, Sunshine JL. Factors affecting Radiologist's PACS usage. J Digit Imaging. 2016;29(6):670–6.

    Article  Google Scholar 

  4. Mirsadraee S, Mankad K, McCoubrie P, Roberts T, Kessel D. Radiology curriculum for undergraduate medical studies--a consensus survey. Clin Radiol. 2012;67(12):1155–61.

    Article  Google Scholar 

  5. Carriero A, Bonomo L, Calliada F, Campioni P, Colosimo C, Cotroneo A, Cova M, Ettorre GC, Fugazzola C, Garlaschi G, et al. E-learning in radiology: an Italian multicentre experience. Eur J Radiol. 2012;81(12):3936–41.

    Article  Google Scholar 

  6. Restauri N, Bang TJ, Hall B, Sachs PB. Development and utilization of a simulation PACS in undergraduate medical education. J Am Coll Radiol. 2018;15(2):346–9.

    Article  Google Scholar 

  7. Zafar S, Safdar S, Zafar AN. Evaluation of use of e-learning in undergraduate radiology education: a review. Eur J Radiol. 2014;83(12):2277–87.

    Article  Google Scholar 

  8. Nkenke E, Vairaktaris E, Bauersachs A, Eitner S, Budach A, Knipfer C, Stelzle F. Spaced education activates students in a theoretical radiological science course: a pilot study. BMC Med Educ. 2012;12:32.

    Article  Google Scholar 

  9. Estai M, Bunt S. Best teaching practices in anatomy education: a critical review. Ann Anat. 2016;208:151–7.

    Article  Google Scholar 

  10. Wan JRZ, X.Y; Li, G.W: The value and significance of PACS system in standardized training of resident. China Continuing Medical Education 2017, 9(16):7–8.

  11. Kumar V, Gadbury-Amyot CC. A case-based and team-based learning model in oral and maxillofacial radiology. J Dent Educ. 2012;76(3):330–7.

    Google Scholar 

  12. Terashita T, Ogasawara K. an introduction and implementation of problem-based learning for radiography positioning training. Nihon Hoshasen Gijutsu Gakkai Zasshi. 2015;71(3):216–21.

    Article  Google Scholar 

  13. Chetlen AL, Mendiratta-Lala M, Probyn L, Auffermann WF, DeBenedectis CM, Marko J, Pua BB, Sato TS, Little BP, Dell CM, et al. Conventional medical education and the history of simulation in radiology. Acad Radiol. 2015;22(10):1252–67.

    Article  Google Scholar 

  14. Pascual TN, Chhem R, Wang SC, Vujnovic S. Undergraduate radiology education in the era of dynamism in medical curriculum: an educational perspective. Eur J Radiol. 2011;78(3):319–25.

    Article  Google Scholar 

  15. Sendra-Portero F, Torales-Chaparro OE, Ruiz-Gomez MJ, Martinez-Morillo M. A pilot study to evaluate the use of virtual lectures for undergraduate radiology teaching. Eur J Radiol. 2013;82(5):888–93.

    Article  Google Scholar 

  16. Zhang S, Xu J, Wang H, Zhang D, Zhang Q, Zou L. Effects of problem-based learning in Chinese radiology education: a systematic review and meta-analysis. Medicine (Baltimore). 2018;97(9):e0069.

    Article  Google Scholar 

  17. Yardley S, Teunissen PW, Dornan T. Experiential learning: transforming theory into practice. Med Teach. 2012;34(2):161–4.

    Article  Google Scholar 

  18. Rodgers PT, Leadon K. Characteristics of experiential education web sites of US colleges and schools of pharmacy. Am J Pharm Educ. 2013;77(5):96.

    Article  Google Scholar 

  19. Hoffman SJ, Silverberg SL. Training the next generation of global health advocates through experiential education: a mixed-methods case study evaluation. Can J Public Health. 2015;106(6):e442–9.

    Article  Google Scholar 

  20. Branstetter BF, Humphrey AL, Schumann JB. The long-term impact of preclinical education on medical students' opinions about radiology. Acad Radiol. 2008;15(10):1331–9.

    Article  Google Scholar 

  21. Schober A, Pieper CC, Schmidt R, Wittkowski W. "anatomy and imaging": 10 years of experience with an interdisciplinary teaching project in preclinical medical education - from an elective to a curricular course. Rofo. 2014;186(5):458–65.

    Google Scholar 

  22. Jang HW, Oh CS, Choe YH, Jang DS. Use of dynamic images in radiology education: movies of CT and MRI in the anatomy classroom. Anat Sci Educ. 2018;11(6):547–53.

    Article  Google Scholar 

  23. Grignon B, Oldrini G, Walter F. Teaching medical anatomy: what is the role of imaging today? Surg Radiol Anat. 2016;38(2):253–60.

    Article  Google Scholar 

  24. Loke YH, Harahsheh AS, Krieger A, Olivieri LJ. Usage of 3D models of tetralogy of Fallot for medical education: impact on learning congenital heart disease. BMC Med Educ. 2017;17(1):54.

    Article  Google Scholar 

  25. Reddy S, Straus CM, McNulty NJ, Tigges S, Ayoob A, Randazzo W, Neutze J, Lewis P. Development of the AMSER standardized examinations in radiology for medical students. Acad Radiol. 2015;22(1):130–4.

    Article  Google Scholar 

  26. Monticciolo DL. The ACR diagnostic radiology in-training examination: evolution, current status, and future directions. J Am Coll Radiol. 2010;7(2):132–7.

    Article  Google Scholar 

  27. Chen JY, Lewis PJ. The value of a medical student radiology triage program in enhancing clinical education and skills. Acad Radiol. 2014;21(7):829–33.

    Article  Google Scholar 

  28. Baghdady MT, Carnahan H, Lam EW, Woods NN. Integration of basic sciences and clinical sciences in oral radiology education for dental students. J Dent Educ. 2013;77(6):757–63.

    Google Scholar 

Download references

Acknowledgments

The authors wish to thanks all the students who participated in this study.

Funding

This work was supported by the Teaching Quality Project of Sun Yat-sen University [grant numbers 80000–18832601]. The Grants-in-Aid just supported this study financially, and had no role in the design of the study and collection, analysis, and interpretation of data and in writing the manuscript.

Author information

Authors and Affiliations

Authors

Contributions

YC, KZ, JY, QM and SF made substantial contributions to study conception and design and data acquisition. YC, SY, JW and ZL made substantial contributions to analysis and interpretation of the data. YC and SF made substantial contributions to drafting the document. YC, LX, JY and SF made substantial contributions to critically revising the article. All authors (YC, KZ, SY, JW, LX, ZL, QM, JY and SF) approved the final manuscript for submission.

Corresponding authors

Correspondence to Jianyong Yang or Shi-Ting Feng.

Ethics declarations

Ethics approval and consent to participate

The ethics committee of the First Affiliated Hospital, Sun Yat-sen University has approved the study. For the convenience of actual operation, verbal consent was obtained from the study participants, which was approved by the ethics committee.

Consent for publication

Not applicable.

Competing interests

The authors declare that they have no competing interests.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary information

Additional file 1.

Self-assessment radiologic skills questionnaire (English language version).

Additional file 2.

Learner satisfaction questionnaire (English language version).

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Chen, Y., Zheng, K., Ye, S. et al. Constructing an experiential education model in undergraduate radiology education by the utilization of the picture archiving and communication system (PACS). BMC Med Educ 19, 383 (2019). https://doi.org/10.1186/s12909-019-1827-0

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-019-1827-0

Keywords