- Research
- Open access
- Published:
The effect of short-term training about depth predicting score on the diagnostic ability of invasion depth for differentiated early gastric Cancer among non-expert endoscopists
BMC Medical Education volume 23, Article number: 347 (2023)
Abstract
Background
The depth-predicting score (DPS) was proposed based on conventional white-light imaging (C-WLI) endoscopic features of early gastric cancer (EGC) to determine the invasion depth of the neoplasm. However, the effect of DPS on training endoscopists remains unclear. Therefore, we aimed to investigate the effect of short-term DPS training on improving the diagnostic ability of EGC invasion depth and compare the training effect among non-expert endoscopists at different levels.
Methods
In the training session, the definitions and scoring rules of DPS were instructed, and classic C-WLI endoscopic example graphics were exhibited to the participants. Another C-WLI endoscopic images of 88 cases of histologically proven differentiated EGC were selected as an independent test dataset for evaluating the training effect. Each participant was tested, and the diagnostic accuracy rate of invasion depth was calculated differently one week before the training and after the completion of training.
Results
A total of 16 participants were enrolled and completed the training. Participants were divided into a trainee group and a junior endoscopist group according to the total number of C-WLI endoscopies performed. The total number of C-WLI endoscopies performed showed a significant difference between the trainee group and junior endoscopist group (350 vs. 2500, P = 0.001). No significant difference between the trainee group and junior endoscopist group was observed for pre-training accuracy. The overall diagnostic accuracy of invasion depth was improved significantly after completing DPS training compared with before (68.75 ± 5.71% vs. 61.58 ± 9.61%, P = 0.009). In the subgroup analysis, the post-training accuracy was higher than the pre-training accuracy, but significant improvement was observed only in the trainee group (61.65 ± 7.33% vs. 68.32 ± 5.71%, P = 0.034). In addition, no significant difference in post-training accuracy between the two groups was observed.
Conclusion
Short-term DPS training can improve the diagnostic ability of the invasion depth of EGC and homogenize the diagnostic ability of non-expert endoscopists at different levels. The depth-predicting score was convenient and effective for endoscopist training.
Introduction
Gastric carcinoma (GC) is one of the foremost prevalent malignant neoplasms of the digestive tract and is the fourth leading cause of cancer-related deaths worldwide [1,2,3]. Early gastric cancer (EGC) is defined as invasive gastric adenocarcinoma confined to the mucosa or submucosa, irrespective of lymph node metastasis (T1, any N) [4]. The prognosis of EGC is excellent for patients, with a 5-year survival rate following lesion resection is > 90% [5, 6]. Minimally invasive treatments, including endoscopic submucosal dissection (ESD), have been widely accepted as the first-line treatment modality for EGC because they are less invasive and offer a better quality of life compared to surgical excision [7, 8].
The selection of curative endoscopic resection for EGC depends on the differentiation, size, and depth of invasion of the lesions [9, 10]. The absolute indications for curative endoscopic resection are differentiated EGC less than 20 mm in diameter and confined to the mucosa, with no lymphatic or vascular involvement [10]. Therefore, accurate determination of the depth of tumor invasion is a crucial indicator for selecting the optimal therapeutic strategy for EGC patients [11,12,13]. Currently, conventional white-light imaging (C-WLI), magnifying endoscopy (ME), and endoscopic ultrasonography (EUS) are the main endoscopic imaging modalities used to predict the invasion depth of EGC [14].
Because of its accessibility and convenience, C-WLI endoscopy is more commonly used to predict the invasion depth of EGC in clinical practice [15]. The depth-predicting score (DPS), which is based on four main endoscopic features, has been proposed for use in diagnosing the invasion depth of differentiated EGC during C-WLI endoscopy. The four features include remarkable redness, uneven surface, lesion size more than 30 mm and margin elevation. It has been reported that the diagnostic accuracy of DPS achieved over 80% and DPS has the superiority of convenience, simplicity, low cost and no additional equipment required, which makes it widely used for invasion depth diagnosis [16]. However, the effect of DPS used for endoscopist training is unclear. Thus, we designed this study to evaluate the effect of short-term DPS training on improving the diagnostic ability of the EGC invasion depth and compare the training effect among non-expert endoscopists at different levels.
Methods
Participants
Eligible participants were gastrointestinal endoscopists from the Second Affiliated Hospital of Anhui Medical University who had not accepted a professional training course about EGC diagnosis and did not know DPS before this study. Participants gave their informed consent prior to starting the survey. All participants were asked to complete a survey questionnaire including age, gender, years of experience in C-WLI endoscopy, and the number of C-WLI endoscopies performed. Exclusion criteria were incomplete questionnaires, unwillingness to participate, and had accepted a professional training course about EGC diagnosis before this study.
Training program and assessment
The training program and assessment consisted of three steps. Stage 1 (pre-training test): All participants were asked to take the diagnostic test by the test dataset first before the training. Stage 2(short-term training): One week after pre-training test, the definitions and scoring rules of DPS were introduced and explained, and classic C-WLI endoscopic example graphics were exhibited to the participants. Stage 3 (post-training test): All participants took the second diagnostic test by the same test dataset immediately after training. The diagnostic accuracy rate of each participant was calculated separately before the training and after the completion of training as evaluation metrics. Using the histological invasion depth as gold standard, the diagnostic accuracy was obtained by dividing the number of cases judged correctly before or after training by the total number of cases in the test dataset. Because SM2 patients can be excluded from absolute indication of ESD, specificity to predict M-SM1 may be more important in this situation. The specificity to predict M-SM1 was also calculated separately before and after the training. Using the histological invasion depth as gold standard, the specificity was obtained by dividing the number of M-SM1 EGC cases judged correctly before or after training by the actual number of M-SM1 EGC cases.
The dataset of the diagnostic test comprised C-WLI endoscopic images of 88 cases of histologically proven differentiated EGC with complete medical record materials. Participants were blinded to the clinical and pathological information. We used the same 88 cases in the same order for the pre-training test and post-training test, and this information was not disclosed to participants. All lesion images were collected with close-up and distant views. All endoscopic images were taken by C-WLI endoscopy (video-endoscope GIF-H260, GIF-H290; Olympus Medical Systems, Tokyo, Japan or video-endoscope EG29-i10N, Pentax, Tokyo, Japan) during actual clinical practice.
Details of DPS
DPS includes four endoscopic metrics: remarkable redness, uneven surface, lesion size more than 30 mm and margin elevation. Each endoscopic metric was assigned a certain number of points. Remarkable redness or uneven surface was assigned 1 point, and lesion size more than 30 mm or margin elevation was assigned 2 points. The resulting DPS was measured by a 6-point scale. A total of 3 points was defined as the cut-off value between pathologic M-SM1 and SM2. Written definitions and assigned points of each endoscopic feature were made available to all participants during DPS training and the post-training test (Table 1).
Statistical analysis
Statistical data analysis was performed using SPSS, version 23.0 (SPSS Inc.). The Shapiro–Wilk test was used to detect the normality of variables. Data were expressed as percentages or mean ± standard deviation, medians and interquartile ranges (1st quartile, 3rd quartile) as appropriate. Fisher’s exact test and Wilcoxon rank-sum tests were used to compare inter-group differences in demographic data. For normally distributed data, inter-group differences were compared using t-test for independent samples. Paired t tests were used to compare pre- and post-training differences. All statistical tests were two-sided, and P < 0.05 was considered statistically significant.
Results
A total of 16 participants were enrolled and completed the training. Participants were divided into a trainee group and a junior endoscopist group according to the total number of C-WLI endoscopies performed. Trainees were defined as residents-in-training who had completed < 400 previous C-WLI endoscopies. Junior endoscopists were defined as those who had completed 2000 to 3000 C-WLI endoscopies. The 16 learners included 8 trainees and 8 junior endoscopists. Participants in the trainee group were on average 26 years old (range, 23–27), the majority were female (75%), and they had less than 1 year of operator experience. Participants in the junior endoscopist group were on average 33 years old (range, 30–36), all were female (100%), and 37.5% had more than 3 years of operator experience. The total number of C-WLI endoscopies performed in the career was significantly different between the trainee group and the junior endoscopist group (350 vs. 2500, respectively, P = 0.001). The demographic information and characteristics are summarized in Table 2.
Pre- and post-training comparison of overall accuracy
The pre-training test accuracy was described as a baseline level. The overall diagnostic accuracy was significantly higher than the baseline after DPS training (68.75 ± 5.71% vs. 61.58 ± 9.61%, respectively), with a mean difference of 7.17% (95% CI 2.07–12.28, P = 0.009) (Fig. 1).
Subgroup analysis of pre- and post-training accuracy
In the subgroup analysis, no significant differences between the two groups were observed for pre-training accuracy (61.65 ± 7.33% vs. 61.51 ± 12.0%, P = 0.978) and post-training accuracy (68.32 ± 5.71% vs. 69.18 ± 6.06%, P = 0.776) (Fig. 2). The post-training accuracy was significantly higher than the baseline (68.32 ± 5.71% vs. 61.65 ± 7.33%, P = 0.034) in the trainee group (Fig. 2). In the junior endoscopists’ group, the post-training accuracy was also higher than the baseline, but with no significant differences (69.18 ± 6.06% vs. 61.51 ± 12.0%, P = 0.114) (Fig. 2).
Pre- and post-training comparison of specificity to Predict M-SM1 EGC
The pre-training specificity to predict M-SM1 EGC was described as a baseline level. The overall specificity was significantly higher than the baseline after DPS training (73.11±10.47% vs. 61.08±14.48%, P = 0.007). In the subgroup analysis, the post-training specificity was also higher than the baseline both in the trainee group (72.54±11.89% vs. 62.12±9.92%) and the junior group (73.68±9.65% vs. 60.04±16.99%), but with no significant differences.
Discussion
In this study, the value of short-term DPS training for endoscopists to improve the diagnostic ability of the invasion depth of EGC during C-WLI endoscopy was evaluated. We found that the overall diagnostic accuracy improved after training. It is indicated that short-term DPS training can improve endoscopists’ diagnostic ability of EGC invasion depth, which may be helpful to select the correct treatment strategy for EGC. To the best of our knowledge, this is the first report to apply DPS in endoscopist training and evaluate the effect of DPS training on improving the diagnostic accuracy of invasion depth of EGC.
DPS was proposed upon logistic regression analysis of four main endoscopic features summarized by three expert endoscopists, and the accuracy of the DPS was 82.5–84.8% in the validation set [16]. Although the diagnostic accuracy of DPS in our study did not achieve 70%, this may be explained by the fact that the participants were inexperienced endoscopists without having accepted a professional training course about EGC diagnosis.
In our study, participants were further divided into two groups according to the total number of C-WLI endoscopies performed. We aimed to observe the training effect among non-expert endoscopists with different levels.
On the one hand, we found that prior to training, the junior endoscopist group did not show higher accuracy in determining the invasion depth of EGC than the trainee group, although they performed more total C-WLI endoscopies. This suggested that the total number of endoscopies performed without special training was not correlated with the diagnostic ability of the invasion depth of EGC. Additionally, it was reported in previous studies that training plays an important role in improving the detection rate of EGC [17, 18]. Therefore, special training for endoscopists is very important to improve the diagnostic abilities of invasion depth of EGC.
On the other hand, post-training accuracy in the two groups increased after short-term DPS training, and showed no statistical difference between the two groups. In addition, the standard deviation of the post-training accuracy narrowed after the training. This shows that short-term DPS training helped to achieve homogeneity in the diagnostic abilities of invasion depth of EGC among non-expert endoscopists at different levels.
Although the accuracy of both groups increased after training, a statistically significant difference was not found in the junior group. The reason may be that greater inter-individual variation existed among junior endoscopists before training, as evidenced by the larger standard deviation. Studies have shown that the diagnostic accuracy of invasion depth may largely depend on the knowledge and experience of the endoscopist [19, 20]. For example, tumor size is insensitive in terms of depth of invasion, which may be because size observation under C-WLI endoscopy is greatly influenced by the physician’s technique and equipment [21,22,23]. Therefore, inter-individual variation in pre-training accuracy became greater in the junior endoscopist group because they had performed more endoscopies with different levels of experience.
Finally, we believed that the main contribution of this study is to show that DPS short-term training can be effective, improve swiftly the diagnostic ability of invasion depth for differentiated EGC among non-expert endoscopists, and have the superiority of being low-cost, simple, and convenient.
Limitations of the study
The present study has several limitations. First, this was a study performed at a single institution. Second, assessments of the endoscopic staging were performed based on recorded still images rather than real-time endoscopic observation. Third, short-term training was designed in our study. Further studies are needed to observe the effect of using a systematic training atlas and long-term DPS training.
Conclusion
Short-term DPS training can improve the diagnostic ability of the invasion depth of EGC and homogenize the diagnostic ability of non-expert endoscopists at different levels. The depth-predicting score was convenient and effective for endoscopist training.
Data availability
All data generated or analyzed during this study are included in this published article, missing datasets used or analyzed are available from the corresponding author on reasonable request.
Abbreviations
- GC:
-
Gastric carcinoma
- EGC:
-
early gastric cancer
- DPS:
-
Depth-predicting score
- C-WLI endoscopy:
-
Conventional white-light imaging endoscopy
- EUS:
-
Endoscopic ultrasonography
- M:
-
Mucosa
- SM:
-
Submucosa
- ESD:
-
Endoscopic submucosal dissection
References
Sung H, Ferlay J, Siegel RL, Laversanne M, Soerjomataram I, Jemal A et al. Global Cancer Statistics 2020: GLOBOCAN Estimates of Incidence and Mortality Worldwide for 36 Cancers in 185 Countries. CA Cancer J Clin, 2021. 71(3): p. 209–249.https://doi.org/10.3322/caac.21660
Liu Y, Ding W, Yu W, Zhang Y, Ao X, Wang J. Long non-coding RNAs: Biogenesis, functions, and clinical significance in gastric cancer. Mol Ther Oncolytics. 2021;23:458–76. https://doi.org/10.1016/j.omto.2021.11.005.
Machlowska J, Baj J, Sitarz M, Maciejewski R, Sitarz R, Gastric Cancer. Epidemiology, risk factors, classification, genomic characteristics and treatment strategies. Int J Mol Sci. 2020;21(11). https://doi.org/10.3390/ijms21114012.
Liu Q, Ding L, Qiu X, Meng F. Updated evaluation of endoscopic submucosal dissection versus surgery for early gastric cancer: a systematic review and meta-analysis. Int J Surg. 2020;73:28–41. https://doi.org/10.1016/j.ijsu.2019.11.027.
Liu B, Sun X. miR-25 promotes invasion of human non-small cell lung cancer via CDH1. Bioengineered. 2019;10(1):271–81. https://doi.org/10.1080/21655979.2019.1632668.
Choi JH, Kim ES, Lee YJ, Cho KB, Park KS, Jang BK, et al. Comparison of quality of life and worry of cancer recurrence between endoscopic and surgical treatment for early gastric cancer. Gastrointest Endosc. 2015;82(2):299–307. https://doi.org/10.1016/j.gie.2015.01.019.
Karimi P, Islami F, Anandasabapathy S, Freedman ND, Kamangar F. Gastric cancer: descriptive epidemiology, risk factors, screening, and prevention. Cancer Epidemiol Biomarkers Prev. 2014;23(5):700–13. https://doi.org/10.1158/1055-9965.EPI-13-1057.
Pyo JH, Lee H, Min BH, Lee JH, Choi MG, Lee JH, et al. Long-term outcome of endoscopic resection vs. surgery for early gastric Cancer: a non-inferiority-matched cohort study. Am J Gastroenterol. 2016;111(2):240–9. https://doi.org/10.1038/ajg.2015.427.
Gotoda T, Yanagisawa A, Sasako M, Ono H, Nakanishi Y, Shimoda T, et al. Incidence of lymph node metastasis from early gastric cancer: estimation with a large number of cases at two large centers. Gastric Cancer. 2000;3(4):219–25. https://doi.org/10.1007/pl00011720.
Nishizawa T, Yahagi N. Long-term outcomes of using endoscopic submucosal dissection to treat early gastric Cancer. Gut Liver. 2018;12(2):119–24. https://doi.org/10.5009/gnl17095.
Zhang X, Yao J, Zhang Y, Huang X, Wang W, Huang H. Updated evaluation of the diagnostic performance of double contrast-enhanced Ultrasonography in the preoperative T staging of gastric Cancer: a Meta-analysis and systematic review. Front Oncol. 2022;12:844390. https://doi.org/10.3389/fonc.2022.844390.
Smyth EC, Nilsson M, Grabsch HI, van Grieken NC, Lordick F. Gastric cancer. Lancet. 2020;396(10251):635–48. https://doi.org/10.1016/S0140-6736(20)31288-5.
Tate DJ, Klein A, Sidhu M, Desomer L, Awadie H, Lee EYT, et al. Endoscopic submucosal dissection for suspected early gastric cancer: absolute versus expanded criteria in a large western cohort (with video). Gastrointest Endosc. 2019;90(3):467–79. https://doi.org/10.1016/j.gie.2019.04.242.
Ochiai Y, Kikuchi D, Inoshita N, Hayasaka J, Suzuki Y, Tanaka M et al. Clinicopathological Features of Advanced Gastric Cancers which Were Misjudged and Subjected to Endoscopic Submucosal Dissection. Gastroenterol Res Pract, 2020. 2020: p. 6525098.https://doi.org/10.1155/2020/6525098
Kato M, Uedo N, Nagahama T, Yao K, Doyama H, Tsuji S, et al. Self-study of the non-extension sign in an e-learning program improves diagnostic accuracy of invasion depth of early gastric cancer. Endosc Int Open. 2019;7(7):E871. https://doi.org/10.1055/a-0902-4467.
Abe S, Oda I, Shimazu T, Kinjo T, Tada K, Sakamoto T, et al. Depth-predicting score for differentiated early gastric cancer. Gastric Cancer. 2011;14(1):35–40. https://doi.org/10.1007/s10120-011-0002-z.
Zhang Q, Chen ZY, Chen CD, Liu T, Tang XW, Ren YT, et al. Training in early gastric cancer diagnosis improves the detection rate of early gastric cancer: an observational study in China. Med (Baltim). 2015;94(2):e. https://doi.org/10.1097/MD.0000000000000384.
Kim SY, Park JM. Quality indicators in esophagogastroduodenoscopy. Clin Endosc. 2022;55(3):319–31. https://doi.org/10.5946/ce.2022.094.
Haruki S, Kobayashi K, Yokoyama K, Sada M, Koizumi W. Comparison of diagnostic accuracies of various endoscopic examination techniques for evaluating the invasion depth of colorectal tumors. Gastroenterol Res Pract, 2012. 2012: p. 621512.https://doi.org/10.1155/2012/621512
Yao Z, Jin T, Mao B, Lu B, Zhang Y, Li S, et al. Construction and Multicenter Diagnostic Verification of Intelligent Recognition System for endoscopic images from early gastric Cancer based on YOLO-V3 Algorithm. Front Oncol. 2022;12:815951. https://doi.org/10.3389/fonc.2022.815951.
Sano T, Okuyama Y, Kobori O, Shimizu T, Morioka Y. Early gastric cancer. Endoscopic diagnosis of depth of invasion. Dig Dis Sci. 1990;35(11):1340–4. https://doi.org/10.1007/BF01536738.
Sonnenberg A, Giger M, Kern L, Noll C, Study K, Weber KB, et al. How reliable is determination of ulcer size by endoscopy? Br Med J. 1979;2(6201):1322–4. https://doi.org/10.1136/bmj.2.6201.1322.
Yao K, Uedo N, Kamada T, Hirasawa T, Nagahama T, Yoshinaga S, et al. Guidelines for endoscopic diagnosis of early gastric cancer. Dig Endosc. 2020;32(5):663–98. https://doi.org/10.1111/den.13684.
Acknowledgements
We show the greatest gratitude to all the participants.
Funding
This study was supported by the Quality Engineering Project of Anhui Province under Grant (number 2018jyxm0403) and the Excellent Talents Project of University in Anhui Province under Grant (number gxgwfx20210122021).
Author information
Authors and Affiliations
Contributions
XP Hu and J Liu mainly contributed to the study concept and design, and revised drafts of the manuscript. H Li contributed to the drafting of the manuscript. H Li, H Hu, P Geng, PH Guo, YR Zhu, and LL Zeng contributed to the acquisition and analysis of the data. All authors have read and approved the submitted version of the paper.
Corresponding authors
Ethics declarations
Ethics approval and consent to participate
All methods were carried out in accordance with relevant guidelines and regulations. And the project was approved by the local ethics committee of the Second Affiliated Hospital of Anhui Medical University, number SL-YX2022-115. Informed consent was obtained from all subjects and/or their legal guardian(s).
Consent for publication
Not applicable.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Li, H., Hu, H., Geng, P. et al. The effect of short-term training about depth predicting score on the diagnostic ability of invasion depth for differentiated early gastric Cancer among non-expert endoscopists. BMC Med Educ 23, 347 (2023). https://doi.org/10.1186/s12909-023-04230-3
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12909-023-04230-3