- Research
- Open access
- Published:
Promotion of training course on ICD-10 Poisoning coding : necessity to adopt preventive strategies
BMC Medical Education volume 23, Article number: 903 (2023)
Abstract
Background
Poisoning is considered the most common cause of referral to emergency departments and hospitalization in the intensive care unit (ICU). Training or retraining of coders and ensuring the positive impact of these trainings in assigning accurate codes to poisoning cases is necessary to adopt practical health measures for optimal management of this disease. The present study aimed to evaluate the impact of holding a training course on poisoning coding rules based on ICD-10 in clinical coders.
Methods
This study is descriptive and analytical. With the target population included the coders of hospitals affiliated with Shahid Beheshti University of Medical Sciences (N = 45). In order to evaluate the training course on poisoning coding rules, the Conex Input Process Product (CIPP) evaluation model was used. This model was the first goal-oriented approach evaluation model. According to the CIPP model, evaluation of the training course held in four components, including Context factors (course objectives and priority of objectives), Input factors (instructor, curriculum, facilities, equipment, and training location), Process factors (teaching process, learning, management, and support), and Product factors (feedback, knowledge, and skills). A researcher-made questionnaire containing 39 questions with a 5-point Likert scale was used to collect data. The validity of the questionnaire was calculated through content validity, and its reliability was calculated using Cronbach’s alpha coefficient (alpha = 90% in all components). In order to analyze the data, descriptive statistics (frequency percentage distribution) and inferential statistics (one-sample t-test) were used.
Results
The findings of this study were presented in four components of context, input, process, and product evaluation. The average criterion for all questions in the questionnaire was considered 3. As a result, the significance level obtained from the one sample t-test was equal to P = 0. 0001.The training course had a favorable effect in terms of context, input, process and products.
Conclusion
The knowledge and skills of clinical coders can be enhanced by updating medical knowledge, holding training courses, workshops, seminars, and conducting clinical coder accreditation. Extensive and continuous training for clinical coders is essential due to the impact of code quality on financial forecasting, electronic health records, and conducting research.
Background
Currently, poisoning is considered the most common cause of referral to emergency departments and hospitalization in the intensive care unit [1, 2]. As many as six to eight million cases of poisoning occur annually in the United States, and roughly $ 99.1 billion is spent on treatment [3, 4]. Of these, approximately 300,000 have been hospitalized, and 30,000 have died [5]. The incidence of poisoning in 2014 is estimated at nearly four million people [5]. In Iran, poisoning is the most common cause of hospitalization and the second leading cause of death in hospitalized patients [6]. Depending on the nature, severity, and complications of acute poisoning, it requires unique methods to plan, prevent, and effectively manage [7].
Recorded medical data and related studies, often used for health services research, are valuable tools for collecting accurate data [8]. On the other hand, to create the ability to collect and analyze this data uniformly, as well as to make significant comparisons between regions or countries, it is necessary to coding the poisoning data correctly and accurately based on a standard tool. The ICD (International Classification of Diseases and health related problems), as an international standard in coding, while providing this capability, provides the basis for providing reliable reports on the types of poisoning and related measures [9].
Accurate coding requires a coding training program. In these programs, by teaching the coding rules, they have improved the coding [10, 11]. Studies show a direct relationship between the effectiveness of coding training and the reliability of codes assigned by coders to cases. In these programs, by teaching the coding rules, they have improved the coding [12].
In examining the quality of coding in Illinois hospitals in the United States, they concluded that the quality of coding in hospitals that provide continuous coding training for coders is higher than in other hospitals [13]. The results of another study on the coding error rate in Australia revealed that in the centers where the coding rules training courses were not implemented, the error rate was higher than in centers with continuous training courses for the coders [14].
In another study, the results indicated that the program of continuous training, continuous monitoring, and feedback of coding training increases the perception of coders and improves the quality of coding. Hence, continuous training of coders allows for increased interaction with clinical staff [15]. In some studies, the importance and effectiveness of coders’ professional training were emphasized through a coherent management structure and data quality improvement [16, 17]. Due to the increasing incidence of poisoning and complications, mainly in developing countries where poisoning is associated with a high mortality rate, information to coding the Poisoning play an essential role in the implementation of control programs and its complications [18, 19]. In a study, assigning accurate codes to carbon monoxide poisoning and not coding it with unknown external agents leads to targeted monitoring of this type of poisoning [20]. In addition, the use of poisoning codes using ICD classification is considered one of the criteria for measuring the prevalence of drug poisoning [21]. In South Korea, using statistics on pesticide poisoning codes using the ICD-10 classification has led to the presentation of health strategies and interventions to control this type of poisoning [22]. In a similar study, the importance of the statistics provided for accurate coding of heroin poisoning in the hospital emergency department was confirmed to monitor and control opioid poisoning [23].
Objectives
The present study aimed to evaluate and promote the impact of holding a training course on poisoning coding rules based on ICD-10 in clinical coders and adopt preventive strategies through the promotion of training courses.
Methods
The present study is a descriptive and analytical study with the target population included the coders of hospitals affiliated with Shahid Beheshti University of Medical Sciences (N = 45). In order to evaluate the training course on poisoning coding rules, the Conex Input Process Product (CIPP) evaluation model was used. This model was the first goal-oriented approach evaluation model by stufflebeam,et al. [24].
According to the CIPP model, evaluation of the training course held in four components, including Context factors (course objectives and priority of objectives), Input factors (instructor, curriculum, facilities, equipment, and training location), Process factors (teaching process, learning, management, and support), and Product factors (feedback, knowledge, and skills).
The context effectiveness of the training course, its purpose is to provide a logical context for determining educational goals, and this stage of evaluation includes analytical efforts to determine elements related to the environment and efforts to identify problems, needs, and opportunities in an educational situation. In the step of input effectiveness, the required information about how to use the resources to achieve the goals of the program is collected. In the process of input effectiveness, the nature of the ability of the educational system and potential strategies to achieve the goals identified as a result of the context effectiveness are determined. Also, at this stage, decision makers are helped to design the methods that are necessary to achieve the goals. The process effectiveness of the training course, at this stage, efforts are made to answer questions such as, is the program being implemented well? What are the obstacles to its success? What changes are necessary? In product effectiveness, the real results are determined. After the complete review of the results, the necessary information is provided to the decision makers to decide whether to continue the program or stop it if necessary.
The questionnaire with 39 questions were administered to 45 coders of the hospital, these coders who work in Health information management department of hospital, study medical records to coding diagnoses based on ICD. This questionnaire is a researcher – made with a 5-point Likert scale (strongly agree to strongly disagree) was used to collect data. The validity of the questionnaire was calculated through content validity, and its reliability was calculated using Cronbach’s alpha coefficient (alpha = 90% in all components). In order to analyze the data, descriptive statistics (frequency percentage distribution) and inferential statistics (one-sample t-test) were used. The evaluation questions of the poisoning coding training course were divided into 4 parts. The first part(context) includes 9 questions about the goals and priorities of the course, the second part (input) includes 10 questions about strategies and the educational program, the third part (process) includes 11 questions about the matching of strategies with goals, evaluation feedback, program implementation and obstacles and necessary changes to the program and department. The fourth part(products) included 9 questions about necessary reforms in conducting the training course and unforeseen cases. One time training was held and also, Pre-test and post-test were designed to evaluate the rate of poisoning coding rules and guidelines by coders.
Results
The findings of this study were presented in four components of context, input, process, and product evaluation. According to the questions of the research questionnaire on a 5-point Likert scale (strongly agree to strongly disagree), the average criterion for all questions was considered 3. As a result, the significance level obtained from the single sample t-test was equal to P = 0.0001. The results of evaluating the effectiveness of the training course on poisoning coding rules in terms of context, input, process, products is presented in Table 1.
According to Table 1, a significant level obtained from a one-sample t-test was equal to P = 0.000. This means that a significant difference (p < 0.01) was observed between the mean of the result and the mean of the criterion. As a result, the training course has had a favorable effect in terms of context.
Regarding the input component, the significance level obtained from the t-sample’s equation was equal to P = 0.000. This means that a significant difference (p < 0.01) was observed between the mean of the result and the mean of the criterion. As a result, the training course has been highly effective in terms of input.
The findings also indicate the optimal effectiveness of the training course in terms of process. Regarding the product component, the significance level obtained from the one-sample t-test was equal to P = 0.000. This means that a significant difference (p < 0.01) was observed between the mean of the result and the mean of the criterion. As a result, the training course has had a desirable effect in terms of product.
Discussion
Poisoning has severe and irreversible effects on human health and, if left untreated, can lead to death [3]. According one study, the causes of poisoning in individuals are diverse, and its range varies based on the extent of toxic chemical agents. Accordingly, it is necessary to adopt unique methods for collecting relevant data to plan, prevent, and manage proper and effective poisoning according to the nature, severity, and complications of acute poisoning [7]. Therefore, a standard tool is needed to create the ability to collect and analyze data uniformly and make significant comparisons between similar data to be able to conduct preventive strategies. ICD is considered a standard tool for coding and classifying this data, as well as reporting for health monitoring in the health system [25]. According to another study, the reliability of diagnosis coding is essential for quality management and care financing [26].
Healthcare staff cannot make optimal patient care decisions without high-quality coded data [27]. Also, the importance of accurate and consistent coding of diagnoses and measures was emphasized. According to the results of this study, while emphasizing the compliance of the requested codes with the type of diagnosis and treatment (to pay for services by the patient), continuous training programs to accurately coding diagnoses and measures, audit, evaluate, and monitor the competence and accuracy of coders considered an essential factor [28].
The knowledge and skills of clinical coders can be enhanced by updating medical knowledge, holding training courses, workshops, seminars, and conducting clinical coder accreditation. Extensive and continuous training for clinical coders is essential due to the impact of code quality on financial forecasting, electronic health records, and conducting research. One way to update and improve the knowledge and skills of healthcare staff, including clinical coders, is to provide in-service training. In addition, developing coding training programs for coding professionals using ICD-10 codes is crucial to improving coding quality [4].
Santos et al. mentioned the lack of continuous training for clinical coders as an organizational factor that effectively reduces the accuracy, completeness, and timeliness of coding. They pointed out that by providing training for clinical coders, the quality of the codes can be improved [15]. Dyers’ research also shows the importance of educational interventions in improving the quality of coding, so it is emphasized that holding educational programs has improved coding accuracy [11].
The results of assessing participants’ opinions on different dimensions of educational programs in the research of Yi, Piryani, and Mohan indicated that participants evaluate education programs in different dimensions, including the curriculum, instructor, teaching method, and educational facilities [29,30,31]. In the above study, in general, the level of self-reported perceived self-confidence of the participants increased significantly after the training workshop. In this research, the Kirkpatrick model with 4-choice Likert was used on faculty members. In the present study, the evaluation of clinical coders was based on the CIPP model with a 5-point Likert, which was observed at four levels of favorable effect. In the study of Mohan was designed on the effectiveness of the training program on biomedical waste management, the population of this study were clinical employees, like our study. Kirkpatrick’s evaluation tool included reaction evaluation and learning evaluation. Various factors under training include definition, classification of biomedical waste, classification, waste management process, etc. As a result of the evaluation, there was a significant improvement in the skill level of the respondents after completing the training program, also a large number of the studied community gained knowledge about various aspects of biomedical waste management.Considering the diversity of educational courses in terms of content, audience, results, etc., it seems that a specific evaluation model does not have the same effectiveness for all educational courses, and it is better to use a suitable model for different levels of educational programs. And also, vvarious factors such as experienced professors, appropriate facilities and equipment, educational and research budgets, and appropriate curriculum and educational environment can affect the satisfaction of educational programs [32]. Accordingly, various aspects of program implementation should be considered in evaluating training courses.
Conclusion
In the present study, all evaluation components of the training course, including Context factors (course objectives and priority of objectives), Input factors (instructor, curriculum, facilities, equipment, and training location), Process factors (teaching process, learning, management, and support), and Product factors (feedback, knowledge, and skills) were evaluated. The results indicated the optimal effectiveness and efficiency of the training course. Therefore, it is possible to improve the accuracy of the coders’ coding for each disease by holding continuous and regular training courses on the rules of coding diagnoses based on ICD-10.
Availability of data and materials
The datasets used and/or analyzed during the present study are available from the corresponding author on reasonable request.
Abbreviations
- ICU:
-
Intensive care unit
- CIPP:
-
Conex Input Process Product
- ICD:
-
International Classification of Diseases and health related problems
References
Lamireau T, Llanas B, Kennedy A, Fayon M, Penouil F, Favarell-Garrigues J, Demarquez J. Epidemiology of Poisoning in children: a 7-year survey in a paediatric emergency care unit. Eur J Emerg Med. 2002;9(1):9–14.
Sabzghabaee A, Eizadi-Mood N, Montazeri K, Yaraghi A, Golabi M. Fatality in paraquat Poisoning. Singap Med J. 2010;51(6):496–500.
Krenzelok EP. The use of Poison prevention and education strategies to enhance the awareness of the Poison information center and to prevent accidental pediatric poisonings. J Toxicol. 1995;33(6):663–7.
Paydar S, Asadi F. Evaluating the effect of an in-service training workshop on ICD-10 coding instructions of pregnancy, Childbirth and the puerperium for clinical coders. J Med Life. 2021;14(4):565.
Stang M, Stang DD, HealthPartnerS Report, Committee on Poison Prevention and Control, Board on Health Promotion and Disease Prevention, Institute of Medicine of the National Academies. Magnitude of the problem. In: Forging a Poison Prevention and Control System. Washington, DC: National Academies Press; 2004. p. 34.
Nikfar S, Khatibi M, Abdollahi-Asl A, Abdollahi M. Cost and utilization study of antidotes: an Iranian experience. Int J Pharmacol. 2011;7(1):46–9.
Ramesha K, Rao KB, Kumar GS. Pattern and outcome of acute Poisoning cases in a tertiary care hospital in Karnataka, India. Indian J Crit care Medicine: peer-reviewed Official Publication Indian Soc Crit Care Med. 2009;13(3):152.
Li J, Heinz C, Finger RP. [Registry-based research in ophthalmology]. Ophthalmologe. 2018;115(10):826–31.
Forrester MB, Jaramillo JE. Coding of Influenza A H1N1 virus calls received by Texas Poison centers. Clin Toxicol (Phila). 2010;48(4):359–64.
Bramley M, Reid B. Clinical coder training initiatives in Ireland. Health Inform Manag. 2005;34(2):40–6.
Dyers R, Ward G, Du Plooy S, Fourie S, Evans J, Mahomed H. Training and support to improve ICD coding quality: a controlled before-and-after impact evaluation. South Afr Med J. 2017;107(6):501–6.
Hak T, Bernts T. Coder training: theoretical training or practical Socialization? Qualitative Sociol. 1996;19(2):235–57.
Callen JR, Hines N, Rust J, Killen J, Robertson L. Is coding in theatres a viable option? A review of the current theatre coding process at Royal Prince Alfred Hospital. ACORN Journal: Official Journal of the Australian Confederation of Operating Room Nurses. 1998;11(2).
Lorenzoni L, Da Cas R, Aparo UL. The quality of abstracting medical information from the medical record: the impact of training programmes. Int J Qual Health Care. 1999;11(3):209–13.
Santos S, Murphy G, Baxter K, Robinson KM. Organisational factors affecting the quality of hospital clinical coding. Health Inform Manag. 2008;37(1):25–37.
Hennessy DA, Quan H, Faris PD, Beck CA. Do coder characteristics influence validity of ICD-10 hospital discharge data? BMC Health Serv Res. 2010;10(1):1–9.
Flanagan R, Rooney C. Recording acute Poisoning deaths. Forensic Sci Int. 2002;128(1–2):3–19.
Fingerhut LA, Cox CS. Poisoning mortality, 1985–1995. Public health reports (Washington, DC: 1974). 1998;113(3):218–33.
Yu M. Coding for medication-related Poisoning and adverse effects. Continuum (Minneapolis Minn). 2017;23(3, Neurology of Systemic Disease):e17-9.
Oda G, Ryono R, Lucero-Obusan C, Schirmer P, Holodniy M. Carbon Monoxide Poisoning surveillance in the Veterans Health Administration, 2010–2017. BMC Public Health. 2019;19(1):190.
Blanc PD, Jones MR, Olson KR. Surveillance of Poisoning and Drug Overdose through hospital discharge coding, Poison control center reporting, and the drug abuse warning network. Am J Emerg Med. 1993;11(1):14–9.
Ko Y, Kim HJ, Cha ES, Kim J, Lee WJ. Emergency department visits due to pesticide Poisoning in South Korea, 2006–2009. Clin Toxicol (Phila). 2012;50(2):114–9.
Slavova S, Quesinberry D, Costich JF, Pasalic E, Martinez P, Martin J, Eustice S, Akpunonu P, Bunn TL. ICD-10-CM-Based definitions for Emergency Department Opioid Poisoning Surveillance: Electronic Health record case confirmation study. Public Health Reports (Washington DC: 1974). 2020;135(2):262–9.
Mckenna B, Nevo D, Stufflebeam D, Thomas R. Guía Profesional Para La Mejora De Los sistemas de evaluación del profesorado. Bilbao: Universidad de Deusto, ICE; 1998.
Mony PK, Nagaraj C. Health information management: an introduction to Disease classification and coding. Natl Med J India. 2007;20(6):307.
Stausberg J, Lang H, Obertacke U, Rauhut F. Classifications in routine use: lessons from ICD-9 and ICPM in surgical practice. J Am Med Inf Assoc. 2001;8(1):92–100.
Atoyebi T. What are the barriers to E-coding of quality clinical data in Irish hospitals from a coder’s perspective. Univ Dublin. 2012;2:12.
Miller J, Lineberry J. Coding for effective denial management. Radiol Manag. 2004;26(1):18–21.
Yi Z-M, Zhou L-Y, Yang L, Yang L, Liu W, Zhao R-S, Zhai S-D. Effect of the international pharmacy education programs: A pilot evaluation based on Kirkpatrick’s model. Medicine. 2020;99(27):e20945.
Piryani RM, Dhungana GP, Piryani S, Neupane MS. Evaluation of teachers training workshop at Kirkpatrick level 1 using retro–pre questionnaire. Adv Med Educ Pract. 2018;9:453.
Mohan DR, Prasad MV, Kumar KS. Impact of training on bio medical waste management–A study and analysis. EXCEL Int J Multidisciplinary Manage Stud. 2012;2(6):69–80.
Fitzpatrick JL. Alternative models for the structuring of professional preparation programs. New Dir Program Evaluation. 1994;1994(62):41–50.
Acknowledgements
We gratefully acknowledge the funding for this research of Shahid Beheshti University of Medical Sciences.
Funding
The study was funded by Shahid Beheshti University of Medical Sciences. Study design, data collection, and data analysis were all conducted independently of the funding body. This manuscript was prepared independently and did not necessarily reflect the views of the study’s funders. No funding was provided for the preparation of this manuscript.
Author information
Authors and Affiliations
Contributions
FA conceived the study and ShA and FA collected all the data. FA analyzed and interpreted the data. ShA drafted the manuscript. FA contributed to the revised paper and ShA was responsible for all final editing. All authors commented on the drafts of the manuscript and approved the final copy of the paper for submission.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
Verbal and written informed consent forms were obtained from all participants prior to the interviews. Participants also were informed that participation was voluntary and anonymous and that they could withdraw from the study at any time. The study protocol and all the procedures were reviewed and approved by the Research Ethics Committee of the Shahid Beheshti University of Medical Sciences. (Ethical research code: (IR.SBMU.RETECH.REC.1401.436). The study adheres to the principles of the Helsinki declaration.
Consent for publication
Not applicable.
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Asadi, F., Afkhami, S. & Asadi, F. Promotion of training course on ICD-10 Poisoning coding : necessity to adopt preventive strategies. BMC Med Educ 23, 903 (2023). https://doi.org/10.1186/s12909-023-04879-w
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12909-023-04879-w