Discrepancies between perceptions of students and deans regarding the consequences of restricting students’ use of electronic medical records on quality of medical education
© The Author(s). 2017
Received: 13 September 2016
Accepted: 17 February 2017
Published: 13 March 2017
Electronic medical records (EMR) are more used in university hospitals, but the use of EMR by medical students at the workplace is still a challenge, because the conflict of interest between medical accountability for hospitals and quality of medical education programs for students. Therefore, this study investigates the use of EMR from the perspective of medical school deans and students, and determines their perceptions and concerns about consequences of restricted use of EMR by students on quality of education and patient care.
We administered a large-scale survey about the existence of EMR, existing policies, students’ use for learning, and consequences on patient care to 42 deans and 789 Residency Physician Applicants in a private university in Colombia. Data from 26 deans and 442 former graduated students were compared with independent t tests and chi square tests.
Only half of medical schools had learning programs and policies about the use of EMR by students. Deans did not realize that students have less access to EMR than to paper-based MR. Perceptions of non-curricular learning opportunities how to write in (E)MR were significantly different between deans and students. Limiting students use of EMR has negative consequences on medical education, according to both deans and students, while deans worried significantly more about impact on patient care than students. Billing issues and liability aspects were their major concerns.
There is a need for a clear policy and educational program on the use of EMR by students. Discrepancies between the planned curriculum by deans and the real clinical learning environment as experienced by students indicate suboptimal learning opportunities for students. Creating powerful workplace-learning experiences and resolving concerns on students use of EMR has to be resolved in a constructive collaboration way between the involved stakeholders, including also EMR designers and hospital administrators. We recommend intense supervision of students’ work in EMR to take full advantage of the technological advances of EMR at the modern clinical site, both for patient care and for medical education.
KeywordsElectronic medical records Electronic health records Undergraduate medical education Clerkships Workplace learning e-learning Student perceptions Stakeholders
Information and communication technologies are an important part of today’s health systems, including university hospitals and therefore medical education. Worldwide, most hospitals are evolving towards the development of electronic medical records (EMR) including standardized entries, suggested prescription and online monitoring of guidelines adherence [1–3]. For medical students of the “net generation” it is more natural to write on a computer and look for information on the internet than to work with handwritten notes on a chart . However, “medical students are learners. Thus, states do not give licenses to them and their notes should not become part of the medical-legal record” . This has been identified by several educational associations such as the Association of American Medical Colleges (AAMC) and the Council of Medical Education (CME) that have issued reports calling for changes in undergraduate and graduate curricula to better educate students and residents in this critical aspect of medical practice [5–7]. The Alliance for Clinical Education states that students must document their own findings in EMR to develop written communication skills and clinical reasoning. The Alliance called for medical educators to have a unified policy in this regard . Understanding of effects of the transition of paper-based medical records to EMR on medical education is still limited.
Medical students are unlicensed and therefore, they are not allowed to independently work in an EMR and report on examination or medical decision-making, but they do have to learn the skills to work with EMR before graduation . A discrepancy arises between interests of medical education and patient care. In order to get insight in the impact of these conflicting interests in practice, this study investigates the perceptions of deans of medical schools, who are well aware of liability issues and regulations, and students, who have to develop their competencies at the workplace, regarding students’ use of EMR, its consequences and felt concerns.
Students will be cautious and awaiting guidance in managing EMR from their teachers, but many medical schools have not changed their curricula to introduce competencies in manage EMR . There is a need to consider the presence of computers as a potential disruptive “third party” on the student-patient relationship and on team work at medical ward.Since the introduction of EMR, the availability of patient information online has changed the way patients’ clinical history is obtained and reviewed, which is likely to affect the development of patient-student relationships and oral communication skills [8, 10, 11]. Students no longer collect information from patients and families before the presentation of the information to the group during the clinical round; instead students and teachers both collect most information about the patient by reviewing EMR in advance. It has been shown that training is needed to learn how to effectively use EMR and identify patient safety issues . Furthermore, the development of written communication skills can be hindered by EMR, as a good proportion of hospitals prohibit data entry by students . The use of the tool to copy and paste information, as well as the presence of programmed inputs to history have diminished the quality of clinical history and hampered the development of clinical reasoning .
Academic medical centers with departments of Health Informatics have designed systems to enable better use of EMR by students, but this is not the case in most hospitals . Only some medical schools have incorporated the topic of adequate use of information technology in their curriculum; training programs for these skills, which are of high importance for today’s physicians, are too often lacking [9, 15]. Therefore, exploring the perspective of deans — the academic authorities — regarding the use of EMR by medical students in comparison to the views of the students themselves will add to our understanding of the challenges medical education is currently facing. Several earlier reported studies have conducted interviews with deans, program directors, clerkship directors, residents or medical students getting their opinions. In general, no positive effects of the implementation and use of EMR on medical education were reported [13, 16–18]. A potential problem with these studies is that contrasts between the viewpoints of different stakeholders have not been studied in depth. When lacking insight in the different perspectives on the same issues, it is hard to find clues to improve the situation . The research question to be addressed is: Are there differences between the perceptions of deans and students regarding the use of EMR by students, its value in medical education, and its consequences for quality of medical education and patient care?
Participants and procedure
We invited all 42 deans of medical schools, being members of the Colombian Association of Medical Schools, to voluntary and anonymously participate in the study and fill out an online survey in February 2013. Seventeen deans and nine program directors on behalf of the deans responded (total response rate 62%), after sending two reminders.
Additionally, we invited 789 medical doctors, who graduated from several universities in Colombia and were applying to a residency program at Pontificia Universidad Javeriana in 2012. Former graduates, who were medical students in the last 3 years and have been users of EMR as students and doctors, represent the experienced student perspective. They are called ‘students’ throughout this article. A paper-based survey was handed out to them just before the presentation of their medical knowledge exam. It started with a paragraph asking for voluntary participation and assuring anonymity. 726 out of 789 (92%) completed the survey. We selected data from graduates in the last 3 years for current analyses, as they had recent experiences with EMR at medical school (N = 442, 49.4% female, 86% younger than 26 years old).
An existing questionnaire about the use of medical records (MR) and EMR in medical education  was used with the proper permission, translated into spanish and modified to our study context. We used two parallel versions — one for students and another for deans — containing 19 items,with small variations in the formulations depending of the targeted group. Items about the intended and actual student’use of MR and EMR to write progress notes were answered on a 4-point Likert type scale (from 1 = no hospitals to 4 = all hospitals). Questions about perception on the impact of students’ use of MR on education and patient care were written using the following general wording, for example: “What impact, if any, do you feel there is on medical student education if student notes are not allowed to be placed in patient records?” Questions were answered on a 5-point Likert scale (from 1 = very negative to 5 = very positive). Additionally, some items were included about demographic factors and characteristics of their medical schools: Number of students, number and type of affiliated hospitals, and if the school was private or public.
Data were analyzed using SPSS 19 software. Data from deans and students were compared with independent t-tests and χ 2 -tests. Data on characteristics of medical schools showed that the sample of students did not differ from the sample of deans in the percentage of public versus private schools, type of teaching hospitals, and number of affiliated hospitals (χ2 tests n.s.). To indicate effect sizes, Cohen’s d is reported: Cohen’s d of 0.2–0.3 is considered as small effect, around 0.5 as medium effect and larger than 0.8 as large effect .
Perceptions of the use of electronic medical records
Comparison of perceptions between students and deans regarding permission for students to place notes on paper MR or EMR
Year of enrollment and type of MR
Year 3, paper
Year 3, EMR
Year 4, paper
Year 4, EMR
Year 5, paper
Year 5, EMR
Students reported that they had access to write notes in patient records in more hospitals than the deans believed (significant on all tests). Students perceived that more hospitals using paper-based MR, allowed them to place notes compared to hospitals using EMR, particularly during years 3 (t = 2.62, p = .02, d = 0.22) and 4 (t = 2.64, p = .01, d = 0.21). This difference in the hospital permission, which dependes on the kind of medical record, was not found in the deans’ perceptions.
Educational program and learning opportunities on MR
The existence of a formal educational program on how to write progress notes in MR was recognized by 58.50% of the students and 57.50% of deans (χ2 = .07, p = .97). Both students and deans perceived the program about writing and assessing progress notes was mainly taught in 3rd and 4th year (χ2 = 3.44, p = .63 for write and χ2 = 5.49, p = .36 for assess). About half of the students (54%) and the deans (46%) answered that there was a university policy that regulates the placement of medical students’ notes in patient medical records.
Non-curricular opportunities to learn how to write progress notes in MR, as indicated by students and deans
Observing attending physicians
Writing without permission
Need to document in MR during internship
Consequences of EMR use for education and patient care
Deans and students thought that students’ notes should be part of the EMR in inpatient services in a progressive way from 3rd year (46% of students and 60% of deans, χ 2 = 3.40, p = .18) to 5th year (85% of students and 96% of deans, χ 2 = 2.07 p = .36). Numbers were similar when they were asked about outpatient services.
Opinions about impact of restriction on medical education, if any, according to students and deans
Impact on Medical Education
Student involvement in patient care
Assessment of competences
Feel part of the team
Development of communication written skills
Groundwork to be a MD
Opinions about impact of restriction of student documentation on MR on patient care, if any, according to students and deans
Impact on Patient Care
Possibility of medical errors
Opportunity of malpractice suits
Use of resident’s/physician’s time
Opportunity to find information on chart
Completeness of patient information
Care team’s understanding of patient problems
On a list of topics that may justify the restriction to write students’ notes on EMR the concern most identified was medical liability, as indicated by 85% of both students and deans. The need for co-signature was more important for deans (mentioned by 73% of them) than for students (47%, χ 2 = 6.89, p = .01). Billing aspect was a concern for 69% of deans and only for 27% of students (χ2 = 21.23, p < .00). Placement of incorrect information on EMR (deans: 73%, students: 57%), and accreditation issues (deans: 65%, students: 46%) were perceived as equally important by both deans and students.
The existence of a mechanism to assure the co-signature of students’ progress notes in EMR was known by 75% of the students and 77% of deans, while 6% of students and 8% of deans did not know about its existence (χ2 = 0.25, p = .88).
This survey including data from two important stakeholders in medical education - deans and students from medical schools - provides important information on perceptions and concerns about use of EMR by students. This aspect of medical education needs more understanding, especially because worldwide ever more university hospitals are using EMR at inpatient and outpatient services. Results indicating differences in perceptions between deans and students raise questions about the relationship between the planned curriculum, which deans are most aware of, and the real clinical learning environment, which is what students experience in daily practice. We found differences and similarities between perceptions of deans and students, which indicate directions for further improvement of the incorporation of the use of EMR in medical education.
Only about half of the deans and students report the existence of a formal learning program to teach how to write and assess progress notes in EMR and the existence of a policy regarding the placement of student notes in EMR. For students and curriculum planners an explicit and well-known policy about this subject would be beneficial. School authorities have to look for solutions to overcome the educational deficit of not having the use of EMR by students in their medical curriculum. Students more often found ways that allowed them to use EMR than assumed by deans. With the increase in the use of EMR at university hospitals, the findings that students perceive less possibility of documenting in the EMR compared to paper-based MR suggest a deterioration in the quality of the learning environment. Our results show that deans are not aware of this difference in student access to medical records depending on its format.
These results call our attention about these disagreements; a useful learning experience must align what planners and learners expect from the experience (participate and write notes in MRs), with the possibilities to do it in real life situations. If these differences between the expected or desired and the real situation are not worked out, learning experience quality will reduce. In their presentation of experience-based learning Dornan  concluded that a decrease of student participation in clinical practice may have a deleterious effect on learning. Designing learning environments has to be done with the participation of students, teachers and designers  The findings of the current study show discrepancies between the designers of learning experiences and the perception of students. A clinical learning environment is a complex setting that deserve in depth studies, with the participation of all actors involved, to understand the manner students find their way to learn while they are authorized to be “doctors” . There are non-curricular resources available in the clinical environment to acquire the required competencies to write on MR. Usefulness of these opportunities was perceived differently from curriculum planners and final users. Most of the deans assumed that observing and imitating attending physicians were resources that students may use to obtain the necessary skills to manage (E)MR. Only one out of three students saw this option as a learning opportunity. These results again raise questions about discrepancies between the planned learning activities and the real situation.
Restriction of students to place notes in patient EMR, may have negative impact on medical education and patient care, according to both deans and students. These findings remark the importance of finding a solution for this urgent educational problem. Restriction of students’ use of EMR causes students to not feeling part of the team of care, not having the possibility to write findings on patient’ charts, and having obstacles to learn and being assessed on writing communication skills. Student’s participation may enhance the amount and quality of relevant information about some aspects of patient conditions and, therefore, limiting their participation may decrease care team understanding of patient’s concerns. These results stress the need to find opportunities to improve quality of education and patient care, avoiding the tacit exclusion of the student in the team of care, as a method to develop real tasks in the design of the learning experiences in clerkships . Furthermore, concerns about economical or legal consequences when students are allowed to put notes in EMR should be shared between different stakeholders in order to align interest and decrease negative effects.
The development of EMR has been guided mainly for administrative purposes, but now seem to block that the students are involved in real clinical tasks. From the point of view of instructional design  and looking for the construction of powerful learning environments [19, 21], we need students acting and feeling as doctors, part of the team of care; we need that educators, teachers and students participate together in the construction of real life learning tasks. The hidden curriculum and the non-curricular opportunities to learn found in this study need to be clarified and incorporated in the curriculum. The opportunity to work with EMR developers to introduce educational tools, like the RIME proposal  and other tools that enable students to use EMR without resign their role as a part of the clinical team, needs to be seriously addressed. The integration between EMR and medical education had not been accomplished [7, 10]. Faculty development in medical bioinformatics and definition of specific competences in informatics for health professionals are necessary steps to take advantage of the prospective applications of EMR and e-health on medical education [10, 15, 26].
The results of our study, which is the first one that compares the perceptions of deans and students on this issue, contributes to understanding the complex situation of the use of a relatively new technological tool in a very traditional learning site as the clinical ward. A limitation of the study is that survey studies are susceptible for social desirability in answering. Our findings resonate with findings of earlier studies, for example a survey with clerk directors at USA, which has shown that medical students use EMR at higher rates than physicians at practice, but once again rises concerns about the link of practice with curricular design . From our results it is clear that a comprehensive approach with the participation of all actors is necessary to fully understand this complex situation. A further study focusing on the amount and type of supervision needed for medical students interfacing with the EMR is suggested. Educators, teachers and students point to different issues and consequences of the use of EMR in medical education, which impact the student-teacher, student-patient and patient-teacher relationships.
The spreading of the use of EMR at university hospitals with restricted access to students and the lack of regulatory policies and devoted learning activities in this context may be hampering the acquisition of clinical competencies for students. This study underlines that the role of the student during clinical clerkships needs to be redefined to resolve the current interference between use of EMR systems in hospitals and the quality of medical education for students. There is a need for a clear policy and educational program on the use of EMR by students. Deans and students, in our study and in other published studies and position statements [5, 8, 15, 17, 28] are convinced about the added value of students being able to write in EMR both for the quality of patient care and education. The Alliance for Clinical Education, an organization of clinical educators, has published critical principles of the use of EMR for medical studies, including that students must document their findings on EMR, while reviewed for content and format – which requires appropriate supervision - and schools must develop a set of medical student competencies related to charting in the EMR . Concerns about medical liability, billing, placement of incorrect information on EMR, and accreditation issues have to be resolved in a constructive collaboration between the involved stakeholders, including also EMR designers and hospital administrators. The restricted students’ use of EMR demonstrates that medical accountability is top priority, with suffering quality of medical education as its consequence. A better balance between both major aims is required.
In order to create a powerful work-placed learning experience the design of learning tasks during clerkships should define an active and well-defined participation of students in the different aspect of patient care, including the use of EMR. We recommend intense supervision of students’ work in EMR. The opportunities to take advantage of the technological advances of EMR and e-health is likely to increase with the coordinated participation of the different actors at the modern clinical site.
To Hospital Universitario San Ignacio for providing support for manuscript preparation, submission and publication.
To FAIMER institute for funding Ivan Solarte during his Master of Health Professions Education at Maastricht University. This study is the result of his thesis.
Hospital Universitario San Ignacio.
Availability of data and materials
The dataset generated and analyzed during the current study is available for review through the following link: https://osf.io/6wcg8/?view_only=6a14962023be408684974de204e0caaa.
IS conceived and designed the study, performed the statistical analysis, drafted the manuscript and contributed to writing the final version. KK contributed to the study design, helped with statistical analysis, revised the initial drafting of the manuscript and wrote with IS the final version. Both authors read and approved the final manuscript.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
The study was approved by the institutional review board of the School of Medicine at Pontificia Universidad Javeriana in Bogotá (Act N° 11/2012). This Committee is approved for the Ministry of Health and is conformed according to Colombia’s law. All participants were asked for voluntary participation assuring anonymity.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Blumenthal D, Glaser JP. Information technology comes to medicine. N Engl J Med. 2007;356:2527–34.View ArticleGoogle Scholar
- Jha AK, DesRoches CM, Campbell EG, Donelan K, Rao SR, Ferris TG, et al. Use of electronic health records in U.S. Hospitals. N Engl J Med. 2009;360:1628–38.View ArticleGoogle Scholar
- Gray BH, Bowden T, Johansen I, Koch S. Electronic health records: an international perspective on “meaningful use”. Commonw Fund Publications 1565. 2011;28:1–18.Google Scholar
- Sandars J, Morrison C. What is the Net generation? the challenge for future medical education. Med Teach. 2007;29:85–8.View ArticleGoogle Scholar
- AAMC. Compliance Advisory: Electronic Health Records (EHRs) in Academic Health Centers. 2014. https://www.aamc.org/download/316610/data/advisory3achallengefortheelectronichealthrecordsofacademicinsti.pdf. Accessed 10 Sept 2016.
- AMA - H-315.969 Medical Student Access to Electronic Health Records. https://www.ama-assn.org/sites/default/files/media-browser/public/hod/i11-cme-reports_0.pdf. Accessed 25 Feb 2017.
- Skochelak SE. A decade of reports calling for changes in medical education. What do they say? Acad Med. 2010;85 Suppl 9:26–33.View ArticleGoogle Scholar
- Hammoud MM, Dalrymple JL, Christner JG, Stewart RA, Fisher J, Margo K, Ali II, Briscoe GW, Pangaro LN. Medical student documentation in electronic health records: a collaborative statement from the alliance for clinical education. Teach Learn Med. 2012;24(3):257–66. doi:https://doi.org/10.1080/10401334.2012.692284.View ArticleGoogle Scholar
- McGowan JJ, Passimentc M, Hoffmand HM. Educating medical students as competent users of health information technologies: the MSOP data. Stud Health Technol Inform. 2007;129(Pt 2):1414–8.Google Scholar
- Pageler NM, Friedman CP, Longhurst CA. Refocusing medical education in the EMR Era. JAMA. 2013;310:2049–50.View ArticleGoogle Scholar
- Chi J, Verghese A. Clinical education and the electronic health record. The flipped patient. JAMA. 2014;312:2331–2.View ArticleGoogle Scholar
- Stephenson LS, Gorsuch A, Hersh WR, Mohan V, Gold JA. Participation in EHR based simulation improves recognition of patient safety issues. BMC Med Educ. 2014;14:224.View ArticleGoogle Scholar
- Heiman HL, Rasminsky S, Bierman JA, Evans DB, Kinner KG, Stamos J, Martinovich Z, McGaghie WC. Medical Students’ observations, practices, and attitudes regarding electronic health record documentation. Teaching Learning Med: Int J. 2014;26:49–55.View ArticleGoogle Scholar
- Zhang J, Walji MF. TURF: toward a unified framework of EHR usability. J Biomed Inform. 2011;44:1056–67.View ArticleGoogle Scholar
- Wald HS, George P, Reis SP, Scott TJ. Electronic health record training in undergraduate medical education: bridging theory to practice with curricula for empowering patient- and relationship- centered care in the computerized setting. Acad Med. 2014;89:380–6.View ArticleGoogle Scholar
- Wittels, K, Wallenstein, J, Patwari R and Patel, S. Medical Student Documentation in the Electronic Medical Record: Patterns of Use and Barriers. West J Emerg Med. 2016;18:133–136. doi:https://doi.org/10.5811/westjem.2016.10.31294 .
- Friedman E, Sainte M, Fallar R. Taking note of the perceived value and impact of medical student chart documentation on education and patient care. Acad Med. 2010;85:1440–4.View ArticleGoogle Scholar
- Schenarts PJ, Schenarts KD. Educational impact of the electronic medical record. J Surg Educ. 2012;69:105–12.View ArticleGoogle Scholar
- Könings KD, Seidel T, Van Merriënboer JJG. Participatory design: integrating perspectives of students, teachers, and designers. Instructional Sci. 2014;42:1–9.View ArticleGoogle Scholar
- Cohen J. Statistical power analysis for the behavioral sciences. 2nd ed. Hillsdale, NJ: Lawrence Erlbaum; 1988.Google Scholar
- Dornan T, Boshuizen H, King N, Scherpbier AJJA. Experience-based learning: a model linking the processes and outcomes of medical Students’ workplace learning. Med Educ. 2007;41:84–91.View ArticleGoogle Scholar
- Van der Zwet J, Zwietering PJ, Teunissen TW, Van der Vleuten CPM, Scherpbier AJJA. Workplace learning from a socio-cultural perspective: creating developmental space during the general practice clerkship. Adv Health Sci Edu. 2011;16:359–73.View ArticleGoogle Scholar
- Tierney MJ, Pageler NM, Kahana M, Pantaleoni JL, Longhurst JL. Medical education in the electronic medical record (EMR) Era: benefits, challenges, and future directions. Acad Med. 2013;88:748–52. doi:https://doi.org/10.1097/ACM.0b013e3182905ceb.View ArticleGoogle Scholar
- Merril M. First principles of instruction. Edu Technol Res Dev. 2002;50:43–59.View ArticleGoogle Scholar
- Stephens MB, Gimbel RW, Pangaro L. The RIME/EMR scheme: an educational approach to clinical documentation in electronic medical records. Acad Med. 2011;86:11–4.View ArticleGoogle Scholar
- Stead WW, Searle JR, Fessler HE, Smith JW, Shortliffe EH. Biomedical informatics: changing what physicians need to know and How they learn. Acad Med. 2011;86:429–34.View ArticleGoogle Scholar
- Hammoud M, Margo K, Christner JG, Fisher J, Fischer SH, Pangaro LN. Opportunities and challenges in integrating electronic health records into undergraduate medical education: a national survey of clerkship directors. Teach Learn Med. 2012;24:219–24.View ArticleGoogle Scholar
- Ellaway RH, Graves L, Greene PS. Medical education in an electronic health record-mediated world. Med Teach. 2013;35:282–6.View ArticleGoogle Scholar