Skip to main content

Performance of a core of transversal skills: self-perceptions of undergraduate medical students

Abstract

Background

There is an increasingly growing trend towards integrating scientific research training into undergraduate medical education. Communication, research and organisational/learning skills are core competences acquired by scientific research activity. The aim of this study was to assess the perceived performance of a core of transversal skills, related with scientific research, by Portuguese medical students.

Methods

A cross-sectional study was conducted in 611 Portuguese students attending the first, fourth and sixth years of the medical course, during the same academic year. A validated questionnaire was applied for this purpose.

Results

Medical students felt confident regarding the majority of the analyzed transversal skills, particularly regarding team work capacity (72.7 % perceived their own capacity as good). On the other hand, the perceived ability to manage information technology, time and to search literature was classified only as sufficient by many of them. The progression over the medical course and participation in research activities were associated with an increasing odds of a good perceived performance of skills such as writing skills (research activity: OR = 2.00; 95 % CI: 1.34–2.97) and English proficiency (research activity: OR = 1.59; 95 % CI: 1.06–2.38/final year medical students: OR = 3.63; 95 % CI: 2.42–5.45).

Conclusions

In this line, the early exposure to research activities along undergraduate medical education is an added value for students and the implementation of an integrated research program on medical curriculum should be considered.

Peer Review reports

Background

In the 90s of the last century, following the developments in the USA, several Western European universities responded to the need looking for research capacity beyond medical students [1]. Medical doctors are the first to experience the need for more evidence-based knowledge in order to deliver better patient care. However, their capability to participate in medical research programs, and to inspire them, is often limited by both lack of training during their studies and the reduced amount of time available for research, even in university hospitals [1]. Consequently, there is an increasingly growing trend towards integrating scientific research training into undergraduate medical education [13].

Medical curriculum in Europe follows the quality assurance frameworks and the portability of qualifications of the directives of Bologna Process [4]. In Portugal, the medical course was reformulated into an Integrated Master Course in Medicine and is currently composed by a first cycle of three years, corresponding to a degree in basic health sciences, and a second cycle also lasting three years of clinical learning and professional clerkship.

At the Faculty of Medicine of the University of Porto (FMUP), along the first cycle of studies all students participate in random research activities in curricular units such as biochemistry, cellular biology and genetics, and some participate in research projects as extra-curricular activities, usually since the fourth year.

Scientific research involves the collection and processing of new information and its interpretation through logic and previous knowledge and experience [3]. Critical thinking, communication ability, literature searching, cope with information technology, team work, solving-problems and self-improving learning are scientific skills acquired through research activity [57]. Some of these skills are required for effective decision-making being a valuable quality required in any program in higher education [8, 9]. However, transversal skills of medical freshman students, as well as their development throughout the medical course, have not yet been assessed, especially considering the recent reforms in medical education. Our research group has been studying several issues related with undergraduate medical education [1012].

The aim of this study, again reflecting our concerns on this matter, was to assess the perceived performance of a core of transversal skills by undergraduate medical students.

Methods

The specific objectives of this study were: (1) To evaluate if self-perception of medical students about transversal skills execution change over the progression of the medical course and (2) To compare the above objective by gender, type of school attended at high schooling level (public or private) and previous involvement (or not) in research projects.

A cross-sectional study was conducted in order to develop this research. Among the 796 eligible medical students, 611 (76.8 %) have participated in the study. The participants were enrolled in the Master Degree Course in Medicine of FMUP, Portugal. The study included freshman students (first year), those who concluded the first cycle of studies (beginning of the fourth year) and students who completed the entire medical course (end of the sixth year). All students from the first and fourth years answered the questionnaire at once at the beginning, and those from the six year at the end, of the same academic year.

Medical students were invited to fulfill an anonymous self-administered and validated questionnaire: “Importance of Transversal Skills for Clinical Practice” (ITS4CP) developed by the authors [12]. The transversal skills included in the questionnaire were adapted from AMEE Medical Education Guide [3].

'The perceived ability to perform the transversal skills was assessed through this questionnaire, following the Likert scale: 1 (good), 2 (sufficient), 3 (insufficient) and 4 (poor). This scale showed a good reliability and validity: the reliability was high for the 11 skills and the three factors described below, and the construct validity was set by the Confirmatory Factor Analysis (CFA). The 11 transversal skills were grouped into three factors: communication skills (CS), research skills (RS) and organisational/learning skills (OS). The CS factor included writing communication (WC), oral communication (OC) and visual communication (VC). The RS factor included the ability to perform literature searching (LS), cope with information technology (IT) and data analysis (DA) and English proficiency (EP). The OS factor included team work (TW) capacity, time management (TM), the ability to solve problems (SP) and to self-improve learning (IL). CFA was used to test the fit of the model with 3-factor structure considering the 11 skills as items. CFA fit was assessed using different indexes: (i) the Tucker–Lewis Index (TLI) [13], (ii) the Comparative fit index (CFI) [14], (iii) the Route mean square error of approximation (RMSEA) [15], and (iv) the Standardized root mean square residual (SRMR) [16]. A good model fit is indicated by a CFI and TLI values of 0.90 or higher [16] and values of RMSEA and SRMR close to 0 [17]. The internal reliability of the scale was tested using the Cronbach’s alpha coefficient.

The perceived ability to perform the transversal skills was recoded, in comparison with the scale shown in Additional file 1, in two categories sufficient (0) vs. good (1), given that no student perceived his/her own ability as insufficient or poor. The percentage of medical students who perceived their performance as good was estimated. Odds ratio (OR) was used to estimate the magnitude of the association between the perceived ability to perform each transversal skill and several factors (gender, academic year, participation in research projects and high school). Unconditional logistic regression adjusted for all variables was used to estimate the OR and the respective 95 % confidence interval. All statistics analyses were performed with the R 2.12.1 [18].

The ethical principles of this research followed the guidelines approved by the Ethics Committee of FMUP.

Results

Characteristics of the sample are summarized in Table 1. The Cronbach’s alpha of the analysis of the 11 transversal skills ranges from 0.651 to 0.818 indicating a moderate to high internal consistency. According to the theoretical model, in the CFA it was assumed that items WC, OC, and VC belong to factor CS (Communication Skills), items LS, IT, DA and EP belong to factor RS (Research Skills), and items TW, TM, SP and IL belong to factor OS (Organizational/learning Skills) and they were correlated with each other. Figure 1 shows the factor loadings supporting these relations. The model global fitness was tested and confirmed. The Cronbach alpha was 0.69, 0.81, 0.80 for factor CS, RS and OS, respectively.

Table 1 Characteristics of the sample
Fig. 1
figure 1

Confirmatory Factor Analysis for three-factor model of the Transversal Skills scale. Legend: Factor CS represents communication skills, Factor RS represents research skills and Factor OS Organizational/learning Skills. Model Chisquare = 142.67 Df = 41 Pr(>Chisq) <0.001, RMSEA index = 0.062591 90 % CI: (0.051578, 0.073944), Bentler-Bonnett NFI = 0.95052, Tucker-Lewis NNFI = 0.95178, Bentler CFI = 0.96405, SRMR = 0.033019

No student perceived his/her own ability to perform the transversal skills as insufficient or poor. More than 50 % of students considered their own ability to manage information technology, of time management and to perform literature searching as sufficient. In relation to the other transversal skills, more than 50 % of students considered their own ability to perform them as good (Fig. 2). 72.7 % of medical students perceived their own capacity of team work as good (Fig. 2).

Fig. 2
figure 2

Percentage of medical students who perceived their performance as good, according to the corresponding transversal skills. Legend: IT, information technology; TM, time management; LS, literature searching; IL, improving learning; OC, oral communication; DA, data analysis; WC, writing communication; VC, visual communication; EP, English proficiency; SP, solving problems; TW, team work

The progression over the medical course, as well as the participation in research activities, was associated with an increasing odds of a good perceived performance of communication skills (Table 2). Regarding writing skills, an approximate 2-fold increase in odds of a good performance was observed in sixth year students and in those who participated in research activities (Table 2).

Table 2 Factors associated with communication skills performance

The progression over the medical course and the participation in research activities were also associated with an increasing odd of a good perceived performance of research skills and organisational/learning skills (Tables 3 and 4). More than 3-fold increase in odds of a good perceived English proficiency was observed in the students of the sixth year of medical course (Table 3).

Table 3 Factors associated with research skills performance
Table 4 Factors associated with organisational/learning skills performance

Male students were associated with an increasing odds of a good perceived manage of information technology and a good performance of data analysis, comparatively to female students (Table 3).

Attending a private school at high school was associated with an increasing odds of a good performance in the majority of skills, although without statistical significance (Tables 2, 3 and 4).

Discussion

This group of medical students felt confident regarding the majority of the studied transversal skills. The progression along the medical course, as well as the participation in research activities might have contributed to this perception. These findings are in line with what has already been investigated regarding the improvement of transversal skills due to the engagement in research activities [57].

On the other hand, the perceived ability to manage information technology, time management and to perform literature searching was classified as sufficient by many of the students. Therefore, improvements in medical education should be further explored in order to develop these competences.

Regarding the information technology, medical educators are rapidly integrating technology into the medical curricula as a necessary intervention [19, 20]. According to Ranasinghe et al., there is a need to improve computer literacy among freshman medical students, by increasing computer training in schools, or by introducing computer training in the initial stages of the medical course [21]. The study by Lim et al. showed that 81.5 % of final year medical students consider their computer skills adequate, despite additional steps need to be taken to increase the use of Internet as a method of instruction [22]. Several studies have explored the incorporation of personal digital assistants (PDAs) [23, 24], e-learning modalities [25] and social networking for interprofessional instruction [26] in medical education.

In order to avoid the workload that medical students usually face, many schools are implementing policies to restrict student work hours [27]. In line with this workload, our students also had difficulties in time management.

Literature searching is an essential competence for both research and clinical activities, and our students could benefit and feel more confident with specific training on this skill. A literature review examining the effectiveness of literature searching skills instruction for medical students showed that although the current instructional methods are effective, there is little evidence that learning persists over time [28].

On the other hand, a significant number of medical students perceived their own team work capacity as good. This ability should continue to be explored during the medical course, for instance through students’ involvement in small research groups. Indeed, teamwork has become a major focus in healthcare [29], partially, in consequence of the report provided by the Institute of Medicine, which details the high rate of preventable medical errors, mainly originated from dysfunctional or nonexistent teamwork [30].

In relation to the putative determinants of perceptions about transversal skills, students who participated in research projects revealed an increased odd of good perceived performance in all transversal skills, including those mentioned above. In this analysis, writing ability stood out between communication skills. In health professions education, writing has been used as a tool to promote a variety of learning goals, but students in medical professions often lack the required writing skills during their education and career [31, 32]. Participation in research activities is therefore essential since students who write concisely and logically, use terminology accurately and justify their assertions, show better academic performance [31]. Furthermore, scientific writing for publication is competitive and demanding for researchers [33], and training in writing skills along the medical course is associated with a significant improvement in text quality, structure and argumentation [34].

Students who finished the medical course demonstrated a significant increase of odds to have a good perceived English proficiency. Probably, this is explained by the need to use international scientific literature during the study years in medical school. However, students should feel confident in their English proficiency from the beginning of the course in order to have an efficient acquisition of knowledge. For the novice English-as-a-second-language researcher, the pressure to publish compounds the difficulties of mastering the English language [33]. In addition, in most countries around the world, local medical students outperform international students, in an academic sense, probably because of the acquision of language proficiency skills [35]. According to Hays et al. Australian medical students whose primary language is other than English, yet with poor English oral communication skills, should be encouraged to speak English away from the medical school and should be offered additional tuition so that their skills in other languages are not lost to the health-care system [36]. On the other hand, Mirza et al. reported that communication skills training purely in English can leave Arab medical students ill equipped to communicate with patients in their own communities and tongue [37].

In relation to problem solving skills, fourth year students demonstrated a significant decrease in the odds of good perceived performance, contrary to freshman and final year students. Problem solving skills has been defined as a hypothetical-deductive activity engaged by physicians, in which the early generation of hypotheses influences the subsequent gathering of information [38]. In the fourth year of the medical course, students begin the clinical practice, hence their perception of a poorer performance can be, partially, explained by the unfulfilled expectations during the first cycle of studies, as well as the fear of becoming incompetent practitioners. Therefore, the need to include instructional activities to promote the development of problem-solving abilities should be asserted in the medical curriculum.

Concerning gender, male students were associated with an increasing odds of a good perceived management of information technology, comparatively to female students. This finding has been reported by some authors who showed that females had more negative attitudes towards computers and Internet than males [39, 40]. Comparison at high schooling level between private and public schools, showed no significant differences. Nonetheless, further studies are needed to explore whether private schools offer a better support for students’ research competences than public schools.

This study assessed the putative performance of a core of transversal skills by Portuguese medical students based on their perceptions. An increased body of evidence shows that student perceptions about several aspects of their competences can be valuable for extracting evaluative conclusions regarding the quality of medical education [41, 42], despite this approach could be seen as a study limitation.

No student perceived his own ability to execute the transversal skills as insufficient or poor, a finding that may reflect a limitation of the used Likert scale, that require to be revised in future studies. This study has the inherent limitations of a cross-sectional study. Thus, a follow-up study of these students’ cohorts could also provide additional information of their transversal skills’ perceptions, as well as important data for the design of a medical educational program.

Conclusions

In conclusion, this group of medical students felt confident regarding the majority of the studied skills, particularly team work capacity. However, conceptual models of medical education modalities should be further explored to improve skills, such as both information technology and time management as well as literature searching.

The progression over the medical course and participation in research activities were associated with an increased odd of a good perceived performance of all transversal skills. Thus, the early exposure to research activities along undergraduate medical education is an added value for students and the implementation of an innovative integrated research program into the medical curriculum should be considered.

References

  1. van Schravendijk C, Marz R, Garcia-Seoane J. Exploring the integration of the biomedical research component in undergraduate medical education. Med Teach. 2013;35(6):e1243–51.

    Article  Google Scholar 

  2. Abu-Zaid A, Alkattan K. Integration of scientific research training into undergraduate medical education: a reminder call. Med Educ Online. 2013;18:22832.

    Article  Google Scholar 

  3. Laidlaw A, Aiton J, Struthers J, Guild S. Developing research skills in medical students: AMEE Guide No. 69. Med Teach. 2012;34(9):754–71.

    Article  Google Scholar 

  4. Cumming A. The Bologna process, medical education and integrated learning. Med Teach. 2010;32(4):316–8.

    Article  Google Scholar 

  5. Greenhalgh T. Doing an intercalated BSc can make you a better doctor. Med Educ. 2003;37:760–1.

    Article  Google Scholar 

  6. Remes V, Helenius I, Sinisaari I. Research and medical students. Med Teach. 2000;22(2):164–7.

    Article  Google Scholar 

  7. Parker R. Skill development in graduate education. Mol Cell. 2012;46(4):377–81.

    Article  Google Scholar 

  8. Cheung C, Rudowicz E, Kwan ASF, Yue XD. Assessing university students’ general and specific critical thinking. Coll Stud J. 2002;36(4):504–25.

    Google Scholar 

  9. Athari Z, Sharif SM, Nasr AR, Nematbakhsh M. Assessing critical thinking in medical sciences students in two sequential semesters: Does it improve? J Educ Health Promot. 2013;31(2):5.

    Google Scholar 

  10. Barbosa J, Severo M, Fresta M, Ismail M, Ferreira MA, Barros H. How students perceive medical competences: a crosscultural study between the Medical Course in Portugal and African Portuguese Speaking Countries. BMC Med Educ. 2011;11:24.

    Article  Google Scholar 

  11. Loureiro E, Severo M, Bettencourt P, Ferreira MA. Third year medical students perceptions towards learning communication skills: implications for medical education. Patient Educ Couns. 2011;85(3):e265–71.

    Article  Google Scholar 

  12. Ribeiro L, Severo M, Pereira M, Ferreira MA. Scientific Skills as Core Competences in Medical Education: What Medical Students think? Int J Sci Educ. 2015;37(12):1875–85.

    Article  Google Scholar 

  13. Tucker LR, Lewis C. A reliability coefficient for maximum likelihood factor analysis. Psychometrika. 1973;38:1–10.

    Article  Google Scholar 

  14. Bentler PM. Comparative fit indexes in structural models. Psychol Bull. 1990;107(2):238–46.

    Article  Google Scholar 

  15. Steiger JH. Structural Model Evaluation and Modification - an Interval Estimation Approach. Multivar Behav Res. 1990;25(2):173–80.

    Article  Google Scholar 

  16. Hu LT, Bentler PM. Cutoff Criteria for Fit Indexes in Covariance Structure Analysis: Conventional Criteria Versus New Alternatives. Struct Equ Model. 1999;6(1):1–55.

    Article  Google Scholar 

  17. Browne MW, Cudeck C. Alternative ways of assessing model fit. Sociol Methods Res. 1993;21:230–58.

    Article  Google Scholar 

  18. R.C. Team. R: A language and environment for statistical computing. 2013. Available from: http://www.R-project.org/.

    Google Scholar 

  19. Robin BR, McNeil SG, Cook DA, Agarwal KL, Singhal GR. Preparing for the changing role of instructional technologies in medical education. Acad Med. 2011;86(4):435–9.

    Article  Google Scholar 

  20. George P, Dumenco L, Dollase R, Taylor JS, Wald HS, Reis SP. Introducing technology into medical education: Two pilot studies. Patient Educ Couns. 2013;93(3):522–4.

    Article  Google Scholar 

  21. Ranasinghe P, Wickramasinghe SA, Pieris WR, Karunathilake I, Constantine GR. Computer literacy among first year medical students in a developing country: a cross sectional study. BMC Res Notes. 2012;14(5):504.

    Article  Google Scholar 

  22. Lim T, Wong W, Lim K. Perceived skill and utilisation of information technology in medical education among final year medical students, Universiti Putra Malaysia. Med J Malaysia. 2005;60(4):432–40.

    Google Scholar 

  23. Ho K, Lauscher HN, Broudo M, Jarvis-Selinger S, Fraser J, Hewes D, Scott I. The impact of a personal digital assistant (PDA) case log in a medical student clerkship. Teach Learn Med. 2009;21(4):318–26.

    Article  Google Scholar 

  24. Tempelhof MW. Personal Digital Assistants: A Review of Current and Potential Utilization Among Medical Residents. Teach Learn Med. 2009;21(2):100–4.

    Article  Google Scholar 

  25. Hawthorne K, Prout H, Kinnersley P, Houston H. Evaluation of different delivery modes of an interactive e-learning programme for teaching cultural diversity. Patient Educ Couns. 2009;74(1):5–11.

    Article  Google Scholar 

  26. King S, Greidanus E, Carbonaro M, Drummond J, Patterson S. Merging social networking environments and formal learning environments to support and facilitate interprofessional instruction. Med Educ Online. 2009;14:5.

    Article  Google Scholar 

  27. Friedman E, Karani R, Fallar R. Regulation of medical student work hours: a national survey of deans. Acad Med. 2011;86(1):30–3.

    Article  Google Scholar 

  28. Just M. Is literature search training for medical students and residents effective? A literature review. J Med Libr Assoc. 2012;100(4):270–6.

    Article  Google Scholar 

  29. Lerner S, Magrane D, Friedman E. Teaching teamwork in medical education. Mt Sinai J Med. 2009;76(4):318–29.

    Article  Google Scholar 

  30. Kohn L, Corrigan J, Donaldson M. To Err Is Human: Building a Safer Health Care System. Washington, DC: National Academy Press; 2000.

    Google Scholar 

  31. Rawson RE, Quinlan KM, Cooper BJ, Fewtrell C, Matlow JR. Writing-skills development in the health professions. Teach Learn Med. 2005;17(3):233–8.

    Article  Google Scholar 

  32. Stephens MB, Reamy BV, Anderson D, Olsen C, Hemmer PA, Durning SJ, Auster S. Writing, self-reflection, and medical school performance: the Human Context of Health Care. Mil Med. 2012;177(9 Suppl):26–30.

    Article  Google Scholar 

  33. Wang MF, Bakken LL. An academic writing needs assessment of English-as-a-second-language clinical investigators. J Contin Educ Health Prof. 2004;24(3):181–9.

    Article  Google Scholar 

  34. Bitran M, Zúñiga D, Flotts P, Padilla O, Moreno R. A workshop to improve written communication skills of medical students. Rev Med Chil. 2009;137(5):617–24.

    Article  Google Scholar 

  35. Mann C, Canny B, Lindley J, Rajan R. The influence of language family on academic performance in Year 1 and 2 MBBS students. Med Educ. 2010;44(8):786–94.

    Article  Google Scholar 

  36. Hays RB, Pearse P, Cooper CW, Sanderson L. Language background and communication skills of medical students. Ethn Health. 1996;1(4):383–8.

    Article  Google Scholar 

  37. Mirza D, Hashim M. Communication skills training in English alone can leave Arab medical students unconfident with patient communication in their native language. Educ Health (Abingdon). 2010;23(2):450.

    Google Scholar 

  38. Shumway JM, Vargas ME, Heller LE. Methods for teaching problem-solving in medical schools. Educ Med Salud. 1984;18(1):46–61.

    Article  Google Scholar 

  39. Broos A. Gender and information and communication technologies (ICT) anxiety: male self-assurance and female hesitation. Cyberpsychol Behav. 2005;8(1):21–31.

    Article  Google Scholar 

  40. Li N, Kirkup G. Gender and cultural differences in Internet use: A study of China and the UK. Computers & Education. 2007;48(2):301–17.

    Article  Google Scholar 

  41. Lizzio A, Wilson K, Simons R. University students’ perceptions of the learning environment and academic outcomes; implications for theory and practice. Stud High Educ. 2002;27:27–51.

    Article  Google Scholar 

  42. Scicluna HA, Grimm MC, O'Sullivan AJ, Harris P, Pilotto LS, Jones PD, McNeil HP. Clinical capabilities of graduates of an outcomes-based integrated medical program. BMC Med Educ. 2012;12(23):23.

    Article  Google Scholar 

Download references

Acknowledgments

Authors thank the students of FMUP that enrolled this study by fulfilling the questionnaire, and Joana Mendes for helping in manuscript writing. This work was performed under the financial support of FCT/MEC; PIDDAC; FEDER; COMPETE (POFC) with the following reference FCOMP-01-0124-FEDER-041872 FCT (EXPL/IVC-PEC/1302/2013, RES4MED: Aprender medicina através da investigação).

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Laura Ribeiro.

Additional information

Competing interests

The authors declare having no competing interests.

Authors’ contributions

LR designed the study, carried out the design research, and participated in the draft of the manuscript. MS participated in the study design and performed the statistical analysis. MAF participated in the study design and made a critical review of the manuscript. All authors read and approved the final manuscript.

Authors’ information

LR is Assistant Professor at the Faculty of Medicine of the University of Porto.

MS is researcher at the Faculty of Medicine of the University of Porto and Public Health Institute of the University of Porto. MAF is Full Professor and Director of the Faculty of Medicine of the University of Porto.

Additional file

Additional file 1:

Questionnaire

Rights and permissions

Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Ribeiro, L., Severo, M. & Ferreira, M.A. Performance of a core of transversal skills: self-perceptions of undergraduate medical students. BMC Med Educ 16, 18 (2016). https://doi.org/10.1186/s12909-016-0527-2

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12909-016-0527-2

Keywords