Non-cognitive characteristics predicting academic success among medical students in Sri Lanka
© Ranasinghe et al.; licensee BioMed Central Ltd. 2012
Received: 12 January 2012
Accepted: 30 July 2012
Published: 3 August 2012
To identify non-cognitive and socio-demographic characteristics determining academic success of Sri Lankan medical undergraduates.
A retrospective study among 90 recently graduated students of the Faculty of Medical Sciences, University of Sri Jayewardenepura, Sri Lanka. Students were stratified into two equal groups; ‘High-achievers’ (honours degree at the final MBBS examination) and ‘Low-achievers’ (repeated one or more subjects at the same examination). A revised version of the Non-cognitive Questionnaire (NQ) with additional socio-demographic data was the study instrument. Academic performance indicator was performance at the final MBBS examinations. A binary logistic regression analysis was performed using the dichotomous variable ‘Honours degree at final MBBS’ as the dependant factor.
Males were 56.7%. Mean age ± SD was 26.4 ± 0.9 years. ‘High-achievers’ were significantly younger than ‘Low-achievers’. Significant proportion of ‘High-achievers’ were from the Western province and selected to university from Colombo district. A significant majority of ‘High-achievers’ entered medical school from their first attempt at GCE A/L examination and obtained ‘Distinctions’ at the GCE A/L English subject. ‘High-achievers’ demonstrated a significantly higher mean score for the following domains of NQ; Positive self-concept and confidence, realistic self-appraisal, leadership, preference of long range goals and academic familiarity.
The binary logistic regression indicates that age, being selected to university from Colombo district, residency in Western province, entering university from GCE A/L first attempt, obtaining a ‘Distinction’ for GCE A/L English subject, higher number of patient-oriented case discussions, positive self-concept and confidence, leadership qualities, preference of long range goals and academic familiarity all significantly increased the odds of obtaining a Honours degree.
A combined system incorporating both past academic performance and non-cognitive characteristics might help improve the selection process and early recognition of strugglers.
KeywordsAcademic performance Predictors Non-cognitive characteristics Medical students Sri Lanka
Medicine is a complex and demanding field of study, medical undergraduates not only requires skill and competence in multiple disciplines, they also need to posses the ability to acquire knowledge on a wide-range of subjects over short-period of time. Medical schools worldwide use different methodologies and criteria to select ‘ideal’ candidates, which include cognitive factors like previous academic performance and non-cognitive factors like personality, performance at interview, comments by referees, personal statements in forms of essays and assessing the involvement in extracurricular activities. However selecting the “ideal” students has always been a challenge and a subject of much debate [1–3]. While traditional medical schools usually tend to depend solely on higher previous academic performance, most modern medical schools are beginning to incorporate a set of non-cognitive selection criteria [4, 5]. A medical student’s training represents a major investment by the government and a considerable personal investment of time and money for the student. Thus, in addition to selecting the ‘ideal’ students it is also important to minimise the rate of attrition by having robust mechanisms to identify and support those who are “struggling”.
Each year nearly seven hundred students graduate from the seven medical faculties in Sri Lanka. The student selection at present is solely based on performance at the GCE Advanced Level examination. The government schools where students study for this examination are of two types 1) National schools – supervised by the central government and has better facilities; 2) Provincial schools – supervised by the respective provincial councils and usually has lesser facilities. Due to this disparity in educational facilities a district based merit system is used for selection . The vacancies for medicine at the universities are filled according to the following 3 sets of criterion: a) All Island Merit criteria: Up to 40% of the available vacancies will be filled in order of Z-Scores for the GCE A/L examination ranked on an all island basis, b) District Merit criteria: Up to 55% of the available places will be allocated to the 25 administrative districts in proportion to the total population, that is, on the ratio of the population of the district concerned to the total population of the country and c) A special allocation up to 5% of the vacancies will be allocated to 16 educationally disadvantaged districts (does not include Colombo) . Furthermore, to be eligible for selection under this criterion, a student must obtain at least a ‘Simple’ pass for each of the three GCE A/L subjects. Recent studies have demonstrated that this sole admission criterion is a poor predictor of academic success of Sri Lankan medical students [7, 8].
The students at Faculty of Medical Sciences, University of Sri Jayewardenepura undergo a five year training programme. The basic sciences of Anatomy, Biochemistry and Physiology are taught in the first two years followed by a summative examination in the second year (commonly known as 2nd MBBS examination), which students must pass in order to proceed to the next level of training. Third and fourth year curricula include training in the para-clinical or applied science subjects, together with clinical training in hospitals. Finally, in the final year students are trained on the clinical subjects of Medicine, Surgery, Obstetrics and Gynaecology, Paediatrics and Psychiatry which is followed by the final examination (commonly known as the final MBBS examination) for graduation which includes multiple choice question paper (MCQ), structured essay question paper (SEQ) and a clinical examination in each subject.
There are no studies examining the non-cognitive predictors of academic performance of medical undergraduates. The primary objective of the present study is to identify socio-demographic and other non-cognitive characteristics determining academic success of medical undergraduates at Faculty of Medical Sciences, University of Sri Jayewardenepura, Sri Lanka.
This retrospective study was conducted among medical students of the Faculty of Medical Sciences, University of Sri Jayewardenepura, Sri Lanka in July 2010 to June 2011. Ninety undergraduates who completed the final MBBS examination in 2010 and 2011 were invited for the study. The students were stratified in to two equal groups; Group ‘A’ (‘High achievers’) included students who have obtained a honours degree at the final MBBS examination, while Group ‘B’ (‘Low achievers’) included students who have referred in one or more subjects at the final MBBS examination. Ethical clearance for the study was obtained from the Ethics Review Committee, Faculty of Medical Sciences, University of Sri Jayewardenepura, Sri Lanka.
A revised version of the Non-cognitive Questionnaire (NQ)  was used as the study instrument. The NQ was developed by Sedlacek and colleagues at University of Maryland as a self-assessment tool that explores non-cognitive domains associated with undergraduate academic success. Items pertaining directly to college students or to the University of Maryland were changed to refer to medical students (eg, "My friends and relatives don't feel I should go to college" was changed to "My friends and relatives don't feel I should go to medical school," or "I am as skilled academically as the average applicant to University of Maryland" was changed to "I am as skilled academically as the average applicant to medical school"). In addition socio-demographic data including age, gender, attempt at GCE A/L, district of selection to medical school, province of residence, educational background of parents, competency in English, availability of books and other facilities and attendance to lectures were also collected. The academic performance indicator was the student performance at the 2nd MBBS and final MBBS examinations. This self-administered questionnaire was distributed amongst the invited students by e-mail or by asking them to collect the questionnaire in person from the Department of Clinical Medicine at the university.
All data were double-entered and cross checked for consistency. Data were analysed using SPSS version 14 (SPSS Inc., Chicago, IL, USA) statistical software package. The significance of the differences between proportions (%) and means were tested using z-test and Student’s t-test or ANOVA respectively.
The Faculty of Medical Sciences at the University of Sri Jayewardenepura is situated in the ‘Colombo’ district in the ‘Western’ province of Sri Lanka. Hence for analytical purposes the districts and provinces were divided in to two groups ‘Colombo district’ or ‘Other districts’ and ‘Western province’ or ‘Other provinces’. A binary logistic regression analysis was performed using the dichotomous variable ‘Honours degree at final MBBS’ as the dependant factor (0 = No; 1 = Yes) and age, gender (0 = Male, 1 = Female), GCE A/L attempt to enter medical school (0 = Second/Third attempt, 1 = First attempt), district of selection to university (0 = Not Colombo, 1 = Colombo), Province of residence (0 = Non-Western, 1 = Western), grade for GCE A/L English subject (0 = Credit, 1 = Distinction), number of patient-oriented case discussions and score for the seven domains of the NQ (Positive self-concept and confidence, Realistic self-appraisal, Availability of support person, Leadership, Long range goals, Ability to establish community ties, Academic familiarity) as independent variables. In all statistical analyses a p value < 0.05 was considered significant.
Socio-demographic characteristics of ‘High achievers’ and ‘Low achievers’
Mean age (±SD)*
District of Selection*
Province of residence*
Educational background (school level) of the two groups
High achievers (%)
Low achievers (%)
GCE (A/L) attempt to enter medical school*
Highest academic qualification of either parent
GCE (A/L) English subject performance*
Credit pass or below
Involved in extra-curricular activities*
Students’ performance at 2 nd MBBS, lecture attendance and computer access
High achievers (%)
Low achievers (%)
Performance at 2nd MBBS examination*
Attendance to lectures*
Limited access only
Involved in extra-curricular activities*
Score for the Non-cognitive questionnaire of the two group
Mean score (±SD)
Positive self-concept and confidence*
Availability of support person
Long range goals*
Ability to establish community ties
Logistic regression analyses of ‘Honours degree at final MBBS’ & measured parameters
Male (reference category)
District of selection to university
Not-Colombo (reference category)
Province of residence
Non-Western (reference category)
GCE A/L attempt
Second or Third (reference category)
GCE A/L English subject
Credit (reference category)
Patient-oriented case discussions
Non-Cognitive Questionnaire domains
Positive self-concept and confidence
Availability of support person
Long range goals
Ability to establish community ties
Medicine is considered to be the longest and most stressful course of undergraduate study . This is the first study from Sri Lanka that evaluates the effects of non-cognitive characteristics on medical student’s success or failure. Our results suggest that past academic performance is not the sole-predictor of future academic success among Sri Lankan medical student. In Sri Lanka students are selected to all seven medical schools depending on their performance at the GCE A/L examination. We demonstrate that students gaining university entrance from 2nd or 3rd attempts performed poorly in comparison to 1st attempt students. In addition entering university in the 1st attempt also increased the odds of obtaining a ‘Honours’ degree at the final MBBS examination. Similar findings have been demonstrated by two different authors from Sri Lanka [7, 8]. Therefore serious consideration must be given about revising the admission criteria to medical schools and restricting the number of attempts by a student at GCE A/L examination to gain university admission.
Due to the disparity in educational facilities in Sri Lankan government schools a district based merit system is used for students selection, where the marks obtained by a student for the three subjects at the GCE A/L is converted to a single standardized Z-Score. Each district is then given a cut-off Z-Score for selection, where districts with lower facilities having a lower Z-Score and vice versa . Our results demonstrate that being from the Western province and being selected to university from Colombo district were both significant predictors of academic success. Colombo being the commercial district of the country has the highest population density and the best facilities. Thus, the GCE A/L cut-off for the Colombo district is invariably significantly higher than for the other districts resulting in a higher competition among Colombo students. This competition invariably results in only the very best students getting selected from Colombo and this might be a probable reason for their ultimate academic success. A downside of this selection process is that it results in many talented students from the Colombo district and sub-urban areas not gaining entry into medical school. Whereas students with a much lower mark at the same entry exam from underprivileged districts enter medical school. Since rapid urbanization and improvement living standards have occurred in many areas of Sri Lanka over the past decades, there is a need re-define underprivileged areas of the country.
The students’ competency in English as assessed by performance at the GCE A/L examination English subject was also a significant predictor of success. In all seven Sri Lankan medical schools teaching and examinations including case discussions are conducted solely in English. However, Sinhalese is the mother-tongue of nearly 90% of Sri Lankans  and until recently the GCE A/L examination was conducted only in Sinhalese. Students less competent in English face obstacles when learning and performing at examinations. The poor knowledge in English also hinders participation in academic activities such as case discussions. Our results also demonstrate that under achieving student take part less in patient oriented case discussion when compared to the successful ones. Students who are from Colombo district being the commercial capital and having the highest number of English speaking population has the language advantage also in addition to better facilities. Thus, it is necessary to identify students less competent in English early during the undergraduate period and implement programmes to help them. Furthermore it might be necessary to conduct a formal English training programme for students for at least few months prior to entering medical school.
The Sedlacek’s Non-Cognitive questionnaire has demonstrated poor predictive value in first year medical students . However we demonstrate that the ability to understand ones strengths and weakness (Self-appraisal), a positive self image (Self-concept), confidence, demonstration of leadership qualities and preference of long-term goals were all significant predictors of academic success in the final MBBS examination. The observed difference could be due to differences in; a) study settings, b) stage of assessment in the undergraduate period and c) method of assessment. Medical schools throughout the world use a variety of criteria to select applicants for admission. These criteria attempts to assess academic performance and personal characteristics suitable for a medical career. Although evaluating academic preparation is simple, assessing personal characteristics are difficult. Non-cognitive testing has been proposed as one such method to assess personal characteristics. However ‘non-cognitive’ tests at present are associated with numerous questions related to their validity, reliability, fairness, and cost. Therefore, before changing admission policies in ‘Traditional’ Sri Lankan medical schools by using non-cognitive tests, an open discussion among all stakeholders in the admissions process is critically important.
There are several limitations in the present study. Although we evaluated academic success, presently it is not known whether this academic success translates in to better clinical performance and improved patient outcomes. This could be a potential area of future research. Furthermore, we also did not evaluate the impact of non-cognitive characteristics on patient care. Our results show that students from Colombo have a higher academic success than students from other areas. However it would also be interesting to do a further evaluation of the few successful students who are not from Colombo to understand what factors influenced their success.
Non-cognitive characteristics are important predictors of academic success among medical students. A combined system incorporating both past academic performance and non-cognitive characteristics might help improve the selection process and early recognition of Low achievers.
The authors wish to acknowledge the support provided by Dr. S. Senanayake and Dr. P.K.A.N. de Silva during the data collection phase of the study.
- Ferguson E, James D, Madeley L: Factors associated with success in medical school: systematic review of the literature. Br Med J. 2002, 324: 952-957. 10.1136/bmj.324.7343.952.View ArticleGoogle Scholar
- Searle J, McHarg J: Selection for medical school: just pick the right students and the rest is easy!. Med Educ. 2003, 37: 458-463. 10.1046/j.1365-2923.2003.01496.x.View ArticleGoogle Scholar
- Powis D: Selecting medical students (commentary). Med Educ. 2003, 37: 1064-1065. 10.1046/j.1365-2923.2003.01706.x.View ArticleGoogle Scholar
- Bardes CL, Best PC, Kremer SJ, Dienstag JL: Perspective: Medical School Admissions and Noncognitive Testing: Some Open Questions. Acad Med. 2009, 84 (10): 1360-1363. 10.1097/ACM.0b013e3181b6a6b3.View ArticleGoogle Scholar
- Tracey TJ, Sedlacek WE: Noncognitive variables in predicting academic success by race. Meas Eval Guidance. 1984, 16: 171-178.Google Scholar
- De Silva NR, Pathmeswaran A, de Silva HJ: Selection of students for admission to a medical school in Sri Lanka. Ceylon Med J. 2004, 49: 81-85.Google Scholar
- De Silva NR, Pathmeswaran A, de Silva N, et al: Admission to medical schools in Sri Lanka: predictive validity of selection criteria. Ceylon Med J. 2006, 51: 17-21.Google Scholar
- Mettananda DSG, Wickramasinghe P: Kudolugoda Arachchi J, et al. Suitability of selection criteria as a measure of outcome of medical graduates: University of Colombo. Ceylon J Med Sci. 2006, 49: 1-12.Google Scholar
- Supe AN: A study of stress in medical students at Seth G.S. Medical College. J Postgrad Med. 1998, 44: 1-6.Google Scholar
- Department of census and statistics Sri Lanka: Census of population and housing. 2001, http://www.statistics.gov.lk/PopHouSat/PDF/Population/p9p1%20Growth.pdf. (accessed 10 Oct 2010), , Population, Intercensal growth and average annual rate of growth by district, 1981 and 2001
- Mavis B, Doig K: The value of noncognitive factors in predicting students' first-year academic probation. Acad Med. 1998, 73 (2): 201-203. 10.1097/00001888-199802000-00021.View ArticleGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6920/12/66/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.