The medical schools outcomes database project: Australian medical student characteristics
© Kaur et al.; licensee BioMed Central Ltd. 2014
Received: 12 February 2014
Accepted: 18 August 2014
Published: 29 August 2014
Global medical workforce requirements highlight the need for effective workforce planning, with the overall aims being to alleviate doctor shortages and prevent maldistribution. The Medical Schools Outcomes Database and Longitudinal Tracking (MSOD) Project provides a foundation for evaluating outcomes of medical education programs against specified workforce objectives (including rural and areas of workforce needs), assisting in medical workforce planning, and provision of a national research resource. This paper describes the methodology and baseline results for the MSOD project.
The MSOD Project is a prospective longitudinal multiple-cohort study. The project invites all commencing and completing Australian medical students to complete short questionnaires. Participants are then asked to participate in four follow-up surveys at 1, 3, 5 and 8 years after graduation.
Since 2005, 30,635 responses for medical students (22,126 commencing students and 8,509 completing students) in Australia have been collected. To date, overall eligible cohort response rates are 91% for commencing students, and 83% for completing students. Eighty three percent of completing medical student respondents had also completed a commencing questionnaire.
Approximately 80% of medical students at Australian medical schools are Australian citizens. Australian medical schools have only small proportions of Indigenous students. One third of medical students speak a language other than English at home.The top three vocational choices for commencing medical students were surgery, paediatrics and child health and general practice. The top three vocational choices for completing students were surgery, adult medicine/ physician, and general practice. Overall, 75.7% of medical students changed their first career preference from commencement to exit from medical school.
Most commencing and completing medical students wish to have their future medical practice in capital cities or in major urban centers. Only 8.1% of commencing students and 4.6% of completing students stated an intention to have their future medical practice in smaller towns and small communities.
The MSOD longitudinal project is now an established national resource that is beginning to generate significant research outputs, along with providing key information for workforce planning and policy makers. The project has now expanded to enrol New Zealand medical students.
KeywordsMedical education Medical workforce Health Medical student Medical doctors Longitudinal Medicine Methodology Interns Internship
Globally there is a well-recognised shortage of healthcare workers, highlighting the need for effective health workforce planning [1–8]. There are relatively few key medical workforce longitudinal studies worldwide that have aimed to purposefully and proactively inform national workforce planning. Some notable longitudinal studies are the BMA Cohort Doctor study , the UK Medical Careers Research Group (UKMCRG) studies , the Young Doctor Cohort of the Longitudinal Study of Norwegian Medical Students and Doctors (NORDOC) , the Jefferson Longitudinal study of Medical Education , and the Medicine in Australia: Balancing Employment and Life (MABEL) longitudinal surveys of medical graduates in practice .
To facilitate and prioritise medical workforce planning in Australia, the Australian government formed Health Workforce Australia (HWA) . Similarly, the New Zealand government established Health Workforce New Zealand (HWNZ) to provide leadership, co-ordination and oversight of planning and development of the health workforce across New Zealand’s health and disability sector .
Responding to this need, and recognising that this requirement for data collection and analysis was a key planning workforce priority, Medical Deans Australia and New Zealand Inc. (Medical Deans Inc.) established the Medical Schools Outcomes Database and Longitudinal Tracking (MSOD) Project in 2005 .
The MSOD project objectives  include:
Provision of an effective, reliable evaluation mechanism for assessing long-term outcomes of educational programs, in particular those aimed at addressing future medical workforce needs (rural health, areas of workforce need, Indigenous health, specialty areas, and others as they arise or are implemented)
Provision of a secure, reliable source of accurate, up-to-date data for the purposes of long-term medical workforce planning
Determining the effectiveness of targeted programs and interventions in influencing the career decisions of medical students
Promotion of strategic reform of medical education policy and programs at the university, state and Commonwealth levels in order to match program and policy frameworks with national health priorities
Provision of an information resource for research projects for Australian medical educators that will contribute to the national and international literature on medical education.
The aim of this paper is to describe the methods, and some baseline results, for Australian commencing and completing medical students participating in the MSOD project of Medical Deans Inc.
List of participating Australian and New Zealand medical schools
Australian Medical Schools
The University of Adelaide
Australian National University
James Cook University
The University of Melbourne
UG, G, P
UG, G, P
The University of Newcastle/University of New England
The University of New South Wales
The University of Notre Dame
The University of Queensland
The University of Sydney
University of Tasmania
The University of Western Australia
University of Western Sydney
University of Wollongong
University of Auckland
New Zealand medical school (UG)
University of Otago
New Zealand medical school (UG)
Annually, all enrolling medical students at all Australian medical schools, and the two New Zealand medical schools, are invited to participate in the MSOD project, and are then asked to complete a short questionnaire in their commencing, final and selected postgraduate years. A list of these medical schools is shown in Table 1.
Questionnaire design and questionnaire administration
Data are collected directly from medical students:
upon entry to medical school (Commencing Medical Students Questionnaire, CMSQ);
in their final year of medical school (Exit Questionnaire, EQ);
Further questionnaires are being administered, or are being developed, for:
one year after completion of their medical studies (PGY1);
three years after completion of their medical studies (PGY3);
five years after completion of their medical studies (PGY5) andeight years after completion of their medical studies (PGY8) (Figure 1).
Further information on individual student placements and electives (Medical Schools Data, MSD) is collected directly from medical schools annually throughout the duration of each student’s program in medical school.
Information from the CMSQ, EQ and MSD will be linked to the postgraduate surveys to provide outcome measures for type and location of medical practice.
The Australian and New Zealand questionnaires differ slightly, taking into account geographical locations and Indigenous status. Further information, including questionnaires, is available on the Project’s website .
The CMSQs are distributed to students within the first few months of commencing medical school. The 17 item questionnaire (35 questions) is paper based due to preference by medical schools for ease of administration to large groups of students at one time. The CMSQ gathers students’ demographics, rural or urban background, enrolment characteristics, previous tertiary education and future career intentions. The majority of questions are quantitative whilst three questions ask for free text responses (relating to scholarship source, previous university qualification and partner occupation).
The MSD are collected from each medical school annually for every student who completes the CMSQ via an Excel template.
Paper versions of the EQs are distributed to students in their final year of medical school, again as preferred by most medical schools, although a proportion of respondents (34% in 2011) complete an online version of the questionnaire. The 14-item EQ (21 questions) gathers student information about further demographic details, future medical practice intentions (preferred type/vocation of medical practice, and preferred geographic location), factors potentially influencing the choice of future medical practice, and internship placements.
Postgraduate surveys (PGY1, 3, 5 and 8)
Participants in their post-graduate year one of training (PGY1) are invited to complete the PGY1 questionnaire. The PGY1 questionnaires are completed online by interns at the end of their first year of post-graduate training. A link to the PGY1 questionnaire is emailed to MSOD participants. The PGY1 gathers information on demographics, internship details, future medical practice intentions, factors potentially influencing the choice of future medical practice, and future contact details.
At the end of their third, fifth and eight years after leaving medical school, graduates are being invited to complete PGY3, PGY5 and PGY8 Questionnaires. These questionnaires collect data on demographics, the participant’s current employment and training situation, intentions for future medical practice, factors potentially influencing the choice of future medical practice, and future contact details.
The MSOD Project maintains consistency in each of the surveys with the career intention and other questions across all questionnaires from CMSQ to PGY8, in order to facilitate comparison over the medical education and training continuum.
The study has ongoing approval by the relevant Human Research Ethics Committees (HREC) for each participating medical school. Any research conducted on data contained in the database requires appropriate clearance from a relevant HREC. Further information, including the Project’s Data Access Policy and ethics approval numbers is available on the Project’s website .
The Project uses a web-based data dictionary incorporating the definitions and origins of the variables collected through each of the questionnaires and the MSD . The MSOD Data Dictionary provides information to registered users about the MSOD minimum dataset and the rationale for each item in this dataset. It also shows the questions and response values used to collect this information; the individual questionnaires in which these questions are asked; and the database variables to which these responses map.
The MSOD Project collects contact details from the respondents via the questionnaires in order to administer subsequent follow up questionnaires with MSOD participants and to keep them informed about the study. These data are stored separately from the participants’ questionnaire data. They are accessible to relevant MSOD staff only.
The completed paper questionnaires (CSMQ and EQ) are returned by the individual medical school to Medical Deans Inc. They are scanned by Educational Assessment Australia (EAA) at the University of New South Wales, Sydney, Australia. Online questionnaires (all surveys) are hosted by the University of Sydney on a secure web server. All data from the scanned paper and online CMSQ, EQ, MSD and postgraduate questionnaires for each survey year are imported into a MySQL database, where they are cleaned and merged into a master file. Data within and between survey years are linked using unique participant identifiers.
The data cleaning process involves importing the data into a staging database table; checks that participant identifiers (student ID, gender, date of birth, and medical school) are correct; matches existing participants to their previous responses via a unique identifier; checks missing and multiple response values in scanned data against the original paper responses; and checks text responses to “other” categories to ensure that the response is not identical to one of the response values. A number of derived variables (such as categorisation of occupation, or previous degree type), used for reporting purposes, are then added to the record, and the data are imported into a production database table which holds previous years’ data for the particular survey.
A number of measures are taken to ensure data integrity: raw data are kept in CSV and MS Excel (for the MSD) files in a secure network folder, and in archived database tables; all data are backed up on a daily basis and on a weekly basis and archived in a compressed format; and retrospective changes to data are saved into an audit history database table.
Measures are taken to ensure data security: survey data are stored separately from participant identifiers, and participant contact data are also stored separately; a unique key is used to match participants across different surveys and participant contact information; access to MSOD data and to participant information is regulated via a browser-based user interface; MSOD research staff have access to participant survey responses, but not to participant identifiers and contact details, whereas MSOD survey administration staff have access to participant contact information, but not survey responses; and levels of read and write access (whether to survey data or contact information) are defined based on the requirements of staff roles.
The Project uses a MySQL relational database. A browser-based user interface controls access to the data, and integrates survey administration and collection processes. Simple data queries and data export processes occur through the user interface, and Crystal Reports is used to generate standardised data and survey administration progress reports directly from the database. More complex data analysis is conducted via native SQL, or by exporting data into statistical analysis software, such as SPSS.
There are two types of data reports produced for the questionnaires – national summary reports, and individual school reports. Information, including data reports by year, is available on the Project’s website . Summary data reports of each of the annual data collections (CMSQ, EQ, and MSD) are provided to the medical schools and are made available to the Commonwealth and the Project’s stakeholder organisations. These reports are de-identified internally and externally, as per MSOD protocols and ethics approvals, to maintain the anonymity of participants.
Data in any public report or publication are presented in forms that do not permit the identification of any individual participant, subgroup or participants from a particular medical school.
Individual school reports, summarising anonymised data responses for participants at that school, are provided to each school along with tables summarising data for all schools combined. This allows each school to view its response profiles compared with the combined response profile for all schools. These individual school reports are provided only to the relevant medical school, and are not available publically.
In this report, results are presented for the combined commencing, and completing, medical student cohorts from Australian medical schools. New Zealand’s two medical schools also now participate in the MSOD Project, and data analyses for New Zealand schools will be available in the future.
Participation and response rates
Responses by Survey and Year
Overall, 7,061 (83%) of completing medical student respondents have completed both the CMSQ and EQ.
Commencing medical students
Socio-demographic characteristics of 30,635 valid responses in the MSOD longitudinal tracking project
N = 22,126 (%)
N = 8509 (%)
New Zealand citizen
Australian permanent resident
Temporary entry permit
Aboriginal and Torres Strait Islander origin
Neither Aboriginal nor
Torres Strait Islander origin
Torres Strait Islander origin
Both Aboriginal and
Torres Strait Islander origin
Missing/ no response
Language other than English spoken at home
Missing/ no response
Just over half of commencing medical students were under 20 years of age (52.5%, Table 3). The great majority were Australian citizens, and were of neither Aboriginal nor Torres Strait Island origin (Table 3). Nearly one third (32.5%) of commencing medical students spoke a language other than English at home (Table 3).
Completing medical students
At completion of medical school, 55% of respondents in the responding cohorts were female. Nearly half (47.8%) of respondents completing Exit Questionnaires were aged 25 to 29 years (Table 3). Just over 80% were Australian citizens. Only 0.55% reported that they were of Aboriginal and/or Torres Straits Islander origin.
Vocational practice intentions
First preference vocational practice intentions
N = 22,126 (%)
N = 8509 (%)
Adult Medicine/Internal Medicine/Physician
Intensive Care Medicine
Non-Specialist Hospital Practice
Obstetrics and Gynaecology
Paediatrics and Child Health
Public Health Medicine
Of 8,509 completing students, 978 did not select any response (there was no ‘not yet decided’ option in any Exit Questionnaire). Therefore 7,531 completing students (88.5%) selected a vocation as their first preference for future practice. The three highest ranking vocations were Surgery (18.8%), Adult Medicine/Internal Medicine/Physician (18.0%), and General Practice (13.3%) (Table 4). The Health Workforce 2025 report indicates that General Practice will be in undersupply .
Between CMSQ and EQ, 75.7% of medical students changed their first vocational preference. MSOD has the ability to track and identify the factors that influence career intentions and enables assessment of whether current intentions are turning into behavior.
Preferred geographic location of future medical practice
Preferred geographic location of future medical practice
N = 22,126 (%)
N = 8509 (%)
Major Urban centre (>100,000)
Regional city or large town (25,000 – 100,000)
Smaller town (10,000 – 24,999)
Small community (<10,000)
Not intending to work in Australia Missing
Longitudinal analyses, and changes with progression in medical school and during training, will form part of future manuscripts.
There have been relatively few comprehensive studies which have been longitudinal encompassing the national continuum of medical school education, early postgraduate experience (internship or pre-registration), and vocational training. In particular, some of the key medical workforce studies [9–13] provide only a ‘snapshot’ view of various programs but are seldom as effective in assessing long-term outcomes. At the time of this report, the MSOD project already has recruited over 30,635 responses from Australian medical students and trainees who are being surveyed prospectively (Table 2), making the project one the largest longitudinally tracked cohorts of medical students in any single research project globally.
The MSOD project is unique with its comprehensive national survey methodology, encompassing medical schools in Australia, and New Zealand. Due to the varying lengths of medical school programs, it will be 2015 before students from all medical schools in both countries will complete the PGY3 questionnaires. By 2021 students who have graduated from all medical schools in both countries will be completing PGY8 questionnaires, and many will have completed their vocational (specialist) training by that time. By the time of implementation of PGY8 questionnaires for all graduates from Australian and New Zealand medical schools, it is anticipated that approximately 24,000 students and trainees will be eligible to complete questionnaires each year.
The data obtained will enable longitudinal comparisons of medical student career intentions with training progression for individual medical student cohorts. As the project continues, it will also be possible to examine trends or differences that may occur in vocational choices for more recent commencing student cohorts in comparison with earlier cohorts. Analyses will be possible which examine differences within cohorts according to factors such as gender, medical school course characteristics such as direct undergraduate entry to medical school or postgraduate entry, self-analysis of rural or urban background, and participants self-rating of nominated career choice influencing factors. This Project is primarily limited by the fact that the questionnaire data gathered is by self report and is not validated by any other sources apart from general medical school curriculum delivery databases.
The strengths of the MSOD are the use of a minimum dataset approach, current high response rates, and development of a database as a national resource that is now well established and is beginning to generate significant research outputs .
MSOD faces a number of ongoing challenges including the continued substantial engagement of all Australasian Medical Schools and key stakeholders, the maintenance of high response and retention rates through postgraduate surveys over time; and ongoing resources to sustain the Project. There is an ongoing need to provide contemporary policy advice and research outputs to address some of the current problems being encountered as reform gathers momentum in medical education and workforce development, during the period when the long term information from the cohorts is not fully gathered. All Medical Deans in Australia and New Zealand are strongly committed to the sustainability of this crucial planning and policy resource. A next key step in Australia is formalising the link between MSOD and the Australian Health Professional Registration Authority (AHPRA). Through this collaboration, efficient linkages between the MSOD database and the National Health Workforce dataset, with appropriate privacy constraints, will allow consequent analyses of key educational and training experiences throughout medical student training that influences long term career choices. This will assist earlier detection of vocational workforce trends, and in particular specialties which are undersubscribed and for which there is a major workforce need both in numbers and in geographic location of practice.
An important further priority for Medical Deans Inc. is identification of the possible educational levers and opportunities for exposure that will lead to more medical graduates choosing semi-rural, rural and remote practice for their future medical careers . This workforce maldistribution issue continues to be one of the main policy conundrums facing Australia .
Health service delivery occurs in a complex and evolving environment, and attempting to plan for future workforce needs is fraught with difficulties. However it is no longer appropriate to leave overall national planning to traditional market economics of supply and demand. The MSOD project provides a framework for scenario based modelling linking student career intentions with current gaps in the medical workforce [17, 20]. This modelling will then allow long term horizon scanning regarding vocational and skills gaps.
The MSOD project is already of great value to medical leaders and policymakers. Workforce reform is crucial to the creation of a sustainable health care system for the future. The MSOD project as a national resource will be a key tool as workforce planning reforms are implemented.
The research on which this publication is based used data provided by the Medical Schools Outcomes Database and Longitudinal Tracking (MSOD) Project, Medical Deans Australia and New Zealand Inc. We are grateful to the medical schools, medical students, graduates and doctors who participated. The MSOD project was possible due to funding made available by Health Workforce Australia (2011 onwards) and The Australian Government Department of Health and Ageing (2004–2011).
- Askew DA, Hansar NR, Dick M-LB: Medical workforce planning: let’s keep it current. Med J Aust. 2009, 191 (2): 72-73.Google Scholar
- Campbell J: The route to effective coverage is through the health worker: there are no shortcuts. Lancet. 2013, 381 (9868): 725.View ArticleGoogle Scholar
- Nelson R: Combating Global Health Worker Shortages. AJN Am J Nurs. 2012, 112 (12): 17-18. 10.1097/01.NAJ.0000423494.77404.42.View ArticleGoogle Scholar
- Fried BJ: Guest editorial: toward a systemic approach to the global health workforce. World Health Popul. 2011, 13 (2): 3-4. 10.12927/whp.2011.22702.View ArticleGoogle Scholar
- Arie S: World needs 3.5 million more health workers to deliver essential services, charity says. BMJ. 2011, 343: d6005-10.1136/bmj.d6005.View ArticleGoogle Scholar
- Moszynski P: One billion people are affected by global shortage of healthcare workers. BMJ. 2011, 342: d696-10.1136/bmj.d696.View ArticleGoogle Scholar
- Chen L, Evans T, Anand S, Boufford JI, Brown H, Chowdhury M, Cueto M, Dare L, Dussault G, Elzinga G, Fee E, Habte D, Hanvoravongchai P, Jacobs M, Kurowski C, Michael S, Pablos-Mendez A, Sewankambo N, Solimano G, Stilwell B, De Waal A, Wibulpolprasert S: Human resources for health: overcoming the crisis. Lancet. 2004, 364: 1984-1990. 10.1016/S0140-6736(04)17482-5.View ArticleGoogle Scholar
- Middleberg M: The Global Health Initiative and the health workforce. World Health Popul. 2011, 13 (2): 5-12. 10.12927/whp.2011.22625.View ArticleGoogle Scholar
- BMA Cohort Doctor Study: Seventh Report of the BMA Cohort Study of 2006 Medical Graduates. 2013, London: BMAGoogle Scholar
- Lambert TW, Goldacre MJ, Edwards C, Parkhouse J: Career preferences of doctors who qualified in the United Kingdom in 1993 compared with those of doctors qualifying in 1974, 1977, 1980, and 1983. BMJ. 1996, 313 (7048): 19-24. 10.1136/bmj.313.7048.19.View ArticleGoogle Scholar
- Tyssen R, Vaglum P, Gronvold NT, Ekeberg O: The impact of job stress and working conditions on mental health problems among junior house officers. A nationwide Norwegian prospective cohort study. Med Educ. 2000, 34 (5): 374-384. 10.1046/j.1365-2923.2000.00540.x.View ArticleGoogle Scholar
- Hojat M, Gonnella JS, Veloski JJ, Erdmann JB: Jefferson Medical College longitudinal study: a prototype for evaluation of changes. Educ Health. 1996, 9 (1): 99-113.Google Scholar
- Joyce CM, Scott A, Jeon S-H, Humphreys J, Kalb G, Witt J, Leahy A: The “Medicine in Australia: Balancing Employment and Life (MABEL)” longitudinal survey - Protocol and baseline data for a prospective cohort study of Australian doctors’ workforce participation. BMC Health Serv Res. 2010, 10: 50-10.1186/1472-6963-10-50.View ArticleGoogle Scholar
- Humphreys JS, Prideaux D, Beilby JJ, Glasgow NJ: From medical school to medical practice: a national tracking system to underpin planning for a sustainable medical workforce in Australasia. Med J Aust. 2009, 191 (5): 244-245.Google Scholar
- Health workforce New Zealand (HWNZ). [http://www.health.govt.nz/our-work/health-workforce]
- Medical Schools Outcomes Database Medical Deans Australia & New Zealand. [http://www.medicaldeans.org.au/msod]
- Health Workforce. 2025, https://www.hwa.gov.au/our-work/health-workforce-planning/health-workforce-2025-doctors-nurses-and-midwives, - Doctors, Nurses and Midwives.
- Jones M, Humphreys J, Prideaux D: Predicting medical students’ intentions to take up rural practice after graduation. Med Educ. 2009, 43 (10): 1001-1009. 10.1111/j.1365-2923.2009.03506.x.View ArticleGoogle Scholar
- Jones M, Humphreys JS, McGrail MR: Why does a rural background make medical students more likely to intend to work in rural areas and how consistent is the effect? A study of the rural background effect. Aust J Rural Health. 2012, 20: 29-34. 10.1111/j.1440-1584.2011.01242.x.View ArticleGoogle Scholar
- Kaur B, Roberton DM, Glasgow NJ: Evidence-based medical workforce planning and education: the MSOD project. Med J Aust. 2013, 198 (10): 518-519. 10.5694/mja13.10243.View ArticleGoogle Scholar
- Rural Health Resources. [http://www.health.gov.au/internet/main/publishing.nsf/Content/ruralhealth-overview]
- Standing Council on Health: National Strategic Framework for Rural and Remote Health. 2012, Canberra: Australian Government Department of HealthGoogle Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6920/14/180/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/4.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.