The need for national medical licensing examination in Saudi Arabia
- Sohail Bajammal1, 14Email author,
- Rania Zaini1,
- Wesam Abuznadah2,
- Mohammad Al-Rukban3,
- Syed Moyn Aly4,
- Abdulaziz Boker5,
- Abdulmohsen Al-Zalabani3,
- Mohammad Al-Omran6,
- Amro Al-Habib6,
- Mona Al-Sheikh7,
- Mohammad Al-Sultan8,
- Nadia Fida5,
- Khalid Alzahrani9,
- Bashir Hamad8,
- Mohammad Al Shehri10,
- Khalid Bin Abdulrahman11,
- Saleh Al-Damegh12,
- Mansour M Al-Nozha13 and
- Tyrone Donnon14
© Bajammal et al; licensee BioMed Central Ltd. 2008
Received: 15 July 2008
Accepted: 25 November 2008
Published: 25 November 2008
Medical education in Saudi Arabia is facing multiple challenges, including the rapid increase in the number of medical schools over a short period of time, the influx of foreign medical graduates to work in Saudi Arabia, the award of scholarships to hundreds of students to study medicine in various countries, and the absence of published national guidelines for minimal acceptable competencies of a medical graduate.
We are arguing for the need for a Saudi national medical licensing examination that consists of two parts: Part I (Written) which tests the basic science and clinical knowledge and Part II (Objective Structured Clinical Examination) which tests the clinical skills and attitudes. We propose this examination to be mandated as a licensure requirement for practicing medicine in Saudi Arabia.
The driving and hindering forces as well as the strengths and weaknesses of implementing the licensing examination are discussed in details in this debate.
The current proposal is an initiative from a group of medical and educational professionals who are interested in enhancing the standards of medical education for the best of medical practice in Saudi Arabia. In this article, we will discuss the need for a national medical licensing examination in Saudi Arabia, its driving and hindering forces, along with the strengths and weaknesses of such an examination. The fact that Saudi Arabia does not have a national medical licensing examination is shared by many countries across the globe, and hence this debate can be extrapolated to other countries considering this licensure process as a mandatory requirement to practice medicine.
We anticipate opposing debates to our proposal, as it was the case with similar proposals for a change before. For example, the criticism against the addition of Part II of the Medical Council of Canada Qualifying Examination for Canadian graduates [1–5], the criticism against the addition of the Clinical Skills component to Step 2 of the United States Medical Licensing Examination by the National Board of Medical Examiners for graduates of medical schools in the United States (US) [6–8], the debate triggered by a proposal to establish a national licensing examination in Australia [9–11] and a similar debate by a consultation conducted by the General Medical Council of the United Kingdom (UK) to enquire about the current status of assessment of medical schools in the UK [12–15].
In this paper, we are not presenting new empirical evidence. In fact, we are summarizing the available debates on the need of a national licensing medical examination.
The current status of medical education in Saudi Arabia
List of Medical Schools in Saudi Arabia
King Saud University
King Abdulaziz University
King Faisal University
King Khalid University
Umm Al Qura University
Al Qassim University
King Faisal University
King Fahd Medical City
King Saud Bin Abdulaziz University for Health Sciences
The Batterjee College for Medical Sciences and Technology
Al Jouf University
Al-Imam Mohammed Bin Saud Islamic University
King Saud University
Al-Marifa College of Medicine
Al-Rajhi College of Medicine
King Saud Bin Abdulaziz University for Health Sciences
King Saud Bin Abdulaziz University for Health Sciences
Twenty of the 25 medical schools are government-funded with no tuition fee for Saudi students. The five private medical schools are open to students of all nationalities; however, the average annual tuition fee is around $15,000 US. Mirroring the British system, all of the medical schools admit students with a high school diploma to enroll in a six year program. Some schools (e.g. King Saud bin Abdulaziz University for Health Sciences, established in 2005) offer an additional graduate students-stream of a four-year program with a requirement of a pre-medical Bachelor degree, mirroring the North American system. Acceptance into medical schools is based on students' high school grade point average, and performance on the General Aptitude Exam and National Achievement Test for Health Colleges. The latter two examinations, introduced four years ago, are national standardized tests conducted by the National Center for Assessment in Higher Education . In addition, most schools include personal interviews in the selection process.
Each medical school in Saudi Arabia decides internally, by virtue of its curriculum committee, on the details of the curriculum and the educational objectives. Similarly, each medical school independently determines the instructional methods to be used to deliver the curriculum. The spectrum of educational strategies ranges from a lecture-based/teacher-centered to problem-based/student-centered approach to teaching and learning [18, 19]. Finally, each medical school in Saudi Arabia develops and administers its own formative and summative assessment measures. Consequently, the methods of assessing students' knowledge, skills and attitudes in these medical schools are quite variable from one school to another. The written methods of assessment include multiple choice questions (MCQs), true-false questions, short answer questions, essays and modified essay questions. The oral methods of assessment include oral examination/viva, observed and unobserved long and short cases, objective structured clinical examination (OSCE), objective structured practical examination, portfolios and logbooks. The use of standardized patients in Saudi medical schools is minimal. External examiners from other Saudi medical schools as well as from other countries participate in the development and administration of these various examination processes.
A mandatory rotating internship year is required of all students before the medical diploma (either an MBBS or an MBChB) is awarded by a medical school. The medical diploma qualifies the graduate as a competent physician with the ability to practice medicine as a general practitioner anywhere in Saudi Arabia. If the graduate chooses to apply for a residency program in Saudi Arabia, he or she must sit for the "Acceptance Test", also known as Saudi Licensing Exam, regulated by the Saudi Commission for Health Specialties (SCHS) . The "Acceptance Test" consists of 100 MCQs and lasts for 2.5 hours. In addition, some residency programs require specialty-specific exams, regulated by the SCHS, to screen candidates for entry into their programs. Established by a Royal decree in 1993, the SCHS is a scientific body with a corporate entity that has multiple roles focused mainly at the level of the postgraduate training programs and practicing healthcare professionals. These include the provision, supervision and accreditation of residency programs in the country in addition to the annual assessments and final certification examinations of residents in all healthcare specialties. SCHS also governs the registration process of all healthcare professionals, including the verification of credentials and the conduct of specialty-based equivalence examinations for foreign medical graduates with specialty certificates obtained abroad. Yet, SCHS has a limited role in supervising undergraduate medical education.
In addition to the establishment of new medical schools, the government has facilitated the sponsorship of many medical students to study abroad to face the increasing need for medical professionals. This has resulted in a large number of students studying medicine in countries like the United States, Canada, Australia, New Zealand, France, Germany, Holland, Ireland, Austria, Poland, Slovakia, Pakistan, Malaysia, and China, in addition to the Arab countries, Egypt, Jordan and Bahrain.
To summarize, we can identify six phenomena in the Saudi medical education movement: 1) the increase in the number of new medical schools over a relatively short period of time; 2) the wide spectrum of educational philosophies, instructional methods and assessment techniques; 3) the absence of published national agreement on the competency of medical graduates or standards for medical school graduation outcomes; 4) the large proportion of foreign medical graduates practicing medicine in Saudi Arabia; 5) the large number of Saudi medical students sent on scholarship to a wide spectrum of medical education systems around the world (from China in the Far East, to Slovakia in Eastern Europe, to Austria in Western Europe, to Canada in North America); and 6) the exponential increase (150% to 200%) in the enrollment of medical students in the established medical schools with no proportional increase in resources. In addition, there has been a heightened public awareness of the challenges facing the Saudi medical system as presented in the local media. These include the need for physician accountability, assurance of patients' safety and frequent reports on medical errors.
Vision of the Saudi medical licensing examination
Acknowledging that the field of educational measurement and assessment is a science by itself, it is beyond the scope of this debate to discuss the psychometric characteristics of medical education examinations and tests. We will briefly outline the vision of a proposed Saudi Medical Licensing Examination hoping to trigger some discussion around the structure, objectives, timing and other details of the exam.
Examples of National Competencies of Physicians
ACGME1 Core Competencies
GMC's2 Good Medical Practice
1. Medical expert
1. Patient care
1. Good clinical care
1. Professional Values, Attitudes, Behavior and Ethics
2. Medical knowledge
2. Maintaining good medical practice
2. Scientific foundation of medicine
3. Practice-based learning and improvement
3. Relationships with patients
3. Communication skills
4. Interpersonal and communication skills
4. Working with colleagues
4. Clinical skills
5. Health advocate
5. Teaching and learning
5. Population health and health systems
6. Systems-based practice
6. Management of information
7. Critical thinking and research
Preparation of high-stakes examinations
As explained concisely by Roberts and colleagues , the four steps involved in preparing high-stakes assessment exams are: 1) blueprinting the educational objectives, 2) selection of appropriate test formats, 3) applying assessment strategies to achieve adequate levels of reliability, and 4) implementing appropriate standard setting and decision-making procedures.
Blueprinting or creating a table of specifications provides a grid which maps the content of the examination against the educational goals and learning objectives of the planned curriculum. Blueprinting ensures that the content and face validity of the test are established. The discussion of types of validity is beyond the scope of this debate .
Taxonomy of Educational Objectives: Knowledge (Cognitive), Skills (Psychomotor) and Attitude (Affective) Domains
Knowledge (Cognitive) 
Skills (Psychomotor) 
Attitudes (Affective) 
1. Knowledge: recall or recognize information
1. Perception: uses sensory cues to guide actions
1. Receiving: demonstrates a willingness to participate in the activity
2. Comprehension: translate, interpret, extrapolate but not see full implications
2. Set: demonstrates a readiness to take action to perform the task
2. Responding: shows interest in the activity by seeking it out
3. Application: apply abstraction or general principles to concrete situations
3. Guided response: knows steps required to complete the task
3. Valuing: internalizes an appreciation for the activity
4. Analysis: separation of a complex idea into parts and understanding of relationship between the parts.
4. Mechanism: performs task in a somewhat confident, proficient, and habitual manner
4. Organization: begins to compare different values and resolves conflicts between them to form an internally consistent system of values
5. Synthesis: creative, mental construction of ideas from multiple sources to form complex ideas into a new integrated and meaningful pattern.
5. Complex overt response: performs task in a confident, proficient, and habitual manner
5. Characterization by a value: adopts a long-term value system that is "pervasive, consistent, and predictable".
6. Evaluation: to make a judgment of ideas using external evidence or self-selected criteria substantiated by observations or informed rationalizations.
6. Adaptation: performs task as above, but can modify actions to account for new situations
7. Origination: creates new tasks or objectives incorporating learned ones.
The third step in preparing high-stakes examination is applying strategies to achieve acceptable reliability of the test. Reliability of a test is the extent to which the results can be reproduced on more than one occasion. In other words, it is a reflection of the consistency of the test. There are three common types of reliability for educational tests: intra-rater, inter-rater and test-retest reliability. We will briefly explain the concept of reliability, but suffice it to say that all testing will involve some error in the measurement process. This means that, regardless of how sophisticated and rigorous the examination methodology might be, the final test score (observed score) that the student achieves is actually the sum of his/her true score (which no one can measure) and sources of error measurement. The aim of all educational psychometricians is to minimize this error of measurement thus increasing the overall reliability of the testing format used to measure students' knowledge, skills and attitudes. There are a number of factors that can contribute to errors of measurement: variation in the difficulty of questions from one exam to another, variation of examiners' leniency and training on assessment protocols, variation in the complexity of the patient encounters, or variation in the examination procedure itself (e.g., use of paper and pencil versus computer, time of day, location). All of these potential sources of variation, which add noise or confounding factors that influence students' scores in testing, are detrimental to the overall reliability of the examination. The detrimental effects of these potential sources of variation can be remedied by using peer-reviewed blueprints (or rubric) of the exams and conducting educational workshops and meetings for the examiners to assure that the best practices of developing MCQs and OSCEs are followed.
The fourth step in preparing high-stakes examination is standard setting. It is the process which determines the borderline or minimum performance level between those students who pass the exam and are deemed acceptable from those who fail the exam and are deemed unacceptable. Although there are multiple methods for standard setting, they can be broadly classified as relative (norm-referenced) or absolute (criterion-referenced) . As most summative and licensure examinations are considered to be high-stakes testing, the criterion-referenced standard setting method is preferred for both written and clinical performance exams. Standard setting requires the input of a number of expert judges who determine independently the criterion from which a minimally competent student must achieve in order to pass.
The proposed examination
The licensing examination should be conducted and maintained by an independent judicial body (for example, SCHS) with representation from the medical schools. Such an organization, especially at the initial stages of such a project, would likely benefit from consulting experienced organizations in conducting such examinations (e.g., the Medical Council of Canada and the National Board of Medical Examiners). Additionally, we suggest recruiting medical education experts in psychometrics and testing to assist in the development and administration of these examinations seeking higher test standards.
The first part of the medical licensing examination would be designed to test the cognitive domain of medical students' understanding of the main specialties with respect to the fundamental basic and clinical sciences knowledge. We specifically propose the use of 5 option one-best answer MCQs (A-type), or a combination of these MCQs with extended matching questions (R-type) and short answer questions. It is recommended that the questions are written to assess higher cognitive levels (application, analysis, synthesis and evaluation) of Bloom's taxonomy  (Table 3), than just recall or comprehension. More over, the questions should be based on clinical vignettes to increase the likelihood of integrating the clinical sciences (e.g., diagnosis, investigation and management options) and, thereby, increasing the clinical relevance of the exam. We invite interested readers to consult a very helpful resource published by the National Board of Medical Examiners for constructing effective MCQs . We suggest considering the use of Item Response Theory in maintaining a Questions Bank to enable computer adaptive testing in the future. One of the advantages of computer adaptive testing is the potential to use fewer numbers of questions without endangering the overall reliability of the test and, simultaneously, avoiding the risk of depleting the items held within the Questions Bank too quickly.
The second part of the licensing examination would focus on the testing of psychomotor (skills) and affective (attitudes) domains of competencies (e.g., history taking, physical examination skills, communication skills, critical thinking, decision-making, breaking bad news, ethics, counseling skills, etc). We propose the use of an OSCE-style examination format that utilizes trained standardized patients and standardized checklists. Although the OSCE format has been found to have good reliability and validity when upwards of 16 stations are used, the expenses to develop and administer this type of examination process can be significant. In addition to having the appropriate facilities and personnel to maintain such a testing centre, there are costs related to the hiring and training of the standardized patients and examiners (raters) that are crucial to ensure the high reliability and validity of the results.
Given the comprehensiveness and standardization in the planning, writing and conduct of these rigorous examinations, these licensing examinations can eventually replace the multiple exams required currently from medical students which include the final year examinations, the SCHS' "Acceptance Test", and the specialty-specific screening exams.
Driving forces for the national examination
1. The increased number of medical schools
The exponential increase in the number of medical schools in Saudi Arabia in a short period of time necessitates a mechanism to ensure high-quality of graduating medical students both from the established and new medical schools. The established medical schools are at a disadvantage due to relocation of some of their experienced medical educators to the new schools, while the new medical schools are often disadvantaged due to being "new" in the business. Although a national medical licensing examination is not the only safeguard to ensure high quality of curriculum, instruction and learning outcomes, it is a tool with a tangible and standard measurable outcome that can be used to identify areas in need for potential improvement in the curriculum and instructional methods used in all medical schools. Although we do not have evidence of variation in the quality of graduates of Saudi medical schools, the need for a quality assurance exam cannot wait for the availability of such evidence. Evidence from other countries, however, is available. Data from the UK showed marked differences in candidates' scores on the examination for membership of the Royal College of General Practitioners when compared by medical school of qualifications [30, 31]. In addition, despite their stringent accreditation system, education standards are different among medical schools [32, 33] and significant variation in examination performances exists .
2. Lack of consistency in assessment methods
The lack of consistency in using valid and reliable assessment methods across Saudi medical schools is an area of potential concern. Although we could not find published reports of the assessment methods used in Saudi medical schools, our personal communications and the fact that the authors of this report represent medical educators from many medical schools across the country confirm our position. We quote and echo Fowell et al.'s areas for concern based on the results of a survey of assessment practices of medical schools in the UK in 1998 . The authors stated: "Assessment methods and practices that might be considered to be less educationally desirable are still used by many schools, such as true/false multiple-choice questions (MCQs), negative-marking of MCQs, essays, patient management problems and oral assessments. There is an apparent lack of knowledge of technical aspects of assessment, particularly regarding the use of test 'blueprints' or 'matrices' in assessment design, robust approaches to standard-setting, and the use of item analysis as an approach to evaluation of assessment".
3. Large proportion of foreign medical graduates in Saudi Arabia
Foreign graduate physicians are present in large numbers in Saudi Arabia to meet the country's health service demands. The standard of their medical training and minimal competencies needs to be tested in a unified testing standard. Although there are examinations conducted by the Saudi Commission of Health Specialties for the purpose of "Professional Classification", these examinations are specialty-based and are not necessarily tailored to address the minimal competencies of a medical professional. On the contrary, in the US or Canada, any foreign medical graduate must pass licensing examinations in order to be eligible to practice in the country, then he or she should enroll in a residency program or under certain conditions, sit for the specialty-specific examination. Therefore, medical practitioners share a common licensing scheme which ensures every graduate has at least the minimum competence to function as a physician, according to the licensing body standards. Even in some countries where there is no medical licensing examination for national graduates, foreign medical graduates have to pass a licensing examination before they are able to practice medicine in these countries. Examples include the Professional and Linguistic Assessments Board (PLAB) Test in UK and the Australian Medical Council examination in Australia.
4. Scholarships for undergraduate medical students
The expansion of international scholarship of undergraduate medical studies will bring many Saudi physicians with variable qualities of undergraduate medical education and from different cultural backgrounds into the country. The licensing exam will serve as a method of unifying the minimum standard of acceptable competency in the health service among these graduates.
5. Planned, delivered, assessed and hidden curricula
6. Completing the standardization process
Interestingly, the decisions to admit students into medical schools are based on the national standardized tests conducted by the National Center for Assessment in Higher Education. Similarly, residents are assessed for fitness to practice based on national standardized tests conducted by the Saudi Commission for Health Specialties. The standardization of the assessment of medical students prior to their entry into medical practice, whether they join residency or not, is needed to complete the first and last step of the standardization process already in practice.
Hindering factors against the national examination
1. Efforts and costs to maintain the process
As we explained earlier in our vision of this examination, this is a very arduous process. The planning, writing, revising, scoring and analyzing of these examinations are very complex and tedious processes that require the allocation of quite a significant amount of time, money and personnel. We believe that this is the strongest barrier against implementing such system. At the time of writing this manuscript, the fee for the Medical Council of Canada Qualifying Examination part I was around $700 US and for part II (a clinical examination) was $1,500 US, while the fee for Step 1 of the United States Medical Licensing Examination was $695 US, for Step 2 Clinical Knowledge was $695 US and for Step 2 Clinical Skills (a clinical examination) was $1,200 US. The expertise of the educators and researchers from the Medical Council of Canada, the National Board of Medical Examiners and the General Medical Council in conducting the standardized MCQ exams and OSCE patient encounter assessments would be beneficial to ease the implementation of these testing formats.
2. Opposing arguments
The natural resistance to change is expected from both the medical schools' administrators and students. Interestingly, this was not the case in Khan and Sear's national online survey of 401 final year medical students' opinion of the General Medical Council's proposed reform of the undergraduate medical assessment system . The majority (92.5%) of the respondents were in favor of consistency of assessment between medical schools. There was a nearly equal division in the number of students who were for and against the national exam to be used as a tool in the grading and ranking of students. Interestingly, 72.3% of the respondents were in favor of the exam being held near the end of the undergraduate course as a prerequisite for graduation and 45.4% of respondents thought that the national exam would lead to a fairer selection process for foundation jobs by allowing grading and marking.
There is an argument that the current SCHS' "Acceptance Test", also known as Saudi Licensing Exam, is enough and might perceive this proposal as redundant. Our rebuttal to this argument is three folds. First, we want to establish a mandatory test for every physician to practice medicine in Saudi Arabia, regardless of his school of graduation and regardless of whether he or she is interested to join a residency program or not. The licensing exam will ensure that minimal competencies are achieved by every practicing physician in Saudi Arabia. This is not the case in the current "Acceptance Test". It is utilized mainly as a screening tool for entry into residency programs in Saudi Arabia. Second, the proposed licensing exam will consist of a written part and OSCE part to ensure that competencies such as history taking, physical examination, and communication and counseling skills are achieved by practicing physicians with acceptable standards. This is not the case in the 100-MCQ "Acceptance Test" conducted by the SCHS. Third, the proposed mandatory licensing exam will function as a benchmark for medical schools to gauge their curriculum and instructional strategies. The SCHS' "Acceptance Test" is not suitable to provide this information for medical schools because only students who want to enroll in a Saudi residency program sit for this test.
3. Exposing potential weakness in medical schools education system
Medical schools might resist this call for change fearing that they will be exposing the weaknesses of their medical schools publicly. This is definitely a valid fear as stakeholders from no one medical school would like to be singled out without an opportunity to address these concerns initially. However, the potential embarrassment can be avoided by keeping the results of the medical schools performance confidential for the first 5 years of implementing the system. This will give the poor performing medical schools time to rectify their problems. The licensing exam has the potential for helping medical schools identify the potential weaknesses in their education system early, which is of crucial importance for new medical schools. The licensing exam will enable them to identify and rectify problems as soon as they are detected.
4. The fear of impeding flexibility within medical school's curriculum
Medical schools educators might resist the change because they believe that national learning outcomes and a national standardized examination will restrict the flexibility of customizing their curriculum and choice of assessment methods. Although there may be some truth in this, the advantage of ensuring that all curricula are meeting a minimal competency standard (national core curriculum) will allow for that flexibility to be maintained. Therefore, as long as the medical school has fulfilled the national curriculum, each is free to complement their respective curriculum with additional materials and resources.
5. Language barrier for non-Arabic speaking physicians
English is the language of instruction and examination in all medical schools in Saudi Arabia. Implementing a mandatory OSCE part which entails communicating with patients, who are mostly Arabic-speaking, might be a major issue for non-Arabic speaking physicians. Although these physicians might be very competent medically, they might have difficulty communicating in Arabic, at least initially upon their arrival to Saudi Arabia. The solution to this problem might be the introduction of basic Arabic courses for physicians.
Strengths of the national medical licensing examination
First, the use of a standardized national exam will ensure that any medical graduate or practicing doctor in Saudi Arabia has achieved at least a common standard of medical knowledge and clinical skills competencies. This does not necessarily mean that all graduates are homogenous. It will ensure that minimal standards are met and will maintain the high reputation of Saudi Arabia-trained physicians.
Second, this exam and the process of assessing both knowledge as well as clinical and generic skills will improve the public trust and confidence in the Healthcare in Saudi Arabia. It will ensure that physicians are competent in their clinical skills and attitudes in addition to their competence in medical knowledge.
Third, the use of results of a national examination is a reliable, transparent and valid measure of candidates' qualifications for jobs and residency programs' application. It will avoid stereotyping students graduating from lenient medical schools as lower performers thus providing equal and fair opportunities in the current competitive job market.
Fourth, the exam can be used as a tool for quality assurance to benchmark medical schools across Saudi Arabia, and to correct any potential problem or deficiency in the curricula or methods of instruction at any medical school.
Fifth, although we do not necessarily propose the exclusive use of this examination as a method of assessing students for readiness to practice, since there are other aspects of competencies (such as professionalism) that cannot be assessed thoroughly by such an examination. The implementation of a standardized national exam (which potentially substitutes for the final exams in medical schools) will decrease the time constrains on the faculty (teachers and educators) thus allowing more time for ongoing global assessment of the learners and the exploration of new methods to rectify the identified weaknesses in medical curricula.
Sixth, if this examination is eventually implemented and proved to be successful in measuring standards of students' performance, Saudi Arabia can become the regional center for the administration of high quality medical licensing examinations that would address the needs of other Arab countries interested in moving towards this process.
Weaknesses of the national medical licensing examination
First, although we discussed standardization of assessment as a strength, this is considered by some as a weakness . Their rationale is that standardization of assessment will force medical schools to eventually standardize their curriculum and instructional methods. Hence, this will eliminate the creativity and innovation in instructional methods. However, this did not happen in Canada, where national licensing examination has been in place for years. On the contrary, in the face of a common national examination for all Canadian medical schools graduates, the problem-based learning approach was initiated at McMaster University. The rationale of opponents of a standardized national examination is that it focuses on the outcome rather than the process of medical education. Some are concerned that both students and staff of medical schools will be exam-oriented. Their focus will be on how to pass the exam and keep the reputation of the school high, and less on how to graduate students as competent physicians. We disagree with these concerns since there is enough evidence that testing improves the learning process and that testing yields better long term retention than repeated studying .
Second, there is a concern that the implementation of a national examination will stratify medical schools into explicit league tables, which could be detrimental for morale of staff and students in medical schools with poor performance. This is a true concern. However, it does not justify avoiding a national examination. On the contrary, if such poor performing medical schools are identified based on the results of the national examination, measures can be taken to rectify the problems early, thus preventing the problem from worsening. We believe that, even if there is not a national examination, there will be implicit league tables of medical schools, which could be detrimental for graduating students from the implicitly poor performing schools. Regardless of how genius, hard working, and innovative the students are, they will be perceived as graduating from a lenient medical school. This will add noise and confusion to the decision of their admission to residency programs and job applications. However, if a standardized national examination exists, their performance on the examination will be easily compared against that of their colleagues from other schools regardless of how lenient or strict their medical school is perceived as being.
Third, some authors argue that a one time assessment is not as comprehensive as ongoing assessments of medical schools . We totally agree with this opinion. We are not proposing an exclusive national exam while discounting other important or relevant methods of assessment used by individual medical schools. Instead, we propose the use of the national exam to ensure that minimal competencies are met for all graduating medical students. This can be supplemented by any number of other methods of ongoing assessments used by the medical schools.
Fourth, this test will definitely burden the students with additional financial commitments. However, students in the government-funded medical schools in Saudi Arabia are already at an advantage in that they can study medicine for free with additional financial support available from the government. As professionals in the discipline, the very least we can do is to make a commitment that we meet recognized national standards for the practice of medicine in Saudi Arabia. Furthermore, we anticipate that the government might be supportive in moving towards this process by subsidizing parts of the exam to lessen the burden on the students.
Alternatives to national medical licensing examination
Development of a body of accreditation
Although there is no formal undergraduate medical accreditation organization in Saudi Arabia, the recent establishment of the National Commission for Academic Accrediation and Assessment  is promising. The commission has recently developed an accreditation system of medical schools in Saudi Arabia; the report is yet to be published. In order for any accreditation body to maintain the highest standards of medical education, its policies and decisions should be transparent and public and it should have enough administrative power to enforce needed changes in any medical school. Furthermore, accreditation is not an alternative to a national licensing exam. Both are complementary and help in competency assessment of our medical graduates.
Medical schools in most countries, including Saudi Arabia, use external examiners (from outside the medical school) to ensure that national and international standards are met. Forbes discussed, in an overview, the requirements and duties of external examiners . External examining is not just the mere visit of another medical school during the final examination period. Karuhije and Ruff  identified six steps in the external examining experience: 1) appointment, 2) contract, 3) review of curriculum and examination materials, 4) on-site visit, 5) consolidating internal and external assessment, and 6) preliminary and final reports. Sheehan  identified 15 facets for the role of external examiner: subject expert, experienced, impartial judge, custodian of standards, interpreter of regulations, rapid reader, board member, decision maker, conflict coper, interviewer, power source, signatory, migrant, reporter and outsider. Apart from the difficulty of finding persons with the aforementioned characteristics, the process of external examining is expensive, including the remuneration, travel, accommodation and hospitality costs. Considering there are 25 medical schools, the cost of multiple external examiners for each medical school can be substantial, yet the outcomes of external examining are not as objective as a national licensing examination.
Establishment of a national center for the assessment of medical competencies
As explained earlier, the process of designing, refining, running and scoring methodologically-sound high-stakes examinations is complex and time consuming. Hence, an alternative to a national medical licensing examination is the establishment of a national center for assessing medical competencies. The function of such a center will be to provide training, advice and technical support in the planning, conduct and analysis of different methods of medical education assessment conducted by local medical schools. Additionally, the center may host a shared bank of assessment methods that can be used by any medical school in the region. Yet, security of the shared bank of assessment methods is an issue that needs to be addressed.
Summary of Driving and Hindering Forces along with strengths and weaknesses of a national medical licensing examination in Saudi Arabia
1. Increase in number of medical schools over short period
1. Cost and time
2. Inconsistency and variable expertise in using valid and reliable assessment methods
2. Natural resistance to change
3. Large number of foreign medical graduates
3. Fear of discovering medical schools' weaknesses
4. Saudi medical students on scholarships to various countries
4. Restriction of medical schools freedom and flexibility on the choice of curriculum and assessment methods
5. What is taught is not necessarily what is learnt. Issues of planned, delivered, assessed and hidden curriculum
5. Difficulty on agreement on a set of educational objectives
6. Standardized testing for admission to medical schools and exit from residency calls for standardization of exit from medical school
6. Language barrier for non-Arabic speaking physicians in the OSCE part of the licensing exam
1. Standardization of medical education leads to graduating medical students with the minimal required competences
1. Standardization of medical education leads to loss of creativity and innovation required of a critical thinker physician
2. Strengthens public trust and maintains the reputation of Saudi trained physicians
2. League tables might be potentially detrimental to the morale of staff and students of "weak" medical schools
3. Fair assessment of medical students and selection of candidates into residency program and jobs pool
3. The risk that students might be exam-oriented
4. Provides quality assurance and feedback on curriculum implementation and instructional methods across all medical schools
4. One time assessment is not as comprehensive as ongoing assessments of medical schools
5. Frees medical teachers to teach and do research and leaves the complexity of conducting examinations to the national organization
5. Burdens the students with additional financial commitment
6. Saudi Arabia may act as a regional center for high quality medical licensing examination
The authors would like to thank Dr. Kamran Khan, Oxford University, for providing additional information on the UK educational consultation. The authors would like to thank the following for their help in reading and commenting on the manuscript: Dr. Hind Jamal Al Lail, College of Education, King Abdulaziz University, Jeddah; Dr. Syeda Kauser Ali, Aga Khan University, Pakistan; Dr. Somayah Bajammal, King Fahad General Hospital, Jeddah; and Prof. Mostafa El-Naggar, Jazan University, Jazan.
- Ness D: Changes to the MCC's qualifying examination. CMAJ. 1990, 142: 1178-1180.Google Scholar
- Hill MD: Why another examination?. CMAJ. 1992, 147: 1744.Google Scholar
- Position statement. Licensure, postgraduate training and the Qualifying Examination. Federation of Medical Licensing Authorities of Canada, Association of Canadian Medical Colleges and Medical Council of Canada. CMAJ. 1992, 146: 345-346.
- Kenyon A: The Part II examination: more thoughts. CMAJ. 1994, 150: 12-14.Google Scholar
- Kennedy B: The Part II examination: political exercise or national standard?. CMAJ. 1995, 152: 1183-1184.Google Scholar
- Hallock JA, Melnick DE, Thompson JN: The step 2 clinical skills examination. JAMA. 2006, 295: 1123-1124. 10.1001/jama.295.10.1123-a.View ArticleGoogle Scholar
- Mehta NP, Kramer DB: A Critique of the USMLE clinical skills examination. MedGenMed. 2005, 7 (2): 76.Google Scholar
- Barrett A: National clinical assessments. StudentBMJ. 2005, 13: 340-341.Google Scholar
- Koczwara B, Tattersall MH, Barton MB, Coventry BJ, Dewar JM, Millar JL, et al: Achieving equal standards in medical student education: is a national exit examination the answer?. Med J Aust. 2005, 182: 228-230.Google Scholar
- McNeil HP, Grimm MC: Achieving equal standards in medical student education: is a national exit examination the answer?. Med J Aust. 2005, 183: 166-167.Google Scholar
- Cox K: Achieving equal standards in medical student education: is a national exit examination the answer?. Med J Aust. 2005, 183: 167-168.Google Scholar
- Fletcher K: Nationally assessed. StudentBMJ. 2005, 13: 266.Google Scholar
- Wass V: Ensuring medical students are "fit for purpose". BMJ. 2005, 331: 791-792. 10.1136/bmj.331.7520.791.View ArticleGoogle Scholar
- Patel K: USMLE-style exam. Med Educ. 2001, 35: 306-307. 10.1046/j.1365-2923.2001.0901d.x.View ArticleGoogle Scholar
- General Medical Council Education Committee: Final Report: Strategic Options for Undergraduate Medical Education. Consultation. 2006, [http://www.gmc-uk.org/education/documents/strategic_outcomes_final_report_jun_2006.pdf]Google Scholar
- Mufti MH: Healthcare development strategies in the Kingdom of Saudi Arabia. 2000, New York: Kluwer Academic/PlenumGoogle Scholar
- National Center for Assessment in Higher Education, Saudi Arabia. 2008, [http://www.qiyas.org]
- Alshehri MY: Medical curriculum in saudi medical colleges: current and future perspectives. Ann Saudi Med. 2001, 21: 320-323.Google Scholar
- Khalid BA: The current status of medical education in the Gulf Cooperation Council countries. Ann Saudi Med. 2008, 28: 83-88.View ArticleGoogle Scholar
- Saudi Commission for Health Specialties. 2008, [http://scfhs.org.sa/]
- Zaini R: Saudi Future Doctors. 2008Google Scholar
- Roberts C, Newble D, Jolly B, Reed M, Hampton K: Assuring the quality of high-stakes undergraduate assessments of clinical competence. Med Teach. 2006, 28: 535-543. 10.1080/01421590600711187.View ArticleGoogle Scholar
- Hays R: Teaching and learning in clinical settings. 2006, Abingdon: RadcliffeGoogle Scholar
- Wass V, McGibbon D, Vleuten Van der C: Composite undergraduate clinical examinations: how should the components be combined to maximize reliability?. Med Educ. 2001, 35: 326-330. 10.1046/j.1365-2923.2001.00929.x.View ArticleGoogle Scholar
- Miller GE: The assessment of clinical skills/competence/performance. Acad Med. 1990, 65: S63-S67. 10.1097/00001888-199009000-00045.View ArticleGoogle Scholar
- Amin Z, Chong YS, Khoo HE: Practical guide to medical student assessment. 2006, Singapore; London: World ScientificView ArticleGoogle Scholar
- Norcini JJ: Setting standards on educational tests. Med Educ. 2003, 37: 464-469. 10.1046/j.1365-2923.2003.01495.x.View ArticleGoogle Scholar
- Bloom BS: Taxonomy of educational objectives: the classification of educational goals. Handbook 1: Cognitive domain. 1956, New York: David McKay Co, 1Google Scholar
- National Board of Medical Examiners. Constructing Written Test Questions For the Basic and Clinical Sciences. [http://www.nbme.org/PDF/ItemWriting_2003/2003IWGwhole.pdf]
- Wakeford R, Foulkes J, McManus C, Southgate L: MRCGP pass rate by medical school and region of postgraduate training. Royal College of General Practitioners. BMJ. 1993, 307: 542-543.View ArticleGoogle Scholar
- McManus IC, Elder AT, de Champlain A, Dacre JE, Mollon J, Chis L: Graduates of different UK medical schools show substantial differences in performance on MRCP(UK) Part 1, Part 2 and PACES examinations. BMC Med. 2008, 6: 5-10.1186/1741-7015-6-5.View ArticleGoogle Scholar
- Boursicot KA, Roberts TE, Pell G: Standard setting for clinical competence at graduation from medical school: a comparison of passing scores across five medical schools. Adv Health Sci Educ Theory Pract. 2006, 11: 173-183. 10.1007/s10459-005-5291-8.View ArticleGoogle Scholar
- Boursicot KA, Roberts TE, Pell G: Using borderline methods to compare passing standards for OSCEs at graduation across three medical schools. Med Educ. 2007, 41: 1024-1031. 10.1111/j.1365-2923.2007.02857.x.View ArticleGoogle Scholar
- Fowell SL, Maudsley G, Maguire P, Leinster SJ, Bligh J: Student assessment in undergraduate medical education in the United Kingdom, 1998. Med Educ. 2000, 34 (Suppl 1): 1-49. 10.1046/j.1365-2923.2000.0340s1001.x.View ArticleGoogle Scholar
- Hays R: What can be learnt in clinical settings?. Teaching and learning in clinical settings. 2006, Abingdon: Radcliffe, 109-123.Google Scholar
- Khan KZ, Sear JW: A national online survey of final year medical students' opinion on the General Medical Council's proposed reforms to the undergraduate medical assessment system. Postgrad Med J. 2007, 83: 606-609. 10.1136/pgmj.2007.059105.View ArticleGoogle Scholar
- Schuwirth L: The need for national licensing examinations. Med Educ. 2007, 41: 1022-1023. 10.1111/j.1365-2923.2007.02856.x.View ArticleGoogle Scholar
- Eva KW: Putting the cart before the horse: testing to improve learning. BMJ. 2007, 334: 535-10.1136/bmj.38993.466678.BE.View ArticleGoogle Scholar
- National Commission for Academic Accrediation and Assessment, Saudi Arabia. [http://www.ncaaa.org.sa/]
- Forbes CD: External examiners. A Practical Guide for Medical Teachers. Edited by: Dent JA, Harden RM. 2005, London: Elsevier Churchil Livingstone, 357-362.Google Scholar
- Karuhije HF, Ruff CC: External examiners: international collaboration in nursing education. ABNF J. 2002, 13: 110-113.Google Scholar
- Sheehan J: External examiners: roles and issues. J Adv Nurs. 1994, 20: 943-949. 10.1046/j.1365-2648.1994.20050943.x.View ArticleGoogle Scholar
- The Royal College of Physicians and Surgeons of Canada. The CanMEDS Physician Competency Framework. [http://rcpsc.medical.org/canmeds/index.php]
- Accreditation Council for Graduate Medical Education. ACGME General Competencies. [http://www.acgme.org/outcome/comp/GeneralCompetenciesStandards21307.pdf]
- General Medical Council. Tomorrow's Doctors. [http://www.gmc-uk.org/education/undergraduate/GMC_tomorrows_doctors.pdf]
- Schwarz MR, Wojtczak A: Global minimum essential requirements: a road towards competence-oriented medical education. Med Teach. 2002, 24: 125-129. 10.1080/01421590220120740.View ArticleGoogle Scholar
- Simpson E: The Classification of Educational Objectives, Psychomotor Domain. 1972, Washington, DC: Gryphon HouseGoogle Scholar
- Krathwohl DR, Bloom BS, Masia BB: Taxonomy of educational objectives: the classification of educational goals. Handbook 2: Affective domain. 1964, New York: David McKay Co, 1Google Scholar
- The pre-publication history for this paper can be accessed here:http://www.biomedcentral.com/1472-6920/8/53/prepub
This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (http://creativecommons.org/licenses/by/2.0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.