- Research
- Open access
- Published:
“Design and implementation challenges of massive open online course on research methods for Indian medical postgraduates and teachers –descriptive analysis of inaugural cycle”
BMC Medical Education volume 22, Article number: 369 (2022)
Abstract
Background
In view of the growing popularity, reach and access for Massive Open Online Courses (MOOCs), India’s apex body for medical education, the National Medical Commission (NMC) mandated uniform foundational course on research methods for the medical post graduates (PGs) and faculty members of the medical institutions under NMC as MOOC. This course is a pioneering effort in the field of India’s PG medical education. NMC entrusted Indian Council of Medical Research (ICMR)-National Institute of Epidemiology (NIE) to design and offer the MOOC, named as Basic Course in Biomedical Research (BCBR). We describe the experience of designing and that of implementation challenges in the inaugural cycle of the course.
Methods
The course objective was to inculcate the fundamental concepts in research methods covering epidemiology and biostatistics in the form of video lectures, resource materials, discussion forum, assignments, feedback and a final proctored examination. The course was delivered over 16 weeks through MOOCs platform under the Indian Ministry of Education. We reviewed records, documents and faculty notes and described the course conceptualization, development, design and implementation process. We abstracted information from course portal on enrolment profile of the participants, self-reported course feedback (structured and open-ended on format, lectures and quality of contents), examination registration form, scores obtained in the assignments/examination and that of the participant queries. We described quantitative data using descriptive statistics. We presented the thematic analysis of qualitative data from open-ended questions in the feedback system and that of email interactions.
Results
The inaugural cycle (September-December 2019) was taken by 24,385 participants. Majority, 15,879 (65%) were from medical background. 13,242 (54%) were medical postgraduates and 2637 (11%) were medical teachers. Among the enrolled, 14,720 (60%) cleared the assignments. A total of 11,392 (47%), 8,205 (62%) medical PGs and 896 (34%) faculty members successfully completed the course. Feedback from 1305 (5%) participants had mean score of 4.5/5 (±0.7) for quality of teaching. We faced challenges in customizing the course for medical participants, unawareness among target group, digital illiteracy and the ongoing pandemic.
Conclusions
During the inaugural cycle of the online Basic Course in Biomedical Research course, nearly half of the enrolled participants successfully completed and received the certificate. India’s MOOC for enhancing research capabilities of future medical researchers encountered successes and challenges. Lessons learnt from the inaugural cycle will guide future directions and to address larger issues in terms of sustainability and replication by stakeholders in medical education in India or elsewhere.
Background
Health research is a prerequisite for pioneering advancements in medicine [1]. In developed countries, there is extensive investment to identify and investigate health research priorities. In India, although health research has surged in the last decade, it is clustered within few institutions with excessive focus in specific geographical settings. The dearth of forums to interact and share knowledge, inaccessibility of existing global resources and information asymmetry all pose a threat to the ecosystem of health research [2]. A lack of uniform training programme in research methods is one of the key factors posing a threat to both quantity and quality of research conducted in India [3]. By using online teaching tools such as MOOCs , we can impart knowledge, and skill in research methods.
The way education has been taught and practiced has changed since the advent of digital technology [4]. Recently, Massive Online Open Courses (MOOCs) have seen an increase in their development and implementation across a wide array of sectors of higher education, including health professions education [5, 6]. MOOCs gained popularity due to its flexibility and accessibility to provide content anywhere and anytime with a meaningful learning experience [7]. Studies have shown that MOOCs are highly efficient and effective for learning [8,9,10]. There is enough evidence that e-learning can achieve the same level of effectiveness as traditional didacticism and promote self-directed learning [11].
According to a review of current MOOCs, a major proportion are now provided by institutions in developed countries [12]. Globally, while major emphasis on the student experience is understandable, there appears to be little research on the provider experiences and challenges [13]. Several reviews of MOOC literature have been done in order to identify emerging trends and directions for future research into the characteristics that can help MOOCs achieve long-term success [10, 14, 15]. There have been very few studies on the implementation and uptake of MOOCs, as well as the implications of the adoption of MOOCs in countries like India.
The National Medical Commission (NMC) (erstwhile Medical Council of India), India’s apex body for regulating medical education, recognizes and recommends medical research as an integral part of the post-graduate (PG) medical education. The key objectives of the recommendation are to develop competency in basic concepts of research methodology and epidemiology, critical appraisal of published research and function as an effective leader of a health team engaged in health care, research and training. Despite the large number of theses being conducted by these postgraduates, the quality of their work remains questionable. The capacity of the medical teachers who guide PG theses is also inadequate. Strengthening the teaching of research methods in PG medical curriculum could improve the current status. This huge research machinery offers an opportunity for good research that can influence practice or contribute to health programmes [16, 17].
Keeping the above in context, the NMC decided to introduce a mandatory, uniform, online, foundational course on research methods for the medical PGs and teachers in the country. The NMC identified the National Institute of Epidemiology (ICMR-NIE), an Institute under the Indian Council of Medical Research (ICMR) to develop and deliver an online course on fundamental concepts in research methodology for medical postgraduates and faculty members across the nation [18]. The selection of ICMR-NIE was based on the institute’s prior experience in developing and delivering massive open online courses (MOOCs) on health research through the MOOCs programme of the Indian Ministry of Education, called SWAYAM [‘Study Webs of Active-Learning for Young Aspiring Minds’]. Building on the experience of ICMR-NIE, the present course called Basic Course in Biomedical Research (BCBR) was designed and delivered through the SWAYAM. In the context of limited reports on the experiences and challenges associated with the implementation of MOOCs for improving biomedical research capacity in medical schools from the Indian sub-continent and that of similar countries, we conducted a retrospective study and described the experience of designing and that of implementation challenges in the inaugural cycle of the BCBR.
Methods
The course objective was to inculcate the fundamental concepts in research methods covering epidemiology and biostatistics in the form of video lectures, resource materials, discussion forum, assignments, feedback and a final proctored examination. The course was delivered over 16 weeks through MOOCs platform under the Indian Ministry of Education. The inaugural cycle (September-December 2019) was taken by 24,385.
Study approach
We did a retrospective study to analyse the inaugural cycle of the course based on review of course records and that of the data generated during the implementation process.
Data collection
In order to describe the course conceptualization, development, design and implementation process, we reviewed records, documents and faculty notes.
We accessed the course portal for abstracting data on enrollment profile of the participants, assignment completion with scores, examination registration form and scores in the assignments and performance in the proctored examination. The course collected feedback of the participants on course contents, structure, faculty, lecture presentation and quality of contents through a 5-point Likert scale ranging from “strongly agree” to “strongly disagree”. We accessed the feedback data for every module and that of overall experience at the end of the course. We reviewed emails sent by course participants regarding queries related to administrative and technical aspects.
Additionally, as part of the course feedback, for each of the module, we collected response to three open-ended questions on what the participant liked, inputs and suggestions to improve and key learning points. We abstracted qualitative data from these open-ended questions, from discussion forum and that of email queries and interactions of the participants.
Data analysis
Based on the review of the documents and notes, we identified the core components of the course, in terms of structure, content and the implementation process of the course. We enlisted the challenges, barriers and facilitators faced in the inaugural cycle of the course.
The quantitative data was used to describe the characteristics of the participants by age, educational background and profession. We plotted number of Indian participants by their Indian State. We calculated percentage assignment submission, mean and standard deviation (SD) of scores of the assignments by lecture and pass percentage. Participants who obtained at least 50% in all the assignments put together were eligible to register for the final proctored examination. We calculated descriptive statistics for participants’ feedback in various domains. We calculated the mean score and standard deviation for the Likert type questions.
We did analyze manually the contents of the qualitative data from the feedback system and that of email interactions. Codes were identified which were then categorized into emergent themes by two authors (ER and SC) independently. Any difference between them was resolved by RA through independent review. All of them were trained in qualitative research. In addition, a word cloud was created for conceptual analysis for the most commonly occurring word in the verbatim texts.
Results
Conceptualization, development, design and implementation process of the course
Learning objectives of the course
The objective of the course was to explain fundamental concepts in epidemiology and biostatistics. Inaugural cycle of BCBR course (September-December 2019, cycle 1) was conducted for 16 weeks by the ICMR-NIE and was delivered through one of the national coordinators of the SWAYAM, namely NPTEL (National Programme on Technology Enhanced Learning) located at the Indian Institute of Technology-Madras, Chennai.
Organizational structure and functions
At the national level, the course coordination committee established by the NMC was monitoring the progress of the course. At the Institute level, the course is coordinated by a core team under the supervision of the Director of ICMR-NIE. The Indian Council of Medical Research (ICMR) funded the initiative. The course is supported by a group of teaching and non-teaching staff of ICMR. The team has been divided into administrative and academic wings. The administrative wing is responsible for handling the issues related to the enrolment and registration of the course participants with a dedicated helpline number and an email account. The academic wing facilitates subject matter query resolution and updating the academic content
Course development team
The NMC formed an expert committee to meet the vision of the “Postgraduate Medical Education (Amendment) Regulations, 2019” to instill a spirit of scientific inquiry, orient the principles of research methodology and epidemiology by the medical postgraduates [19]. ICMR-NIE's multi-disciplinary team of epidemiologists, biostatisticians and public health specialists developed the curriculum contents of BCBR (Additional table 1) according to the competency matrix given by NMC for research methods. This was designed as a self-paced MOOC, as per the SWAYAM guidelines [20]. As per the official notification of NMC dated 13 December 2019, medical PGs had to mandatorily complete the BCBR.
Course contents
The recommended format follows the four-quadrant instructional design which includes: e-tutorial (course videos), e-contents (reading materials, lecture handouts, text transcripts), the discussion forum and assessment (assignments and proctored examination). Accordingly, the course included 23 lectures with an average duration of 20 minutes for each lecture and delivered across 16 weeks. The course covered the topics - conceptualizing a research study, epidemiological considerations and bio-statistical considerations in designing a research study, planning and conducting a research study, writing a research protocol and publication ethics. A total of 23 lectures were covered under these topics by experts in the field of biostatistics, epidemiology, public health, and research methods from ICMR-NIE.
Course implementation
Medical colleges were officially notified regarding the site and enrolment process by the NMC well in advance. The participants were notified through their medical colleges to enroll until 1st December 2019 on the course website or on the SWAYAM mobile application. The enrollment was free of cost. On the course page, the administrative wing regularly posted course-related announcements. Enrolled participants received email and text messages reminders on due dates. They were also able to make inquiries through the helpline.
Upon enrolment, course participants were able to access the course content including the lecture videos, handouts of the slides, transcripts and the reference links. Additionally, the course page provided assignments after each lecture, announcements and frequently asked questions regarding the course process. For academic clarifications, a separate section namely ‘discussion forum’ was created where the participants could post lecture related queries to the teaching assistants (TA). The TAs resolved the queries within two working days.
Assessment and certification
The BCBR course offered both formative as well as a summative assessment to determine eligibility for certification. The assessment strategy adopted was in alignment with the learning objectives of the BCBR. For the formative assessment, the participants had to complete the online auto-graded assignments after every lecture. Each assignment consisted of ten multiple-choice questions. For each lecture, the academic team prepared a set of questions after multiple rounds of internal revisions. The course participants could submit the assignments any number of times before the deadline and the one submitted last was considered for scoring. A minimum of 50% score in the assignment was required to be eligible for final examination registration. Those scoring <50% were prompted to redo the assignments in the next BCBR cycle with the same login credentials.
For summative assessment, an in-person proctored computer based examination was to be conducted at 138 designated centers across the country. Eligible participants were directed to register for the proctored examination by paying a nominal fee using the registration link available on the course page. We initiated the registration process three months in advance of the scheduled examination dates. Six sets of question papers each consisting of a hundred multiple choice questions were prepared by a team of experts from ICMR-NIE. We had scheduled the exams for three days in March and April 2020 with two slots per day. However, the exams could not be conducted due to the ongoing pandemic.
A course participant was considered ‘pass’ and ‘eligible’ for a verifiable e-certificate only if s/he scored at least 50% on an average in the assignment score and final examination score separately. The final marks were communicated to the participants within four weeks from the date of completion of the proctored examination. In the event of scoring less than 50 percent in the proctored examination, the participants had to register again in the next BCBR cycle for the proctored examination with the same login credentials without re-submitting the assignments.
Quality assurance
Quality assurance mechanism was built into the design and conduct of the course. Through the ‘participant feedback mechanism’ participants were able to give their feedback after the completion of each lecture via a link provided below each video. Further inputs and suggestions from participants to improve the quality of course and key learning points from the sessions were documented. In the discussion forum, solutions to the academic queries were formulated by a team of experts including teaching assistants and course consultants. In addition to this, the finalization of the proctored examination was undertaken with strict adherence to the rules laid down by the NPTEL. An extensive technical review of the questions was undertaken by the teams from ICMR-NIE and NPTEL for the finalization of the six sets of encrypted question papers. Moreover, periodic interim meetings were organized between the course coordination committee, course faculty and consultants discussing the progress and challenges faced and the solutions.
Description of the course participants
Enrolment
A total of 24,385 participants from 38 countries enrolled during cycle 1. Majority (n=15906, 65%) were aged 21-30 years. Out of the total enrolled participants, 24,182 (99.2%) were from India. (Additional Table 2) Within India, majority of the participants were from Tamil Nadu and Maharashtra (12% each) states, followed by Karnataka (11%), and Andhra Pradesh (8%) (Fig. 1).
Among the participants, 13,242 (54%) were PGs pursuing MS or MD and 2,637 (11%) were faculty members. Among the medical PGs, 9,213 (69.6%) were pursuing MD and 4029 (30.4%) were pursuing MS. The remaining 8,506 (35%) participants were from outside the target group and included participants who were doing medical diploma, Master of Public Health (MPH) or employed elsewhere. (Additional Table 2)
Among the total enrolled, 14,720 (60%) had passed the assignments and qualified to register for the proctored exams. Of the medical PGs enrolled, 10,726 (81%) and among the faculty enrolled, 1055 (40%) passed the assignments and were eligible to register for the proctored examination. Among the total enrolled, over all 11,392 (47%), medical PGs 8205 (62%) and faculty 896 (34%) registered for the proctored examination. Due to the COVID-19 pandemic, in-person proctored exams could not be conducted. Therefore, the NMC decided to issue pass certificates to all those who had qualified from the assignments and were registered for the proctored examination.
In the analysis by lectures, among the faculty members, the frequency of completion gradually declined from lecture 1 to lecture 23. 38% of the faculty members completed all the assignments. Among those who submitted the assignments, the pass percentage varied from 97% (for lecture 5: Descriptive study designs) to 99.6% (for lecture 3: Literature review). Among PGs, the assignment completion rate varied from 77% to 82%, gradually declined from lecture 1 to lecture 23, and 77% completed all the assignments. Among those PGs who submitted, the pass percentage varied from 99.9% (lecture 16: Principles of data collection) to 99% (lecture 12: Sample size). When taking the mean score of the lectures into account, the five lowest-scoring lectures for both faculty members and PGs were lectures involving developing tools or bio statistical considerations. (Table 1)
A total of 1,845 queries were posted by the participants in the discussion forum which included both academic and administration related queries. There were approximately 348 (19%) academic queries and 1497 (81%) administrative queries which included 1,151 (62%) enrollment and technical, 112 assignment and eligibility related and 234 examination related queries.
Feedback from participants
A total of 1,305 (5%) participants responded with feedback. The mean score (SD) of overall quality of teaching sessions was 4.5 (0.7). (Additional table 3) Majority of the course related technical queries were regarding accessing the course materials and registration in the examination. We implemented a number of solutions for these queries (Additional table 4). Most of the participants expressed their satisfaction about the content, clarity, explanation, presentation and the way the speakers delivered the lecture. A few suggested adding further explanation in certain topics and hands on training in biostatistics, specifically, sampling methods, sample size calculation, data management software and calculation of measures of association. For most of the lectures the participants suggested addition of more examples, especially with screenshots, graphics, animation and clinical scenarios. (Table 2, Additional Figure 1)
Challenges faced
Implementation challenges
As with all major rollouts, the BCBR programme faced several challenges. These challenges can be organized into administrative, technical and participant related challenges. As described, the BCBR course depends on a smooth coordination between three major organizations. This resulted in a few delays in communications between them. In our course, decision making had to go through layers of communications at various levels. Evidence showed that inter-institutional collaborative efforts often impede the course development [21]. Despite these delays, the course was launched on the promised time and successfully started recruiting participants. Another administrative challenge was a lower than expected enrolment of first year postgraduates who were the intended participants for the course. It was realized later that the many PGs were unaware about the course. This was followed by widespread dissemination activities, where information was sent through proper channel to the college deans for dissemination within the college. Despite such activities, the enrolment was poor. Previous research suggested that recruitment of participants often reported as low when a course is initially launched [21]. This was alike to our experience in the course enrollment. There were some delays in responding to the participants. This delay took place because of two reasons. First, participants sometimes asked questions beyond the scope of the lectures. However, we earnestly addressed them with few exceptions. Second, most of the faculty members of BCBR are also researchers in the ICMR-NIE. Hence, there were delays in resolving the participant queries. Overall, most of the queries were answered within 48 hours. When it came to the stage of assignment completion and examination registration, there were a lot of dropouts.
The SWAYAM-NPTEL have been offering several science and technology courses. Offering this MOOC in customized way to a medical group under another authority was a challenge. Few participants faced difficulty in enrollment, accessing and submitting assignments. In other words, digital non-literacy was a major course hindrance factor. A few participants who decided to pay the examination registration fees on the last day of the registration faced difficulties in completing the payment.
Pandemic related challenges
Since most of our participants were doctors and were actively engaged in the Coronavirus disease 2019 (COVID-19) pandemic duties they could not complete the assignments/course. Some of the doctors were reassigned for COVID-19 duty and could not continue course. Requests for cancelling and changing of examination centres were placed by several participants. The examination which was scheduled in March/April 2020 was postponed and then finally cancelled.
Participant side challenges
Apart from the digital literacy challenges faced by the participants, there were issues related to internet connectivity in some areas of the country. Participants experienced problems in accessing the course contents and submitting the assignments. In some cases, the assignment submission did not register with the android app. For developing country like India technological infrastructure could be a major factor for successful retention of MOOCs participants [22].
To resolve the issue the BCBR team posted several announcements on the course page, mailed and texted the course participants individually. However, some of these technical challenges were beyond the scope of the ICMR-NIE to resolve and the NPTEL team had to be intimated regarding these issues. Therefore, maintaining the chain of communication between several stakeholders delayed solving of some issues.
Discussion
In order to improve the rigor of teaching health research among medical postgraduates and the faculty members, India’s apex medical education regulatory body entrusted launching of MOOC on research methods through ICMR-National Institute of Epidemiology. Towards achieving the same, with full support from the ICMR, we designed and implemented a MOOC on research methods. We share our experience from the inaugural cycle in terms of the processes involved, indicators achieved, and challenges faced. The course participants sounded positive about the conduct of the course but also provided suggestions for improvement.
It is truly a one-of-kind experiment in the history of Indian medical education to introduce a mandatory and completely online research course managed and run by an external agency like the ICMR. It shows the willingness of the medical education regulatory agency to upgrade and adapt to the changing needs of the medical postgraduate education. This is also a step in the direction to improve the quality of research performed by young scientists and their mentors.
Online teaching methods have been shown to be no different than face-to-face teaching methods at the school level. A similar situation is also likely true for adult learning, especially for medical subject matter [23]. Several online teaching courses for nurses, nursing students and practicing doctors have shown good effectiveness when compared to face-to-face teaching [24,25,26,27,28]. A few have shown that online only courses have shown no significant difference [29, 30]. One particular evaluation of an interactive for teaching hypothesis testing concepts was shown to be highly effective [31]. Although these studies point to the fact that online medium of instruction may be beneficial for teaching research methodology to a group of medical personnel, a formal randomized controlled study may be required to prove this conclusively [32].
Similar to our observation dropouts was noticed for several MOOCs organized by university of Virginia [33]. They found a negative relationship between procrastination and achievement in MOOCs. Unlike traditional classroom teaching MOOC enrollment needs fewer requirements for eligibility. The intent for enrollment may reflect a trial and error approach since the cost for initiation of most MOOC’s is small. Thus drop out often tends to be high [34]. In addition, similar to our observation various MOOC’s have reported participant challenges such as digital incompetence and unsupportive environment that could restrain participant’s MOOC experience [35, 36].
Planning for subsequent cycles of the BCBR will incorporate the findings discussed above. Among the many tasks to be undertaken, steps to increase the enrollment coverage, update course contents to reflect recent changes and provide additional relevant reading materials to accommodate the participant feedback are primary. A major step towards developing a college/regional level mentorship plan along the lines of the Medical Education Technology programme of the MCI (now, NMC) is also envisioned. These mentors will be readily available at the college level to clarify learner queries and act as a liaison with the coordination team at ICMR-NIE.
With the experience gained in the first cycle, we were able to introduce certain innovations that provided a richer learning experience to the participants. Participant feedback was instrumental in designing these modifications. Some of the planned modifications for future cycles are lecture specific example accompaniments, Frequently Asked Questions documents, reading materials that are open source and simple enough for a beginner and Live webcast session for real time interaction and query solving. From the administrative perspective, we plan to automate the process of query management by having a chatbot on our website and allowing human interactions for rare and uncommon queries.
In this article, we have provided a framework and a roadmap for anyone who is willing to launch a similar campaign at a national or even a regional level. We hope our experiences will benefit the larger medical education community in designing and delivering such health research MOOCs .
Limitations
A common enrolment form is used for fetching the details on the SWAYAM portal for all the courses covering engineering, basic sciences, and selected humanities and social sciences subjects. As a result, we could not capture few enrolment details of participants such as the discipline of the medical post graduate studies, institute name, year of enrolment of PG degree. There was paucity of feedback data as we kept it optional for the participants.
Conclusions
During the inaugural cycle of the online Basic Course in Biomedical Research course, nearly half of the enrolled participants successfully completed and received the certificate. We concluded that India’s MOOC for enhancing capacity in the basics of biomedical research methods among medical PGs and faculty members was a challenging task. The lessons learnt from the inaugural cycle could help in better delivery of the course in the subsequent cycles. Further, the stakeholders need to address larger issues in terms of sustainability and replication in offering similar MOOCs in medical education in India or elsewhere.
Recommendations
Designing and implementing a MOOC on research methods at the national level is fraught with challenges. Taking into account expected hurdles during the design and planning stage may lead to a seamless experience to the course takers. Technological proficiency of participants with medical background will require intensive training and handholding during the implementation. Experiences from other research methodology related MOOCs need to be reported widely and further studies must be undertaken to enable better implementation and knowledge transfer to the course participants.
Availability of data and materials
All data generated or analysed during this study are included in this published article [and its supplementary information files]. The datasets used and/or analysed during the current study available from the corresponding author on reasonable request.
References
Institute of Medicine (US) Committee on Health Research and the Privacy of Health Information: The HIPAA Privacy Rule. Beyond the HIPAA Privacy Rule: Enhancing Privacy, Improving Health Through Research [Internet]. Nass SJ, Levit LA, Gostin LO, editors. Washington (DC): National Academies Press (US); 2009 [cited 2020 Oct 7]. (The National Academies Collection: Reports funded by National Institutes of Health). Available from: http://www.ncbi.nlm.nih.gov/books/NBK9578/
Kalita A, Shinde S, Patel V. Public health research in India in the new millennium: A bibliometric analysis. Glob Health Action. 2015;8:1–10.
Nagoba B, Davane M. Current Status of Medical Research in India- Where are we ? Walawalkar Int Med J. 2017;4(1):71–6.
Sánchez J, Salinas A, Contreras D, Meyer E. Does the New Digital Generation of Learners Exist? A Qualitative Study: New Digital Generation of Learners. Br J Educ Technol. 2011;42(4):543–56.
Chauhan A. Massive Open Online Courses (MOOCS): Emerging Trends in Assessment and Accreditation. Digit Educ Rev. 2014;25:7–17.
Liyanagunawardena TR, Williams SA. Massive Open Online Courses on Health and Medicine: Review. J Med Internet Res. 2014;16(8):e191.
Alhazzani N. MOOC’s impact on higher education. Soc Sci Humanit. 2020;2(1):100030.
Keramidas CG. Are Undergraduate Students Ready for Online Learning? A Comparison of Online and Face-to-Face Sections of a Course. Rural Spec Educ Q. 2012;31(4):25–32.
Hew KF, Cheung WS. Students’ and instructors’ use of massive open online courses (MOOCs): Motivations and challenges. Educ Res Rev. 2014;12:45–58.
Veletsianos G, Shepherdson P. A Systematic Analysis and Synthesis of the Empirical MOOC Literature Published in 2013–2015. Int Rev Res Open Distrib Learn [Internet]. 2016 Mar 1 [cited 2022 Feb 3];17(2). Available from: http://www.irrodl.org/index.php/irrodl/article/view/2448
Ruiz JG, Mintzer MJ, Leipzig RM. The impact of E-learning in medical education. Acad Med J Assoc Am Med Coll. 2006;81(3):207–12.
Ayoub A, Amin R, Wani ZA. Contribution of developed countries towards MOOCs: an exploration and assessment from a representative platform Coursera. Asian Assoc Open Univ J. 2020;15(2):251–62.
Pouezevara S, Horn L. MOOCs and Online Education: Exploring the Potential for International Educational Development [Internet]. RTI Press; 2016 Mar [cited 2022 Feb 3]. Available from: http://www.rti.org/publication/moocs-and-online-education-exploring-potential-international-educational-development
R Deng P Benckendorff What are the key themes associated with the positive learning experience in MOOCs? An empirical investigation of learners’ ratings and reviews. Int J Educ Technol High Educ [Internet]. 2021 [cited 2022 Feb 8];18(1):9 Available from: https://doi.org/10.1186/s41239-021-00244-3
Deng R, Benckendorff P, Gannaway D. Understanding Learning and Teaching in MOOCs from the Perspectives of Students and Instructors: A Review of Literature from 2014 to 2016. In: Delgado Kloos C, Jermann P, Pérez-Sanagustín M, Seaton DT, White S, editors. Digital Education: Out to the World and Back to the Campus. Cham: Springer International Publishing; 2017. p. 176–81. (Lecture Notes in Computer Science).
Agarwal J, Kulkarni M, Mohan U, Das V, Singh V, Das S, et al. IndiaClen recommendations for improving postgraduate medical research & publication. Clin Epidemiol Glob Health. 2013;1(2):54–7.
Pillai RK, Mehendale S, Awasthi S, Ravi VG. The significance of research in post-graduate education and ways to facilitate. Clin Epidemiol Glob Health. 2015;3(2):1–5.
ICMR-National Institute of Epidemiology. Basic Course in Bio-medical Research. Chennai; 2019.
Medical Council of India. Medical Council of India Postgraduate Medical Education Regulations, 2000. India: Medical Education. New Delhi; 2018.
Government of India, Ministry of Human Resource Development D of HE. Revised Guidelines for developing Online Courses for SWAYAM. New Delhi, India: Government of India, Ministry of Human Resource Development; 2018.
Alexander JW, Polyakova-Norwood V, Johnston LW, Christensen P, Loquist RS. Collaborative Development and Evaluation of an Online Nursing Course. Distance Educ. 2003;24(1):41–56.
Castaño-Muñoz J, Kreijns K, Kalz M, Punie Y. Does digital competence and occupational setting influence MOOC participation? Evidence from a cross-course survey. J Comput High Educ. 2017;29(1):28–46.
Means B, Toyama Y, Murphy R, Bakia M, Jones K. Evaluation of Evidence-Based Practices in Online Learning: A Meta-Analysis and Review of Online Learning Studies. U.S. Department of Education Office of Planning, Evaluation, and Policy Development. Washington D.C; 2010.
Turner MK, Simon SR, Facemyer KC, Newhall LM, Veach TL. Web-based learning versus standardized patients for teaching clinical diagnosis: A randomized, controlled, crossover trial. Teach Learn Med. 2006;18(3):208–14.
Beeckman D, Schoonhoven L, Boucqué H, Van Maele G, Defloor T. Pressure ulcers: E-learning to improve classification by nurses and nursing students. J Clin Nurs. 2008;17(13):1697–707.
Bello G, Pennisi MA, Maviglia R, Maggiore SM, Bocci MG, Montini L, et al. Online vs live methods for teaching difficult airway management to anesthesiology residents. Intensive Care Med. 2005;31(4):547–52.
Benjamin SE, Tate DF, Bangdiwala SI, Neelon BH, Ammerman AS, Dodds JM, et al. Preparing child care health consultants to address childhood overweight: A randomized controlled trial comparing web to in-person training. Matern Child Health J. 2008;12(5):662–9.
Hugenholtz NIR, de Croon EM, Smits PB, van Dijk FJH, Nieuwenhuijsen K. Effectiveness of e-learning in continuing medical education for occupational physicians. Occup Med Oxf Engl. 2008;58(5):370–2.
Harris JM, Elliott TE, Davis BE, Chabal C, Fulginiti JV, Fine PG. Educating generalist physicians about chronic pain: Live experts and online education can provide durable benefits. Pain Med. 2008;9(5):555–63.
Jang KS, Hwang SY, Park SJ, Kim YM, Kim MJ. Effects of a Web-based teaching method on undergraduate nursing students’ learning of electrocardiography. J Nurs Educ. 2005;44(1):35–9.
Aberson CL, Berger DE, Healy MR, Romero VL. Evaluation of an Interactive Tutorial for Teaching Hypothesis Testing Concepts. Teach Psychol. 2003;30(1):75–8.
Holmes CM, Reid C. A Comparison Study of On-campus and Online Learning Outcomes for a Research Methods Course. J Couns Prep Superv. 2017;9(2). Available from: https://digitalcommons.sacredheart.edu/jcps/vol9/iss2/15/.
Paul Diver, Ignacio Martinez. MOOCs as a massive research laboratory: opportunities and challenges: Distance Education: Vol 36, No 1 [Internet]. [cited 2020 Oct 6]. Available from: https://www.tandfonline.com/doi/abs/https://doi.org/10.1080/01587919.2015.1019968
Hoxby CM. The Economics of Online Postsecondary Education: MOOCs, Nonselective Education, and Highly Selective Education [Internet]. National Bureau of Economic Research; 2014 Jan [cited 2020 Oct 7]. (Working Paper Series). Report No.: 19816. Available from: http://www.nber.org/papers/w19816
Chauhan J, Goel A. An Overview of MOOC in India. Seventh Sense Researcg Group. 2017;49(2):111–20.
Stracke C, Tan E, Teixeira A, Pinto M, Vassiliadis B, Kameas A, et al. Gap between MOOC Designers’ and MOOC Learners’ Perspectives on Interaction and Experiences in MOOCs: Findings from the Global MOOC Quality Survey. In 2018. p. 1–5.
Acknowledgements
The authors would like to acknowledge the support provided by the senior management of ICMR (New Delhi), the NMC, Dr. Sanjay Mehendale (former Additional Director General-ICMR) and Dr. Sumit Aggarwal (Scientist E, ICMR). The authors would also like to acknowledge the support and assistance provided by the teaching assistants; Dr D. Bella Devaleenal (Scientist C) and Dr V. V. Banurekha (Scientist E), at the ICMR-National Institute for Research in Tuberculosis, Chennai, Dr V. Saravana Kumar (Scientist C) and Dr Jeromie Wesley Vivian Thangaraj (Scientist C), at the ICMR-NIE, Chennai and the assistance provided by Mr. Jeyakumar A, Mr. Harshal Sonekar, Ms. Jeen Melfha M. and Mr. Balusamy M (ICMR-NIE technical staff), P Anitha (Personal Assistant) and I. Arockia Alexzander, (Administrative Assistant) for the day-to-day running of the course.
Funding
The Indian Council of Medical Research, Headquarters, New-Delhi funded the online course (BCBR). However, this particular research was non-funded.
Author information
Authors and Affiliations
Contributions
PM, TB, PG and MM conceptualized the educational model. DB, ER, MV, SAR, SC and US were involved in the data collection, analysis and writing of the first draft of the manuscript. All the authors gave critical inputs to finalize the manuscript and approved the final version of the manuscript.
Corresponding author
Ethics declarations
Ethics approval and consent to participate
All methods were carried out in accordance with relevant guidelines and regulations. The Institutional Human Ethics Committee at ICMR-National Institute of Epidemiology exempted this research from review (Reference number: NIE/IHEC/202107-05) since it was considered as an evaluation for online teaching/training processes educational processes. The data used for this study did not have linked identifiers.
Consent for publication
Not applicable
Competing interests
The authors declare no competing interests.
Additional information
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Supplementary Information
Additional file 1: Figure 1.
Qualitative analysis of feedback received from the participants in a massive open online course on health researchin India, 2019-2020. Table 1. Curriculumof Basic Course in Biomedical Research that was aligned with the competencyframework on research methods for medical post-graduates by the NationalMedical Commission. Table 2. Profile of participants ina massive open online course on health research in India, 2019-2020 (n=24,385). Table 3. Participants’ feedback in a massive open online course on health research in India, 2019-2020. Table 4.Verbatim examples of technical queries received from the participants in a massive open online course on health research in India,2019-2020
Rights and permissions
Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.
About this article
Cite this article
Ponnaiah, M., Bhatnagar, T., Ganeshkumar, P. et al. “Design and implementation challenges of massive open online course on research methods for Indian medical postgraduates and teachers –descriptive analysis of inaugural cycle”. BMC Med Educ 22, 369 (2022). https://doi.org/10.1186/s12909-022-03423-6
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12909-022-03423-6