SHEE Journal No. 1 2024 (Full Version)
In this issue, the team has focused on the theme: "Multiple Mini-Interview (MMI) in Health Science Schools". The aim is to help educators understand the effective use of MMI, leading to a more efficient selection process that aligns with the program's objectives.
We have invited several expert faculty members with extensive experience in administering MMIs to share key insights on conducting these interviews. Topics covered include:
- Fundamentals of MMI: Understanding the principles and purpose behind MMI.
- Designing an Effective MMI: Tailoring MMI to suit the specific needs of health science education.
- Managing the MMI Process: Best practices for organizing and conducting MMIs efficiently.
- Leveraging Technology for MMI: How technology can support and streamline the MMI process.
This issue provides valuable guidance for educators involved in MMI to ensure the selection process is both effective and aligned with the desired educational outcomes.
Author: SHEE
Downloads: 2,138
Issue1/2024-01 Executive talk
Part of the process for selecting students to enter health sciences schools involves an interview. The traditional interview, where the interviewers have the freedom to ask different questions each time, allows candidates to meet only a few interviewers, and the assessment is conducted by different sets of evaluators. With broad scoring criteria that allow interviewers to use their discretion in judgment, this often leads to unreliable interview results. As a result, many institutions are reluctant to use interview scores as a criterion for student selection.
Author: Assoc. Prof. Dr. Cherdsak Iramaneerat
Downloads: 87
Issue1/2024-02 Concepts of MMI
Author: Assoc. Prof. Kasana Raksamani, M.D.
Downloads: 81
Issue1/2024-03 An effective design for Multiple Mini Interviews (MMI)
The management of Multiple Mini-Interviews (MMI) is an effective method for selecting individuals for admission or training. However, to achieve the intended objectives, interview organizers must plan the process appropriately to ensure the selection is valid and aligns with the intended goals. This means ensuring the validity of the assessment, which refers to the accuracy of the measurement.
To design an MMI interview as a valid assessment according to educational and psychological measurement standards (as outlined by the American Educational Research Association, American Psychological Association, and National Council on Measurement in Education, 2014), the process should involve examining evidence across five dimensions: Content, Response Process, Internal Structure, Relations to Other Variables, and Consequences.
Author: Assoc. Prof. Dr. Cherdsak Iramaneerat
Downloads: 80
Issue1/2024-04 Managing a Multiple Mini-Interview (MMI)
The management of the Multiple Mini-Interview (MMI) can be divided into four areas: overall station management, preparation within each station, management related to the interviewers, and management of the examinees.
Overall Station Management
When preparing for an MMI, organizers should consider the number of applicants, the number of stations, the time allocated for each station, and the available resources/limitations related to both the interviewers and the physical space. For example, when organizing an MMI with 5 questions and the facility can accommodate a maximum of 3 groups at once, each group with 3 rounds, if 50 candidates are scheduled for interviews, the station layout should include 1 resting station per group. Therefore, with 6 stations x 3 groups x 3 rounds = 54 candidates in total. The applicants should be divided into three rounds of 18, 16, and 16 people, respectively. Ensuring that all applicants in the first round visit every station helps mitigate risks in management, as the first round is more likely to encounter unforeseen issues. For the second and third rounds, prepare signage for the candidates (2 candidates per round) to communicate with the interviewers at each station, indicating "There are no candidates after this one."
Author: Asst. Prof. Danai Wangsaturaka, M.D., Ph.D.
Downloads: 81
Issue1/2024-05 Virtual MMI and the Use of Technology to Support MMI Implementation
In the past, Multiple Mini-Interviews (MMI) were typically conducted on-site, where both interviewers and interviewees had to travel to the same location. This could pose challenges in situations where either the interviewer or the interviewee is unable to travel, such as during a pandemic. However, the widespread availability of teleconferencing technology, including infrastructure, hardware, and software, has enabled MMIs to be conducted virtually.
Author: Sira Vachatimanont, M.D., Thitiphan Srikulmontree, M.D.
Downloads: 421
Issue1/2024-07 เชิด-ชู
Hello to all our readers. Welcome back to the article "Honor and Recognition." Today, we are honored to feature Prof. Emeritus Dr. Pirom Kamolratanakul, the President of Chulalongkorn University, an outstanding medical educator who was awarded the "National Medical Educator" title in 2023 by the Medical Council of Thailand. In this article, we will share his thoughts and lessons throughout his career as a medical educator to inspire all our readers who aspire to become medical teachers.
Author: SHEE
Downloads: 78
Issue1/2024-08 สับ สรรพ ศัพท์
Construct Validity
Construct validity refers to the extent to which a measurement tool accurately measures the concept it is intended to measure, based on theoretical foundations.
Rater Errors
Rater errors are systematic errors made by evaluators when observing and judging others. These errors can negatively impact the validity and reliability of the evaluation scores and may influence the decisions made regarding the examinee's academic outcomes. If such errors occur in high-stakes examinations, such as entrance exams or certification exams for specialized medical fields, they can have significant consequences on the examinee's future.
Author: Pimmada Samukchan, M.D.
Downloads: 79
Issue1/2024-09 Education movement: Implementing Multiple-Mini Interview in Thai health science schools
From the content provided in this journal issue, readers should now have a better understanding of the fundamental principles behind the selection process using Multiple Mini Interviews (MMI) and recognize the advantages of this process, which is likely to lead to a more suitable selection of candidates for educational programs compared to traditional interviews. In this article, I will propose ways to effectively apply MMI in the context of selecting students for health science programs in Thailand. These suggestions are based on academic data combined with the author's personal experience, and I will outline five key processes as follows.
Author: Assoc. Prof. Dr. Cherdsak Iramaneerat
Downloads: 75
Issue1/2024-10 SHEE Sharing
In this article, the author has chosen the article Comparison of the Multiple Mini-Interview and the Traditional Interview in Medical School Admission: Lessons Learned Using a Hybrid Model at One Institution by Madeline Abrams and colleagues, published in Academic Medicine in 2023, to present to all readers. This study was conducted at the Donald and Barbara Zucker School of Medicine (Zucker SOM) in New York, USA, and utilized admission interview data from the past three years: Traditional Interview (TI) in 2017-2018, and the hybrid interview model (TI-MMI), which combined TI with MMI, in 2018-2019 and 2019-2020. The study aimed to investigate the relationship between the scores and the differences from the data obtained through TI and MMI interviews, as well as whether the hybrid interview model could lead to a more diverse pool of applicants.
Author: Kanin Dardtanim, M.D
Downloads: 84
Issue1/2024-11 SHEE Research การตรวจสอบสามเส้า... หัวใจของการตรวจสอบข้อมูลวิจัยเชิงคุณภาพ
Have you ever heard the saying "Don’t judge a book by its cover"? If translated literally, it means "Don’t judge a book by its cover (it’s better to look at the content inside the book)." Qualitative research faces a similar problem. Researchers who are more familiar with quantitative research, where statistics are used to make judgments, may hesitate when encountering qualitative data analysis methods, which they are not familiar with. They may question whether the research is reliable or if the results could be biased by the researcher. As someone who is familiar with both quantitative and qualitative research, I can tell you that yes, qualitative data analysis methods do carry the risk of researcher bias, which can impact the research outcomes. However, qualitative researchers are well aware of this risk and have strategies in place to address it. Today, I would like to introduce you to the methods currently used to verify the data in qualitative research (including those I recommend). I’m confident that once you understand these methods, you will see that qualitative research, though not based on numbers or statistics, can still be reliable. Please rest assured and feel free to apply these methods in your work.
Author: Dr. Kiattiyot Kuldetchaichan
Downloads: 107
Issue1/2024-12 Click&Go with technology : Edpuzzle
Edpuzzle is a web application that allows instructors to create interactive videos. Instructors can record their lessons and insert questions into the video, including multiple-choice questions, open-ended questions, and notes. It also allows the upload of videos in formats such as AVI, MOV, and MP4, as well as the option to use video links from YouTube. Additionally, Edpuzzle supports setting the number of attempts a learner can make and provides a report of the learner’s score in CSV format. With the free version of Edpuzzle, users can store up to 20 videos per account and upload videos no larger than 1 GB per video. Instructors can use Edpuzzle to create teaching video materials, such as videos introducing MMI exam guidelines or instructional videos for candidates to review on their own in advance. Now that we’ve discussed this, let’s get started on creating!
Author: Assist. Prof. Dr. Vorawan Vanicharoenchai
Downloads: 86
Issue1/2024-13 SHEE Podcast
The Siriraj Health science Education Excellence center (SHEE) has created the SHEE Podcast, which covers interesting topics in the field of health sciences through casual discussions. The podcast is designed to make the content more accessible to everyone, with new episodes released on the 2nd and 4th Fridays of each month at 8:00 PM. As of now, six series have been released:
Series 1: Disruptive Education—If you don't move or adapt, you won't keep up.
Series 2: Successful Teaching Strategies—Secrets (not) to Elevate Your Teaching Success.
Series 3: Effective Assessment Methods—Educational Assessment for Effective Learner Development.
Series 4: Enhancing Transferable Skills – Elevating well-rounded skills to develop expertise beyond knowledge.
Series 5: Creating Active Learning Strategies – Creating proactive learning and igniting curiosity in students.
Series 6: Mastering Performance Assessment – Effective evaluation of practical skills to measure learner competence.