Case-based MCQ generator: A custom ChatGPT based on published prompts in the literature for automatic item generation.

Kıyak Y. S., Kononowicz A. A.

Medical teacher, cilt.46, sa.8, ss.1018-1020, 2024 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Cilt numarası: 46 Sayı: 8
  • Basım Tarihi: 2024
  • Doi Numarası: 10.1080/0142159x.2024.2314723
  • Dergi Adı: Medical teacher
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Academic Search Premier, ASSIA, CINAHL, EBSCO Education Source, Educational research abstracts (ERA), ERIC (Education Resources Information Center), Public Affairs Index
  • Sayfa Sayıları: ss.1018-1020
  • Anahtar Kelimeler: artificial intelligence, automatic item generation, ChatGPT, large language models, multiple-choice questions
  • Gazi Üniversitesi Adresli: Evet

Özet

What is the educational challenge?: A fundamental challenge in medical education is creating high-quality, clinically relevant multiple-choice questions (MCQs). ChatGPT-based automatic item generation (AIG) methods need well-designed prompts. However, the use of these prompts is hindered by the time-consuming process of copying and pasting, a lack of know-how among medical teachers, and the generalist nature of standard ChatGPT, which often lacks the medical context.

What are the proposed solutions?: The Case-based MCQ Generator, a custom GPT, addresses these challenges. It has been trained by using GPT Builder, which is a platform designed by OpenAI for customizing ChatGPT to meet specific needs, in order to allow users to generate case-based MCQs. By using this free tool for those who have ChatGPT Plus subscription, health professions educators can easily select a prompt, input a learning objective or item-specific test point, and generate clinically relevant questions.

What are the potential benefits to a wider global audience?: It enhances the efficiency of MCQ generation and ensures the generation of contextually relevant questions, surpassing the capabilities of standard ChatGPT. It streamlines the MCQ creation process by integrating prompts published in medical education literature, eliminating the need for manual prompt input.

What are the next steps?: Future development aims at sustainability and addressing ethical and accessibility issues. It requires regular updates, integration of new prompts from emerging health professions education literature, and a supportive digital ecosystem around the tool. Accessibility, especially for educators in low-resource countries, is vital, demanding alternative access models to overcome financial barriers.