Guided ChatGPT use and clinical reasoning retention in emergency medicine students

ISRCTN ISRCTN13261015
DOI https://doi.org/10.1186/ISRCTN13261015
Sponsor Cadi Ayyad University
Funder Investigator initiated and funded
Submission date
02/08/2026
Registration date
03/08/2026
Last edited
04/08/2026
Recruitment status
No longer recruiting
Overall study status
Completed
Condition category
Other
Prospectively registered
Protocol
Statistical analysis plan
Results
Individual participant data
Record updated in last year

Plain English summary of protocol

Background and study aims
Clinical reasoning is a core skill for emergency medicine doctors, but it is difficult to teach and assess. ChatGPT, an artificial intelligence chatbot, could help students structure their reasoning, but it is not known whether this help still benefits them once the tool is no longer available. This study aims to find out whether guided use of ChatGPT improves how well medical students document their clinical reasoning immediately afterwards and whether this benefit lasts 1 month later without the tool.

Who can participate?
Fifth- and sixth-year medical students undertaking a clinical rotation in emergency medicine or intensive care at Mohammed VI University Hospital of Marrakech

What does the study involve?
Participants are randomly assigned to one of two groups. Both groups attend a 30-minute session solving two simulated emergency medicine cases. One group receives guided assistance from ChatGPT while working through the cases, under supervision; the other group solves the same cases without any digital assistance. Immediately afterwards, all participants write up two new cases without help, and their reasoning is scored by assessors who do not know which group each participant belonged to. One month later, all participants complete the same exercise again, still without ChatGPT, to see whether any benefit from the tool has lasted.

What are the possible benefits and risks of participating?
There is no direct health risk, as the study uses only simulated clinical cases and does not involve real patients. Participants may benefit from additional practice with structured clinical reasoning, and participation has no effect on academic progression. For fairness, participants in the control group are offered access to a ChatGPT-assisted session after the end of the study.

Where is the study run from?
The Emergency Department of Ar-Razi Hospital, Mohammed VI University Hospital of Marrakech, Faculty of Medicine and Pharmacy, Cadi Ayyad University, Marrakech (Morocco)

When is the study starting and how long is it expected to run for?
April 2026 to May 2026

Who is funding the study?
Investigator initiated and funded

Who is the main contact?
Dr Hayate Errifaiy, h.errifaiy@uca.ac.ma

Contact information

Dr Hayate Errifaiy
Public, Scientific, Principal investigator

Department of Anesthesia and Intensive Care Medicine, Emergency Department, Mohammed VI University Hospital of Marrakech, Faculty of Medicine and Pharmacy, Cadi Ayyad University
Marrakech
44150
Morocco

ORCiD logoORCID ID 0009-0000-6916-436X
Phone +212 (0)666928926
Email h.errifaiy@uca.ac.ma

Study information

Primary study designInterventional
AllocationRandomized controlled trial
MaskingOpen (masking not used)
ControlActive
AssignmentParallel
PurposeEducational/training
Scientific titleEffect of guided ChatGPT use on documented clinical reasoning and its retention among emergency medicine students compared to standard teaching: a randomized controlled trial
Study acronymGRACE (Guided Reasoning with AI in Clinical Emergency [education])
Study objectives 1. To ascertain whether guided ChatGPT use improves the quality of documented clinical reasoning (assessed using the Revised-IDEA score) among emergency medicine students immediately after a structured clinical reasoning exercise, compared with no assistance.
2. To ascertain whether this improvement, if present, persists one month later when clinical reasoning is reassessed under unassisted conditions.
Ethics approval(s)

Approved 09/03/2026, Marrakech University Hospital Ethics Committee (Marrakech University Hospital Center, Marrakech, 40080, Morocco; +212 (0)58362246; aitbatahar@yahoo.fr), ref: 046/2026

Health condition(s) or problem(s) studiedMedical education — clinical reasoning skills (emergency medicine)
InterventionParticipants are randomised 1:1 to one of two parallel groups (30 participants per group), using a simple, unrestricted allocation sequence with no stratification or blocking. The sequence is generated and held by an independent investigator not otherwise involved in enrolment, intervention delivery, or outcome assessment and concealed using sequentially numbered, opaque, sealed envelopes opened by the enrolling investigator only at the time of each participant's inclusion.

Both groups complete a single 30-minute session solving two simulated emergency medicine clinical cases (chest pain and respiratory distress) of intermediate complexity, identical for both arms. In the intervention group, participants have guided access to ChatGPT (GPT-4o, OpenAI) during the session to help structure their clinical reasoning, generate diagnostic hypotheses, and prioritise clinical elements, with standardised instructions not to copy the tool's answers but to formulate their own reasoning; investigators provide no pedagogical input beyond ensuring protocol adherence. In the control group, participants solve the same cases without any digital assistance.

Immediately after the session (T0), all participants individually solve, in writing and without assistance, two further standardised cases distinct from those used in the session. One month later (T1), a retention assessment is performed under the same unassisted conditions, using two new cases of comparable complexity, with no access to ChatGPT for either group. Participants in the intervention group additionally complete a 13-item satisfaction questionnaire at the end of the session. Total participation lasts approximately 1 month per participant, from the intervention session to the final follow-up assessment.
Intervention typeBehavioural
Primary outcome measure(s)
  1. Documented clinical reasoning quality measured using the total Revised-IDEA (R-IDEA) score, scored independently by two blinded raters at T0 (immediately after the intervention session) and T1 (1 month after the intervention session, under unassisted conditions)
  2. Retention of documented clinical reasoning measured using the total R-IDEA score, rated by the same two blinded assessors at T0 (immediately after the intervention session) and T1 (1 month after the intervention session, under unassisted conditions)
Key secondary outcome measure(s)
  1. Participants' perceived usefulness, decisional confidence and motivation regarding ChatGPT use (intervention group only) measured using 13-item, 5-point Likert-type satisfaction questionnaire at T0 (immediately after the intervention session)
Completion date30/05/2026

Eligibility

Participant type(s)
Age groupAdult
Lower age limit18 Years
Upper age limit60 Years
SexAll
Target sample size at registration60
Total final enrolment60
Key inclusion criteria1. Fifth- or sixth-year medical students
2. Undertaking a clinical rotation in emergency medicine or intensive care
3. Provided written, free and informed consent
Key exclusion criteria1. Refusal to participate
2. Prior participation in the pilot study
Date of first enrolment12/04/2026
Date of final enrolment22/04/2026

Locations

Countries of recruitment

  • Morocco

Study participating centres

Results and Publications

Individual participant data (IPD) Intention to shareYes
IPD sharing planThe anonymised datasets generated and/or analysed during this study, the study protocol, the R-IDEA scoring guide (adapted and translated version), and the simulated clinical case vignettes are available from the corresponding author (h.errifaiy@uca.ac.ma) on reasonable request.

Editorial Notes

04/08/2026: The completion date was corrected from 30/06/2026 to 30/05/2026.
03/08/2026: Study's existence confirmed by the Marrakech University Hospital Ethics Committee.