Comparing ChatGPT vs. Surgeon-Generated Informed Consent Documentation for Plastic Surgery Procedures

Comparing ChatGPT vs. Surgeon-Generated Informed Consent Documentation for Plastic Surgery Procedures
Ishan Patel, Anjali Om, Daniel Cuzzone, Gabriela Garcia Nores
Aesthetic Surgery Journal, 22 October 2024
Abstract
Background
Informed consent is a crucial requirement of a patient’s surgical care but can be a burdensome task. Artificial intelligence (AI) and machine learning language models may provide an alternative approach to writing detailed, readable consent forms in an efficient manner. No studies have assessed the accuracy and completeness of AI-generated consents for aesthetic plastic surgeries.
Objectives
This study aims to compare the length, reading level, accuracy, and completeness of informed consent forms that are AI chatbot (ChatGPT-4, OpenAI, San Francisco, CA)-generated versus plastic surgeon-generated for the most commonly performed aesthetic plastic surgeries.
Methods
This study is a cross-sectional design comparing informed consent forms created by the American Association of Plastic Surgeons (ASPS) with informed consent forms generated by ChatGPT-4 for the five most commonly performed plastic surgery procedures: liposuction, breast augmentation, abdominoplasty, breast lift, and blepharoplasty.
Results
The average word count of ChatGPT forms was lower than for the ASPS generated forms (1023 vs 2901, p=0.01). Average reading level for ChatGPT forms was also lower than ASPS forms (11.2 vs 12.5, p=0.02). There was no difference between accuracy and completeness scores for general descriptions of the surgery, risks, benefits, or alternatives. The mean overall impression score for ChatGPT consents was 2.33, whereas it was 2.23 for ASPS consent forms (p=0.18).
Conclusions
Our study demonstrates that informed consent forms generated by ChatGPT were significantly shorter and more readable than ASPS forms with no significant difference in completeness and accuracy.