Dear Editor,
We would like to comment on “Is ChatGPT an Accurate and Reliable Source of Information for Patients with Vaccine and Statin Hesitancy?”1. This study compared the answers provided by ChatGPT-3.5 with those from doctors for vaccine and statin hesitancy-related queries. Experts in internal medicine, microbiology, and cardiology evaluated the responses. The similarity between the average scores of ChatGPT and physicians suggests that ChatGPT was able to produce comments that were as precise, understandable, and succinct as those from physicians.
The study’s methodological flaw is that it only used ChatGPT version 3.5 to generate the questions’ answers. Artificial intelligence (AI) language models come in various iterations and versions; thus, relying only on one could restrict how broadly the results can be applied. Furthermore, the study excluded the opinions of patients or those who were dubious about vaccinations and statins, and evaluated replies solely from ChatGPT and doctors. Including various viewpoints could result in a more thorough comprehension of the problem.
The fact that ChatGPT ignored sources of disinformation about statins and vaccines constitutes another flaw in the study. Conspiracy theories and misleading information frequently contribute to vaccine and statin reluctance, therefore it’s critical that AI language models can confront and disprove these assertions. Subsequent research endeavors may examine the training of AI models to identify and furnish precise data in response to conspiracy theories and false material around statins and vaccines.
Subsequent research paths may entail contrasting ChatGPT’s answers with those of alternative AI language models or with those from people with varying degrees of healthcare experience. Furthermore, gathering information from those who are dubious about vaccinations and statins through qualitative interviews or surveys may shed light on their concerns and worldviews. Then, with these data, AI models that are better able to confront and dispel myths about statins and vaccinations might be developed.