Garcia-Porta, Nery;
Vaughan, Megan;
Rendo-Gonzalez, Sofia;
Gomez-Varela, Ana I;
O'Donnell, Autumn;
de-Moura, Joaquim;
Novo-Bujan, Jorge;
(2024)
Are artificial intelligence chatbots a reliable source of information about contact lenses?
Contact Lens and Anterior Eye
, 47
(2)
, Article 102130. 10.1016/j.clae.2024.102130.
Preview |
Text
PIIS1367048424000134.pdf - Published Version Download (465kB) | Preview |
Abstract
Introduction: Artificial Intelligence (AI) chatbots are able to explain complex concepts using plain language. The aim of this study was to assess the accuracy of three AI chatbots answering common questions related to contact lens (CL) wear. Methods: Three open access AI chatbots were compared: Perplexity, Open Assistant and ChatGPT 3.5. Ten general CL questions were asked to all AI chatbots on the same day in two different countries, with the questions asked in Spanish from Spain and in English from the U.K. Two independent optometrists with experience working in each country assessed the accuracy of the answers provided. Also, the AI chatbots’ responses were assessed if their outputs showed any bias towards (or against) any eye care professional (ECP). Results: The answers obtained by the same AI chatbots were different in Spain and the U.K. Also, statistically significant differences were found between the AI chatbots for accuracy. In the U.K., ChatGPT 3.5 was the most and Open Assistant least accurate (p < 0.01). In Spain, Perplexity and ChatGPT were statistically more accurate than Open Assistant (p < 0.01). All the AI chatbots presented bias, except ChatGPT 3.5 in Spain. Conclusions: AI chatbots do not always consider local CL legislation, and their accuracy seems to be dependent on the language used to interact with them. Hence, at this time, although some AI chatbots might be a good source of information for general CL related questions, they cannot replace an ECP.
| Type: | Article |
|---|---|
| Title: | Are artificial intelligence chatbots a reliable source of information about contact lenses? |
| Location: | England |
| Open access status: | An open access version is available from UCL Discovery |
| DOI: | 10.1016/j.clae.2024.102130 |
| Publisher version: | https://doi.org/10.1016/j.clae.2024.102130 |
| Language: | English |
| Additional information: | © 2024 The Authors. Published by Elsevier Ltd on behalf of British Contact Lens Association. This is an open access article under the CC BY-NC-ND license (http://creativecommons.org/licenses/by-nc-nd/4.0/). |
| Keywords: | Contact lenses, Artificial intelligence chatbots, Eye care professionals, Optometrists, Ophthalmologists, Contact lens opticians |
| UCL classification: | UCL UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Medical Sciences UCL > Provost and Vice Provost Offices > School of Life and Medical Sciences > Faculty of Medical Sciences > UCL Medical School |
| URI: | https://discovery.ucl.ac.uk/id/eprint/10212257 |
Archive Staff Only
 |
View Item |
