Analyzing the performance of ChatGPT in answering inquiries about cervical cancer.
| Title: | Analyzing the performance of ChatGPT in answering inquiries about cervical cancer. |
|---|---|
| Authors: | Yurtcu E; Department of Obstetrics and Gynecology, Faculty of Medicine, Duzce University, Duzce, Türkiye.; Ozvural S; Department of Obstetrics and Gynecology, Acıbadem Hospital, Biruni University, Istanbul, Türkiye.; Keyif B; Department of Obstetrics and Gynecology, Faculty of Medicine, Duzce University, Duzce, Türkiye. |
| Source: | International journal of gynaecology and obstetrics: the official organ of the International Federation of Gynaecology and Obstetrics [Int J Gynaecol Obstet] 2025 Feb; Vol. 168 (2), pp. 502-507. Date of Electronic Publication: 2024 Aug 16. |
| Publication Type: | Journal Article |
| Language: | English |
| Journal Info: | Publisher: Wiley Country of Publication: United States NLM ID: 0210174 Publication Model: Print-Electronic Cited Medium: Internet ISSN: 1879-3479 (Electronic) Linking ISSN: 00207292 NLM ISO Abbreviation: Int J Gynaecol Obstet Subsets: MEDLINE |
| Imprint Name(s): | Publication: 2017- : Malden, MA : Wiley; Original Publication: [New York, NY] Hoeber Medical Division, Harper & Row, [c1969- |
| MeSH Terms: | Uterine Cervical Neoplasms* ; Social Media*; Surveys and Questionnaires/standards ; Humans ; Female ; Generative Artificial Intelligence |
| Abstract: | Objective: To analyze the knowledge of ChatGPT about cervical cancer (CC).; Methods: Official websites of professional health institutes, and websites created by patients and charities underwent strict screening. Using CC-related keywords, common inquiries by the public and comments about CC were searched in social media applications with these data, a list of frequently asked questions (FAQs) was prepared. When preparing question about CC, the European Society of Gynecological Oncology (ESGO), European Society for Radiotherapy and Oncology (ESTRO), and European Society of Pathology (ESP) guidelines were used. The answers given by ChatGPT were scored according to the Global Quality Score (GQS).; Results: When all ChatGPT answers to FAQs about CC were evaluated with regard to GQS, 68 ChatGPT answers were classified as score 5, and none of ChatGPT answers for FAQs were scored as 2 or 1. Moreover, ChatGPT answered 33 of 53 (62.3%) CC-related questions based on ESGO, ESTRO, and ESP guidelines with completely accurate and satisfactory responses (GQS 5). In addition, eight answers (15.1%), seven answers (13.2%), four answers (7.5%), and one answer (1.9%) were categorized as GQS 4, GQS 3, GQS 2, and GQS 1, respectively. The reproducibility rate of ChatGPT answers about CC-related FAQs and responses about those guideline-based questions was 93.2% and 88.7%, respectively.; Conclusion: ChatGPT had an accurate and satisfactory response rate for FAQs about CC with regards to GQS. However, the accuracy and quality of ChatGPT answers significantly decreased for questions based on guidelines.; (© 2024 The Author(s). International Journal of Gynecology & Obstetrics published by John Wiley & Sons Ltd on behalf of International Federation of Gynecology and Obstetrics.) |
| References: | Am J Perinatol. 2023 Jul;40(10):1054-1060. (PMID: 34327683); Ann Allergy Asthma Immunol. 2022 Feb;128(2):139-145. (PMID: 34555532); Eur J Cardiovasc Nurs. 2024 Jan 12;23(1):e13-e14. (PMID: 37194466); J Pediatr Urol. 2024 Feb;20(1):26.e1-26.e5. (PMID: 37596194); Int J Gynaecol Obstet. 2025 Feb;168(2):502-507. (PMID: 39148482); Int J Gynaecol Obstet. 2017 Jul;138 Suppl 1:47-56. (PMID: 28691334); J Multidiscip Healthc. 2023 May 30;16:1513-1520. (PMID: 37274428); J Med Internet Res. 2021 May 12;23(5):e17917. (PMID: 33978589); Int J Gynaecol Obstet. 2020 Aug;150(2):189-193. (PMID: 32471005); Gynecol Obstet Invest. 2023;88(5):310-313. (PMID: 37494894); Strabismus. 2020 Dec;28(4):175-180. (PMID: 33074741); Arch Gynecol Obstet. 2024 Apr;309(4):1543-1549. (PMID: 37975899); CA Cancer J Clin. 2018 Nov;68(6):394-424. (PMID: 30207593); Int Urol Nephrol. 2024 Jan;56(1):17-21. (PMID: 37658948); Ophthalmol Sci. 2023 May 05;3(4):100324. (PMID: 37334036); Clin Med (Lond). 2023 May;23(3):278-279. (PMID: 37085182) |
| Contributed Indexing: | Keywords: ChatGPT; artificial intelligence; cervical cancer; guideline |
| Entry Date(s): | Date Created: 20240816 Date Completed: 20250423 Latest Revision: 20250514 |
| Update Code: | 20260130 |
| PubMed Central ID: | PMC11726164 |
| DOI: | 10.1002/ijgo.15861 |
| PMID: | 39148482 |
| Database: | MEDLINE |
Journal Article