AI-Assisted knowledge assessment: comparison of ChatGPT and Gemini on undescended testicle in children

Basit Öğe Kaydı
dc.contributor.authorÖzdemir Kaçer, Emine
dc.contributor.authorTuşat, Mustafa
dc.contributor.authorKılıçaslan, Murat
dc.contributor.authorMemiş, Sebahattin
dc.date.accessioned2025-10-01T11:41:15Z
dc.date.available2025-10-01T11:41:15Z
dc.date.issued2025
dc.departmentTıp Fakültesi
dc.description.abstractThis study aimed to evaluate the accuracy and completeness of ChatGPT-4 and Google Gemini in answering questions about undescended testis, as these AI tools can sometimes provide seemingly accurate but incorrect information, raising caution in medical applications. Methods: Researchers created 20 identical questions independently and submitted them to both ChatGPT-4 and Google Gemini.A pediatrician and a pediatric surgeon evaluated the responses for accuracy, using the Johnson et al. scale (accuracy rated from 1 to 6 and completeness from 1 to 3).Responses that lacked content received a score of 0. Statistical analyses were performed using R Software (version 4.3.1) to assess differences in accuracy and consistency between the tools. Results: Both chatbots answered all questions, with ChatGPT achieving a median accuracy score of 5.5 and a mean score of 5.35, while Google Gemini had a median score of 6 and a mean of 5.5. Completeness was similar, with ChatGPT scoring a median of 3 and Google Gemini showing comparable performance. Conclusion: ChatGPT and Google Gemini showed comparable accuracy and completeness; however, inconsistencies between accuracy and completeness suggest these AI tools require refinement.Regular updates are essential to improve the reliability of AI-generated medical information on UDT and ensure up-to-date, accurate responses.
dc.identifier.endpage97
dc.identifier.issue3
dc.identifier.startpage93
dc.identifier.urihttps://hdl.handle.net/20.500.12451/14581
dc.identifier.volume5
dc.institutionauthorÖzdemir Kaçer, Emine
dc.institutionauthorTuşat, Mustafa
dc.institutionauthorKılıçaslan, Murat
dc.institutionauthorMemiş, Sebahattin
dc.institutionauthorEmine, Özdemir Kaçer
dc.institutionauthorid0000-0002-0111-1672
dc.institutionauthorid0000-0003-2327-4250
dc.institutionauthorid0000-0003-1243-9830
dc.institutionauthorid0000-0002-3829-9218
dc.language.isoen
dc.publisherAksaray Üniversitesi
dc.relation.ispartofAksaray Üniversitesi Tıp Bilimleri Dergisi
dc.relation.publicationcategoryMakale - Uluslararası Hakemli Dergi - Kurum Öğretim Elemanı
dc.rightsinfo:eu-repo/semantics/openAccess
dc.subjectChatGPT
dc.subjectGemini
dc.subjectChildren
dc.subjectUndescended Testicle
dc.titleAI-Assisted knowledge assessment: comparison of ChatGPT and Gemini on undescended testicle in children
dc.typeArticle

Dosyalar

Orijinal paket
Listeleniyor 1 - 1 / 1
Küçük Resim
İsim:
ozdemir kacer-emine-2025.pdf
Boyut:
334.6 KB
Biçim:
Adobe Portable Document Format
İndir
Lisans paketi
Listeleniyor 1 - 1 / 1
[ X ]
İsim:
license.txt
Boyut:
1.17 KB
Biçim:
Item-specific license agreed upon to submission
Açıklama:
İndir

Koleksiyon

Cilt 5, Sayı 3, Makale Koleksiyonu
Makale Koleksiyonu
Makale Koleksiyonu