Assessment of artificial intelligence applications in responding to dental trauma

Özden İ., Gökyar M., Özden M. E., Sazak Öveçoğlu H.

Dental Traumatology, 2024 (SCI-Expanded) identifier identifier

  • Yayın Türü: Makale / Tam Makale
  • Basım Tarihi: 2024
  • Doi Numarası: 10.1111/edt.12965
  • Dergi Adı: Dental Traumatology
  • Derginin Tarandığı İndeksler: Science Citation Index Expanded (SCI-EXPANDED), Scopus, Academic Search Premier, CINAHL, EMBASE, MEDLINE
  • Anahtar Kelimeler: artificial intelligence, chatbots, ChatGPT, dental trauma, Google Bard Gemini, large language models
  • Marmara Üniversitesi Adresli: Evet

Özet

Background: This study assessed the consistency and accuracy of responses provided by two artificial intelligence (AI) applications, ChatGPT and Google Bard (Gemini), to questions related to dental trauma. Materials and Methods: Based on the International Association of Dental Traumatology guidelines, 25 dichotomous (yes/no) questions were posed to ChatGPT and Google Bard over 10 days. The responses were recorded and compared with the correct answers. Statistical analyses, including Fleiss kappa, were conducted to determine the agreement and consistency of the responses. Results: Analysis of 4500 responses revealed that both applications provided correct answers to 57.5% of the questions. Google Bard demonstrated a moderate level of agreement, with varying rates of incorrect answers and referrals to physicians. Conclusions: Although ChatGPT and Google Bard are potential knowledge resources, their consistency and accuracy in responding to dental trauma queries remain limited. Further research involving specially trained AI models in endodontics is warranted to assess their suitability for clinical use.