인문학
사회과학
자연과학
공학
의약학
농수해양학
예술체육학
복합학
지원사업
학술연구/단체지원/교육 등 연구자 활동을 지속하도록 DBpia가 지원하고 있어요.
커뮤니티
연구자들이 자신의 연구와 전문성을 널리 알리고, 새로운 협력의 기회를 만들 수 있는 네트워킹 공간이에요.
초록·키워드
Abstract Objectives This study aimed to comprehensively evaluate the readability, quality, and reliability of the content generated by four state-of-the-art artificial intelligence (AI)-powered chatbots—OpenAI ChatGPT-4, DeepSeek v3, Google Gemini 2.5 Pro, and Grok-2—in response to frequently asked questions (FAQs) posed by patients on the Internet regarding chronic otitis media (COM). Methods A curated set of 25 frequently asked questions (FAQs) on COM was meticulously compiled using insights from Google Trends, Semrush, and authoritative clinical sources. Each question was posed to four leading AI-powered chatbots—OpenAI ChatGPT-4, DeepSeek v3, Google Gemini 2.5 Pro, and Grok-2—via standardized prompts to ensure consistency. Responses were rigorously evaluated for quality and reliability using the Ensuring Quality Information for Patients (EQIP) tool and the modified DISCERN (mDISCERN) instrument. Readability was assessed through the Flesch Reading Ease Score (FRES) and the Flesch–Kincaid Grade Level (FKGL), offering a comprehensive appraisal of the clarity, accuracy, and patient-centeredness of AI-generated content. Results Statistically significant differences were observed among the evaluated chatbots in terms of information quality and reliability, as reflected by EQIP and mDISCERN scores ( p < 0.001), with Grok demonstrating higher performance. In contrast, no statistically significant differences were found in readability measures (FRES and FKGL), and all responses required advanced reading skills. Moreover, no statistically significant differences were observed among the evaluated AI models in terms of readability. Conclusion AI-powered chatbots show promise in delivering health-related information about chronic otitis media; however, their outputs vary notably in quality and reliability while remaining uniformly challenging in terms of readability. Ongoing validation and optimization are essential to enhance the accessibility and educational value of AI-generated medical content. Level of evidence 5.
인공지능 문자 인식 모델을 통해 추출된 텍스트로, 일부 오타나 오류가 포함될 수 있으나 지속적으로 개선 중입니다.
오류를 발견하셨다면 해당 부분을 드래그한 후 ' 를 통해 신고해주세요.
오류를 발견하셨다면 해당 부분을 드래그한 후 ' 를 통해 신고해주세요.