xRead - Incorporating Artificial Intelligence into Clinical Practice (March 2026)

AI-generated text in otolaryngology publications: a comparative analysis before and after the release of ChatGPT Jonathan M. Carnino 1 , Nicholas Y. K. Chong 1 , Henry Bayly 2 , Lindsay R. Salvati 2 , Hardeep S. Tiwana 3 , Jessica R. Levi 1,4 1 Boston University Chobanian & Avedisian School of Medicine, Boston, MA, USA 2 Boston University School of Public Health, Boston, MA, USA 3 Washington State University Elson S. Floyd College of Medicine, Spokane, WA, USA 4 Department of Otolaryngology – Head and Neck Surgery, Boston Medical Center, Boston, MA, USA Abstract Purpose— This study delves into the broader implications of artificial intelligence (AI) text generation technologies, including large language models (LLMs) and chatbots, on the scientific literature of otolaryngology. By observing trends in AI-generated text within published otolaryngology studies, this investigation aims to contextualize the impact of AI-driven tools that are reshaping scientific writing and communication. Methods— Text from 143 original articles published in JAMA Otolaryngology – Head and Neck Surgery was collected, representing periods before and after ChatGPT’s release in November 2022. The text from each article’s abstract, introduction, methods, results, and discussion were entered into ZeroGPT.com to estimate the percentage of AI-generated content. Statistical analyses, including T-Tests and Fligner-Killeen’s tests, were conducted using R. Results— A significant increase was observed in the mean percentage of AI-generated text post-ChatGPT release, especially in the abstract (from 34.36 to 46.53%, p = 0.004), introduction (from 32.43 to 45.08%, p = 0.010), and discussion sections (from 15.73 to 25.03%, p = 0.015). Publications of authors from non-English speaking countries demonstrated a higher percentage of AI-generated text. Conclusion— This study found that the advent of ChatGPT has significantly impacted writing practices among researchers publishing in JAMA Otolaryngology – Head and Neck Surgery, raising concerns over the accuracy of AI-created content and potential misinformation risks. This manuscript highlights the evolving dynamics between AI technologies, scientific communication, and publication integrity, emphasizing the urgent need for continued research in this dynamic field. The findings also suggest an increasing reliance on AI tools like ChatGPT, raising questions about their broader implications for scientific publishing. HHS Public Access Author manuscript Eur Arch Otorhinolaryngol . Author manuscript; available in PMC 2025 November 01. Published in final edited form as: Eur Arch Otorhinolaryngol . 2024 November ; 281(11): 6141–6146. doi:10.1007/s00405-024-08834-3.

Author Manuscript Author Manuscript Author Manuscript Author Manuscript

✉ Jonathan M. Carnino, jcarnino@bu.edu. Conflict of interest Authors have no financial conflicts of interest to disclose. Authors declare no conflicts of interest.