ChatGPT versus Google Search-linked responses to surgical and fertility-related endometriosis questions: a cross-sectional content analysis

Other OA: closed public-domain-us
View on OpenAlex View on PubMed View at publisher

Abstract

OBJECTIVE: To compare guideline concordance, safety, actionability, and readability of ChatGPT and Google Search-linked responses to patient-facing surgical and fertility-related endometriosis questions. METHODS: We performed a cross-sectional comparative digital content analysis of 40 prespecified questions across diagnosis/imaging, minimally invasive surgery, deep organ-involving disease, and fertility/ovarian reserve. For each question, one ChatGPT response and one Google Search-linked response archived on May 31, 2026 were scored independently by two physicians with platform and source identifiers concealed; readability was assessed using Flesch-Kincaid Grade Level (FKGL), Flesch Reading Ease (FRES), and Simple Measure of Gobbledygook (SMOG). RESULTS: Eighty responses were analyzed. ChatGPT responses were longer than Google Search-linked responses (52.6 ± 3.9 vs 38.6 ± 4.0 words). ChatGPT had a higher overall clinical quality score (4.91 ± 0.11 vs 4.53 ± 0.23; paired mean difference, 0.38; 95% CI, 0.32 to 0.45), driven by completeness (0.94; 95% CI, 0.78 to 1.10) and actionability (0.60; 95% CI, 0.47 to 0.73). Safety scores were similarly high, and no response was judged harmful or misleading. Mean grade-level estimates for both platforms exceeded the sixth-grade reference benchmark. CONCLUSION: In this controlled set of surgical and fertility-related endometriosis questions, ChatGPT responses received higher completeness and actionability ratings than Google Search-linked answers, with similarly high safety ratings. Both platforms had mean grade-level estimates above the sixth-grade reference benchmark, supporting clinician-reviewed educational use and further assessment of patient comprehension.

My notes (saved in your browser only)

Citation neighborhood (2-hop)

Papers in the corpus that this work cites (lower rings, blue) and that cite this one (upper rings, green). Dot size scales with the paper's in-corpus citation count — bigger dot = more influential within the endo/adeno field. Click a dot to open that paper. Outer rings show 2-hop neighbours — papers reached through the immediate citers/citees. [ collapse to 1-hop ]

References (37)

Source provenance

europepmc
last seen: 2026-11-21T06:17:04.340742+00:00
openalex
last seen: 2026-11-21T06:07:56.064915+00:00
pubmed
last seen: 2026-11-21T06:09:43.705417+00:00
unpaywall
last seen: 2026-11-20T08:37:33.920708+00:00
License: public-domain-us · commercial use OK · attribution required
Courtesy of the U.S. National Library of Medicine