A recent analysis has revealed that Google’s AI-powered search feature, AI Overview, frequently cites YouTube as its primary source when answering health-related questions. The finding has raised concerns over the reliability and medical accuracy of the responses, especially since many sources cited lack verified medical credentials.
YouTube Tops Health Sources
German analytics firm SE Ranking reviewed more than 50,000 AI Overview datasets related to health queries. The study found that YouTube emerged as the top source which researchers used for citations because it appeared in 4.4 percent of their references. The study found that references to established medical institutions such as hospital websites and government health portals and professional medical associations were used less than studies on medical topics.
Majority of Sources Lack Medical Credibility
The study further revealed that 66% of sources cited by AI Overview come from websites with unverified medical credibility, while less than 1% of citations were linked to government health agencies or academic journals. SE Ranking commented that most AI-generated health answers rely heavily on YouTube, commercial websites, and blogs, which suggests many responses may not be grounded in evidence-based medical research.
Example of Misinformation
The report found a dangerous error in AI Overview’s health guidance system, which it had discovered during its investigation. The AI Overview system for pancreatic cancer patients mistakenly recommended complete dietary restriction of fatty foods while medical guidelines advised them to eat small amounts of digestible fats. The incorrect medical guidance which was given to patients could lead to serious health problems.
What This Means
The research results demonstrate rising anxiety about AI-generated health information which depends on widely used yet unverified sources. Experts argue that AI search systems should improve user experience but need to deliver trustworthy scientific evidence-based content particularly for medical information.