Google Scraps AI Health Feature After Safety Concerns & Criticism
Google has quietly removed a new feature, “What People Suggest,” that allowed users to access crowdsourced health advice from individuals online. The feature, initially touted by the company as demonstrating the potential of artificial intelligence to improve health outcomes, was discontinued after a relatively short period. While Google maintains the decision was part of a broader effort to simplify its search results page, the move comes amid increasing scrutiny of the accuracy and safety of AI-generated health information provided by the tech giant.
The “What People Suggest” tool aimed to organize online health discussions into easily understandable themes, offering users insights from others experiencing similar medical conditions. For example, someone managing arthritis could potentially find information on exercise routines favored by others with the condition. The feature was initially available only on mobile devices in the United States. Google’s initial announcement, made in March 2025, highlighted the value of peer-to-peer information in the context of medical experiences, as detailed in a blog post by then-chief health officer Karen DeSalvo.
Concerns Over AI-Driven Health Information
This decision follows a period of heightened concern regarding the reliability of health information presented through Google’s AI Overviews. A Guardian investigation in January 2026 revealed instances where AI Overviews provided false or misleading health advice, potentially putting users at risk. These AI-generated summaries, displayed prominently above traditional search results and reaching an estimated 2 billion people monthly, have prompted questions about the safeguards in place to ensure accuracy.
Initially, Google downplayed the findings, asserting that the AI Overviews linked to reputable sources and advised consulting with healthcare professionals. However, the company subsequently removed AI Overviews for some, though not all, medical queries. This back-and-forth underscores the challenges of deploying AI in sensitive areas like healthcare, where misinformation can have serious consequences.
The Broader Context of AI in Search
Google’s foray into AI-powered search features extends beyond “What People Suggest” and AI Overviews. The company has been actively integrating generative AI into its search engine, aiming to provide users with quicker and more comprehensive answers to their queries. As outlined in a May 2024 blog post, Google’s Gemini model is now being used to power AI Overviews and other search enhancements. The company reports billions of uses of AI Overviews through its Search Labs experiment, indicating a strong user appetite for this type of functionality.
However, the recent removal of “What People Suggest” suggests a recalibration of Google’s approach. The company now frames the decision as part of a broader effort to streamline the search experience, rather than a response to concerns about the quality of the crowdsourced advice. A Google spokesperson stated that the feature’s removal “had nothing to do with the quality or safety of the feature.”
The Challenge of Balancing Access and Accuracy
The episode highlights the inherent tension between providing accessible health information and ensuring its accuracy. While peer-to-peer support can be valuable for individuals navigating health challenges, relying on unverified advice from strangers carries significant risks. The potential for misinformation, particularly in areas where medical expertise is crucial, is a serious concern.
The decision to scrap “What People Suggest” also raises questions about the future of AI-driven health tools. Google’s continued investment in AI suggests that it remains committed to leveraging the technology to improve search, but the company may need to prioritize accuracy and safety over innovation in this sensitive domain. The company’s next “The Check Up” event, scheduled for Tuesday, is expected to provide further insights into its plans for AI in healthcare.
The incident underscores the need for ongoing vigilance and critical evaluation of AI-generated health information. Users should always consult with qualified healthcare professionals for diagnosis and treatment, and should be wary of relying solely on information found online, regardless of its source. The evolving landscape of AI in healthcare demands a cautious and informed approach, prioritizing patient safety and well-being above all else.