Study Reveals Google's AI Features Pose Serious Risks to Children

Source: Date:

Internet giants are increasingly facing scrutiny from lawmakers, regulators, and organizations concerned with children's safety online. Google and its AI Search have recently come under fire for their potential risks.

Interestingly, Google’s AI may be facing criticism due in part to the popularity of Chromebooks, which are widely used as school laptops. The Common Sense Media organization highlights that Google’s AI is “ubiquitous on children's personal and school-issued devices.”

Why learn math when AI can solve it for you?

Common Sense Media identified several issues with Google's AI features, particularly regarding homework. The AI Mode can complete assignments for students, providing inconsistent answers—sometimes correct, sometimes incorrect.

Moreover, the report notes that Google’s AI Mode “failed kids in crisis, including missing clear signs of suicidal ideation, reinforcing signs of psychosis and mania, validating disordered eating including purging, and celebrating cannabis use.”

Study finds that Google's AI features create ''unacceptable risks'' for children

AI Mode is the chatbot interface activated by clicking the “AI Mode” button, while the AI Overview feature appears automatically. A significant concern is that neither of these features can be disabled.

You can read the full report on Common Sense Media’s findings here (PDF). In summary, Google's AI features did not meet expectations, performing poorly on seven out of eight “established AI Principles” evaluated by the organization.

Source | Via

Scroll to Top