EN ▾
SNAPE REP RT Front page →
DevelopingAI safety05 Nov, 21:34 UTC

Parents sue Google, alleging Gemini on a school Chromebook helped their 13-year-old plan a suicide

The complaint, filed on Monday in California and moved by Google to federal court on Wednesday, is the first known negligence case over AI on Chromebooks; Google says it is reviewing the claims, which are untested in court.

Read at The Economic Times (AFP) Share

Why it matters

The case targets AI inside Search, not the Gemini app: the girl's school had blocked Gemini and ChatGPT, but she could still use Google Search, whose AI-powered tools were not among those Google said this week it would disable by default for students. The family's lawyer argues schools should turn search off until Google removes AI Mode or guarantees student safety. Google says AI Mode has self-harm safeguards. Watch the federal court ruling on the case and whether schools and regulators change how AI search is enabled on student devices.

Key facts

  • Filed on Monday in California; moved by Google to federal court on Wednesday
  • First known negligence case over AI integrations on Chromebooks (AFP)
  • Plaintiffs say the girl used AI features in Google Search after school blocked Gemini and ChatGPT
  • School monitoring flagged a document titled 'Funeral' on 17 March
  • Google says it is reviewing the claims and that AI Mode has self-harm safeguards

Sources

More on AI safety
More from Snape ReportFront page →