Child Safety Groups Warn: Google AI Threatens Classrooms

Child safety organizations are questioning the appropriateness of Google Search for classroom use, citing significant risks associated with its AI-powered features. A recent report by Common Sense Media concluded that Google's generative AI search poses an "unacceptable risk" to young users, recommending students cease its use until safety measures are implemented. This concern escalates as AI becomes increasingly embedded in educational technology.

Google's AI Mode for Search, launched last year, is powered by Gemini models, which are age-gated in other Google services. Child safety advocates express alarm that this integration, particularly through Google Workspace for Education and Chromebooks, exposes millions of students to AI without their explicit awareness. Experts warn that AI Overviews can perpetuate misinformation and that AI tools may facilitate academic dishonesty, making learning more difficult.

Amanda Bickerstaff, deputy director of AI for Education, criticized AI Mode as a "backdoor" to unsafe AI experiences, hindering AI literacy efforts. Common Sense Media's report highlights potential mental health and safety risks, noting that Google currently offers no option to disable AI features while keeping Search accessible. Parents and schools can block Google.com, but this presents a difficult choice for educators.

In response, Google stated that the stress testing by Common Sense Media was narrow and ambiguous. However, advocates like David Monahan of Fairplay for Kids argue that if Google won't disable AI for students, schools should discontinue Google product use. Organizations like Schools Beyond Screens are pushing for tech use moratoriums in classrooms, citing the pervasive colonization of public education by Big Tech and the potential for legal liabilities for school districts.

Legal precedents, including a wrongful death lawsuit against Google involving Gemini and a negligent platform design ruling against YouTube, add to these concerns. Child safety groups urge school districts to demand stronger controls over embedded generative AI or to void contracts with Google, leveraging their power as major purchasers to drive change.