Roblox's New AI Scan Faces Scrutiny Over Accuracy

Roblox is set to implement a mandatory AI-powered facial age estimation for its chat feature beginning January 7. This new safety measure comes as the company faces significant scrutiny and nearly 80 lawsuits related to child safety on the platform, with 42% of its users being under 13. The AI scan is designed to verify user ages to enhance safety and compliance.

During a demonstration, the facial scan estimated the reporter's age as 18-20, despite her being 24, highlighting potential accuracy issues. Roblox's Chief Safety Officer, Matt Kaufman, stated the AI is most accurate for younger users, with accuracy decreasing for older individuals. The company uses a third-party provider, Persona, for this technology.

Despite the accuracy concerns, Roblox emphasizes that user photos are deleted immediately after processing. For parents worried about their children's online safety, Roblox offers robust parental controls, including chat restrictions and screen time limits. Experts advise parents to actively utilize these tools and consider disabling chat functions altogether.