Roblox, Discord, OpenAI, Mozilla, and Google Launch New Child Safety Group
Roblox, Discord, OpenAI, and Google have formed a new coalition aimed at protecting children online, announced at the Artificial Intelligence Action Summit in Paris.
ROOST: A Tech Giant’s Online Safety Initiative
As the digital landscape rapidly evolves, the need for reliable and accessible security infrastructures has become paramount. In response, industry leaders Roblox, Discord, OpenAI, Mozilla, and Google have come together to establish a nonprofit organization called ROOST, short for Robust Open Online Safety Tools. Launching at the perfect time during a global AI summit in Paris, ROOST aims to foster a community dedicated to creating foundational tools necessary for a safer AI ecosystem.
Open-Source Security Tools for All
ROOST is committed to providing free open-source safety tools to both public and private organizations to deploy across their platforms. Initially focusing on child safety, the organization specifically targets the development of tools to “detect, review, and report Child Sexual Abuse Material (CSAM)”. This initiative is supported by the financial and technical expertise of its founding partners.
Online Child Safety: A Top Priority
The issue of online child safety has gained significant attention with the proposal of laws like COPPA (Children and Teen’s Online Privacy Protection Act) and KOSA (Kids Online Safety Act) in Congress. Google and OpenAI, two key ROOST collaborators, have pledged to prevent their AI tools from being used to create CSAM.
Roblox and the Critical Issue of Child Safety
Child safety is especially critical for Roblox, where in 2020, two-thirds of American children aged nine to twelve were active users. The platform has faced challenges in managing child safety effectively. A 2024 Bloomberg Businessweek report highlighted a “pedophilia problem” at Roblox, prompting the company to implement several policy changes and new restrictions on children’s private messaging. While ROOST will not solve all these issues, it aims to ease their management for any company or organization facing similar challenges as Roblox.