openai will apply new restrictions to chatgpt users under 18

OpenAI Announces New Policies for Younger Users

Sam Altman, CEO of OpenAI, revealed a series of updated user policies on Tuesday. These changes include a commitment to significantly modify ChatGPT’s interactions with individuals under the age of 18.

Prioritizing Teen Safety

According to the official announcement, the safety of teenage users is being prioritized over concerns regarding privacy and freedom. The company acknowledges that this technology is both new and powerful, necessitating substantial protections for minors.

Restrictions on Sensitive Topics

The policy adjustments specifically address conversations concerning sexual content and self-harm. ChatGPT will be re-trained to avoid engaging in any “flirtatious talk” with users identified as underage.

Furthermore, enhanced safeguards will be implemented around discussions related to suicide. Should a minor utilize ChatGPT to explore suicidal thoughts or scenarios, the service will attempt to notify their parents or, in critical situations, contact local law enforcement.

Real-World Implications and Lawsuits

These measures are being implemented in response to tragic events. OpenAI is currently facing a wrongful death lawsuit filed by the parents of Adam Raine, who died by suicide following prolonged interactions with ChatGPT.

Character.AI, a competing chatbot platform, is also contending with a similar legal challenge. The potential for chatbot-induced delusion is a growing concern, especially given the increasing sophistication and depth of these conversational AI systems.

New Parental Control Features

In addition to content restrictions, parents registering accounts for their underage children will now have the ability to establish “blackout hours.” This feature will restrict access to ChatGPT during specified times, a capability not previously available.

Senate Hearing on AI Chatbot Risks

These policy changes coincide with a Senate Judiciary Committee hearing, “Examining the Harm of AI Chatbots.” The hearing was announced by Senator Josh Hawley (R-MO) in August.

Adam Raine’s father is scheduled to testify at the hearing, alongside other invited guests.

Reuters Investigation and Policy Updates

The hearing will also address findings from a Reuters investigation. This investigation revealed internal policy documents that appeared to encourage sexual interactions with underage users.

In response to the report, Meta has updated its own chatbot policies.

Age Verification Challenges

Determining the age of users presents a significant technical hurdle. OpenAI outlined its approach in a separate blog post, stating they are “building toward a long-term system to understand whether someone is over or under 18.”

In cases where age is uncertain, the system will default to the more restrictive safety measures.

Parent Account Linking for Enhanced Safety

The most reliable method for verifying a user’s age is to link their account to an existing parent account. This also allows the system to directly alert parents if the teen user is perceived to be in distress.

Balancing Privacy and Freedom

Altman emphasized OpenAI’s continued dedication to user privacy and providing adult users with extensive freedom in their interactions with ChatGPT.

“We realize that these principles are in conflict,” the post concludes, “and not everyone will agree with how we are resolving that conflict.”

Resources for Support

If you or someone you know is struggling, please reach out for help. You can call 1-800-273-8255 for the National Suicide Prevention Lifeline. Alternatively, text HOME to 741-741 for free support, text 988, or contact the Crisis Text Line for 24-hour assistance. For international resources, please visit the International Association for Suicide Prevention.