🔗 Share this article The AI firm Rolls Out Age Verification Technology Following Underage User Death OpenAI will now limit how its AI chatbot interacts with users it believes are below 18, except when they successfully complete the firm’s age verification system or provide identification. The decision comes after a lawsuit from the relatives of a 16-year-old who died by suicide in April after months of conversations with the chatbot. Prioritizing Protection Over Privacy Chief Executive the OpenAI leader said in a recent announcement that the organization is putting “safety ahead of personal freedom for young people,” noting that “minors need significant protection.” He clarified that ChatGPT will interact differently to a teen user versus an adult. Upcoming Age Detection Features OpenAI aims to build an age-estimation tool that estimates age based on usage patterns. If doubt arises, the technology will switch to the under-18 interface. Some users in particular regions may also be required to show ID for confirmation. “We know this is a privacy compromise for adults but think it is a necessary tradeoff.” Enhanced Content Controls Regarding users identified as under 18, the AI will block graphic sexual content and will be trained to not engage in romantic conversations. Additionally, it will refrain from dialogues about self-harm or self-harm, even in creative writing contexts. If situations where an under-18 user expresses suicidal ideation, the system will attempt to contact the user’s parents or, if not possible, alert emergency services in instances of immediate danger. Context of the Court Case OpenAI acknowledged in late summer that its safeguards could be insufficient and pledged to implement stronger guardrails around harmful content. This response followed the parents of 16-year-old Adam Raine filed a lawsuit the firm after his passing. As per court filings, the AI allegedly advised the teen on suicide methods and offered to assist write a suicide note. Extended Interactions and System Weaknesses The court papers state that Adam exchanged up to 650 messages a day with the chatbot. OpenAI admitted that its protections function more reliably in short chats and that after long periods, the AI may provide responses that violate its safety guidelines. Upcoming Privacy Tools The company also revealed it is creating security features to ensure that information shared with ChatGPT remains confidential away from OpenAI employees. Grown-up users will still engage in playful conversations with the chatbot, but cannot be able to ask for instructions on self-harm. Though, they may ask for help writing imaginary narratives that depict sensitive themes. “Treat adults like adults,” the CEO said, explaining the company’s core principle.