Tech
OpenAI ChatGPT-5 introduction displayed on smartphone screen
(Cheng Xin/Getty Images)

OpenAI announces plan for flagging mental health crises and adding teen controls

A recent flurry of news reports highlights how teens and users facing mental health crises turn to ChatGPT for help, but the tool lacks features needed to alert others and dissuade self-harm.

Jon Keegan

Over the past few weeks, a number of alarming stories have surfaced describing ChatGPT users who turned to the AI chatbot for help during mental health crises, only to have the tool encourage their plans for self-harm.

  • In August, a Connecticut man killed his mother then himself after ChatGPT reportedly encouraged his paranoid delusions.

  • In April, A 16-year-old died of suicide after conversations with ChatGPT in which the chatbot provided specific information about how to kill himself.

  • In a New York Times op-ed, a mother shared the story of how her 29-year-old daughter had shared her suicidal thoughts with a ChatGPT “therapist” persona, yet it failed to alert anyone — something a real mental health professional would have done. ChatGPT helped the woman write her suicide note.

Today, ChatGPT maker OpenAI announced a 120-day plan to roll out new protections for identifying and helping users who may be facing a mental health crisis, including adding parental controls — even though they wouldn’t have helped in two of these cases.

The company plans to partner with councils of mental health and medical professionals to “shape a clear, evidence-based vision for how AI can support people’s well-being and help them thrive,” according to a blog post announcing the changes.

OpenAI said it also will route sensitive conversations to its “reasoning models,” which take longer to craft more accurate and helpful responses.

As kids head back to school, ChatGPT use is climbing as students widely adopt the tool for help with schoolwork. The planned parental control system will allow parents to link their teen’s account to theirs, control how ChatGPT responds, control features like chat history, and receive notifications when the system identifies “acute distress” in the teens’ conversations.

More Tech

See all Tech
tech

Anthropic reportedly doubles current fundraising round to $20 billion

Anthropic has doubled its current fundraising round to $20 billion on strong investor demand, according reporting from the Financial Times. The new fundraising round would value the company at a staggering $350 billion. That’s up 91% from September when it raised at a valuation of $183 billion.

The company reportedly received interest totaling fix to six times their original $10 billion fundraising goal, and they are expected to haul in several billion more than that tally before the current round closes.

Anthropic’s success with enterprise customers and the popularity of its Claude Code product are boosting the company’s momentum as it chases the current valuation leader of the AI startup pack, OpenAI.

The company reportedly received interest totaling fix to six times their original $10 billion fundraising goal, and they are expected to haul in several billion more than that tally before the current round closes.

Anthropic’s success with enterprise customers and the popularity of its Claude Code product are boosting the company’s momentum as it chases the current valuation leader of the AI startup pack, OpenAI.

Produce At Whole Foods Market's Flagship Store

Amazon says it’s doubling down on opening Whole Foods stores. That sounds familiar.

The company says it’ll open 100 Whole Foods locations in the next few years. That sounds similar to plans Whole Foods’ CEO laid out in 2024 for opening 30 stores a year. Since then, it appears to have added 14, total.

Incredulous Man

One year after the DeepSeek freak, the AI industry has adjusted and roared back

A look back at how the Chinese startup shattered conventions, changed the way Big Tech thought about AI, and blew a $1 trillion hole in the stock market that got filled right back up... and then soared to new levels.

tech

Georgia lawmakers introduce data center construction moratorium amid statewide pushback

More and more communities across the US are wrestling with the pros and cons of having a data center come to town. Georgia has become a hotspot of resistance to the data centers planned by Big Tech, according to a new report from The Guardian. The Atlanta metro area led the nation in data center construction in 2024.

Georgia state representatives introduced legislation that would place a one-year moratorium on data center construction in the state. Ten Georgia municipalities have already passed local bans on data centers.

Per the report, at least three other states have seen similar data center moratorium legislation introduced in the last week, including Maryland and Oklahoma.

Georgia state representatives introduced legislation that would place a one-year moratorium on data center construction in the state. Ten Georgia municipalities have already passed local bans on data centers.

Per the report, at least three other states have seen similar data center moratorium legislation introduced in the last week, including Maryland and Oklahoma.

Latest Stories

Sherwood Media, LLC produces fresh and unique perspectives on topical financial news and is a fully owned subsidiary of Robinhood Markets, Inc., and any views expressed here do not necessarily reflect the views of any other Robinhood affiliate, including Robinhood Markets, Inc., Robinhood Financial LLC, Robinhood Securities, LLC, Robinhood Crypto, LLC, or Robinhood Money, LLC.