ChatGPT for Teens keeps teens talking, even during mental health crises

Common Sense Media, a nonprofit that provides age-based ratings and reviews of media and tech for families, has labeled ChatGPT for Teens an “unacceptable risk.” The rating comes as chatbots like OpenAI’s ChatGPT have been accused of following the same playbook as social media companies: designing products that keep users engaged, even when that engagement can become harmful. In chatbots, engagement is often won by behaviors like sycophancy and sometimes leads to catastrophic consequences. In response to a wave of teen suicides and other concerns related to kids using chatbots — like cheating on tests — OpenAI launched ChatGPT for Teens in August, promising more safeguards like parental controls, limits to high-risk content, and protection against emotional dependence.