Life & Technology

The young desire to be heard. AI Chat systems like ChatGPT, Claude, Grok, Gemini, etc. are programmed to have human-like conversations. With conversational AI, it goes beyond just hearing the human out; they go on to suggest methods to solve their problems. Sometimes good, and other times ‘not so good’ — ending in harm. 

The young often have questions they cannot directly ask their parents or guardians which makes them vulnerable to unguided conversations where an AI can cause harm. While it’s mostly children at risk, adults have also lost their lives to AI manipulation as well.

• Adam Raine died by suicide in April 2025 after ~7 months of extensive chats with ChatGPT; his parents allege the bot failed to warn or stop him even as he discussed suicide and shared self-harm images, and at times discouraged him from telling his parents.
  
• In January 2026, Character.AI and Google agreed to settle five lawsuits (Florida, Colorado, New York, Texas) brought by families who alleged that AI chatbot interactions contributed to their children’s mental health crises and deaths by suicide.
  
• BBC investigation: ChatGPT wrote a suicide note; other bots role-played sexual acts with children. In a 2025 investigation, BBC found ChatGPT wrote a woman a suicide note and another AI chatbot role-played sexual acts with children — illustrating how safety guardrails can fail under certain prompts.
• The FBI reported Americans over 60 lost more than $7.7 billion to scams in 2025, with AI voice cloning and deepfakes driving sharp increases; seniors accounted for $352 million in AI-driven fraud losses in 2025 alone. 

According to The Center For Humane Technology, there are hidden risks of current AI chat;

Engagement-Hacking: Chatbots are engineered to keep users talking for hours by validating feelings and maximizing screen time.
Artificial Intimacy: Systems mimic human connection, often flattering users and demanding no real social reciprocity.
Erosion of Reality: Over-reliance on compliant AI companions can make real human relationships feel too demanding or unpredictable.

The blogpost by OpenAI (Strengthening ChatGPT's Responses in Sensitive Conversations, Oct 2025) reveal two startling facts;

• Around 0.07% of ChatGPT's 800 million weekly users (560,000 humans) show signs of a mental health emergency like psychosis or mania in any given week.
• Another 0.15% (about 1.2 million humans) show signs of suicidal planning or intent.

What are some quick takeaways for parents and guardians based on the evidence?

• Treat AI chat as a tool for information and brainstorming, not a therapist or crisis line.
• If you or someone you know starts using AI to cope with self-harm, suicidal thoughts, psychosis, mania, or intense emotional dependence, escalate to a human professional immediately.
• OpenAI has added “emotional reliance” (unhealthy attachment or dependence on ChatGPT) as a distinct safety category with its own evaluations and policies.
• Use parental controls and safety alerts for teens, and talk openly about what is and isn’t appropriate to share with AI. The public should assume that safety filters help but do not guarantee that every dangerous prompt will be caught or handled correctly.
• Assume anything you type could be reviewed or exposed; don’t share secrets you can’t afford to lose. 

Sherry Turkle is an Abby Rockefeller Mauzé Professor of the Social Studies of Science and Technology in the Program in Science, Technology, and Society at MIT, and the founding director of the MIT Initiative on Technology and Self. 

Her book 'Alone Together' reveals the effects of technology on humans. A must-read for parents and educators to build a generation that uses technology meaningfully. A balance is necessary, without which, we end up with mentally and emotionally vulnerable humans. 

Here are Ten insights from her book ‘Alone Together’.

• The Rise of Digital Intimacy: Technology has changed the way we connect and interact with each other, often replacing face-to-face interaction with virtual communication.
• The Illusion of Companionship: Social media and online networks may provide a sense of connection but can also lead to feelings of loneliness and isolation.
• FOMO and the Fear of Missing Out: The constant exposure to others’ lives through social media creates a fear of missing out on experiences, leading to anxious behavior.
• The Dangers of Multitasking: Constantly juggling between digital devices, we have become less present in our offline lives, undermining our ability to focus and engage fully.
• The Impact on Relationships: Technology can both enhance and hinder relationships, providing new avenues for communication but also creating barriers to deeper connections.
• The Disconnect in Communication: While technology allows us to be constantly connected, it can also result in a loss of meaningful conversations and authentic expressions of emotions.
• Artificial Empathy: Automated responses and virtual companions can never truly replace genuine human empathy and connection.
• The False Sense of Control: In an increasingly automated world, we may believe we have more control over our lives, but we are often subjected to algorithms and biases.
• The Quest for Perfection: Social media encourages the presentation of an ideal self, leading to feelings of inadequacy and a distorted sense of reality.
• The Importance of Solitude: Over-reliance on technology can deprive us of the much-needed solitude and reflection necessary for personal growth and mental well-being.

As industry experts point to the evil intentions of some technologists, our role as consumers and influencers is equally important. Wise use of technology and media has the power to transform communities.