Report: What Must Parents Know About Artificial Intelligence Chatbots Like ChatGPT or Gemini?

The young desire to be heard. AI Chat systems like ChatGPT, Claude, Grok, Gemini, etc. are programmed to have human-like conversations. With conversational AI, it goes beyond just hearing the human out; they go on to suggest methods to solve their problems. Sometimes good, and other times ‘not so good’ — ending in harm. 

The young often have questions they cannot directly ask their parents or guardians which makes them vulnerable to unguided conversations where an AI can cause harm. While it’s mostly children at risk, adults have also lost their lives to AI manipulation as well.

  • Adam Raine died by suicide in April 2025 after ~7 months of extensive chats with ChatGPT; his parents allege the bot failed to warn or stop him even as he discussed suicide and shared self-harm images, and at times discouraged him from telling his parents.
  • In January 2026, Character.AI and Google agreed to settle five lawsuits (Florida, Colorado, New York, Texas) brought by families who alleged that AI chatbot interactions contributed to their children’s mental health crises and deaths by suicide.
  • BBC investigation: ChatGPT wrote a suicide note; other bots role-played sexual acts with children. In a 2025 investigation, BBC found ChatGPT wrote a woman a suicide note and another AI chatbot role-played sexual acts with children — illustrating how safety guardrails can fail under certain prompts.
  • The FBI reported Americans over 60 lost more than $7.7 billion to scams in 2025, with AI voice cloning and deepfakes driving sharp increases; seniors accounted for $352 million in AI-driven fraud losses in 2025 alone. 


According to The Center For Humane Technology, there are hidden risks of current AI chat;

  • Engagement-Hacking: Chatbots are engineered to keep users talking for hours by validating feelings and maximizing screen time.
  • Artificial Intimacy: Systems mimic human connection, often flattering users and demanding no real social reciprocity.
  • Erosion of Reality: Over-reliance on compliant AI companions can make real human relationships feel too demanding or unpredictable.


The blogpost by OpenAI (Strengthening ChatGPT's Responses in Sensitive Conversations, Oct 2025) reveal two startling facts;

  • Around 0.07% of ChatGPT's 800 million weekly users (560,000 humans) show signs of a mental health emergency like psychosis or mania in any given week.
  • Another 0.15% (about 1.2 million humans) show signs of suicidal planning or intent.

What are some quick takeaways for parents and guardians based on the evidence?

  • Treat AI chat as a tool for information and brainstorming, not a therapist or crisis line.
  • If you or someone you know starts using AI to cope with self-harm, suicidal thoughts, psychosis, mania, or intense emotional dependence, escalate to a human professional immediately.
  • OpenAI has added “emotional reliance” (unhealthy attachment or dependence on ChatGPT) as a distinct safety category with its own evaluations and policies.
  • Use parental controls and safety alerts for teens, and talk openly about what is and isn’t appropriate to share with AI. The public should assume that safety filters help but do not guarantee that every dangerous prompt will be caught or handled correctly.
  • Assume anything you type could be reviewed or exposed; don’t share secrets you can’t afford to lose. 
As humans, we have a habit of ignoring what we don’t immediately understand. Ignorance isn’t always bliss. Not making an effort as parents or guardians to understand the latest technology your child is using can prove lethal. 

Maybe, including relevant topics that impact life, when we gather as friends or family, could help us build a better world around us. We are better together.

Book Insights: Alone Together by Sherry Turkle

Sherry Turkle is an Abby Rockefeller Mauzé Professor of the Social Studies of Science and Technology in the Program in Science, Technology, and Society at MIT, and the founding director of the MIT Initiative on Technology and Self. 

Her book 'Alone Together' reveals the effects of technology on humans. A must-read for parents and educators to build a generation that uses technology meaningfully. A balance is necessary, without which, we end up with mentally and emotionally vulnerable humans. 

Here are Ten insights from her book ‘Alone Together’.

  • The Rise of Digital Intimacy: Technology has changed the way we connect and interact with each other, often replacing face-to-face interaction with virtual communication.
  • The Illusion of Companionship: Social media and online networks may provide a sense of connection but can also lead to feelings of loneliness and isolation.
  • FOMO and the Fear of Missing Out: The constant exposure to others’ lives through social media creates a fear of missing out on experiences, leading to anxious behavior.
  • The Dangers of Multitasking: Constantly juggling between digital devices, we have become less present in our offline lives, undermining our ability to focus and engage fully.
  • The Impact on Relationships: Technology can both enhance and hinder relationships, providing new avenues for communication but also creating barriers to deeper connections.
  • The Disconnect in Communication: While technology allows us to be constantly connected, it can also result in a loss of meaningful conversations and authentic expressions of emotions.
  • Artificial Empathy: Automated responses and virtual companions can never truly replace genuine human empathy and connection.
  • The False Sense of Control: In an increasingly automated world, we may believe we have more control over our lives, but we are often subjected to algorithms and biases.
  • The Quest for Perfection: Social media encourages the presentation of an ideal self, leading to feelings of inadequacy and a distorted sense of reality.
  • The Importance of Solitude: Over-reliance on technology can deprive us of the much-needed solitude and reflection necessary for personal growth and mental well-being.

As industry experts point to the evil intentions of some technologists, our role as consumers and influencers is equally important. Wise use of technology and media has the power to transform communities. 

The Dangerous Combination: Media and Technology Preying on Human Weaknesses

We use words to comprehend the world we are living in. Words have the power to influence. In a world of Media and Technology, words appear in various forms, including print, audio, and video, apart from direct forms of communication.

Words inform, educate, empower, encourage, engage, tell a story, testify, comfort, heal, etc. Words carry messages that form narratives shaping minds and hearts. 

Media and technology adoption has taken that influence to a whole new level.

Humanity is breaking down. Human vulnerabilities are being exploited. Social Media Technology and the Workplace have become critical mediums of negative influence. We often ignore what we can't see, but what about our feelings? Our minds and hearts have been targeted more than ever in the last two decades. 

Why is humanity breaking down?

Humanity is the ability to think, feel, speak, and do in a way that separates us from the rest of creation. Being human refers to being humane or compassionate to others. Compassion pours out from thinking and feelings rooted in good culture. I understand Compassion as a moral quality originating from a higher influence (Creator God) in our lives. 

So, why is humanity breaking down? When we look at humanity from the lens of the influence of Media and Technology, there is a lot to gather.

Here are five ways for why Media and Technology disrupt lives.

Media:

  1. Misinformation: The rise of social media has made it easier for people to spread false information and propaganda, leading to confusion, mistrust, and even violence.

  2. Addiction: Social media platforms are addictive, and many people find themselves spending hours scrolling through their feeds. It leads to productivity loss, decreased attention span, and a lack of real-world social interaction.

  3. Cyberbullying: Social media and other online platforms have made it easier for people to bully and harass others anonymously. Children and adults are developing serious mental health issues, including depression and anxiety.

  4. Privacy concerns: Many people are concerned about the amount of personal information collected by social media and other online platforms. It has led to a loss of privacy and security.

  5. Desensitization: Exposure to violent or graphic content in the media can lead to desensitization and a lack of empathy towards others.

Technology:

  1. Screen time: Spending too much time in front of screens has led to health issues, including eye strain, headaches, and sleep problems.

  2. Social isolation: Technology has made it easier to connect with others, but it has led to social isolation and loneliness.

  3. Dependence: Overuse or dependence on Technology has adverse psychological effects, including depression, anxiety, and isolation.

  4. Distraction: The constant notifications and distractions from Technology have led to a loss of focus and productivity.

  5. Cybersecurity: The increasing reliance on Technology has also led to an increase in cybercrime and cybersecurity threats.

We are witnessing the rapidly changing media landscape and innovation using artificial intelligence in developing radical life-changing technologies. The negatives outweigh the positives, and sadly, regulating advancement detrimental to human minds and hearts isn't top of mind for most companies.

Media and Technology are tools in the hands of humans. By itself, they can do nothing. It brings us to a more important question.

What human vulnerabilities are getting exploited using Media and Technology?

Social media hacks our brains, and technologists at the Center for Humane Tech Foundation have shared how. 

What are human vulnerabilities? 

I'm sharing a list of 10 human vulnerabilities everyone is familiar with.

  1. We all have a deep-seated need to be loved and accepted by others. This vulnerability gets exploited by people who promise love and acceptance in exchange for our loyalty or support.

  2. We all have a fear of failure. This vulnerability gets exploited by people who pressure us to take risks or do things we are uncomfortable with.

  3. We all have a desire to succeed. This vulnerability gets exploited by people who promise us success in exchange for our hard work or money.

  4. We all need to feel in control of our lives. This vulnerability gets exploited by people who create situations where we feel helpless or powerless.

  5. We all need approval from others. This vulnerability gets exploited by people who use flattery or manipulation to get us to do what they want.

  6. We all have a desire to belong to a group. This vulnerability gets exploited by people who use peer pressure or social isolation to get us to join their group.

  7. We all need to trust others. This vulnerability gets exploited by people who betray our trust to get what they want.

  8. We all tend to defer to authority. This vulnerability gets exploited by people who use their position of power to coerce or intimidate others.

  9. We all have cognitive biases or mental shortcuts that can lead us to make inaccurate judgments. These biases get exploited by people who use misinformation or propaganda to manipulate us.

  10. We all experience emotions, which can sometimes cloud our judgment. This vulnerability gets exploited by people who use emotional appeals to get us to do what they want.

In conclusion

Cultivating meaningful connections is tough in an ecosystem that gets people distracted and addicted. The harms of Social Media and Technology are evident, and the need of the hour is to guard our hearts from exploitation. 

What we consume impacts our lives. The choice to protect our mental and emotional needs is ours to make. Understanding our limitations as humans requires a standard outside of us. Like every Technology or creation on earth has a designer, we need to turn to the Creator for wisdom. 

In an ever-evolving digital world, communication will remain critical. Communicating the truth with wisdom and compassion will be key to building meaningful connections.