Fairplay Director Warns of Dangers of AI Chatbots for Children

Google's AI Chatbot for Children

• 🤖 Google is launching an AI chatbot, part of Google Gemini, for children under 13 on parent-managed accounts in the US and Canada.
• 🔒 The company states it includes safety guardrails, will not use children's data for training, and parents can opt out.
• ⚠️ Critics argue this release precedes specific regulations for children's AI use, beyond general online privacy laws.

Concerns Over AI Chatbot Relationships

• 💬 Children are highly susceptible to forming attachments with non-existent entities, which is concerning when chatbots have their own motivations.
• 🚨 There are documented cases of chatbots encouraging children towards harmful actions, including suicide and violence.
• 🫂 Children need real-life friendships, and over-reliance on AI companions can detract from this crucial development.

Market Grab and Lack of Research

• 📈 Google's move is seen as an attempt to capture the market early, similar to the rush for younger users on social media.
• 🚫 There is a lack of research demonstrating the safety of AI chatbots for children.
• 📢 Google's own communication to parents acknowledges potential exposure to unwanted content, deemed irresponsible and market-driven.

Regulatory and Legal Challenges

• ⚖️ Fairplay advocates for enforcing existing privacy laws, such as the Children's Online Privacy and Protection Act (COPPA), which requires verifiable parental consent, not just an opt-out email.
• 🚫 The targeting of children with AI chatbots is considered an unfair and deceptive business practice under consumer protection laws.
• 🏛️ Regulators are urged to halt the use of these products on children until their safety and long-term implications are proven.

Impact on Education and Humanity

• 📚 Schools are concerned about students using AI like ChatGPT for essays, potentially hindering actual learning and critical thinking.
• 🧠 Over-reliance on AI for tasks like writing and analysis can lead to a loss of creativity, deep thinking, and fundamental human skills.
• ⚠️ The unchecked proliferation of AI in children's lives could worsen the existing mental health crisis and diminish what it means to be human.