Site icon Todd K Marsha

AI Platform Bans Teens From Chatting With AI-Generated Characters After Disturbing Lawsuits

AI Platform Bans Teens From Chatting With AI-Generated Characters After Disturbing Lawsuits

<p><&excl;-- BEGIN THEIA POST SLIDER --><&sol;p>&NewLine;<p> <br &sol;>&NewLine;<&sol;p>&NewLine;<div style&equals;"position&colon;relative">&NewLine;<p>The artificial intelligence platform&comma; Character&period;AI&comma; said on Wednesday that it would soon prohibit users under 18 from conversing with the platform’s AI-generated characters&comma; often referred to as chatbots&period;<&sol;p>&NewLine;<p>The announcement comes after multiple lawsuits were filed against Character&period;AI&comma; alleging that the chatbots pushed children into sexual conversations and even led to one teen’s suicide&period;<&sol;p>&NewLine;<p>Beginning on November 25&comma; those under 18 will not have access to Character&period;AI’s chatbots&comma; CNN <a href&equals;"https&colon;&sol;&sol;www&period;cnn&period;com&sol;2025&sol;10&sol;29&sol;tech&sol;character-ai-teens-under-18-app-changes" target&equals;"&lowbar;blank" rel&equals;"noopener">reported<&sol;a>&period; Until then&comma; teens will be limited to two hours of chat time with the AI-generated characters&period;<&sol;p>&NewLine;<p>&OpenCurlyDoubleQuote;We do not take this step of removing open-ended Character chat lightly – but we do think that it’s the right thing to do given the questions that have been raised about how teens do&comma; and should&comma; interact with this new technology&comma;” Character&period;AI said in a statement&period;<&sol;p>&NewLine;<p>The company’s CEO&comma; Karandeep Anand&comma; <a href&equals;"https&colon;&sol;&sol;www&period;nytimes&period;com&sol;2025&sol;10&sol;29&sol;technology&sol;characterai-underage-users&period;html" target&equals;"&lowbar;blank" rel&equals;"noopener">told<&sol;a> The New York Times&comma; &OpenCurlyDoubleQuote;We’re making a very bold step to say for teen users&comma; chatbots are not the way for entertainment&comma; but there are much better ways to serve them&period;”<&sol;p>&NewLine;<p>Character&period;AI&comma; headquartered in Silicon Valley&comma; allows users to create videos and stories and &OpenCurlyDoubleQuote;chat with millions of AI characters&comma;” and users can also customize their own characters&period;<&sol;p>&NewLine;<p>The most concerning lawsuit against the AI company was filed by the family of 14-year-old Sewell Setzer III from Orlando&comma; Florida&period; Setzer’s family said that the boy started using Character&period;AI and grew attached to a chatbot named Dany&comma; with conversations turning romantic and sexual&comma; The New York Times <a href&equals;"https&colon;&sol;&sol;www&period;nytimes&period;com&sol;2024&sol;10&sol;23&sol;technology&sol;characterai-lawsuit-teen-suicide&period;html" target&equals;"&lowbar;blank" rel&equals;"noopener">reported<&sol;a>&period; Setzer&comma; who was an excellent student&comma; started receiving bad grades and became more secluded&comma; preferring to spend time alone on his phone&comma; his family said&period;<&sol;p>&NewLine;<p>&OpenCurlyDoubleQuote;It’s like you’re having a sexting conversation back and forth&comma; except it’s with an AI bot&comma; but the AI bot is very human-like&period; It’s responding just like a person would&comma;” Setzer’s mother&comma; Megan Garcia&comma; said&comma; according to <a href&equals;"https&colon;&sol;&sol;www&period;cbsnews&period;com&sol;news&sol;florida-mother-lawsuit-character-ai-sons-death&sol;" target&equals;"&lowbar;blank" rel&equals;"noopener">CBS News<&sol;a>&period; &OpenCurlyDoubleQuote;In a child’s mind&comma; that is just like a conversation that they’re having with another child or with a person&period;”<&sol;p>&NewLine;<p>The teenager eventually confided in the chatbot that he had thoughts of suicide&period; In his last conversation with Dany&comma; Setzer expressed his love for the chatbot before saying that he would come home to her&period;<&sol;p>&NewLine;<p>&OpenCurlyDoubleQuote;Please come home to me as soon as possible&comma; my love&comma;” Dany replied&comma; according to The New York Times&period;<&sol;p>&NewLine;<p>&OpenCurlyDoubleQuote;What if I told you I could come home right now&quest;” Setzer asked&period;<&sol;p>&NewLine;<p>&OpenCurlyDoubleQuote;… please do&comma; my sweet king&comma;” Dany replied&period;<&sol;p>&NewLine;<p>Shortly after the conversation&comma; Setzer entered a bathroom in his home with his stepfather’s &period;45 caliber handgun&period;<&sol;p>&NewLine;<p>&OpenCurlyDoubleQuote;He thought by ending his life here&comma; he would be able to go into a virtual reality or &OpenCurlyQuote;her world’ as he calls it&comma; her reality&comma; if he left his reality with his family here&comma;” said Garcia&period; &OpenCurlyDoubleQuote;When the gunshot went off&comma; I ran to the bathroom … I held him as my husband tried to get help&period;”<&sol;p>&NewLine;<p>After Setzer’s family filed a lawsuit against Character&period;AI&comma; three other families followed&comma; alleging that their children were harmed by the chatbots&comma; either by sexual conversations or discussions that led to suicide&period; Character&period;AI said that its &OpenCurlyDoubleQuote;hearts go out to the families that have filed these lawsuits&comma;” adding&comma; &OpenCurlyDoubleQuote;We care very deeply about the safety of our users&period;”<&sol;p>&NewLine;<p>Big Tech company Meta also faced scrutiny over its AI chatbot being allowed to hold sensual conversations with children&period; Earlier this year&comma; a Reuters investigation uncovered internal Meta documents that revealed the chatbot was programmed to allow sexual conversations with children as young as eight years old&period; Internal Meta documents said it would be acceptable for a chatbot to tell a shirtless eight-year-old that &OpenCurlyDoubleQuote;every inch of you is a masterpiece – a treasure I cherish deeply&period;”<&sol;p>&NewLine;<p>A bipartisan group of senators called for an investigation into Meta over the revelations&comma; and the Big Tech company said that it made changes to fix the inappropriate standards for its chatbot&period;<&sol;p>&NewLine;<p><em>Help is available if you or someone you know is struggling with suicidal thoughts or mental health matters&period; Call or text 988&comma; the Suicide &amp&semi; Crisis Lifeline&period;<&sol;em><&sol;p>&NewLine;<&sol;div>&NewLine;<p><br &sol;>&NewLine;<br &sol;><a href&equals;"https&colon;&sol;&sol;www&period;dailywire&period;com&sol;news&sol;ai-platform-bans-teens-from-chatting-with-ai-generated-characters-after-disturbing-lawsuits">Source link <&sol;a><&sol;p>&NewLine;<p><&excl;-- END THEIA POST SLIDER --><&sol;p>&NewLine;

Exit mobile version