During a conversation with local school officials, reporter Ella Napack was told of a concern that some students were struggling after having been lured into relationships with AI chatbot “companion” apps that mimicked boyfriends and girlfriends. Napack found that school officials around the state were dealing with this issue, while many parents remained in the dark about the hidden world of AI chatbots on their kids’ phones.
AI companion chatbots – technology that allows users to have relationships with chatbots on the other side of a text message exchange – are designed to form emotional and often sexual attachments with users. Napack tested chatbots and found that all escalated explicit content with users who identified as middle school aged.
The result was a chilling and revelatory examination of how AI companion app companies were targeting children with advertising and pushing sexually explicit conversations to minor users. The reporting has also prompted legislative action on both the local and national level.
