The prevalence of artificial intelligence (AI) is undeniable. Companies see it as a productivity enhancer. High school and college students rely on it to complete assignments. During the Superbowl, Google’s ad for its Gemini platform showcased how AI can generate images for a move to a new family home to ease the transition for young children.
In mid-March, Anthropic, a self-described “AI safety and research company” surveyed 81,000 users to collect hundreds of quotes about their AI use. Many touched on deeply personal experiences:
“It’s much easier for me to learn without being judged—just friendly feedback. It’s harder with friends or family to get that.”
“I had AI analyze some old messages between me and a friend who has since passed away. It was able to pull such stunning insight out of that, I was shocked … it saw into my soul the way that no living human ever did.”
“My dog died. I fell into my deepest low. Desperate, I turned to an AI chatbot. It showed more understanding than my friends.”
“Who else would be available at 2 a.m. in a moment of anxiety?”
While framed as a tool, AI is seemingly capable of addressing another unique challenge: reproducing human connection. This effort often takes the form of an automated AI conversation bot—or “chatbot”—designed to simulate human conversation via text or voice interactions. In fact, some users prefer AI chatbots over actual human connection.
But as with all technology, it is not without bugs. Across the country, AI users and their families are alleging chatbots contributed to serious concerns for users’ health (including minors). This has prompted a new wave of litigation against chatbot operators, and encouraged lawmakers to consider statutory and regulatory reforms. As a result, the landscape for chatbot use is likely to change dramatically over the coming months and years.
The Rise of Chatbots: AI-Driven Conversations Evolve Into Humanlike Companions
Once the stuff of science-fiction (think, the HAL 9000 in "2001: A Space Odessey"), chatbots can simulate conversations with the end-user as if they were talking to a real person, often in addition to core AI-driven capabilities that provide answers to user-generated questions. A chatbot can even take on the persona of pre-existing fictitious characters in popular media (for example, Daenerys Targaryen from the popular HBO show "Game of Thrones"). Or it can create an entirely customized persona based on the user’s requests or inputs. The range of chatbots is as broad as a user can imagine (and input) within the AI program’s capabilities, subject only to oversight by the chatbot operator.
In the case of child users, chatbots have included imitations of TV characters like the beloved animated Australian blue heeler, Bluey. But user inputs can also lead chatbots to develop mature—and incredibly convincing—personalities that imitate real conversation. Depending on the limitations and age-restrictions of the AI platform, users can receive responses involving violent, explicit, or even sexual content. And some online communities even revolve around chatbots substituting for romantic partners (for example, see the subreddit r/MyBoyfriendIsAI).
The Response to AI Chatbots
All this has left many questioning whether content- and age-based restrictions should be implemented, up to and including an alert system that flags when a user may be facing a serious health crisis.
In recent months, lawsuits have been filed alleging AI chatbots caused harm to users, including wrongful death actions by surviving family members. Notably, at least one state (Kentucky) is taking action, alleging the failure to implement safeguards to protect underage users violated various consumer and data protection laws.
But lawsuits are not the only factor driving change. Earlier this month, Michigan introduced a set of bills to regulate chatbots, including limiting “dangerous” capabilities when the chatbot is used by a minor, strict privacy settings, and limitations on targeted advertising. Violations of the proposed bills would constitute an “unfair trade practice” under consumer protection laws.
Last year, Sen. Josh Hawley launched an investigation into Meta’s AI-powered chatbots, stating the Senate Judiciary’s subcommittee on crime and counterterrorism would be investigating “whether Meta’s generative-AI products enable exploitation, deception, or other criminal harms to children, and whether Meta misled the public or regulators about its safeguards.” More recently, Sen. Bernie Sanders interviewed Anthropic’s proprietary chatbot, Claude, to discuss AI’s potential for widespread economic disruption and exploitation. In the conversation, Claude agreed with Sanders’ proposal for a moratorium on data centers—for which he has since introduced legislation in the Senate with Sen. Alexandria Ocasio-Cortez.
The Future of Chatbots
With the rise of individual suits, increased scrutiny at the state and federal levels, and states like Kentucky prosecuting perceived abuses under existing consumer and data protection laws, AI companies should be mindful of how they operate their various chatbot programs moving forward.
Given the attention to this space, legislatures may likely require AI companies to implement specific safeguards—especially for underage end-users—that mitigate or address potential harms to users. This includes the detection and reporting of potential mental health risks. And companies are also taking steps to regulate their own programs, such as OpenAI, which indefinitely paused its plans for an adult model after receiving internal criticism the model could foster unhealthy emotional dependence on ChatGPT.
As the landscape continues to evolve, AI companies should proactively consider end-user protections that mitigate those risks and maintain compliance with the evolving state and federal regulation landscape. Until then, the conversation surrounding the need for guideposts around chatbots usage will continue to play out in our courts, legislatures, and, equally importantly, in real-world and online communities.
"Let’s Give ’Em Something to Talk About: The Rise of AI Chatbots," by Jeffrey N. Rosenthal, Timothy J. Miller, and Liam M. Leahy was published in The Legal Intelligencer on April 9, 2026. Reprinted with permission.
