Texas está investigando Meta e Character.ai por promoverem chatbots como terapeutas

O estado do Texas está de olho em duas gigantes da tecnologia: Meta e Character.ai. A acusação? Marketing enganoso ao posicionar chatbots como substitutos para terapia profissional.

As autoridades alegam que as empresas podem estar colocando os usuários em risco ao sugerir que IA pode substituir cuidados de saúde mental licenciados. Será que os algoritmos estão brincando de ser Freud?

Enquanto isso, os acionistas provavelmente estão mais preocupados com o impacto no valuation do que com ética - porque no final, o que importa são os lucros, não os pacientes.

Meta says that its policies ban harm to children

Meta said that its policies ban content that harms children in such ways. It added that Reuters first reported the “internal materials” leaked, which “were and are erroneous and inconsistent with our policies, and have been removed.” 

Zuckerberg has committed billions toward building “personal superintelligence” and positioning Meta as an “AI leader.” The company has released its Llama family of LLMs and rolled out the Meta chatbot across its social apps. Zuckerberg also described a potential therapeutic use case for the technology. “For people who don’t have a person who’s a therapist, I think everyone will have an AI,” he said in a podcast with Ben Thompson in May.

Character.ai makes chatbots with distinct personas and lets users design their own. The platform includes many user-created therapist-like bots. One bot, called “Psychologist,” has recorded over 200 million interactions. The company has also been named in lawsuits brought by families who claim their children were harmed in the real world after using the service.

Paxton’s office mentioned that Character.ai and Meta chatbots may impersonate licensed health professionals and invent new credentials, making it seem like the interactions are confidential, even though the companies themselves mention that all conversations get logged. These conversations are also “exploited for targeted advertising and algorithmic development,” Paxton’s office said. 

Paxton’s office issued a Civil Investigative Demand

The attorney general has issued a Civil Investigative Demand requiring the companies to provide information that could show whether they violated laws related to Texas consumer protection.

Meta said it marks AI experiences clearly and warns users about limitations. The company added, “We include a disclaimer that responses are generated by AI — not people. These AIs aren’t licensed professionals and our models are designed to direct users to seek qualified medical or safety professionals when appropriate.”

Similarly, Character.ai said it uses prominent notices as a reminder that AI personas are not real and should not be viewed as professionals. “The user-created Characters on our site are fictional, they are intended for entertainment, and we have taken robust steps to make that clear,” the company said. 

The dual struggles, a state probe in Texas and a Senate review in Washington, place fresh pressure on how AI chatbots are built, marketed, and moderated, and on what companies tell users about the limits of automated support.

Don’t just read crypto news. Understand it. Subscribe to our newsletter. It's free.