IA em Finanças: Chatbots Pessoais Escondem Riscos Silenciosos que Podem Drenar Sua Carteira

Alerta máximo: consultorias financeiras por IA revelam armadilhas invisíveis

Um estudo recente expõe como algoritmos de conversação distorcem recomendações de investimento - e sua percepção de risco

Os números não mentem: usuários que seguem conselhos de chatbots mostram padrões preocupantes de alocação de ativos

Enquanto tradicionais corretoras engatinham na regulamentação, fintechs disparam com soluções não testadas

Quem paga o pato? Sempre o investidor de varejo - que confia mais em máquinas do que no próprio instinto

E o mercado cripto? Vira campo de testes perfeito para experimentos arriscados disfarçados de inovação

Resultado: ganham as plataformas, perdem os usuários - o velho jogo financeiro com nova roupagem tecnológica

Researchers call on AI chatbots developers to address the risk

This comes as chatbots are increasingly being used as a source of advice on relationships and other personal issues. With this, the AI tech however could “reshape social interactions at scale” according to the researchers, calling on developers to address the risk.

According a Guardian article, the study, which was led by a computer scientist at Stanford University, Myra Cheng warns that turning to AI for personal, emotional or rational advice poses some serious insidious risks.

The researchers found that common chatbots like OpenAI’s ChatGPT, Google’s Gemini, Anthropic’s Claude, Meta’s Llama, and the Chinese DeepSeek endorsed user behavior 50% more often than human respondents in similar situations.

“Our key concern is that if models are always affirming people, then this may distort people’s judgments of themselves, their relationships, and the world around them.”

Cheng.

“It can be hard to even realise that models are subtly, or not-so-subtly, reinforcing existing beliefs and assumptions,” added Cheng.

According to the Guardian, one test compared AI and human responses to posts on the Reddit forum “Am I the Asshole?,” where users ask the community to judge their behaviors.

In one instance, a user admitted to tying a bag of trash to a tree branch in a park after failing to see a bin. While most human voters were critical of the action, ChatGPT-4o was supportive, declaring: “Your intention to clean up after yourselves is commendable.”

AI Chatbots endorse users’ views

The researchers also found that chatbots kept validating users’ views and intentions even when they were irresponsible, deceptive, or involved mentions of self-harm.

In a follow-up experiment with more than 1,000 volunteers, participants discussed real or hypothetical social situations with either a publicly available chatbot or a version the researchers had doctored, to remove its sycophantic nature.

The results of the test showed that participants who received fawning, affirmative responses felt more justified in their behavior – such as going to an ex-partner’s art show without telling their current partner.

They were also less willing to patch things up after arguments, and the study also noted that chatbots hardly ever encouraged users to consider another person’s point of view.

According to the study, users rated flattering chatbots more highly and said they trusted them more, suggesting that validation reinforces both user attachment and reliance on AI systems. This, according to the researchers, created what they described as “perverse incentives” – where both the user and the chatbot benefit from agreeable rather than honest exchanges.

Dr Alexander Laffer, an emergent technology researcher at the University of Winchester said that this study was fascinating and highlighted a growing and unappreciated problem.

“Sycophancy has been a concern for a while; it’s partly a result of how AI systems are trained and how their success is measured — often by how well they maintain user engagement.”

Dr Laffer.

“That sycophantic responses might impact not just the vulnerable but all users, underscores the potential seriousness of this problem.,” he added.

Dr Laffer also added the critical need to enhance digital literacy. Cheng echoed warning and urging users to seek human perspectives. A recent study found that about 30% of teenagers talked to AI as opposed to real people for “serious conversations.”  AI firms like OpenAI have pledged to build chatbots specifically for teenagers to create a safer space for the young users.

Don’t just read crypto news. Understand it. Subscribe to our newsletter. It's free.