AI Financial Chatbots Have Provided Inaccurate Advice
Popular AI models frequently failed on financial queries, with some errors creating risks of significant tax penalties.
Updated on Sept. 19, 2026 in Financial Planning
Live Poll
Would you rely on an AI chatbot to provide advice on complex financial decisions?
AI chatbots from developers including OpenAI and Google provided incorrect answers to financial queries 57 percent of the time in a study of 10,000 inquiries. Complex multi-calculation questions proved particularly unreliable, with some models failing 88 to 99 percent of the time.
Why it matters
As one in five UK adults express openness to using AI for financial decision-making, the current lack of regulation means users face risks like incorrect pension tax guidance. One specific error by an AI model regarding tax rules carried a potential penalty of 17,500 pounds.
AI models failed 88 percent of complex multi-calculation financial questions, with some models failing 99 percent of the time. These errors can lead to real-world costs, such as a 17,500 pound charge risk identified in one pension tax rule scenario.
The players
Financial Conduct Authority
The regulatory body that oversees conduct in the UK financial services industry.
Claude Opus 5
A high-performing AI model that produced incorrect financial responses in 39 percent of tested cases.
Claude Haiku 4.5
An AI model whose error regarding pension tax rules highlighted potential financial risks for users.
The details
Researchers tested 18 different AI models by submitting over 100 money-related questions repeatedly. The models frequently hallucinated financial rules or omitted critical tax changes during their analysis. While paid models generally performed more accurately than free versions, even the top-performing model, Claude Opus 5, provided incorrect answers in 39 percent of cases.
Timeline
Claude Haiku 4.5 was released last year.
The Financial Conduct Authority published research on investor trust last month.
Two-thirds of younger investors expect to increase AI usage for financial matters next year.
Money Landscape
The widespread inaccuracy of these models highlights the risks within a sector that currently lacks regulatory oversight for consumer financial guidance. This uncertainty arrives as younger investors increasingly plan to lean on automated tools for their complex financial planning needs.
Users should treat AI-generated guidance as unverified information rather than professional financial advice. Always consult with a qualified financial or tax professional before acting on figures or rules provided by a chatbot.
The takeaway
The high error rate of AI models makes them unreliable for complex financial or tax-related calculations. When in doubt, verify information through official government portals or by speaking with a qualified tax advisor.
Further reading
For more on managing your financial choices, visit our section on Financial Planning.
Live Poll
Would you rely on an AI chatbot to provide advice on complex financial decisions?
