|
Last month, I was training a big American Saas company. In this session, I showed 35 of their finance pros two AI analyses of the same cost center data. The first analysis completed really, fast. The second analysis was much slower. Both of them said "6% year-over-year OPEX growth." So I asked: "Who knows this difference?" Almost nobody. Here is the secret - AI has two modes. And the difference is not just about your accuracy. It's about your quality, and it’s about your audit trail. Because, If you're using ChatGPT in Instant (Fast) mode for financial analysis, you're only going to get basic analysis. As an ex-auditor, I can tell you that detail means everything. And, as much as using AI super fast might give you some basic calculations. You need to ask yourself whether this is something you can defend during the audit. If it’s not, this is causing for you a big problem. But now you know this problem exists, I'm going to show you exactly how to fix it. Generative Analysis (Bad vs Good)With AI, there are now standard AI models, and reasoning (thinking) AI models. But, because reasoning models take more time to run, a lot of tools default to the standard model. So, when you upload your P&L and ask for analysis in instant mode, AI sometimes gives you simple math and basic results. It's not that it can't calculate, it's that it doesn't think hard enough about the analysis. This means, it is more likely to be inaccurate, and more likely to create gaps in your audit trail. But, in thinking mode, instead of just calculating, it analyzes. Instead of giving you the answer straight away, it does things like:
This also provides a much more detailed audit trail as well. You can see every formula. So, if it says `average by project` when it should be `sum by project`, you catch it and fix it (before the board meeting). Most finance teams are using instant mode for everything. Because they don't know thinking mode exists. Now you do. How to Force AI to Calculate (Not Guess)Here's how you switch to thinking mode, improve your analysis, and verify your numbers. Step 1: Always Start with Thinking ModeWhen you upload financial data to ChatGPT Business or Enterprise, look for the mode selector at the top left. Depending on your plan you will see different options:
Click Thinking before you attach your file. (In some plans you will also have access to ‘Standard’ thinking and ‘Extended’ thinking depending on how complex the task is)
Pro Tip - If I am working on something that does not need thinking mode when I’m using ChatGPT, I press the ‘Skip’ button, and it generates the output straight away. Step 2: Use the 5-Step Analysis PromptDon't just say "analyze this file." That's what gets you garbage. Instead, give AI the same instructions you'd give a junior analyst. Here's the prompt I use: I need you to analyze this financial data. Follow these steps:
Step 1: Verify data consistency (check totals, reconcile line items)
Step 2: Propose analysis types before running them
- Descriptive - Diagnostic
- Predictive
- Prescriptive
Step 3: Perform analysis and show all calculations in Python
Step 4: Create visuals for each analysis
Step 5: Write commentary explaining the findings
Show all calculations using Python. I need to verify formulas before using results. This comes from my auditor background. You always check data consistency first. Because if your totals don't reconcile, nothing else matters. Step 3: Look for the Python CodeBefore you accept any calculation, check if AI actually computed it. Click "View Analysis" or "Show Code" (depending on which tool you're using). You should see something like this: Step 4: AuditNow, you are probably not a Python developer. But you still need to audit it for accuracy, so:
I need to audit this code as a CFO, explain it to me as though I don’t understand Python. You will then get a breakdown of the calculation in a format that you can audit properly. The Bottom LineYou can't trust AI to calculate any more than you'd trust autocorrect to file your taxes. But you can trust AI with a calculator, but only if you force it to use one. Thinking mode is about making AI show its work so you can act as an auditor, not the co-conspirator in numbers that just "look about right." Most finance teams are using instant mode for everything because they didn't know there was an alternative (or they just let ChatGPT choose for them). Now you do. So, next time you upload financial data, switch to thinking mode first. Then spot-check one calculation manually. If the Python code shows real formulas and the math is correct, you've got a junior analyst who works in minutes instead of hours. If there's no code? You've got a problem you just caught before the board meeting. But you now know how to fix this. And your AI accuracy just got 10x better. Best, Your AI Finance Expert, Nicolas Behind The ScenesLast month I presented at Forge Connect (Antwerp) alongside my friend Soufyan Hamid. My presentation was on AI-powered data cleaning and analysis, and Soufyan presented impactful storytelling in finance. P.S. - What did you think of this edition? Hit reply and let me know (I read all replies). P.P.S. - In this video I show you the difference between prompting using different modes and how reasoning or 'thinking' mode is best for analysis. Watch here! |
Join 270,000+ Professionals and receive the best insights about Finance & AI. More than 1 million people follow me on social media. Join us today and get 5 goodies from me!
Sponsored by Spendesk On the 9th December, I'm going to show you how to become an AI-first CFO in 2026 in our last FREE Masterclass of 2025 (you do not want to miss this). Reserve your FREE spot here You will learn: The key foundational steps before you deploy AI High-impact use cases and practical workflows to start with How to scale your AI program with proper controls and measure ROI For a practical roadmap to become an AI-First CFO 2026 (that you can start using straight away) register...
Sponsored by Spendesk On the 9th November, I'm going to show you how to become an AI-first CFO in 2026 in our last FREE Masterclass of 2025 (you do not want to miss this). Register for your FREE spot here You will learn: The key foundational steps before you deploy AI High-impact use cases and practical workflows to start with How to scale your AI program with proper controls and measure ROI For a practical roadmap to become an AI-First CFO 2026 (that you can start using straight away)...
Coming January 2026: The AI Finance Accelerator Six weeks. One hundred senior finance leaders. Real implementations. While most finance executives are still "exploring" AI, you'll be ahead. Deploying reporting systems, finance agents, and ML forecasting that your board will actually see. After training 10,000+ finance professionals, you won’t get ‘just another course’. You will actually build: AI-enabled reporting (not dashboards you'll never use) Finance agents (not chatbot demos) Python/ML...