Articulate before you automate: the judgement that protects your profit
Part of your profit rests on decisions only a few experienced people know how to make. To articulate that judgement is to write down what they notice, weigh and decide, before AI takes over the work around it.
The board paper says AI will take hours out of the work. It does not say which decisions will change, or who will catch the wrong ones.
A training library, a handover meeting or a tool that learns an executive’s style can each help. None of them, on its own, tests whether the judgement survived.
And adding AI does not settle it. A 2024 meta-analysis of 106 experiments found that people and AI together beat people alone on average. But they did worse than the better of the two working alone (Vaccaro, Almaatouq and Malone, 2024).
Layer 4: Judgement Intelligence
A research paper from BusinessGPS on the judgement behind business decisions: how to find it, test it and protect it when you bring in AI. It brings together published research, with every source cited, and sets out how we design decision support.
What the paper shows you
- Why experience, confidence and seniority are not proof that a judgement is sound.
- How to rebuild real decisions with the people who made them, and test the result on a case where the same answer would be wrong.
- Three questions to keep apart: how a decision was made, whether it was sound and who is authorised to make it.
- How to test AI support against how the decision is made today, before you trust it.
Short on time? Read the short version on our blog: Articulate the judgement that protects your profit before you automate around it.
Automating a task can remove the judgement around it
An AI business case can count the hours a task takes and stop there. The paper looks at the decision around the task: what the expert notices, what goes wrong without it and who may decide. Automate the visible task alone, and a wrong decision travels faster.
About BusinessGPS
BusinessGPS helps organisations own the capacity to change. We are the custodian of Transformation Capability Management, a proposed standard for running change, and we wrote its first draft.
The research behind the paper
The paper draws on published research, cited in full. Among its sources:
- Kahneman, D. and Klein, G. (2009). Conditions for Intuitive Expertise: A Failure to Disagree. American Psychologist.
- Klein, G., Calderwood, R. and Macgregor, D. (1989). Critical Decision Method for Eliciting Knowledge. IEEE Transactions on Systems, Man, and Cybernetics.
- Vaccaro, M., Almaatouq, A. and Malone, T. W. (2024). When combinations of humans and AI are useful. Nature Human Behaviour.
We hold our own work to the same standard of evidence. We publish our own Baseline report, red steps included.
Read the paper: Layer 4: Judgement Intelligence
Want to see how far the decisions behind your change are written down? Start with the Baseline.