The Quiet Casualties of the AI Era │ How Organisations Are Using AI for Decision-Making and Why Human Judgement Still Matters
Introduction
You ask an app for directions to a street you've driven down a hundred times. You let autocomplete finish your sentence before you've decided what you meant to say. You take a photo of a document instead of reading it, trusting the summary a model hands back. None of these moments feel like a loss. Each one is, on its own, a reasonable trade of effort for convenience. But add them up across a year, a career, an industry, and you start to wonder what exactly we've been trading away. Every technology wave produces its own founding myth. For AI, the myth is that intelligence can be manufactured at scale, bottled into a model, and dispensed on demand - cheaper, faster, and eventually better than the human original. It's a seductive story, and one we've been telling ourselves so uncritically that we've stopped noticing what it costs.
The casualties of this bet are rarely dramatic. Nobody announces that a skill has quietly atrophied, or that a habit of independent judgement has gone unused long enough to weaken. These losses don't show up as headlines; they show up later, as gaps, when the system that was supposed to think for us turns out not to have been thinking at all. Ford Motor Company's recent decision to rehire around 350 veteran engineers, after leaning heavily on AI-driven quality systems, is a small but telling data point.¹ The lesson isn't that automation failed outright — it's that a process can be automated without the judgement that made the process work ever being captured in the first place. That distinction between automating a task and actually preserving the human expertise behind it is the real subject of this AI moment.
How Organisations Are Using AI in Decision-Making
More organisations are now leaning on AI not just to execute tasks, but to help shape decisions. Deloitte's 2026 Global Human Capital Trends survey found that 60% of executives now regularly use AI to support their decisions, and the same report cites Gartner's projection that by 2027, half of all business decisions will be augmented or automated by AI agents. Companies like Netflix and Amazon are often pointed to as examples of this working well using AI to enhance recommendations and logistics while keeping people involved in the interpretation, generating significant value in the process. Elsewhere, results have been more mixed: MIT's "State of AI in Business 2025" study found that 95% of generative AI pilots showed no measurable P&L impact within six months, often because this initiative failed to integrate feedback or adapt to context rather than because the underlying model was flawed. Critics have noted the study used a narrow definition of success (six-month, bottom-line ROI), so the figure may understate the value AI creates in ways that aren't captured on the P&L. Notably, this is not an argument against using AI. It is an argument about how we use it and why the human-in-the-loop principle, keeping people actively involved in judgement rather than passively rubber-stamping outputs, is not a compliance checkbox but the thing that determines whether automation actually works. That distinction, between automating a task and preserving the human expertise behind it, is the point of contention.
Finding the Balance
The lesson isn't to use AI less, it's to be deliberate about where it sits in the process. The strongest results come from pairing AI's speed with human judgement, not swapping one for the other. That means keeping a clear owner for important decisions, checking that the model is optimising for the right goal, and treating its output as a strong first draft rather than a final answer. Used this way, AI doesn't replace thinking, it gives good judgement more room to work.
Two Framings We Should Retire
Conversations about AI adoption keep falling into two lazy framings. The first is AI versus humans, as if technology and workforce are locked in a zero-sum contest for relevance. The second is AI versus jobs, reducing every discussion to headcount and displacement. Both are legitimate concerns, but they crowd out a more urgent question: as AI gets embedded deeper into how decisions are made, what happens to the quality of the decisions themselves? This is not a question about whether AI is useful and it plainly is. It is a question about what gets quietly outsourced along with the task, and whether anyone notices before it matters.
Why “Wisdom of Crowds” Does Not Automatically Apply to AI
A comforting analogy often gets reached for: surely, with millions of people using the same models, errors will average out, the way independent forecasters tend to converge on accurate estimates.² That analogy breaks down where it matters most. The wisdom-of-crowds effect depends on independent thinking, genuinely diverse information, and an aggregation mechanism that does not distort the signal. When millions of people query the same underlying model, those conditions collapse. Everyone draws from the same statistical engine, trained on overlapping data, tuned toward similar “safe” answers. The apparent agreement is not corroboration, it is an echo. This creates a genuinely new risk: AI can be confidently, fluently, and uniformly wrong across an entire organisation at once, without the friction that would normally surface an error in a single person's judgement.
The Casualties, Named Plainly
Several things erode quietly when organisations are not deliberate about integrating AI into decisions. Independent judgement is the first casualty of the willingness to form a view before checking what the model says. Verification effort follows: generative AI collapses retrieval and generation into one fluent output, and people invest less effort checking something that already sounds complete and well-reasoned. Diversity of thought narrows as more decision-makers lean on the same handful of models for research and drafting, quietly reducing the range of framings available when it matters most. Accountability becomes harder to trace when a recommendation generated by a model and passed along with minimal scrutiny creates a strange vacuum where a decision was made but nobody quite owns it. And informational anchoring sets in, where a signal becomes a coordination point simply because everyone is looking at it, regardless of its accuracy.
Why Human-in-the-Loop Is a Design Requirement
“Human in the loop” often becomes a rubber-stamp step rather than genuine scrutiny. That is a mistake, because the functions humans provide are structural, not decorative. Context that a model cannot infer history, relationships, unstated constraints shapes whether a reasonable-sounding answer is right in a specific situation. Domain expertise built over years lets someone recognise when a fluent answer is subtly wrong. Ethical judgement decides trade-offs a model has no standing to make on an organisation's behalf. Accountability means someone can be asked why a decision was made and answer from reasoning, not from “the system recommended it.” And the rarest function of all is the willingness to challenge a convincing answer and resisting the very fluency that makes AI output persuasive.
What This Looks Like in Practice
For organisations, the goal is not slowing AI adoption but being deliberate about where human judgement stays load-bearing. AI output should default to draft status until a qualified person has actively tested its logic against context the model lacks. Teams using the same AI tools for analysis should build in a step that actively seeks disagreement, rather than assuming convergence means correctness. Ford's decision to bring engineers back to lead design reviews is instructive: expertise, once encoded into a system, is not safe to let atrophy in the people who built it.³ Verification should be visible and required for decisions with real financial, legal, safety, or reputational consequences. And organisations should track which decisions were AI-assisted and who owned the final call, so accountability stays traceable rather than quietly disappearing.
Conclusion
Decades ago, management thinkers warned that automating a broken process only helps an organisation fail faster. The AI era raises the stakes on that warning: judgement itself, the hard-won capacity to reason well under uncertainty, can be automated away without anyone deciding to give it up. Machines already process information faster than any team of people. What they cannot yet do is originate the wisdom that comes from human experience, accountability, and the willingness to be told one is wrong. That capacity erodes not because AI is powerful, but because organisations stop deliberately exercising it. The real task ahead is not resisting AI, but ensuring that as it takes on more of the work of deciding, humans deliberately keep hold of the responsibility of deciding.
References
- https://www.assemblymag.com/articles/100186-ford-rehires-veteran-engineers-to-improve-ai-vehicle-quality
- https://finance.yahoo.com/technology/ai/articles/ford-rehires-veteran-engineers-ai-144332497.html
- https://finance.yahoo.com/technology/ai/articles/ford-rehires-more-300-engineers-162210705.html
- https://www.msn.com/en-us/money/other/ford-rehires-hundreds-of-engineers-after-ai-struggles-to-improve-quality/ar-AA26P4QB?ocid=BingNewsSerp
- https://www.foxbusiness.com/technology/ford-rehires-experienced-engineers-after-ai-misses-mark
- https://www.livemint.com/opinion/online-views/artificial-wisdom-of-crowds-jobs-crisis-ai-technology-automation-openai-model-11785009289768.html
- https://www.deloitte.com/us/en/insights/topics/talent/human-capital-trends/2026/decision-making-with-ai.html
- https://www.hpcwire.com/aiwire/2026/03/04/deloittes-state-of-ai-2026-why-enterprise-execution-is-falling-behind-adoption/ and Legal.io summary: https://www.legal.io/blog/5719519/MIT-Report-Finds-95-of-AI-Pilots-Fail-to-Deliver-ROI-Exposing-GenAI-Divide
- https://www.marketingaiinstitute.com/blog/mit-study-ai-pilots

.webp)
