Every role is a building.
Know which walls are load-bearing.
Before your organization replaces human judgment with AI, understand the architecture underneath.
Three Layers of Judgment
AI is phenomenal at one type. Blind to another. Completely lost on the third.
Visible Judgment
Data in systems. Patterns in records. Structured decisions with clear feedback loops.
Contextual Judgment
AI can surface the inputs but can't make the call. Requires interpretation, calibration, reading the room.
Invisible Judgment
Relationships. Institutional memory. The informal signal layer that only comes from being there.
Two Rules That Change Everything
Learn these before you automate anything.
The 94% Trap
When someone says "AI handles 94%," ask: 94% of the volume or 94% of the consequences?
The Bottleneck Principle
One load-bearing invisible component makes the whole role unsafe to fully automate.
Three Gates Before You Automate
Ask these questions or face predictable disasters.
Gate 1: Values
What values govern these decisions? Has anyone written them down?
Gate 2: Liability
If AI gets this wrong, what's the worst-case damage?
Gate 3: Escalation
When AI hits a case it can't handle, what's the human path?
The Confidence Problem
AI doesn't just get things wrong. It gets things wrong with certainty.
Ellis George Law Firm: AI generated complete legal citations for cases that never existed. The system was certain. The lawyers trusted it. The bar fined them $31,000.
Turnitin: AI was certain students cheated. Flagged over 5,000 for AI-generated work. Wrong 61% of the time for non-native English speakers.
Air Canada: The algorithm predicted refund decisions with high confidence. It was wrong. The company paid the cost, not the algorithm.
What Happens When You Get It Wrong
The Architecture Collapse
Elon Musk cut 80% of Twitter's workforce without understanding the judgment architecture underneath. Content moderation, infrastructure, advertiser relationships, compliance—each team looked overstaffed on paper. But they weren't independent systems. They were connected by invisible judgment.
Remove the walls that aren't "core" to the function? The whole building collapses.
What Happens When You Get It Right
The Collaboration Model
Markel used Cytora AI to process applications and flag risks automatically. But they didn't eliminate underwriters. They freed them. Underwriters now focus on complex cases, judgment calls, and relationship management. The AI handles visible judgment. Humans handle contextual and invisible judgment.
Stop Renovating Blind
Understand your judgment architecture. Know which walls are load-bearing. Automate the right way.