What Deming really meant

Deming observed that the greatest barrier to improvement is not a lack of knowledge, but the belief that we already have it. Organizations operate for years in a state he called apparent knowledgea set of practices, procedures, and beliefs that “work” because the system has not yet collapsed. Results are acceptable, customers have not left, and managers can explain everything retrospectively. That is enough to conclude that we understand what we are doing.

The problem is that this “knowledge” is very often not causal in nature. It is based on experience, intuition, correlations, anecdotes, and past successes. Deming emphasized that experience without theory teaches nothing it only reinforces habits. The organization knows what it is doing, but it does not know why it works or under what conditions it will stop working.

The transition to conscious ignorance occurs when someone begins to ask questions that the system cannot answer. Why do results change despite having “good people”? Why does improving one KPI worsen others? Why do actions that worked for years suddenly stop delivering results? This is a very uncomfortable moment, because it undermines leaders’ sense of competence and the meaning of existing practices.

Deming considered this stage essential. Conscious ignorance is not a failure, but the first step toward knowledge. It is a state in which the organization stops pretending it understands the system and begins to truly study it. A willingness emerges to test, to work with data, and to distinguish variation due to randomness from real signals. Without this stage, all “improvement” is just turning knobs without understanding the mechanism.

Deming strongly connects this process with the theory of knowledge (one of the four elements of his system of profound knowledge). Knowledge is not about accumulating facts or best practices. Knowledge is about having a theory that allows you to predict the effects of actions. If we cannot predict what will happen after a change, it means we are still in the realm of ignorance even if we have thousands of data points and years of experience.

Importantly, Deming noted that most management systems actively block the transition to conscious ignorance. KPIs, rankings, performance appraisals, and pressure for quick answers create an illusion of control. Instead of saying “we don’t know,” the organization produces narratives, slides, and justifications. In this way, it remains in a state of apparent knowledge comfortable, but very dangerous.

A mature leader, in Deming’s view, is someone who can remain in a state of not knowing without rushing to close it with false answers. Someone who accepts that “we don’t know yet” and creates the conditions for learning: experimentation, analysis of variation, and building causal models. Only from this state can knowledge emerge that truly improves the system, rather than merely explaining the past.