| ISSUE 022 | 22 MAY 2026 | BROADCAST LIVE
--:--:-- UTC LIBRARY
SOS DATA FEED  ·  L&D METRICS TERMINAL  ·  LIVE
NPS SCORE ↑ 94%  ✓        COMPLETION RATE ↑ 97%  ✓        LEARNER SATISFACTION ↑ 91%  ✓        ACTUAL SKILL TRANSFER  ???  ↓        NPS SCORE ↑ 94%  ✓        COMPLETION RATE ↑ 97%  ✓        LEARNER SATISFACTION ↑ 91%  ✓        ACTUAL SKILL TRANSFER  ???  ↓   
KNOWLEDGE TEST PASS RATE ↑ 88%  ✓        ENGAGEMENT INDEX ↑ 86%  ✓        CERTIFICATION COMPLETIONS ↑ 312  ✓        BEHAVIOR CHANGE 90 DAYS OUT  ???  ↓        KNOWLEDGE TEST PASS RATE ↑ 88%  ✓        ENGAGEMENT INDEX ↑ 86%  ✓        CERTIFICATION COMPLETIONS ↑ 312  ✓        BEHAVIOR CHANGE 90 DAYS OUT  ???  ↓   
MANAGER 360 FEEDBACK ↑ 4.7 / 5.0  ✓        GOODHART'S LAW  ACTIVE  ⚠        SESSION RATINGS ↑ 4.9  ✓        DECISION QUALITY UNDER PRESSURE  UNMEASURED        MANAGER 360 FEEDBACK ↑ 4.7 / 5.0  ✓        GOODHART'S LAW  ACTIVE  ⚠        SESSION RATINGS ↑ 4.9  ✓        DECISION QUALITY UNDER PRESSURE  UNMEASURED   
TIME-ON-TASK ↑ 18 MIN AVG  ✓        REPEAT LOGINS ↑ 68%  ✓        VOLUNTARY PRACTICE REPETITION  ???        COBRA EFFECT  SEE SIGNAL 02  ⚠        TIME-ON-TASK ↑ 18 MIN AVG  ✓        REPEAT LOGINS ↑ 68%  ✓        VOLUNTARY PRACTICE REPETITION  ???        COBRA EFFECT  SEE SIGNAL 02  ⚠   
LEVEL 1 SMILE SHEET ↑ 96%  ✓        LEVEL 2 KNOWLEDGE TEST ↑ 91%  ✓        LEVEL 3 BEHAVIOR APPLIED  NOT TRACKED        LEVEL 4 RESULTS  NOT TRACKED        STRATHERN 1997  STILL CORRECT  ⚠        LEVEL 1 SMILE SHEET ↑ 96%  ✓        LEVEL 2 KNOWLEDGE TEST ↑ 91%  ✓        LEVEL 3 BEHAVIOR APPLIED  NOT TRACKED   
ANOMALY DETECTED — SIGNAL 022

The board is full of good-looking numbers. Something is off. Every metric is green. The thing we actually came here to change is nowhere on the screen.

SOS-022
// SIGNAL-OS DATA BROADCAST //
22 MAY
2026
ISSUE 022 · LIVING INCOME
When the Metric Becomes the Target
GOODHART'S LAW · L&D SYSTEMS
COBRA EFFECT · MEASUREMENT FAILURE
BROADCAST LIVE
All metrics above are real proxies used in real L&D programs.
The red ones are what you actually came here to build.
// SIGNAL-OS DATA BROADCAST // When the Metric Becomes the Target ISSUE 022 · LIVING INCOME · 22 MAY 2026
SIGNAL 01 THE LAW

Goodhart's Law

In 1975, British economist Charles Goodhart was studying monetary policy when he noticed something that would outlive his career and colonize every measuring institution on earth: "Any observed statistical regularity will tend to collapse once pressure is placed upon it for control purposes."

Goodhart, C.A.E. (1975). Problems of Monetary Management: The U.K. Experience. Reserve Bank of Australia.

Twenty-two years later, anthropologist Marilyn Strathern reframed it in the language that stuck: "When a measure becomes a target, it ceases to be a good measure." She was writing about university audit systems in Britain. She could have been writing about every training program you've ever designed.

Strathern, M. (1997). Improving Ratings: Audit in the British University System. European Review, 5(3), 305–321.
metric
from Greek metron — a measure · a tool for knowing distance
A meter is a tool, not a goal. You use it to know where you are. The moment you use it to prove where you are, the reading starts lying to you. You've confused the map for the territory — the instrument is no longer pointing at the world; it's pointing at your need to look good. Every practitioner who has sat in a meeting defending their NPS score knows this feeling from the inside.
A measuring tape — the tool that becomes the target

The tool was built to measure distance. Not to be the destination. — Unsplash

This is not a flaw in the people doing the measuring. It is a structural property of any system that ties incentives to indicators. The indicator and the thing it was pointing at start to diverge — slowly at first, then completely. By the time you notice, you've been optimizing the wrong thing for years.

SIGNAL 02 IN THE ROOM

The Practitioner's Version

You have seen this play out. Not as a theory — as a Tuesday. Here is what Goodhart's Law looks like from inside the room:

Completion rates as a proxy for learning. The LMS shows 97% completion. People clicked through every slide to get the certificate. The learning took twelve minutes. The forgetting started fourteen minutes later.

NPS scores as a proxy for impact. Participants rate to be nice. They rate the facilitator's energy, the quality of the coffee, the fact that they got out of the office for a day. Kirkpatrick Level 1 — the smile sheet — was designed to be one input, not the verdict.

Competency checklists as a proxy for competence. Once people know the rubric, they learn to perform the rubric. The checklist stops pointing at the skill and starts pointing at checklist-passing behavior.

Knowledge tests as a proxy for decision quality. A person can score 91% on a post-module assessment and still make the same bad call under pressure — because pressure is not on the test.

Muller, J.Z. (2018). The Tyranny of Metrics. Princeton University Press. — 250 pages of case studies from healthcare, policing, higher education, and financial services, all demonstrating the same structural failure.
A cobra — the animal at the center of an unintended consequence
⚠ THE COBRA EFFECT — BRITISH INDIA, 19th C.

The British colonial government, alarmed by the cobra population in Delhi, offered a bounty for every dead cobra brought to the office. Logical intervention. Clear metric. The result: entrepreneurs began breeding cobras to collect the bounty. When the government discovered the farms and cancelled the program, the breeders released their stock. The cobra population rose. The incentive created the opposite of the intended outcome — not because the people were malicious, but because the measure became the target.

Siebert, H. (2001). Der Kobra-Effekt: Wie man Irrwege der Wirtschaftspolitik vermeidet. DVA. — German economist Horst Siebert coined the term. The mechanism is universal.

Your learning programs are not growing cobras. But they may be growing completion certificates, favorable ratings, and knowledge-test scores — while the behavior change you promised your client remains unmeasured and therefore unknown.

SIGNAL 03 THE RESEARCH

The Literature

Goodhart's Law did not begin in L&D — Learning & Development, the industry that designs and measures workplace training. It began in monetary economics, traveled through anthropology and higher education auditing, and arrived in the training room via organizational psychology. The convergence of these lineages is the story worth understanding.

Research library — four fields of knowledge converging on the same structural flaw

Monetary economics → anthropology → psychology → your training room. Four fields. One mechanism. — Unsplash

"When a measure becomes a target, it ceases to be a good measure."
— Marilyn Strathern, 1997

Alfie Kohn's Punished by Rewards (1993) arrived at the same conclusion from a different direction: incentive structures — including the meta-incentive of being rated and evaluated — undermine intrinsic motivation. When the external measure is present, the internal signal quiets. Practitioners who design for scores may be actively suppressing the autonomous motivation that makes learning durable.

Kohn, A. (1993). Punished by Rewards: The Trouble with Gold Stars, Incentive Plans, A's, Praise, and Other Bribes. Houghton Mifflin.

Donald Campbell's 1979 formulation — now called Campbell's Law — adds a social dimension: "The more any quantitative social indicator is used for social decision-making, the more subject it will be to corruption pressures and the more apt it will be to distort and corrupt the social processes it is intended to monitor." The institutional pressure to show results doesn't just distort measurement. It distorts the thing being measured.

Campbell, D.T. (1979). Assessing the Impact of Planned Social Change. Evaluation and Program Planning, 2(1), 67–90. — Campbell's work on social indicators predates Strathern's popularization and offers the corruption-pressure framing that explains why the distortion is systematic, not personal.

Donella Meadows, writing in Thinking in Systems, frames the deeper issue as an information flow problem: the feedback loop that should correct the system is receiving the wrong signal. The system is not broken — it is working exactly as designed. It is designed around the wrong metric.

Meadows, D. (2008). Thinking in Systems: A Primer. Chelsea Green Publishing.
SIGNAL 04 THE METRICS BOARD WHAT YOU MEASURE VS. WHAT YOU NEED
WHAT WE MEASURE
WHAT WE ACTUALLY NEED
01 Completion Rate
01 Durable skill change — behavior still present 90 days later
02 NPS / Smile Sheet Score
02 Behavior applied in a novel situation, without a coach watching
03 Knowledge Test Score
03 Decision quality under real pressure, with real stakes
04 Engagement Metrics (time-on-task, clicks, logins)
04 Voluntary repetition of the practice when nobody is counting
05 Certification Pass Rate
05 Confidence and competence under novel, unsupported conditions
06 Manager 360 Feedback Score
06 Team outcomes over 12 months — observable, measurable, real
SIGNAL 05 THE MECHANISM

Why Smart People Still Do It

Understanding Goodhart's Law intellectually does not stop practitioners from chasing the wrong metrics. If it did, the training industry would have fixed this in 1997. The law is clear. The behavior persists. There must be a competing commitment operating beneath the surface.

A lock — the competing commitment that keeps practitioners chasing the wrong metrics
KEGAN & LAHEY — IMMUNITY TO CHANGE

The competing commitment behind metric-chasing is the need to prove value. Practitioners who cannot show transformation numerically face an existential threat to their work, their budget, their seat at the table. The metric isn't just a measurement — it is a survival tool. The assumption underneath it: if I can't show the number, I don't get to keep doing the work. This competing commitment (prove value numerically) protects a big assumption (value only counts if it is countable) and it runs hot enough to override the intellectual understanding that the metric is lying.

Kegan, R. & Lahey, L.L. (2009). Immunity to Change: How to Overcome It and Unlock Potential in Yourself and Your Organization. Harvard Business Review Press.

This is why information alone does not fix Goodhart's Law in practice. The practitioners who know the law still report the same metrics — because the competing commitment (show a number that justifies your existence) runs deeper than the knowledge. Fixing this requires working at the level of identity, not data literacy.

MELIORIST FRAME · CONSTRUCTIVE STEWARDSHIP
Extracting Value While Appearing to Create It

Constructive stewardship means stewarding your measurement systems as carefully as your learning systems. If your metrics are optimizing for something other than the outcome you claim to serve, the system is extracting value from clients — their time, attention, money, trust — while appearing to create it. That is wealth extraction disguised as wealth creation. The practitioners who earn income commensurate with their actual impact are the ones who can point to real change in the people they serve. Not because they are more virtuous. Because they built measurement systems that couldn't lie to them.

SIGNAL 06 COUNTER-MOVES

Breaking the Goodhart Trap

The trap is structural. The counter-moves are also structural — design choices, not willpower choices. Here are five that work:

01
Use leading indicators, not lagging ones. Measure the behaviors that produce the outcome — not a proxy for the outcome. If the goal is better coaching conversations, measure the number of coaching conversations held this week, not the 360 score in six months. The leading indicator is harder to fake.
02
Use multiple metrics in tension. When metrics conflict, they become harder to game simultaneously. Pair a speed metric with a quality metric. Pair a completion metric with a follow-through metric. A practitioner optimizing two conflicting measures has less room to optimize only the one that looks best.
03
Qualitative + quantitative. A number plus a story is harder to fake than a number alone. Ask participants to describe one specific moment they applied the skill, not just whether they would recommend the program. The story is your Level 3 check — and it is free to collect.
04
Measure the measure. Periodically ask: is this metric still pointing at what I think it is? Goodhart's Law does not operate all at once — it drifts. An annual audit of your measurement system, asking whether each metric is still a good proxy for the outcome you care about, catches drift before it becomes corruption.
05
The Dragonfly Question (Meadows). Donella Meadows named the dragonfly after an insect that can see in almost every direction simultaneously. The question: What would you need to measure to know if this is actually working? Ask it before you start, not after. The answer often reveals that the real thing you need to measure is not in your current system — and that is exactly the information you need.
Meadows, D. (2008). Thinking in Systems: A Primer. Chelsea Green. — The Dragonfly concept appears in Meadows' systems leverage points work; the "measure the measure" practice is derived from her intervention on information flows.
SIGNAL 07 FIELD WORK

Your Three Metrics

90-SECOND FIELD WORK

Pull your three most-used training metrics — the ones you report to clients, managers, or funders. For each one, work through this sequence:

  • Write down the actual behavior change you are trying to create. Be specific: not "improved communication" — "fewer escalations in the first conversation."
  • Ask: does this metric point directly at that behavior, or at a proxy? If it's a proxy, how many steps removed is it from the real thing?
  • Ask: could someone score well on this metric without the behavior change actually happening? If yes, your metric is a Goodhart candidate.
  • Ask: what would you need to measure to know if the real thing happened? You don't have to measure it yet — just name it. Naming it changes what you notice.
SOURCES BIBLIOGRAPHY
01 Goodhart, C.A.E. (1975). Problems of Monetary Management: The U.K. Experience. Reserve Bank of Australia.
02 Strathern, M. (1997). Improving Ratings: Audit in the British University System. European Review, 5(3), 305–321.
03 Muller, J.Z. (2018). The Tyranny of Metrics. Princeton University Press.
04 Kohn, A. (1993). Punished by Rewards. Houghton Mifflin.
05 Siebert, H. (2001). Der Kobra-Effekt. DVA.
06 Kegan, R. & Lahey, L.L. (2009). Immunity to Change. Harvard Business Review Press.
07 Meadows, D. (2008). Thinking in Systems: A Primer. Chelsea Green.
08 Campbell, D.T. (1979). Assessing the Impact of Planned Social Change. Evaluation and Program Planning, 2(1), 67–90.