Why We Need Cybernetics in the Age of AI

In 1960 Norbert Wiener wrote in Science: “If we use, to achieve our purposes, a mechanical agency with whose operation we cannot efficiently interfere once we have started it… we had better be quite sure that the purpose put into the machine is the purpose which we really desire.”

Sixty-five years later, that sentence could open almost any paper on AI safety. And yet the field it came from has been largely absent from the conversation. We would like to gently suggest five reasons it deserves a seat at the table.

1. AI systems are control systems

Modern AI is trained by feedback. A model makes a prediction, measures its error, and adjusts. Reinforcement learning from human feedback tunes models toward outputs people rate highly. Recommendation systems learn from the behaviour they shape. Agents act, observe results, and act again.

These are cybernetic loops. Cybernetics has seventy years of concepts for analysing them: stability, oscillation, runaway amplification, goal drift, and the difference between the variable a system is told to control and the one it actually controls.

2. The proxy problem is a control problem

AI systems optimise measurable proxies: engagement, approval ratings, benchmark scores. Over time the system may get very good at the proxy while drifting from what people actually wanted. Economists call this Goodhart’s law. In cybernetic terms, the question is what is actually being controlled. Perceptual Control Theory frames it precisely: a system controls its perception of a variable, and if that perception is a proxy, it will push the proxy wherever it can, by whatever path is available.

3. Oversight needs requisite variety

Ashby’s Law of Requisite Variety says a regulator must be able to produce as many distinct responses as the disturbances it faces. AI systems generate outputs at a speed and variety no human review team can match. A regulator with less variety than the system it regulates cannot control it. It can only sample, set boundaries, or amplify its own variety, for example with automated tools, layered oversight, or by reducing the variety of what the system is allowed to do. Any credible governance scheme for AI is a variety-engineering problem, whether or not it uses the term.

4. The observer is inside the loop

Second-order cybernetics says observers cannot step outside the systems they describe. That applies to AI in at least three ways:

Evaluation shapes the system. Benchmarks become training targets, and the measure changes what is measured.
Users adapt. People change how they write, search, and think in response to AI, and that changed behaviour becomes future data.
Designers are participants. The choices of the people building AI systems, including what counts as helpful or harmful, shape how the system behaves.

5. The unit of analysis is the larger system

An AI model is one component of a socio-technical system that includes companies, users, regulators, data pipelines, markets, and the information environment. Stafford Beer’s Viable System Model asks whether such a system has all the functions it needs to remain viable: operations, coordination, control, intelligence about the future, and a clear identity. Many current AI deployments are strong on operations and weak on the functions that let a system notice it is going wrong and change course.

What cybernetics does not offer

Cybernetics will not hand anyone a technical solution to alignment, and it would be unwise to pretend otherwise. What it offers is a set of questions and a way of seeing: tracing loops, paying attention to regulation, and keeping the observer inside the picture. Those questions belong to no single discipline, which is exactly why they so often fall between computer science, policy and ethics.

A practical start

The Diagnostic Toolkit on this site turns five cybernetic ideas into questions you can ask of any system, including AI deployments. Start with the first: what is this system actually controlling?