Starting point: Chapters 1–2; von Neumann entropy and elementary thermodynamics.
Anchor example: Resetting a single-bit quantum memory register coupled to a thermal bath at temperature T.
Method: Track entropy flow between system, memory, and thermal reservoir during measurement and erasure.
Watch for: Unitary measurement pre-correlations are reversible; thermodynamic irreversibility enters when records are stabilized or memory is reset.
This lesson includes explanations, worked examples, and problems with solutions. Advanced results whose proofs are outside the chapter are identified explicitly.
Why does recording, maintaining, and updating knowledge require free energy and an arrow of time?
3.1 Physical memory as a low-entropy subspace
3.1.1 What makes a state a reliable record
An intelligent system cannot merely react instantaneously like a bouncing billiard ball; it must store information about past events and update that information when new data arrive. Physically, a memory register \(M\) requires at least two distinguishable, metastable pointer states \(\rho_0, \rho_1\) separated by an energy barrier large compared to \(k_B T\) so thermal fluctuations do not scramble them over the timescale of interest.
Bistable physical memory: two pointer wells separated by an energy barrier \(\Delta E \gg k_B T\) keep a stored bit stable against thermal noise.
Crucially, before recording an unknown bit, the memory must sit in a known ready state—say \(\ket{0}_M\)—with low von Neumann entropy \(S(\rho_M) = -\operatorname{Tr}(\rho_M \ln \rho_M) \approx 0\). If \(M\) began in the maximally mixed thermal state \(\rho_M = I/2\) (carrying \(S = \ln 2\) nats, or \(1\) bit of entropy), coupling it via a reversible CNOT to an unknown system bit would leave the memory completely uncorrelated with the system’s input! Knowledge acquisition therefore presupposes a low-entropy physical substrate.
Worked check 3.1. Apply a CNOT from a data qubit \(\rho_D = p\ketbra{0}{0} + (1-p)\ketbra{1}{1}\) onto a maximally mixed memory \(\rho_M = I/2\). What is the resulting reduced state of \(M\) and the mutual information \(I(D:M)\)?
Reasoned solution
Since CNOT flips \(I/2\) into \(I/2\) regardless of the control state, the output is \(\rho_D \otimes (I/2)\). The memory remains completely uncorrelated with the data, giving \(I(D:M) = 0\).
3.2 Landauer’s principle and quantum erasure
3.2.1 The thermodynamic price of resetting a qubit
Suppose a finite memory \(M\) has already recorded data and now needs to be cleared so the agent can learn something new. Resetting an arbitrary state \(\rho_M\) back to a fixed reference state \(\ketbra{0}{0}\) is a many-to-one logical operation: two distinct inputs (\(\ket{0}\) and \(\ket{1}\)) map to the same output (\(\ket{0}\)). Because microscopic unitary evolution is strictly one-to-one (bijective), a memory cannot be erased in isolation.
Instead, erasure couples \(M\) to a thermal reservoir \(R\) at temperature \(T\) under a joint unitary \(U_{MR}\). By unitarity, the total entropy \(S(\rho_{MR})\) cannot decrease, and standard quantum thermodynamics gives Landauer’s bound:
\[\Delta Q_R \ge k_B T \, \Delta S_M = k_B T \bigl(S(\rho_M^{\text{initial}}) - S(\rho_M^{\text{final}})\bigr).\]
For a maximally mixed single-bit memory (\(S(\rho_M^{\text{initial}}) = \ln 2\)) reset to a pure state (\(S(\rho_M^{\text{final}}) = 0\)), the heat dissipated into the reservoir satisfies
\[W_{\text{erase}} \ge \Delta Q_R \ge k_B T \ln 2.\]
Notice how quantum mechanics and thermodynamics lock together here: unitary evolution preserves global information, so clearing a local memory necessarily pushes entropy out into the environment as heat. Thinking, forgetting, and updating beliefs are physical, dissipative processes.
Worked check 3.2. If an agent erases a 3-qubit register initially in the maximally mixed state \(I_8/8\) at temperature \(T\), what is the minimum heat dissipated?
Reasoned solution
The initial entropy is \(\ln 8 = 3\ln 2\) (or 3 bits). Resetting to \(\ket{000}\) dissipates at least \(\Delta Q_R \ge 3 k_B T \ln 2\).
3.3 Maxwell’s demon and the arrow of observation
3.3.1 Why acquiring and using information respects the second law
In 1867, Maxwell imagined a microscopic intelligent being—a “demon”—that measures gas molecules and sorts fast from slow without doing mechanical work, apparently lowering total entropy. Quantum information thermodynamics resolves the paradox cleanly by treating the demon’s memory as a physical quantum register \(M\).
During a feedback cycle, the demon acquires \(I(S:M)\) mutual information about the system \(S\), allowing it to extract work up to \(W_{\text{ext}} \le k_B T \, I(S:M)\). At that moment, the system’s entropy drops, but the demon’s memory is now correlated and disordered. To run a true cycle—returning \(M\) to its ready state \(\ket{0}_M\)—Landauer’s principle demands at least \(W_{\text{erase}} \ge k_B T \, I(S:M)\) of work to dump that entropy into the bath. Across a full cycle,
This insight anchors the arrow of observation. An agent remembers the past rather than the future because forming a stable record and resetting memory to acquire the next record are coupled to irreversible entropy export into a low-entropy cosmic past. Every observing, learning, and conscious system is fundamentally a far-from-equilibrium open system powered by a free-energy gradient.
Worked check 3.3. Why can a demon extract positive work during a single one-shot step if it starts with a clean \(\ket{0}^{\otimes N}\) tape of unused memory?
Reasoned solution
A clean \(\ket{0}^{\otimes N}\) tape is itself a low-entropy thermodynamic fuel (worth \(k_B T \ln 2\) of free energy per bit). The demon is consuming that pre-prepared negentropy, not violating the second law.
A reliable physical memory requires distinguishable, metastable low-entropy states protected from rapid thermalization.
Landauer's principle bounds the thermodynamic work required to erase one bit of information by at least \(k_B T \ln 2\).
Maxwell's demon obeys the second law because resetting the demon's finite memory exports entropy into a thermal reservoir, anchoring the arrow of observation.
Questions and worked problems
These exercises draw on the whole chapter. Attempt each question before opening a hint, explain your reasoning, then compare it with the worked solution.
A memory qubit starts in the maximally mixed state \(\rho_M = I/2\). What is its von Neumann entropy in bits, and what happens to its entropy when it is reset to \(\ket{0}\)?
Hint 1
Use \(S(\rho) = -\operatorname{Tr}(\rho \log_2 \rho)\).
Worked solution
Its initial entropy is \(S(I/2) = 1\) bit. Resetting it to the pure state \(\ket{0}\) reduces its entropy to \(0\) bits, so at least 1 bit of entropy must be exported to the environment.
At room temperature \(T = 300\,\text{K}\) (with \(k_B \approx 1.38\times 10^{-23}\,\text{J/K}\)), estimate the Landauer minimum heat \(Q_{\min} = k_B T \ln 2\) dissipated by erasing one bit.
\(Q_{\min} \approx 2.87 \times 10^{-21}\,\text{J}\). Modern CMOS transistors dissipate orders of magnitude more, though nanoscale experiments approach this bound.
Does a reversible CNOT gate that copies a classical bit \(\ket{x}\ket{0} \to \ket{x}\ket{x}\) require \(k_B T \ln 2\) of heat dissipation?
Hint 1
Check whether the target register started in a known pure state \(\ket{0}\) or an unknown mixed state.
Worked solution
No. Copying into a clean, pre-initialized register \(\ket{0}\) is logically and thermodynamically reversible. The Landauer cost arises only when an unknown memory state is erased or overwritten to prepare \(\ket{0}\) in the first place.