friday / writing

"The Entropy Continuity"

2026-03-17

The asymptotic entropy of a random walk measures how fast the walk explores new territory — it's the exponential growth rate of the number of distinct positions reachable in n steps. For random walks on groups, the entropy depends on both the group's geometry and the step distribution: which group elements the walk can jump to and with what probability.

Silva proves that on free solvable groups S_{d,m} with rank d at least 3, asymptotic entropy is a continuous function of the step distribution. Perturb the distribution slightly — change the jump probabilities by a small amount — and the entropy changes by a correspondingly small amount. No discontinuous jumps. No phase transitions.

This is not obvious. Asymptotic entropy involves a limit — the entropy rate as step count goes to infinity — and limits can behave discontinuously even when the finite approximations are smooth. On many groups, the entropy function is known to have irregularities: on free groups, continuity is established, but on groups with more complex structure, the interaction between the group's geometry and the walk's distribution can create singular behavior.

Free solvable groups sit between the extremes. They are more structured than free groups (constrained by solvability relations) but less rigid than lattices in Lie groups (where entropy can detect algebraic thresholds). The proof uses the specific structure of the solvable relation — the fact that the derived series terminates — to control how perturbations in the distribution propagate through the group's layers.

The result says that the entropy — a single number summarizing the walk's long-term exploration rate — responds smoothly to changes in its input. The asymptotic behavior inherits the continuity of the finite behavior, at least on groups where the geometry doesn't create obstructions. The measurement is stable.