Lecture 7

When integrability fails

What this lecture does

Course map: G1, step 7 of 9, which shows why the goal is exceptional. Lecture 5 and Lecture 6 built the integrable world: tori, actions, frequencies. This lecture perturbs it. Poincaré’s theorem says that a perturbation, under conditions stated exactly, destroys the integrals, and the KAM theorem says that most of the tori survive anyway. Between the two, resonant tori generically break into island chains and chaos. In the Hénon–Heiles system we see island chains and chaotic scatter that resemble this picture, beside the three-particle Toda ring it truncates, whose plotted orbits stay on smooth curves.

Reading and tutorial. Material marked Reading is studied on your own; material marked Tutorial is worked in the tutorial. Everything else is the lectured core.

7.1 The question

Lecture 6 made the motion of an integrable system free in action–angle variables, on tori labelled by the actions. Real systems are at best close to integrable. So the question is

what happens to the tori when an integrable system is perturbed — and how do you see it?

Two theorems answer the first half, one destructive and one constructive; the section map answers the second. The worked example is Hénon–Heiles (§7.6), set beside the Toda ring that Lecture 8 and Lecture 9 will solve.

7.2 Poincaré’s non-existence theorem

Imported from Lecture 6: near a torus of an integrable system there are action–angle coordinates (φ,I)(\varphi,I), φ∈Tn\varphi\in T^{n}, II in an open set D⊂RnD\subset\R^{n}, in which H=H0(I)H=H_0(I) and the motion is φ˙=ν(I)=∂H0/∂I\dot\varphi=\freq(I)=\partial H_0/\partial I, I˙=0\dot I=0 (Theorem 6.5, Corollary 6.4). H0H_0 is non-degenerate if det⁡(∂2H0/∂I2)≠0\det(\partial^{2}H_0/\partial I^{2})\ne0, and then, for n≥2n\ge2, the resonant tori of Definition 6.9 are dense and of measure zero (Figure 6.7).

Poincaré called the following the fundamental problem of dynamics: a nearly integrable system H(φ,I)=H0(I)+εH1(φ,I)+O(ε2),H1=∑k∈Znhk(I) eik⋅φ, H(\varphi,I)=H_0(I)+\varepsilon H_1(\varphi,I)+O(\varepsilon^{2}), \qquad H_1=\sum_{k\in\Z^{n}}h_k(I)\,e^{\ii k\cdot\varphi}, (7.1) with ε\varepsilon small and H1H_1 expanded in a Fourier series in the angles. The planets are the original case: H0H_0 is the motion of each planet round the Sun, and εH1\varepsilon H_1 their mutual attraction.

Example 7.1 (Two rotors in a weak periodic potential). On T2×R2T^{2}\times\R^{2}, with the positions q∈T2q\in T^{2} themselves the angles and p=Ip=I, let H=12∣p∣2+εV(q),H0=12∣I∣2,ν(I)=I.H=\tfrac12\abs{p}^{2}+\varepsilon V(q), \qquad H_0=\tfrac12\abs{I}^{2},\qquad \freq(I)=I . Here ∂2H0/∂I2\partial^{2}H_0/\partial I^{2} is the identity: non-degenerate. Two choices of VV will do different things.

  1. V=cos⁡q1+cos⁡q2V=\cos q_1+\cos q_2 separates: F=12p12+εcos⁡q1F=\tfrac12p_1^{2}+\varepsilon\cos q_1 is an exact second integral, and the system is integrable for every ε\varepsilon.

  2. V=Pr(q1)Pr(q2)V=P_r(q_1)P_r(q_2), where Pr(x)=(1−r2)/(1−2rcos⁡x+r2)=∑m∈Zr∣m∣eimxP_r(x)=(1-r^{2})/(1-2r\cos x+r^{2})=\sum_{m\in\Z}r^{\abs m}e^{\ii mx} for a fixed 0<r<10<r<1. Then hk=r∣k1∣+∣k2∣h_k=r^{\abs{k_1}+\abs{k_2}}: every Fourier coefficient is nonzero.1

What separates the two cases is which Fourier modes act on which resonant tori.

Definition 7.2 (Poincaré set, n=2n=2). The Poincaré set P⊂D\mathfrak P\subset D of (7.1) is the set of II at which some k∈Z2∖{0}k\in\Z^{2}\setminus\{0\} has k⋅ν(I)=0andhk(I)≠0:k\cdot\freq(I)=0\qquad\text{and}\qquad h_k(I)\ne0 : the resonant tori on which a Fourier mode of the perturbation resonates.

For general nn, I∈PI\in\mathfrak P asks for n−1n-1 linearly independent such kk. In Example 7.1, k⋅ν(I)=k⋅I=0k\cdot\freq(I)=k\cdot I=0 is a line through the origin of the II-plane. With V=cos⁡q1+cos⁡q2V=\cos q_1+\cos q_2 only k=±(1,0),±(0,1)k=\pm(1,0),\pm(0,1) have hk≠0h_k\ne0, and P\mathfrak P is the two axes. With V=PrPrV=P_rP_r every rational line through 00 is in P\mathfrak P: it is dense.

Theorem 7.3 (Poincaré; in Kozlov’s form cited). Let H(φ,I,ε)H(\varphi,I,\varepsilon) be real-analytic on Tn×D×(−ε0,ε0)T^{n}\times D\times(-\varepsilon_0,\varepsilon_0), with H(φ,I,0)=H0(I)H(\varphi,I,0)=H_0(I) non-degenerate on DD, and let the Poincaré set P\mathfrak P be dense in DD. Then Hamilton’s equations have no first integral F=F0(φ,I)+εF1(φ,I)+ε2F2(φ,I)+⋯ ,F=F_0(\varphi,I)+\varepsilon F_1(\varphi,I)+\varepsilon^{2}F_2(\varphi,I)+\cdots, a formal power series in ε\varepsilon with smooth coefficients, that is independent of HH.

Here independent is Definition 5.1 read order by order in ε\varepsilon (Kozlov, ch. IV §1). So the second choice of VV in Example 7.1 has no second integral of this kind, and “non-integrable” is a theorem about it, not a report that nobody has found one.

The engine of the proof is visible at first order, and we prove that part in the next section.

7.3 Small denominators

The obvious strategy is to remove εH1\varepsilon H_1 by a canonical transformation close to the identity, as Hamilton–Jacobi removed all of HH in Lecture 6. Take a type-2 generating function (Proposition 4.9) with old positions φ\varphi and new momenta I′I', S(φ,I′)=I′⋅φ+εS1(φ,I′),I=∂S∂φ=I′+ε∂S1∂φ,φ′=∂S∂I′=φ+ε∂S1∂I′.S(\varphi,I')=I'\cdot\varphi+\varepsilon S_1(\varphi,I'), \qquad I=\frac{\partial S}{\partial\varphi}=I'+\varepsilon\frac{\partial S_1}{\partial\varphi}, \qquad \varphi'=\frac{\partial S}{\partial I'}=\varphi+\varepsilon\frac{\partial S_1}{\partial I'} . Substitute into (7.1) and expand H0(I′+ε ∂φS1)H_0(I'+\varepsilon\,\partial_\varphi S_1): H=H0(I′)+ε(ν(I′)⋅∂S1∂φ+H1(φ,I′))+O(ε2). H=H_0(I')+\varepsilon\Big(\freq(I')\cdot\frac{\partial S_1}{\partial\varphi} +H_1(\varphi,I')\Big)+O(\varepsilon^{2}). (7.2) The new Hamiltonian is integrable to first order if the bracket does not depend on the angles. Its angle average is h0h_0, since ∂φS1\partial_\varphi S_1 averages to zero; so we need the homological equation ν(I′)⋅∂S1∂φ=h0(I′)−H1(φ,I′). \freq(I')\cdot\frac{\partial S_1}{\partial\varphi}=h_0(I')-H_1(\varphi,I'). (7.3)

Proposition 7.4 (First-order perturbation theory). On an open set of I′I' on which k⋅ν(I′)≠0k\cdot\freq(I')\ne0 for every kk with hk≠0h_k\ne0, and on which the series below converges together with its first and second derivatives, and for ε\varepsilon small enough, S1(φ,I′)=∑k≠0i hk(I′)k⋅ν(I′) eik⋅φ S_1(\varphi,I')=\sum_{k\ne0}\frac{\ii\,h_k(I')}{k\cdot\freq(I')}\,e^{\ii k\cdot\varphi} (7.4) (terms with hk=0h_k=0 omitted) solves (7.3), and the new Hamiltonian is H0(I′)+εh0(I′)+O(ε2)H_0(I')+\varepsilon h_0(I')+O(\varepsilon^{2}).

Proof. ν⋅∂φeik⋅φ=i(k⋅ν)eik⋅φ\freq\cdot\partial_\varphi e^{\ii k\cdot\varphi}=\ii(k\cdot\freq)e^{\ii k\cdot\varphi}, so the kk-th mode of the left side of (7.3) is i(k⋅ν)sk\ii(k\cdot\freq)s_k and that of the right side is −hk-h_k. Solve: sk=ihk/(k⋅ν)s_k=\ii h_k/(k\cdot\freq).2 

If H0H_0 is non-degenerate and H1H_1 has finitely many Fourier modes, such open sets exist: everything off the finitely many active resonance hypersurfaces k⋅ν(I′)=0k\cdot\freq(I')=0. If the Poincaré set is dense, as for the second rotor of Example 7.1, no open set qualifies.

Every term is divided by k⋅ν(I′)k\cdot\freq(I'), the combination whose vanishing is resonance. On a resonant torus with hk≠0h_k\ne0 — a point of the Poincaré set — the kk-th mode of (7.3) reads 0=−hk0=-h_k, and there is no solution at all. Near one the coefficient is enormous. And for n≥2n\ge2 the resonant tori are dense, so every torus has resonant ones arbitrarily close: these are the small denominators (Figure 7.1). They are not a defect of the method. Near resonance, a small perturbation is not a small change.

Figure 7.1. Small denominators for the rotors of Example 7.1, V=PrPrV=P_rP_r, r=12r=\tfrac12: the largest term ∣hk∣/∣k⋅ν∣\abs{h_k}/\abs{k\cdot\freq} of (7.4), ∣k1∣+∣k2∣≤40\abs{k_1}+\abs{k_2}\le40, against the frequency ratio. The low-order rationals show as spikes; the truncated sum has a pole at every rational a/ba/b with a+b≤40a+b\le40, of width shrinking like ra+br^{a+b}. Most of the line stays low (scripts/figures/small_denominators.py).

The same obstruction kills integrals, which is Poincaré’s point.

Proposition 7.5 (Poincaré’s mechanism at first order). Let n=2n=2, let H0H_0 be non-degenerate, and let F=F0+εF1+O(ε2)F=F_0+\varepsilon F_1+O(\varepsilon^{2}) be a first integral of (7.1), with F0,F1F_0,F_1 smooth on T2×DT^{2}\times D. Then

  1. F0F_0 depends on II alone;

  2. at every point of P\mathfrak P, ∇F0\nabla F_0 is parallel to ν\freq, that is, dF0∧dH0=0\dd F_0\wedge\dd H_0=0.

If P\mathfrak P is dense, dF0∧dH0=0\dd F_0\wedge\dd H_0=0 everywhere: the leading term of every such integral is a function of the energy.

Proof. Expand {F,H}=0\pb{F}{H}=0 in ε\varepsilon, with the angles as positions and the actions as momenta.

Order 11: {F0,H0}=ν⋅∂φF0=0\pb{F_0}{H_0}=\freq\cdot\partial_\varphi F_0=0. Its kk-th Fourier mode is i(k⋅ν)f0,k(I)=0\ii(k\cdot\freq)f_{0,k}(I)=0, so f0,k(I)=0f_{0,k}(I)=0 wherever ν(I)\freq(I) is non-resonant. Those II are dense, because H0H_0 is non-degenerate (Figure 6.7), and f0,kf_{0,k} is continuous, so f0,k≡0f_{0,k}\equiv0 for k≠0k\ne0: F0=F0(I)F_0=F_0(I).

Order ε\varepsilon: {F1,H0}+{F0,H1}=0\pb{F_1}{H_0}+\pb{F_0}{H_1}=0. The first term is ν⋅∂φF1\freq\cdot\partial_\varphi F_1; the second is −∇F0⋅∂φH1-\nabla F_0\cdot\partial_\varphi H_1, since F0F_0 has no angles. The kk-th mode:3 i (k⋅ν) f1,k=i (k⋅∇F0) hk.\ii\,(k\cdot\freq)\,f_{1,k}=\ii\,(k\cdot\nabla F_0)\,h_k . At I∈PI\in\mathfrak P pick the kk of Definition 7.2: the left side vanishes and hk≠0h_k\ne0, so k⋅∇F0=0k\cdot\nabla F_0=0. Then ν\freq and ∇F0\nabla F_0 are both orthogonal to the nonzero vector kk of R2\R^{2}, hence parallel. The last sentence follows by continuity. 

7.4 The KAM theorem

Poincaré’s theorem destroys the integrals, but not necessarily the tori. A torus is an invariant set, and it may survive even where no integral does; Proposition 7.4 cannot build it, because of the resonances. The tori to hope for are those furthest from every resonance.

Definition 7.6 (Diophantine). With ∣k∣=∣k1∣+⋯+∣kn∣\abs k=\abs{k_1}+\dots+\abs{k_n}, a frequency vector ν∈Rn\freq\in\R^{n} is (γ,τ)(\gamma,\tau)-Diophantine if ∣k⋅ν∣ ≥ γ∣k∣τfor every k∈Zn∖{0}.\abs{k\cdot\freq}\ \ge\ \frac{\gamma}{\abs k^{\tau}} \qquad\text{for every }k\in\Z^{n}\setminus\{0\}.

It is quantitative non-resonance: every term of (7.4) is then at most ∣hk∣∣k∣τ/γ\abs{h_k}\abs k^{\tau}/\gamma, which an analytic H1H_1, with hkh_k decaying exponentially, easily beats. And almost every vector is Diophantine.

Lemma 7.7 (Diophantine vectors have almost full measure, n=2n=2). Let τ>1\tau>1. In the disc ∣ν∣≤R\abs{\freq}\le R of R2\R^{2}, the vectors that are not (γ,τ)(\gamma,\tau)-Diophantine have total area at most 162 R γ ζ(τ)16\sqrt2\,R\,\gamma\,\zeta(\tau), where ζ(τ)=∑m≥1m−τ\zeta(\tau)=\sum_{m\ge1}m^{-\tau}.

Proof (★). For one k≠0k\ne0, the bad set ∣k⋅ν∣<γ∣k∣−τ\abs{k\cdot\freq}<\gamma\abs k^{-\tau} is a strip about the line k⋅ν=0k\cdot\freq=0 of width 2γ∣k∣−τ/∥k∥≤22 γ∣k∣−τ−12\gamma\abs k^{-\tau}/\norm k\le2\sqrt2\,\gamma\abs k^{-\tau-1}, since the Euclidean length ∥k∥≥∣k∣/2\norm k\ge\abs k/\sqrt2. Inside the disc it has length at most 2R2R, so area at most 42 Rγ∣k∣−τ−14\sqrt2\,R\gamma\abs k^{-\tau-1}. There are 4m4m vectors kk with ∣k∣=m\abs k=m. Summing, ∑m≥14m⋅42 Rγ m−τ−1=162 Rγ ζ(τ)\sum_{m\ge1}4m\cdot4\sqrt2\,R\gamma\,m^{-\tau-1}=16\sqrt2\,R\gamma\,\zeta(\tau), which is finite because τ>1\tau>1. 

Theorem 7.8 (Kolmogorov–Arnold–Moser cited). Let H=H0(I)+εH1(φ,I)H=H_0(I)+\varepsilon H_1(\varphi,I) on Tn×DT^{n}\times D, with H0H_0 analytic and H1H_1 analytic and 2π2\pi-periodic in the angles. Let D0D_0 be a bounded region whose closure lies in DD, with H0H_0 non-degenerate on a neighbourhood of that closure, and let both functions extend analytically to a complex neighbourhood of fixed width of Tn×D0‾T^{n}\times\overline{D_0}, where H1H_1 is bounded. Then for sufficiently small ε\varepsilon, most non-resonant invariant tori of H0H_0 over D0D_0 do not vanish but are only slightly deformed: the perturbed system has invariant tori, densely filled by quasi-periodic orbits with nn independent frequencies. They form a majority in the sense that the measure of the part of Tn×D0T^{n}\times D_0 they do not cover is small when ε\varepsilon is small. The theorem guarantees the survival of a large family whose frequencies satisfy a fixed Diophantine condition (Definition 7.6).

7.5 The section map

To see what becomes of the tori we need one tool: the section map.

Take n=2n=2 and fix the energy, H=EH=E, a three-dimensional level set. Choose a surface Σ\Sigma in it that the flow crosses transversally — for instance q1=0q_1=0 with q˙1>0\dot q_1>0 — with coordinates (q2,p2)(q_2,p_2), the remaining momentum p1p_1 being fixed by H=EH=E. If the orbit from x∈Σx\in\Sigma comes back to Σ\Sigma, call the first return P(x)P(x): the Poincaré map (Figure 7.2).

Proposition 7.9 (The section map preserves area proved modulo Stokes). For every loop γ\gamma in Σ\Sigma on which PP is defined, the area enclosed in the (q2,p2)(q_2,p_2)-plane is the same for γ\gamma and P∘γP\circ\gamma.

The proof is Stokes on the tube of orbits joining γ\gamma to P∘γP\circ\gamma, on which ω\symp vanishes; it is in the reading.

Proof (★). With τ(u)\tau(u) the return time of γ(u)\gamma(u), the map (s,u)↦Φsτ(u)(γ(u))(s,u)\mapsto\Phi_{s\tau(u)}(\gamma(u)), s∈[0,1]s\in[0,1], sweeps a tube CC of orbits from γ\gamma to P∘γP\circ\gamma. Both of its tangent vectors are tangent to the level set H=EH=E, and one of them is τXH\tau\hvf{H}. Since ιXHω=dH\iota_{\hvf H}\symp=\dd H (Definition 4.1), ω(XH,v)=dH(v)=0\symp(\hvf H,v)=\dd H(v)=0 for every vv tangent to the level set, so ω\symp vanishes on CC. By Stokes on CC (Theorem 3.11) and d(p⋅dq)=−ω\dd(p\cdot\dd q)=-\symp (Theorem 4.17), ∮P∘γp⋅dq=∮γp⋅dq\oint_{P\circ\gamma}p\cdot\dd q=\oint_\gamma p\cdot\dd q. On Σ\Sigma, dq1=0\dd q_1=0, so p⋅dq=p2 dq2p\cdot\dd q=p_2\,\dd q_2 there, and ∮p2 dq2\oint p_2\,\dd q_2 is the signed enclosed area. So PP preserves area, and orientation with it. 

Two readings follow. An invariant torus meets Σ\Sigma in a closed curve, and PP maps the curve to itself. And for the unperturbed system, with Σ={φ2=0}\Sigma=\{\varphi_2=0\}, coordinates (φ1,I1)(\varphi_1,I_1) and ν2>0\freq_2>0 (reverse φ2\varphi_2 if necessary), the return time is 2π/ν22\pi/\freq_2, in which φ1\varphi_1 advances by 2πν1/ν22\pi\freq_1/\freq_2: P0(φ1,I1)=(φ1+2πρ(I1), I1),ρ=ν1/ν2 on the level H0=E. P_0(\varphi_1,I_1)=\big(\varphi_1+2\pi\rho(I_1),\,I_1\big), \qquad \rho=\freq_1/\freq_2\ \text{on the level }H_0=E . (7.5) Each circle I1=cI_1=c is turned rigidly by 2πρ2\pi\rho. If ρ\rho changes with I1I_1 — which is what isoenergetic non-degeneracy says — P0P_0 is a twist map: circles at different heights turn by different angles.

Figure 7.2. A Poincaré section: the orbit (red) winds round an invariant torus, and its crossings of Σ\Sigma (dots) lie on the curve in which the torus meets Σ\Sigma.

7.6 Poincaré sections: Hénon–Heiles

Hénon and Heiles wanted to know whether a star in an axisymmetric galaxy has a third integral besides the energy and the angular momentum. The question reduces to two degrees of freedom, and they took as the simplest model H=12(px2+py2)+12(x2+y2)+x2y−13y3. H=\tfrac12\big(p_x^{2}+p_y^{2}\big)+\tfrac12\big(x^{2}+y^{2}\big)+x^{2}y-\tfrac13y^{3}. (7.6) The potential has a minimum at 00 and three saddles, at (0,1)(0,1) and (±3/2,−12)(\pm\sqrt3/2,-\tfrac12), all at height 1/61/6; below E=1/6E=1/6 the motion near the origin is confined to a curved triangle.4

Its potential is the isotropic oscillator plus a cubic term. Rescaled to a fixed energy, the cubic term’s strength is proportional to E\sqrt E (a reading has the computation): the higher the energy, the stronger its effect.

Take the section Σ={x=0, px>0}\Sigma=\{x=0,\ p_x>0\} at fixed EE, with coordinates (y,py)(y,p_y), and plot the crossings of a dozen orbits (the tutorial at the end of this section has the code). By Proposition 7.9 the picture is a portrait of an area-preserving map, and three kinds of orbit look different:

  • an orbit on an invariant torus fills a smooth closed curve;

  • an orbit in an island chain fills several small curves, visited in turn;

  • a chaotic orbit fills a region, erratically, and its points scatter.

An island chain is what a resonant circle of a perturbed twist map generically breaks into. Every point of a circle with rotation number a/ba/b is fixed by P bP^{\,b} before the perturbation. After it, the Poincaré–Birkhoff theorem (a reading) guarantees at least two periodic orbits, and in the generic picture there are 2kb2kb periodic points for some k≥1k\ge1, alternately elliptic, ringed by small closed curves, and hyperbolic, saddles of P bP^{\,b}. The two curves of points that approach a hyperbolic point, forwards and backwards in time, join into a separatrix in an integrable system; after a perturbation they generically cross, into a homoclinic tangle, which forces chaotic dynamics nearby; the reading computes one for a model twist map, the standard map. The Hénon–Heiles sections below show island chains and scatter that resemble this picture, but they are not a consequence of the theorem: the unperturbed Hénon–Heiles map has a constant rotation number and is no twist map.

Figure 7.3. Sections x=0x=0, px>0p_x>0 of Hénon–Heiles (7.6) at E=1/12E=1/12, 1/81/8 and 1/61/6, fourteen orbits each: curves and island chains, then a chaotic sea that at E=1/6E=1/6 fills most of the section (scripts/figures/henon_heiles_sections.py).

Figure 7.3 is the result, and it is what Hénon and Heiles saw in 1964. At low energy the plotted orbits lie on apparent curves, as if each had a second integral. At higher energies the scatter spreads, and at E=1/6E=1/6 most plotted orbits scatter. A finite-time test classifies launch points as regular or not (Figure 7.4): the fraction classified regular is 11 to the resolution at small EE and falls near E≈0.1E\approx0.1.

Figure 7.4. The regular fraction of the Hénon–Heiles section against the energy: a uniform grid of launch points, each classified by a finite-time Lyapunov exponent (regular if below 0.020.02 after t=800t=800) (scripts/figures/surviving_tori.py).

Tutorial

The code

Take Σ={x=0, px>0}\Sigma=\{x=0,\ p_x>0\} at fixed EE, with coordinates (y,py)(y,p_y); the allowed region is 12py2+12y2−13y3≤E\tfrac12p_y^{2}+\tfrac12y^{2}-\tfrac13y^{3}\le E. Launch an orbit from a point of it, with px=2E−py2−y2+23y3p_x=\sqrt{2E-p_y^{2}-y^{2}+\tfrac23y^{3}}; integrate Hamilton’s equations accurately; record (y,py)(y,p_y) each time xx passes through 00 upwards; plot; repeat for a dozen starting points.

The whole computation is a dozen lines of Python.

def rhs(t, z):                      # Hamilton's equations for (eq:6:HH)
    x, y, px, py = z
    return [px, py, -(x + 2*x*y), -(y + x*x - y*y)]
def crossing(t, z): return z[0]     # the section x = 0 ...
crossing.direction = 1              # ... crossed upwards, px > 0

def section(E, y, py, tmax=2000):
    px = sqrt(2*E - py**2 - y**2 + 2*y**3/3)
    s = solve_ivp(rhs, (0, tmax), [0, y, px, py], events=crossing,
                  rtol=1e-10, atol=1e-12)
    return s.y_events[0][:, 1], s.y_events[0][:, 3]   # (y, py)

Two things decide whether the picture can be trusted. The accuracy: HH must stay constant along the orbit, and checking it is part of the computation — the generator measures a drift below 10−810^{-8} over t≈2000t\approx2000, and refuses to draw above 5×10−85\times10^{-8}. And the event detection: the crossing must be located by root finding on x(t)=0x(t)=0, not by the nearest time step. scripts/figures/henon_heiles_sections.py is this code with a loop over launch points.

7.7 Toda against Hénon–Heiles at equal energy

Three particles on a ring, each pushed by its neighbours through the exponential potential of Toda, with the centre of mass removed and the coordinates, time and energy rescaled (Toda, §2.9), have the Hamiltonian HToda=12(px2+py2)+124(e2y+23x+e2y−23x+e−4y)−18. H_{\mathrm{Toda}}=\tfrac12\big(p_x^{2}+p_y^{2}\big) +\tfrac1{24}\Big(e^{2y+2\sqrt3x}+e^{2y-2\sqrt3x}+e^{-4y}\Big)-\tfrac18 . (7.7) This is the periodic Toda chain, a model that Lecture 9 will prove integrable; here we claim nothing else about it. Expand the exponentials: the constants cancel the −18-\tfrac18, the linear terms cancel (2y+2y−4y=02y+2y-4y=0), the quadratic ones give 12(x2+y2)\tfrac12(x^{2}+y^{2}), and the cubic ones give 1144[(2y+23x)3+(2y−23x)3−64y3]=x2y−13y3.\tfrac1{144}\Big[(2y+2\sqrt3x)^{3}+(2y-2\sqrt3x)^{3}-64y^{3}\Big] =x^{2}y-\tfrac13y^{3}. So HTodaH_{\mathrm{Toda}} agrees with Hénon–Heiles (7.6) through cubic order, and differs from it at quartic order.5 Hénon–Heiles is the cubic truncation of the Toda chain.

Figure 7.5. The same section x=0x=0, px>0p_x>0, at the same energy E=1/6E=1/6, for the Toda chain (7.7) (left) and its cubic truncation Hénon–Heiles (right). Every plotted Toda orbit lies on a smooth curve; the truncation is mostly chaotic (scripts/figures/toda_vs_henon_heiles.py).

Figure 7.5 puts the two side by side at E=1/6E=1/6, the highest energy of Figure 7.3. Two Hamiltonians that agree through cubic order disagree about everything that matters. Integrability belongs to the whole Hamiltonian: the cubic Taylor polynomial cannot see it, and it need not survive truncation.

7.8 Lyapunov exponents

Definition 7.10 (Lyapunov exponent). For an orbit Φt(x0)\Phi_t(x_0) and a tangent vector uu at x0x_0, λ(x0,u)=lim⁡t→∞1tln⁡∣dΦt(u)∣∣u∣,\lambda(x_0,u)=\lim_{t\to\infty}\frac1t\ln\frac{\abs{\dd\Phi_t(u)}}{\abs u}, where it exists (Ott, §4.4). A positive exponent means exponential sensitivity to the initial condition.

On a torus of an integrable system, in action–angle coordinates φ(t)=φ(0)+ν(I)t\varphi(t)=\varphi(0)+\freq(I)t, so a small change δI\delta I gives δφ(t)=δφ(0)+t (∂ν/∂I) δI\delta\varphi(t)=\delta\varphi(0)+t\,(\partial\freq/\partial I)\,\delta I: nearby orbits separate linearly, by shear, and every λ\lambda is 00. In a chaotic region they separate exponentially (Figure 7.6). Numerically one computes a finite-time exponent, as in Figure 7.4.

Figure 7.6. Two pairs of Hénon–Heiles orbits at E=1/8E=1/8, each started 10−910^{-9} apart: inside an island (blue) they separate linearly, in the chaotic sea (red) exponentially (scripts/figures/lyapunov_separation.py).

7.9 What it buys

  • Integrability is exceptional, in a stated sense. Poincaré’s theorem rules out a second integral that is a power series in ε\varepsilon, for a non-degenerate H0H_0 and a dense Poincaré set; and truncating the Toda ring at cubic order turns its regular section at E=1/6E=1/6 into a mostly chaotic one (Figure 7.5). So the integrable systems of Lecture 8 and Lecture 9 have to be found exactly as they are.

  • The tori are robust. KAM keeps most of them, so an integrable system organises the systems near it.

  • A diagnostic: a section’s curves against its scatter, and Lyapunov exponents.

7.10 Caveats, in one place

  • Status. Poincaré’s theorem, KAM and the Poincaré–Birkhoff theorem (a reading) are cited. What is proved is the first-order step of Poincaré’s argument (Proposition 7.5): the leading term of any such integral is a function of H0H_0, which is not yet non-existence. Proposition 7.4 is proved; Lemma 7.7 is proved in a reading, and Proposition 7.9 in a reading modulo Stokes.

  • What KAM does not say. No size for “sufficiently small”, no rate for “small”, and no integral. The Diophantine family it guarantees does not fill the resonance zones, and the theorem does not say what is there. The two theorems do not conflict: Poincaré’s rules out an integral of a specified form, and KAM supplies many invariant tori, not an integral.

  • Hénon–Heiles is outside both theorems. It perturbs the isotropic oscillator, which is degenerate, so neither Theorem 7.3 nor Theorem 7.8, as stated, applies to it. Its sections, and the regular fraction of Figure 7.4, are measurements, not predictions.

  • A positive Lyapunov exponent alone is not chaos: a hyperbolic periodic point has one. For a bounded orbit that is not periodic it is a numerical indicator, and the threshold in Figure 7.4 is a classifier.

  • Genericity, and no more. The course puts no measure on the space of all Hamiltonians. It claims Poincaré’s theorem, the effect of truncation in Figure 7.5, and, in a reading, that the integrable members of the Hénon–Heiles family are isolated, for meromorphic integrals.

Reading

7.11 Poincaré–Birkhoff, the standard map and the homoclinic tangle

On a circle with ρ=a/b\rho=a/b rational (in lowest terms), every point is a fixed point of P0 bP_0^{\,b}: the torus is resonant, filled with periodic orbits (Proposition 6.10). On an irrational circle every orbit is dense. Perturb: PεP_\varepsilon is still area-preserving (Proposition 7.9) and close to P0P_0. By Theorem 7.8 most of the irrational circles survive as invariant curves. A circle of fixed points is not robust — nothing forces a whole circle of solutions of P bx=xP^{\,b}x=x to persist — and what remains of it is fixed by a theorem of Poincaré.

Theorem 7.11 (Poincaré’s geometric theorem cited). An area-preserving homeomorphism of a closed annulus to itself that turns its two boundary circles in opposite directions has at least two fixed points.

(Arnold, App. 9: Poincaré announced it just before his death, and Birkhoff proved it.) Apply it between two surviving invariant curves whose rotation numbers ρ−<a/b<ρ+\rho_-<a/b<\rho_+ straddle the resonance, to Pε bP_\varepsilon^{\,b} followed by a rotation by −2πa-2\pi a: the inner boundary turns back, the outer forward. The result is periodic orbits of period bb that survive the break-up — for a sufficiently small perturbation of an isoenergetically non-degenerate system, at least two geometrically distinct ones (Arnold, App. 9, p. 422).

Two steps hide in “the inner boundary turns back”. Arnold’s hypothesis is pointwise: every point of the inner circle must move backwards. That holds because a circle homeomorphism with rotation number ρ−<a/b\rho_-<a/b moves every point by less than 2πa2\pi a in bb steps (if some point moved by exactly 2πa2\pi a the rotation number would be a/ba/b). And the two fixed points of the theorem might lie on one orbit; that there are two distinct periodic orbits coming from this resonant torus is Arnold’s corollary (p. 422): when an nn-dimensional torus filled with closed trajectories of an isoenergetically non-degenerate system breaks up under a sufficiently small perturbation, at least 2n−12^{n-1} closed trajectories form, counted with multiplicity, of which at least nn are geometrically distinct.

In the generic case there are kbkb periodic points of each of two kinds, and they alternate round the old circle (Ott, §7.2.2): elliptic points, surrounded by small invariant curves of their own, and hyperbolic points, saddles of Pε bP_\varepsilon^{\,b}. The resonant torus has become an island chain (Figure 7.7).

Figure 7.7. Poincaré–Birkhoff. Left: in the frame turning with the resonant circle (ρ=a/b\rho=a/b, dotted), the inner circle C−C_- turns backwards and the outer C+C_+ forwards under P0 bP_0^{\,b}; the dotted circle is fixed pointwise. Right: after the perturbation C±C_\pm survive (KAM) and, of the circle, only the fixed points guaranteed by Theorem 7.11 remain — in the generic case alternately elliptic, ringed by islands, and hyperbolic. Schematic; Figure 7.8 is the computed version.

A model twist map, and a homoclinic tangle

The simplest area-preserving perturbation of a twist map is the standard map on the cylinder, p′=p+Ksin⁡x,x′=x+p′(x mod 2π), p'=p+K\sin x,\qquad x'=x+p'\qquad(x\bmod2\pi), (7.8) the section map of a rotor kicked once per unit time by the potential Kcos⁡xK\cos x. Its Jacobian has determinant 11, and at K=0K=0 it is (7.5) with rotation pp.6 Figure 7.8 shows the whole story: at K=0.5K=0.5 the golden circle survives, deformed, while the resonant circle ρ=1/3\rho=1/3 has broken into three islands and three hyperbolic points, exactly as Figure 7.7 predicts.

Figure 7.8. The standard map (7.8). Left, K=0.5K=0.5, a band of pp: most circles survive, deformed (grey); the invariant curve of golden rotation number (3−5)/2(3-\sqrt5)/2 (indigo) is a KAM curve; the resonant circle ρ=1/3\rho=1/3 is gone, replaced by three islands round an elliptic orbit of period 33 (red) and a hyperbolic orbit of period 33 (crosses). Right, K=0.95K=0.95: a chaotic sea, and the golden curve still there. Greene’s numerical evidence suggests that the golden rotational circle is among the last to break, near K≈0.9716K\approx0.9716 (Ott, §7.3.2).

The hyperbolic points carry the chaos. A hyperbolic fixed point has a stable curve WsW^{s} of points that approach it, and an unstable curve WuW^{u} of points that approach it backwards in time. In an integrable system they join smoothly into a separatrix, as for the pendulum (§6.4). Perturbed, they generically cross. One crossing xx forces infinitely many, since every image PmxP^{m}x is again on both curves; the lobes between successive crossings have equal areas because the map preserves area, and as they crowd towards the fixed point they must stretch into long thin tongues. This homoclinic tangle (Figure 7.9), discovered by Poincaré, forces chaotic dynamics nearby (Ott, §§4.3, 7.2.2): a mechanism for the chaotic dynamics that Figure 7.8 shows, not a computation of that sea’s origin.

Figure 7.9. A homoclinic tangle, computed: the unstable (red) and stable (indigo) curves of the hyperbolic fixed point of the standard map at K=1K=1, which sits at both ends (x=0x=0 and x=2πx=2\pi are the same point). They do not join into one separatrix; they cross, and the lobes pile up near the fixed point (scripts/figures/homoclinic_tangle.py).

Two consequences of KAM and of the Diophantine condition. For n=2n=2 it has a sharp consequence. On a three-dimensional energy level a two-dimensional torus separates, like a surface of revolution in space: an orbit starting between two surviving tori stays between them forever, and its actions stay near their initial values (Arnold, App. 8, p. 407, under the analogous isoenergetic non-degeneracy condition). For n≥3n\ge3 the tori separate nothing, and a slow drift through the gaps is possible — Arnold diffusion, which we only name.

Figure 7.10. Lemma 7.7. Each resonance k⋅ν=0k\cdot\freq=0 (a line through 00) is thickened to a strip of width ∝γ∣k∣−τ−1\propto\gamma\abs k^{-\tau-1}; representative strips with ∣k∣≤5\abs k\le5 are drawn, not to scale. Every line through 00 with rational slope gets a strip, so the strips are dense, but their total area is O(γ)O(\gamma): the Diophantine vectors, which lie outside all of them, are almost all.

Positive exponents without chaos. A positive exponent alone is not chaos: the hyperbolic fixed point of the standard map has one. For a bounded orbit that is not periodic, λ>0\lambda>0 is the standard numerical indicator of chaos, and that is how it is used here.

The energy as the perturbation parameter. The energy is the perturbation parameter. Rescaling (x,y,p)↦s (x,y,p)(x,y,p)\mapsto s\,(x,y,p) gives 1s2H(sx,sy,sp)=12(px2+py2+x2+y2)+s(x2y−13y3),\frac{1}{s^{2}}H(sx,sy,sp) =\tfrac12\big(p_x^{2}+p_y^{2}+x^{2}+y^{2}\big)+s\big(x^{2}y-\tfrac13y^{3}\big), so the dynamics at energy EE is that of the isotropic oscillator plus a cubic perturbation of size ε=s=E\varepsilon=s=\sqrt E at energy 11.

The Hénon–Heiles family. In the family Vλ=12(x2+y2)+x2y+λ3y3V_\lambda=\tfrac12(x^{2}+y^{2})+x^{2}y+\tfrac\lambda3y^{3}, λ≠0\lambda\ne0 (Hénon–Heiles is λ=−1\lambda=-1), the known integrable members are λ=1\lambda=1, which separates in the coordinates (y±x)/2(y\pm x)/\sqrt2, and λ=6\lambda=6, which has a second integral that is a polynomial of degree four, quadratic in the momenta.7 For every other λ\lambda there is no second integral that is meromorphic in the complexified coordinates and momenta — in particular no rational or polynomial one (cited: Ito 1985, completed by Morales-Ruiz, Ramis and Simó 2007). Integrals that are only smooth, or defined on part of phase space, are not excluded. So the statement is: within this family, and for integrals of this class, the integrable members are isolated points of the parameter line.

Summary

  • The problem: H=H0(I)+εH1(φ,I)H=H_0(I)+\varepsilon H_1(\varphi,I) (7.1). Poincaré’s theorem (cited): for H0H_0 non-degenerate and a dense Poincaré set there is no second integral that is a power series in ε\varepsilon.
  • Small denominators: first-order perturbation theory divides by k⋅νk\cdot\freq (Proposition 7.4), which vanishes on the dense set of resonances; the same resonances force the leading term of any integral to depend on H0H_0 alone (Proposition 7.5).
  • KAM (cited): most tori survive, deformed, with Diophantine frequencies, which are almost all (Lemma 7.7).
  • Sections: the section map preserves area (Proposition 7.9). Curves, island chains and a chaotic sea appear in Hénon–Heiles as the energy grows, while the Toda ring it truncates stays regular at the same energy (Figure 7.5). Lyapunov exponents vanish on tori.
  • Next: Lecture 8 asks where the Toda ring’s integrals come from, and finds them in a Lax pair.

Worked in the tutorial: Exercise Sheet 7.

References

Arnold, Mathematical Methods of Classical Mechanics, App. 8–9; Kozlov, Russian Math. Surveys 38:1 (1983), ch. IV §1; Ott, Chaos in Dynamical Systems, §§4.4, 7.2–7.3; Toda, Theory of Nonlinear Lattices, §§1.2, 2.9; Hénon and Heiles, Astron. J. 69 (1964) 73; Ito (1985) and Morales-Ruiz, Ramis and Simó (2007) for the Hénon–Heiles family.

The whole bibliography, lecture by lecture →


  1. scripts/check-l6-algebra.py, check 3: the closed form of PrP_r symbolically, the coefficients sampled.↩︎

  2. scripts/check-l6-algebra.py, check 1, symbolically, including the sign through the type-2 convention of Proposition 4.9.↩︎

  3. scripts/check-l6-algebra.py, check 2, with the frozen bracket.↩︎

  4. scripts/check-l6-algebra.py, check 5.↩︎

  5. scripts/check-l6-algebra.py, check 6, which also checks the reduction from three particles.↩︎

  6. scripts/check-l6-algebra.py, check 8. This is Chirikov’s form; Ott (7.15) kicks after the turn, a conjugate map.↩︎

  7. scripts/check-l6-algebra.py, check 5, which prints it.↩︎