Lecture 7
Course map: G1, step 7 of 9, which shows why the goal is exceptional. Lecture 5 and Lecture 6 built the integrable world: tori, actions, frequencies. This lecture perturbs it. Poincaré’s theorem says that a perturbation, under conditions stated exactly, destroys the integrals, and the KAM theorem says that most of the tori survive anyway. Between the two, resonant tori generically break into island chains and chaos. In the Hénon–Heiles system we see island chains and chaotic scatter that resemble this picture, beside the three-particle Toda ring it truncates, whose plotted orbits stay on smooth curves.
Lecture 6 made the motion of an integrable system free in action–angle variables, on tori labelled by the actions. Real systems are at best close to integrable. So the question is
what happens to the tori when an integrable system is perturbed — and how do you see it?
Two theorems answer the first half, one destructive and one constructive; the section map answers the second. The worked example is Hénon–Heiles (§7.6), set beside the Toda ring that Lecture 8 and Lecture 9 will solve.
Imported from Lecture 6: near a torus of an integrable system there are action–angle coordinates , , in an open set , in which and the motion is , (Theorem 6.5, Corollary 6.4). is non-degenerate if , and then, for , the resonant tori of Definition 6.9 are dense and of measure zero (Figure 6.7).
Poincaré called the following the fundamental problem of dynamics: a nearly integrable system (7.1) with small and expanded in a Fourier series in the angles. The planets are the original case: is the motion of each planet round the Sun, and their mutual attraction.
Example 7.1 (Two rotors in a weak periodic potential). On , with the positions themselves the angles and , let Here is the identity: non-degenerate. Two choices of will do different things.
separates: is an exact second integral, and the system is integrable for every .
, where for a fixed . Then : every Fourier coefficient is nonzero.1
What separates the two cases is which Fourier modes act on which resonant tori.
Definition 7.2 (Poincaré set, ). The Poincaré set of (7.1) is the set of at which some has the resonant tori on which a Fourier mode of the perturbation resonates.
For general , asks for linearly independent such . In Example 7.1, is a line through the origin of the -plane. With only have , and is the two axes. With every rational line through is in : it is dense.
Theorem 7.3 (Poincaré; in Kozlov’s form cited). Let be real-analytic on , with non-degenerate on , and let the Poincaré set be dense in . Then Hamilton’s equations have no first integral a formal power series in with smooth coefficients, that is independent of .
Here independent is Definition 5.1 read order by order in (Kozlov, ch. IV §1). So the second choice of in Example 7.1 has no second integral of this kind, and “non-integrable” is a theorem about it, not a report that nobody has found one.
The engine of the proof is visible at first order, and we prove that part in the next section.
The obvious strategy is to remove by a canonical transformation close to the identity, as Hamilton–Jacobi removed all of in Lecture 6. Take a type-2 generating function (Proposition 4.9) with old positions and new momenta , Substitute into (7.1) and expand : (7.2) The new Hamiltonian is integrable to first order if the bracket does not depend on the angles. Its angle average is , since averages to zero; so we need the homological equation (7.3)
Proposition 7.4 (First-order perturbation theory). On an open set of on which for every with , and on which the series below converges together with its first and second derivatives, and for small enough, (7.4) (terms with omitted) solves (7.3), and the new Hamiltonian is .
If is non-degenerate and has finitely many Fourier modes, such open sets exist: everything off the finitely many active resonance hypersurfaces . If the Poincaré set is dense, as for the second rotor of Example 7.1, no open set qualifies.
Every term is divided by , the combination whose vanishing is resonance. On a resonant torus with — a point of the Poincaré set — the -th mode of (7.3) reads , and there is no solution at all. Near one the coefficient is enormous. And for the resonant tori are dense, so every torus has resonant ones arbitrarily close: these are the small denominators (Figure 7.1). They are not a defect of the method. Near resonance, a small perturbation is not a small change.
scripts/figures/small_denominators.py).The same obstruction kills integrals, which is Poincaré’s point.
Proposition 7.5 (Poincaré’s mechanism at first order). Let , let be non-degenerate, and let be a first integral of (7.1), with smooth on . Then
depends on alone;
at every point of , is parallel to , that is, .
If is dense, everywhere: the leading term of every such integral is a function of the energy.
Proof. Expand in , with the angles as positions and the actions as momenta.
Order : . Its -th Fourier mode is , so wherever is non-resonant. Those are dense, because is non-degenerate (Figure 6.7), and is continuous, so for : .
Order : . The first term is ; the second is , since has no angles. The -th mode:3 At pick the of Definition 7.2: the left side vanishes and , so . Then and are both orthogonal to the nonzero vector of , hence parallel. The last sentence follows by continuity.
Poincaré’s theorem destroys the integrals, but not necessarily the tori. A torus is an invariant set, and it may survive even where no integral does; Proposition 7.4 cannot build it, because of the resonances. The tori to hope for are those furthest from every resonance.
Definition 7.6 (Diophantine). With , a frequency vector is -Diophantine if
It is quantitative non-resonance: every term of (7.4) is then at most , which an analytic , with decaying exponentially, easily beats. And almost every vector is Diophantine.
Lemma 7.7 (Diophantine vectors have almost full measure, ). Let . In the disc of , the vectors that are not -Diophantine have total area at most , where .
Proof (★). For one , the bad set is a strip about the line of width , since the Euclidean length . Inside the disc it has length at most , so area at most . There are vectors with . Summing, , which is finite because .
Theorem 7.8 (Kolmogorov–Arnold–Moser cited). Let on , with analytic and analytic and -periodic in the angles. Let be a bounded region whose closure lies in , with non-degenerate on a neighbourhood of that closure, and let both functions extend analytically to a complex neighbourhood of fixed width of , where is bounded. Then for sufficiently small , most non-resonant invariant tori of over do not vanish but are only slightly deformed: the perturbed system has invariant tori, densely filled by quasi-periodic orbits with independent frequencies. They form a majority in the sense that the measure of the part of they do not cover is small when is small. The theorem guarantees the survival of a large family whose frequencies satisfy a fixed Diophantine condition (Definition 7.6).
To see what becomes of the tori we need one tool: the section map.
Take and fix the energy, , a three-dimensional level set. Choose a surface in it that the flow crosses transversally — for instance with — with coordinates , the remaining momentum being fixed by . If the orbit from comes back to , call the first return : the Poincaré map (Figure 7.2).
Proposition 7.9 (The section map preserves area proved modulo Stokes). For every loop in on which is defined, the area enclosed in the -plane is the same for and .
The proof is Stokes on the tube of orbits joining to , on which vanishes; it is in the reading.
Proof (★). With the return time of , the map , , sweeps a tube of orbits from to . Both of its tangent vectors are tangent to the level set , and one of them is . Since (Definition 4.1), for every tangent to the level set, so vanishes on . By Stokes on (Theorem 3.11) and (Theorem 4.17), . On , , so there, and is the signed enclosed area. So preserves area, and orientation with it.
Two readings follow. An invariant torus meets in a closed curve, and maps the curve to itself. And for the unperturbed system, with , coordinates and (reverse if necessary), the return time is , in which advances by : (7.5) Each circle is turned rigidly by . If changes with — which is what isoenergetic non-degeneracy says — is a twist map: circles at different heights turn by different angles.
Hénon and Heiles wanted to know whether a star in an axisymmetric galaxy has a third integral besides the energy and the angular momentum. The question reduces to two degrees of freedom, and they took as the simplest model (7.6) The potential has a minimum at and three saddles, at and , all at height ; below the motion near the origin is confined to a curved triangle.4
Its potential is the isotropic oscillator plus a cubic term. Rescaled to a fixed energy, the cubic term’s strength is proportional to (a reading has the computation): the higher the energy, the stronger its effect.
Take the section at fixed , with coordinates , and plot the crossings of a dozen orbits (the tutorial at the end of this section has the code). By Proposition 7.9 the picture is a portrait of an area-preserving map, and three kinds of orbit look different:
an orbit on an invariant torus fills a smooth closed curve;
an orbit in an island chain fills several small curves, visited in turn;
a chaotic orbit fills a region, erratically, and its points scatter.
An island chain is what a resonant circle of a perturbed twist map generically breaks into. Every point of a circle with rotation number is fixed by before the perturbation. After it, the Poincaré–Birkhoff theorem (a reading) guarantees at least two periodic orbits, and in the generic picture there are periodic points for some , alternately elliptic, ringed by small closed curves, and hyperbolic, saddles of . The two curves of points that approach a hyperbolic point, forwards and backwards in time, join into a separatrix in an integrable system; after a perturbation they generically cross, into a homoclinic tangle, which forces chaotic dynamics nearby; the reading computes one for a model twist map, the standard map. The Hénon–Heiles sections below show island chains and scatter that resemble this picture, but they are not a consequence of the theorem: the unperturbed Hénon–Heiles map has a constant rotation number and is no twist map.
scripts/figures/henon_heiles_sections.py).Figure 7.3 is the result, and it is what Hénon and Heiles saw in 1964. At low energy the plotted orbits lie on apparent curves, as if each had a second integral. At higher energies the scatter spreads, and at most plotted orbits scatter. A finite-time test classifies launch points as regular or not (Figure 7.4): the fraction classified regular is to the resolution at small and falls near .
scripts/figures/surviving_tori.py).Take at fixed , with coordinates ; the allowed region is . Launch an orbit from a point of it, with ; integrate Hamilton’s equations accurately; record each time passes through upwards; plot; repeat for a dozen starting points.
The whole computation is a dozen lines of Python.
def rhs(t, z): # Hamilton's equations for (eq:6:HH)
x, y, px, py = z
return [px, py, -(x + 2*x*y), -(y + x*x - y*y)]
def crossing(t, z): return z[0] # the section x = 0 ...
crossing.direction = 1 # ... crossed upwards, px > 0
def section(E, y, py, tmax=2000):
px = sqrt(2*E - py**2 - y**2 + 2*y**3/3)
s = solve_ivp(rhs, (0, tmax), [0, y, px, py], events=crossing,
rtol=1e-10, atol=1e-12)
return s.y_events[0][:, 1], s.y_events[0][:, 3] # (y, py)Two things decide whether the picture can be trusted. The accuracy: must stay constant along the orbit, and checking it is part of the computation — the generator measures a drift below over , and refuses to draw above . And the event detection: the crossing must be located by root finding on , not by the nearest time step. scripts/figures/henon_heiles_sections.py is this code with a loop over launch points.
Three particles on a ring, each pushed by its neighbours through the exponential potential of Toda, with the centre of mass removed and the coordinates, time and energy rescaled (Toda, §2.9), have the Hamiltonian (7.7) This is the periodic Toda chain, a model that Lecture 9 will prove integrable; here we claim nothing else about it. Expand the exponentials: the constants cancel the , the linear terms cancel (), the quadratic ones give , and the cubic ones give So agrees with Hénon–Heiles (7.6) through cubic order, and differs from it at quartic order.5 Hénon–Heiles is the cubic truncation of the Toda chain.
scripts/figures/toda_vs_henon_heiles.py).Figure 7.5 puts the two side by side at , the highest energy of Figure 7.3. Two Hamiltonians that agree through cubic order disagree about everything that matters. Integrability belongs to the whole Hamiltonian: the cubic Taylor polynomial cannot see it, and it need not survive truncation.
Definition 7.10 (Lyapunov exponent). For an orbit and a tangent vector at , where it exists (Ott, §4.4). A positive exponent means exponential sensitivity to the initial condition.
On a torus of an integrable system, in action–angle coordinates , so a small change gives : nearby orbits separate linearly, by shear, and every is . In a chaotic region they separate exponentially (Figure 7.6). Numerically one computes a finite-time exponent, as in Figure 7.4.
scripts/figures/lyapunov_separation.py).Integrability is exceptional, in a stated sense. Poincaré’s theorem rules out a second integral that is a power series in , for a non-degenerate and a dense Poincaré set; and truncating the Toda ring at cubic order turns its regular section at into a mostly chaotic one (Figure 7.5). So the integrable systems of Lecture 8 and Lecture 9 have to be found exactly as they are.
The tori are robust. KAM keeps most of them, so an integrable system organises the systems near it.
A diagnostic: a section’s curves against its scatter, and Lyapunov exponents.
Status. Poincaré’s theorem, KAM and the Poincaré–Birkhoff theorem (a reading) are cited. What is proved is the first-order step of Poincaré’s argument (Proposition 7.5): the leading term of any such integral is a function of , which is not yet non-existence. Proposition 7.4 is proved; Lemma 7.7 is proved in a reading, and Proposition 7.9 in a reading modulo Stokes.
What KAM does not say. No size for “sufficiently small”, no rate for “small”, and no integral. The Diophantine family it guarantees does not fill the resonance zones, and the theorem does not say what is there. The two theorems do not conflict: Poincaré’s rules out an integral of a specified form, and KAM supplies many invariant tori, not an integral.
Hénon–Heiles is outside both theorems. It perturbs the isotropic oscillator, which is degenerate, so neither Theorem 7.3 nor Theorem 7.8, as stated, applies to it. Its sections, and the regular fraction of Figure 7.4, are measurements, not predictions.
A positive Lyapunov exponent alone is not chaos: a hyperbolic periodic point has one. For a bounded orbit that is not periodic it is a numerical indicator, and the threshold in Figure 7.4 is a classifier.
Genericity, and no more. The course puts no measure on the space of all Hamiltonians. It claims Poincaré’s theorem, the effect of truncation in Figure 7.5, and, in a reading, that the integrable members of the Hénon–Heiles family are isolated, for meromorphic integrals.
On a circle with rational (in lowest terms), every point is a fixed point of : the torus is resonant, filled with periodic orbits (Proposition 6.10). On an irrational circle every orbit is dense. Perturb: is still area-preserving (Proposition 7.9) and close to . By Theorem 7.8 most of the irrational circles survive as invariant curves. A circle of fixed points is not robust — nothing forces a whole circle of solutions of to persist — and what remains of it is fixed by a theorem of Poincaré.
Theorem 7.11 (Poincaré’s geometric theorem cited). An area-preserving homeomorphism of a closed annulus to itself that turns its two boundary circles in opposite directions has at least two fixed points.
(Arnold, App. 9: Poincaré announced it just before his death, and Birkhoff proved it.) Apply it between two surviving invariant curves whose rotation numbers straddle the resonance, to followed by a rotation by : the inner boundary turns back, the outer forward. The result is periodic orbits of period that survive the break-up — for a sufficiently small perturbation of an isoenergetically non-degenerate system, at least two geometrically distinct ones (Arnold, App. 9, p. 422).
Two steps hide in “the inner boundary turns back”. Arnold’s hypothesis is pointwise: every point of the inner circle must move backwards. That holds because a circle homeomorphism with rotation number moves every point by less than in steps (if some point moved by exactly the rotation number would be ). And the two fixed points of the theorem might lie on one orbit; that there are two distinct periodic orbits coming from this resonant torus is Arnold’s corollary (p. 422): when an -dimensional torus filled with closed trajectories of an isoenergetically non-degenerate system breaks up under a sufficiently small perturbation, at least closed trajectories form, counted with multiplicity, of which at least are geometrically distinct.
In the generic case there are periodic points of each of two kinds, and they alternate round the old circle (Ott, §7.2.2): elliptic points, surrounded by small invariant curves of their own, and hyperbolic points, saddles of . The resonant torus has become an island chain (Figure 7.7).
The simplest area-preserving perturbation of a twist map is the standard map on the cylinder, (7.8) the section map of a rotor kicked once per unit time by the potential . Its Jacobian has determinant , and at it is (7.5) with rotation .6 Figure 7.8 shows the whole story: at the golden circle survives, deformed, while the resonant circle has broken into three islands and three hyperbolic points, exactly as Figure 7.7 predicts.
The hyperbolic points carry the chaos. A hyperbolic fixed point has a stable curve of points that approach it, and an unstable curve of points that approach it backwards in time. In an integrable system they join smoothly into a separatrix, as for the pendulum (§6.4). Perturbed, they generically cross. One crossing forces infinitely many, since every image is again on both curves; the lobes between successive crossings have equal areas because the map preserves area, and as they crowd towards the fixed point they must stretch into long thin tongues. This homoclinic tangle (Figure 7.9), discovered by Poincaré, forces chaotic dynamics nearby (Ott, §§4.3, 7.2.2): a mechanism for the chaotic dynamics that Figure 7.8 shows, not a computation of that sea’s origin.
scripts/figures/homoclinic_tangle.py).Two consequences of KAM and of the Diophantine condition. For it has a sharp consequence. On a three-dimensional energy level a two-dimensional torus separates, like a surface of revolution in space: an orbit starting between two surviving tori stays between them forever, and its actions stay near their initial values (Arnold, App. 8, p. 407, under the analogous isoenergetic non-degeneracy condition). For the tori separate nothing, and a slow drift through the gaps is possible — Arnold diffusion, which we only name.
Positive exponents without chaos. A positive exponent alone is not chaos: the hyperbolic fixed point of the standard map has one. For a bounded orbit that is not periodic, is the standard numerical indicator of chaos, and that is how it is used here.
The energy as the perturbation parameter. The energy is the perturbation parameter. Rescaling gives so the dynamics at energy is that of the isotropic oscillator plus a cubic perturbation of size at energy .
The Hénon–Heiles family. In the family , (Hénon–Heiles is ), the known integrable members are , which separates in the coordinates , and , which has a second integral that is a polynomial of degree four, quadratic in the momenta.7 For every other there is no second integral that is meromorphic in the complexified coordinates and momenta — in particular no rational or polynomial one (cited: Ito 1985, completed by Morales-Ruiz, Ramis and Simó 2007). Integrals that are only smooth, or defined on part of phase space, are not excluded. So the statement is: within this family, and for integrals of this class, the integrable members are isolated points of the parameter line.
Arnold, Mathematical Methods of Classical Mechanics, App. 8–9; Kozlov, Russian Math. Surveys 38:1 (1983), ch. IV §1; Ott, Chaos in Dynamical Systems, §§4.4, 7.2–7.3; Toda, Theory of Nonlinear Lattices, §§1.2, 2.9; Hénon and Heiles, Astron. J. 69 (1964) 73; Ito (1985) and Morales-Ruiz, Ramis and Simó (2007) for the Hénon–Heiles family.
scripts/check-l6-algebra.py, check 3: the closed form of symbolically, the coefficients sampled.↩︎
scripts/check-l6-algebra.py, check 1, symbolically, including the sign through the type-2 convention of Proposition 4.9.↩︎
scripts/check-l6-algebra.py, check 2, with the frozen bracket.↩︎
scripts/check-l6-algebra.py, check 5.↩︎
scripts/check-l6-algebra.py, check 6, which also checks the reduction from three particles.↩︎
scripts/check-l6-algebra.py, check 8. This is Chirikov’s form; Ott (7.15) kicks after the turn, a conjugate map.↩︎
scripts/check-l6-algebra.py, check 5, which prints it.↩︎