Lecture 0

Why integrability?

Course map: the question that all five goals answer. Two experiments in which many interacting particles refused to forget how they were started, and one line of mechanics that says why one dimension is special. Together they pose the question of the course. Its answer, in one line, is conserved quantities, as many as there are degrees of freedom. The rest of the lecture is a map: the twenty lectures that make that answer precise, and the five things a student who finishes them can do. Later lectures recall what they use from here: the collisions of §0.2 (Lectures 10 and 11), the cradle (Lectures 11 and 20) and the FPUT spring (Lecture 12). A claim that names a later lecture is proved, sketched or cited there, and marked as such.

0.1 Two experiments that should not have happened

The Fermi–Pasta–Ulam–Tsingou chain

Take NN equal masses in a row, joined by springs, with the two ends fixed. If the springs obey Hooke’s law the problem is linear and completely solved: the motion is a superposition of NN normal modes, the kk-th a standing sine wave with frequency ωk=2sin⁡kπ2(N+1),k=1,…,N \omega_k=2\sin\frac{k\pi}{2(N+1)},\qquad k=1,\dots,N (0.1) (in units with mass and spring constant one). Each mode is a harmonic oscillator on its own. The energy in each mode is conserved separately: NN conserved quantities, one per mode. Start the chain in the lowest mode and it stays there for ever.

Now make the springs slightly nonlinear. With rr the extension of a spring, take the spring energy V(r)=r22+α r33, V(r)=\frac{r^{2}}2+\alpha\,\frac{r^{3}}3 , (0.2) with α\alpha small. The modes are now coupled: the cubic term lets energy flow from one to another. What should happen seemed clear to Fermi (Toda, §1.1). The expectation, from statistical mechanics, was that a large system of coupled degrees of freedom, left alone, forgets everything about how it was started except its conserved quantities — here, only the total energy — and settles into thermal equilibrium, where on average every mode holds the same share of the energy. That is equipartition. The nonlinearity was put in precisely to let it happen, and the plan was to watch how long it took.

Fermi, Pasta and Ulam, with Mary Tsingou writing and running the programs on one of the first electronic computers at Los Alamos, integrated this chain with 3232 and with 6464 masses, all the energy in the lowest mode at the start (Toda, §1.1). The 1955 report thanked Tsingou for coding and running the computations; her decisive part was properly recognised, and her name added to the problem’s, only about fifty years later (Dauxois 2008). Figure 1 is the same experiment, integrated for these notes.

Figure 1. The Fermi–Pasta–Ulam–Tsingou recurrence, integrated here rather than quoted: 3232 masses, α=14\alpha=\tfrac14, ends fixed, started at rest with all the energy in the lowest mode. Plotted is the energy in each of the four lowest modes. The energy leaves mode 11 (below 10%10\% of its start), passes through modes 22, 33 and 44 — and comes back: more than 95%95\% of it is in mode 11 again near t=104t=10^{4}, about 150150 periods of that mode, and more than 90%90\% a second time near t=2×104t=2\times10^{4}. Modes 99 to 3232 together never hold even 1%1\% of the energy; equipartition would give them three quarters of it (scripts/figures/fput_recurrence.py, which asserts each of these numbers).

The energy did spread — into the next few modes, never into the rest — and then it came back. Not equipartition: a recurrence, the chain returning almost exactly to where it started, again and again.

It is not an artefact of the integration: in Figure 1 the total energy is conserved to a few parts in a million over the whole run, and the recurrence has been reproduced many times since (Toda, §1.1). What it says is that the chain behaves as though it had more conserved quantities than energy. Energy alone cannot stop the flow into the high modes: every way of sharing out the same energy is allowed by that one constraint. Something else is holding the motion back. The Hooke chain had NN conserved quantities and never forgot anything; the question FPUT raised is how much of that survives the nonlinearity.

The quantum Newton’s cradle

Fifty years later the same question was asked of a quantum system, with atoms instead of a computer. Kinoshita, Wenger and Weiss (2006) trapped rubidium-87 atoms in an array of thin tubes made of laser light, each tube holding between 4040 and 250250 atoms and so narrow that the atoms can move only along it: a one-dimensional gas, with a harmonic trap along the tube. A short sequence of light pulses set each atom into a quantum superposition of moving one way and the other, so that the gas in each tube split into two clouds with opposite momenta. The two clouds then oscillate in the trap, passing through each other at its centre twice per period (Figure 2).

Figure 2. The quantum Newton’s cradle of Kinoshita, Wenger and Weiss (2006), schematically: this is a cartoon of the set-up, not their data. Atoms confined to move along a tube, in a harmonic trap, are split into two clouds with opposite momenta; the clouds oscillate and collide at the centre twice per period.

Two clouds of gas colliding head-on thousands of times should thermalise: the momentum distribution of the atoms should relax to a single thermal hump. It did not. After thousands of collisions the gas had not noticeably equilibrated; the two populations were still there. The name is the desk toy’s: a row of steel balls in which the momentum given to one end passes down the row and leaves at the other, over and over, without ever spreading out.

What the two have in common

Both experiments watched a system of many interacting parts and waited for it to forget its starting point. Neither did. In statistical mechanics the only things a system is allowed to remember are its conserved quantities, and what thermal equilibrium means is that the energy (with total momentum and particle number, where they are conserved) is all it remembers. A system that remembers more, for as long as these did, is evidence of further constraints on the motion — exact conserved quantities, or approximate ones that hold for a long time. Integrability is the case in which there are enough exact ones to pin the motion down. The FPUT chain turns out to be close to such a case, and the cradle’s gas very close (§0.4 says how close, and on whose authority). So the question of the course is

why do some systems of many interacting particles never forget how they were started — and what would a theory of such systems look like?

For particles on a line, two lines of mechanics already answer the first half (§0.2). The second half is the course, laid out on one page in §0.3. It makes integrability precise twice, classically in Lectures 1–9 and quantum mechanically in Lectures 10–20, and comes back to both experiments: FPUT in Lecture 12, where the Toda chain’s spring turns out to be FPUT’s through cubic order, and the cradle in Lecture 20.

0.2 Why one dimension is special

The Newton’s cradle already contains the key fact, and it takes two lines of algebra.

Proposition 0.1 (Two equal masses on a line). Two particles of equal mass collide elastically on a line, with velocities v1,v2v_1,v_2 before and w1,w2w_1,w_2 after. Then either (w1,w2)=(v1,v2)(w_1,w_2)=(v_1,v_2) or (w1,w2)=(v2,v1)(w_1,w_2)=(v_2,v_1): the particles pass unchanged or exchange velocities.

Proof. Momentum and energy are conserved (elastic means the energy of the relative motion is returned in full once the particles separate): w1+w2=v1+v2,w12+w22=v12+v22.w_1+w_2=v_1+v_2,\qquad w_1^{2}+w_2^{2}=v_1^{2}+v_2^{2}. Squaring the first and subtracting the second gives w1w2=v1v2w_1w_2=v_1v_2. So w1w_1 and w2w_2 have the same sum and the same product as v1v_1 and v2v_2: they are the two roots of the same quadratic x2−(v1+v2)x+v1v2=(x−v1)(x−v2)x^{2}-(v_1+v_2)x+v_1v_2=(x-v_1)(x-v_2). 

For particles that cannot pass through each other, only the exchange is possible. The conclusion needs equal masses. For masses m1≠m2m_1\ne m_2 the same two laws give w1=((m1−m2)v1+2m2v2)/(m1+m2)w_1=\big((m_1-m_2)v_1+2m_2v_2\big)/(m_1+m_2), and w1−v2=(m1−m2)(v1−v2)/(m1+m2)w_1-v_2=(m_1-m_2)(v_1-v_2)/(m_1+m_2) is not zero: the velocities are reshuffled into new values. It also needs one dimension: in the plane, three conservation laws (two components of momentum, and energy) for four unknown velocity components leave a one-parameter family of outcomes, labelled by the scattering angle, and that is how a gas in two or three dimensions shares out energy.

So in one dimension, a gas of identical particles cannot change its set of velocities by two-body collisions at all. The list of velocities is merely handed from particle to particle. If the velocity distribution is to relax, something else has to do it: three particles close together at once.

Three bodies

For three equal masses the count changes. Momentum and energy are still two equations, but now for three unknown outgoing momenta, and two equations in three unknowns leave a one-parameter family. The family is a circle: with PP the total momentum, p12+p22+p32=P23+u2+v2,u=p1−p22,v=p1+p2−2p36,p_1^{2}+p_2^{2}+p_3^{2}=\frac{P^{2}}3+u^{2}+v^{2},\qquad u=\frac{p_1-p_2}{\sqrt2},\quad v=\frac{p_1+p_2-2p_3}{\sqrt6}, so fixed PP and fixed energy EE confine the outgoing momenta to the circle u2+v2=2E−P2/3u^{2}+v^{2}=2E-P^{2}/3 (scripts/check-l0-algebra.py, group 3). The six rearrangements of the incoming momenta are six points on it. A generic three-body collision lands somewhere else on the circle, and the set of momenta changes. That is how a one-dimensional gas can thermalise.

Figure 3. Three equal masses meet at once on a line, with the same incoming momenta (1.6, 0.3, −1.2)(1.6,\,0.3,\,-1.2) (dashed) in both panels. Left: the Toda interaction eq1−q2+eq2−q3e^{q_1-q_2}+e^{q_2-q_3} of Lecture 12. The outgoing momenta are the incoming ones, rearranged: p1p_1 leaves with −1.2-1.2, p3p_3 with 1.61.6, p2p_2 with 0.30.3. Right: a generic repulsion, the same Gaussian bump e−(qi−qj)2e^{-(q_i-q_j)^{2}} between every pair. Momentum and energy are conserved in both runs, but on the right the particles leave with (−0.94, −0.14, 1.78)(-0.94,\,-0.14,\,1.78), a new set, 0.440.44 away from every rearrangement (scripts/figures/collisions_1d.py).

Figure 3 runs the experiment twice. On the right, a reasonable short-range repulsion; the three particles leave with new momenta. On the left, the Toda chain, an interaction chosen so that it has as many conserved quantities as particles — and the three particles leave with the momenta they came in with, rearranged, exactly as if they had met in pairs. Lecture 12 explains why. The chain carries a matrix, its Lax matrix, which changes in time but only in a way that keeps its eigenvalues fixed; long before and long after the collision it becomes diagonal, with the momenta on the diagonal. So the incoming and the outgoing momenta are both its eigenvalues (the separation of the particles, which this uses, is a cited theorem there). For such a system, in scattering, the rest of the argument goes through: no collision, of two particles or of three or of NN, changes the set of momenta the particles carry away. A gas is harder, because its particles are never free for long and their momenta at any instant do change. What an integrable gas conserves instead are quantities that play the part of the asymptotic momenta (in Part II, the rapidities). In a uniform gas their distribution is conserved, which stops the gas relaxing to ordinary thermal equilibrium; in the trap of the cradle it moves, and to a good approximation keeps returning. Lecture 16 makes the distribution precise, Lecture 19 and Lecture 20 the ensemble it fixes, and Lecture 20 its motion in a trap. The atoms of the Newton’s cradle interact, to a good approximation, by point-like contact forces, and the one-dimensional Bose gas with point-like interactions is exactly such a system in its quantum form — the Lieb–Liniger gas of Lecture 11. Kinoshita, Wenger and Weiss themselves suggested this as the probable explanation.

0.3 What it buys: the map of the course

Proposition 0.1 and Figure 3 already hold the answer the course makes precise. A system that never forgets how it was started has conserved quantities beyond the energy. In the integrable case it has as many as it has degrees of freedom, and in one dimension they can be as simple as the set of momenta the particles carry. Figure 4 is the course on one page: two halves, five goals, and every lecture opens by saying where on this map it stands.

Figure 4. The course on one page. Each half is read from the top down. A tag marks a lecture that builds a goal, and the goal is complete at its last tag; the untagged lectures build what the tagged ones use. G5 joins the halves: the identity that makes the quantum conserved quantities commute in Lecture 14 becomes, as ℏ→0\hbar\to0, the classical identity of Lecture 9. Lecture 20 comes back to the cradle of Lecture 0.

The five goals. A student who finishes the course can

  1. prove a many-body system integrable from scratch, and say what that buys: the Toda chain on a ring (Lectures 1–9);

  2. build a family of commuting quantum conserved quantities from one matrix, and diagonalise it: the Heisenberg spin chain (Lectures 10–15);

  3. solve an interacting quantum gas exactly and take it to the thermodynamic limit: the Lieb–Liniger gas (Lectures 11, 16 and 17);

  4. explain why an integrable system does not thermalise, and predict where it goes instead: a quench of the Ising chain, then a gas in motion (Lectures 18–20);

  5. show that the quantum structure of G2 becomes the classical structure of G1 as ℏ→0\hbar\to0, on the quantum Toda chain (Lecture 14).

Five ideas carry them, and each lecture uses one or two:

  1. Integrability is a count: as many independent conserved quantities, compatible with one another, as degrees of freedom. What it buys is free motion in the right variables (Lectures 5 and 6).

  2. For the Toda ring and the Heisenberg chain the conserved quantities come as one family, the trace of a matrix that depends on an extra parameter, and they commute because of one local identity: classically in Lecture 9, quantum mechanically in Lecture 14.

  3. Integrable scattering only rearranges momenta, and many-body scattering is a sequence of two-body events. Their consistency is one equation, the Yang–Baxter equation (Lecture 13); putting the particles on a ring then fixes each momentum by an equation of its own, a Bethe equation (Lectures 10–13).

  4. With many particles the momenta become a density, fixed by one linear integral equation. That equation gives the ground state (Lecture 16), and dressing by it gives the excitations (Lecture 17). At a temperature one more equation, a nonlinear one, fixes how full each momentum is and gives the equation of state (Lecture 17). In a gas that flows, dressing gives the velocity at which each momentum travels, and the density of each momentum is carried along at that velocity: the hydrodynamics of Lecture 20.

  5. What an integrable system conserves, it remembers: it relaxes, but to an ensemble that keeps every conserved quantity, not to a thermal state (Lectures 19 and 20).

How each lecture is built. Every lecture follows the same order: its question; only the definitions the question needs; one worked example on the course’s running model; the statement; its proof; what the result buys; the caveats, gathered in one section; and a summary pointing to the next lecture. Proved is the default and carries no mark. A result that is only sketched or cited is marked so where it is stated. Sections marked ★ are reading, and sections marked ▸ are tutorial; neither is lectured, and no core argument depends on them.

What is assumed: calculus, linear algebra (including eigenvalues and tensor products of matrices), ordinary differential equations, classical mechanics in Hamiltonian form, and quantum mechanics at the level of spin and perturbation theory. What is not: manifolds, differential forms, symplectic geometry, Lie groups, representation theory. Each is built, concretely, in the lecture that first needs it. What is not done: integrable field theories — solitons, the Korteweg–de Vries equation, the inverse scattering transform — which need this course first. The optional lectures A (quantum chaos and level statistics), B (the Calogero–Moser systems) and C (nesting and the Hubbard model) lie off the path.

0.4 Caveats, in one place

  • FPUT is not integrable. Its spring agrees with a Toda spring through cubic order, for every α≠0\alpha\ne0 (the tutorial at the end of this lecture), and the Toda chain with fixed ends is integrable (Toda, §2.10) cited. Numerical studies find that at low energy, and for very long times, the FPUT chain stays close to it (Benettin, Christodoulidi and Ponno 2013) cited. On that reading the recurrence is the shadow of the Toda chain’s conserved quantities. The course proves neither statement. It proves the Toda chain integrable on a ring (Lecture 9), and solves its scattering on an open line (Lecture 12).

  • The cradle is only nearly integrable. The trap along the tube, and the tube’s finite width, break the integrability of the Lieb–Liniger description slightly. Why the gas still did not thermalise on the time scale of the experiment is Lecture 20’s business.

  • In quantum mechanics, counting conserved quantities is not a definition. A Hamiltonian on a finite-dimensional space commutes with the projector onto each of its own eigenspaces, so commuting conserved quantities are never in short supply, and what “independent” should mean has no agreed answer (Caux and Mossel 2011). Part II therefore works with the two criteria of P3 and P2: scattering that only rearranges momenta, in the solutions of Lectures 10–13, and one commuting family from one matrix, for the Heisenberg chain in Lectures 14 and 15. The Ising chain of Lectures 18 and 19 is solved another way, by turning it into free fermions.

Reading

0.5 History, briefly

The FPUT computation was written up as a Los Alamos report in 1955 (Fermi, Pasta and Ulam, LA-1940). Mary Tsingou’s part — she wrote and ran the programs — was brought to light by Dauxois (2008), and the problem now carries her name. The first explanation came from the continuum. Zabusky and Kruskal (1965) replaced the chain by a partial differential equation, the Korteweg–de Vries equation, found numerically that its localised waves pass through one another and re-emerge unchanged, called them solitons, and read the recurrence through their motion (Toda, §§1.1 and 2.7). That line leads to the inverse scattering transform and to classical field theory, which this course leaves out. Toda (1967) went the other way: keep the lattice, and look for a spring law for which the chain has exact nonlinear waves. He found the exponential spring of Lecture 12, and the Toda chain turned out to be integrable. Whether the FPUT chain itself eventually equipartitions, and on what time scale, is still studied numerically, and the Toda chain is now the reference point for that question (Benettin, Christodoulidi and Ponno 2013).

Tutorial

0.6 The FPUT spring is a Toda spring, to cubic order

The general Toda spring, with two constants aa, bb, is VT(r)=ab e−br+ar−ab=ab2 r2−ab26 r3+O(r4),V_{\mathrm{T}}(r)=\frac ab\,e^{-br}+ar-\frac ab =\frac{ab}2\,r^{2}-\frac{ab^{2}}6\,r^{3}+O(r^{4}), the constant chosen so that VT(0)=0V_{\mathrm T}(0)=0; the linear terms cancel. Match it to κ(12r2+α3r3)\kappa\big(\tfrac12r^{2}+\tfrac\alpha3r^{3}\big), the FPUT spring (0.2) with a spring constant κ>0\kappa>0. The quadratic terms give ab=κab=\kappa and the cubic terms −ab2/6=κα/3-ab^{2}/6=\kappa\alpha/3, so b=−2α,a=−κ2α.b=-2\alpha,\qquad a=-\frac{\kappa}{2\alpha}. For every α≠0\alpha\ne0 there is exactly one Toda spring that agrees with FPUT’s through cubic order. For α<0\alpha<0 both constants are positive; with κ=1\kappa=1, α=−12\alpha=-\tfrac12 it is e−r+r−1e^{-r}+r-1, the spring of Lecture 12. For α>0\alpha>0, as in Figure 1, both are negative, and VT(r)V_{\mathrm T}(r) is the α<0\alpha<0 spring with rr replaced by −r-r: the chain of Figure 1 is, to cubic order, a Toda chain with compression and extension exchanged (scripts/check-l0-algebra.py, group 4). The two springs part company at quartic order, and that difference is what makes FPUT a perturbation of Toda rather than Toda itself.

Summary

  • Two experiments — the FPUT chain’s recurrence and the quantum Newton’s cradle — show many-body systems that do not forget how they were started (Figures 1 and 2): evidence of conserved quantities beyond the energy. Integrability is the case of enough exact ones.
  • One dimension is special: two equal masses on a line can only exchange velocities (Proposition 0.1). A three-body collision has a circle of possible outcomes, and an integrable one picks a rearrangement (Figure 3).
  • The map (Figure 4): five goals, complete at Lecture 9 (G1), 15 (G2), 17 (G3), 20 (G4) and 14 (G5, which joins Lecture 14 to Lecture 9); five ideas, P1–P5, that carry them.
  • Next: Lecture 1 starts G1 with the arena everything happens in — phase space, and the flows on it.

References

M. Toda, Theory of Nonlinear Lattices, §1.1 (the FPU problem, its parameters and the recurrence), §2.7 and §2.10; E. Fermi, J. Pasta and S. Ulam, Los Alamos report LA-1940 (1955); T. Dauxois, Physics Today 61(1) (2008) 55; N. J. Zabusky and M. D. Kruskal, Phys. Rev. Lett. 15 (1965) 240; M. Toda, J. Phys. Soc. Japan 22 (1967) 431; G. Benettin, H. Christodoulidi and A. Ponno, J. Stat. Phys. 152 (2013) 195; T. Kinoshita, T. Wenger and D. S. Weiss, Nature 440 (2006) 900; J.-S. Caux and J. Mossel, J. Stat. Mech. (2011) P02023.

End of Lecture 0

Why integrability?