Optional lecture A

Quantum chaos and level statistics

What this lecture does

Off the path: nothing on it uses this lecture. Lecture 7 told an integrable orbit from a chaotic one by a picture. The quantum substitute is not a count of commuting operators, which decides nothing, but a set of criteria: charges from commuting transfer matrices, scattering without diffraction, and the statistics of the energy levels. The last can be tested on a laptop, and doing so honestly takes one piece of care that every first attempt leaves out. None of the criteria is a theorem.

Reading and tutorial. Material marked Reading is studied on your own; material marked Tutorial is worked in the tutorial. Everything else is the lectured core.

A.1 The question

Lecture 7 diagnosed classical integrability by a picture (Figure 7.5): at the same energy, an orbit of the Toda ring crosses a Poincaré section on a curve, the torus it winds round cut by the section (Figure 7.2), while most orbits of its cubic truncation, Hénon–Heiles, scatter over an area. A quantum system has no orbits to cut. So the question is

what tells an integrable quantum system from a chaotic one, and what does the test prove?

The answer: not the number of conserved operators (Proposition A.1) but their locality; and, as a test, the level statistics inside one fully resolved symmetry block — Poisson for XXZ, Wigner–Dyson with a next-nearest-neighbour coupling J2=0.5J_2=0.5 at N=18N=18 (Figure A.2). The test is one of three working criteria, and no general theorem connects them (§A.5). The worked example is Lecture 19’s chain (19.1).

A.2 The naive definition fails

By Lecture 10’s rule of translation (10.1), AA is conserved when [A,H]=0\comm{A}{H}=0, and two conserved operators are “in involution” when they commute. Every ingredient of Lecture 5’s definition translates except independence.

What “independent” meant classically

Every function of the energy is conserved, {h(H),H}=0\pb{h(H)}{H}=0, so conserved quantities are never scarce. Liouville’s definition (Definition 5.5) asks for more: nn of them whose differentials are linearly independent (Definition 5.1). That is a condition with content. h(H)h(H) fails it, since dh(H)=h′(H) dH\dd h(H)=h'(H)\,\dd H is parallel to dH\dd H; and independence is what makes a level set {F=f}\{F=f\} an nn-dimensional manifold, which, where compact and connected, the theorem proves to be a torus (Theorem 5.7). At most nn functions in involution can be independent (Proposition 4.11), so “nn” is a sharp number.

The quantum count

Take the simplest quantum system that could be a many-body problem: a Hilbert space CD\C^{D} of finite dimension. A chain of NN spins 12\tfrac12 has D=2ND=2^{N}. Let HH be Hermitian with simple spectrum E1<E2<⋯<EDE_1<E_2<\dots<E_D and eigenvectors ψa\psi_a, and let Πa=ψaψa†\Pi_a=\psi_a\psi_a^{\dagger} be the projector onto the aa-th eigenline. (The projectors are Πa\Pi_a throughout; PP is the permutation operator of Definition 9.4.)

Proposition A.1 (Every Hamiltonian has DD commuting integrals).

  1. (a)

    The Πa\Pi_a commute with HH and with each other, are linearly independent, and H=∑aEaΠaH=\sum_aE_a\Pi_a.

  2. (b)

    An operator AA commutes with HH if and only if A=∑acaΠaA=\sum_ac_a\Pi_a for some numbers cac_a, if and only if A=f(H)A=f(H) for a polynomial ff of degree less than DD. In particular Πa=∏b≠aH−EbEa−Eb. \Pi_a=\prod_{b\ne a}\frac{H-E_b}{E_a-E_b}. (A.1)

  3. (c)

    Every operator AA on CD\C^{D} satisfies a nonzero polynomial equation, pA(A)=0p_A(A)=0, where pAp_A is its characteristic polynomial.

Proof. (a) In the eigenbasis every Πa\Pi_a and HH are diagonal, so they commute; Πa\Pi_a has a single 11 on the diagonal, in position aa, so the DD of them are linearly independent, and H=diag⁡(Ea)=∑EaΠaH=\operatorname{diag}(E_a)=\sum E_a\Pi_a. (b) In the eigenbasis, (AH−HA)ab=(Eb−Ea)Aab(AH-HA)_{ab}=(E_b-E_a)A_{ab}, which vanishes for all a≠ba\ne b exactly when AA is diagonal, A=∑aAaaΠaA=\sum_a A_{aa}\Pi_a. The right side of (A.1) is diagonal with entry ∏b≠a(Ec−Eb)/(Ea−Eb)\prod_{b\ne a}(E_c-E_b)/(E_a-E_b) in position cc, which is 11 for c=ac=a and 00 otherwise; so each Πa\Pi_a, hence each ∑caΠa\sum c_a\Pi_a, is a polynomial in HH of degree D−1D-1. Conversely every polynomial in HH commutes with HH. (c) is the Cayley–Hamilton theorem. 

Now try to say what “DD independent conserved operators” should mean.

  • Linearly independent. By (a), every Hamiltonian with simple spectrum has DD of them in involution, D−1D-1 after discarding the identity ∑Πa\sum\Pi_a (with degenerate levels, take the projectors of any eigenbasis). A random matrix qualifies as well as the XXX chain of Lecture 10.

  • Functionally independent, the classical notion, where A=f(B)A=f(B) counts as dependent, as h(H)h(H) did. By (b), if the spectrum is simple then every conserved operator is a function of HH, and no such Hamiltonian has a single integral beyond HH itself, however regular its dynamics. With degenerate levels, as for XXX, the same happens one step up: every commuting family consists of functions of one operator (von Neumann; the reading at the end of this lecture).

  • Algebraically independent: no nonzero polynomial relation among them. By (c), not even one operator on CD\C^{D} is algebraically independent; the projectors satisfy Πa2=Πa\Pi_a^{2}=\Pi_a and ΠaΠb=0\Pi_a\Pi_b=0 besides.

One reading makes every system integrable, the other two make none. The count of commuting operators cannot be the definition, and there is no quantum analogue of functional independence to rescue it: the classical notion was a statement about differentials, and a finite matrix has none. Caux and Mossel (2011) call the counting definition “too naive” for this reason cited.

What survives is not how many conserved operators there are but what they look like in the basis in which the system was written down. The projector onto a typical eigenstate of a chain of twenty spins has nonzero entries all over its symmetry block, a block of dimension up to about 10410^{4}; the Hamiltonian is a sum of twenty terms, each acting on two neighbouring spins. Lecture 19’s local charges (Definition 19.1) make the difference precise: those of range at most rr span at most 4r4^{r} dimensions, whatever NN (Proposition 19.2), while the commutant has at least 2N2^{N}. At any fixed range, then, the local charges fill a fraction at most 4r/2N4^{r}/2^{N} of the conserved operators, which goes to zero as the chain grows. So no family of local charges of one bounded range can be complete; a tower whose ranges grow, like XXX’s (Lecture 15’s reading), needs a separate count, and on a ring of NN sites it has only about NN members. Locality — not number — is what can tell one Hamiltonian’s conserved quantities from another’s.

A local charge, and how easily it is lost

Write Pn:=Pn,n+1P_n:=P_{n,n+1} for the permutation of two neighbouring sites, so that Lecture 10’s Heisenberg Hamiltonian is H=J2∑n(Pn−1)H=\frac J2\sum_n(P_n-1) (10.2), a local charge of range 22.

Theorem A.2 (A third conserved charge proved in the tutorial). On a ring of N≥4N\ge4 sites, the local charge of range 33 Q3=∑n=1N(σn×σn+1)⋅σn+2=2i∑n=1N[Pn,Pn+1] Q_3=\sum_{n=1}^{N}\big(\boldsymbol\sigma_n\times\boldsymbol\sigma_{n+1}\big) \cdot\boldsymbol\sigma_{n+2} =2\ii\sum_{n=1}^{N}\comm{P_n}{P_{n+1}} (A.2) commutes with the Heisenberg Hamiltonian (10.2).

Q3Q_3 is genuinely new: it is not a polynomial in HH (the tutorial shows this by a reflection), and Lecture 15’s reading finds it in the second logarithmic derivative of the transfer matrix, and sketches the tower above it. And the proof is fragile. Add a next-nearest-neighbour coupling J2∑Sn⋅Sn+2J_2\sum\mathbf S_n\cdot\mathbf S_{n+2} — the J1J_1–J2J_2 chain — and both cancellations fail, and a computer search at N=8,9N=8,9 finds no range-33 conserved charge beyond HH and the total spin (the tutorial). Make the chain anisotropic instead (XXZ) and (A.2) fails too, but a modified range-33 charge exists: XXZ is integrable. Grabowski and Mathieu proposed the existence of one range-33 charge beyond the Hamiltonian as a test of integrability; it is a conjecture cited.

A.3 Level statistics

Spacings

Let E1≤E2≤…E_1\le E_2\le\dots be the eigenvalues of HH in one symmetry sector, a notion made precise below, and sn=En+1−Ens_n=E_{n+1}-E_n the spacings. The density of levels varies across the spectrum, so before spacings from different places can be compared they are unfolded: replace each EnE_n by the smoothed count of levels below it, so that the mean spacing is 11 everywhere. The histogram P(s)P(s) of unfolded spacings is the object.

Uncorrelated levels. If the levels were independent random points of unit density, the chance that an interval of length ss contains none of them would be e−se^{-s} (the limit of (1−s/L)L(1-s/L)^{L} for LL points in length LL), and the spacing distribution is PP(s)=e−s(Poisson). P_{\mathrm P}(s)=e^{-s}\qquad\text{(Poisson).} (A.3) Its maximum is at s=0s=0: nearly degenerate pairs are common.

Levels that repel. Now let the Hamiltonian be a generic real symmetric matrix, with no structure. For two levels the whole story is visible.

Proposition A.3 (The Wigner surmise). Let H=(accb)H=\begin{pmatrix}a&c\\c&b\end{pmatrix} with a,ba,b Gaussian of variance 11 and cc Gaussian of variance 12\tfrac12, all independent (the Gaussian orthogonal ensemble, GOE, for 2×22\times2). Its eigenvalue spacing, rescaled to mean 11, has density PW(s)=πs2 e−πs2/4. P_{\mathrm W}(s)=\frac{\pi s}{2}\,e^{-\pi s^{2}/4}. (A.4)

Proof. The spacing is s=x2+y2s=\sqrt{x^{2}+y^{2}} with x=a−bx=a-b and y=2cy=2c, which are independent Gaussians of the same variance, 22. So (x,y)(x,y) is an isotropic Gaussian in the plane and ss its distance from the origin: its density is proportional to the circumference 2πs2\pi s times e−s2/4e^{-s^{2}/4}. Rescaling to mean 11 gives (A.4). 

The factor ss is the whole point. A degeneracy needs two conditions, a=ba=b and c=0c=0, and two conditions on a random point of the plane are met with probability zero and nearly met only rarely: level repulsion, P(s)→0P(s)\to0 as s→0s\to0. For large GOE matrices the spacing distribution is not exactly (A.4), but close to it (the first reading at the end of this lecture measures how close). “Wigner–Dyson statistics” means this shape.

Why should an integrable system be Poissonian and a chaotic one look like a random matrix? Two conjectures say so, supported by much evidence and proved in neither generality: Berry and Tabor (1977) for integrable systems and Bohigas, Giannoni and Schmit (1984) for chaotic ones cited; spin chains were tested from Poilblanc et al. (1993) on. The picture to keep: in an integrable system every level carries quantum numbers, one per conserved charge, and levels with different labels do not mix, so their spacings are uncorrelated; in a chaotic system nothing labels the levels, and every pair repels (the reading at the end of this lecture).

The ratio

Unfolding needs a fit and a choice of what to discard at the edges. A statistic that needs neither is the ratio of consecutive spacings (Oganesyan and Huse 2007), rn=min⁡(sn,sn+1)max⁡(sn,sn+1)∈[0,1], r_n=\frac{\min(s_n,s_{n+1})}{\max(s_n,s_{n+1})}\in[0,1], (A.5) which does not see the local density because it is a ratio. For Poisson levels its mean is ⟨r⟩P=2ln⁡2−1≈0.386 \langle r\rangle_{\mathrm P}=2\ln2-1\approx0.386 (A.6) (the tutorial at the end of this lecture); for the GOE, ⟨r⟩≈0.531\langle r\rangle\approx0.531 (Atas, Bogomolny, Giraud and Roux 2013, who find 0.53070.5307 numerically for large matrices and 4−23≈0.5364-2\sqrt3\approx0.536 from 3×33\times3 ones) cited. One number, between 0.3860.386 and 0.5310.531, is the whole diagnosis.

A.4 Resolve the symmetries first

The first experiment everyone does gives the wrong answer. Take a chain that nobody believes to be integrable and histogram its spacings (Figure A.1, left): Poisson.

Figure A.1. One chain expected to be non-integrable, (19.1) with Δ=0.55\XXZ=0.55, J2=0.5J_2=0.5, N=18N=18, Sz=1S^{z}=1. Left: the levels of the eight momentum blocks 0<k<π0<k<\pi put into one list — Poisson, and wrong. Right: spacings taken inside each block and then pooled — Wigner–Dyson. Both panels start from the same eight block spectra; each applies its own unfolding and bulk cut. (Generated and checked by scripts/figures/level_statistics.py.)

The reason is block structure. If HH commutes with a symmetry — here the translation τ\tau — it is block diagonal in the symmetry’s eigenbasis, one block per eigenvalue (per momentum kk). Levels in different blocks sit in different blocks of a matrix: they never mix, so they do not repel, and a list that interleaves several blocks’ spectra is a superposition of independent sequences. Superpose enough independent sequences and the result is Poisson whatever each one was — the same reason independent points are Poisson. (Two GOE spectra superposed already give ⟨r⟩≈0.43\langle r\rangle\approx0.43; eight give 0.390.39; check-l13-algebra.py.) So a symmetry left unresolved fakes integrability. The cure is to diagonalise one block at a time and collect statistics inside each.

Which symmetries. Here: translation (momentum k=2πj/Nk=2\pi j/N), the total SzS^{z}, the spin flip Sz→−SzS^{z}\to-S^{z}, the reflection k→−kk\to-k, and for isotropic chains SU(2)\SU(2). A block is resolved when no remaining unitary symmetry acts within it (an antiunitary one may, and fixes the reference ensemble; the first reading); Sz=1S^{z}=1, 0<k<π0<k<\pi and anisotropy achieve it, since the flip and the reflection each move such a block to a different one. That argument is the proof. The generator adds a necessary check, not a sufficient one: no two levels in any block coincide (no spacing below 10−810^{-8} of the mean). A reader repeating the experiment should do both.

The experiment

The chain is Lecture 19’s (19.1), at Δ=0.55\XXZ=0.55. At J2=0J_2=0 it is the XXZ chain, which the algebraic Bethe ansatz solves (Lecture 15’s reading); for J2≠0J_2\ne0 it is not known to be integrable, and Figure A.2 shows why nobody expects it to be.

Figure A.2. Unfolded spacings of (19.1), N=18N=18, Sz=1S^{z}=1, each momentum block 0<k<π0<k<\pi unfolded on its own and the spacings pooled (88 blocks, 19 44819\,448 levels, the central 80%80\% of each used). Left: XXZ, integrable, Poisson. Right: with J2=0.5J_2=0.5, Wigner–Dyson. The generator asserts ∣⟨r⟩−0.386∣<0.015\abs{\langle r\rangle-0.386}<0.015 on the left and ∣⟨r⟩−0.531∣<0.015\abs{\langle r\rangle-0.531}<0.015 on the right.
Figure A.3. ⟨r⟩\langle r\rangle against the next-nearest-neighbour coupling J2J_2 in (19.1), resolved blocks, three chain lengths. The crossover from Poisson to GOE moves to smaller J2J_2 as NN grows.

Figure A.3 sweeps J2J_2. The mean ratio leaves the Poisson value as soon as J2J_2 is switched on; at N=18N=18 it reaches the GOE value by J2≈0.4J_2\approx0.4, at N=14N=14 only at larger coupling, and the crossover is sharper for the longer chain. Whether an arbitrarily small J2J_2 makes an infinitely long chain chaotic is a real question, and the figure cannot answer it; §A.6 returns to it.

A.5 Working criteria, and their status

The working criteria of quantum integrability, as used in practice and on the path of this course:

  1. (T)

    Transfer-matrix charges. A family of commuting transfer matrices t(λ)t(\lambda), built from a solution of the Yang–Baxter equation (Lecture 14), whose logarithmic derivatives give a tower of local conserved charges (Lecture 15 and its reading).

  2. (S)

    Non-diffractive scattering. When particles are far apart, their momenta are conserved as a set, and many-body scattering factorises into two-body events — the quantum form of Lecture 12’s Theorem 12.2, and Sutherland’s definition (Lecture 10, Lecture 11, Lecture 13).

  3. (P)

    Poisson statistics, in fully resolved symmetry blocks.

They are criteria, not a definition, because no general theorem connects them, and there are systems where one holds without another.

  • Charges without (P). The Haldane–Shastry chain, whose exchange falls off as the inverse square of the chord distance, has an explicit commuting family of conserved charges (Talstra and Haldane 1995), though not local ones: they are sums over pairs, triples, … of sites. Its level statistics are neither Poisson nor Wigner–Dyson (Finkel and González-López 2005, quoted by Caux and Mossel) cited. The harmonic oscillator is not Poisson either (the reading on Berry and Tabor).

  • (P) without (T). A strongly disordered chain in the many-body localised regime shows Poisson statistics and has no transfer matrix; it has quasi-local conserved quantities of its own, but whether that regime survives in infinitely long chains is contested (Abanin, Altman, Bloch and Serbyn 2019; Šuntajs, Bonča, Prosen and Vidmar 2020) cited. And, as Figure A.1 showed, (P) can be produced by carelessness alone.

  • (S) needs room. Non-diffraction concerns particles that separate — gases on a line, dilute excitations of a chain — and says nothing directly about a finite spectrum (Caux and Mossel) cited.

Symmetry is not integrability, in either direction. The J1J_1–J2J_2 Heisenberg chain has all of SU(2)\SU(2) and translation, so its levels come in large degenerate multiplets; yet within blocks of fixed total spin and momentum its statistics are Wigner–Dyson (⟨r⟩=0.53\langle r\rangle=0.53 at J2=0.7J_2=0.7, N=18N=18, total spin 11; check-l13-algebra.py), and a search at that coupling (N=8,9N=8,9) finds no range-33 charge beyond HH and the total spin (the tutorial). Conversely the anisotropic XYZ chain, ∑(JxSxSx+JySySy+JzSzSz)\sum(J_xS^{x}S^{x}+J_yS^{y}S^{y}+J_zS^{z}S^{z}) with three different couplings, has no continuous symmetry at all and is integrable, by a commuting family of transfer matrices (Baxter, Exactly Solved Models, §10.14) cited. Degeneracies count symmetries; integrability is something else.

On the path, Lecture 14 constructs commuting transfer matrices for XXX and for quantum Toda; for XXX, Lecture 15 obtains the Hamiltonian from their logarithmic derivative, and its reading sketches the local tower. The Ising chain’s charges are constructed directly, with no transfer matrix (Lecture 18’s reading, Proposition 19.8). None of the criteria is assumed to imply another.

A.6 The mirror of Lecture 7

Lecture 7 diagnosed classical integrability by a picture: curves or scattered dots in a Poincaré section (Figure 7.5). Figure A.4 sets it beside this lecture’s. No theorem relates the two rows — one is a property of orbits, the other of a spectrum — but they play the same role, and the two conjectures above claim that they agree where both make sense.

Figure A.4. The two diagnostics. Top: sections at E=1/6E=1/6 as in Figure 7.5, recomputed with fewer orbits — curves for Toda, a cloud with a few regular curves for Hénon–Heiles. Bottom: the spacings of Figure A.2, Poisson against Wigner–Dyson. (scripts/figures/quantum_mirror.py.)

The mirror goes one step further. Classically, a weak perturbation of an integrable system does not destroy it at once: most tori survive (KAM, Theorem 7.8), and chaos grows from the resonances. The quantum question is what Figure A.3 raises and cannot settle: does a weakly broken integrable chain keep a memory of its charges? For a while it often does — the prethermal plateau of Remark 20.2 — and whether it does in a controlled sense is the quantum KAM question, which that remark leaves open.

Dictionary

the Poisson bracket, f˙={f,H}\dot f=\pb{f}{H}⟶the commutator, A˙=[A,H]/iℏ\dot A=\comm{A}{H}/\ii\hbar (analogy: the same role; this lecture proves nothing about ℏ→0\hbar\to 0)

Liouville’s nn independent integrals in involution⟶no agreed definition; three criteria, no general theorem connecting them (a declared absence)

Poincaré sections: curves or scattered dots⟶level statistics: Poisson or Wigner–Dyson (analogy; the link is the Berry–Tabor and BGS conjectures, cited)

A.7 What it buys

  • A test anyone can run: ⟨r⟩\langle r\rangle inside fully resolved blocks, 0.3860.386 against 0.5310.531 (Figures A.2 and A.3).

  • Why it is not a definition: counting decides nothing (Proposition A.1), and no general theorem connects the criteria.

  • The quantum mirror of Lecture 7, related by conjecture, not by theorem; and, in a reading, the tori globally, left open by Lecture 5 and Lecture 6.

A.8 Caveats, in one place

  • Status. Proposition A.1 and Proposition A.3 are proved; Theorem A.2 and ⟨r⟩P=2ln⁡2−1\langle r\rangle_{\mathrm P}=2\ln2-1 are proved in the tutorial. The two conjectures, the GOE value of ⟨r⟩\langle r\rangle and the charges of Haldane–Shastry and XYZ are cited. Every statement about one chain at one size — the figures, the charge search — is numerical, at that size only.

  • Resolved means proved resolved, by an argument about the symmetries; no coincident levels is a necessary check, not a sufficient one.

  • The limit is open: Figure A.3 does not settle whether an arbitrarily small J2J_2 makes an infinitely long chain chaotic.

  • Classical and quantum are not one definition. The one bridge the course proves, Lecture 14’s limit ℏ→0\hbar\to0, takes quantum Toda’s RTTRTT relation to Lecture 9’s bracket: one structure in one model, not one definition into another. Spin chains have no classical limit at fixed NN (the reading on Berry and Tabor), so the mirror is an analogy.

Tutorial

A.9 Four computations

The proof of Theorem A.2. Write Pn:=Pn,n+1P_n:=P_{n,n+1}. The only facts about permutations the proof uses are Pn2=1,PnPn+1Pn=Pn+1PnPn+1,PnPm=PmPn  if ∣n−m∣≥2, P_n^{2}=1,\qquad P_nP_{n+1}P_n=P_{n+1}P_nP_{n+1},\qquad P_nP_m=P_mP_n\ \text{ if } \abs{n-m}\ge2 , (A.7) the last because the two bonds share no site (on the ring, ∣n−m∣\abs{n-m} is measured round it). The middle identity says both sides exchange sites nn and n+2n+2. The second form of (10.2) uses σn⋅σn+1=2Pn,n+1−1\boldsymbol\sigma_n\cdot\boldsymbol\sigma_{n+1}=2P_{n,n+1}-1, true because both sides equal 11 on the triplet and −3-3 on the singlet.

The two forms agree. [σa,σb]=2iϵabcσc\comm{\sigma^{a}}{\sigma^{b}}=2\ii\epsilon_{abc} \sigma^{c} on one site gives [σn⋅σn+1,σn+1⋅σn+2]=−2i(σn×σn+1)⋅σn+2\comm{\boldsymbol\sigma_n\cdot\boldsymbol\sigma_{n+1}} {\boldsymbol\sigma_{n+1}\cdot\boldsymbol\sigma_{n+2}} =-2\ii(\boldsymbol\sigma_n\times\boldsymbol\sigma_{n+1})\cdot\boldsymbol\sigma_{n+2}, and the left side is 4[Pn,Pn+1]4\comm{P_n}{P_{n+1}}.

Only neighbours contribute. By (10.2), [H,Q3]=iJ∑m,n[Pm,[Pn,Pn+1]]\comm{H}{Q_3}=\ii J\sum_{m,n}\comm{P_m}{\comm{P_n}{P_{n+1}}}. The bond mm commutes with PnP_n and Pn+1P_{n+1} unless it touches one of the sites nn, n+1n+1, n+2n+2, that is unless m∈{n−1,n,n+1,n+2}m\in\{n-1,n,n+1,n+2\} (four distinct bonds, since N≥4N\ge4). The sum splits into two kinds of term (Figure A.5).

Three-site terms, m=nm=n and m=n+1m=n+1. Write a=Pna=P_n, b=Pn+1b=P_{n+1}. Using a2=b2=1a^{2}=b^{2}=1, [a,[a,b]]=2b−2aba,[b,[a,b]]=2bab−2a,\comm{a}{\comm{a}{b}}=2b-2aba,\qquad \comm{b}{\comm{a}{b}}=2bab-2a, and by the braid relation aba=bababa=bab the sum is 2(b−a)=2(Pn+1−Pn)2(b-a)=2(P_{n+1}-P_n). Summed over nn round the ring, it telescopes to zero.

Four-site terms, m=n−1m=n-1 and m=n+2m=n+2. Relabelling n→n+1n\to n+1 in the first, ∑n([Pn−1,[Pn,Pn+1]]+[Pn+2,[Pn,Pn+1]])=∑n([a,[b,c]]+[c,[a,b]]),\sum_n\Big(\comm{P_{n-1}}{\comm{P_n}{P_{n+1}}}+\comm{P_{n+2}}{\comm{P_n}{P_{n+1}}}\Big) =\sum_n\Big(\comm{a}{\comm{b}{c}}+\comm{c}{\comm{a}{b}}\Big), now with a=Pna=P_n, b=Pn+1b=P_{n+1}, c=Pn+2c=P_{n+2}. The Jacobi identity says [a,[b,c]]+[c,[a,b]]=−[b,[c,a]]\comm{a}{\comm{b}{c}}+\comm{c}{\comm{a}{b}}=-\comm{b}{\comm{c}{a}}, and [c,a]=0\comm{c}{a}=0 because the bonds nn and n+2n+2 are disjoint. So [H,Q3]=0\comm{H}{Q_3}=0.

Figure A.5. The stencil of [H,Q3]\comm{H}{Q_3}. The density qnq_n of Q3Q_3 spans three sites; four bonds of HH touch it. The two inside it give three-site terms that add up to a difference of neighbouring bonds; the two overhanging it give four-site terms that cancel against the neighbouring densities’ by the Jacobi identity. Every other bond commutes with qnq_n.

Q3Q_3 is not a polynomial in HH. Let RR be the reflection of the ring, site n↦N+1−nn\mapsto N+1-n. It maps each bond to a bond, so RHR−1=HRHR^{-1}=H, and hence Rf(H)R−1=f(H)Rf(H)R^{-1}=f(H) for every polynomial ff. It maps (σn×σn+1)⋅σn+2(\boldsymbol\sigma_n\times\boldsymbol\sigma_{n+1})\cdot\boldsymbol\sigma_{n+2} to the same triple product of three consecutive sites taken in the reverse order, which is minus it (the three factors act on different sites and commute, and the triple product is antisymmetric in its outer two vectors). So RQ3R−1=−Q3RQ_3R^{-1}=-Q_3. Finally Q3≠0Q_3\ne0 for N≥4N\ge4: its terms are Pauli strings on different triples of sites and cannot cancel.

A search for local charges. Every local charge of range at most 33 is a combination of the translation sums of the 43=644^{3}=64 Pauli strings on three sites; for N≥5N\ge5 they span 4949 dimensions (Proposition 19.2; on smaller rings wrap-around makes some coincide). Requiring [H,Q]=0\comm{H}{Q}=0 is a linear condition on the coefficients, solved by computer. At N=8N=8 and 99 (scripts/check-l13-algebra.py) the solutions are: for XXX exactly 11, SxS^{x}, SyS^{y}, SzS^{z}, HH and Q3Q_3; for the J1J_1–J2J_2 chain at J2=0.3J_2=0.3, 0.50.5 and 0.70.7 the same list without Q3Q_3; for XXZ at Δ=0.55\XXZ=0.55, 11, SzS^{z}, HH and an anisotropic cousin of Q3Q_3; for XXZ with J2J_2, only 11, SzS^{z}, HH. That is a search at two sizes, not a proof about any other.

The ratio for uncorrelated levels. Take two consecutive spacings of Poisson levels, independent with density e−se^{-s}. Then r~=sn/sn+1\tilde r=s_n/s_{n+1} has distribution Pr⁡(r~≤x)=∫0∞ ⁣ ⁣e−t (1−e−xt) dt=1−11+x,density 1(1+x)2.\Pr(\tilde r\le x)=\int_0^{\infty}\!\!e^{-t}\,(1-e^{-xt})\,\dd t =1-\frac1{1+x},\qquad\text{density }\frac{1}{(1+x)^{2}} . The density is unchanged by x↦1/xx\mapsto1/x (with its Jacobian), so r=min⁡(r~,1/r~)r=\min(\tilde r,1/\tilde r) has density 2/(1+r)22/(1+r)^{2} on [0,1][0,1], and ⟨r⟩P=∫012r(1+r)2 dr=2[ln⁡(1+r)+11+r]01=2ln⁡2−1.\langle r\rangle_{\mathrm P}=\int_0^{1}\frac{2r}{(1+r)^{2}}\,\dd r =2\Big[\ln(1+r)+\frac{1}{1+r}\Big]_0^{1}=2\ln2-1 . The same computation with the three-level GOE density in place of the exponentials gives 4−234-2\sqrt3 (Atas et al.). The check script confirms both, and confirms by simulation that the ratio of two independent exponentials has the density above.

Reading

A.10 Three refinements

Degenerate spectra. If HH has degenerate eigenvalues — because of a symmetry, say — the operators commuting with it no longer commute with each other, and one looks instead for a maximal commuting family among them. Any such family, simultaneously diagonalised, still consists of the linear combinations of DD projectors, and the objections of §A.2 return. Von Neumann showed that any commuting family of Hermitian matrices consists of functions of a single one of them (cited by Caux and Mossel) cited.

Which ensemble. The momentum blocks of §A.4 are complex Hermitian, which would suggest the s2s^{2} repulsion of the unitary ensemble. But reflection combined with complex conjugation maps each block to itself, and that antiunitary symmetry, squaring to +1+1, makes the real, orthogonal ensemble the right reference — which is what Figure A.2 shows. In general P(s)P(s) vanishes like ss, s2s^{2} or s4s^{4} — Dyson’s index 11, 22 or 44 — for the orthogonal (an antiunitary symmetry squaring to +1+1), unitary (none) and symplectic (one squaring to −1-1) ensembles. How close the large-matrix law is to the surmise: pooling 3⋅1043\cdot10^{4} bulk spacings of 100100 random 600×600600\times600 GOE matrices, the fraction below any ss differs from the surmise’s by 0.0070.007 (check-l13-algebra.py, which requires less than 0.0150.015).

Classes. Caux and Mossel propose a classification by how fast the number of nonzero coefficients of the charges grows with NN when they are expanded in a preferred tensor-product basis of operators, such as the Pauli strings (∑nSnz\sum_nS^{z}_n has NN of them, although as a matrix it has exponentially many nonzero entries): XXX is “linear”, Haldane–Shastry “quasi-polynomial”, and a generic chain’s conserved operators beyond 11, HH and its symmetries are expected to need exponentially many cited. It is a proposal; this course uses only its moral, which is Proposition 19.2’s.

Reading

A.11 Why Poisson, and why Wigner–Dyson

Berry and Tabor. For an integrable system with nn degrees of freedom semiclassical quantisation puts the levels at E=K(I)E=K(I) with the actions on a lattice, I=ℏ(m+α)I=\hbar(m+\alpha), m∈Znm\in\Z^{n} (Bohr–Sommerfeld with the Maslov shifts α\alpha of Lecture 10’s reading). The levels in a window of energy are the lattice points in a thin shell between two surfaces K=EK=E and K=E+δEK=E+\delta E; for n≥2n\ge2 and a curved, generic KK, successive lattice points met in energy order come from unrelated parts of the lattice, and Berry and Tabor (1977) argued that their spacings are then Poisson distributed cited. The argument fails where the lattice is seen coherently. For harmonic oscillators KK is linear in II: with one degree of freedom the levels are equally spaced (a “picket fence”); with commensurate frequencies they are highly degenerate; with incommensurate ones they are neither, and their spacing law depends on the arithmetic of the frequency ratio — but it is not Poisson either (Berry and Tabor treat both cases). The conjecture is for generic integrable systems.

Bohigas, Giannoni and Schmit. For a system whose classical limit is chaotic, the conjecture (1984) is that the spectral fluctuations are those of the random-matrix ensemble with the same antiunitary symmetry: orthogonal with a time reversal squaring to +1+1, unitary without one, symplectic with one squaring to −1-1 cited. Semiclassical arguments through periodic orbits support it; there is no proof.

Spin chains have no classical limit with NN fixed, so neither conjecture applies to them as stated; that they nevertheless follow the same pattern is an empirical fact, tested since the early 1990s and on every chain studied in this course, and it is why (P) is a criterion and not a theorem.

Reading

A.12 The tori globally: Hamiltonian monodromy

Theorem 5.7 describes one regular torus, and Lecture 6 extends its angle coordinates to a neighbourhood. Can the tori over all regular values be given coordinates at once? Not always. The obstruction is called Hamiltonian monodromy; it has nothing to do with the monodromy matrix of Definition 9.1, which shares only the name.

The spherical pendulum

A unit mass on a sphere of unit radius, in unit gravity, with polar angle θ\theta from the upward vertical, azimuth ϕ\phi, and z=cos⁡θz=\cos\theta its height: H=12pθ2+pϕ22sin⁡2θ+cos⁡θ,J=pϕ.H=\tfrac12p_\theta^{2}+\frac{p_\phi^{2}}{2\sin^{2}\theta}+\cos\theta, \qquad J=p_\phi . JJ, the angular momentum about the vertical, commutes with HH by rotational symmetry, and n=2n=2. The level sets are compact, since ∣p∣2≤2(H+1)\abs{p}^{2}\le2(H+1). At fixed J=jJ=j the height moves in the reduced potential Vj(z)=j2/2(1−z2)+zV_j(z)=j^{2}/2(1-z^{2})+z, whose minima are the circular conical motions: j2=−(1−z2)2/zj^{2}=-(1-z^{2})^{2}/z with energy E=(3z2−1)/2zE=(3z^{2}-1)/2z, for −1<z<0-1<z<0. These curves bound the image of the energy–momentum map (H,J)(H,J) (Figure A.6). Over each point of these curves the fibre is a single circle; over their common endpoint (−1,0)(-1,0), the stable equilibrium, it is a point.

The unstable equilibrium at the top, z=1z=1, p=0p=0, is the other critical point. There dH=dJ=0\dd H=\dd J=0, it has energy 11, and its image (1,0)(1,0) is an isolated critical value in the middle of the image. Every other interior point is a regular value with a compact connected fibre (Cushman–Bates, ch. IV, §3.4), a torus by Theorem 5.7. The fibre over (1,0)(1,0) contains the equilibrium and the trajectories that leave it and return to it; it is a torus with one cycle pinched to a point (Figure A.7). So the set of regular values is a region with a puncture, and a loop round the puncture cannot be shrunk.

Figure A.6. The image of the energy–momentum map of the spherical pendulum, drawn from the formulae in the text. The boundary is the curve of conical motions, over whose points the fibre is a circle; it meets the axis at the stable equilibrium (−1,0)(-1,0). The point (1,0)(1,0), the unstable equilibrium, is an isolated critical value: the regular values form a punctured region, and the loop Γ\Gamma cannot be contracted in it.
Figure A.7. The fibre over (1,0)(1,0): a pinched torus. The cycle δ\delta, drawn where the tube is still fat, shrinks to a point at the pinch, which is the unstable equilibrium. On nearby tori δ\delta is the orbit of the rotation generated by JJ, of period 2π2\pi. (Cushman–Bates, ch. IV, fig. 3.4.2.)

The period lattice, carried round the loop

Over each regular value there is a period lattice, and it varies continuously. Choose a basis at one point of the loop Γ\Gamma and carry it continuously round Γ\Gamma. It comes back as a basis of the same lattice, so the two differ by an integer matrix of determinant ±1\pm1. Take the basis [δ],[γ][\delta],[\gamma], with δ\delta the JJ-orbit and γ\gamma the cycle made by flowing along HH for the first-return time to the same JJ-orbit and then back along that JJ-orbit to the starting point. Then carried once round Γ\Gamma, positively oriented, the basis returns as ([δ][γ])  ⟼  (10−11)([δ][γ]), \begin{pmatrix}{[\delta]}\\{[\gamma]}\end{pmatrix} \;\longmapsto\; \begin{pmatrix}1&0\\-1&1\end{pmatrix} \begin{pmatrix}{[\delta]}\\{[\gamma]}\end{pmatrix}, (A.8) (cited: Duistermaat 1980; the matrix, basis and orientation from Cushman–Bates, ch. IV, §5.2). The JJ-cycle comes back to itself — it is defined everywhere by the symmetry — and the other cycle comes back with a copy of it subtracted (Figure A.8). Other sources print (1101)\begin{pmatrix}1&1\\0&1\end{pmatrix} for the same system: the entries depend on the basis and the orientation of the loop. The invariant content is that the matrix is a non-trivial shear, and it cannot be undone by any other choice of basis. One way to see it numerically: the rotation number, the advance of ϕ\phi in one period of zz divided by 2π2\pi, continued once round Γ\Gamma, comes back changed by exactly 11.1

Figure A.8. Hamiltonian monodromy. The period lattice returns to itself after one circuit of the puncture, but a basis carried continuously does not return to itself: δ\delta is fixed and γ\gamma becomes γ−δ\gamma-\delta, the matrix (A.8).

What it means, and why it does not contradict the theorem

The theorem is about one torus and, via Lecture 6, a neighbourhood of one torus, where the lattice basis can always be chosen continuously. Monodromy is about the whole family: if angle coordinates existed on all the tori over the punctured region at once, the basis they define would be carried round Γ\Gamma unchanged, and (A.8) says it is not. So the spherical pendulum has no global action–angle coordinates (Duistermaat 1980). The same happens round any focus–focus equilibrium: one at which the linearised pair (H,J)(H,J) is, in suitable canonical coordinates, the pair (xpx+ypy, xpy−ypx)(xp_x+yp_y,\ xp_y-yp_x) — a hyperbolic scaling and a rotation — provided its critical value is isolated and the nearby fibres, and the singular one, are compact and connected. The top of the sphere is such a point (cited: the geometric monodromy theorem, Cushman–Bates, ch. X, §2). Theorem 5.7 proves the single-torus statement and Lecture 6 the neighbourhood one; global triviality is false.

The quantum sequel

After quantisation HH and JJ still commute, and their joint eigenvalues (E,ℏm)(E,\hbar m) form a set of points in the plane. By the Einstein–Brillouin–Keller rule of Lecture 10’s reading, near any regular value the points are the image of the lattice ℏ(n+12,m)\hbar(n+\tfrac12,m) (a libration in the polar angle, a rotation in the azimuth) under the smooth map (I1,I2)↦(E,J)(I_1,I_2)\mapsto(E,J) inverse to the action map, asymptotically as ℏ→0\hbar\to0: locally a deformed square lattice. Carry a unit cell of it round the critical value (1,0)(1,0) and it comes back sheared: the quantum numbers label the actions, which pair with the cycles, so the cell’s edges transform contragrediently to (A.8) — in the conventions displayed there by its inverse transpose (1101)\big(\begin{smallmatrix}1&1\\0&1\end{smallmatrix}\big), again a non-trivial shear. The joint spectrum has a lattice defect at the puncture, and no choice of two global quantum numbers labels it smoothly (Cushman and Duistermaat 1988) cited. Classical Hamiltonian monodromy — the obstruction to global action–angle variables — is thus visible in a quantum spectrum.

Sources. R. H. Cushman and L. M. Bates, Global Aspects of Classical Integrable Systems, ch. IV (the spherical pendulum: §3.4 the fibres, §5 monodromy) and ch. X; J. J. Duistermaat, “On global action-angle coordinates”, Comm. Pure Appl. Math. 33 (1980); R. H. Cushman and J. J. Duistermaat, “The quantum mechanical spherical pendulum”, Bull. Amer. Math. Soc. 19 (1988).

Reading

A.13 Why study exceptional systems?

Integrable systems are exceptional (Lecture 7), so why study them? Because there are two roads from nature to a prediction, and each charges a toll (Figure A.9).

Figure A.9. Two roads from nature to a prediction. On the left the model is exact and the solution approximate; on the right the model is an idealisation and the solution exact. Neither road is free.

On the left, one writes down the model one believes and solves it approximately: perturbation theory about something simple, numerics, linearisation about a minimum. On the right, one replaces the model by an idealisation that can be solved exactly, and pays in the model instead. A truncation you can solve is worth as much as a truth you cannot, and it is worth more when it is the organising centre of the truth. The harmonic oscillator organises vibrational spectroscopy, and the hydrogen atom organises chemistry, in exactly this way: nobody believes a molecule is a set of oscillators, but every real spectrum is read as a perturbation of that one. Integrable models are the next such centres: exactly solvable, genuinely interacting, and the points from which nearby systems can be studied as perturbations. How far that works is a real question. Lecture 7 answers it classically (the KAM theorem, Theorem 7.8: most of the tori survive a small perturbation, under hypotheses stated there), and Lecture 20 says what is known for a nearly integrable quantum gas (Remark 20.2).

Lecture 7 also adds the caveat that keeps this honest. Integrability is a property of the whole system, not of an approximation to it: truncating the integrable Toda potential at cubic order gives Hénon–Heiles, which is not integrable (Figure 7.5). The right-hand road does not mean “simplify until solvable”; it means finding the exceptional systems exactly as they are, and treating the rest of the world as their perturbation. Nor are the exceptional systems common: in a one-parameter family of potentials that contains Hénon–Heiles, the integrable members are isolated values of the parameter, for conserved quantities of a precise kind (Lecture 7’s reading, which states exactly that much and no more).

Summary

  • Counting fails: on CD\C^{D}, a Hamiltonian with simple spectrum has DD linearly independent commuting conserved operators, all of them polynomials in HH, and no operator is algebraically independent (Proposition A.1). No reading of “independent” separates integrable from not; locality does (Proposition 19.2).
  • A local charge is fragile: XXX has Q3Q_3 (Theorem A.2); at N=8,9N=8,9 and the couplings tried, the J1J_1–J2J_2 chain has no range-33 charge beyond HH and the total spin.
  • Level statistics: Poisson e−se^{-s} against Wigner πs2e−πs2/4\frac{\pi s}{2} e^{-\pi s^{2}/4} (Proposition A.3), ⟨r⟩≈0.386\langle r\rangle\approx0.386 against 0.5310.531 — after every symmetry is resolved (Figure A.1).
  • Criteria, not a theorem: transfer-matrix charges, non-diffractive scattering, Poisson statistics, with no general theorem connecting them; there are charges without (P), and (P) without (T).

References

J.-S. Caux and J. Mossel, J. Stat. Mech. (2011) P02023; M. P. Grabowski and P. Mathieu, Mod. Phys. Lett. A 9 (1994) 2197 and J. Phys. A 28 (1995) 4777; V. Oganesyan and D. A. Huse, Phys. Rev. B 75 (2007) 155111 (the ratio); Y. Y. Atas, E. Bogomolny, O. Giraud and G. Roux, Phys. Rev. Lett. 110 (2013) 084101 (⟨r⟩\langle r\rangle); M. V. Berry and M. Tabor, Proc. R. Soc. Lond. A 356 (1977) 375; O. Bohigas, M.-J. Giannoni and C. Schmit, Phys. Rev. Lett. 52 (1984) 1; D. Poilblanc, T. Ziman, J. Bellissard, F. Mila and G. Montambaux, Europhys. Lett. 22 (1993) 537; F. Finkel and A. González-López, Phys. Rev. B 72 (2005) 174411; J. C. Talstra and F. D. M. Haldane, J. Phys. A 28 (1995) 2369; D. A. Abanin, E. Altman, I. Bloch and M. Serbyn, Rev. Mod. Phys. 91 (2019) 021001; J. Šuntajs, J. Bonča, T. Prosen and L. Vidmar, Phys. Rev. E 102 (2020) 062144; R. J. Baxter, Exactly Solved Models in Statistical Mechanics, §10.14 (the XYZ chain). The readings’ sources are named in them.

The whole bibliography, lecture by lecture →


  1. scripts/check-l4-algebra.py, check 9 — a numerical check, not a proof.↩︎