The whole book Contents and reading orders
- Part 0 Entrance — how to read this book
- 0-01 How to read this book
- 0-02 One picture
- 0-03 Reading the problem statement word by word
- 0-04 Four dimensions in mathematics and four dimensions in physics
- Part 1 Mathematical preparation
- 1-01 Vector spaces and linear maps
- 1-02 What a group is
- 1-03 Lie groups and Lie algebras
- 1-04 SU(2) and SU(3)
- 1-05 Manifolds and tangent spaces
- 1-06 Differential forms and the exterior derivative
- 1-07 Vector bundles and connections
- 1-08 Probability and measure
- 1-09 Probability in infinite dimensions
- 1-10 Hilbert spaces and self-adjoint operators
- 1-11 Fourier analysis and distributions
- 1-12 Detour: what happens only in four dimensions
- Part 2 Physical preparation
- 2-01 Lagrangians and the action
- 2-02 The idea of a field
- 2-03 Electromagnetism is a gauge theory
- 2-04 Special relativity and spacetime
- 2-05 The bones of quantum mechanics
- 2-06 The harmonic oscillator and creation and annihilation
- 2-07 The idea of the path integral
- 2-08 Statistical mechanics and phase transitions
- 2-09 Detour: the gap and the correlation length in the Ising model
- 2-10 The relaxation time and the dynamical exponent z
- Part 3 Yang–Mills theory (classical)
- 3-01 The gauge principle
- 3-02 Non-abelian gauge fields
- 3-03 The action and the equations
- 3-04 Gauge theory as geometry
- 3-05 Instantons and topology
- 3-06 Detour: Donaldson and exotic R⁴
- 3-07 Yang–Mills inside the Standard Model
- Part 4 Quantisation
- 4-01 Canonical quantisation and the Hamiltonian
- 4-02 The path integral and Euclideanisation
- 4-03 Perturbation theory and Feynman diagrams
- 4-04 Divergences and renormalisation
- 4-05 The algebra of divergences
- 4-06 Asymptotic freedom
- 4-07 Dimensional transmutation and Λ
- 4-08 Gauge fixing and Faddeev–Popov
- 4-09 The axioms of quantum field theory
- 4-10 The Osterwalder–Schrader axioms and reconstruction
- 4-11 The definition of the mass gap
- 4-12 Detour: the perturbation series diverges
- Part 5 Lattice gauge theory
- 5-01 Wilson's lattice
- 5-02 The strong-coupling expansion
- 5-03 Reflection positivity and the transfer matrix
- 5-04 The infinite-volume limit and the cluster expansion
- 5-05 Weak coupling and the continuum limit
- 5-06 How U(1) differs from the non-abelian case
- 5-07 The Monte Carlo method
- 5-08 Measuring glueballs and the string tension
- 5-09 What to hold fixed when taking the limit
- 5-10 Lattice gauge theory with finite groups
- 5-11 Detour: Bakry–Émery and one-link integration
- Part 6 Constructive field theory
- 6-01 What constructive field theory is
- 6-02 Solvability in two dimensions and the Yang–Mills measure
- 6-03 Constructing scalar fields
- 6-04 The cluster expansion
- 6-05 The sequence of renormalisation group steps
- 6-06 Ultraviolet stability of three-dimensional Yang–Mills
- 6-07 Four dimensions
- 6-08 Triviality of φ⁴ in four dimensions
- 6-09 Stochastic quantisation and regularity structures
- 6-10 Where four dimensions stops
- 6-11 Obstacles other than divergence
- 6-12 Detour: "if 1/0 is given a symbol"
- Part 7 From the side of physics
- 7-01 How physics sees it
- 7-02 Mechanisms of confinement
- 7-03 The string picture
- 7-04 Large N
- 7-05 String theory and extra dimensions
- 7-06 How extra dimensions become invisible
- 7-07 Where gauge fields come from
- 7-08 Holography
- 7-09 The mass gap becomes geometry
- 7-10 Back to four dimensions
- 7-11 Supersymmetry and Seiberg–Witten
- 7-12 The sentence that plays the role of an equivalence principle
- 7-13 Where the way physics digs parts from mathematics
- Part 8 A dictionary of two languages — the physical and the mathematical view
- 8-01 How to read the dictionary
- 8-02 Dictionary A
- 8-03 Dictionary B
- 8-04 Dictionary C
- 8-05 The physical counterparts of our assumptions
- Part 9 Where things stand, and open tasks
- 9-01 How far the world has come
- 9-02 Where the two ways of digging part
- 9-03 Candidates for new concepts
- 9-04 The list of open tasks
- 9-05 Common misconceptions
- Part 10 Towards a proof of the mass gap — building the first step of the staircase
- 10-00 Entrance — the staircase, and the random walk, the ruler and the clock
- 10-01 The line of construction and Assumption H
- 10-02 Roads tried on the four-dimensional lattice, and walls
- 10-03 The four steps of the staircase — why we start from 0+1 dimensions
- 10-04 The path measure of the double well, and kinks
- 10-05 The statement of the first step — four conditions and Proposition 4.5
- 10-06 (H1) Local Poincaré within a phase
- 10-07 The map of (H2) — seven routes and the seam of the ring
- 10-08 What computer-assisted means — the conditions on the chain inside the window
- 10-09 The sector framework and the three strands of route 5
- 10-10 The list of detour plans — types of breakage
- 10-11 (H3)(H4) and the constant of the core
- 10-12 The integrated table and the dependency graph
- 10-13 Lean statements and the limits of machine checking
- 10-14 Reconciliation — the numbers of the record and the known numbers
- 10-15 What remains and its cost — the distance to a theorem
- 10-16 What is not claimed
- 10-17 Insights and small questions
- Part 11 Further considerations — beyond Assumption H, and other views
- 11-00 Further considerations — entrance
- 11-01 One form that obstructs H — a nearly conserved global quantity
- 11-02 Choosing the ruler and the coordinates again — the length at which conservation breaks
- 11-03 Two ways to repair H — the sector H and the local H
- 11-04 Which H the one-sided bridge needs
- 11-05 Making time continuous — the Hamiltonian lattice and the vacuum measure
- 11-06 Paying with rarity instead of convexity — renormalisation on groups and log-Sobolev
- 11-07 Because it is four dimensions — the dimensionless coupling and topology
- 11-08 Questions, and what is not claimed
- 11-A1 Table of notation for Part 11
- Appendices
- A-01 Table of notation
- A-02 Glossary
- A-03 Guide to the literature
- A-04 Lean and machine checking
- A-05 How this book was made
- A-06 Index of assumptions
Probability and measure — the mean settles down, and the fluctuations become Gaussian
What this chapter shows — The language that writes probability as "a rule that distributes weight over sets (a measure)". That the Gaussian distribution is fixed by its covariance alone, and higher moments are a count of pairings. That the law of large numbers and the central limit theorem say "the mean settles down, and the fluctuations become Gaussian", and that the rate is .
Prerequisite chapters — None (the example of §03 is easier to read with 1-02).
Said first — We do not prove measure theory. Probability in infinite dimensions is the subject of 1-09. Constructing four-dimensional Yang–Mills theory as a probability measure is unsolved, and this site does not show it either.
- Why probability
- Probability spaces
- Random variables and distributions — the uniform distribution on a group and the semicircle (Figure 1)
- Expectation, variance, characteristic function
- Independence
- The Gaussian distribution — covariance and counting pairings (Figure 2, Detour: counting the Catalan numbers in two ways)
- Gaussian fields on a lattice — correlation length and mass (Figure 3)
- The law of large numbers — the mean settles down (Figure 4)
- The central limit theorem — the fluctuations become Gaussian (Figure 4)
- Detour: what does not become Gaussian
Why probability — field theory is written with probability measures
Moving quantum field theory to imaginary time (Euclideanisation, 4-02) attaches a weight ( is the action) to each configuration of the field, and after normalisation it can be read as a probability. The problem statement too lists 'non-Gaussian, Euclidean-invariant measures' among the by-products of constructing field theories Known. In lattice Yang–Mills a group element sits on each edge (5-01), and the probability has the following form.
is the uniform weight on the group (§03), and the constant that makes the total 1 (2-08). Example: if there is one edge, the group is the circle and ( is the inverse of the lattice coupling; the same letter as the inverse temperature of statistical mechanics), then (1) has density , and the larger is, the more it gathers near . This chapter assembles the language for this.
Probability spaces — distributing weight over sets
A probability is a rule that distributes weights from 0 to 1 over subsets (events) of the whole of what can happen. The family of events that receive weights is assumed to contain and to be closed under complements and countable unions (a σ-algebra). The triple is a probability space, and on we impose the following Known.
A non-negative set function with satisfying the second half of (2) (countable additivity) is a measure, and a measure with total 1 is a probability (Durrett §1.1; the axiomatisation is said to begin with Kolmogorov's book of 1933). is not taken to be all subsets because a construction using the axiom of choice produces subsets to which no length invariant under rotation and satisfying (2) can be assigned (Vitali 1905) Known. Example: a die is . The uniform distribution on is , that is, length (Lebesgue measure). The probability of each point is 0, yet some point always comes out; but (2) cannot be used for uncountable unions, so there is no contradiction. Something that holds with probability 1 is said to hold "almost surely".
Random variables and distributions — the uniform distribution on a group and the semicircle
A random variable is a real-valued function on such that every is an event (measurable). Its distribution is the measure obtained by pushing the weight of onto the number line by .
is the distribution function, and the density. Example: the number of heads in tosses of a coin with probability of heads follows the binomial distribution , and keeping while gives the Poisson distribution .
A group of matrices that is closed and bounded, such as , is called a compact group. A compact group has exactly one probability measure unchanged by multiplication from either left or right, that is, satisfying () for every and subset ; it is called the Haar measure (for the circle, ) Known. The of (1) is this. Example: elements of are ( are the Pauli matrices, ), and is the sphere (1-02). The Haar measure is the uniform distribution on , and . The cross-section at height is a sphere of radius (area ), and the width of the band is , so the density of is proportional to , and has the semicircle density Known.
Making a histogram (20 bins) of from uniform points on , the difference between the fraction falling in each bin and the probability of each bin given by (4) (0.019–0.064) was within Computed. Figure 1 shows how it goes as the points increase. The same semicircle also appears as the distribution of eigenvalues of a large symmetric matrix with independent Gaussian entries, in the limit where it is suitably normalised and the size of the matrix goes to infinity (7-04).
ComputedThe histogram of Figure 1 embeds the counts per bin of the first points of a sample made on this machine (the same points as in the text above). The curve and the bin probabilities are computed from formula (4). If JavaScript is disabled, it can be read from the numbers in the text above.
Expectation, variance, characteristic function — writing the mean as an integral
The expectation is the total of "value × weight", and for continuous cases an integral. The Lebesgue integral slices the values instead, and adds up times "the weight of the set where the value is near ". As a metaphor, it is counting a pile of coins by denomination; to be exact, it is the limit of the sums for functions taking only finitely many values.
Taking the expectation of ( is 1 on and 0 outside) as gives Chebyshev's inequality Known.
The characteristic function determines the distribution uniquely (Durrett §3.3). Example: for a die, , . The of the Poisson distribution is used in the counting of centre vortices (7-02). For (4), , .
Independence — how it differs from being uncorrelated
and being independent means that the joint probability splits into a product.
Then the distribution of is the measure that gives the weight to the rectangle in the plane (the product measure), and , , Known. If the covariance is 0 they are uncorrelated; independent implies uncorrelated, but the converse is false. Example: if takes with equal probability and , the covariance is 0 but .
In field theory we would like the fields at two distant points to be "almost independent". The problem statement gives clustering as a consequence of the mass gap (4-11) Known. It is the property that the size of the correlation of local quantities , with expectation 0 placed at points of space (since the expectations are 0, the covariance above is just the expectation of the product) is, if , at most where is large enough. To be exact, are operators of quantum theory, and the correlation is the expectation in the ground state (the vacuum) (an example is in §07).
The Gaussian distribution — covariance and counting pairings
A Gaussian distribution with mean 0 in dimensions is fixed by the covariance matrix alone (a positive definite symmetric matrix, 1-01).
There are three properties Known. (i) The image under a linear map is also Gaussian, with covariance . (ii) If jointly Gaussian, uncorrelated implies independent (if is diagonal the density splits into a product). (iii) Higher moments are the sum over all ways of pairing up the variables of products of (Isserlis 1918; in physics a formula of the same form is used as Wick's theorem (1950)).
For random of , against the right-hand side of (9), samples gave Computed. In one variable it is . (the double factorial, multiplying only the odd numbers) is the number of ways of pairing up points (the partner of point 1 can be chosen in ways, and the same is repeated for the rest). On the other hand, the moments of the semicircle (4) are the number of ways of joining points on a circle by chords that do not cross, the Catalan numbers Paper (the detour computes both). Counting the non-crossing pairings and numerically integrating (4) both agreed with for (the integral to 6 digits) Computed. Choosing a row of Table 1 lines up those ways of pairing for in Figure 2.
| (sample ) | |||
|---|---|---|---|
| 1 | 1 | 1 | 1.001 |
| 2 | 3 | 2 | 2.001 |
| 3 | 15 | 5 | 5.001 |
| 4 | 105 | 14 | 14.00 |
| 5 | 945 | 42 | 42.01 |
| 6 | 10395 | 132 | 132.05 |
ComputedThe pairings of Figure 2 are listed in the browser, and their numbers have been checked to agree with the counts of Table 1 (computed on this machine). If JavaScript is disabled, they can be read from Table 1.
(9) is the prototype of Feynman diagrams (4-03), and non-crossing pairings lead to the planar diagrams of large (7-04).
Detour: counting the Catalan numbers in two ways
A subsection you may skip.
The number of non-crossing pairings. Number the points on the circle 1 to clockwise, and let () be the number of non-crossing pairings. If the partner of point 1 is point , the points between 1 and cannot cross the chord , so they can only pair among themselves. There is an even number of points between, so , and the pairings inside and the pairings outside can be chosen separately. Written with the coefficients lined up in one power series (the generating function) ,
Solving the quadratic equation, taking the root that is finite at , and expanding by the binomial series gives the coefficients.
The moments of the semicircle. Putting in (4) gives , . By integration by parts satisfies , , so (). Using ,
The last equality follows from . The two computations arrived separately at the same Paper. Why the semicircle counts non-crossing pairings becomes visible in the counting of planar diagrams of large (7-04).
Gaussian fields on a lattice — correlation length and mass
To variables () arranged on a ring, attach a weight under which neighbours prefer close values and the whole is pulled back towards 0.
is the lattice Laplacian. It is different from the mass gap of §05, so we distinguish it with the subscript lat. Comparing with (8), (10) is the Gaussian distribution with covariance . The problem statement calls the Gaussian measure on the continuum with a covariance of the same form (with the lattice Laplacian replaced by the continuum one) 'the free, mass-m0 field'. (10) is its analogue on a one-dimensional lattice (a ring), and on a -dimensional lattice too the covariance has the same form Known. If the ring is infinitely long, exactly Known.
is the correlation length, and the mass is roughly its inverse (both measured in units of the lattice spacing). This rate of decrease corresponds to the "gap" of quantum theory (2-06). (10) is the discretised imaginary-time path integral of an oscillator, and corresponds to the of 2-07 (there , so it is the step itself). The general theory of correlation length is in 2-08.
| ((11)) | read from the slope | ||
|---|---|---|---|
| 0.05 | 20.00 | 0.703 | 24.1 |
| 0.1 | 10.00 | 0.452 | 10.2 |
| 0.3 | 3.35 | 0.0915 | 3.35 |
| 1 | 1.04 | 1.04 | |
| 2 | 0.57 | 0.57 |
ComputedThe numbers of Figure 3 and Table 2 were computed on this machine (the figure is drawn from the exact correlations and fixed random numbers; the slope from –12). If JavaScript is disabled, they can be read from Table 2.
For the read from the slope is larger than 20 because the ring is only about 3 times the correlation length, and the contribution from going the other way round matters (a finite-box effect, 5-09). (10) is Gaussian, so by (9) all correlations are fixed by , and there is no interaction (a free field).
The law of large numbers — the mean settles down
Let be the sum of independent following the same distribution (mean , variance ). From §05, , and putting this into (6) gives the weak law of large numbers Known.
Moreover, with alone, holds almost surely (the strong law, Durrett Theorem 2.4.1) Known. In "As is" in Figure 4, you can see the distribution of shrinking to and the left-hand side of (12) ().
ComputedThe numbers of Figure 4 and Table 3 were computed on this machine (the figure computes on the spot from the binomial distribution and an approximation formula for , agreeing with the Python values to 4 digits). If JavaScript is disabled, they can be read from the next paragraph and Table 3.
For , , the left-hand side of (12) is 0.754, 0.0569, at , and the right-hand side is 2.5, 0.25, 0.025 Computed. The right-hand side is a crude upper bound, but enough for the limit. The practical reading is that the error of a sample mean is about , so ten times the precision needs a hundred times the samples. Estimating by sample means gave for and for (a different sample from Table 1; the error bar is the sample standard deviation ) Computed. In lattice Monte Carlo, successively generated configurations are not independent, so the effective decreases (5-07).
The central limit theorem — the fluctuations become Gaussian
The deviation is of size . Magnifying it by makes the Gaussian distribution appear, whatever the original distribution (the central limit theorem, Durrett Theorem 3.4.1) Known.
The reason is visible through characteristic functions. If , then , and by independence , which is the characteristic function of the one-dimensional standard Gaussian of (8). The continuity theorem, which derives convergence of distributions from convergence of characteristic functions (Durrett Theorem 3.3.17), gives (13) (the classical proof under general conditions is Lindeberg 1922). The rate of approach is given by the Berry–Esseen inequality ().
Durrett proves it with , and Shevtsova (2011) has shown Known. Both sides can be compared in the magnified view of Figure 4 and in Table 3.
| Right-hand side | ||||
|---|---|---|---|---|
| 0.5 | 10 | 0.1230 | 0.1501 | 0.389 |
| 0.5 | 1000 | 0.0126 | 0.0150 | 0.399 |
| 0.1 | 100 | 0.0832 | 0.1298 | 0.832 |
| 0.02 | 100 | 0.1767 | 0.3258 | 1.767 |
For , settles at . If is even, the distribution function has a step of height about at , and the smooth passes through its middle, so half the step always remains (Durrett §3.4.4). If is odd there is no step in the centre, and between the two central steps () the distribution function stays flat at , leaving a deviation of the same size at its ends ( at , 0.399 at ) Computed. Either way it is not faster than . For , we have : the distribution is close to an asymmetric Poisson distribution, and still far from Gaussian. Limit theorems do not say "when it is close", so an estimate of the rate is needed.
Detour: what does not become Gaussian — heavy tails, triviality
A section you may skip.
(13) assumes that the variance is finite. The Cauchy distribution (density , characteristic function ) has , and the mean of of them follows the same distribution as the original (Durrett Exercise 3.3.6) Known.
In field theory, conversely, "collapsing to a Gaussian" becomes the problem. For the model on a four-dimensional lattice, it has been shown that the limit of refining the lattice near the critical point is Gaussian and the interaction vanishes (triviality) (Aizenman–Duminil-Copin 2021, 6-08) Known. As a metaphor it is the central limit theorem's way of collapsing; to be exact, it is a theorem about strongly correlated fields, and the tools of proof are different.
The "non-trivial" Yang–Mills theory of the problem statement is, roughly, a theory that is not Gaussian in the limit. As the problem statement (§6.2) says of scalar fields, the free field is obtained from a Gaussian measure, and 'one requires non-Gaussian dµ to obtain nonlinear fields'. The lattice (1) is not Gaussian to begin with, but there is no result showing that it survives in the limit as a non-Gaussian measure with clustering, and the problem statement itself writes that at present not a single non-trivial relativistic field theory satisfying the axioms in four dimensions is known Known. This site does not show it either (0-03, 6-10).
What this chapter can say
| Said | Not said |
|---|---|
| KnownThe definitions, (6), the proof of (12), the derivation of (4). The other theorems are cited from the literature. | Proofs of measure theory (the extension theorem, the convergence theorems, the continuity theorem). |
| PaperThat the moments of the semicircle and the number of ways of joining points on a circle by non-crossing chords are both (the two computations of the detour of §06). For also checked by counting and by numerical integration Computed. | Why the two agree (the planar diagrams of large , treated in 7-04). |
| ComputedTables 1–3, Figures 1–4, the numbers of §03, §06, §08, §09. | The numbers are checks with finite , and samples, and are not a substitute for proofs of the limits. |
| KnownFrom the problem statement: that the free field is a Gaussian measure, clustering, that a non-trivial theory needs a non-Gaussian measure. The triviality of four-dimensional . | Measures in infinite dimensions (1-09). The existence, non-triviality and clustering of the measure of four-dimensional Yang–Mills (unsolved; this site does not show them either). |
Sources and reproduction
| Item | Kind | Source / tools |
|---|---|---|
| The theorems and remarks of §02, §04, §08–§10 | Known | R. Durrett, Probability: Theory and Examples, 5th ed., Cambridge Univ. Press (2019) (Theorems 2.4.1, 3.4.1, 3.3.17, 3.4.17, the remark of §3.4.4, Exercise 3.3.6). Text checked in the author's public version. |
| Original papers (axiomatisation, Vitali, Haar, (9), (13), (14)) | Known | A. Kolmogoroff, Grundbegriffe der Wahrscheinlichkeitsrechnung, Springer (1933). G. Vitali, Bologna (1905). A. Haar, Ann. of Math. 34 (1933) 147. L. Isserlis, Biometrika 12 (1918) 134–139. G. C. Wick, Phys. Rev. 80 (1950) 268–272. J. W. Lindeberg, Math. Z. 15 (1922) 211–225. A. C. Berry, Trans. AMS 49 (1941) 122–136. C.-G. Esseen, "On the Liapounoff limit of error in the theory of probability", Ark. Mat. Astron. Fys. A 28, No. 9 (1942) 1–19. All bibliographic data only. |
| , the triviality of §10 | Known | I. Shevtsova, arXiv:1111.6554 (2011). M. Aizenman, H. Duminil-Copin, Ann. of Math. 194 (2021) 163–235, arXiv:1912.07973 (abstract checked). Same authors, Corrigendum, Ann. of Math. 199 (2024) 479 (bibliographic data only). |
| Quotations from the problem statement (§01, §05, §07, §10) | Known | A. Jaffe, E. Witten, "Quantum Yang–Mills Theory" (the problem description of the Clay Mathematics Institute). Included in J. Carlson et al. (eds.), The Millennium Prize Problems, Clay Math. Inst. / AMS (2006) 129–152. Text checked in Clay's public version (formula (2) of §5, §6.2). |
| The Catalan numbers of §06 (detour) | Paper | Computations within this chapter (the recursion by integration by parts and the binomial series). The semicircle of Gaussian matrices is in 7-04 and its table of sources. |
| Tables, figures, numbers | Computed | Python 3.12 on this machine (NumPy, SciPy): moments.py (Table 1, §03, §08; the numerical integration of the semicircle is ), pairings.py (counting for , (9)), fig_semicircle.py (the counts per bin for Figure 1), lattice_gauss.py (Table 2, Figure 3), clt.py (Table 3, Figure 4), clt_odd.py (odd in §09). The functions of the figures were checked against the tables with fig_check.js and fig_check2.js (node). |
Next chapter: 1-09 Probability in infinite dimensions — probability on fields themselves, and the Gaussian measure as the starting point.
← 1-07 Vector bundles and connectionsContents1-09 Probability in infinite dimensions →