Contents / Real Analysis / Advanced Topics
Chapter 8
Advanced Topics
Functions of bounded variation and the Jordan decomposition; absolute continuity, the Cantor function, and the link to the integral; the Lebesgue differentiation theorem via the Hardy-Littlewood maximal function; L^p spaces with Young, Holder, Minkowski and Riesz-Fischer completeness; Fourier series with orthogonality, Bessel, Parseval, Fejer and the Gibbs phenomenon; and rigorous multivariable calculus through Fubini-Tonelli, change of variables and Stokes.
Introduction
This chapter collects the four subjects that a first course in analysis reaches only at its end, and it is long because they are genuinely four subjects. What ties them together is a single question left open by the earlier chapters: which functions does calculus actually work for?
The Riemann theory answered "continuous ones, more or less", and Riemann Integration sharpened that to Lebesgue's criterion — integrability is continuity almost everywhere. The Lebesgue theory answered "measurable ones", and the convergence theorems of Lebesgue Integration made limits and integrals commute under hypotheses that are easy to check. Neither theory says anything about differentiation. The fundamental theorem of calculus, in the form proved in Riemann Integration, assumes at the outset that exists and is integrable, which quietly rules out every interesting example.
The first two parts of this chapter repair that. Bounded variation is the condition that makes a function differentiable almost everywhere — a weak conclusion, but true for a huge class, monotone functions included. Absolute continuity is the strictly stronger condition that makes the fundamental theorem true in both directions: is an indefinite Lebesgue integral of its own derivative exactly when it is absolutely continuous. Between the two classes sits the Cantor function, continuous, of bounded variation, with derivative zero almost everywhere and yet climbing from to ; it is the counterexample that makes the distinction necessary rather than pedantic. The third part, on differentiation theory, proves that the repair is not an accident: the Lebesgue differentiation theorem says averages of any locally integrable function converge back to the function at almost every point, and the engine that drives it — the Hardy–Littlewood maximal function — is the first genuinely modern tool in the book.
The fourth and fifth parts change register. spaces are the setting in which the convergence theorems become geometry: a set of functions with a norm, complete, and for carrying an inner product. Hölder's and Minkowski's inequalities are what make the norm a norm, and the Riesz–Fischer theorem — completeness — is the single result that makes Lebesgue's integral worth its cost, since the same construction over the Riemann integral produces an incomplete space. Fourier series are then the theory made concrete, and the place where the difference between pointwise, uniform and mean-square convergence stops being a technicality: the same series can converge in , fail to converge at a point, and overshoot a jump by a fixed no matter how many terms are taken.
The last part, rigorous multivariable calculus, is independent of the rest and could be read first. Its content is that the derivative in several variables is a linear map, not a list of partials, and that every major theorem — chain rule, inverse function theorem, change of variables, Stokes — is a statement about that linear map.
Throughout, denotes Lebesgue measure, the measure of a set , "a.e." means outside a set of measure zero, and is the indicator function of . Measurability, the integral, and the convergence theorems are taken from Lebesgue Integration without reproof.
8.1Definition via Total Variation
Monotone functions are easy to handle: they have one-sided limits everywhere, countably many discontinuities, and — as we will prove — a derivative almost everywhere. Most functions of interest are not monotone, but many are built out of monotone pieces, and the right way to say "built out of monotone pieces" is to measure how much total up-and-down motion a function performs.
Definition 8.1 (Variation over a partition and total variation). Let and let be a partition. The variation of over is
The total variation of on is
the supremum taken over all partitions of . If we say is of bounded variation on and write .
The supremum is the right operation because refining a partition can only increase the sum: this is the first thing to prove, and everything else rests on it.
Lemma 8.2 (Refinement increases variation). If are partitions of , then . Consequently the partition sums increase along any refining sequence, and is their limit whenever the refinements exhaust a set of points dense in .
Proof. It suffices to treat with , since a general refinement is obtained by adding one point at a time. The two sums differ only in the -th block, and there
by the triangle inequality proved in The Real Number System. So the refined sum is at least as large, and induction on the number of added points finishes the argument.∎
Example 8.3 (Variation of a monotone function and of a sawtooth). Compute for (a) , and (b) the function on that is linear on each of with , , , .
Solution.
- (a) is increasing, so every term and the sum telescopes to for every partition. The supremum of a constant family is that constant: .
- This is general: for increasing , , and for decreasing it is .
- (b) On each monotone piece the variation is the size of the jump in value, and the partition already separates the pieces. Adding points inside a linear piece changes nothing, by the same telescoping.
- Hence .
- Sanity check: , and as it must be — the net change is never more than the total motion.
Two facts about deserve to be recorded immediately, because they are used constantly and both follow from the definition in a line.
Proposition 8.4 (Boundedness and additivity). If then is bounded, with for all . Moreover, for any ,
Proof. For the bound, the two-point partition gives , hence .
For additivity, take partitions of and of ; their union is a partition of with . Taking suprema separately gives . Conversely, given a partition of , the refinement splits into partitions of the two halves, so by Lemma Refinement increases variation, ; take the supremum over .∎
Pitfall. Continuity does not imply bounded variation. The function for , , is continuous on yet has infinite total variation, because the peaks at have heights and diverges. Raising the damping to makes the heights summable and restores bounded variation. Continuity controls local oscillation; bounded variation controls its total.
8.2Jordan Decomposition: Bounded Variation as a Difference of Increasing Functions
The pitfall above shows that bounded variation is not a smoothness condition. What is it, then? Jordan's theorem answers exactly: it is the condition of being a difference of two increasing functions, and nothing more. Everything true of functions is therefore a consequence of something true of monotone functions.
The key object is the variation accumulated so far.
Definition 8.5 (The variation function). For define by , with . Call the variation function of .
Theorem 8.6 (Jordan decomposition). A function is of bounded variation if and only if with increasing on . One such decomposition is
where is the variation function; in it, and may be taken with , .
Proof. () Suppose with both increasing. For any partition,
using that each increment of an increasing function is non-negative so the sums telescope. The right-hand side does not depend on the partition, so .
() Suppose . First, is increasing: for , additivity (Proposition Boundedness and additivity) gives . Second, is increasing: for , the two-point partition of shows
so . Third, is increasing by the same computation applied to , since and hence .
Now set and . Both are increasing by the previous paragraph, and identically.∎
The decomposition is not unique — adding the same increasing function to and to changes neither difference — but the one built from is minimal in a precise sense, and this is worth stating because it identifies the variation function as canonical.
Proposition 8.7 (Minimality of the Jordan decomposition). If with increasing, then for every
So no decomposition accumulates less total increase than the one built from the variation function, and equality for all forces and to be the same constant.
Proof. The inequality is the computation in the () half of Theorem Jordan decomposition, applied on rather than on . Suppose equality holds for all . Since , the function is well defined, and the equality reads , i.e. . So is constant.∎
Intuition. Think of as the position of a walker on a line. The variation function is the odometer: total distance walked, which only ever goes up. Position is , where is the total distance walked forwards and the total distance walked backwards, and both of those are odometers too. "Bounded variation" just says the odometer does not run away to infinity in finite time. That is why the class is closed under so much: any statement about odometers transfers.
Example 8.8 (Jordan decomposition of an explicit function). Let on . Compute and exhibit the Jordan decomposition.
Solution.
- , so decreases on and increases on , with , , .
- Variation is additive over the monotone pieces, and on each piece it is the net change in absolute value: .
- The variation function accumulates the motion: for the function is decreasing, so ; for we add the rise since , giving .
- Then and . On : and . On : and .
- Check: is constant then increasing, increasing then constant, and equals on the left piece and on the right. Both give . And matches step 2.
Corollary 8.9 (The vector space ). is a vector space, and it is closed under products: if then . If in addition then .
Proof. For sums, term by term from the triangle inequality inside each partition sum, and is immediate. For products, each is bounded by Proposition Boundedness and additivity, say by , and
so summing gives . For the reciprocal, , so .∎
8.3Differentiability and Discontinuities of BV Functions
Jordan's theorem converts every question about functions into a question about monotone functions. Two such questions have classical answers, and together they say that a function is well behaved in exactly the two ways one could hope for: its discontinuities are few, and it has a derivative nearly everywhere.
Theorem 8.10 (Discontinuities of a monotone function). Let be increasing. Then and exist at every interior , every discontinuity is a jump, and the set of discontinuities is at most countable.
Proof. Fix . The set is bounded above by , so it has a supremum by the completeness axiom of The Real Number System; a routine -argument shows this supremum is , and symmetrically . Monotonicity gives , so the only possible failure of continuity is : a jump.
To count them, let be the jump at a discontinuity . For distinct discontinuities in , the intervals are pairwise disjoint subintervals of , so . Hence for each , the set has at most elements, and the discontinuity set is a countable union of finite sets.∎
Corollary 8.11 (Discontinuities of a BV function). A function of bounded variation has one-sided limits at every point and at most countably many discontinuities, all of them jumps. In particular a function has no oscillatory discontinuity.
Proof. Write by Theorem Jordan decomposition. One-sided limits of exist because they exist for and by Theorem Discontinuities of a monotone function, and limits subtract. is continuous wherever both and are, so its discontinuity set is contained in the union of two countable sets. Since both exist, no discontinuity can be of oscillatory type in the classification of Limits & Continuity.∎
The differentiability statement is deeper, and its proof is postponed to the section on Vitali covering arguments where the right tool is built. We state it now because the rest of the part uses it.
Theorem 8.12 (Lebesgue's differentiation theorem for monotone functions). An increasing function is differentiable at almost every point of , is measurable and non-negative a.e., and
The inequality can be strict.
Proof. Sketch, with the covering lemma assumed. The almost-everywhere differentiability is proved in the section Proof Ideas (Vitali Covering or Rising Sun in 1D) below; granting it, the integral inequality is a short application of Fatou's lemma from Lebesgue Integration. Extend by for and set
Then a.e., and each is measurable as a difference of monotone functions. Fatou gives
The first term equals exactly, by the extension; the second is at least since there. Hence .∎
Corollary 8.13 (BV implies differentiable a.e.). If then exists and is finite for almost every , and with .
Proof. Write with increasing (Theorem Jordan decomposition). Each is differentiable a.e. by Theorem Lebesgue's differentiation theorem for monotone functions, and the union of two null sets is null, so exists a.e. For the integral bound, a.e., so for the minimal decomposition.∎
Example 8.14 (Where strictness comes from). Let be the jump function on . Compute , a.e., and compare with .
Solution.
- is increasing with a single jump of size , so .
- is locally constant off the single point , so for every — that is, almost everywhere.
- Therefore , while . The inequality in Theorem Lebesgue's differentiation theorem for monotone functions is strict, by exactly the size of the jump.
- The moral: the derivative cannot see a jump, because a jump lives on a null set. Any theorem recovering from must therefore exclude jumps — and in fact must exclude more, as the Cantor function will show.
8.4Absolute Continuity: a Preview of the Stronger Condition
Example Where strictness comes from shows that is too weak for the fundamental theorem: a jump destroys it. One might guess that continuity plus bounded variation is enough. It is not, and the counterexample is important enough to construct carefully.
Definition 8.15 (The Cantor function). Let be the middle-thirds Cantor set. The Cantor function (or devil's staircase) is defined by writing in base as with : if some , truncate at the first such ; then
equivalently, is constant on each interval removed at stage of the construction, taking there the dyadic value .
Theorem 8.16 (Properties of the Cantor function). is continuous and increasing on with , ; it is of bounded variation with ; and for almost every , so that
Proof. Monotone and surjective. By construction maps the closed intervals surviving at stage onto the dyadic intervals in order, so is increasing and its range contains all dyadic rationals in .
Continuous. An increasing function fails continuity only by a jump (Theorem Discontinuities of a monotone function), and a jump would leave an interval of values unattained. But the range contains a dense set, and the range of an increasing function omitting an interval cannot be dense there. So has no jump and is continuous.
Bounded variation. is increasing, so by Example Variation of a monotone function and of a sawtooth.
Derivative zero a.e. The complement is a countable union of open intervals on each of which is constant, so there. The total length removed is , so and the set where is contained in a null set.∎
So a continuous, increasing, bounded-variation function can rise by while its derivative integrates to . The whole increase happens on the null set . The condition that forbids this is a uniform strengthening of continuity — instead of controlling for one short interval, it controls the sum over finitely many disjoint short intervals.
Definition 8.17 (Absolute continuity, first statement). is absolutely continuous if for every there is such that for every finite collection of pairwise disjoint intervals in ,
Proposition 8.18 (The Cantor function is not absolutely continuous). fails the condition of Definition Absolute continuity, first statement.
Proof. Take and let be arbitrary. At stage of the Cantor construction the surviving set is a union of closed intervals of total length , and increases by exactly across each, hence by in total across them. Choose with . These disjoint intervals have total length below yet total increment .∎
Intuition. Ordinary continuity says: a small interval maps to a small set of values. Absolute continuity says: a small total length, however it is scattered, maps to a small total change. The Cantor function passes the first test and fails the second, because it does all its climbing on a set of length zero that can be covered by many tiny intervals at once. Absolute continuity is precisely the ban on doing work on a null set.
8.5Riemann–Stieltjes Integration against BV Integrators
Bounded variation is not only a differentiability hypothesis; it is the natural hypothesis on an integrator. The Riemann–Stieltjes integral was defined in Riemann Integration as a limit of sums . The following theorem explains why is the right condition: it is exactly what makes those sums bounded uniformly in the partition.
Theorem 8.20 (Existence against a BV integrator). If is continuous on and , then exists, and
Proof. By Theorem Jordan decomposition write with increasing; by linearity of the Stieltjes sums in it suffices to treat an increasing integrator, which is the case proved in Riemann Integration under the title A sufficient condition for existence (continuous integrand, monotone integrator). Existence follows.
For the bound, estimate any Stieltjes sum directly:
by Definition Variation over a partition and total variation. The bound is uniform over partitions and tags, so it passes to the limit.∎
Remark. The inequality says that is a bounded linear functional on with norm at most . The Riesz representation theorem — beyond this chapter — says every bounded linear functional on arises this way, from a unique normalised . Bounded variation is thus not one possible hypothesis among many; it is the exact dual of continuity.
Proposition 8.21 (Stieltjes integration against a jump). Let on with and . Then for every continuous at ,
Proof. Let be a partition of mesh and let be a subinterval containing . Every increment vanishes except for the ones straddling , where the increments total . Hence the Stieltjes sum equals for a tag within of (or splits as between two adjacent tags, both within of ). By continuity at , as , so the sums converge to .∎
Example 8.22 (A mixed integrator). On let for and for . Compute and .
Solution.
- is increasing, so .
- Split with and . Stieltjes integration is linear in the integrator.
- Against the integral is ordinary: .
- Against , Proposition Stieltjes integration against a jump gives .
- Total: .
- Sanity check against Theorem Existence against a BV integrator: , and .
Corollary 8.23 (Integration by parts for BV integrators). If is continuous and , and one of , exists, then so does the other and
Proof. This is the theorem Stieltjes integration by parts of Riemann Integration; the content added here is only that the hypothesis " monotone" used there may be relaxed to " ", which follows by writing and adding the two identities.∎
8.6The ε-δ Definition: Uniform Control on Total Increments
Definition Absolute continuity, first statement was given in passing to expose the Cantor function. It is now the central object, so we restate it and place it correctly among the conditions already known.
Definition 8.24 (Absolutely continuous function). is absolutely continuous, written , if for every there exists such that for every finite family of pairwise disjoint open intervals , ,
Taking recovers uniform continuity verbatim, so uniformly continuous. The content of the definition is that must work for all at once — the same budget of total length, however finely it is chopped up and scattered.
Proposition 8.25 (Lipschitz implies absolutely continuous). If for all , then . In particular every continuously differentiable function on a closed bounded interval is absolutely continuous.
Proof. Given take . For disjoint intervals of total length ,
For the second claim, if then is continuous on a compact set, hence bounded by some by the Extreme Value Theorem of Limits & Continuity, and the Mean Value Theorem of Differentiation gives the Lipschitz bound with that .∎
Theorem 8.26 (The chain of inclusions). On ,
and every inclusion is strict.
Proof. The inclusions themselves: the first two are Proposition Lipschitz implies absolutely continuous; because gives uniform continuity; is Theorem Absolutely continuous implies bounded variation below; and is trivial.
Strictness, one example each. on is Lipschitz but not . on is absolutely continuous (it is increasing with , and Theorem Absolutely continuous means indefinite integral applies) but not Lipschitz, since is unbounded. The Cantor function lies in but not in , by Proposition The Cantor function is not absolutely continuous. And is in but not continuous.∎
Example 8.27 (Testing the definition on a non-example). Show directly that on is not Lipschitz but does satisfy the - condition when the intervals are forced to avoid — and explain what happens at .
Solution.
- Not Lipschitz: as , so no single constant works.
- Away from : on with the derivative is bounded by , so is Lipschitz there, hence absolutely continuous on by Proposition Lipschitz implies absolutely continuous.
- At the single interval contributes , and as soon as . So the bad point costs a smaller , not an impossible one.
- Combining: given , put ; intervals meeting contribute at most in total by monotonicity, and the rest are handled by the Lipschitz bound on with . So after all.
- The contrast with is instructive: has one point of unbounded derivative, and one point is negligible; has an uncountable set of them, of measure zero but of positive "variation mass".
Pitfall. Uniform continuity is not absolute continuity. is continuous on the compact , hence uniformly continuous by Heine-Cantor, and is still not absolutely continuous. The distinction is invisible for one interval and only appears when arbitrarily many disjoint intervals are allowed simultaneously.
8.7Equivalence with Being an Indefinite Integral
This is the central theorem of the part, and it is the fundamental theorem of calculus in its final form. Both directions matter: one says indefinite integrals are absolutely continuous, the other says nothing else is.
Theorem 8.28 (Absolute continuity of the integral). Let . For every there is such that implies , for every measurable .
Proof. Let . Then pointwise, so by the Monotone Convergence Theorem of Lebesgue Integration, , which is finite. Choose with , and put . Then for ,
Corollary 8.29 (Indefinite integrals are absolutely continuous). If and , then .
Proof. Given , take from Theorem Absolute continuity of the integral. For disjoint intervals with , put , so and
Theorem 8.30 (Fundamental Theorem of Calculus for the Lebesgue integral). For the following are equivalent.
- .
- exists a.e., , and for every .
- is an indefinite integral: for some .
When these hold, a.e.
Proof. is Corollary Indefinite integrals are absolutely continuous. is immediate with .
, the substantial direction, in three steps. Step A. (Theorem Absolutely continuous implies bounded variation below), so by Corollary BV implies differentiable a.e. the derivative exists a.e. and lies in .
Step B. Set . By Corollary Indefinite integrals are absolutely continuous, , and by the Lebesgue differentiation theorem (stated in the next part, Lebesgue differentiation theorem) a.e. Hence is absolutely continuous with a.e. and .
Step C. An absolutely continuous function with vanishing derivative a.e. is constant. Fix and , and let be as in Definition Absolutely continuous function for this . The set has full measure in . For each and each there are arbitrarily short intervals with ; these form a Vitali cover of , so by the Vitali covering lemma (used again in Proof Ideas (Vitali Covering or Rising Sun in 1D)) finitely many disjoint such intervals cover all but of . Across those intervals the total increment of is at most ; across the leftover set, of measure , it is at most by absolute continuity. Hence , and letting gives . So .∎
Example 8.31 (Recovering a function from its derivative, and failing to). For each of on and , decide whether .
Solution.
- for , unbounded at but integrable: .
- And . The identity holds, so by Theorem Fundamental Theorem of Calculus for the Lebesgue integral. Unboundedness of is no obstruction; only non-integrability would be.
- a.e. by Theorem Properties of the Cantor function, so for every , while . The identity fails at every where .
- By the theorem, this is equivalent to — we now have two independent proofs of that fact, the direct one and this one.
8.8Properties Inherited from Integrals
Because functions are exactly indefinite integrals, every stability property of the integral becomes a stability property of , usually with a one-line proof. This section collects the ones that get used.
Theorem 8.32 (Algebra of absolutely continuous functions). Let and . Then , , and are in ; and if then .
Proof. Sums and scalars: add the -versions of the defining condition. For , the reverse triangle inequality gives , so the same works.
For products, and are continuous on a compact interval hence bounded by some , and
given , use the that serves for each factor. For quotients, and then apply the product case.∎
Theorem 8.33 (Integration by parts and substitution). If then and
Proof. By Theorem Algebra of absolutely continuous functions, , so by Theorem Fundamental Theorem of Calculus for the Lebesgue integral applied to ,
and the integrand is in . It remains to see a.e., which is the product rule of Differentiation applied at each of the almost-every points where both and exist — the intersection of two full-measure sets.∎
Proposition 8.34 (Composition). If is Lipschitz on an interval containing the range of , and , then . The composition of two absolutely continuous functions need not be absolutely continuous.
Proof. For the positive statement, with Lipschitz constant for , , so the serving for serves for .
For the negative statement, take on , absolutely continuous by Example Testing the definition on a non-example, and with . One checks that is of bounded variation and absolutely continuous on , since its oscillations are damped by . But
which is not even of bounded variation, by the pitfall in Definition via Total Variation. Absolute continuity is therefore not preserved by composition on the inside.∎
Example 8.35 (Variation of an AC function as an integral). Let on . Compute two ways.
Solution.
- By monotone pieces. increases on from to , decreases on from to , increases on from to . Total: .
- By the integral. For one has — the variation function is itself the indefinite integral of . Here .
- The two agree, as they must.
Theorem 8.36 (Variation of an AC function). If then for all .
Proof. () For any partition of , ; take the supremum.
() Let , measurable, and approximate: by Lusin's theorem (from Lebesgue Integration) and density of step functions in , choose a step function with values in and . With constant on the blocks of a partition ,
and was arbitrary.∎
8.9Relation to Bounded Variation and Singular Functions
We owe a proof of the inclusion used twice already, and we can then state the decomposition theorem that puts the Cantor function in its place inside the general theory.
Theorem 8.37 (Absolutely continuous implies bounded variation). If then . The converse is false: the Cantor function is continuous and of bounded variation but not absolutely continuous.
Proof. Apply Definition Absolutely continuous function with to get a . Choose an integer and split into consecutive closed intervals each of length .
Fix and let be any partition of . Its subintervals are pairwise disjoint with total length , so the defining condition applies and gives . Taking the supremum over yields .
By additivity of variation (Proposition Boundedness and additivity, applied times),
The converse fails by Theorem Properties of the Cantor function together with Proposition The Cantor function is not absolutely continuous: and .∎
Definition 8.38 (Singular function). A function is singular if it is continuous, of bounded variation, non-constant, and for almost every .
The Cantor function is the standard example, and Theorem Properties of the Cantor function verifies each clause. The next theorem says that singular functions and absolutely continuous ones account for every function once jumps are separated off.
Theorem 8.39 (Lebesgue decomposition of a BV function). Every can be written uniquely, up to additive constants, as
where , is continuous with a.e., and is a jump function — a sum over the (countably many) discontinuities with .
Proof. Sketch; the measure-theoretic ingredient is quoted. Write with increasing (Theorem Jordan decomposition), so it suffices to treat increasing . By Corollary Discontinuities of a BV function the discontinuities are countable with jumps summing to at most ; define as that sum and check that is continuous and increasing. Next set , which is by Corollary Indefinite integrals are absolutely continuous and has the same derivative a.e. as by the Lebesgue differentiation theorem. Then is continuous with derivative a.e.
Uniqueness: a difference of two such decompositions is an function with derivative a.e. and no jumps, hence constant by Step C of Theorem Fundamental Theorem of Calculus for the Lebesgue integral. What is being assumed is the correspondence between increasing right-continuous functions and Lebesgue–Stieltjes measures, together with the Lebesgue decomposition of a measure, which is the subject of the next section.∎
Example 8.40 (Decomposing an explicit function). Decompose on and compute .
Solution.
- The three summands are already of the three types: (Lipschitz, hence ), (singular), .
- is a sum of increasing functions, hence increasing, so .
- and , so .
- Note , strictly less than : the deficit is exactly the singular mass plus the jump.
8.10Absolute Continuity of Measures and Radon–Nikodym
Every statement of this part has a measure-theoretic shadow, and in the shadow the theorems are cleaner. A function corresponds to a signed measure; absolute continuity of the function corresponds to absolute continuity of the measure; and the fundamental theorem becomes the Radon–Nikodym theorem.
Definition 8.41 (Absolute continuity and mutual singularity of measures). Let be ( -finite, signed or positive) measures on a measurable space . Say is absolutely continuous with respect to , written , if . Say they are mutually singular, , if with and .
Proposition 8.42 (The ε-δ form for finite measures). If is a finite measure, then if and only if for every there is with .
Proof. () If then for every , so for every , so .
() Suppose the - statement fails for some . Then for each there is with and . Put . Then for every , so ; while for every and is finite, so continuity from above gives . This contradicts .∎
Remark. Finiteness of is essential in the () direction. On with Lebesgue measure and we have , yet for every .
Theorem 8.43 (Radon–Nikodym). Let be -finite and a -finite measure with . Then there is a -a.e. unique measurable with
One writes , the Radon–Nikodym derivative.
Proof. Sketch (von Neumann's argument), for finite ; the -finite case follows by exhaustion. What is assumed: the Riesz representation theorem for bounded linear functionals on a Hilbert space, which is not proved in this book.
Set and consider on . By Cauchy–Schwarz, , so is bounded, and Riesz representation supplies with for all .
Testing on indicators shows -a.e. Rearranging, . The set then has -measure , hence -measure by , so a.e. Putting and taking (justified by monotone convergence on truncations) gives .
Uniqueness: if for all , test on and on its complement to force -a.e.∎
Corollary 8.44 (The function form). A finite Borel measure on satisfies (Lebesgue) if and only if its distribution function is absolutely continuous, and then a.e.
Proof. If , Radon–Nikodym gives with , so by Corollary Indefinite integrals are absolutely continuous, and a.e. by the Lebesgue differentiation theorem. Conversely if then by Theorem Fundamental Theorem of Calculus for the Lebesgue integral; a set of Lebesgue measure zero then has -measure zero, since the integral of an function over a null set vanishes.∎
Example 8.45 (Reading off a Radon–Nikodym derivative). On let . Compute , identify , and decide whether .
Solution.
- .
- By definition , and because an integral over a null set is .
- For the reverse: trivially, but consider — it is -null too, so that is no obstruction. Since for , any set with has , hence . So in fact as well, and .
- The measures are therefore equivalent: each is absolutely continuous with respect to the other. That fails as soon as the density vanishes on a set of positive measure.
8.11The Lebesgue Differentiation Theorem
The fundamental theorem just proved has a local counterpart that holds for every integrable function, absolutely continuous or not: averages over shrinking intervals converge back to the function almost everywhere. This is the result the previous part kept quoting.
Definition 8.46 (Averaging operator). For and a ball write
In dimension one this is .
Theorem 8.47 (Lebesgue differentiation theorem). Let . Then
In dimension one, consequently, a.e.
Proof. Granting the maximal inequality proved in the next section. Fix and work on the ball ; it suffices to prove the statement there. Define the oscillation
The claim is a.e. Let . By density of continuous functions in (proved in Lebesgue Integration), choose continuous with . For continuous , at every by continuity, so . Writing and using linear,
where is the Hardy–Littlewood maximal operator of the next section. Hence for ,
using the weak-type inequality for the first term and Chebyshev's inequality for the second. Since was arbitrary, for every , and taking and a countable union gives a.e.∎
The structure of that argument is worth naming, because it recurs everywhere in analysis: a dense class on which the statement is trivial, plus a quantitative bound that controls the error uniformly. Density alone proves nothing — convergence a.e. is not preserved under limits — and the maximal inequality is precisely the missing uniformity.
Example 8.48 (Averages of a function with a jump). Let on . Compute for and for with , and identify the exceptional set.
Solution.
- For and , the whole interval lies in , so . Likewise for , .
- At : for every , so the limit is .
- The exceptional set is , of measure zero, exactly as the theorem permits. Note the limit exists at — it simply equals the average of the two one-sided values.
Corollary 8.49 (Density points). Let be measurable. Then for almost every ,
and the same limit is for almost every .
Proof. Apply Theorem Lebesgue differentiation theorem to , noting , and let .∎
Intuition. Density points say that a measurable set has no genuinely "fuzzy" interior: almost every point of is a point where occupies of every sufficiently small ball. A set like the rationals, which feels dense everywhere, has measure zero and therefore no density points — its apparent ubiquity is topological, not measure-theoretic.
8.12The Hardy–Littlewood Maximal Function and the Weak-Type Inequality
The maximal function replaces a limit that may not exist by a supremum that always does, at the cost of an inequality instead of an identity. Controlling it is the whole game.
Definition 8.50 (Hardy–Littlewood maximal function). For ,
Note at once that does not map into : if then for large , which is not integrable on . The correct substitute is a bound on the distribution function.
Lemma 8.51 (Vitali covering lemma, finite form). Let be balls in . There is a pairwise disjoint subcollection with
Proof. Greedy selection. Pick of largest radius. Having chosen , pick of largest radius among those disjoint from all previously chosen; stop when none remain.
Every meets some chosen — otherwise it would have been selectable — and the first chosen ball it meets has radius at least that of , by the greedy order. If two balls meet and , then , the concentric triple. Hence and
since dilating a ball by multiplies its measure by .∎
Theorem 8.52 (Hardy–Littlewood maximal inequality (weak type (1,1))). For every and every ,
Proof. Let and let be compact; by inner regularity it suffices to bound .
For each there is, by Definition Hardy–Littlewood maximal function, a radius with
These balls cover ; by compactness finitely many suffice. Apply Lemma Vitali covering lemma, finite form to get a disjoint subfamily with . Then
the last step because the are pairwise disjoint. Taking the supremum over compact gives the claim.∎
Corollary 8.53 (Strong type for ). For there is with .
Proof. Sketch; the interpolation step is quoted. For the bound is immediate with , since every average of is at most . For , the Marcinkiewicz interpolation theorem applied between the weak- bound of Theorem Hardy–Littlewood maximal inequality (weak type (1,1)) and the strong bound yields the strong bound. The interpolation theorem itself is beyond this chapter; the elementary route is to split , apply the weak bound to the first piece, and integrate the distribution function via .∎
Example 8.54 (The maximal function of an indicator). Compute for on , and verify the weak-type bound at .
Solution.
- For the ball with small lies inside , giving average ; no average exceeds , so there.
- For , the best interval is the smallest one containing all of , namely : then .
- So , of measure .
- The bound gives .
- Note at infinity, confirming even though : the weak-type form is not a weakness of the proof but of the operator.
8.13Proof Ideas: Vitali Covering and the Rising Sun Lemma
Two arguments carry the differentiation theory. The first is the covering idea already used; the second is a one-dimensional trick that gives monotone differentiability with bare hands.
Lemma 8.55 (Vitali covering lemma). Let with and let be a family of closed balls that covers in the Vitali sense: every lies in balls of of arbitrarily small radius. Then for every there are finitely many pairwise disjoint with
Proof. Sketch. Enclose in an open with and discard balls not contained in ; the family still covers in the Vitali sense. Select greedily: having chosen disjoint , if they do not already cover up to measure , choose disjoint from them with radius at least half the supremum of admissible radii. Disjointness inside forces , so radii tend to . A point of not covered by lies in some admissible small ball, which must meet some with and hence lies in ; therefore the uncovered part has measure at most . Choose making this .∎
Lemma 8.56 (Rising sun lemma). Let be continuous on and let
be the set of points "in shadow". Then is open, , and for each .
Proof. is open because is continuous: if then the same works for all near . Write as a countable disjoint union of open intervals , its connected components.
Fix and . We claim . Let ; the set is non-empty () and closed by continuity, so the supremum is attained and . If then , so some has , contradicting maximality of . Hence ; if then , impossible since is an endpoint of a component and is open — so and . Letting and using continuity gives .∎
Theorem 8.57 (Monotone functions are differentiable a.e.). An increasing is differentiable at almost every point.
Proof. Sketch, using the covering lemma. For let
the set where the derivative fails to exist with the two Dini limits separated by the rationals . The non-differentiability set is , a countable union, so it suffices to show each is null.
Put (outer measure) and fix . Intervals on which the increment ratio is form a Vitali cover of ; by Lemma Vitali covering lemma finitely many disjoint ones cover all but , and summing gives . Inside those intervals, intervals with ratio form a Vitali cover of , whose outer measure is at least ; selecting disjoint ones covering all but gives . Since the sit inside the and is increasing, the second sum is at most the first, so
Letting gives , and since this forces . Finiteness of the derivative a.e. follows from the integral bound in Theorem Lebesgue's differentiation theorem for monotone functions.∎
Remark. The rising sun lemma gives a second, wholly one-dimensional route: applied to it produces the estimate , a weak-type bound for the derivative rather than the average, from which the same argument runs. The name is Riesz's: the shadowed set is what a horizontal sun rising from the right leaves in darkness.
8.14Differentiation of Measures and the Radon–Nikodym Derivative
Averaging a function over small balls generalises to comparing two measures over small balls, and the limit is again a Radon–Nikodym derivative — with the Cantor function's pathology appearing as the singular part.
Definition 8.58 (Symmetric derivative of a measure). Let be a signed Borel measure on , finite on compacts. Its derivative with respect to Lebesgue measure at is
when the limit exists.
Theorem 8.59 (Lebesgue decomposition). Let be -finite and -finite on . Then decomposes uniquely as
Proof. Sketch, assuming Radon–Nikodym for the pair . Since and , Theorem Radon–Nikodym supplies densities; write with . Let and . On one gets , so . On , setting gives , so .
Uniqueness: if are two such decompositions, then is simultaneously and , and a measure both absolutely continuous and singular with respect to is zero.∎
Theorem 8.60 (Differentiating a measure). Let be a finite signed Borel measure on with Lebesgue decomposition . Then exists a.e. and
Proof. Sketch. The absolutely continuous part is Theorem Lebesgue differentiation theorem verbatim, since .
For the singular part, let carry with . Replacing by the maximal operator , the same Vitali argument as in Theorem Hardy–Littlewood maximal inequality (weak type (1,1)) gives for compacts exhausting ; regularity of makes the right side arbitrarily small off , so a.e. off , hence a.e.∎
Example 8.61 (The measure induced by the Cantor function). Let be the Lebesgue–Stieltjes measure with . Find its Lebesgue decomposition and .
Solution.
- is a probability measure on (total mass ) supported on the Cantor set : every removed interval is a plateau of and so has -measure .
- by Theorem Properties of the Cantor function, so with the splitting .
- Hence and : the decomposition is entirely singular.
- By Theorem Differentiating a measure, a.e., which is the statement a.e. read as a statement about measures.
- Note has no atoms either ( is continuous), so it is an example of a continuous singular measure — neither a density nor a sum of point masses.
8.15Lebesgue Points and Lusin's Condition (N)
Two refinements close this part. The first strengthens the differentiation theorem from "averages converge" to "averages of the deviation converge". The second gives the missing metric characterisation of absolute continuity.
Definition 8.62 (Lebesgue point). A point is a Lebesgue point of if
Theorem 8.63 (Almost every point is a Lebesgue point). If then almost every is a Lebesgue point of .
Proof. For apply Theorem Lebesgue differentiation theorem to the function , which is locally integrable: there is a null set off which
Let , still null. Fix and , and choose rational with . Then
Since was arbitrary, the limsup is .∎
Remark. The difference from the plain differentiation theorem matters: allows cancellation between places where is too big and places where it is too small, as the jump in Example Averages of a function with a jump illustrates. A Lebesgue point forbids the cancellation, which is what makes Lebesgue points the right notion of "the value of at " for an equivalence class of functions agreeing a.e.
Definition 8.64 (Lusin's condition (N)). satisfies condition (N) if for every : maps null sets to null sets.
Theorem 8.65 (Banach–Zarecki). if and only if is continuous, of bounded variation, and satisfies condition (N).
Proof. () Continuity and bounded variation are Theorem The chain of inclusions and Theorem Absolutely continuous implies bounded variation. For (N), let and , and take from Definition Absolutely continuous function. Cover by disjoint intervals of total length ; on each, attains its max and min at points inside, and the image of that interval is an interval of length . The intervals are disjoint of total length , so , giving .
() Sketch. Given continuity, and (N), one shows , which by Theorem Variation of an AC function characterises . The step that uses (N) is that the image of the set where fails to exist — null by Corollary BV implies differentiable a.e. — contributes no length, so no variation is hidden there; the remaining variation is accounted for by the derivative via a Vitali covering argument.∎
Example 8.66 (The Cantor function violates (N)). Show that maps a null set onto a set of measure , and reconcile this with Theorem Banach–Zarecki.
Solution.
- maps onto and is constant on each removed interval, so of the removed set is a countable set of dyadic values, of measure .
- Since has measure , and the removed part contributes measure , we get .
- But . So carries a null set to a set of full measure: condition (N) fails spectacularly.
- This is consistent: is continuous and , and Theorem Banach–Zarecki then says exactly one thing can be wrong, namely (N) — which is a third independent proof that .
- The picture to keep: absolute continuity is the analytic name for "does not manufacture measure out of nothing".
8.16 Spaces: Definition and Basic Properties
We now change subject. The convergence theorems of Lebesgue Integration say when limits may be taken inside an integral; theory turns those statements into the geometry of a normed space, where "limit" means limit in a norm and the theorems become statements about completeness.
Definition 8.67 (The space ). Let be a measure space and . For measurable put
and let be the set of measurable with , with two functions identified when they agree -a.e. For set
the essential supremum, and .
The identification of a.e.-equal functions is not a technicality to be waved through: without it is only a seminorm, since says exactly a.e., not . An element of is an equivalence class, and Theorem Almost every point is a Lebesgue point is what lets us speak of "the value at " for a canonical representative.
Proposition 8.68 ( is a norm, given Minkowski). For , is a vector space and is a norm on it.
Proof. Homogeneity, , is immediate from pulling out of the integral. Definiteness holds because of the a.e. identification, as noted. Closure under addition and the triangle inequality are both Theorem Minkowski's inequality, proved two sections below; note that already gives closure under addition without it. For , the triangle inequality follows because and outside a null set, whose union is null.∎
Proposition 8.69 (). If and , then as .
Proof. Write . Upper bound: . Lower bound: for the set has by definition of the essential supremum, and
Since was arbitrary, .∎
That proposition is the reason for the notation: is the limiting case of , and the essential supremum rather than the supremum is what makes the limit work — a function altered on a null set has the same for every finite , so the limit cannot see an ordinary supremum.
Example 8.70 (Which does belong to?). On with Lebesgue measure, for which is in ? Compute .
Solution.
- converges exactly when , i.e. .
- So for and .
- For : , so .
- Sanity check on the boundary: at the integral is , confirming exclusion. The example shows the scale is genuinely a scale: membership is a sharp threshold, not a yes/no for all at once.
Example 8.71 (The same question at infinity). On , for which is in ? Compute .
Solution.
- converges exactly when .
- So for but — the opposite threshold to the previous example.
- , so .
- Comparing the two examples: near a singularity, small helps; near infinity, large helps. This is why no inclusion between spaces holds on , as the section on relations will make precise.
8.17Hölder's and Minkowski's Inequalities
Two inequalities make work, and both come from a single convexity fact about the logarithm. We prove that fact first, since deriving Hölder from it and Minkowski from Hölder is the cleanest sequence in this chapter.
Definition 8.72 (Conjugate exponents). are conjugate exponents if
with the conventions , so that and are conjugate, and is self-conjugate.
Lemma 8.73 (Young's inequality). Let be conjugate. Then for all ,
with equality if and only if .
Proof. If or both sides behave trivially, so assume . The logarithm is concave — its second derivative is — so for weights ,
Exponentiating, using that is increasing, gives the inequality. Strict concavity makes the middle step an equality exactly when .∎
Theorem 8.74 (Hölder's inequality). Let be conjugate exponents in . For measurable ,
In particular whenever and .
Proof. The cases are immediate: a.e., so integrate.
Let . If then a.e. and both sides vanish; likewise for . If either norm is infinite the right side is . So assume and normalise:
Apply Lemma Young's inequality pointwise with , :
Integrate over , using monotonicity and linearity of the integral:
Multiplying through by gives .∎
Corollary 8.75 (Cauchy–Schwarz). , with equality iff and are proportional a.e.
Proof. Take in Theorem Hölder's inequality. The equality case comes from the equality case of Lemma Young's inequality: a.e., i.e. a.e.∎
Theorem 8.76 (Minkowski's inequality). For and ,
Proof. For integrate the pointwise triangle inequality; for see Proposition is a norm, given Minkowski. Let and assume , which is finite because .
Split the integrand by writing and using :
Apply Theorem Hölder's inequality to each term with exponents and :
since and . Divide both sides by the finite non-zero quantity and use :
Example 8.77 (Hölder in a concrete estimate). On , bound using Hölder with , and compare with the exact value .
Solution.
- Take , and apply Corollary Cauchy–Schwarz.
- , so .
- By the symmetry , too.
- Hence the integral is at most .
- The true value is about , so the bound is valid but lossy by a factor near — expected, since equality in Cauchy–Schwarz needs , and here the two factors are singular at opposite endpoints.
Pitfall. Hölder's inequality requires conjugate exponents, and the commonest error is to use and instead of and . Check by homogeneity: replacing by must scale both sides by , and replacing by likewise, which pins down uniquely.
8.18Completeness: the Riesz–Fischer Theorem
Completeness is the property for which the Lebesgue integral was built. The same definition of applied to Riemann-integrable functions produces a space that is not complete — Cauchy sequences of continuous functions can converge to discontinuous limits — and every limiting argument in analysis then has to carry its own existence proof.
Theorem 8.79 (Riesz–Fischer: is complete). For and any measure space, is a Banach space: every Cauchy sequence in converges in to an element of .
Proof. Take (the case is at the end). Let be Cauchy. It suffices to produce a subsequence converging in norm to some , since a Cauchy sequence with a convergent subsequence converges — a fact from Sequences & Series that holds in any metric space.
Step 1: extract a rapidly Cauchy subsequence. Choose with
Step 2: a dominating function. Put
By Theorem Minkowski's inequality applied times, . The increase to , so the Monotone Convergence Theorem of Lebesgue Integration gives . Hence and in particular a.e.
Step 3: pointwise limit. Where the telescoping series
converges absolutely, hence converges; call its sum , and set on the null set where . Then a.e., and , so .
Step 4: convergence in norm. , a fixed integrable dominating function, and a.e. The Dominated Convergence Theorem of Lebesgue Integration gives , i.e. .
The case . If is Cauchy in , then for each pair the inequality holds off a null set ; off the countable union , still null, is uniformly Cauchy, hence converges uniformly to some bounded , and .∎
Corollary 8.80 (Norm convergence gives an a.e. convergent subsequence). If in , , then some subsequence converges to -a.e.
Proof. is Cauchy in norm; Step 1 to Step 3 of Theorem Riesz–Fischer: is complete produce a subsequence converging a.e. to some and in norm to . Norm limits are unique, so in , i.e. a.e.∎
Example 8.81 (Norm convergence without pointwise convergence). On let run through the indicators of the dyadic intervals , , taken in order — the "typewriter sequence". Show in but for any .
Solution.
- The -th function is the indicator of an interval of length where , so .
- Fix . For each exactly one of the intervals of that generation contains , so for infinitely many and for infinitely many .
- Hence diverges at every : convergence does not imply a.e. convergence.
- Corollary Norm convergence gives an a.e. convergent subsequence is not violated. Take the subsequence , the first function of each generation: it tends to at every . A subsequence converges a.e.; the full sequence need not.
Corollary 8.82 ( is a Hilbert space). with is a Hilbert space, and .
Proof. The integral defining is finite by Corollary Cauchy–Schwarz, and it is sesquilinear and positive definite modulo the a.e. identification. That it induces is immediate. Completeness is Theorem Riesz–Fischer: is complete at .∎
Remark. is the only exponent for which comes from an inner product. The test is the parallelogram law ; taking indicators of disjoint sets of measure gives on the left and on the right, which agree only when . Everything specific to Fourier series in the next part is a consequence of this one accident.
8.19Duality and Reflexivity
Hölder's inequality says that each defines a bounded linear functional on . The duality theorem says these are all of them.
Definition 8.83 (The dual pairing). For conjugate and , define by
Proposition 8.84 (The pairing is isometric). For with conjugate and , the functional is bounded with operator norm exactly .
Proof. is Theorem Hölder's inequality, so .
For the reverse, assume and , and take the extremal . Then , so , while
Hence , using . The cases and are handled by testing on indicators of sets where is nearly maximal.∎
Theorem 8.85 (Duality of ). Let be -finite and with conjugate . Then is an isometric isomorphism . In particular and, for , is reflexive.
Proof. Sketch; the Radon–Nikodym theorem is the substantial input. Injectivity and isometry are Proposition The pairing is isometric. For surjectivity, let and first suppose . Define a set function . Countable additivity of follows from continuity of and . If then in , so : thus , and Theorem Radon–Nikodym gives with . Linearity extends from indicators to simple functions and then, by density of simple functions in and continuity, to all of . A truncation argument shows . The -finite case follows by exhausting with sets of finite measure.
Reflexivity for : applying the isomorphism twice, , and one checks the composite is the canonical embedding.∎
Remark. The theorem fails at : is strictly larger than , containing functionals built from finitely additive measures (Banach limits), and and are therefore not reflexive. The hypothesis in Theorem Duality of is essential, not technical.
Example 8.86 (Computing an operator norm by duality). Let on . Find .
Solution.
- The conjugate of is , since .
- By Proposition The pairing is isometric, with .
- .
- So .
- Sanity check: the crude bound is exactly what we computed, and it is attained at up to scaling, since the extremal is .
8.20Relations between Spaces
On a general measure space no contains another. Two hypotheses restore order in opposite directions: finite measure, and a measure bounded below on its atoms.
Theorem 8.87 (Inclusions on a finite measure space). If and , then and
Proof. For the claim is , immediate by integrating .
For apply Theorem Hölder's inequality to the product with exponents and its conjugate :
Take -th roots: .∎
Proposition 8.88 (Reverse inclusions for counting measure). For and , we have with — the inclusion runs the other way.
Proof. Normalise , so for every . Then because and the base is at most , hence and . Homogeneity extends this to all .∎
Theorem 8.89 (Interpolation of norms). Let and write for a unique . Then
so for every intermediate .
Proof. Take ; split and apply Theorem Hölder's inequality with exponents and . These are conjugate because
Hölder then gives ; take -th roots.∎
Example 8.90 (No inclusion on the whole line). Exhibit and .
Solution.
- Take . By Example Which does belong to?, and .
- Take . By Example The same question at infinity, and .
- Neither space contains the other, so Theorem Inclusions on a finite measure space really does need : on the measure is infinite and both failures are available at once.
- Their sum lies in neither nor . It does lie in for and only there: the singular part at requires and the tail at infinity requires .
8.21Applications of Spaces
Three settings where the framework does real work, each stated with the result that makes it work.
Theorem 8.91 (Density of nice functions). For , the continuous compactly supported functions are dense in . The same fails for .
Proof. Sketch. Simple functions are dense in (approximate and from below by simple functions and dominate). A simple function is a finite combination of indicators of finite-measure sets, so it suffices to approximate with . By regularity of Lebesgue measure there are compact and open with and ; Urysohn's lemma supplies continuous with , and .
For the closure of is the space of continuous functions vanishing at infinity, which does not contain : the uniform distance from any continuous function to an indicator is at least .∎
Theorem 8.92 (Convolution and Young's convolution inequality). For and , , the convolution is defined for a.e. and
Proof. For this is Tonelli's theorem: after the substitution in the inner integral. For , write and apply Theorem Hölder's inequality in with exponents :
Raise to the -th power, integrate in , and use Tonelli again on the inner double integral to get . The case is Hölder with .∎
Remark. The three applications worth naming. Probability: is the space of finite-variance random variables, the inner product is covariance about the mean, and conditional expectation is orthogonal projection onto a sub- -algebra — so the whole theory of least-squares prediction is Hilbert-space geometry. Partial differential equations: Sobolev spaces are built from by requiring weak derivatives up to order to lie in , and existence proofs work by finding a weak solution in such a space and then upgrading its regularity. Fourier analysis: Theorem Convolution and Young's convolution inequality with an approximate identity is how one proves that smoothing converges, and it is the engine behind Fejér's theorem in the next part.
Example 8.93 (An approximate identity). Let be continuous with and set . Show for every and bound for .
Solution.
- Substituting , : . Since , .
- By Theorem Convolution and Young's convolution inequality with , .
- So smoothing never increases the norm, uniformly in — exactly the uniform bound needed to run the density argument of Theorem Lebesgue differentiation theorem again, this time proving in .
8.22Trigonometric Polynomials and Orthogonality
Fourier series are the concrete realisation of the theory: an orthonormal basis for of the circle, written down explicitly. Everything begins with one computation.
Definition 8.94 (Fourier coefficients and partial sums). For and , the Fourier coefficients and partial sums are
In real form, , , and .
Theorem 8.95 (Orthogonality of the trigonometric system). With and the inner product , the system is orthonormal:
Equivalently, for : , , and for all .
Proof. If then and .
If , put . Then
since for integer .
For the real form, use the product-to-sum identities: . Each cosine with non-zero frequency integrates to over a full period, leaving exactly when . Similarly and , the latter an odd function, whose integral over a symmetric interval is .∎
Theorem 8.96 (Best approximation in ). For , among all trigonometric polynomials of degree , the one minimising is , i.e. .
Proof. Expand, using orthonormality (Theorem Orthogonality of the trigonometric system):
Only the last sum depends on the , and it is minimised, at value , exactly when .∎
Corollary 8.97 (Bessel's inequality). For , . In particular as .
Proof. Put in the expansion of the proof above: , so the partial sums of are bounded by for every . A non-decreasing bounded sequence converges, by the monotone convergence theorem for sequences in Sequences & Series, and the limit is at most . Convergence of the series forces its terms to .∎
Example 8.98 (Fourier coefficients of a square wave). Let on and on . Compute and .
Solution.
- is odd, and is even, so is odd and for all .
- For , use oddness to fold the integral: .
- , so , which is for even and for odd .
- Hence
- Sanity check via Bessel: , and in real form . Equality — as Parseval's identity will explain.
8.23Pointwise Convergence: Dirichlet and Jordan
Bessel's inequality controls the coefficients but says nothing about whether at a given . The classical answer is local: convergence at depends only on near , and bounded variation near suffices.
Definition 8.99 (Dirichlet kernel).
Proposition 8.100 (Properties of the Dirichlet kernel). for every , is even, and .
Proof. The integral of is the sum of the integrals of , all zero except which gives ; divide by . Evenness is clear from the sum, since the terms combine to . For the closed form, multiply by and telescope. The growth of follows from giving and summing the resulting harmonic-type series over the humps .∎
The divergence of — the Lebesgue constants — is the source of every pathology in this part. A kernel whose norm blows up cannot converge for all continuous functions.
Theorem 8.101 (Riemann–Lebesgue lemma). If then as .
Proof. For the integral is , of modulus at most . By linearity the result holds for step functions, which are dense in by Theorem Density of nice functions. Given and , pick a step function with ; then
for large.∎
Theorem 8.102 (Dini's criterion and the localisation principle). Let and be such that for some
Then . Consequently, if two integrable functions agree on a neighbourhood of , their Fourier series converge or diverge together at .
Proof. Using and evenness,
Write . Since near , the Dini hypothesis makes integrable on ; on the denominator is bounded below, so . The displayed integral is , which tends to by Theorem Riemann–Lebesgue lemma.
Localisation: if near then satisfies Dini's condition at with .∎
Theorem 8.103 (Dirichlet–Jordan). If is of bounded variation on a neighbourhood of , then
If is of bounded variation and continuous on with , the convergence is uniform.
Proof. Sketch; the second mean value theorem for integrals is assumed. By Theorem Jordan decomposition it suffices to treat increasing near , and by localisation (Theorem Dini's criterion and the localisation principle) only the behaviour on matters. Write , which is of bounded variation on with . Applying the second mean value theorem to splits it into terms controlled by times the uniformly bounded sine integrals . Choosing small makes the first factor small, and the remaining range is handled by Riemann–Lebesgue.∎
Example 8.104 (Evaluating a series by pointwise convergence). Use the square wave of Example Fourier coefficients of a square wave at to evaluate .
Solution.
- is of bounded variation and continuous at , with , so Theorem Dirichlet–Jordan gives .
- is for even and for odd .
- Hence .
- Therefore : the Leibniz series, obtained here as a corollary of Fourier convergence.
8.24 Convergence and Parseval's Identity
Pointwise convergence is delicate. Mean-square convergence is not: it always holds, for every , with no regularity hypothesis whatever. This is the pay-off of completeness.
Theorem 8.105 (Completeness of the trigonometric system). Trigonometric polynomials are dense in . Equivalently, if for all then a.e.
Proof. Let and . By Theorem Density of nice functions choose continuous and -periodic with . By Theorem Fejér below, the Cesàro means converge to uniformly, hence in on a finite interval; choose with . Since is a trigonometric polynomial, .
For the equivalent form: if all coefficients vanish then for every trigonometric polynomial, hence by density, hence , so .∎
Theorem 8.106 (Mean-square convergence and Parseval's identity). For every , , and
In real form, . More generally .
Proof. By Theorem Best approximation in , for every trigonometric polynomial of degree . Given , Theorem Completeness of the trigonometric system supplies a trigonometric polynomial , of some degree , with ; then for all . So in .
For the identity, the expansion in the proof of Theorem Best approximation in at reads
Letting , the left side tends to , so the sum tends to . That is Parseval. The polarised version follows by applying it to and and subtracting.∎
Example 8.107 (Parseval and the Basel problem). Apply Parseval to on to evaluate .
Solution.
- is odd so , and . Integrating by parts, .
- So .
- Parseval in real form: .
- The left side is , so .
- Sanity check: the first four terms already give , climbing toward .
Example 8.108 (Parseval for the square wave). Apply Parseval to the square wave to evaluate .
Solution.
- From Example Fourier coefficients of a square wave, and .
- Parseval: .
- So , giving .
- Consistency with the previous example: , so and .
8.25Cesàro Means, Fejér's Theorem, and Uniform Convergence
The Dirichlet kernel is not positive and its norms diverge, which is why misbehaves. Averaging the partial sums repairs both defects at once.
Definition 8.109 (Fejér means and kernel).
Lemma 8.110 (The Fejér kernel is an approximate identity). ; for every ; and for each , as .
Proof. Non-negativity is immediate from the closed form, a square divided by . The closed form itself follows by summing , which telescopes after multiplying by to give . The mass is because each has mass (Proposition Properties of the Dirichlet kernel) and is their average.
For concentration, on we have , and the numerator is at most , so there; integrating over a set of measure at most gives a bound .∎
Theorem 8.111 (Fejér). If is continuous and -periodic, then uniformly on . If and both one-sided limits exist at , then .
Proof. Since ,
is continuous and periodic, hence uniformly continuous by Heine-Cantor applied on , and bounded, say . Given pick with whenever , uniformly in . Split the integral:
The first term is at most , using and total mass . The second tends to as by Lemma The Fejér kernel is an approximate identity, uniformly in because the bound does not involve ; choose making it . Then for .
For the second statement, replace by the average of the one-sided limits and use evenness of to pair with ; the same split works.∎
Corollary 8.112 (Weierstrass approximation, trigonometric form). Trigonometric polynomials are dense in , and a continuous periodic function is determined by its Fourier coefficients.
Proof. is a trigonometric polynomial — it is a finite combination of the , — and it converges uniformly to by Theorem Fejér. If all coefficients of vanish then every , so every , so uniformly.∎
Intuition. chops the frequency spectrum off abruptly at ; a sharp cut in frequency produces ringing in space, which is the Dirichlet kernel's oscillating tail. tapers the coefficients linearly to zero — — and a smooth taper gives a positive, concentrated kernel with no ringing. Every practical signal-processing window is a version of this trade.
8.26Divergence, the Gibbs Phenomenon, and Carleson's Theorem
Fejér repairs convergence at the cost of changing the sums being taken. Left alone, genuinely misbehaves, in two distinct ways.
Theorem 8.113 (Existence of a continuous function with divergent Fourier series). There exists whose Fourier series diverges at . The set of such is comeager in .
Proof. Sketch, using the uniform boundedness principle. The maps are bounded linear functionals on with by Proposition Properties of the Dirichlet kernel — the norm is attained in the limit by testing against continuous approximations to . If converged for every , the sequence would be bounded for each , and the uniform boundedness principle (a consequence of the Baire category theorem of Metric Spaces) would force , a contradiction. Baire's theorem also gives the comeagerness.∎
Theorem 8.114 (Gibbs phenomenon). Let have a jump of size at and be smooth on each side. Then
an overshoot of about of the jump that does not shrink as ; it merely migrates toward .
Proof. Sketch, for the square wave; the general case follows by subtracting a smooth function and using localisation. For the square wave of Example Fourier coefficients of a square wave, differentiating term by term shows the first maximum to the right of occurs at . Evaluating,
the sum being a Riemann sum for that integral. Numerically , so the limit is against the true value : an overshoot of of the half-jump, i.e. of the full jump .∎
Theorem 8.116 (Carleson–Hunt). If with — in particular if is continuous — then for almost every . For the conclusion fails: Kolmogorov constructed whose Fourier series diverges everywhere.
Proof. Proof sketch only; a complete proof is a research paper and is not attempted here. The statement is equivalent to a weak-type bound on the Carleson maximal operator , namely , by exactly the density-plus-maximal-inequality scheme used in Theorem Lebesgue differentiation theorem: trigonometric polynomials are dense and the statement is trivial for them. What is assumed and not proved is the maximal bound itself, whose proof requires a time-frequency decomposition of the operator into "tiles" and a delicate combinatorial selection argument. Kolmogorov's counterexample at shows no such bound can hold there.∎
Pitfall. Three modes of convergence are in play and they are genuinely different. in for every (Theorem Mean-square convergence and Parseval's identity); a.e. for , (Theorem Carleson–Hunt); and uniformly only under extra regularity, since a continuous function can have a divergent series. Gibbs shows that even where pointwise convergence holds, uniform convergence can fail near a jump — the sup-norm error stays bounded away from .
8.27Applications and Extensions
Definition 8.117 (Fourier transform on ). For ,
Theorem 8.118 (Plancherel). The Fourier transform, defined first on , extends uniquely to a unitary operator on :
Proof. Sketch. On the Gaussian one computes directly by completing the square and a contour shift. Using the multiplication formula and dilates of the Gaussian as an approximate identity, one obtains for in the dense subspace of Schwartz functions. A densely defined isometry on a complete space extends uniquely to an isometry of the whole space — this is where Theorem Riesz–Fischer: is complete at is used. Surjectivity follows from the inversion formula on the dense subspace.∎
Example 8.119 (Solving the heat equation by Fourier series). Solve on with and . Evaluate to four decimal places.
Solution.
- Separating variables, satisfies the equation and the boundary conditions term by term.
- Matching : the initial datum is already a single mode, so and all other .
- Hence .
- At , , so .
- The moral: the Fourier basis diagonalises , turning a PDE into an ODE in each coordinate. That is the same statement as Theorem Orthogonality of the trigonometric system, used in earnest.
Theorem 8.120 (Weyl equidistribution). If is irrational then the sequence is equidistributed in : for every interval , .
Proof. By Corollary Weierstrass approximation, trigonometric form and a sandwich of between continuous functions, it suffices to prove for every non-zero integer . That is a geometric sum with ratio (here irrationality of is used), so
Remark. Three further directions, stated without proof. Wavelets replace the globally supported by localised bases, giving unconditional bases of for where the trigonometric system fails to be one. The Poisson summation formula links Fourier series to the Fourier transform and is the analytic heart of the functional equation of the Riemann zeta function. Uncertainty principles quantify the observation in the Gibbs analysis, that and cannot both be concentrated: .
8.28Differentiability in Several Variables
The single idea of this last part is that the derivative of a map is a linear map, and that partial derivatives are merely its matrix entries in one chosen basis. Confusing the two is the source of every standard error.
Definition 8.121 (Total derivative). Let be open and . is differentiable at if there is a linear map with
is then unique and is called the total derivative; its matrix in the standard bases is the Jacobian .
Proposition 8.122 (Uniqueness, and differentiability implies continuity). The map in Definition Total derivative is unique, and differentiability at implies continuity at and the existence of every directional derivative, with .
Proof. Uniqueness. If both work, then as . Fix a unit vector and take , : by linearity , but the left side does not depend on , so it is . Hence .
Continuity. The defining limit gives for small , which tends to .
Directional derivatives. Put : .∎
Theorem 8.123 (Continuous partials imply differentiability). If all partial derivatives exist on a neighbourhood of and are continuous at , then is differentiable at .
Proof. It suffices to treat , applying the result to each component. Write and interpolate one coordinate at a time: with and ,
Each summand changes only the -th coordinate, so the Mean Value Theorem of Differentiation in one variable applies: it equals for some on the segment, and as . Therefore
which tends to by continuity of the partials at .∎
Example 8.124 (Partials exist, differentiability fails). Let for and . Compute , , and decide whether is differentiable at the origin.
Solution.
- Along the axes , so : both partials exist.
- If were differentiable, would be the zero map by Proposition Uniqueness, and differentiability implies continuity, and then .
- Take : , so .
- So is not differentiable at the origin — indeed it is not even continuous there, since along the diagonal and along the axes.
- The hypothesis of Theorem Continuous partials imply differentiability fails: the partials exist everywhere but are not continuous at . Existence of partials is a statement along lines; differentiability is a statement about all directions at once, uniformly.
Theorem 8.125 (Symmetry of second derivatives). If and exist near and are continuous at , then .
Proof. Work in the plane and consider the second difference
Applying the Mean Value Theorem twice, first in then in , gives for some in the rectangle; applying it in the other order gives . Divide by and let : both , so continuity of the two mixed partials at forces the limits, hence the values at , to agree.∎
8.29The Chain Rule, Inverse and Implicit Function Theorems
Theorem 8.126 (Chain rule in several variables). Let be differentiable at and differentiable at , with . Then is differentiable at and
i.e. the Jacobian of a composite is the product of the Jacobians.
Proof. Write , , and define the error terms
with and . Put , so for small . Then
Now , and by the linear bound on . So the total error is , which is the definition of .∎
Theorem 8.127 (Inverse function theorem). Let be on an open and suppose is invertible. Then there are open and with a bijection, of class , and
Proof. Sketch; the fixed-point step is complete, the regularity of the inverse is outlined. Normalise , , by composing with the linear map and translating. Set ; a fixed point of is a solution of . Since is continuous and vanishes at , choose with on ; the mean value inequality then makes a contraction with constant , mapping into itself for . The Banach fixed-point theorem of Metric Spaces supplies a unique fixed point, giving a bijection onto an open set .
For regularity, the contraction estimate gives , so is Lipschitz, hence continuous; feeding that into the difference quotient and using invertibility of near shows is differentiable with the stated derivative, and the formula for the inverse of a matrix is continuous in its entries, so is .∎
Theorem 8.128 (Implicit function theorem). Let be near with , and suppose the block is invertible. Then there are neighbourhoods , and a unique map with and
Proof. Apply Theorem Inverse function theorem to , a map . Its Jacobian at is block triangular,
with determinant , hence invertible. So has a local inverse of the form , and satisfies . Differentiating that identity by Theorem Chain rule in several variables gives , i.e. the stated formula.∎
Example 8.129 (Implicit differentiation on a circle). The curve near : verify the hypotheses and compute there.
Solution.
- is with .
- , so Theorem Implicit function theorem applies and locally.
- , so .
- Check against the explicit solution : .
- At the hypothesis fails, , and indeed is not a function of there — the circle has a vertical tangent.
8.30Multiple Integrals, Fubini and Tonelli
Theorem 8.130 (Tonelli). Let , be -finite and measurable for the product -algebra. Then is measurable and
Proof. Sketch. For with in the product -algebra the statement is the definition of the product measure together with a monotone class argument: the collection of for which it holds contains measurable rectangles, is closed under increasing unions and proper differences by -finiteness, hence contains the generated -algebra. Linearity extends it to non-negative simple functions, and the Monotone Convergence Theorem of Lebesgue Integration extends it to all non-negative measurable by taking simple .∎
Theorem 8.131 (Fubini). With the same hypotheses, if then is in for -a.e. , the a.e.-defined function is in , and the iterated integrals both equal .
Proof. Apply Theorem Tonelli to : the iterated integral of is finite, so for -a.e. . Now split , both non-negative and dominated by , hence with finite iterated integrals. Tonelli applies to each, and subtracting the two identities gives the result; the subtraction is legitimate because both quantities are finite.∎
Pitfall. Tonelli needs but no integrability; Fubini needs integrability but no sign. Using Fubini without checking is the standard error, and it is not harmless. On with the two iterated integrals are and . Nothing is wrong with the theorems; , so neither applies. The safe order is always: Tonelli on first, Fubini on second.
Example 8.132 (An iterated integral over a triangle). Compute .
Solution.
- The inner integral has no elementary antiderivative, so swap the order. The region is .
- The integrand is positive and the region has finite measure, so Theorem Tonelli permits the swap with no further check.
- .
- Substituting : .
Proposition 8.133 (Volume of a region as an iterated integral). If is measurable, then , where is the slice.
Proof. Apply Theorem Tonelli to , noting .∎
8.31Change of Variables in Multiple Integrals
Theorem 8.134 (Change of variables). Let be a diffeomorphism between open subsets of . Then for every measurable on (and for every ),
Proof. Sketch; the key measure-theoretic estimate is stated rather than proved in full. The content is the special case , i.e.
For a linear this is the determinant's defining property: maps the unit cube to a parallelepiped of volume , and the formula extends to all measurable sets by translation-invariance and countable additivity. For a general diffeomorphism, cover by small cubes ; on each, with error , so and agree to relative error tending to as the cubes shrink. Summing over the cubes and passing to the limit, using uniform continuity of on compacts, gives the identity for ; monotone convergence then gives it for non-negative and linearity for . What is assumed is that the error terms can be controlled uniformly, which requires the Vitali covering machinery of the earlier part.∎
Corollary 8.135 (Polar and spherical coordinates). For on , . For , .
Proof. In two dimensions,
In three, expanding the Jacobian along the last row and using twice gives , which is non-negative for .∎
Example 8.137 (The Gaussian integral). Evaluate by squaring and changing to polar coordinates.
Solution.
- Let . Then , the product being legitimate by Theorem Tonelli since the integrand is positive.
- Change to polar by Corollary Polar and spherical coordinates: and .
- .
- Hence , taking the positive root since the integrand is positive.
- The whole trick is the factor : without it the substitution would not close.
Example 8.138 (Volume of a ball in spherical coordinates). Compute the volume of .
Solution.
- By Corollary Polar and spherical coordinates the element is , with , , .
- The integral factors: .
- These are , , and .
- Volume . For this is .
8.32Differential Forms, the Exterior Derivative, and Stokes' Theorem
The final result of the chapter unifies the fundamental theorem of calculus, Green's theorem, the divergence theorem and the classical Stokes theorem into a single line. The unification requires the right objects: differential forms, which are exactly the things that can be integrated over oriented -dimensional pieces.
Definition 8.139 (Differential -form and exterior derivative). A -form on an open is an expression
with smooth coefficients, where is associative, bilinear and alternating: , hence . The exterior derivative is
a -form.
Proposition 8.140 (). For every smooth form , .
Proof. By linearity it suffices to take . Then
The coefficient is symmetric in by Theorem Symmetry of second derivatives, while is antisymmetric. Pairing the and terms, each pair cancels, and the diagonal terms vanish because .∎
Theorem 8.141 (Stokes' theorem). Let be a compact oriented smooth -manifold with boundary carrying the induced orientation, and let be a smooth -form on . Then
Proof. Sketch; the machinery of partitions of unity and manifold charts is assumed. Using a partition of unity subordinate to a cover by charts, write with each supported in one chart; both sides are linear in , so it suffices to treat a single chart.
Two cases. If the chart is interior, has compact support in the open half-space's interior, and reduces to , which is by the one-variable fundamental theorem of Riemann Integration applied in the direction — the compact support kills both endpoint terms. And since vanishes near the boundary. If the chart meets the boundary, model it on the half-space ; the same one-variable computation now leaves exactly one surviving endpoint term, the value on , which is precisely . Orientation conventions are fixed so that the sign comes out .
What is assumed and not proved here: the existence of smooth partitions of unity, the invariance of under orientation-preserving changes of chart (which is Theorem Change of variables together with the transformation rule ), and the definition of the induced boundary orientation.∎
Corollary 8.142 (The classical theorems as special cases). Stokes' theorem specialises to: the Fundamental Theorem of Calculus (), Green's theorem ( in the plane), the classical Stokes/curl theorem ( in ), and the divergence theorem ( in ).
Proof. Each is a matter of writing out in coordinates. For , , a -form, , , and the theorem reads .
For Green, gives after cancelling the terms with a repeated or .
For the divergence theorem, gives , and is the flux . The curl theorem is the intermediate case.∎
Example 8.143 (Green's theorem computing an area). Use to compute the area enclosed by the ellipse , , .
Solution.
- , so is the area.
- By Theorem Stokes' theorem, the area equals .
- On the curve, and .
- So the integrand is , and the integral is .
- Check against .
Intuition. The pattern in every case is the same: measures how much a form fails to be "already a boundary value", and Stokes says the total of that failure inside equals what is seen on the edge. is the statement that a boundary has no boundary — the edge of a disc is a circle, and a circle has no endpoints. Every conservation law in physics is that identity in disguise.
- Assuming continuity implies bounded variation. is continuous on with infinite variation. Continuity bounds local oscillation; bounded variation bounds its total.
- Assuming bounded variation implies absolute continuity. The Cantor function is continuous, increasing and , yet climbs by with derivative a.e. Three separate proofs of its non-absolute-continuity appear above; all say the same thing — it manufactures measure on a null set.
- Using the fundamental theorem without checking absolute continuity. is equivalent to , not a consequence of existing a.e.
- Confusing uniform continuity with absolute continuity. Every continuous function on a compact interval is uniformly continuous; only some are absolutely continuous. The difference appears only when arbitrarily many disjoint intervals are allowed at once.
- Expecting when . The maximal function decays like at infinity and is never integrable unless . Weak type is the correct — and sharp — statement.
- Using non-conjugate exponents in Hölder. , so the conjugate of is , not . Homogeneity in and in pins the relation down uniquely.
- Assuming in general. The inclusion for needs ; on with counting measure the inclusion reverses; on neither holds.
- Believing convergence implies pointwise convergence. The typewriter sequence converges to in and at no point at all. Only a subsequence converges a.e.
- Applying the parallelogram law or orthogonal projection in , . Only has an inner product; the entire Fourier-basis argument is unavailable elsewhere.
- Forgetting that need not converge pointwise for continuous . The Dirichlet kernel's norms diverge like , and uniform boundedness turns that into a genuine counterexample. Use Fejér means if uniform convergence is needed.
- Thinking the Gibbs overshoot disappears with more terms. It does not: it stays at about of the jump and only moves closer to the discontinuity. Pointwise convergence and uniform convergence differ exactly here.
- Reading Parseval as pointwise equality. It is an identity between norms; it says nothing about the value of the series at any particular .
- Deducing differentiability from existence of partial derivatives. has both partials at the origin and is not even continuous there. Continuous partials are what suffice.
- Applying Fubini without checking . Use Tonelli on first. Two iterated integrals of over the unit square differ in sign.
- Dropping the absolute value or the Jacobian in the change of variables formula. The factor is ; the area element in polar coordinates is , and omitting is why appears intractable.