Contents / Real Analysis / Limits & Continuity
Chapter 3
Limits & Continuity
Limits of functions by epsilon-delta with the laws derived rather than quoted; the sequential characterisation of limits and continuity; the classification of discontinuities; uniform continuity, Lipschitz and Heine-Cantor; the Intermediate Value Theorem proved from completeness; and the Extreme Value Theorem with compactness, each hypothesis shown necessary by counterexample.
Introduction
The previous chapter built and established what a sequence does: convergence, the algebra of limits, the Cauchy criterion, and the least-upper-bound property that makes all of it work. A sequence, though, is a function on , and its index marches to infinity in one direction only. This chapter replaces that index by a real variable, which may approach a point from either side, from inside a gap in the domain, or from nowhere in particular, and it asks what survives.
Almost everything does, but three things genuinely change. The "index" can approach along infinitely many routes, so a limit is a statement about all of them at once — and the sequential characterisation proved below is the bridge that lets us borrow sequence theorems. The point is one where may or may not be defined, and whether agrees with is no longer automatic: that agreement is continuity. And because ranges over a set rather than a list, the same - promise can be demanded uniformly over that set, which turns out to depend on the shape of the set rather than on the function.
The chapter has five movements: the - definition and the limit laws proved from it; continuity and its sequential characterisation, which does most of the real work; uniform continuity and the Heine–Cantor theorem, the first place compactness pays for itself; the Intermediate Value Theorem, which is the completeness of in disguise; and the Extreme Value Theorem, which is compactness in disguise. In each of the last two, the counterexample that appears the moment a hypothesis is dropped is exhibited alongside the proof.
Notation is fixed once. Throughout, and are real-valued functions on a set , the letter denotes a limit point of , and , denote candidate limits. The results Triangle inequality and Upper bound, supremum, infimum from The Real Number System are used without comment, as are Uniqueness of limits, the Squeeze Theorem and the Cauchy criterion for sequences from Sequences and Series. The Bolzano–Weierstrass theorem — every bounded real sequence has a convergent subsequence — is likewise taken as proved there.
3.1Approaching a point: one-sided limits
The informal sentence is: when can be made as close to as we please by taking close enough to , but not equal to . That last clause is the whole reason limits are worth having — the derivative is a limit of difference quotients undefined at the point in question. Before making the sentence precise it pays to split it, since approaching from the left and from the right are different experiments and a function may pass one and fail the other.
Definition 3.1 (One-sided limits). Let be defined on an interval to the left of . Then means: for every there is such that
The right-hand limit is the same statement with .
Each one-sided limit ignores half the picture on purpose: the left-hand limit is computed from the values of strictly below and nothing else — not from , not from anything to the right. The two-sided limit is exactly the conjunction of the two.
Theorem 3.2 (Two-sided limits from one-sided limits). Suppose is defined on a punctured interval around . Then if and only if both one-sided limits exist and
Proof. Suppose first that , and let . The two-sided definition supplies with whenever . The condition implies , so the same witnesses the left-hand limit; the condition likewise implies , so it witnesses the right-hand one. Both one-sided limits therefore exist and equal .
Conversely, suppose both one-sided limits equal , and let . Choose from the left-hand definition and from the right-hand one, and set — a minimum of two positive numbers is positive, which is the only reason this step is legal. If then , so either or , and in both cases the corresponding one-sided estimate gives .∎
The theorem earns its keep in the contrapositive: to show a limit fails to exist, produce the two one-sided limits and observe that they disagree. That is a finite piece of work, whereas verifying "no satisfies the definition" directly would be an argument about every real number at once.
Intuition. Walk toward the point along the -axis and watch the height of the graph. If the heights settle on a single number whichever direction you come from, that number is the limit. The height at is not part of the experiment — the function may be undefined there, or defined with an entirely unrelated value, and neither affects the answer.
Example 3.3 (A limit that exists where the function does not). Find , noting that the expression is undefined at .
Solution.
- Factor the numerator: , so the quotient is .
- Cancel. The cancellation is legitimate precisely because the limit never evaluates at : for every in a punctured neighbourhood of we have , and there the function is literally equal to .
- Two functions that agree on a punctured neighbourhood of have the same limit at , since the definition only ever inspects such a neighbourhood. So the limit is .
- Sanity check: and , bracketing symmetrically. The limit is although does not exist — a removable discontinuity, since defining would repair it and nothing else needs changing.
A second example shows the theorem doing its destructive work. For , defined for , we have identically on and identically on , so the one-sided limits at are and . They exist but disagree, so by the theorem Two-sided limits from one-sided limits the two-sided limit does not exist — and note that this rules out every candidate at once, since no number is within of both and . This is a jump discontinuity, and unlike the previous one no redefinition at repairs it.
3.2The precise - definition
The phrase "as close as we please" hides a game between two players, and the definition is nothing but a transcript of that game with the moves in a fixed order.
Definition 3.5 (Limit of a function). means: for every there exists such that
Two features of the ordering carry all the content. The is quantified first, so may depend on it — and normally must. The variable is quantified last, inside the implication, so may not depend on : one serves the whole punctured neighbourhood. A "proof" producing a that still mentions has proved nothing, and that is the single most common error in a first course. The clause excludes itself, which is what made the previous section's cancellation legal; nothing demands that be defined at , or that be near .
Intuition. Think of as a horizontal band of half-width drawn around the height , and as a vertical strip of half-width drawn around . Your opponent picks the band, as narrow as they like; you must answer with a strip so narrow that the whole graph inside it — with the single point above deleted — lies inside the band. You lose if there is any for which no strip works.
Example 3.6 (Two limits from the definition). Prove from the definition that (a) , and (b) .
Solution.
- (a) Scratch work, which is where is discovered and which is not itself the proof. We need ; simplifying, , so the requirement is .
- The proof, written forwards. Let be given and put . If then . Since was arbitrary, the limit is . With the recipe gives ; the linear relation records that a slope- map doubles input errors.
- (b) The quadratic case is harder because is not a constant multiple of . Factor: , where the first factor is controlled and the second is a nuisance depending on .
- Pre-restrict. Insist from the outset that . Then gives , hence and , so on that neighbourhood .
- To force it suffices that , so both constraints hold at once for
- Verification: if then , making the bound available, and , so .
- Sanity check with : , and gives , so . The estimate is not tight, and need not be — has only to be positive and adequate.
- Repeating step 4 at a general base point instead of gives , which proves for every — and which visibly shrinks as grows. No single serves every base point, a defect the section Uniform continuity: moving the quantifier is entirely about.
The linear case is easy because is an exact constant multiple of . The moment is not linear, the factor multiplying itself depends on , and a second idea is needed: restrict in advance so that the nuisance factor is bounded, then shrink further.
Example 3.7 (A quadratic limit, and the "restrict first" device). Prove .
Solution.
- Factor the target: . The first factor is the one we control directly; the second is the nuisance.
- Pre-restrict. Insist from the outset that . Then gives , hence and so . On that neighbourhood, .
- Now finish as in the linear case: to force it suffices that . Both constraints hold at once if we take
- Verification. Let and take this . If then , so the bound is available, and , so .
- Sanity check with : , and gives , so . The estimate is not tight — never has to be the largest that works, only positive and adequate.
3.3Infinite limits, limits at infinity, and the laws in outline
Two more variants of the definition cover the cases where either the output or the input is allowed to run off the end of the line. Neither introduces a new idea: each replaces one of the two tolerances by a threshold to be beaten.
Definition 3.9 (Infinite limits and limits at infinity). means that for every there is with
and symmetrically for . Separately, means that for every there is with
Notation. Writing is a statement of a particular way of failing to converge, not a claim that the limit exists as a real number. When a text says "the limit does not exist" of at it is not contradicting the display above; it is declining to work in the extended reals. We will use the symbol freely and say "diverges to " when precision matters.
The limit laws are the reason nobody computes limits from the definition in practice. They are collected here as a single statement and then proved one at a time in the section Proving the limit laws, because each proof is a distinct technique worth owning.
The limit laws are the reason nobody computes limits from the definition in practice: sums, products, quotients and constant multiples of convergent functions converge to the corresponding combination of the limits. Each is proved from the - definition in the section Proving the limit laws — the sum in the theorem Sum rule for limits, the product in Product rule for limits, the quotient in Quotient rule for limits — and the constant multiple is the product rule applied with the constant function, whose limit is that constant because for every whatsoever.
A remark on the hypotheses, which are stronger than they look. The laws require both limits to exist before they say anything about the combination, and the converse direction is false: and have no limits at , yet is identically zero and converges perfectly well. Knowing that a sum converges tells you nothing about the summands.
Example 3.10 (An infinite limit from the definition). Prove .
Solution.
- Unpack the goal: given an arbitrary threshold , we must force for all close enough to on the right.
- Solve the target inequality. For , , the direction of the inequality reversing because both sides are positive.
- Choose . If then , hence .
- Sanity check: to beat the recipe gives , and every in indeed has . Note that the two-sided limit is not : approaching from the left gives .
The laws also settle limits at infinity by the standard device of dividing by the highest power. For instance
legitimately for ; the facts and are immediate from the definition with and , so the numerator tends to and the denominator to . The quotient law applies because that denominator limit is nonzero, giving the value . At the expression is , approaching from above as the term predicts.
3.4The definition in full, and what it forces
Written with every quantifier explicit and the domain named, the definition reads as follows. This is the form to check an argument against when something feels wrong.
Definition 3.11 (The - definition of a limit). Let and let be a limit point of . Then if and only if
Definition 3.12 (Limit point). A point is a limit point of if every punctured neighbourhood of meets : for every there is some with .
The limit-point hypothesis is not decoration. If were isolated in — say and — then makes the antecedent false for every , so the implication holds vacuously for every and "the limit" would be simultaneously , and . Requiring to be a limit point rules that out, and the next theorem is the pay-off.
Theorem 3.13 (Uniqueness of the limit). If is a limit point of and and , then .
Proof. Suppose and put . Applying the definition twice gives with whenever and , and with under the corresponding condition. Let .
Because is a limit point of , there exists at least one with — this is the only place the hypothesis is used, and without it the argument would have no point at which to evaluate . For that both estimates hold, so by the triangle inequality
which asserts , a contradiction. Hence .∎
That argument is the function-limit twin of Uniqueness of limits for sequences, and the proof is verbatim the same once "for all " becomes "for all with ". The next theorem explains why: the two notions are interchangeable.
Theorem 3.14 (Sequential characterisation of limits). Let be a limit point of . Then if and only if for every sequence in with we have .
Proof. () Assume the limit is and let be such a sequence. Given , take from the definition of the limit, then take from the convergence so that for all . Since , we have for those , hence . As was arbitrary, .
() We prove the contrapositive. Suppose fails. Negating the definition, there is some such that no works: for every there is with and . Apply this with for each and call the resulting point . Then and , so ; but for every , so . This exhibits a sequence violating the right-hand condition, which is what the contrapositive required.∎
The device in the second half — feed to a failed - statement and harvest a sequence — recurs three more times below, and each time it converts a negated quantifier statement into a concrete object that is far easier to argue with.
Read in contrapositive form, that equivalence is a divergence test: if two sequences and in give and different limits, then no can satisfy the definition, since the forward direction would force both to equal and Uniqueness of limits for sequences forbids that.
Example 3.15 (Divergence by two routes). Show that does not exist.
Solution.
- First route, chosen to make the sine vanish: is nonzero and tends to , with , so .
- Second route, chosen to make it equal : , again nonzero and tending to , with , so .
- The route-limits and differ, so by the theorem Sequential characterisation of limits no limit exists.
- Sanity check: is bounded, so this is not a blow-up — the function completes infinitely many oscillations in every neighbourhood of , hitting every value of infinitely often. It is the standard essential (oscillatory) discontinuity.
3.5Strategies for proving a limit from the definition
There are only four moves, and every - exercise in a first course is some combination of them.
Method 3.16 (Proving a limit from the definition).
- Factor out . Manipulate into the form (something) .
- Pre-restrict to some convenient bound, usually , so that the "something" is bounded by a constant on that neighbourhood.
- Solve , giving .
- For quotients, bound the denominator away from zero on a small neighbourhood first, so that dividing by it does not destroy the estimate.
Step 4 is the one with real content, and it deserves a statement of its own because the same fact is needed again when we prove the quotient law.
Lemma 3.17 (A nonzero limit keeps the function away from zero). If , then there is such that
Proof. Apply the definition of the limit with the particular tolerance , which is positive because . It supplies with whenever . By the reverse triangle inequality,
Proposition 3.18 (Local boundedness). If exists and is finite, then is bounded on some punctured neighbourhood of : there are and with whenever .
Proof. Apply the definition with to get such that on the punctured -neighbourhood. Then there, so works.∎
Local boundedness is why a convergent function cannot oscillate with growing amplitude near , and it is what makes the product rule's stray factor manageable — all for one application of the definition at a fixed tolerance.
Example 3.19 (Squeezing an oscillation). Prove , even though itself has no limit at .
Solution.
- Bound the bad factor: for every , whatever happens to be. Hence .
- Let and put . If then .
- Sanity check: at the factor lies in , so the product is at most in absolute value however wild the oscillation. The Squeeze Theorem applied to gives the same conclusion.
- Note the contrast with the previous example: multiplying an unbounded oscillation by a factor tending to zero repairs it. The oscillation is still infinitely rapid; it is the amplitude that the definition sees.
Step 4 of the recipe is what the lemma above is for. To prove , write ; the nuisance factor blows up at , so pre-restrict , whence , and . Then finishes it. Sanity check at : and the worst point gives — worst because is largest at the left end, which is exactly why the bound was the binding one.
Pitfall. A that still contains is not a . If your scratch work ends at " ", you have not finished: the quantifier order forbids from depending on . The fix is always step 2 of the recipe — bound the offending factor by a constant on a pre-restricted neighbourhood, then use that constant.
3.6Proving the limit laws
Each law is proved from the definition. Read them as a catalogue of techniques: splitting the error budget, adding and subtracting a convenient term, and bounding a denominator.
Theorem 3.20 (Sum rule for limits). If and then .
Proof. Let . Since the two limits exist, apply each definition with the tolerance : there are with
Put . For both estimates hold at once, so by the triangle inequality
Nothing forces the split to be even — and serve equally. What matters is that the pieces are positive and sum to at most , so each limit can be invoked at a tolerance of its own.
Theorem 3.21 (Product rule for limits). If and then .
Proof. The difference does not obviously split, so manufacture a split by adding and subtracting :
whence .
The stray factor is handled by the proposition Local boundedness: there is and a constant with for .
Now allocate. Let . Choose so that on the punctured -neighbourhood, and so that on the punctured -neighbourhood; the in the denominator costs nothing and covers the case , where dividing by would be illegal. Set . For all three estimates hold simultaneously, and
Theorem 3.22 (Quotient rule for limits). If and with , then .
Proof. By the theorem Product rule for limits it suffices to prove the special case and then multiply by . So consider
The danger is the factor , and the lemma A nonzero limit keeps the function away from zero removes it: there is with on the punctured -neighbourhood, so there
Given , choose so that on the punctured -neighbourhood, and put . Then for ,
Finally , and the product rule gives . Note that the hypothesis was used twice: once to make a legal tolerance, and once to divide by .∎
Theorem 3.23 (Squeeze theorem for functions). Suppose for all in some punctured neighbourhood of , and . Then .
Proof. Let , and let be a radius on which the inequalities hold. Choose so that and on the respective punctured neighbourhoods, and set . For all three conditions hold, so
which is exactly .∎
The squeeze theorem is the only law that concludes existence from an inequality rather than from other limits, which makes it the tool of choice when itself is too unruly to estimate — as with , or , whose classical proof squeezes the ratio between and .
Pitfall. "Substitute the inner limit" is not a theorem. If and , the composite need not tend to : take identically and for with . Then and , yet for every . The composition law needs a side condition — either near , or continuous at — and the second is the one that always holds in practice, which is why composition is stated for continuous functions in the theorem Continuity of compositions.
3.7Continuity at a point
Continuity is the assertion that the limit and the value agree. Everything technical is already in place; what is new is that the point is no longer excluded, and the number is no longer free to be chosen — it is forced to be .
Definition 3.24 (Continuity at a point). Let and . Then is continuous at if for every there is such that
Three differences from the limit definition matter. The point must belong to , since appears in the conclusion. The condition has become , admitting — harmless, since there the conclusion reads . And need not be a limit point: at an isolated point of the definition holds vacuously, so every function is continuous at an isolated point of its domain.
Proposition 3.25 (Continuity as a limit). If is a limit point of , then is continuous at if and only if exists and equals .
Proof. () Suppose is continuous at and let ; take the from the definition. Any with in particular satisfies , so . That is the limit definition with .
() Suppose the limit exists and equals , and let with corresponding . For with there are two cases: if then and the limit estimate gives ; if then . Either way the continuity condition holds.∎
Intuition. Continuity says three separate things at once, and a discontinuity is a failure of any one of them: must be defined, must exist, and the two must be equal. Checking a suspicious point means checking all three in that order — most textbook "discontinuities" fail at the second, and the interesting ones fail only at the third.
Theorem 3.26 (Algebra of continuous functions). If and are continuous at , then so are , and for any constant ; and is continuous at provided .
Proof. If is isolated in the common domain there is nothing to prove, since every function is continuous there. Otherwise is a limit point, and by the proposition Continuity as a limit we have and . The theorem Limit laws then gives
and likewise for . For the quotient, the hypothesis is exactly the nonvanishing required by Quotient rule for limits, and it gives . In each case the limit equals the value, which by Continuity as a limit read backwards is continuity at .∎
Example 3.27 (A function continuous at exactly one point). Let for rational and for irrational. Determine where is continuous.
Solution.
- At : for any , is either or , so , and works. So is continuous at .
- At any : take rationals and irrationals , both available by density. Then while , and these differ because , so by the theorem Sequential characterisation of limits no limit exists at and continuity fails.
- Sanity check: the two branches of — the line and the line — meet at exactly one point, and that is exactly where continuity survives. A function can be continuous at a single point and nowhere else, so continuity at says nothing whatever about a neighbourhood of .
3.8Continuity on a set, and how continuous functions are built
Definition 3.28 (Continuity on a set). is continuous on if it is continuous at every point of . It is continuous if it is continuous at every point of its domain.
Almost every function one writes down is continuous, and the reason is not luck: the constants and the identity are continuous, and the building operations preserve continuity. Two results make this precise, covering polynomials, rational functions, and any composite of them.
Theorem 3.29 (Continuity of compositions). If is continuous at and is continuous at , then is continuous at .
Proof. Write and let . Continuity of at supplies such that implies , for in the domain of . Continuity of at , applied with tolerance , supplies such that implies .
Chaining the two: if then satisfies , hence .∎
Compare this with the pitfall about substituting an inner limit, which required an awkward side condition. Here there is none, and the reason is visible in the proof: we never needed , because continuity of at covers as well. Continuity is precisely the hypothesis that makes composition unconditional.
Proposition 3.30 (Polynomials and rational functions are continuous). Every polynomial is continuous on , and every rational function is continuous at every point where does not vanish.
Proof. The constant function is continuous everywhere, since for any ; the identity is continuous everywhere, since works. A monomial is a finite product of these, hence continuous by the theorem Algebra of continuous functions applied times, and a polynomial is a finite sum of monomials, hence continuous by the same theorem. For a rational function, apply the quotient clause of that theorem at each point where the denominator is nonzero.∎
Example 3.31 (Continuity of a rational function, and the point where it fails). Determine where is continuous, and classify the failure.
Solution.
- Numerator and denominator are polynomials, continuous on , and the quotient clause of Polynomials and rational functions are continuous applies wherever , so is continuous at every .
- At the function is undefined, so continuity is not merely false but meaningless. The limit does not exist either: the numerator tends to while the denominator tends to , so — concretely and .
- Sanity check: the discontinuity is infinite, not removable, since no finite value assigned at is close to both and .
Composition then covers everything else one writes down. To see that is continuous on , write with , a polynomial, and , which is continuous at every because , so works. Since everywhere, the theorem Continuity of compositions applies at every point.
3.9The sequential characterisation, and a taxonomy of discontinuities
The most useful reformulation of continuity trades quantifiers for sequences: it makes disproving continuity a matter of exhibiting one badly behaved sequence, and it imports every theorem about sequences wholesale.
Theorem 3.32 (Sequential characterisation of continuity). Let and . Then is continuous at if and only if for every sequence in with we have .
Proof. () Assume continuity at and let in . Given , take from the definition of continuity and then with for . For such , . Hence . Observe that, unlike in Sequential characterisation of limits, no clause is needed, because continuity covers .
() Contrapositive. Suppose is not continuous at . Negating the definition gives such that for every there is with and . Take and let be such a point. Then and , so , while for every , so . This sequence witnesses the failure of the right-hand condition.∎
Definition 3.33 (Classification of discontinuities). Let fail to be continuous at , an interior point of an interval in its domain. The discontinuity is
- removable if exists but either differs from or is undefined;
- a jump (discontinuity of the first kind) if both one-sided limits exist and are finite but differ;
- essential (of the second kind) if at least one one-sided limit fails to exist as a finite number — because the function blows up, or oscillates without settling.
The names are honest. A removable discontinuity is repaired by redefining a single value; a jump cannot be repaired by any redefinition, though the function is still tame on each side; an essential discontinuity means at least one side has no limiting behaviour at all. The trichotomy is exhaustive: either both one-sided limits exist finitely — agreeing, hence removable, or disagreeing, hence a jump — or one does not, which is the essential case.
Theorem 3.34 (Monotone functions have only jump discontinuities). Let be increasing on an interval and let be an interior point. Then both one-sided limits exist at , with
Consequently every discontinuity of a monotone function is a jump.
Proof. Consider the set . It is nonempty since is interior, and bounded above by because is increasing. By the least-upper-bound property of — the definition Upper bound, supremum, infimum — the number exists and satisfies .
We claim . Let . By the characterisation of the supremum, is not an upper bound of , so there is with . Put . For any with we have , so monotonicity gives , hence .
The right-hand statement is the same argument applied to , which is bounded below by , with the infimum in place of the supremum. Both one-sided limits therefore exist and are finite, so no essential discontinuity is possible; and if they are equal then, being sandwiched around , they both equal and is continuous there. So a discontinuity forces the two to differ, which is a jump.∎
A short extra argument turns that into a striking finiteness statement: distinct discontinuities of an increasing carry disjoint open jump-intervals, so choosing one rational from each injects them into , and a monotone function therefore has at most countably many discontinuities.
Example 3.35 (Thomae's function). Define for irrational and for a rational written in lowest terms with (so ). Show that is continuous at every irrational and discontinuous at every rational.
Solution.
- Discontinuity at a rational . Take irrationals , available by density. Then while , so by the theorem Sequential characterisation of continuity is discontinuous at .
- Continuity at an irrational . Let and choose with . The rationals in with denominator at most are finitely many, and none equals . Let be less than and less than the distance from to each of them — a minimum of finitely many positive numbers is positive, which is the crux.
- Take any with . If is irrational, . If is rational then by the choice of its denominator exceeds , so .
- Sanity check on the asymmetry: near any point there are rationals with huge denominators and hence tiny values, so the irrational value is approachable from everywhere, while a rational's own value is isolated in the surrounding sea of near-zeros.
Example 3.36 (Classifying three discontinuities at the origin). Classify the discontinuity at of (a) with , (b) , and (c) with .
Solution.
- (a) exists but the assigned value is ; both one-sided limits exist and agree, so the discontinuity is removable and redefining repairs it.
- (b) and both exist finitely and differ, so this is a jump of size , repairable by no redefinition — consistent with Monotone functions have only jump discontinuities, the floor function being increasing.
- (c) By the example Divergence by two routes neither one-sided limit of exists at , so the discontinuity is essential, of oscillatory type.
- Sanity check: the three cases are distinguished purely by the one-sided limits — both exist and agree, both exist and differ, or one fails — and (a), (b), (c) realise them in order.
3.10Uniform continuity: moving the quantifier
The whole content of this section is the position of a single quantifier. Continuity on a set is asserted point by point, so the that works at one point need not work at another; uniform continuity demands one for the entire set.
Definition 3.37 (Pointwise continuity on a set, in full). is continuous on if
The point is named before is chosen, so may depend on as well as on .
Definition 3.38 (Uniform continuity). is uniformly continuous on if
Here is chosen before any point of is named, so it may depend on (and on and ) alone.
Uniform continuity implies ordinary continuity on , and the proof is one line: given and , take the uniform and apply the condition to the pair . The converse is false, as the example One failure and one success shows with on .
To disprove uniform continuity one negates the definition; the negated form is what every counterexample actually verifies.
Proposition 3.39 (Negation of uniform continuity). fails to be uniformly continuous on if and only if there exist and sequences in with
Proof. () If uniform continuity fails, there is such that no works. Apply this to : there are with and . The first condition forces .
() Conversely, given such sequences, no can work for : choose with , which is possible since ; the pair then satisfies the hypothesis of the implication but violates its conclusion.∎
Proposition 3.40 (Lipschitz implies uniformly continuous). If there is with for all , then is uniformly continuous on . The converse is false.
Proof. Given , put , which depends on nothing but and . If then .
For the converse, on is uniformly continuous by the example One failure and one success below, yet no can satisfy the Lipschitz condition: taking and gives , which is unbounded.∎
Example 3.41 (One failure and one success). (a) Show is continuous on but not uniformly continuous there. (b) Show is uniformly continuous on the equally unbounded .
Solution.
- (a) Continuity came from the example Two limits from the definition, whose last step gave — a formula already carrying the warning, since it tends to as .
- Apply the proposition Negation of uniform continuity with and the sequences , . The separation vanishes, , but the image separation does not:
- So no works for . The mechanism is visible in : on the amplification factor is unbounded.
- (b) The key algebraic fact is for . Assuming , we have , valid because ; take square roots.
- Given put , which mentions no point. If then .
- Sanity check on the contrast: an unbounded domain does not by itself destroy uniform continuity. What destroys it is unbounded amplification of separations, and the square root compresses rather than amplifies. Note too that is uniformly continuous without being Lipschitz — from and the ratio equals , which is unbounded — so the proposition Lipschitz implies uniformly continuous runs in one direction only.
3.11Heine–Cantor: compactness buys uniformity
On or on the two notions genuinely differ. On a closed bounded interval they coincide, and the reason is compactness — the same property that drives the Extreme Value Theorem below.
Theorem 3.42 (Heine–Cantor). Let be closed and bounded and let be continuous. Then is uniformly continuous on .
Proof. Suppose not. By the proposition Negation of uniform continuity there are and sequences in with and
Since is bounded, the sequence is bounded, so by Bolzano–Weierstrass it has a convergent subsequence . Since is closed and every lies in , the limit lies in too — this is where closedness is used, and without it could escape the set and continuity at would be unavailable.
The matching subsequence of converges to the same point:
Now apply the theorem Sequential characterisation of continuity at the point to both subsequences: and . Hence
so the left-hand side is eventually smaller than , contradicting , which asserted it is at least for every index. Therefore is uniformly continuous.∎
Neither hypothesis is decorative: boundedness produced the convergent subsequence, closedness kept its limit inside where is continuous. Drop boundedness and on is a counterexample; drop closedness and on is one.
Example 3.43 (Heine–Cantor made explicit). Verify by an explicit that , not uniformly continuous on , is uniformly continuous on .
Solution.
- The abstract route takes one line: is closed and bounded and is continuous on it, so Heine–Cantor applies, with no computation at all.
- The explicit route shows why. For , since , so works and mentions no point of the interval.
- Sanity check: with we get , and the worst pair sits at the right end, , : . The bound is essentially attained, confirming that is the binding constraint.
- The moral: capping the domain caps the amplification factor. Here is in fact Lipschitz with , so Lipschitz implies uniformly continuous gives the conclusion a third way.
3.12The Cauchy criterion and continuous extension
Uniform continuity has a second characterisation, in terms of what the function does to Cauchy sequences, and it explains why uniformly continuous maps extend to the closure of their domain while merely continuous ones need not.
Theorem 3.44 (Cauchy-sequence criterion). If is uniformly continuous on , then maps every Cauchy sequence in to a Cauchy sequence in .
Proof. Let be Cauchy in and let . Uniform continuity supplies such that implies for all . Since is Cauchy, there is with for all . For such , applying the uniform condition to the pair gives . Hence is Cauchy.∎
Note what the proof needed: one good for the pair , neither member being a fixed point of the domain. Ordinary continuity attaches its to a point, and a Cauchy sequence need not have its limit in — so there may be no point to attach it to. That is the gap the next example exploits.
Corollary 3.45 (Extension from a dense subset). Let and let be uniformly continuous. Then extends uniquely to a continuous function on the closure , and is uniformly continuous.
Proof. Let and choose with . A convergent sequence is Cauchy, so by the theorem Cauchy-sequence criterion the image is Cauchy in , hence convergent by the completeness of — the Cauchy criterion of the previous chapter. Define .
Well defined. If is another such sequence, interleave them into , which also converges to ; its image is Cauchy by the same theorem, hence convergent, and a convergent sequence has all subsequences converging to the same value. So .
Extends . If , take the constant sequence to get .
Uniformly continuous. Let and take from the uniform continuity of for the tolerance . Let with , and pick with , , and , all possible by the construction of . Then , so and
Unique. Any continuous extension must satisfy for in , by Sequential characterisation of continuity.∎
Example 3.46 (One function that extends and two that do not). On consider , and . Decide in each case whether the function is uniformly continuous and whether it extends continuously to .
Solution.
- . Take , which converges in to and hence is Cauchy — even though its limit lies outside the domain, which is the whole point. Its image is unbounded and so not Cauchy, so by the theorem Cauchy-sequence criterion is not uniformly continuous and no continuous extension to exists.
- The direct route agrees: , give while always, matching Negation of uniform continuity at .
- . By the example Divergence by two routes the limit at does not exist, so no value at extends it continuously. Interleaving the Cauchy sequences and gives a Cauchy sequence whose image oscillates between and , so is not uniformly continuous either — which the corollary Extension from a dense subset, read in contrapositive, already predicted.
- . By the example Squeezing an oscillation, . Setting gives a function whose limit at equals its value, hence continuous there by Continuity as a limit and elsewhere by the algebra and composition theorems.
- Since is closed and bounded, Heine–Cantor makes uniformly continuous, so was uniformly continuous on all along. Sanity check: is bounded but not closed, so Heine–Cantor applied to none of the three directly — the compactness had to be manufactured by filling the missing endpoint, which only permitted.
3.13The Intermediate Value Theorem
The first of the two great theorems about continuous functions on a closed bounded interval says that such a function cannot get from one value to another without passing through everything in between. It sounds obvious, and it is false over — so whatever makes it true is a property of , not of continuity alone.
Theorem 3.47 (Intermediate Value Theorem). Let be continuous on and let lie strictly between and . Then there exists with .
Proof. Assume ; the other case follows by applying this one to and . Define
is nonempty, since puts , and bounded above by . By the least-upper-bound property of , exists, and .
We rule out and in turn, each time using continuity at with a tolerance chosen to keep on one side of .
Suppose . Apply continuity at with : there is such that and imply , hence . Since forces , the interval is nonempty and every point in it satisfies , so with — contradicting that is an upper bound for .
Suppose instead . Apply continuity at with , getting with for all within of . Since forces , the interval meets and contains no point of . Hence (or , whichever is larger) is an upper bound for strictly smaller than , contradicting that is the least upper bound.
Both alternatives are impossible, so . Finally and because , so .∎
Completeness entered at exactly one word: . Over the set has no least upper bound, and the theorem is genuinely false there — is continuous on with , yet no rational has , by Irrationality of the square root of two. The Intermediate Value Theorem is the least-upper-bound property wearing a disguise.
Intuition. Think of as the set of inputs at which the function is still at or below the level , and as the last such input. Just to the right of the function has committed to being above ; just to the left it was still at or below. Continuity forbids it from making that switch by a jump, so at itself it must be sitting exactly on the level.
Example 3.48 (Existence of a square root of 2). Use the Intermediate Value Theorem to prove that some positive real satisfies .
Solution.
- Let , continuous on by Polynomials and rational functions are continuous, with straddling the level .
- By the Intermediate Value Theorem there is with , that is .
- Sanity check: and , so , consistent with . Note what has been delivered — existence, nothing more, since the proof located as a supremum rather than computing it. Digits are the business of the bisection method below.
3.14Consequences of the Intermediate Value Theorem
Corollary 3.50 (Continuous images of intervals are intervals). If is an interval and is continuous on , then is an interval.
Proof. A set is an interval precisely when it contains every point between any two of its points. So take with , say and with . The closed interval with endpoints and lies inside , because is an interval, and is continuous on it. By the theorem Intermediate Value Theorem applied on that interval, there is between and with , so .∎
Corollary 3.51 (Odd-degree polynomials have a real root). Every polynomial of odd degree with real coefficients has a real root.
Proof. Let with odd and ; replacing by if necessary, assume . Writing , the bracket tends to as , so for large enough the bracket exceeds and has the sign of . Because is odd, for large positive and for large negative . Choose with and with . Then is continuous on and , so the Intermediate Value Theorem supplies with .∎
The parity hypothesis does real work: has even degree and no real root, since for even the leading term has the same sign at both ends.
Corollary 3.52 (One-dimensional fixed point theorem). If is continuous, then has a fixed point: some with .
Proof. Let , continuous on by the theorem Algebra of continuous functions. Since maps into we have and , so and .
If then is a fixed point; if then is. Otherwise , and the Intermediate Value Theorem applied to on with gives with , that is .∎
Method 3.53 (The bisection method).
- Find with and of opposite signs; the Intermediate Value Theorem now guarantees a root in .
- Evaluate at the midpoint .
- Replace by whichever half still shows a sign change.
- Repeat. After steps the root is trapped in an interval of length .
Example 3.54 (Bisection in action). Locate the root of to within .
Solution.
- Bracket: and , so the Intermediate Value Theorem puts a root in .
- , so the sign change moves to ; , so it moves to ; , so the root lies in , of length .
- Sanity check: the true root is , indeed inside . Each step halves the bracket, so the error after steps is at most — about three steps per decimal digit. The method needs only sign changes and continuity, never a derivative.
3.15Why continuity cannot be dropped
The Intermediate Value Theorem has two hypotheses — continuity and an interval domain — and each fails loudly when removed. This section isolates the first.
Example 3.55 (A jump skips every intermediate value). Define on by for and for . Show that no has , although .
Solution.
- The endpoint values straddle : . But the image of is the two-point set , so no value strictly between is attained and for every .
- Which hypothesis broke: is a perfectly good interval, so it is continuity. The one-sided limits at are and , so jumps there and is discontinuous at and nowhere else.
- Sanity check by exhaustion: gives ; gives . Note also that is not an interval, exactly the failure predicted by the corollary Continuous images of intervals are intervals read backwards.
Remark (A function that misses everything in between). The Dirichlet function for and otherwise is discontinuous at every point: by density there are rationals and irrationals with and , and since is one of one of these contradicts the theorem Sequential characterisation of continuity. Its image on is the two-point set , so it attains and and nothing between.
Note what nevertheless does satisfy: it is bounded on a compact interval and it attains both a maximum and a minimum, so the conclusion of the Extreme Value Theorem happens to hold for it. Attainment of extrema and the intermediate value property are logically independent consequences of continuity, and a discontinuous function may satisfy either without the other.
Remark (The converse fails too). Having the intermediate value property does not imply continuity. The function with takes every value in on every interval around , so it maps intervals onto intervals, yet it is discontinuous at by the example Classifying three discontinuities at the origin. A deeper example is Darboux's theorem: every derivative has the intermediate value property, even when the derivative is discontinuous — the function of Differentiation being the standard instance. So "takes all intermediate values" is strictly weaker than "continuous".
3.16The Extreme Value Theorem: statement
The second great theorem is about attainment. A continuous function on a closed bounded interval does not merely have a finite supremum; it actually reaches it.
Theorem 3.56 (Boundedness theorem). If is continuous on , then is bounded on .
Proof. Suppose were unbounded. Then for each there is with . The sequence lies in the bounded set , so Bolzano–Weierstrass gives a convergent subsequence , and because is closed.
By the theorem Sequential characterisation of continuity, . A convergent sequence is bounded, so is bounded; but for every , which is unbounded. Contradiction.∎
Theorem 3.57 (Extreme Value Theorem). If is continuous on the closed bounded interval , then there exist with
The theorem asserts two things that must be kept apart. That and are finite is the Boundedness theorem; that they are attained is the new content, and it is exactly the part that fails on an open interval. Combined with Continuous images of intervals are intervals this sharpens to: is precisely the closed bounded interval .
A concrete instance keeps the two claims apart. On the function is continuous and the interval is closed and bounded, so extrema exist; and indeed with equality at the interior point , while gives with equality at both endpoints. So , , and the image is exactly . Note that the maximum lives at the endpoints rather than at an interior critical point: searching only where the derivative vanishes would have found the minimum and missed the maximum entirely.
3.17Proving the Extreme Value Theorem from completeness
Proof. We prove that the supremum is attained; the infimum follows by applying the result to , whose supremum is .
By the theorem Boundedness theorem, the image is a bounded nonempty set of reals, so by the least-upper-bound property exists and is finite.
By the characterisation of the supremum — for each , the number is not an upper bound — there is with
By Bolzano–Weierstrass the bounded sequence has a convergent subsequence , and since is closed.
Two facts now collide. On one hand, the Squeeze Theorem applied to gives . On the other, the theorem Sequential characterisation of continuity at gives . By uniqueness of sequential limits, , so the supremum is attained at .∎
Three ingredients did the work and each is indispensable: the least-upper-bound property manufactured the target ; Bolzano–Weierstrass, itself a consequence of completeness, stopped the near-optimal points escaping; continuity carried the values along with the points. Remove completeness and even the first step fails — over the continuous on is unbounded, its pole sitting at an irrational point the rational interval cannot see.
The closed end is not negotiable. On the function is continuous, since the denominator never vanishes, but makes it unbounded above, so it has no maximum — while its infimum is attained at , showing that attainment is a separate question at each end. The step that fails is the appeal to closedness in Boundedness theorem: the escaping subsequence converges to , so there is no point of the domain at which to invoke continuity. Adding does not help, because cannot be defined there at all.
3.18Both hypotheses are necessary
The Extreme Value Theorem needs continuity and a domain that is both closed and bounded, so there are three ways to break it, and all three occur.
Continuity fails. On the compact interval define for and . Then everywhere while values arbitrarily close to occur, so is never attained. The domain is compact, so the only defective hypothesis is continuity, which fails at where the left limit is .
Closedness fails. On the continuous has , so no maximum exists — the case discussed just above.
Boundedness fails. On , which is closed but unbounded, the continuous satisfies for every , so no value is maximal.
A fourth failure is the surprising one: a function can be continuous and bounded on a non-compact domain and still attain nothing.
Example 3.58 (Two ways to lose an extremum). (a) Show on is continuous and bounded with , , neither attained. (b) Show on has neither a maximum nor a minimum.
Solution.
- (a) everywhere and is continuous, so is a quotient of continuous functions with nonvanishing denominator. And for every , so no value reaches .
- The bounds are sharp: gives , and by oddness . Numerically and , creeping toward .
- Which hypothesis broke. is closed but unbounded, hence not compact. Boundedness of the function is irrelevant — the hypothesis is about the domain. The optimum has run away to , where there is no point to attain it at.
- (b) with throughout the open interval, so the quotient clause of Algebra of continuous functions gives continuity.
- Which hypothesis broke. The domain is bounded but not closed, so compactness fails. As we get , and ; symmetrically at the other end. Numerically and .
- Unlike a removable case, the interval cannot simply be closed up: has no finite limit at , so no continuous extension exists. The defect is intrinsic to the function, not to the notation for its domain.
3.19Compactness, in the end, is the whole story
Both great theorems used exactly the same two facts about : every sequence in it has a convergent subsequence, and the limit stays inside. That is sequential compactness, and restating the theorems in those terms both generalises and explains them.
Theorem 3.59 (Continuous images of compact sets are compact). Let be closed and bounded and continuous. Then is closed and bounded.
Proof. Bounded. If not, there are with . Bolzano–Weierstrass gives with by closedness, and Sequential characterisation of continuity gives , so that subsequence of images is bounded — contradicting .
Closed. Let be a limit of points of , say with . Bolzano–Weierstrass and closedness give a subsequence , and continuity gives . But is a subsequence of the convergent sequence , hence converges to . By uniqueness of limits, . So contains all its limit points.∎
Corollary 3.60 (Extreme Value Theorem on a compact set). A continuous real-valued function on a nonempty closed bounded set attains a maximum and a minimum on .
Proof. By the theorem Continuous images of compact sets are compact, is nonempty, closed and bounded. Being bounded and nonempty, it has a supremum ; being closed, it contains , because is either a member of already or a limit of members, the characterisation of the supremum supplying points of within of for every . Hence , so for some , and is a maximum. The minimum is the same argument with the infimum, or an application to .∎
This is the form the theorem takes in a general metric space, where by Characterizations of compactness in a metric space the sequential and open-cover definitions agree, and in the theorem Heine-Borel identifies the compact sets as exactly the closed bounded ones. The interval structure was never used above — only compactness — which is why the statement applies equally to a Cantor set or a finite union of intervals.
A one-line application shows the gain. The unit circle is bounded, lying inside the disc of radius , and closed, being the preimage of under the continuous map ; by Heine-Borel it is compact. The height is a coordinate projection, hence continuous, so by the corollary Extreme Value Theorem on a compact set it attains a maximum and a minimum — namely at and at , as the parametrisation confirms. Note that is not an interval, so only the compactness formulation makes the application legal.
Summary. The - definition makes "approaches" precise; the two sequential characterisations convert it into statements about sequences, which is how nearly every later proof gets leverage. Continuity is the agreement of limit and value, preserved by the algebra and by composition — which is why explicit - work is almost never needed in practice. Uniform continuity moves one quantifier, and Heine–Cantor says compactness restores it for free. The two great theorems split by which property of they use: the Intermediate Value Theorem is the least-upper-bound property, the Extreme Value Theorem is compactness.
- Choosing a that depends on . The order is , so is fixed before is named. An answer of the form has proved nothing; bound the offending factor by a constant on a pre-restricted neighbourhood instead.
- Reversing the quantifiers. "There is such that for all ... " says the function is locally constant, not that it has a limit.
- Requiring to exist or to equal the limit. The definition inspects only the punctured neighbourhood: although the function is undefined there.
- Treating "the limit is " as a kind of convergence. It is a specific mode of divergence; the limit laws do not apply to it.
- Using the limit laws without checking the component limits exist. can exist when neither nor does, so the laws run one way only.
- Assuming continuity at a point says something about a neighbourhood. The function equal to on and elsewhere is continuous at exactly one point.
- Confusing continuity with uniform continuity. Pointwise continuity lets shrink as the base point moves; on and on are continuous and not uniformly so.
- Believing uniform continuity requires a bounded derivative. That is the Lipschitz condition, strictly stronger: on is uniformly continuous with unbounded difference quotients at .
- Applying Heine–Cantor to a bounded but non-closed domain. Both halves of compactness are used in the proof, and on is the standard counterexample.
- Dropping a hypothesis from the two great theorems. A step function skips intermediate values; on attains no extremum. In each case exactly one hypothesis is missing and the counterexample is one line.
- Thinking the intermediate value property implies continuity. It does not: with value at the origin has the property and is discontinuous, and by Darboux's theorem every derivative has it.
- Confusing attainment of extrema with the existence of critical points. The theorem says a maximum exists; locating it may require checking endpoints, where the derivative need not vanish, as on shows.