Contents / Set Theory / ZFC Axioms
Chapter 2
ZFC Axioms
The nine axioms and what each one buys: extensionality and the uniqueness of the empty set; separation blocking Russell and proving there is no universal set; intersection and difference needing no axioms of their own; the Kuratowski ordered pair with its degenerate case; Cartesian products from power set and separation; foundation forbidding membership cycles; the von Neumann naturals satisfying the Peano axioms; the cumulative hierarchy with the sizes of its finite stages; and replacement as a schema reaching sets separation cannot.
Introduction
Almost every other chapter in mathematics starts by assuming that some objects exist. Analysis assumes the real numbers; algebra assumes a group; geometry assumes a plane and its points. This chapter is the one that has nothing to assume. It begins with a formal language containing a single relation symbol, , and a list of axioms saying which sets that language can be made to produce, and it ends with the natural numbers, the ordered pair, the Cartesian product, the power set tower and the cumulative hierarchy — every one of them constructed, not postulated.
The reason to do this at all is that the alternative failed, publicly and irreparably. Naive set theory took as its single principle that any property whatsoever determines a set: for each formula there is a set . In 1901 Russell pointed at and the whole edifice fell over in two lines. The Zermelo–Fraenkel axioms are the repair. They are not a list of everything true about sets; they are a carefully rationed licence to build sets, restrictive enough that Russell's construction is simply not one of the permitted moves, and generous enough that the rest of mathematics still goes through unchanged.
Two habits of reading will help throughout. First, every axiom here is an existence statement or a uniqueness statement — it says either "given these sets, this further set exists" or "two sets agreeing in this way are the same set". Nothing else is on offer. Second, "proof" in this chapter almost always means derivation from the axioms: we will prove that intersections exist, that the ordered pair works, that no set is a member of itself, that satisfies the Peano axioms. Those are theorems of ZF, and the pleasure of the subject is watching ordinary mathematical furniture appear from a list of nine sentences.
Throughout, lower-case letters range over sets — in ZF everything is a set, so there is no second sort of object to range over — and denotes a formula of the first-order language of set theory. We write ZF for Zermelo–Fraenkel without the axiom of choice, and ZFC for ZF together with choice, and we will be careful to say which of the two a result needs.
2.1The point of an axiom system
The language of set theory is deliberately tiny. Its only non-logical symbol is the binary relation ; the rest is the ordinary apparatus of first-order logic — variables, , the quantifiers and , and equality. There is no symbol for , none for , none for , none for . Every one of those is an abbreviation, introduced only after an axiom has been shown to guarantee that the object it names exists and a theorem has shown it to be unique.
Definition 2.1 (The language of set theory). The language has variables , the logical connectives and quantifiers, the equality symbol , and one binary relation symbol . Atomic formulas are exactly and ; every other formula is built from these by connectives and quantifiers.
Notation. We use the standard abbreviations. means ; means ; means there is exactly one with . Note that is defined, not primitive: subsethood is a formula, whereas membership is a symbol.
Intuition. Think of the axioms as the rules of a construction kit. You are given a supply of pieces (at the start, essentially none) and a list of permitted operations: given two pieces you may staple them into a pair, given a box of boxes you may tip it out into one box, given a piece you may collect all of its sub-pieces. The question the axioms answer is never "is this collection real?" but "can this collection be reached from nothing by finitely many permitted moves?"
Three features of this setup are worth stating explicitly before anything else, because each one surprises students who meet it for the first time.
Everything is a set. There are no atoms, no "urelements", no numbers sitting outside the universe waiting to be gathered. When we build , it will be a set, with three members. When we build the ordered pair , it will be a set. This is an economy, not a philosophical claim: one sort of object means one relation to axiomatise.
The axioms are schematic in places. Two of the nine items on the list — Separation and Replacement — are not single sentences but infinite families, one sentence for each formula of the language. First-order logic cannot quantify over formulas, so an infinite family is the only way to say what those axioms say. This costs nothing in practice and has a striking consequence taken up in the section on the schema nature of Replacement.
The axioms cannot prove their own consistency. By Gödel's second incompleteness theorem, if ZFC is consistent then ZFC cannot prove that it is. We work in ZFC because a century of hard use has not broken it, not because it comes with a certificate.
Remark. The system is also not complete: there are sentences, the continuum hypothesis being the famous one, that ZFC neither proves nor refutes. That is not a defect peculiar to set theory. Any consistent, effectively axiomatised theory strong enough to encode arithmetic has the same property.
2.2The nine axioms, listed once
Here is the whole list. Read it once now without trying to absorb it; the remaining sections unpack five of these items in detail, and the others are used constantly in the arguments along the way.
Definition 2.2 (The axioms of ZFC).
- Extensionality. — a set is determined by its members.
- Pairing. — the set exists.
- Union. — the set exists.
- Power set. — the set exists.
- Infinity. — an inductive set exists.
- Separation (schema). For each formula : .
- Replacement (schema). For each formula : if defines a function on , then the image of under it is a set.
- Regularity (Foundation). — every nonempty set has an -minimal member.
- Choice. Every family of nonempty sets has a choice function. ZF is items 1–8; ZFC is all nine.
Counting these nine items is the standard bookkeeping, and it is worth fixing: of the nine, exactly two are schemas, namely Separation and Replacement, so the list is nine axioms in the informal sense but infinitely many sentences in the formal one. Some presentations shorten the list, because Pairing and Separation are both derivable from Replacement together with Power set; others lengthen it by splitting Infinity or by adding the existence of the empty set as a separate item. Nothing below depends on which bookkeeping you prefer, provided you say which one you are using.
Note (Where the empty set comes from). The list above does not include " exists". It does not need to. First-order logic assumes a nonempty domain, so some set exists; Separation applied to with the formula produces a set with no members at all. Extensionality then shows it is unique, and only at that point is the symbol legitimate.
Example 2.3 (Which axiom licenses which set). You have the sets and . Name the axiom that produces each of , , , and .
Solution.
- is exactly Pairing applied to and .
- is Pairing applied to and : the axiom yields a set whose members are the with , that is, . No separate singleton axiom is needed.
- takes two steps: Pairing gives , then Union applied to gives , whose members are the lying in or in .
- is Power set applied to , and no combination of the other axioms produces it — this is the one operation that genuinely increases size.
Pitfall. Union takes a set of sets and flattens it one level: . It is not the binary . The binary operation is the two-step derived construction in the example above, which is why " " is an abbreviation and " " is the axiom.
2.3Why axioms at all: the paradoxes
The single principle the axioms replace is unrestricted comprehension: for every formula , the collection is a set. It is an appealing principle, it is how most people think about sets before they are taught otherwise, and it is inconsistent.
Theorem 2.4 (Russell's paradox). Unrestricted comprehension is inconsistent: there is no set such that for all , .
Proof. Suppose such an existed. Instantiate the defining equivalence at , which is legitimate because is a set and the equivalence was asserted for all sets:
If , the right-hand side gives , a contradiction. If , the equivalence gives , again a contradiction. Both cases are impossible and one of them must hold, so no such exists. Unrestricted comprehension asserts that exists for the formula , so unrestricted comprehension is false.∎
The repair is to weaken comprehension so that a formula can only ever carve a subset out of a set already in hand. That is exactly Separation.
Definition 2.5 (Separation, in words). For each formula , and for every set and parameters , there is a set
With the bound in place, Russell's argument no longer produces a contradiction. It produces a theorem, and a strong one.
Theorem 2.6 (Separation blocks Russell, and proves there is no universal set). Work in ZF, indeed in Extensionality plus Separation alone. Then:
- For every set , the set exists and satisfies .
- There is no set with .
Proof. For (1), exists by Separation. Suppose, for contradiction, that . Ask whether . By the defining property of ,
Since we have assumed , the right-hand conjunct is true, so the equivalence collapses to , which is a contradiction exactly as in Russell's paradox. Hence the assumption fails and .
For (2), suppose were a set containing every set. Apply (1) with : we obtain a set with . But is a set, and contains every set, so — a contradiction. Therefore no such exists.∎
Read part (1) again: it says that from any set , Separation manufactures a set that is not a member of . So no set can be all-inclusive, and the paradox has been converted from a disaster into a diagonal argument. This is the pattern that repeats throughout the subject — Cantor's theorem later in this chapter has exactly the same shape.
Intuition. Unrestricted comprehension treats a property as a net that can be cast over the whole universe at once. Separation makes you first point at a bucket, then fish inside it. Russell's net came back holding a contradiction; Russell's bucket comes back holding a proof that the bucket was too small — which is a true and useful thing to learn.
Remark. The collection is not nothing; it is a proper class, a collection definable by a formula but too large to be a set. Classes are a convenience of the metalanguage in ZFC: writing or is shorthand for a formula, never a term. Von Neumann–Bernays–Gödel set theory (NBG) makes classes into official objects and is a conservative extension of ZFC, proving exactly the same theorems about sets.
Example 2.7 (Burali-Forti, the same trap in ordinal clothing). Explain why there is no set of all ordinals, given that any set of ordinals is itself well-ordered by and that the ordinals are exactly the transitive sets well-ordered by .
Solution.
- Suppose were a set. Every member of an ordinal is an ordinal, so is transitive, and it is well-ordered by because any set of ordinals is.
- Therefore satisfies the definition of an ordinal, so .
- But no ordinal is a member of itself, since well-orders it and a well-order is irreflexive. Contradiction, so is a proper class.
- The moral matches the theorem Separation blocks Russell, and proves there is no universal set: the trouble is always a collection that would have to contain a diagonal object built from itself.
Pitfall. "Russell's paradox shows that some sets contain themselves" is backwards. It shows that the collection of non-self-membered sets is not a set. Whether any set contains itself is a separate question, settled negatively by Regularity later in this chapter, and ZF minus Regularity does not settle it at all.
2.4ZF, ZFC, and what choice is for
The ninth axiom stands apart from the first eight. Axioms 1–8 tell you how to build a specific set from specific ingredients, and in every case the set built is uniquely determined by the ingredients. Choice does not: it asserts that a selection exists without giving any rule for making it.
Definition 2.8 (Axiom of Choice). For every set of nonempty sets there is a function with domain such that for every . Such an is a choice function for .
Intuition. Given infinitely many pairs of shoes you need no axiom: pick the left one from each pair, a rule anyone can state. Given infinitely many pairs of socks there is no rule, and Choice is precisely the assertion that a selection exists anyway. Russell's image is exact: Choice is needed only when the family is infinite and the members carry no distinguishing structure.
For finite families, no axiom is needed at all, and the proof shows precisely where the finiteness is used.
Proposition 2.9 (Finite choice is a theorem of ZF). Let be a finite set of nonempty sets. Then ZF proves that a choice function for exists.
Proof. Induct on . If then and the empty function is a choice function vacuously.
Suppose the claim holds for families of size and let . Pick any — this is a single existential instantiation inside a proof, which first-order logic permits, not an appeal to Choice. Since there is some , again by a single instantiation. By the inductive hypothesis has a choice function , and is a choice function for ; it is a set by Pairing and Union, and a function because .
The induction makes instantiations for a family of size . That is the whole difference: a proof is a finite object, so it can make finitely many arbitrary picks and no more. An infinite family needs infinitely many simultaneous picks, and that is what Choice supplies.∎
Note (Equivalents and independence). Over ZF, the axiom of choice is equivalent to Zorn's lemma, to the well-ordering theorem (every set can be well-ordered), to the statement that every vector space has a basis, and to the statement that every surjection has a right inverse. Gödel (1938) showed ZF cannot refute Choice, and Cohen (1963) showed ZF cannot prove it; the same pair of results holds for the continuum hypothesis over ZFC. So Choice is genuinely independent, and citing it is a real hypothesis, not a formality.
Which results in this chapter need Choice? Almost none — and that is worth noticing. Everything about Extensionality, Pairing, Union, Separation, the Kuratowski pair, Cartesian products, Regularity, the von Neumann naturals, , the Peano axioms, Cantor's theorem and the cumulative hierarchy below is proved in ZF alone. Choice enters when you want to compare arbitrary cardinals, to well-order the reals, or to choose from an infinite family with no canonical member.
Example 2.10 (Spotting a hidden use of Choice). A sequence of nonempty sets is given, and someone writes "choose for each and form the sequence ". Is that a theorem of ZF?
Solution.
- No. The phrase "for each " asks for infinitely many simultaneous selections, which is exactly the countable axiom of choice, .
- It becomes a theorem of ZF the moment the selection is definable: if each is a nonempty set of natural numbers, take , and the sequence exists by Replacement with no choice at all.
- The lesson is that Choice is invisible in the grammar of English. "Choose one from each" is either free or an axiom, depending entirely on whether a rule exists.
Pitfall. ZFC is not "ZF with more sets". Adding Choice adds no new sets; it adds a new assertion about functions that were already candidates for existence. A model of ZF failing Choice is not missing objects so much as missing the coordination between them.
2.5Extensionality: the statement
The first axiom is the only one on the list that is not an existence statement. It says what it means for two sets to be the same.
Definition 2.11 (Axiom of Extensionality). For all sets and ,
In words: if and have exactly the same members, they are equal.
The converse direction, that equal sets have the same members, is not part of the axiom — it is a consequence of the logical axioms for equality, which say that equals may be substituted for equals in any formula. Extensionality supplies only the direction that logic cannot: it turns agreement of members into identity.
Intuition. A set is a bag with no colour, no label, no date of manufacture and no memory of how it was filled. Two bags holding the same things are the same bag. Everything that distinguishes objects in ordinary life — a name, a construction, an ordering, a multiplicity — is invisible to a set, and Extensionality is the axiom that makes that invisibility official.
The immediate reformulation is the one used constantly in practice: it turns set equality into a pair of inclusions, which is why almost every proof that two sets are equal is written in two halves.
Proposition 2.12 (Equality by double inclusion). For all sets and , if and only if and .
Proof. () Suppose and . Let be arbitrary. If then by the first inclusion; if then by the second. Hence , and Extensionality gives .
() Suppose . By the substitution property of equality, and are the same statement for every , so each of and holds.∎
Remark. Extensionality is what makes a partial order rather than merely a preorder: reflexivity and transitivity are pure logic, but antisymmetry — the proposition Equality by double inclusion read from right to left — is exactly the axiom. Drop Extensionality and you may have distinct sets with identical members, and stops separating points.
2.6What extensionality forces
Three consequences follow immediately, and together they explain why set notation behaves the way it does: repetition is invisible, order is invisible, and the empty set is unique.
Proposition 2.13 (Repetition and order are invisible). For all sets and :
- .
- .
- .
Proof. For (1), Pairing applied to and gives a set with , and Pairing applied to and in the singleton reading gives with . The two right-hand conditions and are logically equivalent, so , and Extensionality gives . Writing the left side as and the right as is exactly the claim.
For (2), the membership condition for is and for it is . Disjunction is commutative, so the conditions are equivalent and Extensionality applies.
For (3) the condition is , equivalent to by idempotence of ; apply Extensionality again.∎
Every part of that proof has the same two-step shape: reduce the two sets to their membership conditions, observe that the conditions are logically equivalent, then invoke Extensionality. The set-theoretic content is nil; the point is that all of the familiar informalities of brace notation are theorems, not conventions.
Corollary 2.14 (Uniqueness of the empty set). There is exactly one set with no members.
Proof. Existence was shown in the note Where the empty set comes from. For uniqueness, let and both have no members. Then for every , both and are false, so the biconditional holds vacuously for every . Extensionality gives .∎
Corollary 2.15 (Cardinality of a listed set). The set has exactly members, where is the number of distinct sets among .
Proof. By the proposition Repetition and order are invisible applied repeatedly, any repeated entry may be deleted without changing the set, so equals the listing of the distinct entries, of which there are . Conversely those entries are pairwise distinct members, so the set has exactly members.∎
Pitfall. and are never interchangeable. has one member and has none, so by Extensionality they are different sets — indeed and are both true while is false. A one-element set is a box containing a thing, not the thing.
Example 2.16 (Counting members through the braces). How many members does each of , , and have?
Solution.
- has one member, namely .
- has two members: and , which differ by the pitfall above.
- by the proposition Repetition and order are invisible, so it has one member.
- has exactly one member, namely the two-element set inside it. Braces at the outside always give a singleton however complicated the contents.
2.7Extensionality at work
The axiom earns its keep in proofs of the form "these two differently-described sets are the same". The recipe never varies.
Method 2.17 (Proving two sets equal). To show :
- Take an arbitrary and derive , giving .
- Take an arbitrary and derive , giving .
- Conclude by the proposition Equality by double inclusion.
If the two membership conditions are visibly the same formula, steps 1 and 2 collapse into a single chain of biconditionals and you may quote Extensionality directly.
Example 2.18 (A distributive law by double inclusion). Prove that .
Solution.
- Let . Then , and or . In the first case ; in the second . Either way .
- Conversely let . In either case , and lies in or in , so and hence .
- Both inclusions hold, so the sets are equal by the recipe Proving two sets equal. Notice that the argument is nothing but the distributivity of over in the membership conditions; Extensionality is what converts that logical fact into a set identity.
Example 2.19 (Two descriptions of one set). Let and . Are and the same set, and does the answer depend on how they were built?
Solution.
- A natural number is even precisely when it is twice another natural number, so the two membership conditions are equivalent formulas.
- Hence and Extensionality gives .
- The construction route is irrelevant: both sets came from Separation applied to , but even if one had been produced by Replacement the answer would be the same. A set has no memory of its derivation.
Example 2.20 (Extensionality failing). Suppose a theory allows two distinct "atoms" , neither of which has any members. Which axiom does this violate, and what breaks?
Solution.
- Both and have no members, so holds vacuously and Extensionality would force . So such a theory rejects Extensionality — this is the theory ZFA, with urelements.
- What breaks is the corollary Uniqueness of the empty set: there are now many memberless objects, and "the" empty set is no longer well defined.
- The proposition Equality by double inclusion also fails, since and hold vacuously while .
2.8Pairing, union and separation: what they give for free
Extensionality pins down identity; the constructive axioms then supply objects. A surprising amount of everyday set theory needs no new axiom at all, and this section proves it. Intersection, difference, the ordered pair and the Cartesian product all fall out of Pairing, Union, Separation and Power set.
Theorem 2.21 (Intersection and difference need no axiom of their own). Let and be sets. Then and exist as sets, provably from Separation alone. Moreover, if is a nonempty set, then exists.
Proof. For , apply Separation to the set with the formula , in which appears as a parameter. The resulting set has as members exactly those lying in both, which is the defining property of ; it is unique by Extensionality.
For , apply Separation to with .
For with , choose any — a single instantiation, not Choice — and apply Separation to with the formula . The result contains exactly those lying in every member of : such a lies in in particular, so nothing is lost by bounding the search inside .∎
Remark. The hypothesis in the last part is essential. If the condition " lies in every member of " is vacuously true of every set, so would be the universal set, which the theorem Separation blocks Russell, and proves there is no universal set forbids. By contrast is perfectly well behaved, because Union is an existence axiom with no such bound needed.
The ordered pair is the next construction, and it is the one place in elementary set theory where a clever encoding does real work. An ordered pair must satisfy one property and only one: it must remember which component came first.
Definition 2.22 (Kuratowski ordered pair). For sets and define
This is a set: and exist by Pairing, and then Pairing applied to those two sets gives .
Theorem 2.23 (The defining property of the ordered pair). For all sets ,
Proof. () If and then and by substitution, hence the two pairs are the same set.
() Assume . Split on whether .
Case 1: . Then by the proposition Repetition and order are invisible, so , a set with exactly one member. The right-hand side is therefore also a one-element set, so . Since we get , and then the right side is . Equating the unique members, , so ; and . Both conclusions hold.
Case 2: . Then has two members while has one, so and the left-hand side has exactly two members. Now , so either or .
If then and , so the right-hand side is , a one-element set, contradicting that the left has two members. Hence and therefore .
It remains to show . We have . Since (it has two members), we get . Now , and , so , as required.∎
Intuition. The encoding works by asymmetry. In the first coordinate appears in both inner sets while the second appears in only one, so the first coordinate is recoverable as the member of and the second as the member of when the coordinates differ. Any encoding with that asymmetry would do; Kuratowski's is simply the cheapest one that Pairing alone can build.
Pitfall. The degenerate case is where careless proofs of the characterisation fail. When the pair has one member, not two, and an argument that assumes " always has two members" is wrong on the diagonal. Case 1 of the proof above exists entirely to handle this.
Example 2.24 (Unwinding a Kuratowski pair). Write as an explicit set of sets, using the von Neumann numerals and , and count its members and the members of its members.
Solution.
- By definition .
- Its two members are , which has one member, and , which has two. So has members, carrying memberships between them.
- Compare , which has just member. The drop from to is exactly the degeneracy the pitfall warns about.
With pairs available, products follow — and here Power set does the work that Separation cannot do alone, because a product is not a subset of anything already in hand until you find the right ambient set.
Theorem 2.25 (Cartesian products exist). For all sets and there is a set
Proof. Let and . Then , so and ; that is, and are both members of . Consequently
The set exists: by Pairing and Union, then Power set twice. Now apply Separation to it with the formula
which is a legitimate formula of with parameters and . The resulting set contains exactly the Kuratowski pairs with first coordinate in and second in , which is .∎
The pattern of that proof — find an ambient set large enough, then separate — is the standard method for proving existence in ZF, and it is why Power set is indispensable even for constructions that look as though they only need pairing.
Corollary 2.26 (Relations and functions are sets). For all sets and , the collection of all relations from to is a set, and so is the collection of all functions from to .
Proof. A relation from to is by definition a subset of , so the collection of all of them is , a set by the theorem Cartesian products exist and Power set. A function from to is a relation with the extra first-order property of being total and single-valued, so is obtained from by Separation.∎
Example 2.27 (Sizes of products and function spaces). Let and . Compute the number of members of , of the set of all relations from to , and of .
Solution.
- , one pair for each choice of coordinates.
- Relations are subsets of , so there are of them.
- A function assigns to each of the members of one of the members of , so . Every one of these sets exists by the corollary Relations and functions are sets, with no appeal to Choice.
2.9Regularity: the statement
The eighth axiom is the one nobody misses until it is gone. It proves no theorem of ordinary mathematics and can be dropped without damaging analysis or algebra; what it does is impose a shape on the universe, and that shape is what makes induction and recursion available on all sets rather than only on the well-ordered ones.
Definition 2.28 (Axiom of Regularity (Foundation)). Every nonempty set has an -minimal member:
The member is minimal in the sense that no member of is also a member of .
Intuition. Read as " is a floor". The axiom says every nonempty set contains at least one member that shares nothing with it — you cannot keep descending through members of members of members forever, because at some point the box you open has nothing from the original collection inside. The universe rests on and is built upwards in layers; it has a bottom.
Pitfall. Regularity does not say "every set has a member that is empty", nor " is a member of every nonempty set". contains no empty set, but is -minimal in it, because and . Minimality is relative to , not absolute.
Example 2.29 (Finding the minimal member). Identify an -minimal member of and of , using the von Neumann numerals.
Solution.
- In with : the members of are just , and , so and is -minimal. ( is not: and .)
- In , the member has only inside, and , so is -minimal. The other member is not minimal, since lies in both it and .
- In each case exactly the "lowest" member in the layering is the one the axiom promises.
2.10Well-foundedness: no loops anywhere
The advertised payoff of Regularity is the ban on membership cycles. Both proofs below have the same one-move structure: manufacture a set whose minimality contradicts the supposed cycle.
Theorem 2.30 (No set is a member of itself). In ZF, for every set .
Proof. Suppose for some set . By Pairing, is a set, and it is nonempty, so Regularity supplies a member with . The only member of is , so and therefore .
But by assumption and always, so , making that intersection nonempty. This contradicts the previous line, so no such exists.∎
Theorem 2.31 (No membership cycles of any finite length). In ZF there are no sets with and
Proof. Suppose such a cycle exists. Let , which is a set: build it by applications of Pairing and Union, or in one step by Separation from any set containing the . It is nonempty since .
By Regularity there is with . But the cycle provides a predecessor: reading indices modulo , we have , and by construction. Hence , so that intersection is nonempty — contradicting the choice of .
Since was an arbitrary index supplied by the axiom and every index has a predecessor in the cycle, no member of can be -minimal, so violates Regularity. Therefore no cycle exists. Taking recovers the theorem No set is a member of itself.∎
Corollary 2.33 (No descending chain reachable inside a set). There is no set together with a function such that for every .
Proof. Suppose such an existed. Its range is a set, by the corollary Relations and functions are sets and Replacement, and it is nonempty. By Regularity there is with ; write . Then and , so , contradicting emptiness.∎
Remark. The converse — that a universe with no infinite descending -chain satisfies Regularity — needs the axiom of choice to produce the chain from a set with no minimal member, so "well-founded" and "satisfies Regularity" are equivalent in ZFC but not provably so in ZF alone. This is one of the few places in the chapter where Choice is genuinely required, and it is worth flagging because the two conditions are routinely treated as the same thing.
2.11The cumulative hierarchy
Regularity is best understood not as a prohibition but as a picture. The sets are stacked in levels indexed by the ordinals, each level containing all subsets of everything below it, and Regularity says that this stack is the whole universe.
Definition 2.34 (The von Neumann hierarchy). Define, by transfinite recursion on the ordinals,
The rank of a set is the least ordinal with , equivalently the least with .
Theorem 2.35 (Every set has a rank). In ZF, every set belongs to some ; equivalently . Moreover .
Proof. The recursion defining is legitimate because Replacement licenses transfinite recursion and Power set supplies the successor step; the limit step is Union applied to the set , which is a set by Replacement.
For the rank formula, suppose every has a rank. Then is a set of ordinals by Replacement, so it has a supremum , and for every ; hence and . Minimality of is immediate, since if then every has .
That every set has a rank at all is exactly where Regularity is used: were some set rankless, the collection of rankless sets appearing inside it would, by Regularity applied to a suitable set built from its transitive closure, have an -minimal member, all of whose members have ranks — and the displayed formula then assigns that member a rank, a contradiction.∎
The first few levels are small enough to write down, and their sizes grow at a rate that is worth seeing once.
Proposition 2.36 (The finite levels). , , , , , , and in general .
Proof. has members. Each successor level is a power set, so , which gives the recursion. Evaluating it: , , , , . The next value, , has decimal digits, and cannot be written down in this universe.∎
Example 2.38 (Computing ranks). Compute the rank of , of , of , and of the ordered pair .
Solution.
- , since and the supremum over an empty set of members is .
- .
- For a von Neumann natural, : by the rank formula and induction, . So .
- . Here and , so the rank of the pair is . In general .
2.12What regularity rules out
It is instructive to see exactly which objects Regularity kills, and to notice how few of them anyone wanted.
Definition 2.39 (Transitive closure). The transitive closure of a set is the smallest transitive set containing as a subset, obtained as
the union of the iterated unions, which is a set by Replacement and Union. Its members are exactly the sets reachable from by descending through memberships.
Example 2.40 (Transitive closures of small sets). Compute and with the von Neumann numerals, and count their members.
Solution.
- and and . Starting from : the layers are , then contributing and , then contributing , then nothing new.
- So , with members.
- For : the set itself contributes ; descending adds nothing new. So itself, with members — as it must be, since a von Neumann natural is already transitive.
Example 2.41 (A Quine atom). A Quine atom is a set with . Show that Regularity forbids it, and say what survives without Regularity.
Solution.
- If then , so , contradicting the theorem No set is a member of itself.
- Without Regularity the existence of is consistent: Aczel's Anti-Foundation Axiom (AFA) replaces Regularity and asserts that every directed graph has a unique decoration, which produces exactly one Quine atom.
- ZF minus Regularity plus AFA is equiconsistent with ZF, so neither theory is more dangerous than the other. Regularity is a choice of picture, not a safety requirement.
Remark. Non-well-founded sets are genuinely useful in computer science, where a stream or a process is naturally modelled by a circular structure. That is a reason to work in AFA-style set theory, not a reason to doubt ZF: the two are inter-interpretable, and mainstream mathematics has never needed a set that contains itself.
Example 2.42 (Why Regularity proves nothing about numbers). Does removing Regularity from ZFC change which statements about real numbers are provable?
Solution.
- No. Every object of ordinary mathematics — , , function spaces, manifolds — is built by the constructive axioms, and each lands in for a definite well below the first inaccessible.
- Formally, if ZF minus Regularity is consistent, then , the class of well-founded sets, forms a model of full ZF inside it, and that model contains a copy of every ordinary structure.
- Regularity earns its place by simplifying arguments, chiefly -induction and the rank function, not by extending the reach of the theory.
2.13Infinity: the statement
Nothing so far produces an infinite set. Pairing, Union, Power set and Separation each take sets in and give a set out, and starting from they only ever reach finite sets. The fifth axiom is the one that breaks out, and it does so in the most economical possible way: it asserts the existence of one set that is closed under a single successor operation.
Definition 2.43 (Successor and inductive sets). The successor of a set is , a set by Pairing and Union. A set is inductive if
Definition 2.44 (Axiom of Infinity). There exists an inductive set.
Intuition. says: to move on from , keep everything you had and add the box holding all of it. Starting at this generates , , , … — each numeral is literally the set of all its predecessors, so " has members" is true on the nose rather than by counting.
Pitfall. Infinity does not assert that exists. It asserts that some inductive set exists, and an inductive set may be much larger than — is inductive, for instance. Cutting the promised set down to the smallest inductive one is a separate step, and it is Separation that does it.
2.14Building the natural numbers
Definition 2.45 (Von Neumann naturals). Define
The definition above is a schema of abbreviations, one per numeral; to have the set of all of them we need one more step, and this is where Infinity and Separation combine.
Theorem 2.47 (Omega is well defined). There is a unique smallest inductive set
Proof. Let be inductive, given by Infinity. The collection is a set, by Power set and Separation with the first-order formula expressing inductiveness. It is nonempty, since , so exists by the theorem Intersection and difference need no axiom of their own.
is inductive: lies in every , hence in the intersection; and if then for every such , so for every such , so .
is contained in every inductive set: let be inductive. Then is inductive (both conditions are inherited by the intersection of two inductive sets) and is a subset of , so and therefore .
Independence of and uniqueness follow: if were built from another inductive set , each of is inductive and each is contained in every inductive set, so and , whence by the proposition Equality by double inclusion.∎
Theorem 2.48 (The Peano axioms hold in omega). With and successor , the structure satisfies:
- ;
- for every ;
- for every ;
- is injective on ;
- (Induction) if contains and is closed under , then .
Proof. (1) and (2) are the statement that is inductive, proved in the theorem Omega is well defined.
(3): always, so is nonempty and hence differs from .
(5): such an is an inductive set, so by minimality; with given, double inclusion gives . Induction is thus not an extra assumption — it is minimality.
(4): first note that every is transitive, i.e. . This holds by induction using (5): is vacuously transitive, and if is transitive and then either , so , or . Now suppose . Then , so or ; symmetrically or . If we would get and , a -cycle forbidden by the theorem No membership cycles of any finite length. Hence .∎
Remark. Part (4) is the only place in the chapter where the Peano axioms lean on Regularity, and it can be proved without it by an induction on transitivity instead. It is included in this form because it shows the two axioms cooperating: Infinity supplies the objects, Regularity supplies their rigidity.
Example 2.49 (Members, subsets and the successor). Compute the number of members of , the number of subsets of , and write explicitly.
Solution.
- , so has exactly members — the defining feature of the von Neumann encoding.
- The subsets of a -element set number , so . (This matches , and not by accident: and .)
- .
2.15Why the axiom cannot be dropped
It is tempting to think that since we can build one at a time without Infinity, the axiom only tidies up. It does not. Each numeral is a separate theorem; there is no theorem of ZF minus Infinity that produces a set containing all of them.
Theorem 2.50 (ZF minus Infinity does not prove Infinity). The set of hereditarily finite sets satisfies every axiom of ZFC except Infinity, and satisfies the negation of Infinity. Consequently, if ZF is consistent, Infinity is not provable from the other axioms.
Proof. Every member of is finite and has all of its members in , so is transitive and Extensionality and Regularity hold in it automatically.
Pairing: if then . Union: if then , so . Power set: if then every subset of lies in , so . Separation and Replacement: a subset of a finite set is finite, and the image of a finite set under a function is finite, so both stay inside — with Replacement using that any level-bounded finite family is bounded by a single . Choice holds because every member is finite, by the proposition Finite choice is a theorem of ZF.
Infinity fails: an inductive set contains and so is infinite, while every member of is finite. So , and a theory cannot prove a sentence false in one of its models.∎
Intuition. Without Infinity you can walk as far along the numerals as you like and you can never turn round and pick up the road behind you. Each step is a finite construction; the collection of all steps is not the result of any finite construction, so it has to be asserted.
Example 2.51 (What survives without Infinity). Which of the following are available in ZF minus Infinity: the number , the set , the set , the set ?
Solution.
- as a von Neumann numeral is a hereditarily finite set, so yes — it lives in , indeed with rank .
- is again a single numeral, so yes.
- is infinite, so no; by the theorem ZF minus Infinity does not prove Infinity it fails in .
- is infinite, so no. Arbitrarily large finite objects are cheap; a single infinite one is an axiom.
2.16What infinity unlocks
Definition 2.52 (Limit and successor ordinals). An ordinal is a successor if for some ordinal , and a limit if and is not a successor. Equivalently, is a limit exactly when and .
Theorem 2.53 (Omega is the least limit ordinal). is an ordinal, it is a limit ordinal, and every ordinal smaller than is either or a successor. Hence is the least limit ordinal.
Proof. is transitive: if then , proved by induction using part (5) of the theorem The Peano axioms hold in omega, since vacuously and with gives . It is well-ordered by by the same induction, so it is an ordinal.
since . If then , so by inductiveness, i.e. , contradicting the theorem No set is a member of itself. So is a limit.
Every is or a successor: by induction, is , and any is a successor. Hence no member of is a limit, so is the least one.∎
Remark. After the ordinals continue: , , …, then , , , , and far beyond. Every one of these is a set, and producing them in bulk needs Replacement, which is the subject of the last part of this chapter.
Example 2.54 (Successor or limit). Classify , , , and as zero, successor or limit, and compute for and for .
Solution.
- is zero; is a successor; is a limit by the theorem Omega is the least limit ordinal; is a successor; is a limit.
- : for a successor ordinal the union is .
- , since every has and . This is the criterion for a limit stated in the definition Limit and successor ordinals.
2.17Power set: the statement
Definition 2.55 (Axiom of Power Set). For every set there is a set whose members are exactly the subsets of :
By Extensionality this is unique; we write it .
Strictly, the axiom as usually stated only asserts a set containing every subset of ; Separation then trims it to exactly the subsets. That weaker form is preferred in careful treatments because it is easier to verify in models, and the two versions are equivalent over the rest of ZF.
Proposition 2.56 (Elementary facts about the power set). For all sets and :
- and , so for every ;
- if and only if ;
- if is transitive then so is .
Proof. (1) and , so both are members of . In particular has one member.
(2) If and then , so . Conversely if then by (1), so .
(3) Let , so , and let . Then , and transitivity of gives , i.e. . Hence every member of a member of is a member of .∎
Pitfall. and swap roles across the power set. and say the same thing, but and do not. Writing is correct; writing is not, unless happens to be a subset — which, in the von Neumann encoding, it is, and that coincidence has confused generations of students.
2.18Why power set is the strong axiom
Every other constructive axiom is size-preserving in a rough sense: Pairing produces a two-element set, Union produces something no larger than the sum of the pieces, Separation produces a subset. Power set is the only one that leaps, and Cantor's theorem measures the leap.
Proposition 2.57 (Counting the subsets of a finite set). If then .
Proof. A subset of is determined by an independent in-or-out decision for each of the members, so subsets correspond bijectively to functions , of which there are . Formally, induct on : for the only subset is and ; and adding one new member to doubles the count, since each subset of yields exactly two subsets of , one containing and one not.∎
Theorem 2.58 (Cantor's theorem). For every set there is no surjection . Hence .
Proof. Let be any function, and put
which is a set by Separation and is a subset of , so . Suppose for some . Ask whether . By the definition of ,
a contradiction either way. So is not in the range of and is not surjective. Since is an injection , the strict inequality of cardinalities follows.∎
Intuition. This is Russell's diagonal again, domesticated. Where Russell's set produced a contradiction from an unbounded comprehension, Cantor's set is a perfectly legitimate subset of — and the contradiction falls on the assumption that is onto instead of on the theory. The same three lines, aimed at a bounded target, become a theorem.
Corollary 2.59 (The power set of omega is uncountable). is not countable; that is, there is no surjection . The same holds for , which is in bijection with .
Proof. Immediate from the theorem Cantor's theorem with . For the second claim, binary expansions give an injection and Dedekind cuts give an injection ; Cantor–Schröder–Bernstein, a theorem of ZF requiring no choice, converts the two injections into a bijection.∎
Note (The continuum hypothesis). , and CH is the assertion — that no cardinality lies strictly between and its power set. Gödel showed ZFC cannot refute CH and Cohen showed ZFC cannot prove it. Power set is thus an axiom whose output size the axioms do not pin down.
2.19What power set builds
Theorem 2.60 (The standard structures of mathematics are sets). Given , the following exist as sets in ZF: the Cartesian products and , the set of integers, the set of rationals, the set of reals, and for any sets the function space and the set of all topologies on .
Proof. Products exist by the theorem Cartesian products exist, which used Power set twice. is a set of equivalence classes of , hence a subset of , obtained by Separation; likewise from . as Dedekind cuts is a set of subsets of , so a subset of , again by Separation. Function spaces are the corollary Relations and functions are sets. A topology on is a subset of with first-order closure properties, so the collection of topologies is obtained by Separation from .∎
Each line of that proof is the same move: locate the object inside an iterated power set, then separate. Power set is what makes "the set of all things of this kind over " a legitimate construction rather than a wish.
Example 2.61 (How many power sets deep?). The real line is built from . How many applications of are needed to reach a set containing , and how many to reach a set containing the collection of all topologies on ?
Solution.
- is (a subset of a set obtained from) -level material, and up to coding we may take -level. A real is a subset of , so and : two further applications beyond .
- A topology on is a subset of , so the set of all of them is a subset of : two more applications beyond .
- All of it is comfortably inside , which is why ordinary analysis never needs Replacement.
2.20Power set towers
Proposition 2.62 (Iterated power sets of a finite set). Write and . If then , , and in general the size is a tower of twos capped by .
Proof. Induct on using the proposition Counting the subsets of a finite set: each application replaces the current size by . Starting at the sizes are ∎
Example 2.63 (A tower computed). Let . Compute , and , and say which first contains .
Solution.
- , so .
- and .
- , and by the definition The von Neumann hierarchy. So , which is a member of . The tower of power sets over is exactly the finite cumulative hierarchy.
Example 2.64 (Subsets with a constraint). How many subsets does a -element set have, how many of them contain a fixed element , and how many have exactly members?
Solution.
- subsets in total, by the proposition Counting the subsets of a finite set.
- Those containing correspond to arbitrary subsets of the other elements: .
- Two-element subsets number . Each of these three collections is a set by Separation applied to — counting is combinatorics, but existence is Power set plus Separation.
2.21Replacement: the statement
Definition 2.65 (Axiom schema of Replacement). Let be a formula of . The corresponding instance of Replacement says: if is functional on , meaning
then there is a set containing exactly the corresponding values,
Informally: the image of a set under a definable class function is a set.
Intuition. Separation shrinks: it hands back part of a set you already had. Replacement relabels: it keeps the index set and swaps each member for whatever the formula names, however much larger that is. The size of the output is the size of — no more — but its rank can be enormously higher, and rank, not size, is what the other axioms cannot climb.
Theorem 2.66 (Separation follows from Replacement). Every instance of Separation is derivable from the corresponding instance of Replacement (together with the existence of some set).
Proof. Fix and a formula . Define for a fixed chosen as follows. If no member of satisfies , then , which exists. Otherwise pick with . Then is functional on : each is sent to itself if it satisfies , and to otherwise. By Replacement the image is a set, and that image is exactly , since itself satisfies .∎
Remark. So the official list of nine axioms is redundant: Separation is a consequence of Replacement, and Pairing is a consequence of Replacement plus Power set (replace the two members of , a two-element set, by and ). The redundant items are kept because Zermelo set theory Z — ZF without Replacement — is a natural and much-used weaker system in which Separation must be assumed outright.
2.22Replacement is a schema
Replacement is not one axiom. There is no way, in first-order logic, to say "for every formula …", because quantification ranges over sets and not over formulas of the language. What we have instead is a recipe that emits one axiom for each formula, and the collection of emitted axioms is infinite.
Definition 2.67 (Axiom schema). An axiom schema is a decidable set of axioms given by a template with a syntactic parameter — here, the formula — so that the theory has infinitely many axioms although only finitely many templates. Separation and Replacement are the two schemas of ZFC; every other axiom on the list is a single sentence.
Note (ZFC is not finitely axiomatisable). If ZFC is consistent, then no finite set of sentences has exactly the same consequences as ZFC. The reason is the reflection theorem: for each finite fragment of ZFC, ZFC proves that some level is a model of . If a finite axiomatised all of ZFC, then ZFC would prove that some set is a model of ZFC, hence prove , contradicting Gödel's second incompleteness theorem. So the infinitude of the schemas is essential, not a presentational convenience. By contrast, the class theory NBG is finitely axiomatisable, because it can quantify over classes and so state Replacement in one sentence.
Example 2.68 (Writing one instance). State the instance of Replacement used to prove that is a set.
Solution.
- Take , which says " is the power set of ".
- Power set gives existence of such a and Extensionality gives uniqueness, so : the formula is functional on .
- That instance of Replacement then yields the set . Note that a different formula would be a different axiom; nothing in the theory quantifies over .
Pitfall. Replacement requires to be functional — exactly one per . If several can answer to one , the instance does not apply, and the corresponding principle (Collection, which asks only for a set containing at least one witness for each ) is a separate axiom, equivalent to Replacement over ZF but not over weaker systems.
2.23What replacement is for
Replacement earns its place in three ways: it licenses transfinite recursion, it produces ordinals beyond the reach of Zermelo set theory, and it makes rank a total function. All three are the same fact wearing different clothes — Replacement is the axiom that lets you climb.
Theorem 2.69 (Transfinite recursion). Let be a definable class function. Then there is a unique definable class function on the ordinals with for every , and for each ordinal the restriction is a set.
Proof. Call an -approximation if is a function with domain satisfying for all . By -induction on , any two approximations agree on the intersection of their domains, so approximations are unique where defined; and an -approximation exists for every , since at a successor one appends and at a limit one takes the union of the earlier approximations — and that union is a set precisely because Replacement turns the set of indices into the set of approximations indexed by them. Defining to be the common value gives the result.∎
Without Replacement the limit step fails: you can form each approximation but not the set of them, so the recursion stalls at the first limit stage that needs collecting. That is exactly what goes wrong in Zermelo set theory.
Note (Where Zermelo set theory stops). satisfies every axiom of ZFC except Replacement. It contains , , every function space over , and all of ordinary analysis — which is why Replacement is invisible to most mathematicians. What it does not contain is the set or the ordinal , both of which exist in ZF. So Replacement is not decorative; it is what distinguishes ZF from Z, and it fails to be provable in Z for exactly this reason.
Example 2.70 (The ordinal that Zermelo cannot reach). Show that ZF proves the existence of , naming the axioms used.
Solution.
- The map is definable by a formula and is functional on , since ordinal addition is defined by transfinite recursion and is single-valued.
- Replacement applied to with that formula yields the set .
- Union applied to that set gives its supremum , an ordinal. Infinity supplied , Replacement supplied the family, Union supplied the limit — three axioms, and Separation and Power set were not needed.
2.24Replacement in action
The cleanest demonstration of what Replacement adds is a set that Separation provably cannot produce, because Separation can only ever cut a subset out of something already available, and here nothing available is large enough.
Theorem 2.71 (The power set tower over omega is a set). ZF proves the existence of the set
Proof. Let be a formula expressing " ". This is first-order expressible: says that there exists a function with domain such that , for , and . Such an is a finite sequence, hence a set, and Power set plus Extensionality make it unique, so .
Replacement applied to with now delivers the image as a set. Union then gives , a set of rank at least .∎
Remark. Separation alone cannot reach this set. Each has rank roughly , so any set containing all of them has rank at least — and by the note Where Zermelo set theory stops, is a model of Zermelo set theory in which no such set exists. Separation could only carve this collection out of a set already containing every member of it, and Z proves no such set exists.
Example 2.72 (Replacement versus Separation on the same target). You want the set . Can Separation do it, and does the answer change for ?
Solution.
- For , yes: exists by five applications of Power set, and all six sets are members of up to the usual coding, so Separation carves them out of that single ambient set.
- For all there is no such ambient set to carve from — that is precisely the content of the remark above — so Separation cannot do it and Replacement is required.
- The general lesson: finitely many steps of any construction stay inside the reach of the other axioms; assembling all the steps into one set is Replacement's job.
Example 2.73 (A definable image that is small but high). Let and let say . What does Replacement produce, and how many members does it have?
Solution.
- is functional on , so Replacement yields .
- It has exactly members — Replacement never increases cardinality, since the image of a -element set has at most members and here the three values are distinct.
- But its rank is , far above the rank of . Small and high: that is the signature of Replacement, and the reason it cannot be replaced by Separation.
Pitfall. "Replacement lets you build bigger sets" is only half right and misleads. always. What grows is rank, not cardinality — and what makes that possible is that the values may live arbitrarily far up the hierarchy even though there are few of them.
- Using unrestricted comprehension. Writing with no bounding set is the move ZF exists to forbid. Always write , and if no such is available, you need Replacement or you need to admit you are describing a proper class.
- Thinking Russell's paradox is about self-membership. It is about the non-existence of a set of all non-self-membered sets. That no set contains itself is a different fact, proved from Regularity.
- Confusing with . for every , but only for some. is generally false; is not the same claim as either.
- Forgetting the degenerate case of the ordered pair. has one member, not two. Any proof of the pair characterisation that does not split on is incomplete.
- Believing Infinity gives you directly. It gives an inductive set. is the intersection of all inductive subsets of it, and that intersection step is Separation.
- Reading as . Union is unary and flattens a set of sets; the binary is derived from Pairing plus Union.
- Claiming exists. It would be the universal set, which the theorem Separation blocks Russell, and proves there is no universal set forbids. The hypothesis is not decoration.
- Treating Replacement as one axiom. It is a schema, one axiom per formula, and that infinitude is why ZFC is not finitely axiomatisable.
- Applying Replacement to a non-functional formula. Exactly one per is required; otherwise you are using Collection, which is a different principle.
- Invoking Choice without noticing. "Pick one from each" is free for finite families and for families with a definable selection, and is an axiom otherwise. Conversely, over-citing Choice is its own error: Cantor's theorem, Cantor–Schröder–Bernstein and everything about in this chapter are theorems of ZF alone.
- Expecting the axioms to settle everything. CH and the existence of large cardinals are independent of ZFC. Independence is the normal condition of a strong theory, not a sign that something is broken.