Contents / Mathematical Logic / Model Theory
Chapter 5
Model Theory
Structures, satisfaction, elementary equivalence, substructures, ultraproducts, and the completeness theorem.
Introduction
A formal language is a supply of marks on paper: symbols, formulas, proofs. A mathematical structure is a set with some operations and relations on it. Model theory is the systematic study of the map between the two — which structures make which sentences true, and what that correspondence can and cannot see.
The subject's characteristic discovery is that the correspondence is lossy in a precisely measurable way. First-order logic cannot count past the finite: a theory with arbitrarily large finite models has an infinite one, a theory with one infinite model has models of every infinite size, and no first-order theory pins down up to isomorphism. Those limitations are not defects to be patched; they are theorems, and each of them is a tool. Compactness manufactures infinite integers; Löwenheim–Skolem manufactures countable models of set theory; ultraproducts manufacture a single structure out of infinitely many and prove compactness as a by-product.
This chapter builds the machinery in order: structures and the maps between them, elementary equivalence and elementary substructures, the two Löwenheim–Skolem theorems, compactness and its standard harvest, filters and the ultraproduct construction with Łoś's theorem, the completeness theorem in its model-existence form, and finally categoricity and quantifier elimination — the tools that let you prove a theory complete and then decide its sentences.
5.1Structures, Homomorphisms and Embeddings
Everything begins with a choice of vocabulary. A signature (or language) is a set of constant symbols, function symbols and relation symbols, each function and relation symbol carrying an arity, the number of arguments it takes. The signature of ordered rings is ; the signature of graphs is a single binary relation ; the signature of pure set theory is a single binary relation . Nothing in the signature has meaning yet: is a mark with arity .
Definition 5.1 (Structure). An -structure consists of a non-empty set , called the domain or universe, together with an interpretation of each symbol of :
- each constant symbol receives an element ;
- each -ary function symbol receives a function ;
- each -ary relation symbol receives a set .
The cardinality of is .
The non-emptiness requirement is not cosmetic. Classical first-order semantics validates , and a great many derivations silently instantiate a universal quantifier to obtain an element; both fail over an empty domain. Free logics drop the requirement and pay for it with a more complicated deduction system.
Interpretations of the symbols propagate to interpretations of terms. Given an assignment of domain elements to variables, define by recursion: a variable denotes , a constant denotes , and denotes . Formulas are then evaluated by a second recursion.
Definition 5.2 (Satisfaction). The relation (" satisfies under the assignment ") is defined by recursion on the structure of :
- iff and are the same element;
- iff ;
- iff fails, and the clauses for follow the truth tables;
- iff for some assignment agreeing with off ;
- iff for every such .
The value of depends on only through its values on the free variables of — an easy induction. A sentence has no free variables, so for sentences we drop and write . A theory is a set of sentences; means satisfies every member, and then is a model of . We write when every model of satisfies , and for the set of all sentences true in — the complete theory of .
Intuition. A signature is a list of names with no meanings attached. A structure hands out the meanings: here is the set of things we are talking about, here is what " " does to two of them, here is which pairs count as " ". Satisfaction is then nothing more than reading a sentence aloud with those meanings substituted and checking whether what you said is true.
Structures over the same signature are compared by maps that respect the interpretations.
Definition 5.3 (Homomorphism, embedding, isomorphism). Let be -structures. A homomorphism is a function with
and for every relation symbol .
It is an embedding if moreover is injective and the relational condition holds in both directions:
An isomorphism is a surjective embedding; means one exists.
The one-directional relational clause is what separates a homomorphism from an embedding, and the separation is real: the identity map from with interpreted as the empty relation into is a bijective homomorphism that is not an embedding, because it does not reflect the relation. Algebra usually escapes the distinction because groups, rings and fields have purely functional signatures, where an injective homomorphism is automatically an embedding.
Definition 5.4 (Substructure). is a substructure of , written , if , every lies in and equals , each is the restriction of to (so must be closed under ), and each .
Substructures and embeddings are two views of one notion: is an embedding exactly when it is an isomorphism onto a substructure of . The next lemma records precisely which formulas a substructure inherits, and it is the reason "substructure" is a far weaker relation than it looks.
Lemma 5.5 (Embeddings preserve quantifier-free formulas). Let be an embedding and a quantifier-free formula. Then for all ,
Proof. First, terms: induction on gives . For a variable this is trivial, for a constant it is the clause , and for it is the function clause applied to the inductive hypotheses.
Now induct on . If is , then says ; applying and the term identity gives , and injectivity of gives the converse direction. If is , the two-directional relational clause is exactly what is needed. The Boolean cases are immediate, since a biconditional is preserved by negation and conjunction. There is no quantifier case, which is the whole point: the argument collapses the moment a quantifier appears, because a witness in need not lie in the image of .∎
Example 5.6 (Counting structures on a fixed domain). How many distinct -structures are there on the fixed three-element domain , where has one constant symbol , one unary function symbol and one binary relation symbol ?
Solution. A structure is exactly a choice of interpretation for each symbol, and the choices are independent, so count each and multiply.
Step 1 (the constant). is any element of : choices.
Step 2 (the function). is any map : choices.
Step 3 (the relation). is any subset of , a nine-element set: choices.
Step 4 (multiply). .
Sanity check: dropping leaves structures, and each of those is refined by one of relations, reproducing the same total. This counts labelled structures on a fixed domain, not isomorphism types — of the latter there are far fewer.□
Example 5.7 (Evaluating satisfaction step by step). Let have domain , constant , and unary the successor modulo . Does ?
Solution. Step 1 (unfold the quantifier). By the clause for , the sentence holds iff for every .
Step 2 (evaluate the term). Applying three times cycles all the way around: , , . In each case the value returns to .
Step 3 (check the atomic formula). The atomic clause for asks whether both sides denote the same element, which Step 2 confirms for all three . Hence .
The same sentence is false in , where the successor function is injective but not surjective. Satisfaction is a relation between a sentence and a world, never a property of the sentence alone.□
Pitfall. " " constrains the atomic data only, and by Lemma Embeddings preserve quantifier-free formulas that is exactly as far as the guarantee reaches. is a substructure of , yet "every non-zero element has a multiplicative inverse" is false in the first and true in the second.
Notation. denote structures and the matching italic letters their domains. denotes enlarged by a fresh constant symbol for every , and is read as an -structure by interpreting as . This device — naming the elements — is used constantly from the next section onward. The atomic diagram is the set of atomic and negated atomic -sentences true in ; the elementary diagram is the set of all -sentences true in .
5.2Elementary Equivalence and Elementary Substructures
Isomorphism is the strongest comparison between structures and is usually out of reach; first-order logic offers a coarser one that is often exactly the right granularity.
Definition 5.8 (Elementary equivalence). Structures and are elementarily equivalent, written , if they satisfy exactly the same -sentences:
equivalently .
Proposition 5.9 (Isomorphism implies elementary equivalence). If then .
Proof. Let be an isomorphism. Extend Lemma Embeddings preserve quantifier-free formulas by induction through the quantifiers, which is now legitimate because is onto. For : if with witness , then by the induction hypothesis , so . Conversely a witness is for some by surjectivity, and the induction hypothesis pulls it back. The universal case is the same argument, or the existential one applied to . Taking a sentence gives the claim.∎
The converse fails badly, and the failure is the engine of the whole subject: first-order logic cannot see cardinality.
Example 5.10 (Elementary equivalence without isomorphism). Show that and are elementarily equivalent but not isomorphic, in the language with the single binary symbol .
Solution. Step 1 (no isomorphism). An isomorphism is in particular a bijection of domains, and is countable while is not. So none exists.
Step 2 (both are models of DLO). Each is a linear order; between any two elements lies a third, namely ; and neither has a least or a greatest element. These are exactly the axioms of DLO, the theory of dense linear orders without endpoints.
Step 3 (DLO is complete). The section Categoricity and Quantifier Elimination proves DLO is -categorical and deduces completeness from Vaught's test. A complete theory decides every sentence, so any two of its models agree on every sentence.
Conclusion. while . The cardinality gap is invisible to first-order sentences over .□
Inside a fixed the corresponding refinement of "substructure" is the central notion of the chapter.
Definition 5.11 (Elementary substructure). A substructure is an elementary substructure, written , if for every formula and every tuple from ,
An embedding whose image is an elementary substructure is an elementary embedding.
Note the quantifier order. Elementary equivalence compares two structures on sentences; elementary substructure demands agreement on all formulas with parameters from the small structure. The second is strictly stronger than together with : there are structures with , hence , and still — for instance , which is isomorphic to the whole but omits the element lying strictly between the parameters and .
Verifying the definition directly means checking infinitely many formulas of unbounded quantifier depth. The following test reduces the work to a single quantifier alternation, and is the workhorse behind every construction in the next two sections.
Theorem 5.12 (Tarski–Vaught test). Let be a substructure. Then if and only if:
for every formula and every tuple from , if there is with , then there is with .
Proof. () Suppose and for some . Then , so by elementarity , giving some with ; elementarity again lifts this to .
() Assume the condition and prove by induction on .
Atomic. This is the substructure hypothesis: constants, functions and relations agree by restriction, so Lemma Embeddings preserve quantifier-free formulas applies to the inclusion embedding.
Negation. If the equivalence holds for , negating both sides preserves it.
Conjunction. iff both conjuncts hold in , iff (induction) both hold in , iff . The other connectives are definable from .
Existential. Let with from . If , take with ; the induction hypothesis for — applicable since and all lie in — gives , so . Conversely, if there is with ; the test supplies with , and the induction hypothesis converts this to , whence .
Since is , the universal case is covered. This completes the induction, so .∎
Intuition. Read the test as: never has to leave home. Whenever the big structure can satisfy an existential demand using parameters already owns, owns a witness too. If that is true for every demand, can simulate 's entire first-order reasoning internally, and the two agree on everything expressible.
Example 5.13 (A substructure that is not elementary). Show , using the Tarski–Vaught test.
Solution. Step 1 (it is a substructure). , the language has no constants or function symbols, and is the restriction of . So the inclusion is a substructure.
Step 2 (produce a failing witness demand). Take to be and the parameters , , both in . In the element satisfies .
Step 3 (no witness at home). No integer lies strictly between and , so no satisfies . The test fails, hence .
Step 4 (in fact they are not even elementarily equivalent). The density sentence is true in and false in , so .□
Pitfall. together with does not give , as shows. Elementary equivalence quantifies over sentences with no parameters; elementary substructure demands agreement on formulas with parameters, which is a strictly stronger requirement.
Example 5.15 (A substructure that is elementary). Show that .
Solution. Step 1 (it is a substructure). and the order is inherited; there is nothing to close under.
Step 2 (reduce the witness demand to inequalities). Let be any formula and a tuple of rationals, and suppose some real has . By quantifier elimination for DLO — proved in the section Categoricity and Quantifier Elimination — is equivalent over to a quantifier-free formula, that is a Boolean combination of the atomic statements , and .
Step 3 (describe the solution set). A Boolean combination of those conditions defines a set that is a finite union of the points and of open intervals whose endpoints lie in or are . It is non-empty, since belongs to it.
Step 4 (find a rational in it). A point is already rational. A non-empty open interval with rational or infinite endpoints contains a rational, by density of in . Either way there is a rational witness with .
Step 5 (apply the test). Theorem Tarski–Vaught test now gives — a strictly stronger statement than the elementary equivalence established above, and the reason may be used as a "small copy" of for any question expressible in the order alone.□
5.3Löwenheim–Skolem: Shrinking and Growing Models
The Tarski–Vaught test does more than diagnose; run as a construction, it builds elementary substructures to order. Given and any subset , close under witnesses for every existential demand, repeat countably many times, and the union satisfies the test automatically. Controlling the cardinality of the result is what makes the theorem sharp.
Definition 5.16 (Skolem function). Fix a well-ordering of . For each formula with of length , define by: is the -least with if any exists, and the -least element of otherwise. These are the Skolem functions of .
Theorem 5.17 (Downward Löwenheim–Skolem). Let be an -structure and . Then there is with and
In particular, if is countable, every structure has a countable elementary substructure containing any prescribed countable set.
Proof. Write . There are exactly formulas, hence at most Skolem functions .
Set if is empty, and otherwise, so and . Define recursively
and put .
Cardinality. If then the set of tuples from has size at most , and there are at most Skolem functions, so at most new elements appear; hence . A countable union of sets of size at most has size at most , so , and by construction.
carries a substructure. For a function symbol and from , all of lies in some single (the chain is increasing and is finite). Taking to be , the value lands in . Constants are handled by equal to . So is closed, and we give it the induced structure .
Tarski–Vaught. Let be a formula, a tuple from , and suppose some has . Again lies in some , so , and since a witness exists, is one. The test is met, so by Theorem Tarski–Vaught test, .∎
Note where the axiom of choice enters: the well-ordering of used to define the Skolem functions. Without choice one selects witnesses ad hoc and the theorem becomes delicate.
The other direction grows models instead, and its proof runs through compactness — stated in the next section and proved in the one after that, so no circularity arises.
Theorem 5.18 (Upward Löwenheim–Skolem). Let be an infinite -structure and let . Then there is of cardinality exactly with (more precisely, with an elementary embedding of into ).
Proof. Work in the language with a constant for each , and add further fresh constants . Let
Every finite subset of has a model. A finite subset mentions only finitely many of the , say . Interpret those as distinct elements of — possible because is infinite — and interpret each as . The resulting expansion of satisfies the elementary diagram (it is ) and the finitely many inequations.
Apply compactness. By Theorem Compactness, has a model . The map is an elementary embedding of into the -reduct, precisely because satisfies every sentence of the elementary diagram, and it is injective because contains for distinct . The constants are pairwise distinct, so .
Trim to size exactly . The language has cardinality at most . Apply Theorem Downward Löwenheim–Skolem inside to the subset , of size : it yields containing with , and since . So , and composing the two elementary maps embeds elementarily into .∎
Corollary 5.19 (No infinite structure is determined up to isomorphism). If a theory in a countable language has an infinite model, it has models of every infinite cardinality , and hence models that are elementarily equivalent but not isomorphic.
Proof. Downward Löwenheim–Skolem gives a countable model; upward gives one of each larger size. Structures of different cardinality cannot be isomorphic, yet all are models of the complete theory of the original, so all are elementarily equivalent to it.∎
Example 5.20 (The Skolem paradox). ZFC proves the existence of uncountable sets. If ZFC is consistent, it has a countable model . How can a countable contain an element it believes to be uncountable?
Solution. Step 1 (both halves are genuine). If ZFC is consistent it has a model, and its language is countable, so Theorem Downward Löwenheim–Skolem yields a countable elementary substructure — a countable . Meanwhile ZFC proves , so there is with " is uncountable".
Step 2 (unfold what "uncountable" says). " is uncountable" is the sentence: there is no bijection between and . That is a statement quantifying over the elements of only. So asserts that no member of codes such a bijection.
Step 3 (the bijection lives outside). The set is a subset of the countable set , hence countable in the real world, so a bijection with exists externally. It is simply not an element of . The model is missing the very function that would refute it.
Step 4 (diagnosis). "Uncountable" is not an absolute property; it is relative to which functions a model possesses. The paradox dissolves once one notices that 's quantifiers range over , not over the universe. Nothing is contradictory: is uncountable in and countable outside it.□
Pitfall. The Skolem paradox is often misread as "Löwenheim–Skolem refutes Cantor's theorem". It does not. Cantor's theorem holds inside every model of ZFC — the model contains no surjection from onto its power set. What varies between models is which external functions have been admitted as elements, and first-order set theory cannot say "all functions", only "all functions that are elements of me".
Intuition. Downward Löwenheim–Skolem is a closure argument: keep throwing in one witness per existential demand until nothing new is demanded. Upward Löwenheim–Skolem is a padding argument: ask for pairwise distinct new constants, note that each finite portion of the demand is satisfiable inside the old infinite model, and let compactness grant the whole demand at once.
5.4Compactness and What It Builds
Theorem 5.21 (Compactness). A set of first-order sentences has a model if and only if every finite subset of has a model.
The left-to-right direction is trivial: a model of is a model of each subset. The content is the converse, and this chapter proves it twice — once from ultraproducts in the section Filters, Ultraproducts and Łoś's Theorem, and once from the Henkin construction in The Completeness Theorem Revisited. Until then it is used as a stated theorem, not assumed silently.
Intuition. Read compactness as a finiteness of evidence principle. A proof is a finite object, so it can only appeal to finitely many axioms; therefore an inconsistency, if one exists, is already visible in a finite subtheory. Contrapositively, if no finite subtheory is inconsistent, the whole theory is satisfiable. That is exactly why a compactness argument can grant infinitely many demands at once: nothing can go wrong globally that was not already wrong locally.
The standard use is a two-step template: to build a model with a strange property, write down a theory whose models must have it, then verify finite satisfiability inside an ordinary structure.
Theorem 5.22 (Non-standard models of arithmetic). Let be the complete theory of the standard model — true arithmetic. Then there is a model containing an element larger than every standard natural number. Hence but .
Proof. Add one fresh constant and set
where is the numeral with occurrences of .
A finite subset mentions only finitely many numerals, so there is a largest with in . Interpret as in the standard model: every sentence of is true there, and each of the finitely many inequations holds. So has a model.
By Theorem Compactness, has a model . Its interpretation exceeds every , so it is not equal to any numeral value and is not isomorphic to (in , every element is a numeral value). But , so it satisfies exactly the same sentences as .∎
Every non-standard has a rigid shape. Its standard part — the numeral values — forms an initial copy of . Above it, each non-standard element has a predecessor and a successor, all still non-standard, so the non-standard elements fall into -shaped blocks. The blocks are densely ordered without endpoints, since between blocks and with far below lies the block of . For a countable the block order is a countable DLO, hence a copy of : the order type is .
Theorem 5.24 (Arbitrarily large finite models give an infinite model). If a theory has finite models of unboundedly large size, then has an infinite model. Consequently, the class of finite structures is not the class of models of any first-order theory, and "finite" is not first-order expressible.
Proof. For each let be the sentence "there exist at least distinct elements", namely . Put .
A finite subset of contains finitely many , with a largest index . By hypothesis has a model with at least elements, and that model satisfies . So every finite subset of is satisfiable, and Theorem Compactness gives a model of . It satisfies every , so it is infinite, and it models .
For the consequence: if some theory had exactly the finite structures as models, it would have arbitrarily large finite models and therefore an infinite one, a contradiction.∎
The same template yields non-standard analysis. Adjoin a constant to the complete theory of the ordered field with a symbol for every real, together with . Every finite subset is satisfiable in itself by choosing small enough, so compactness delivers an ordered field elementarily equivalent to containing a positive infinitesimal.
Definition 5.25 (Order indiscernibles). Let be a structure and a linear order. A family of elements of is a set of order indiscernibles if for every formula and all increasing tuples and from ,
That is, the truth of a formula depends only on the relative order of the arguments, not on which elements were chosen.
Theorem 5.26 (Ehrenfeucht–Mostowski: existence of indiscernibles). Every theory with an infinite model has, for each linear order , a model containing a set of order indiscernibles indexed by .
Proof (Sketch). This is a sketch; it rests on two results proved elsewhere — Ramsey's theorem for -tuples (see the combinatorics chapter) and Theorem Compactness.
Take with an infinite model. Add constants and let
the last family taken over all formulas and all pairs of increasing tuples. By compactness it suffices to model each finite subset , which mentions finitely many formulas , each of arity at most , and finitely many constants — say of them.
Inside an infinite model , colour each increasing -tuple from an infinite subset by the tuple of truth values of on it: finitely many colours, namely . Ramsey's theorem yields an infinite monochromatic set : on increasing -tuples from , every has constant truth value. Interpreting the constants as increasing elements of models .
Compactness then gives a model of , in which the interpretations of the are indiscernible by construction.∎
Example 5.27 (Compactness fails for second-order logic). Show that the compactness theorem is genuinely a first-order phenomenon by exhibiting a second-order theory each of whose finite subsets is satisfiable, but which has no model.
Solution. Step 1 (second-order logic can say "finite"). In second-order logic one can write a sentence asserting the Dedekind-finiteness of the universe: every injective function from the universe to itself is surjective. This quantifies over functions, so it is not first-order.
Step 2 (build the theory). Let with as in Theorem Arbitrarily large finite models give an infinite model.
Step 3 (finite subsets are satisfiable). A finite subset involves at most; any finite set of size satisfies those and is Dedekind-finite, so it models the subset.
Step 4 (the whole theory is not). A model of all the is infinite, and an infinite set admits an injective non-surjective self-map, contradicting . So has no model, and compactness fails.
This also re-proves that cannot be first-order expressible: if it were, Theorem Compactness would be contradicted.□
5.5Filters, Ultraproducts and Łoś's Theorem
Compactness produced models by a soft existence argument. Ultraproducts produce them explicitly: they take a family of structures and a notion of "large index set", and build one structure whose truths are the truths holding on large sets of coordinates. The notion of largeness is what a filter formalises.
Definition 5.28 (Filter and ultrafilter). A filter on a non-empty set is a family of subsets of such that , , is closed under finite intersections, and is closed upward ( and imply ).
An ultrafilter is a filter with the maximality property
Since and is closed under intersection, exactly one of the two holds.
is principal if for some fixed , and non-principal otherwise.
Proposition 5.29 (Non-principal ultrafilters contain the cofinite sets). An ultrafilter on is non-principal if and only if it contains no finite set. In that case contains every cofinite subset of .
Proof. If contains a finite set, take one of least size, . For each , either or its complement is. If some , then upward closure makes principal at . Otherwise every complement is in , and intersecting all of them with gives , a contradiction. So a non-principal contains no finite set; and conversely a principal contains the singleton .
If is cofinite then is finite, hence not in , hence by maximality.∎
Theorem 5.30 (Ultrafilter lemma). Every filter on extends to an ultrafilter on . In particular, on an infinite the Fréchet filter of cofinite sets extends to a non-principal ultrafilter.
Proof. Order the filters on extending the given by inclusion. The union of a chain of such filters is again a filter — closure under finite intersection involves only two members, which lie in a common link of the chain, and is in no link. So Zorn's lemma gives a maximal filter .
Maximality gives the ultrafilter property. Suppose and . If for every , then is a filter properly containing , contradicting maximality. So for some , i.e. , whence by upward closure — a contradiction. Applying this to the Fréchet filter on an infinite yields an ultrafilter containing all cofinite sets, hence non-principal by Proposition Non-principal ultrafilters contain the cofinite sets.∎
Pitfall. The ultrafilter lemma is a genuine use of choice: it is not provable in ZF alone. No non-principal ultrafilter on can be exhibited by an explicit rule, so "take a non-principal " is always an appeal to Zorn's lemma, never a construction.
Definition 5.31 (Ultraproduct and ultrapower). Let be -structures and an ultrafilter on . On the Cartesian product define
This is an equivalence relation, by the filter axioms. The ultraproduct has domain the set of classes , with
When all are the same , the result is the ultrapower .
The definitions are well posed: if then the agreement sets intersect, and a finite intersection of -sets is in , so the value of a function or the truth of a relation does not depend on the representatives chosen.
Theorem 5.32 (Łoś's theorem). For every formula and all classes in the ultraproduct,
In particular, a sentence holds in the ultraproduct exactly when it holds in -almost all factors.
Proof. Induction on . Write for the index set on the right.
Atomic. A term induction shows , using the coordinatewise definition of the functions. The clauses for and then read off the definition of and of in the ultraproduct, which are stated exactly as membership of the relevant index set in .
Negation. By the induction hypothesis, iff , and by the ultrafilter property this holds iff ; but . This is the only step using maximality of , and it is the step that fails for a general filter.
Conjunction. . Closure under finite intersection gives one direction and upward closure the other.
Existential. Suppose , witnessed by a class . By the induction hypothesis , and this set is contained in , which is therefore in by upward closure.
Conversely let . For each choose (axiom of choice) some with , and for let be arbitrary. Then , so that set is in , and the induction hypothesis gives , hence .
The universal quantifier is , already covered.∎
Corollary 5.33 (Ultrapowers are elementary extensions). The diagonal map sending to the class of the constant sequence is an elementary embedding.
Proof. For a formula and from , the index set is either all of (if ) or empty (if not). The first is in and the second is not, so Łoś's theorem gives iff .∎
Theorem 5.34 (Compactness via ultraproducts). If every finite subset of a theory has a model, then has a model.
Proof. Let be the set of finite subsets of , and for each pick a model . For put
The family has the finite intersection property: contains the index , so it is non-empty. Hence it generates a filter, which by Theorem Ultrafilter lemma extends to an ultrafilter on .
Fix . For every we have and , so . Thus , and the latter is in by upward closure. By Theorem Łoś's theorem, . As was arbitrary, the ultraproduct models .∎
Intuition. An ultraproduct is a majority vote across infinitely many worlds, with the ultrafilter deciding which coalitions count as a majority. Maximality — or its complement, never both, never neither — is what makes the vote decide every question, which is why the new world is a structure at all and not a partial one.
Example 5.35 (Building an infinite natural number). Let be a non-principal ultrafilter on and form the ultrapower . Show that the class of the identity sequence exceeds every standard natural number.
Solution. Step 1 (translate via Łoś). Write for the diagonal image of . By Theorem Łoś's theorem, iff .
Step 2 (the index set is cofinite). omits only , so it is cofinite.
Step 3 (apply non-principality). By Proposition Non-principal ultrafilters contain the cofinite sets, every cofinite set belongs to . Hence for every standard .
Step 4 (and the ultrapower still satisfies true arithmetic). By Corollary Ultrapowers are elementary extensions, , so every sentence of survives. This is an explicit non-standard model — the same object Theorem Non-standard models of arithmetic produced abstractly, now written down.
Contrast with the principal case: if is generated by , Łoś reduces every formula to its truth at coordinate , the map is an isomorphism, and no new element appears.□
Example 5.36 (An ultraproduct of finite fields). What is the characteristic of , where enumerates the primes and is non-principal on ?
Solution. Step 1 (each candidate characteristic is a sentence). For a fixed prime , "characteristic " is the sentence saying .
Step 2 (count the large index sets). only when , so is a single index — a finite set, hence not in the non-principal .
Step 3 (apply Łoś). So for every prime : the characteristic is .
Step 4 (what else survives). Every field axiom holds in every factor, so it holds in the ultraproduct: an infinite field of characteristic built entirely out of finite fields. Since each satisfies "every element has a -th root" only for its own , one must check sentence by sentence which properties transfer — that is exactly the content of Łoś's theorem, and it is the mechanism behind the Ax–Kochen transfer principles.□
5.6The Completeness Theorem Revisited
Compactness and Löwenheim–Skolem were semantic. The completeness theorem connects them to syntax: it says the proof system and the class of structures measure the same thing.
Theorem 5.37 (Model existence / completeness, semantic form). A theory is consistent — no derivation of a contradiction from exists — if and only if has a model. Equivalently, if and only if .
The easy half is soundness: every rule of the proof system preserves truth in a structure, so a model of cannot also model a derived contradiction. The hard half builds a model out of syntax itself, and the idea is Henkin's: let the domain consist of the closed terms of the language, so every element is literally named by a term. One obstacle stands in the way — a consistent theory may assert while no term provably witnesses it — so the construction manufactures the missing names first.
Definition 5.38 (Henkin theory). A theory in a language is a Henkin theory if for every formula with one free variable there is a constant with
Such a is a witness constant for .
Method 5.39 (Henkin construction).
- Add witnesses. For each formula add a fresh constant and the Henkin axiom . Iterate times, since each round creates new formulas needing witnesses, and take the union .
- Complete it. Extend to a maximal consistent -theory by Lindenbaum's lemma: enumerate the -sentences and add each one, or its negation, whichever keeps the theory consistent.
- Build the term model. Let the domain be the closed -terms modulo the relation iff . Interpret each constant by its own class, each function symbol by , and each relation by iff .
- Verify. Prove by induction on that the term model satisfies exactly when ; conclude it models .
Lemma 5.40 (Adding a witness preserves consistency). If is consistent and is a constant not occurring in , then is consistent.
Proof. Suppose not. Then , hence and . Since does not occur in , a derivation of from can be converted into one of for a fresh variable — replace by throughout, which leaves every axiom of unchanged and every rule valid. Generalising, , that is . Together with this contradicts consistency of .∎
Proof (Sketch). Proof sketch of Theorem "Model existence / completeness, semantic form". This sketch fills in the two steps of the Henkin recipe that are not immediate, and rests on Lemma Adding a witness preserves consistency and on Zorn's lemma (or, for a countable language, a plain enumeration).
Step 1 preserves consistency: a single witness is safe by the lemma, a finite iteration by induction, and the -limit because any derivation of a contradiction is finite and so lives at a finite stage. Step 2 preserves consistency by the same finiteness argument applied to Lindenbaum's chain. For step 4 one proves the truth lemma by induction on : the atomic case is the definition of the term model; the Boolean cases use that is maximal consistent, so it contains exactly one of and contains iff it contains both; and the existential case is where the witnesses pay off — if then the Henkin axiom and maximality put , so the class is a genuine witness inside the term model. Finally, the -reduct of the term model is a model of .
The one further wrinkle: if the language has no constants, the term model could be empty, which structures may not be. Adding the witness constants in step 1 removes that possibility.∎
Corollary 5.41 (Compactness from completeness). Theorem Compactness follows from Theorem Model existence / completeness, semantic form.
Proof. Suppose every finite subset of has a model. If were inconsistent, there would be a derivation of a contradiction from ; a derivation is a finite object and cites only finitely many members . Then is inconsistent, so by soundness has no model — contradicting the hypothesis. Hence is consistent, and by model existence it has a model.∎
This is the second, independent proof of compactness promised earlier; the ultraproduct proof in the previous section used no proof system at all.
Intuition. Think of a theory as a wish list for a world. Soundness says a world cannot grant contradictory wishes. Completeness says the converse: if the wish list never contradicts itself on paper, some world granting all of it exists. The Henkin trick is to build that world out of the wish list's own vocabulary — every object in it is a phrase, and the theory's job is to decide which phrases name the same thing.
Example 5.42 (Consistency gives a model, traced through Henkin). Let in a language with one unary predicate and nothing else. Trace the Henkin construction to produce a model.
Solution. Step 1 (witnesses). needs witnesses for and for : add fresh constants with axioms and . By Lemma Adding a witness preserves consistency the enlarged theory is consistent.
Step 2 (complete). Extend to a maximal consistent . Since , modus ponens and maximality give ; likewise .
Step 3 (term model). The closed terms are and . Nothing in forces — indeed refutes it — so the domain is , of size , and is interpreted as .
Step 4 (check). satisfies , so holds; satisfies , so holds. Both axioms are true, giving with .□
Pitfall. Completeness says some model exists, never that it is the model you had in mind. The theory of true arithmetic is consistent, and among its models are the non-standard ones of Theorem Non-standard models of arithmetic. Consistency buys satisfiability, not standardness — and by Corollary No infinite structure is determined up to isomorphism, no first-order theory can buy standardness.
Remark. Completeness and Gödel's incompleteness theorems are different statements about different objects and are consistent with one another. Completeness says: what is true in all models is provable. Incompleteness says: for a theory like Peano arithmetic there are sentences true in the standard model but false in another model, so they are true in some models and false in others, hence not provable and not refutable. The gap between "true in " and "true in all models of PA" is exactly where independent sentences live.
5.7Categoricity and Quantifier Elimination
Corollary No infinite structure is determined up to isomorphism says no first-order theory determines an infinite model up to isomorphism. The best available substitute is determination within a cardinality, and it turns out to be strong enough to prove completeness.
Definition 5.43 (Categoricity). A theory is -categorical, for an infinite cardinal , if has a model of cardinality and any two models of of cardinality are isomorphic.
Theorem 5.44 (Vaught's test). Let be a theory in a language with no finite models, and suppose is -categorical for some . Then is complete: for every sentence , either or .
Proof. Suppose not: there are models and . Both theories are satisfiable, and neither has a finite model, so both and are infinite.
By Theorem Downward Löwenheim–Skolem and Theorem Upward Löwenheim–Skolem applied to each, there are and both of cardinality exactly — shrink if the model is larger than , grow if smaller, which is legitimate since .
Now and are models of of the same cardinality , so -categoricity makes them isomorphic, and by Proposition Isomorphism implies elementary equivalence, . But and — a contradiction. Hence decides every sentence.∎
Example 5.45 (DLO is -categorical, hence complete). Prove that any two countable dense linear orders without endpoints are isomorphic, and deduce that DLO is complete.
Solution. Step 1 (set up the back-and-forth). Let and be countable models of DLO, enumerated. Build an increasing chain of finite partial order-isomorphisms .
Step 2 (the forth step). Given a finite order-preserving , take the least-indexed not yet in its domain. The elements already matched split into finitely many intervals, and sits in one of them; the corresponding interval of is non-empty — if the interval is bounded on both sides, density supplies a point; if unbounded on one side, "no endpoint" supplies one. Choose such a and extend.
Step 3 (the back step). Symmetrically, take the least-indexed not in the range and find a matching the same way.
Step 4 (union). Alternating the two steps ensures every enters the domain and every the range, so is an order-preserving bijection: .
Step 5 (completeness). DLO has no finite models — density forces infinitude — and the language is finite, so Theorem Vaught's test with gives completeness. This is the fact the section Elementary Equivalence and Elementary Substructures borrowed to conclude .□
Categoricity at one cardinal and at another are not independent, which is one of the deepest results in the subject.
Theorem 5.46 (Morley's categoricity theorem (quoted)). Let be a complete theory in a countable language. If is -categorical for some uncountable , then it is -categorical for every uncountable .
We quote Morley's theorem without proof: it depends on the machinery of stability theory and totally transcendental theories, well beyond this chapter. The four possible categoricity patterns it leaves — categorical in all infinite powers, only in , only above , or in none — are realised, for instance, by the theory of an infinite set with no structure, by DLO, by ACF, and by true arithmetic respectively.
The second route to completeness is syntactic and gives much more: an algorithm.
Definition 5.47 (Quantifier elimination). A theory admits quantifier elimination if for every formula there is a quantifier-free formula in the same free variables with
Lemma 5.48 (One existential over a conjunction suffices). To prove that admits quantifier elimination, it is enough to eliminate the quantifier from every formula of the form where each is atomic or negated atomic.
Proof. Argue by induction on quantifier depth. Take a formula with at least one quantifier and consider an innermost one; its scope is quantifier-free, so it can be put in disjunctive normal form. Since distributes over — is equivalent to — the problem reduces to a single disjunct, a conjunction of literals. Eliminating there produces a quantifier-free equivalent, lowering the depth by one. A universal quantifier is handled as . Iterate.∎
Example 5.49 (Quantifier elimination for dense linear orders). Eliminate the quantifier from over DLO, and describe the general procedure.
Solution. Step 1 (classify the literals). In the language every literal involving is one of , , , or a negation of these. Negations collapse: is , and is . So after re-applying the distribution of Lemma One existential over a conjunction suffices, each disjunct is a conjunction of positive literals , , .
Step 2 (kill any equality). If some conjunct is , substitute for throughout and drop the quantifier entirely. Nothing quantified remains.
Step 3 (the remaining case). Otherwise the disjunct reads . Such an exists in a dense linear order without endpoints exactly when every lower bound is below every upper bound:
with the convention that an empty conjunction is — if there are no the "no least element" axiom provides , and if there are no the "no greatest element" axiom does. The right-hand side is quantifier-free.
Step 4 (the given formula). Rewrite as and distribute, giving two disjuncts:
- , which by Step 3 becomes ;
- , which becomes .
The answer is the disjunction of the two, entirely free of quantifiers.
Step 5 (completeness again). A sentence has no free variables, so its quantifier-free equivalent is a Boolean combination of atomic sentences in a language with no constants — there are none, so the equivalent is or , decided the same way in every model. Hence DLO is complete and, since the elimination is an algorithm, decidable.□
Theorem 5.50 (Quantifier elimination for algebraically closed fields (quoted)). The theory ACF of algebraically closed fields admits quantifier elimination in the ring language . Consequently ACF, for each fixed characteristic (prime or zero), is complete, and the image of a constructible set under a projection is constructible — Chevalley's theorem.
Proof (Sketch). A sketch; the algebraic input is the theory of resultants, which is not developed here. By Lemma One existential over a conjunction suffices it is enough to eliminate from a conjunction of polynomial equations and inequations . Repeated division reduces the system to a single equation and a single inequation; "these have a common root" is then expressed by the vanishing of a resultant, a polynomial in the coefficients alone, and "the equation has a root not shared with the inequation" is a further resultant condition. Every such condition is quantifier-free in .
Completeness of ACF then follows as in Step 5 above, since a quantifier-free sentence in the ring language is a Boolean combination of numerical identities among integers, decided by the characteristic alone.∎
Remark. ACF is also -categorical for every uncountable : an algebraically closed field is determined up to isomorphism by its characteristic and its transcendence degree over the prime field, and for the transcendence degree equals . Vaught's test therefore gives completeness a second way. It is not -categorical — the countable models have transcendence degrees , pairwise non-isomorphic.
Theorem 5.51 (Ryll-Nardzewski (quoted)). A complete theory in a countable language with only infinite models is -categorical if and only if for every there are only finitely many formulas in free variables up to -equivalence.
We quote this without proof; it rests on the omitting types theorem. It explains why -categoricity is rare: it demands that the language, modulo the theory, be able to describe only finitely many kinds of -tuple. DLO passes — an -tuple is described entirely by which of its coordinates are equal and how the rest are ordered, giving finitely many possibilities. The theory of an infinite set with one unary predicate splitting it into two infinite pieces also passes. Most theories of algebraic interest fail.
Summary.
- -categoricity plus "no finite models" gives completeness (Vaught's test), and by Morley's theorem uncountable categoricity does not depend on which uncountable is chosen.
- Quantifier elimination gives completeness and decidability, by reducing every sentence to a quantifier-free one that every model evaluates identically.
- DLO is -categorical and eliminates quantifiers; ACF is uncountably categorical and eliminates quantifiers; true arithmetic is categorical in no infinite cardinal and eliminates nothing.
- Elementary equivalence is not isomorphism. only says no first-order sentence separates them. Cardinality, well-foundedness and "being standard" are invisible to first-order logic; by Corollary No infinite structure is determined up to isomorphism every infinite structure has non-isomorphic elementary equivalents.
- Substructure is not elementary substructure. constrains only the atomic data. Use Theorem Tarski–Vaught test to check elementarity, and remember that fails it.
- Forgetting that domains are non-empty. Classical first-order semantics requires ; is valid. This is why the Henkin construction must supply at least one constant.
- Believing ultraproducts are always exotic. If is principal at , Łoś's theorem collapses to evaluation at coordinate and the ultraproduct is isomorphic to . Non-principality is what buys new elements, and it costs an appeal to Zorn's lemma.
- Using Łoś's theorem with a mere filter. The negation step of the proof needs " or ". With a filter that is not maximal, the reduced product satisfies only the positive Horn part of the theory, not every formula.
- Reading the Skolem paradox as a refutation of Cantor. A countable model of ZFC still satisfies Cantor's theorem internally; it merely lacks, as an element, the external bijection that would witness countability of its "uncountable" set.
- Expecting completeness to deliver the intended model. Consistency yields some model. True arithmetic is consistent and has non-standard models; PA is consistent and has models of .
- Applying Vaught's test without excluding finite models. The empty theory in the empty language is -categorical for every infinite — any two infinite sets of the same size are isomorphic as bare sets — yet it is plainly incomplete, since "there are at least two elements" is true in some of its models and false in the one-element model. The proof of Theorem Vaught's test breaks exactly there: the Löwenheim–Skolem step needs both counterexample models to be infinite before it can resize them.