Decision problem pertaining to equivalence of expressions
This article is about algorithmic word problems in mathematics and computer science. For the term 'word problem' as often used in education, seeWord problem (mathematics education). For other uses, seeWord problem.
Incomputer algebra one often wishes to encode mathematical expressions using an expression tree. But there are often multiple equivalent expression trees. The question naturally arises of whether there is an algorithm which, given as input two expressions, decides whether they represent the same element. Such an algorithm is called asolution to the word problem. For example, imagine that are symbols representingreal numbers - then a relevant solution to the word problem would, given the input, produce the outputEQUAL, and similarly produceNOT_EQUAL from.
The most direct solution to a word problem takes the form of a normal form theorem and algorithm that maps every element in anequivalence class of expressions to a single encoding known as thenormal form - the word problem is then solved by comparing these normal forms viasyntactic equality.[1] For example one might decide that is the normal form of,, and, and devise a transformation system to rewrite those expressions to that form, in the process proving that all equivalent expressions will be rewritten to the same normal form.[2] But not all solutions to the word problem use a normal form theorem - there are algebraic properties that indirectly imply the existence of an algorithm.[1]
While the word problem asks whether two terms containingconstants are equal, a proper extension of the word problem known as theunification problem asks whether two terms containingvariables haveinstances that are equal, or in other words whether the equation has any solutions. As a common example, is a word problem in theinteger group,while is a unification problem in the same group; since the former terms happen to be equal in, the latter problem has thesubstitution as a solution.
One of the most deeply studied cases of the word problem is in the theory ofsemigroups andgroups. A timeline of papers relevant to theNovikov–Boone theorem is as follows:[3][4]
1910 (1910):Axel Thue poses a general problem of term rewriting on tree-like structures. He states "A solution of this problem in the most general case may perhaps be connected with unsurmountable difficulties".[5][6]
1912 (1912):Dehn presentsDehn's algorithm, and proves it solves the word problem for thefundamental groups of closed orientable two-dimensionalmanifolds of genus greater than or equal to 2.[8] Subsequent authors have greatly extended it to a wide range ofgroup-theoretic decision problems.[9][10][11]
1914 (1914):Axel Thue poses the word problem for finitely presented semigroups.[12]
1947 (1947):Emil Post andAndrey Markov Jr. independently construct finitely presented semigroups with unsolvable word problem.[14][15] Post's construction is built onTuring machines while Markov's uses Post's normal systems.[3]
1950 (1950):Alan Turing shows the word problem forcancellation semigroups is unsolvable,[16] by furthering Post's construction. The proof is difficult to follow but marks a turning point in the word problem for groups.[3]: 342
1955 (1955):Pyotr Novikov gives the first published proof that the word problem for groups is unsolvable, using Turing's cancellation semigroup result.[17][3]: 354 The proof contains a "Principal Lemma" equivalent toBritton's Lemma.[3]: 355
1954 (1954) – 1957 (1957):William Boone independently shows the word problem for groups is unsolvable, using Post's semigroup construction.[18][19]
1957 (1957) – 1958 (1958):John Britton gives another proof that the word problem for groups is unsolvable, based on Turing's cancellation semigroups result and some of Britton's earlier work.[20] An early version of Britton's Lemma appears.[3]: 355
1958 (1958) – 1959 (1959):Boone publishes a simplified version of his construction.[21][22]
1961 (1961):Graham Higman characterises thesubgroups of finitely presented groups withHigman's embedding theorem,[23] connecting recursion theory with group theory in an unexpected way and giving a very different proof of the unsolvability of the word problem.[3]
1961 (1961) – 1963 (1963):Britton presents a greatly simplified version of Boone's 1959 proof that the word problem for groups is unsolvable.[24] It uses a group-theoretic approach, in particularBritton's Lemma. This proof has been used in a graduate course, although more modern and condensed proofs exist.[25]
1977 (1977):Gennady Makanin proves that the existential theory of equations overfree monoids is solvable.[26]
The accessibility problem forstring rewriting systems (semi-Thue systems or semigroups) can be stated as follows: Given a semi-Thue system and two words (strings), can be transformed into by applying rules from? Note that the rewriting here is one-way. The word problem is the accessibility problem for symmetric rewrite relations, i.e. Thue systems.[27]
The accessibility and word problems areundecidable, i.e. there is no general algorithm for solving this problem.[28] This even holds if we limit the systems to have finite presentations, i.e. a finite set of symbols and a finite set of relations on those symbols.[27] Even the word problem restricted toground terms is not decidable for certain finitely presented semigroups.[29][30]
Given apresentation for a groupG, the word problem is the algorithmic problem of deciding, given as input two words inS, whether they represent the same element ofG. The word problem is one of three algorithmic problems for groups proposed byMax Dehn in 1911. It was shown byPyotr Novikov in 1955 that there exists a finitely presented groupG such that the word problem forG isundecidable.[31]
The word problem in combinatorial calculus and lambda calculus
One of the earliest proofs that a word problem is undecidable was forcombinatory logic: when are two strings of combinators equivalent? Because combinators encode all possibleTuring machines, and the equivalence of two Turing machines is undecidable, it follows that the equivalence of two strings of combinators is undecidable.Alonzo Church observed this in 1936.[32]
Likewise, one has essentially the same problem in (untyped)lambda calculus: given two distinct lambda expressions, there is no algorithm that can discern whether they are equivalent or not;equivalence is undecidable. For several typed variants of the lambda calculus, equivalence is decidable by comparison of normal forms.
Solving the word problem: deciding if usually requires heuristic search (red,green), while deciding is straightforward (grey).
The word problem for anabstract rewriting system (ARS) is quite succinct: given objectsx andy are they equivalent under?[29] The word problem for an ARS isundecidable in general. However, there is acomputable solution for the word problem in the specific case where every object reduces to a unique normal form in a finite number of steps (i.e. the system isconvergent): two objects are equivalent under if and only if they reduce to the same normal form.[33]TheKnuth-Bendix completion algorithm can be used to transform a set of equations into a convergentterm rewriting system.
Inuniversal algebra one studiesalgebraic structures consisting of agenerating setA, a collection ofoperations onA of finite arity, and a finite set of identities that these operations must satisfy. The word problem for an algebra is then to determine, given two expressions (words) involving the generators and operations, whether they represent the same element of the algebra modulo the identities. The word problems for groups and semigroups can be phrased as word problems for algebras.[1]
The word problem on freeHeyting algebras is difficult.[34] The only known results are that the free Heyting algebra on one generator is infinite, and that the freecomplete Heyting algebra on one generator exists (and has one more element than the free Heyting algebra).
The word problem onfree lattices and more generally freebounded lattices has a decidable solution. Bounded lattices are algebraic structures with the twobinary operations ∨ and ∧ and the two constants (nullary operations) 0 and 1. The set of all well-formedexpressions that can be formulated using these operations on elements from a given set of generatorsX will be calledW(X). This set of words contains many expressions that turn out to denote equal values in every lattice. For example, ifa is some element ofX, thena ∨ 1 = 1 anda ∧ 1 =a. The word problem for free bounded lattices is the problem of determining which of these elements ofW(X) denote the same element in the free bounded latticeFX, and hence in every bounded lattice.
The word problem may be resolved as follows. A relation ≤~ onW(X) may be definedinductively by settingw ≤~vif and only if one of the following holds:
w =v (this can be restricted to the case wherew andv are elements ofX),
w = 0,
v = 1,
w =w1 ∨w2 and bothw1 ≤~v andw2 ≤~v hold,
w =w1 ∧w2 and eitherw1 ≤~v orw2 ≤~v holds,
v =v1 ∨v2 and eitherw ≤~v1 orw ≤~v2 holds,
v =v1 ∧v2 and bothw ≤~v1 andw ≤~v2 hold.
This defines apreorder ≤~ onW(X), so anequivalence relation can be defined byw ~v whenw ≤~v andv ≤~w. One may then show that thepartially orderedquotient setW(X)/~ is the free bounded latticeFX.[35][36] Theequivalence classes ofW(X)/~ are the sets of all wordsw andv withw ≤~v andv ≤~w. Two well-formed wordsv andw inW(X) denote the same value in every bounded lattice if and only ifw ≤~v andv ≤~w; the latter conditions can be effectively decided using the above inductive definition. The table shows an example computation to show that the wordsx∧z andx∧z∧(x∨y) denote the same value in every bounded lattice. The case of lattices that are not bounded is treated similarly, omitting rules 2 and 3 in the above construction of ≤~.
Example: A term rewriting system to decide the word problem in the free group
Bläsius and Bürckert[37]demonstrate theKnuth–Bendix algorithm on an axiom set for groups. The algorithm yields aconfluent andnoetherianterm rewrite system that transforms every term into a uniquenormal form.[38] The rewrite rules are numbered incontiguous since some rules became redundant and were deleted during the algorithm run.The equality of two terms follows from the axioms if and only if both terms are transformed into literally the same normal form term. For example, the terms
, and
share the same normal form, viz.; therefore both terms are equal in every group.As another example, the term and has the normal form and, respectively. Since the normal forms are literally different, the original terms cannot be equal in every group. In fact, they are usually different innon-abelian groups.
Group axioms used in Knuth–Bendix completion
A1
A2
A3
Term rewrite system obtained from Knuth–Bendix completion
^Müller-Stach, Stefan (12 September 2021). "Max Dehn, Axel Thue, and the Undecidable". p. 13.arXiv:1703.09750 [math.HO].
^Steinby, Magnus; Thomas, Wolfgang (2000). "Trees and term rewriting in 1910: on a paper by Axel Thue".Bulletin of the European Association for Theoretical Computer Science.72:256–269.CiteSeerX10.1.1.32.8993.MR1798015.
^Mostowski, Andrzej (September 1951). "A. Markov. Névožmoinost' nékotoryh algoritmov v téorii associativnyh sistém (Impossibility of certain algorithms in the theory of associative systems). Doklady Akadémii Nauk SSSR, vol. 77 (1951), pp. 19–20".Journal of Symbolic Logic.16 (3): 215.doi:10.2307/2266407.JSTOR2266407.
^Boone, William W. (1954). "Certain Simple, Unsolvable Problems of Group Theory. I".Indagationes Mathematicae (Proceedings).57:231–237.doi:10.1016/S1385-7258(54)50033-8.
^Britton, J. L. (October 1958). "The Word Problem for Groups".Proceedings of the London Mathematical Society.s3-8 (4):493–506.doi:10.1112/plms/s3-8.4.493.
Matiyasevich, Yu. V. (1967). "Simple examples of undecidable associative calculi".Soviet Mathematics.8 (2):555–557.ISSN0197-6788.
^Novikov, P. S. (1955). "On the algorithmic unsolvability of the word problem in group theory".Trudy Mat. Inst. Steklov (in Russian).44:1–143.
^Statman, Rick (2000). "On the Word Problem for Combinators".Rewriting Techniques and Applications. Lecture Notes in Computer Science. Vol. 1833. pp. 203–213.doi:10.1007/10721975_14.ISBN978-3-540-67778-9.