 Cover page | |
| Author | Jacob Bernoulli |
|---|---|
| Language | Latin |
| Subject | Probability |
| Published | 1713 |
| Publisher | Impensis Thurnisiorum, Fratrum |
| Publication place | Basel,Old Swiss Confederacy |
Ars Conjectandi (Latin for "The Art of Conjecturing") is a book oncombinatorics and mathematicalprobability written byJacob Bernoulli and published in 1713, eight years after his death, by his nephew,Nicolaus I Bernoulli. The seminal work consolidated, apart from many combinatorial topics, many central ideas inprobability theory, such as the very first version of thelaw of large numbers: indeed, it is widely regarded as the founding work of that subject. It also addressed problems that today are classified in thetwelvefold way and added to the subjects; consequently, it has been dubbed an important historical landmark in not only probability but all combinatorics by a plethora of mathematical historians. The importance of this early work had a large impact on both contemporary and later mathematicians; for example,Abraham de Moivre.
Bernoulli wrote the text between 1684 and 1689, including the work of mathematicians such asChristiaan Huygens,Gerolamo Cardano,Pierre de Fermat, andBlaise Pascal. He incorporated fundamental combinatorial topics such as his theory ofpermutations andcombinations (the aforementioned problems from the twelvefold way) as well as those more distantly connected to the burgeoning subject: the derivation and properties of the eponymousBernoulli numbers, for instance. Core topics from probability, such asexpected value, were also a significant portion of this important work.
In Europe, the subject ofprobability was first formally developed in the 16th century with the work ofGerolamo Cardano, whose interest in the branch of mathematics was largely due to his habit of gambling.[1] He formalized what is now called the classical definition of probability: if an event hasa possible outcomes and we select anyb of those such thatb ≤ a, the probability of any of theb occurring is. However, his actual influence on mathematical scene was not great; he wrote only one light tome on the subject titledLiber de ludo aleae (Book on Games of Chance), which was published posthumously in 1663.[2][3]
The date which historians cite as the beginning of the development of modern probability theory is 1654, when two of the most well-known mathematicians of the time, Blaise Pascal and Pierre de Fermat, began a correspondence discussing the subject. The two initiated the communication because earlier that year, a gambler fromParis namedAntoine Gombaud had sent Pascal and other mathematicians several questions on the practical applications of some of these theories; in particular he posed theproblem of points, concerning a theoretical two-player game in which a prize must be divided between the players due to external circumstances halting the game. The fruits of Pascal and Fermat's correspondence interested other mathematicians, includingChristiaan Huygens, whoseDe ratiociniis in aleae ludo (Calculations in Games of Chance) appeared in 1657 as the final chapter of Van Schooten'sExercitationes Matematicae.[2] In 1665 Pascal posthumously published his results on the eponymousPascal's triangle, an important combinatorial concept. He referred to the triangle in his workTraité du triangle arithmétique (Traits of the Arithmetic Triangle) as the "arithmetic triangle".[4]
In 1662, the bookLa Logique ou l’Art de Penser was published anonymously in Paris.[5] The authors presumably wereAntoine Arnauld andPierre Nicole, two leadingJansenists, who worked together with Blaise Pascal. The Latin title of this book isArs cogitandi, which was a successful book on logic of the time. TheArs cogitandi consists of four books, with the fourth one dealing with decision-making under uncertainty by considering the analogy to gambling and introducing explicitly the concept of a quantified probability.[6][7]
In the field of statistics and applied probability,John Graunt publishedNatural and Political Observations Made upon the Bills of Mortality also in 1662, initiating the discipline ofdemography. This work, among other things, gave a statistical estimate of the population of London, produced the firstlife table, gave probabilities of survival of different age groups, examined the different causes of death, noting that the annual rate of suicide and accident is constant, and commented on the level and stability ofsex ratio.[8] The usefulness and interpretation of Graunt's tables were discussed in a series of correspondences by brothers Ludwig and Christiaan Huygens in 1667, where they realized the difference between mean and median estimates and Christian even interpolated Graunt's life table by a smooth curve, creating the first continuous probability distribution; but their correspondences were not published. Later,Johan de Witt, the then prime minister of the Dutch Republic, published similar material in his 1671 workWaerdye van Lyf-Renten (A Treatise on Life Annuities), which used statistical concepts to determinelife expectancy for practical political purposes; a demonstration of the fact that this sampling branch of mathematics had significant pragmatic applications.[9] De Witt's work was not widely distributed beyond the Dutch Republic, perhaps due to his fall from power and execution by mob in 1672. Apart from the practical contributions of these two work, they also exposed a fundamental idea that probability can be assigned to events that do not have inherent physical symmetry, such as the chances of dying at certain age, unlike say the rolling of a dice or flipping of a coin, simply by counting the frequency of occurrence. Thus, probability could be more than mere combinatorics.[7]
In the wake of all these pioneers, Bernoulli produced many of the results contained inArs Conjectandi between 1684 and 1689, which he recorded in his diaryMeditationes.[1][10] When he began the work in 1684 at the age of 30, while intrigued by combinatorial and probabilistic problems, Bernoulli had not yet read Pascal's work on the "arithmetic triangle" nor de Witt's work on the applications of probability theory: he had earlier requested a copy of the latter from his acquaintanceGottfried Leibniz, but Leibniz failed to provide it. The latter, however, did manage to provide Pascal's and Huygens' work, and thus it is largely upon these foundations thatArs Conjectandi is constructed.[11] Apart from these works, Bernoulli certainly possessed or at least knew the contents from secondary sources of the La Logique ou l’Art de Penser as well as Graunt'sBills of Mortality, as he makes explicit reference to these two works.
Bernoulli's progress over time can be pursued by means of theMeditationes. Three working periods with respect to his "discovery" can be distinguished by aims and times. The first period, which lasts from 1684 to 1685, is devoted to the study of the problems regarding the games of chance posed by Christiaan Huygens; during the second period (1685-1686) the investigations are extended to cover processes where the probabilities are not known a priori, but have to be determined a posteriori. Finally, in the last period (1687-1689), the problem of measuring the probabilities is solved.[6]
Before the publication of hisArs Conjectandi, Bernoulli had produced a number of treatises related to probability:[12]
Between 1703 and 1705, Leibniz corresponded with Jakob after learning about his discoveries in probability from his brotherJohann.[13] Leibniz managed to provide thoughtful criticisms on Bernoulli's law of large numbers, but failed to provide Bernoulli with de Witt's work on annuities that he so desired.[13] From the outset, Bernoulli wished for his work to demonstrate that combinatorics and probability theory would have numerous real-world applications in all facets of society—in the line of Graunt's and de Witt's work— and would serve as a rigorous method of logical reasoning under insufficient evidence, as used in courtrooms and in moral judgements. It was also hoped that the theory of probability could provide comprehensive and consistent method of reasoning, where ordinary reasoning might be overwhelmed by the complexity of the situation.[13] Thus the titleArs Conjectandi was chosen: a link to the concept ofars inveniendi fromscholasticism, which provided the symbolic link to pragmatism he desired and also as an extension of the priorArs Cogitandi.[6]
In Bernoulli's own words, the "art of conjecture" is defined in Chapter II of Part IV of hisArs Conjectandi as:
The art of measuring, as precisely as possible, probabilities of things, with the goal that we would be able always to choose or follow in our judgments and actions that course, which will have been determined to be better, more satisfactory, safer or more advantageous.
The development of the book was terminated by Bernoulli's death in 1705; thus the book is essentially incomplete when compared with Bernoulli's original vision. The quarrel with his younger brother Johann, who was the most competent person who could have fulfilled Jacob's project, prevented Johann from accessing the manuscript. Jacob's own children were not mathematicians and were not up to the task of editing and publishing the manuscript. Finally Jacob's nephew Nicolaus, 7 years after Jacob's death in 1705, managed to publish the manuscript in 1713.[14][15]
Bernoulli's work, originally published in Latin[16] is divided into four parts.[11] It covers most notably his theory of permutations and combinations; the standard foundations of combinatorics today and subsets of the foundational problems today known as thetwelvefold way. It also discusses the motivation and applications of a sequence of numbers more closely related tonumber theory than probability; theseBernoulli numbers bear his name today, and are one of his more notable achievements.[17][18]
The first part is an in-depth expository on Huygens'De ratiociniis in aleae ludo. Bernoulli provides in this section solutions to the five problems Huygens posed at the end of his work.[11] He particularly develops Huygens' concept of expected value—the weighted average of all possible outcomes of an event. Huygens had developed the following formula:
In this formula,E is the expected value,pi are the probabilities of attaining each value, andai are the attainable values. Bernoulli normalizes the expected value by assuming thatpi are the probabilities of all the disjoint outcomes of the value, hence implying thatp0 + p1 + ... + pn = 1. Another key theory developed in this part is the probability of achieving at least a certain number of successes from a number of binary events, today namedBernoulli trials,[20] given that the probability of success in each event was the same. Bernoulli shows throughmathematical induction that givena the number of favorable outcomes in each event,b the number of total outcomes in each event,d the desired number of successful outcomes, ande the number of events, the probability of at leastd successes is
The first part concludes with what is now known as theBernoulli distribution.[16]
The second part expands onenumerative combinatorics, or the systematic numeration of objects. It was in this part that two of the most important of the twelvefold ways—the permutations and combinations that would form the basis of the subject—were fleshed out, though they had been introduced earlier for the purposes of probability theory. He gives the first non-inductive proof of the binomial expansion for integer exponent using combinatorial arguments. On a note more distantly related to combinatorics, the second section also discusses the general formula for sums of integer powers; the free coefficients of this formula are therefore called theBernoulli numbers, which influenced Abraham de Moivre's work later,[16] and which have proven to have numerous applications in number theory.[22]
In the third part, Bernoulli applies the probability techniques from the first section to the common chance games played with playing cards or dice.[11] He does not feel the necessity to describe the rules and objectives of the card games he analyzes. He presents probability problems related to these games and, once a method had been established, posed generalizations. For example, a problem involving the expected number of "court cards"—jack, queen, and king—one would pick in a five-card hand from a standard deck of 52 cards containing 12 court cards could be generalized to a deck witha cards that containedb court cards, and ac-card hand.[23]
The fourth section continues the trend of practical applications by discussing applications of probability tocivilibus,moralibus, andoeconomicis, or to personal, judicial, and financial decisions. In this section, Bernoulli differs from the school of thought known asfrequentism, which defined probability in an empirical sense.[24] As a counter, he produces a result resembling thelaw of large numbers, which he describes as predicting that the results of observation would approach theoretical probability as more trials were held—in contrast, frequentsdefined probability in terms of the former.[14] Bernoulli was very proud of this result, referring to it as his "golden theorem",[25] and remarked that it was "a problem in which I've engaged myself for twenty years".[26] This early version of the law is known today as either Bernoulli's theorem or the weak law of large numbers, as it is less rigorous and general than the modern version.[27]
After these four primary expository sections, almost as an afterthought, Bernoulli appended toArs Conjectandi a tract oncalculus, which concernedinfinite series.[16] It was a reprint of five dissertations he had published between 1686 and 1704.[21]
Ars Conjectandi is considered a landmark work in combinatorics and the founding work of mathematical probability.[28][29][30] Among others, an anthology of great mathematical writings published byElsevier and edited by historianIvor Grattan-Guinness describes the studies set out in the work "[occupying] mathematicians throughout 18th and 19th centuries"—an influence lasting three centuries.[31] StatisticianAnthony Edwards praised not only the book's groundbreaking content, writing that it demonstrated Bernoulli's "thorough familiarity with the many facets [of combinatorics]," but its form: "[Ars Conjectandi] is a very well-written book, excellently constructed."[32] Perhaps most recently, notable popular mathematical historian and topologist William Dunham called the paper "the next milestone of probability theory [after the work of Cardano]" as well as "Jakob Bernoulli's masterpiece".[1] It greatly aided what Dunham describes as "Bernoulli's long-established reputation".[33]
Bernoulli's work influenced many contemporary and subsequent mathematicians. Even the afterthought-like tract on calculus has been quoted frequently; most notably by the Scottish mathematicianColin Maclaurin.[16] Jacob's program of applying his art of conjecture to the matters of practical life, which was terminated by his death in 1705, was continued by his nephewNicolaus Bernoulli, after having taken parts verbatim out ofArs Conjectandi, for his own dissertation entitledDe Usu Artis Conjectandi in Jure which was published already in 1709.[6] Nicolas finally edited and assisted in the publication ofArs conjectandi in 1713. Later Nicolaus also edited Jacob Bernoulli's complete works and supplemented it with results taken from Jacob's diary.[34]
Pierre Rémond de Montmort, in collaboration with Nicolaus Bernoulli, wrote a book on probabilityEssay d'analyse sur les jeux de hazard which appeared in 1708, which can be seen as an extension of the Part III ofArs Conjectandi which applies combinatorics and probability to analyze games of chance commonly played at that time.[34]Abraham de Moivre also wrote extensively on the subject inDe mensura sortis: Seu de Probabilitate Eventuum in Ludis a Casu Fortuito Pendentibus of 1711 and its extension The Doctrine of Chances or, a Method of Calculating the Probability of Events in Play of 1718.[35] De Moivre's most notable achievement in probability was the discovery of the first instance ofcentral limit theorem, by which he was able to approximate thebinomial distribution with thenormal distribution.[16] To achieve this De Moivre developed anasymptotic sequence for thefactorial function —- which we now refer to asStirling's approximation —- and Bernoulli's formula for the sum of powers of numbers.[16] Both Montmort and de Moivre adopted the termprobability from Jacob Bernoulli, which had not been used in all the previous publications on gambling, and both their works were enormously popular.[6]
The refinement of Bernoulli's Golden Theorem, regarding the convergence of theoretical probability and empirical probability, was taken up by many notable latter day mathematicians like De Moivre, Laplace, Poisson, Chebyshev, Markov, Borel, Cantelli, Kolmogorov and Khinchin. The complete proof of the Law of Large Numbers for the arbitrary random variables was finally provided during first half of 20th century.[36]
A significant indirect influence wasThomas Simpson, who achieved a result that closely resembled de Moivre's. According to Simpsons' work's preface, his own work depended greatly on de Moivre's; the latter in fact described Simpson's work as an abridged version of his own.[37] Finally,Thomas Bayes wrote an essay discussingtheological implications of de Moivre's results: his solution to a problem, namely that of determining the probability of an event by its relative frequency, was taken as a proof for theexistence of God by Bayes.[38] Finally in 1812,Pierre-Simon Laplace published hisThéorie analytique des probabilités in which he consolidated and laid down many fundamental results in probability and statistics such as the moment generating function, method of least squares, inductive probability, and hypothesis testing, thus completing the final phase in the development of classical probability. Indeed, in light of all this, there is good reason Bernoulli's work is hailed as such a seminal event; not only did his various influences, direct and indirect, set the mathematical study of combinatorics spinning, but even theology was impacted.