INDUSTRIAL ENGINEERING :

The “roots” of Industrial Engineering are certainly extensive, diverse and deep. Similarly, there are numerous historical “heroes” that made significant contributions to the development of the Industrial Engineering discipline. For the sake of argument, this article will assume that Industrial Engineering has at least two identifiable main roots, namely Determinism and Stochastism. The article attempts to trace the early history of the stochastic root which is very closely linked to the history of probability and statistics and hence games of chance, gambling and divinity. Therefore, the life and times, contributions and personalities of some of the heroes and villains, champions and sad cases of the stochastic world, will be briefly discussed in a somewhat light-hearted, but not necessarily flippant, manner.


INTRODUCTION
An interest shown by a country, an organization or an individual in its own history and roots, is at least an indication that this entity may have reached some state of maturity in terms of culture and civilization. It is the author's contention that this state has been reached by the Industrial Engineering profession in South Africa. Whereas the mature Industrial Engineer may be interested in history for the sake of the lessons that may be learned in this way, the relatively immature individual may show interest mainly for the purpose of identifying idols, role models and heroes.
The "roots" of Industrial Engineering are certainly extensive, diverse and deep. Similarly, there are numerous historical "heroes" that made significant contributions to the development of the Industrial Engineering discipline. For the sake of argument, this paper will assume that Industrial Engineering has at least two identifiable main roots, namely Determinism and Stochastism (see figure 1). The deterministic root is mainly entrenched in the work of people such as Adam Smith (1723-1790), Charles Babbage (1791-1871), Frederick Winslow Taylor  and Frank Bunker Gilbreth . There are numerous other roots that may not easily be classified as either deterministic or stochastic, for example, the roots imbedded in the economic, management, engineering, human and natural sciences. However, this paper will attempt to trace the early history of the stochastic root which is very closely linked to the history of probability and statistics and hence games of chance, gambling and divinity.
The main purpose of the paper is to pay homage to some of the great mathematical and statistical minds of the past and to endeavour to infuse some life into what is so often considered by Industrial Engineers as the "dull subject of mathematical statistics". At the same time the paper will attempt to show that these great heroes were often just ordinary, "normal" human beings, but with private lives and specific personalities, which were sometimes quite interesting and even, entertaining. The discussion will be limited to individuals who were born, lived and worked in the period 1500 to 1900 AD.

GIROLAMO CARDANO (1501 -1576) : The Gambling Physician
The ancient Britons, Greeks, Romans, Egyptians and the inhabitants of South America, the Middle and the Far East used astragali (knuckle bones), as a means for introducing unpredictability into games of chance (gambling), long before the birth of Christ. It was the Romans who imitated the astragalus by carving a rough cube from stone, wood or ivory and inscribing the sides with lewd figures and different numbers of dots thus creating the present day dice. These "random generators" were, and still are, used widely in a variety of games of chance but they were also used extensively in all kinds of religious ceremonies and specifically as a mechanism for soliciting the wishes of the gods (divination). The involvement of religion, and even magic, may be the restraining reason why no known attempt was made to mathematically analyse the stochastic process of throwing a die until the sixteenth century 2 . It was left to the Italian from Pavia (or Milan), Girolamo Cardano, to show the audacity of suggesting that there may be some kind of logical structure in the seemingly unpredictable magic of a die.
Girolamo Cardano, the illegitimate son of Fazio Cardano, was a real rogue, lived a somewhat less than charming, certainly not a conservative, but nevertheless, a very colourful and interesting life. He had an unhappy childhood, but was gifted, and was appointed Professor of Medicine at Pavia in 1543, and at Bologna in 1562. In 1551 he treated the Archbishop of St Andrews in Scotland for an asthmatic complaint and in London cast the horoscope of Edward VI. His family life was tragic; his eldest son was executed for the murder of his wife, his other son was constantly jailed for various crimes and his daughter was a prostitute. The Inquisition arrested him for heresy, at the age of 69, since he dared to cast a horoscope of Jesus Christ (contained in De astrorum iudiciis)). He immediately recanted and was subsequently hired by Pope Pius V as an astrologer and later granted a pension by Pope Gregory XIII. He predicted the date of his own death by casting his own horoscope. However, since he was healthy at the end of the specified day, he poisoned himself ! Quite a lot is known about Gardano since he wrote a lengthy autobiography, De propria vita (The book of my life). He was strongly disliked by some of his contemporaries and despised by some of his successors, while his biographers alternately described him as a charlatan and a persecuted savant. Some historians are even of the opinion that the contents of De propria vita are a complete hoax or at best a figment of Gardano's over active imagination. Cardano was a skinny man, with a long neck, a heavy lower lip, a wart over one eye, and a voice so loud that even his friends complained about it. He was a physician, philosopher, and engineer, a theoretical and applied mathematician, astrologer, eccentric, liar and gambler, but above all a gambler.

Figure 2: Astragali and modern dice
In his own words : "I have an immoderate devotion to table games and dice …. During many years …. I have played not off and on but, as I am ashamed to say, every day".
He did not escape the consequences of his lifestyle :"I suffer from diarrhoea, ruptures, kidney trouble, palpitations and even an infection of a nipple".
He was also fully aware of his own peculiar personality traits : "I am hot-tempered, singleminded, given to woman, cunning, crafty, sarcastic, diligent, impertinent, sad, treacherous, a magician and sorcerer, miserable, hateful, lascivious, obscene, lying, obsequious, and fond of the prattle of old men".
Nevertheless, he was the first scientist who made a serious attempt to analyse, mathematically, the probabilities inherent in the throwing of dice. He wrote 131 printed works on many subjects, including mathematics, astronomy, physics, urine, teeth, the life of the Virgin Mary, morality and immortality. He claimed to have burned 170 other manuscripts before publication and on his death he left another 111 manuscripts. Some of his most popular and best selling works include De Sibtilitate Rerum (On the Subtlety of Things), Ars Magna (The Great Art) and Liber de Ludo Aleae (Book on Games of Chance). However, it was his passion for gambling which probably motivated Cardano to apply his considerably mathematical skills to the analysis of dice throwing. He converted experimentation into theory, defined "An Honest Die", used the concept of mathematical combinations to calculate "Chance" (he never used the word probability), defined Equallyprobable Events and the concept of expressing Probability as a Fraction. The very early basis of modern probability theory, and thus the early stochastic roots of Industrial Engineering, should be seen as his lasting contribution. Once Cardano has broken the (d)ice, further development of the mathematics of chance followed relatively quickly with significant contributions made by most of the great mathematical minds of the time.

T Th he e H Hi ig gh h a an nd d t th he e M Mi ig gh ht ty y
Galileo considered the problem of playing dice (gambling) unworthy of serious mathematical consideration but was forced by his gambling employer, the Grand Duke of Tuscany, to write an essay, Sopra le Scoperty dei Dadi (On Playing Dice). To show his total disgust with the topic, Galileo wrote this essay in a vernacular Italian and not in the customary Latin. Nevertheless, it was the First Paper on Probability and the first time the word probabilità was used. He boldly advocated doctrines about the universe (for example the Copernican theory) that were condemned by the Pope and after a long and famous trial, he was "pronounced to be vehemently suspect of heresy", and condemned to life-imprisonment (commuted to life-long house arrest). A statement by the Pope before the Pontifical Academy of Sciences in 1992 may be interpreted as a rehabilitation of Galileo.

PIERRE (DE) FERMAT (1601 -1665) : The Rich Lawyer
Fermat was a successful and rich lawyer for whom mathematics was a sideline and something to be used to exercise and amuse his extraordinary mathematical genius. Most of his work was communicated by way of letters to his friends, often as theorems, statements or even puzzles without providing the proof, leaving most of it to Leonard Euler (1707-1783) a hundred years later. This was at least partly due to the fact that he experienced severe problems in publishing his work for the simple reason that he suffered from a total lack of, or disinterest in, editorial polish. Andrew Wiles, the British mathematician from Princeton, only recently (1993) proved the correctness of Ferma's, "Last Theorem". The correspondence between Fermat and Blaise Pascal is considered to mark the Foundations of Probability Theory, even though it was almost exclusively concerned with a gambling problem -The problem of how to divide the "pot" amongst the players when a gambling game is suspended. He was very much interested in the London "Bills of Mortality" and realised the possible value of such information for the profitable purpose of estimating the expected value of life annuities issued by the state and how such observed data may be used to investigate and possibly improve the social conditions in a country.
His publication in 1662, Natural and Political Observations … made upon the Bills of Mortality, laid the foundations for Statistical Inference (inferring population estimates from a limited and incomplete data set). The word "Statistics" (the analysis of quantitative facts about the state) originated from this work, and he may be regarded as the founder of the modern day Actuarial Sciences as well as the science of Demography. He set up a table for "Average Life Expectancy" which is the basis for much of the life insurance industry and may be seen as the innovator of the concepts of Sampling Theory. Though he never used the word "probability" he did use words such as "hazard", "likelihood" and the most intriguing concept of "an even lay".

T Th he e S So on n o of f a a T Ta ax x F Fa ar rm me er r
Pascal was a child prodigy who was tutored in mathematics by his father while the Jansenists (a Catholic sect) worked on his soul. His father removed all the books on mathematics from the house (they were only returned when Pascal was twelve) thus only managing to intrigue the young Pascal. At the age of sixteen he wrote a paper on the mathematics of the cone that impressed even the great René Descartes (1596-1650). Soon afterwards (1642), Pascal developed a mechanical calculator, the Pascaline, to speed-up arithmetic calculations for his father and thus may have constructed the first computer. Chevalier de Méré, a nobleman with an insatiable appetite for gambling, solicited Pascal's help in "improving the odds in gambling". Pascal turned to Fermat for support and thus started an amazing journey of discovery into the Mathematics of Chance. Pascal was also a very religious man who, in his old age (he died at the age of 39), was convinced that the practice of mathematics was a mortal sin. Nevertheless, he could not refrain from bringing some mathematical logic to bear even on his religious writings as demonstrated by the so-called "Pascal's Wager" : "If God does not exist, one will loose nothing by believing in him, while if he does exist, one will lose everything by not believing. … we are compelled to gamble !"

C CR RI IS ST TI IA AA AN N H HU UY YG GE EN NS S ( (1 16 62 29 9 --1 16 69 93 3) ) : : T Th he e S So on n o of f a a D Di ip pl lo om ma at ti ic c P Po oe et t
Huygens was the son of a poet who worked as a diplomat in the service of the Prince of Orange and suffered from persecution mania, specifically with regard to his family. His mathematical education was greatly influenced by Rene Descartes who was a friend of his father. He devised a new and better way of grinding and polishing lenses and using one of his own lenses, he detected the first moon of Saturn in 1655 and in 1657 he patented the first pendulum clock. In this way he contributed significantly to the development of the two most important tools required by any Industrial Engineer involved in work study; a stopwatch and a pair of binoculars !

J JA AC CO OB B, , J JO OH HA AN NN N A AN ND D D DA AN NI IE EL L B BE ER RN NO OU UL LL LI I : : T Th he e F Fi ig gh ht ti in ng g B Br ro ot th he er rs s, , S So on n a an nd d N Ne ep ph he ew w
Nicolaus was the patriarch of this mostly quarrelsome and jealous family, consisting of a dynasty if highly gifted mathematicians and scientists, sometimes used by Sir Francis Galton as a good example to illustrate his concept of eugenics. Nicolaus' sons, Jacob (or Jacques, or James) ( Being a French Huguenot, de Moivre was imprisoned for over two years for his religious beliefs. He managed to flee to England, never to return to the hated country of his birth and he never, ever, wrote anything in French, except a few forlorn love letters. De Moivre was a disgruntled man who never managed to get the academic position he craved, and deserved. (He experienced the misfortune of being a Protestant in a Catholic France, and even worse, a Frenchman in an England where appointing a Frenchman to an academic position was out of the question). He acted as a consultant to gamblers, tutored the children of the rich and worked on the mathematics of annuities, never securing a full-time paid position and he died in abject poverty. Similar to Gardano, he predicted his own death; this time by using an arithmetic progression of his sleep patterns and he actually died on the predicted day ! He published The Doctrine of Chance in 1718 and derived the Normal Distribution as an approximation to the binomial distribution in 1733, long before the birth of either Gauss or Laplace ! Apart from this, his greatest contributions are probably the concept of Expected Value and the definition of the Standard Deviation as a measure of dispersion. (Coining of the word "standard deviation" had to wait for Karl Pearson).

THOMAS BAYES (1702 -1761) : The Dissenting, Non-Conformist Minister
Bayes' father was one of the first non-conformist ministers and this may have been the reason why the young Thomas was privately tutored. There exists the intriguing possibility that one of his tutors may have been Abraham de Moivre. However, Bayes followed in his father's footsteps and became a Presbyterian minister. He preferred to practice mathematics in the privacy of his study and his only publication, Essay towards solving a problem in the doctrine of chances, was published (1763) posthumously on his own instructions. Though it started a major controversy, raging for many years, it nevertheless made major contributions to the science of Decision Analysis and what is today known as Bayesian Inference. Recently (1999) some doubts were raised as to whether Bayes was the first to formulate Bayes' Theorem ! His Thèory Analytique des Probabilités was published in 1812 and included discussions on the probability of compound events, Buffon's needle, mathematical expectation and probabilistic views on legal matters, life expectancy and the length of marriages. The development of the Central Limit Theorem may be attributed to him and he warned against "the tendency to assign a particular cause to an outcome when in fact only the laws of probability are at work" !

CARL FRIEDRICH GAUSS (1777 -1855) : The Paranoiac Recluse
Gauss, often known as the prince of mathematics, was a child prodigy and an obsessively suspicious and secretive man. Some mathematicians estimate that if Gauss was just a little more forthcoming in disclosing the methods he used, rather than just providing the results of his research, it may have advanced mathematics with at least a hundred years. He had an absolute distaste for travel and left his hometown of Göttingen only once during the last twenty-eight years of his life. However, he cared for his sick mother for twenty years, discovered the Binomial Theorem independently, developed the Method of Least Squares and rediscovered de Moivre's "Bell Curve" as part of his work in geodetic surveying.

FRANCIS GALTON (1822 -1911) : The Gentleman Explorer
Galton spent some time in medical school but when he was confronted with his first cadaver he decided that medicine was not the profession for him. Fortunately he inherited part of his father's considerable estate at about the same time. Galton was therefore independently wealthy and became a very charming social snob who never had to work a day in his long life to earn a living. However, he did more than anyone else in history to transform mathematical statistics from a somewhat esoteric mathematical pastime, mainly applied to gambling problems, to a tool for analysing the technological and social problems of the everyday world. He was obsessed with counting, measuring and making observations, anything from counting the number of times people fidgeted as they listened to a lecture and measuring and comparing the height of fathers and their sons, to classifying the degree of attractiveness of the girls he passed on the streets of London. The trip by his first cousin, Charles Robert Darwin, on the HMS Beagle inspired him to explored Africa as a young man, inter alia hunting big game in Namibia. Galton had a keen interest in the effects of heredity, especially with respect to the transference of "genius" from parent to child (eugenics). He had no children and therefore escaped the humiliation of seeing his own offspring possibly not conforming to his pet theories. He suffered from occasional bouts of severe depression and under these circumstances referred to himself as "the man with the sprained brain".

Figure 6: Galton's dice
Galton developed a set of dice for the generation of standard normal variates thus laying some of the foundations for Simulation Modelling. He devised the basis of all modern weather maps and discovered the uniqueness of human fingerprints. He saw "bell curves" wherever he went and was principally responsible for the transformation of the Normal Distribution (he coined the word "normal") from being a "Law of Error" used mainly in astronomy to a "Law of Nature" applicable to almost every facet of everyday life. With his gadgets, the Quincunx I and II, he demonstrated, and to some extend proved, the tendency towards "normality" in nature. Together with Quetelet, Edgeworth and Pearson he brought mathematical statistics into the realm of the social sciences and invented the concept of Correlation. He insisted that variety is ever present but that there is often order in what may seem chaos and sometimes there is at least some structure in the seemingly unpredictability of random events. Figure 7: Quincunx I Using his Quincunx, some experiments with peas and what may only be described as an astonishing brilliant "mind experiment", Galton discovered and formulated the phenomenon known as "Regression to the Mean" or, according to the title of the relevant publication,