Академический Документы
Профессиональный Документы
Культура Документы
No. 87107
JANUARYFEBRUARY 1987
Decision Making:
Thinking Backward
To understand how thinking backward works,
think back to the days of the cave dwellers and consider the following exercise in assessing cause and
effect. Imagine that you belong to a tribe that is
sophisticated in methodology but primitive in science. Your tribe has very little knowledge of biology,
physics, or chemistry but a very big probleman
alarming decrease in the birthrate. The problem is so
severe that the tribes statistician estimates that
unless you can reverse the trend soon, the tribe will
become extinct.
Copyright 1986 by the President and Fellows of Harvard College. All rights reserved.
JanuaryFebruary 1987
JanuaryFebruary 1987
Thinking Forward
Whether we like to acknowledge it or not, most of
the time we do a poor job of thinking forward with
any accuracy. Evidence gathered in such diverse
fields as marriage counseling, bank lending, economic forecasting, and psychological counseling
indicates that most human predictions are less accurate than even the simplest statistical models.
Most people have more faith in human judgment,
however, than in statistical models. The disadvantages of statistical models compared with human
judgment seem obvious. Or so the argument goes.
But is this right? Lets consider the evidence.
Models make errors. The use of a formal model
implies trade-offs; a model will make errors since it
HARVARD BUSINESS REVIEW
JanuaryFebruary 1987
As far as human judgment is concerned, it is simply not clear that people do learn from feedback in
making predictions. Part of the difficulty in learning
occurs when people make predictive judgments to
take action. The outcomes provide only ambiguous
feedback on the quality of the predictions.
For example, imagine a case in which the president of the United States takes strong measures to
counteract a predicted economic slowdown. Now
consider the difficulties of learning from the various
possible outcomes. Imagine having no recession as
an outcome. This could result either from an incorrect prediction and an ineffective action or from an
accurate prediction and a highly effective action.
Now imagine a recession as an outcome. This could
result either from an accurate prediction and an ineffective action or from an inaccurate prediction and a
boomerang action that causes the very malady it is
intended to prevent. The problem is this: to learn
about our predictive ability requires separating the
quality of predictions from the effects of actions
based on those predictions.
Models are not worth their cost. In general, it is
impossible to evaluate the argument that any marginal increase in accuracy from using models does
not outweigh the extra cost of building them. If a
model is used to make enough predictions, however,
even small increases in accuracy can produce large
benefits.
For example, in the late 1970s, AT&T conducted a
study to determine the characteristics of good and
bad credit risks.1 Management incorporated the
results in a set of decision rules that it used to determine which new customers should be required to
provide deposits. In developing these rules, AT&T
went through a time when it granted credit to customers it would have previously classified as both
good risks and bad risks. As a result, the rules were
validated across the whole range of customer characteristics. By implementing the decision rules,
management realized an estimated annual reduction
of $137 million in bad debts. While no figures are
available on the cost of creating and maintaining the
model, it is difficult to believe that the savings did
not warrant the expense.
While many phenomena we try to predict are
complex, the rules for reasoning forward need not
match this complexity. Many successful applications have involved simple combinations of just a
few variables. Sometimes the rules develop from
modeling an experts past judgments, sometimes
simply by averaging past decisions, and sometimes
just by aggregating a few relevant variables.
1. J.L. Showers and L.M. Chakrin, Reducing Uncollectible Revenue from
Residential Telephone Customers, Interfaces, December 1981, p. 21.
70
JanuaryFebruary 1987