Вы находитесь на странице: 1из 13

18

VOL. 102 NO. 1

After Uniqueness:
The Evolution of
Forensic-Science
Opinions Big changes are occurring in
forensic science, particularly
among experts who compare
the patterns found in finger-
prints, footwear impressions,
By William C. Thompson, toolmarks, handwriting, and
Joelle Vuille, the like. Forensic examiners
Franco Taroni &
Alex Biedermann are reaching conclusions in
new ways and changing the
language they use in reports
and testimony. This article
explains these changes and
VOLUME 102 NUMBER 1 SPRING 2018 the challenges they pose for

JUDICATURE
Published by the Bolch Judicial Institute of Duke Law. Reprinted with permission.
lawyers and judges.

© 2018 Duke University School of Law. All rights reserved.


judicialstudies.duke.edu/judicature
JUDICATURE 19

Although testimony about forensic were presumed to be unique, and thus commentary on the issue in the broader
comparisons has been offered in court the impressions left by a given shoe, scientific and academic communities
for over a century, it has recently become or a given set of teeth (if sufficiently (beyond the community of forensic
controversial. Questions have emerged clear and detailed) were assumed to science practitioners) has been nearly
about the scientific foundation of the differ from the impressions left by any unanimous in dismissing such claims as
pattern-matching disciplines and about other shoe or set of teeth. Applying the unwarranted.3
the logic underlying forensic scientists’ same analysis, everyone’s handwriting Consider the claim that the ridge
conclusions. The traditional assump- was presumed to be unique, and hence patterns on every finger are unique.
tion that items like fingerprints and a sample of handwriting from a given Like similar claims about snowflakes,
toolmarks have unique patterns that individual (if sufficiently extensive) was it is impossible to demonstrate empiri-
allow experts to accurately determine presumed to be distinguishable from cally that this claim is true because one
their source has been challenged and is the handwriting of any other individual. cannot conduct a systematic compar-
being replaced by a new logic of foren- These presumptions have been called the ison of every finger against every
sic reporting. The new logic requires theory of discernible uniqueness.1 other. Furthermore, there is a differ-
experts to evaluate and weigh probabili- According to this traditional ence between the claim that the ridge
ties rather than claim certainty. Forensic account, the job of the forensic examiner pattern on each finger is unique and
experts must now moderate the claims was first to assess whether the patterns the claim that a fingerprint examiner
they make about their own accuracy and, seen in impressions contained sufficient can accurately determine whether two
increasingly, use numbers to describe the detail to allow a determination of source fingerprints were made by the same
strength of their conclusions. Because and, second, to compare the impres- finger. The validity of the latter also
these changes have important impli- sion patterns. If sufficient detail was depends on the quality of the prints and
cations for the probative value of the available, then a “match” between the the level of analysis employed during
conclusions that forensic experts offer in patterns meant the source of the impres- the comparison. Even if the ridge detail
court, it is important that judges under- sions must necessarily be the same, and of every finger were unique, it does not
stand them. a mismatch (failure to match) meant follow that every impression made by
that the source of the impressions must every finger will always be distinguish-
THE DEMISE OF THE THEORY necessarily be different. If insufficient able from every impression made by
OF DISCERNIBLE UNIQUENESS detail was available to make a definitive any other finger, particularly when the
As recently as a decade ago, forensic determination, then the examination impressions are of poor quality (e.g.,
scientists in the pattern-matching disci- was inconclusive. limited detail, smudged, distorted, or
plines told a common story when asked Examiners in a number of foren- overlaid on another impression). By
to explain how they reached conclu- sic disciplines have testified that this analogy, it may be that every human face
sions. Their analytic process began analysis allows them to make source is unique, but we can still mistake one
with the assumption that the items determinations with complete certainty. person for another, particularly when
they examined had unique patterns: For A prominent fingerprint examiner comparing poor-quality photos.4
example, every finger was said to have explained the matter as follows: This is a limitation that most finger-
a unique set of friction ridges, and thus Fingerprint examiners routinely claim to print examiners now acknowledge:
every print left by a given finger (if suffi- have “identified” or “individualized” an When fingerprint comparisons are being
cient in size and clarity) was expected unknown mark to a single known print. made, they are not being made from fric-
to be different from the print made by This identification is often characterized tion ridge skin to friction ridge skin. They
any other finger. Similarly, every gun as being “to the exclusion of all others” on are being made from one imperfect, incom-
barrel was thought to be unique; hence earth to a 100 [percent] certainty, and plete recording to another. . . . [Hence]
the pattern of marks found on bullets the comparison method used is claimed correctly associating a degraded mark to
fired through a given barrel (if suffi- to have a zero percent error rate. These its true source is by no means a certainty,
cient in size and clarity) was expected to claims are based on the premises that fric- even were one to presume absolute unique-
differ from the pattern found on bullets tion ridge skin is unique and permanent.2 ness of all friction ridge skin.5
fired through any other gun barrel. The Unfortunately, these claims have not Consequently, the key scientific ques-
soles of shoes and human dentition also withstood scientific scrutiny. Indeed, tion is not whether the ridge pattern of 4
20 VOL. 102 NO. 1

each finger is unique, but how well an ysis, but relatively little research has no longer credibly claim the ability to
examiner can distinguish the impres- been conducted on the accuracy of other infallibly discern whether two compared
sions of different fingers at the level of forensic science disciplines. In 2016, sets of features share a unique pattern and
analysis applied in a forensic examina- the President’s Council of Advisors on thus have a common source. Professional
tion. That question cannot be answered Science and Technology (PCAST) issued associations and standards-setting bodies
by assertions about the uniqueness of a report that reviewed scientific research in various branches of forensic science
ridge patterns; it can only be answered published to that point on the accuracy have recommended that examiners avoid
by empirical research. of six forensic science disciplines that asserting that their conclusions are infal-
This critique also applies to other rely on “feature comparison”: DNA lible and avoid claiming that they can
forensic pattern-matching disciplines, analysis, latent print analysis, firearms discern whether a pattern is unique.12
such as toolmark analysis, footwear analysis, bitemarks analysis, footwear Experts are now discussing a variety of
analysis, handwriting analysis, and analysis, and microscopic hair analysis.9 new approaches to reporting.
bitemark analysis. Although some prac- PCAST found that adequate research
titioners in these fields persist in making had been done to establish the “founda- THE LOGIC OF FORENSIC INFERENCE
the injudicious claim that their conclu- tional validity” of latent print analysis To understand and evaluate the new
sions must be accurate because they are and DNA analysis of single-source and approaches to reporting, it is neces-
comparing patterns that are unique, the simple mixture samples. “Foundational sary to understand the logic of forensic
broader scientific community has called validity” means the method in question inference — that is, the logical steps
for empirical studies to put such claims is capable of producing accurate results by which a forensic examiner proceeds
to the test. when properly performed. PCAST from observations to conclusions. Let’s
A key event in the evolution of concluded, however, that too little consider, as an example, the logical steps
forensic science opinion was a 2009 research had been published to establish that lead a latent print examiner from
report by the United States National the “foundational validity” of firearms the observation that two fingerprints
Academy of Sciences (NAS), which analysis, bitemarks analysis, footwear have similar ridge patterns to conclu-
called for the development of “quan- analysis, microscopic hair analysis, and sions about whether they were made
tifiable measures of the reliability DNA analysis of complex mixtures. by the same finger. If examiners can no
and accuracy of forensic analyses” that Moreover, even if latent print exam- longer credibly claim that prints must
reflect “actual practice on realistic case ination has “foundational validity,” the necessarily have a common source if
scenarios . . . .”6 It called for research to studies do not show that it is infallible they appear to have “matching” ridge
establish “the limits of reliability and (as examiners have claimed). The studies patterns, what conclusions can they
accuracy that analytic methods can be reviewed by PCAST showed that latent reasonably draw?
expected to achieve as the conditions print examiners have: The new approaches all recognize that
of forensic evidence vary.”7 The report . . . a false-positive rate that is substantial forensic inference requires an inductive
concluded that “much forensic evidence and is likely to be higher than expected by line of reasoning, which entails consid-
— including, for example, bitemarks many jurors based on longstanding claims eration of probabilities. The examiner
and firearm and tool mark identifica- about the infallibility of fingerprint must consider the probability of seeing
tions — is introduced in criminal trials analysis. The false-positive rate could be the patterns observed in the impressions
without any meaningful scientific vali- as high as [one] error in 306 cases [based under two alternative hypotheses about
dation, determination of error rates, or on an FBI study] and [one] error in 18 their origin: (1) that the impressions
reliability testing to explain the limits cases based on a study by another crime have the same source (e.g., same finger,
of the discipline.”8 laboratory.10 same tool); and (2) that the impressions
In response to this high-level scien- The studies reviewed by PCAST also have a different source.
tific criticism, forensic scientists made showed substantial numbers of false Suppose, for example, that a latent
some efforts to study the accuracy of exclusions.11 print examiner observes that two finger-
their methods, although these efforts In light of these developments, foren- prints have similar patterns but with
have been limited. The FBI commis- sic scientists have begun to change the slight discrepancies. The examiner
sioned an important series of studies way they describe their analytic process must consider how probable it would
on the accuracy of latent print anal- and report their conclusions. They can be to observe those particular patterns
JUDICATURE 21

Professional
associations and
(including both similarities and discrep- means the expert thinks the observed
ancies) if the prints were made by the standards-setting patterns are equally likely under the two
same finger. This might involve consid-
eration of the likelihood that slipping bodies in various hypotheses, and hence the evidence has
no value for distinguishing the hypoth-
or torsion of the finger, or some other
process, could have distorted one or
branches of eses. A value greater than one means the
expert thinks the observed patterns are
both of the prints enough to produce
the discrepancies. The examiner must
forensic science more likely under one hypothesis than
the alternative, and thus the forensic
also consider how probable it would have recommended evidence supports the favored hypoth-
be to observe those particular patterns
(including both similarities and that examiners avoid esis. The larger the likelihood ratio,
the greater the expert’s perception of
discrepancies) if the prints were made
by different fingers. This would involve
asserting that their how strongly the balance of probabil-
ities supports the favored hypotheses.
consideration of the rarity of the shared
features, hence how likely or unlikely it
conclusions are European latent print experts sometimes
report very high likelihood ratio values,
would be to observe so much similarity infallible and avoid such as one million or even ten million.
in prints made by different fingers.
In order to draw inferences and reach claiming that they The European Network of Forensic
Science Institutes (ENFSI) and the
conclusions about whether two impres-
sions have a common source, the expert
can discern whether U.K. Royal Statistical Society promote
the use of likelihood ratios to describe
must consider the balance between the
two key probabilities: (1) the probability
a pattern is unique. experts’ assessments of the strength
of forensic evidence.14 Many forensic
of the observed patterns if the impres- scientists in Europe, New Zealand, and
sions have the same source; and (2) the about how examiners should report parts of Australia also have adopted this
probability of the observed patterns if their conclusions regarding the balance approach.15
the impressions have a different source. of probability. In this section of the The question most commonly asked
The ratio between these two probabili- article, we will outline the different about likelihood ratios is how the
ties provides an index of the probative approaches and discuss their strengths experts come up with the numbers they
value of the evidence for distinguishing and weaknesses. report. In some disciplines, experts can
the two hypotheses. The evidence favors rely on databases and statistical model-
a particular hypothesis to the extent Likelihood Ratios. One approach that ing. This is most common in fields like
that the observed results are more prob- is popular in Europe allows examin- forensic DNA analysis and forensic voice
able under that hypothesis than under ers to use numbers called likelihood comparison, where extensive databases
the alternative hypothesis. For exam- ratios to describe their perception of the exist and methods for statistical model-
ple, if a latent print examiner thinks the balance of probabilities.13 The likeli- ing have been evaluated in the scientific
observed ridge patterns (including both hood ratio represents the expert’s view of literature.16 Likelihood ratios have been
similarities and discrepancies) would the relative probability of the observed presented in the United States for many
be more probable if the prints have the features under the alternative hypothe- years in connection with forensic DNA
same source (same finger) than if they ses about the source of the impressions. evidence. The expert typically says
have a different source (different fingers), A likelihood ratio of 1000, for exam- something like the following:
then the evidence supports the hypothe- ple, represents the expert’s view that the The genetic characteristics observed in
sis that the prints have the same source. observed patterns are 1000 times more the evidentiary sample are X times more
This logic is fundamental and ines- probable under one hypothesis (e.g., likely if the defendant was a contribu-
capable. It is the basis for any conclusions same source) than under the alternative tor than if the contributor was instead a
that examiners choose to report. hypothesis. Experts typically make the random unknown Caucasian.
favored hypothesis the numerator of the In the past, there has been insufficient
APPROACHES TO REPORTING likelihood ratio so that reported values data on the rarity of the features observed
There are several schools of thought range from one to infinity. A value of one by experts in most pattern-matching 4
22 VOL. 102 NO. 1

If the examiner does


disciplines to allow statistical esti-
not know enough to two items have a common source.22 If
mates, but that is starting to change. assess the relevant the examiner does not know enough to
Recently the Defense Forensic Science
Center (DFSC) of the Department of the probabilities, then assess the relevant probabilities, then
the examiner does not know enough
Army began presenting probabilities in
connection with fingerprint evidence. In
the examiner does to evaluate the strength of the foren-
sic evidence — and hence nothing the
March 2017, the laboratory announced
that future reports would include state-
not know enough examiner says about the value of the
evidence should be trusted. It makes no
ments like the following: to evaluate the sense, proponents say, to allow experts
The latent print on Exhibit ## and the to testify about conclusions they reached
standards bearing the name XXXX strength of the based on a subjective judgment of the
have corresponding ridge detail. The
probability of observing this amount of forensic evidence — balance of probabilities but not allow
the expert to use a likelihood ratio to say
correspondence is approximately ## times
greater when impressions are made by
and hence nothing what their judgment was. When experts
report their judgments of the likelihood
the same source rather than by different
sources.17
the examiner says ratio, proponents argue, the expert’s
judgmental process is more transpar-
The laboratory uses a software about the value of ent, and hence the value of the expert’s
program to score the similarity of the
prints being compared based on “the the evidence should conclusions is easier to evaluate.23

spatial relationship and angles of the


ridge details.”18 The program then uses
be trusted. Verbal Equivalents of Likelihood
Ratios. Examiners may nevertheless
a database to evaluate how much more be reluctant to put specific numbers
common it is to observe a given simi- on their subjective judgments, even if
larity score when comparing prints not developed databases and statisti- those judgments are well grounded. An
from the same finger than prints from cal models. In those fields, experts may examiner may justifiably believe that
different fingers. Although this is a rely on their training and experience to the observed results are more probable
novel method that has not yet been come up with a likelihood ratio. In some if the items being compared have the
adopted by other forensic laborato- instances, a likelihood ratio can be based same source than a different source, for
ries, the DFSC has reportedly offered partly on empirical data and partly on example, without being able to say with
to share this software with any govern- the expert’s judgment.19 While some any precision how much more prob-
ment forensic laboratory in the United commentators have derided such esti- able. Forcing examiners to articulate
States, and other labs are evaluating mates as “subjective” and questioned numbers may lend a false air of precision
this approach. Similar software-based, their validity (one commentator called to a subjective assessment.
quantitative methods for assessing tool- them “numbers from nowhere”20), the One way to avoid this problem is to
mark and handwriting evidence also are practice of presenting likelihood ratios allow examiners to express conclusions
under development, although it may be based on expert judgment (rather than about the balance of probabilities using
a few years before they are ready for the a database) appears to have taken hold words rather than numbers. In a 2012
courtroom. As experts begin offering in many European countries.21 Whether report, a group of experts assembled
testimony based on these new methods such testimony should be admitted in by the National Institute of Standards
in United States courtrooms, litigants the United States is an issue judges may and Technology (NIST) recommended
are likely to challenge admissibility soon need to contemplate. that latent print examiners report their
under the Daubert or Frye standards, Those who support the use of likeli- conclusions using statements like the
which will require judges to scrutinize hood ratios based on expert judgment following:
whether the new methods are reliable (rather than databases) point out that It is far more probable that this degree
and generally accepted. a forensic examiner must make subjec- of similarity would occur when compar-
Likelihood ratios also can be reported tive judgments of probability in order ing the latent print with the defendant’s
in forensic science disciplines that have to draw any conclusions about whether fingers than with someone else’s fingers.24
JUDICATURE 23

strong” support we are likely to see similar testimony in


TABLE 1. PROPOSED LIKELIHOOD RATIO TERMINOLOGY (AFSP, 2009) for the conclusion other pattern-matching disciplines.
NUMERICAL EXPRESSION OF VERBAL EXPRESSION OF that the items Even without empirical data, experts
PROBATIVE STRENGTH PROBATIVE STRENGTH have a common sometimes make statements about
(likelihood ratio)
source. A foren- the random match probability based
1 – 10 Weak or limited
sic scientist who on training and experience. These
10 – 100 Moderate
concluded that subjective-match probabilities are typi-
100 – 1,000 Moderately strong
the results are cally reported with words rather than
1000 – 10,000 Strong
100,000 times numbers. An examiner might say, for
10,000 – 1,000,000 Very strong
more likely if the example, that the set of features shared
> 1,000,000 Extremely strong
patterns being by two items is “rare” or “unusual.”
compared have a One drawback of this approach is that
common source it addresses only one of the two ques-
This approach allows examiners to would say that the evidence provides tions needed to evaluate the balance of
substitute an imprecise verbal statement “very strong support” for the hypothesis probabilities reflected in the likelihood
(“far more probable”) for a number, while of a common source. Statements of this ratio. It addresses the probability of the
still explaining the strength of the foren- type are not common in U.S. courts, but observed patterns under the hypothe-
sic evidence in terms of the balance of they have been discussed extensively in sis that they have a different source. It
probabilities. Of course lawyers can (and the academic literature.26 They offer one fails to consider the probability of the
should) ask experts testifying in this possible answer to the question of how to observed patterns if the impressions
manner to explain what they mean by report source conclusions. have the same source. Consequently,
statements like “far more probable” and this approach may be misleading in
what basis they have for that conclusion. Match Frequencies / Random Match cases in which the latter probability is
Another approach that has been Probabilities. When a comparison low, when, for instance, the patterns
popular in Europe substitutes words for reveals matching features in two items, have important discrepancies as well as
numerical likelihood ratios. The U.K.- forensic scientists sometimes estimate similarities. Likelihood ratios, which
based Association of Forensic Science and report the frequency of the match- consider both probabilities, arguably
Providers (AFSP) has proposed that foren- ing features in a reference population. offer a more balanced and complete
sic scientists use the “verbal expressions” This occurs most commonly in forensic account of the strength of such evidence.
shown in Table 1 (above) to describe how DNA analysis, where genetic databases
strongly their evidence supports a partic- provide an empirical basis for assessing Source Probabilities. In the United
ular hypothesis about the evidence (e.g., the proportion of a population that has States, forensic examiners often pres-
the hypothesis that two items have a a particular genetic feature. Forensic ent opinions on the probability that
common source).25 Under this approach, DNA analysts sometimes refer to these two items have a common source.
forensic scientists first come up with a estimates as match frequencies (e.g., “The Opinions of this type can be expressed
likelihood ratio that reflects their percep- blood stain at the crime scene and the quantitatively, using probabilities or
tion of the balance of probabilities, and reference blood sample from the suspect percentages. For example, a forensic
then use one of the verbal expressions in have the same DNA profile. This profile scientist might say there is a 99 percent
the table instead of (or in addition to) the is estimated to occur in one person in 10 chance that two items have a common
number to describe their conclusions in million among Caucasian-Americans.”). source. It is more common, however, for
reports and testimony. Alternatively, they may present these examiners to express such conclusions
For example, a forensic scientist estimates as random match probabilities with words rather than numbers. For
who concludes (by whatever means) (RMPs) (e.g., “The probability that a example, the forensic scientist might
that the results observed in a forensic random Caucasian-American would say it is “moderately probable,” “highly
comparison are 500 times more likely if match this DNA profile is 0.0000001 probable,” or “practically certain” that
the items have a common source than if or 1 in 10 million.”). As forensic scien- two items have a common source.
they have a different source would report tists develop databases that can be used Lawyers and judges tend to like
that the comparison provides “moderately to quantify the rarity of pattern features, source probabilities because they are 4
24 VOL. 102 NO. 1

In order to under-
stand the expert’s
easy to understand; they address the The demise of the theory of discernible
exact question that the trier of fact conclusions, the uniqueness has made these conclusions
needs to assess — how likely it is that
the two impressions (e.g., two finger- Trier-of-fact will more difficult to justify. Most experts
now acknowledge that these conclusions
prints) come from the same source?
The problem, unfortunately, is that the
need to know how require the examiner to make a decision
about whether the evidence is strong
information forensic scientists can glean
from a comparison of impressions is
the expert evaluated enough to support a definitive conclu-
sion, but there does not appear to be a
not, by itself, sufficient to allow them the relevant generally accepted theory regarding how
to reach conclusions about source prob-
ability. As we will explain, examiners probabilities, and experts should make that decision.
One approach requires experts to
can logically draw conclusions about
source probabilities only by combining
how, where, and make an assessment of the source proba-
bility. They report “identification” when
conclusions drawn from a comparison
of the impressions with assumptions
why the expert their assessed source probability exceeds
some high threshold and “exclusion”
or conclusions about the strength of set the threshold when their assessment falls below some
other evidence that bears on the ques-
tion of whether the impressions being for reporting a low threshold. As discussed in the previ-
ous section, however, the assessment of
compared have a common source.27
To illustrate, consider the Elvis
particular decision. source probabilities requires the expert
to make assumptions or draw conclu-
Problem discussed in the sidebar. What
is the probability that Elvis Presley was
The trier-of-fact sions about matters beyond the forensic
comparison in question. Experts cannot
the source of the evidence left at the also will need draw conclusions about source probabil-
crime scene? As explained, this ques- ities without facing the Elvis Problem,
tion cannot be answered based on the information about which renders such conclusions prob-
forensic science evidence alone. It is
only by making assumptions or drawing the accuracy of lematic. If courts allow experts to present
conclusions reached in this manner, they
conclusions about the likelihood of Elvis
being at the crime scene — a matter
decisions reached should also require experts to disclose
the factual basis for their asserted source
having nothing to do with the foren-
sic science evidence — that the forensic
in this manner. probabilities. To evaluate the expert’s
conclusion, the trier-of-fact will need to
examiner can draw conclusions about the know the extent to which the expert’s
probability that Elvis was the source. decision was influenced by assumptions
The same problem arises whenever Identification and Exclusion. In the or conclusions about matters beyond the
forensic scientists express opinions United States, the most popular method realm of forensic science.
on source probabilities. The opinion of reporting results of forensic compari- To avoid the Elvis Problem, foren-
must, of logical necessity, depend in sons is to state a bottom-line conclusion sic scientists might instead base their
part on conclusions or assumptions about whether two traces have a common decision on their judgment of the
about matters having nothing to do source. The conclusion that two traces balance of probabilities. If they believe
with forensic science, such as whether have the same source is often described the balance weighs strongly enough in
the person who is alleged to have left a as “identification” or “individualiza- favor of the hypothesis that the items
trace (e.g., a fingerprint or shoeprint) at tion,” while a conclusion that they have being compared have the same source,
the crime scene is a likely or unlikely a different source is “exclusion.” These then they might report “identifica-
suspect and how many other people conclusions can be seen as extreme tion.” If they believe the balance weighs
had access to the crime scene. Forensic examples of source probabilities, corre- strongly enough in favor of the hypoth-
examiners are not in a good position to sponding to either a 100 percent or a esis that the items have a different
make such judgments and have no busi- zero percent chance that the traces being source, then they might report “exclu-
ness doing so anyway. compared have the same source. sion.” This approach avoids the need for 4
JUDICATURE 25

ELVIS’S ALIBI
Imagine that a bloodstain of recent origin is
found at the scene of a crime. Imagine further
that the DNA profile of the bloodstain is
somehow determined to be the same as the
DNA profile of rock-and-roll legend Elvis
Presley. Finally, imagine that the DNA profile in question is one million times more likely to be observed
if the sample came from Elvis than if it came from a random person. Based on the DNA evidence, what can
the examiner logically infer about the probability that the crime scene stain came from Elvis Presley?
A moment of reflection should be sufficient to realize that the examiner can draw no conclusion about
the probability that the crime scene stain came from Elvis based on the DNA evidence alone; the exam-
iner must also consider other matters, such as whether Elvis could plausibly be the source. In this case,
the suspect (Elvis) has a strong alibi — he was widely reported to have died in 1977. If the forensic scientist
believes this “alibi,” then the probability that the bloodstain came from Elvis is necessarily zero.
An examiner who believes Elvis is dead might decide to report that there is a zero percent chance the crime
scene sample came from Elvis. Notice, however, that this conclusion is not based on
the strength of the DNA evidence. It depends entirely on the expert’s
assessment of matters beyond the realm of forensic science — in this
case Elvis’s alibi.
The expert might try to take a neutral position on the alibi — assum-
ing, for example, that the question of whether Elvis could have been the
source is a toss-up or 50:50 chance. When this seemingly neutral assump-
tion about the truth of the alibi is taken as a starting point, the expert can
update the initial assessment in light of the DNA evidence. That approach
leads logically to the conclusion that there is more than a 99 percent chance
that Elvis was the source of the blood.32 Notice, however, that this conclusion
depends only partly on the DNA evidence; it also depends critically on the assump-
tion of a 50 percent chance a priori that the blood at the crime scene came from
Elvis (an assumption many people will view as fanciful). Should forensic scien-
tists be basing their conclusions on assumptions of this type?
The problem (as should now be clear) is that no assumption about the prob-
ability of an alibi’s veracity can truly be considered “neutral.” Yet without
some assumption about the probability of the alibi’s veracity, there is no
logical way to assess the probability that Elvis was the source.
This same logical conundrum arises in any case in which a forensic scientist is asked to assess
the probability that a particular suspect was the source of a crime scene sample based on a
forensic comparison. The expert can never answer the question based solely on the forensic
evidence. Inevitably the expert must make assumptions or take a position on other matters,
such as the probability that the suspect’s alibi is true. Doing that may well invade the jury’s
province; it certainly requires the expert to delve into matters beyond his or her scientific
expertise. Consequently, judges should consider carefully whether to admit statements
about source probabilities into evidence. If such statements are admitted, judges
(and lawyers) should try to make clear to the jury the extent to which the expert’s
conclusions depend on comparison of the items in question, and the extent to
which they depend on assumptions or conclusions about other matters.
26 VOL. 102 NO. 1

the expert to evaluate source probabil- aware of the issues discussed in this Without appropriate estimates of accu-
ities, but it still raises many questions. article, we expect they will examine the racy, an examiner’s statement that two
In order to understand the expert’s logic and basis of such conclusions far samples are similar — or even indistin-
conclusions, the trier-of-fact will need more closely than they have in the past. guishable — is scientifically meaningless:
to know how the expert evaluated the it has no probative value, and considerable
relevant probabilities, and how, where, THE GROWING IMPORTANCE OF STATISTICAL potential for prejudicial impact. Nothing
and why the expert set the threshold DATA ON ERROR RATES — not training, personal experience nor
for reporting a particular decision. The Regardless of how forensic scientists professional practices — can substitute
trier-of-fact also will need information choose to present their conclusions, for adequate empirical demonstration of
about the accuracy of decisions reached we also expect in the near future to see accuracy.28
in this manner. more testimony about the error rates PCAST called for a continuing
In the past, expert forensic science of pattern-matching disciplines. The program of research in which examin-
testimony about “identification” and 2016 PCAST report argued forcefully ers are tested by having them compare
“exclusion” often went unchallenged, that empirical research is the only way samples from known sources. PCAST
with lawyers on both sides assuming to assess the accuracy (and hence the recommended that the samples used
such testimony was reliable and uncon- probative value) of examiners’ source in the research be representative of the
troversial. As lawyers become more conclusions: samples encountered in casework, that
examiners have no information about
ALEX JOËLLE VUILLE the correct answer, that independent
BIEDERMANN is is a senior researcher groups with no stake in the outcome
associate professor at the University of conduct multiple studies, and that the
at the University Lausanne School of data be available to other scientists for
of Lausanne Criminal Justice. review.29 Courts will need to consider
(Switzerland) in She has written the results of such studies when decid-
the Faculty of extensively on the ing whether testimony about forensic
Law, Criminal Justice and Public use of scientific evidence in criminal comparisons is sufficiently trustworthy
Administration. Previously, he worked courts and the use of probabilities in to be admitted — whether, in the words
as a scientific advisor in the Federal the judicial context. of Rule 702(c) of the Federal Rules of
Department of Justice and Police in Evidence, it is “the product of reliable
FRANCO principles and methods.”30
Berne in cases investigated by the
TARONI is When such testimony is admit-
Office of the Attorney General of
professor of foren- ted, error-rate data will be relevant for
Switzerland.
sic statistics at assessing its probative value. PCAST
WILLIAM C. the University suggested that testimony about error
THOMPSON is of Lausanne, also rates of the relevant forensic method,
professor emeri- in the Faculty as research has shown on samples like
tus of criminology, of Law, Criminal Justice and Public those in the case at hand, should always
law and society at Administration. He has authored and be presented in conjunction with testi-
the University of coauthored several books on the use of mony about the results of forensic
California, Irvine. probabilities in the judicial context and comparisons. Experts are likely to be
He studies human judgment and deci- is editor of the journal Law, Probability asked about error rates during cross-ex-
sion making with a particular focus on and Risk (Oxford University Press). amination even if the proponent of the
cognitive and contextual bias in scien- forensic evidence elects not to pres-
Vuille and Biedermann gratefully acknowledge the
tific assessments, the use of scientific support of the Swiss National Science Foundation ent error-rate data in direct testimony.
and statistical evidence in the court- through grants no. PZ00P1_154955 / 1 Lawyers are likely to debate the implica-
and BSSGI0_155809. Thompson gratefully
room, and lay perceptions of scientific acknowledges support from the Center for Statistics tions and significance of error-rate data
and statistical evidence. and Applications in Forensic Evidence (CSAFE). for evaluating the probability that an
error occurred in the case at hand.
JUDICATURE 27

We are thus on the cusp of a new era (providing a simple mathematical descrip- 11 Law, Probability & Risk 347 (2012), at
for forensic science — an era in which tion of the likelihood ratio that lawyers and 351-353.
judges may encounter when reviewing forensic 24
Expert Working Grp. on Human Factors
statistics will inevitably play a greater
evidence. Let E represent the observed features in Latent Print Analysis, Latent Print
role. Oliver Wendell Holmes once of two traces that a forensic scientist is asked Examination and Human Factors:
declared that “the man of the future to compare; let HS represent the proposition Improving the Practice Through a
is the man of statistics . . . . ”31 In the (hypothesis) that the items have the same Systems Approach (2012), at 134.
pattern-matching disciplines of forensic source and Hd the proposition that they have 25
Ass’n of Forensic Sci. Providers, Standards for
science, that future has arrived. a different source. The likelihood ratio is then the Formulation of Evaluative Forensic Science
p(E|HS)/p(E|Hd), which is read as “the proba- Expert Opinion, 49 Sci. & Just. 161 (2009), at
bility of E given HS over the probability of E 163.
given Hd.”).
1
Michael J. Saks & Jonathan Koehler, The
26
Raymond Marquis et al., Discussion on How
14
European Network of Forensic Sci. Insts., to Implement a Verbal Scale in a Forensic
Coming Paradigm Shift in Forensic Identification
Guideline for Evaluative Reporting in Laboratory: Benefits, Pitfalls and Suggestions to
Science, 309 Science 892 (2005), at 892.
Forensic Science (2015), at 2.4; see also, Avoid Misunderstandings, 56 Sci. & Just. 364
2
Heidi Eldridge, The Shifting Landscape of Latent Royal Statistical Soc’y, http://www.rss.org.uk/
Print Testimony: An American Perspective, 3 J. (2016).
practitioner-guides (last visited Jan. 7, 2018)
of Forensic Sci. & Med. 72 (2017), at 72.
27
See, Bernard Robertson, et al., Interpreting
(providing reports on this issue).
3
See, Nat’l Acad. of Sci., Nat’l Research Evidence – Evaluating Forensic Science
15
Alex Biedermann, et al., Development of in the Courtroom (2d ed. 2016), at 16-18;
Council, Strengthening Forensic European Standards for Evaluative Reporting
Science in the United States: A Path Ian W. Evett, Towards a Uniform Framework
in Forensic Science: The Gap Between Intentions for Reporting Opinions in Forensic Science
Forward (2009) [hereinafter NAS Report] and Perceptions, 21 The Int’l J. of Evidence
at 44, 108, 162, 169, 176; President’s Casework, 38 Sci. & Just. 198 (1998), at
& Proof 14 (2017), at 26. 200-201 (explaining that after comparing
Council of Advisors on Sci. & Tech., 16
See, John Butler, Fundamentals of two items, a forensic examiner may be able to
Forensic Science in Criminal Courts:
Forensic DNA Typing (2009); Geoffrey S. judge the probability of the observed results
Ensuring Scientific Validity of Feature-
Morrison & William C. Thompson, Assessing under the alternative hypotheses: p(E|HS ) and
Comparison Methods (2016) [hereinafter:
the Admissibility of a New Generation of Forensic p(E|Hd ) . But these probabilities are not the
PCAST Report], at 19, 30, 54.
Voice Comparison Testimony, 18 Colum. Sci. & same as source probabilities; source probabili-
4
Simon Cole, Forensics Without Uniqueness, Tech. L. Rev. 326 (2017). ties are the inverse of these conditionals — i.e.,
Conclusions Without Individualization: The 17
Def. Forensic Sci. Ctr., Dep’t of the p(HS |E) and p(Hd |E). To infer source proba-
New Epistemology of Forensic Identification,
Army, Information Paper: Modification bilities from the probability of the observed
8 Law Probability & Risk 233 (2009), at
of Latent Print Technical Reports to evidence, the examiner must take into account
236-237.
Include Statistical Calculations (2017), the prior probability that the items have the
5
Eldridge, supra note 2, at 76. at 2. same source, p(HS ) , or different source,
6
NAS Report, Recommendation 3(b), supra 18
Id., at 2. p(Hd ) .).
note 3, at 23. 28
PCAST Report, supra note 3, at 46.
19
Alex Biedermann, et al., How to Assign a
7
Id. Likelihood Ratio in a Footwear Mark Case: An 29
Id., at 66.
8
Id., at 108. Analysis and Discussion in the Light of R v T, 30
Fed. R. Evid. 702(c).
9
PCAST Report, supra note 3. 11 Law, Probability & Risk 259 (2012), at 31
O.W. Holmes, The Path of the Law, 8 Harv. L.
10
Id., at 9–10. 265-270. Rev. 457, 469 (1897).
11
See e.g., Igor Pacheco, et al., Miami-Dade
20
D. Michael Risinger, Reservations About 32
E.g., David J. Balding & Christopher D.
research study for the reliability of the Likelihood Ratios (and Some Other Aspects of Steele, Weight-of-Evidence for Forensic
ACE-V process: Accuracy & precision in Forensic ‘Bayesianism’), 12 Law, Probability & DNA Profile (2015).
latent fingerprint examinations (2014), Risk 63, 72 (2012).
at 53-55. 21
Charles E. H. Berger, et al., Evidence
12
See e.g., Sci. Working Group on Friction Evaluation: A Response to the Court of Appeal
Ridge Analysis, Study and Technology Judgment in R v T, 51 Sci. & Just. 43 (2011), IF YOU ARE READING THIS BUT
(SWGFAST), Document # 4: Guideline at 43-44. AREN'T A JUDICATURE SUBSCRIBER,
Marjan Sjerps & Charles E. Berger, How Clear
YOU SHOULD BE.
22
for the Articulation of the Decision-
Making Process for the Individualization is Transparent? Reporting Expert Reasoning in
in Friction Ridge Examination (Latent/ Legal Cases, 11 Law, Probability & Risk 317
Tenprint) r. 11.2.3 (2013), at 11.2.3. (2012). SUBSCRIBE NOW AT
13
Colin G.G. Aitken & Franco Taroni, Statis- 23
Id.; Biedermann, supra note 19, at 259; JUDICIALSTUDIES.DUKE.EDU/
tics and the Evaluation of Evidence for William C. Thompson, Discussion Paper: Hard JUDICATURE
Forensic Scientists (2d ed. 2004), at 95 Cases Make Bad Law – Reactions to R v T,
IN THIS EDITION
JUDICATURE VOL. 102 NO. 1

Departments
2 EDITOR’S NOTE, BRIEFS, HONORS

58
INTRODUCING THE BOLCH JUDICIAL INSTITUTE

9 ON E-DISCOVERY
WHY CAN’T I JUST REVIEW IT IN OUTLOOK?
George Socha & Margaret Wolf

15
12 THE STORIED THIRD BRANCH
ICON OF THE BENCH AND GRIDIRON:
JUDGE KIM HAMMOND
Raul A. Zambrano

Features 67 POINT-COUNTERPOINT
PIECE OF CAKE: MASTERPIECE CAKESHOP LTD.
V. COLORADO CIVIL RIGHTS COMMISSION

15 Frank S. Ravitch & Brett G. Scharffs

FORENSIC FAIL 76 BOOK REVIEW


Brandon L. Garrett HOW SOLITUDE CAN MAKE YOU A BETTER LEADER

18
Spencer D. Levine

AFTER UNIQUENESS: THE EVOLUTION OF 80 REDLINES


FORENSIC SCIENCE OPINIONS LET’S DITCH UNNECESSARY PROCEDURAL DETAIL
William C. Thompson, Joëlle Vuille, Joseph Kimble
Franco Taroni & Alex Biedermann

28
HOW TRIAL JUDGES SHOULD THINK ABOUT
FORENSIC SCIENCE EVIDENCE
Jonathan J. Koehler

39
76
UP TO THE COURTS: MANAGING FORENSIC TESTIMONY
WITH LIMITED SCIENTIFIC VALIDITY
J. H. Pate Skene

50

67
JHEALTH – HOW THE TENTH CIRCUIT IS IMPROVING THE HEALTH
AND PERFORMANCE OF FEDERAL JUDGES
Marcia S. Krieger, Michael H. Gendel & Timothy D. DeGiusti

56
12
HOW LOCKHART REALLY SHOULD HAVE BEEN DECIDED:
CANONS OF CONSTRUCTION ARE KEY
Bryan A. Garner

58
DECODING GDPR
EDRM GDPR Drafting Team
!

!"#$%&'() by the WHAT AN HONOR IT IS FOR ME TO GREET YOU AS THE INAUGURAL


*+,-./0123-34,/356737178 DIRECTOR OF THE BOLCH JUDICIAL INSTITUTE OF DUKE LAW SCHOOL.
of Duke Law School As you will read in this journal, Carl and Susan Bolch have endowed this Institute to
support and promote the study of courts and judicial decision-making, institutional design
and reform, and, above all, the rule of law and the role of an independent judiciary in
2398-7+9 upholding the rule of law. It is a wonderful and broad mission that touches upon many areas
of scholarship and law reform and opens up many avenues for collaboration, teaching, and
"#$%&!'(!)*$%! field work. An effective, fair judicial and legal system is the foundation of any prosperous
!"#$%&'(&)*+$&",-&'$,."#/,&0(&)*+$&)$",&
and functioning economy and culture. But it is not permanent or impervious to decay.
123445&46&7"89&)*+$&:,/;$<%/=>&
This Institute will study the rule
of law, how it is achieved, described,
28!17:/2398-7+9 measured, and protected, and how it
+,-.!/(!0#1%*2! can be advanced to promote justice,
nonviolence, and international order.
466+-3478/2398-7+9 We will study how technology and
innovation can advance the rule of
3*4%.&#!35*67!8#9:-.
law and human rights, improve the
administration of justice, and help
provide access to justice. And we
JUDICATURE will share the results of our endeav-
ors with judiciaries and governments
?@7:AB&CDE9&0:A'BF&C around the world.

;454<35</8237+9
VKWX$DYZ$U0O=!"YZK These are big and consequential
topics. Fortunately, we have a deep
3*4%.&#!35*67!8#9:-.
“bench” of scholars here at Duke,
both at the law school and throughout the university, who are leaders and experts in these
fields. We also are eager to work with other organizations around the world. We aspire to
8)%=>?%@$/4&&%&=@AB( connect scholarly research to the large network of organizations that are already actively
;-#.%!<,,=>!),6#!?*@-!'#6A*6>!! involved in fostering the rule of law on the ground. And we will look to the judiciary and
"#B%#!C6**.>!+#.7*!D#5E,,&>!! the legal profession to join and enhance our efforts.
"#:.5!)9>!8#4*6%*!3#6%.,>!',66*7@!F,6A#.>!
G.&6*E!H#6=>!'6#.B*7!H6*7A#>!!!
Judicature will continue to flourish under the umbrella of the Bolch Judicial Institute.
;,I-%#!J#.! As before, it will explore the administration of justice and the practice of judging. It will
continue to offer scholarship that is relevant to the courts, insight that can inform and
advance the work of the judiciary, and perspectives that challenge us to broader under-
!""#$%%&&'()%%$ standing. This edition’s cover story on forensic science is a good example of how scholar-
*$&%+)$,-./$0123/45267$"89::;$:<$=>?@$$ ship and research can affect the decisions judges make on a day-to-day basis. The Bolch
A;;$42B965$4/5/43/C@$D925$E-F;28>62:1G$:4$>17$E>46$69/4/:<G$$ Judicial Institute’s renewed focus on judicial independence recalls Judicature’s original
H>7$1:6$F/$4/E4:C-8/C$?269:-6$?4266/1$E/4H2552:1$$
purpose as the magazine of the American Judicature Society, which was dedicated to
<4:H$,-./$0123/45267@$$I2/?5$/JE4/55/C$9/4/21$C:$1:6$$
necessarily reflect the views of Duke Law School $
promoting an independent judiciary insulated from the pressure of electoral politics. As
>5$>1$/16267$:4$:<$265$<>8-;67@$ it renews this focus, the Bolch Judicial Institute will work to expand Judicature’s reach
K/L-/565$<:4$4/E42165$H>7$F/$5/16$6:M$ within the legal profession and academy in the United States and around the world.
'4523&!*-/2/"5&G,%=/=*=$&46&)*+$&7"8&123445&&& I am grateful for your support of this journal and look forward to working with you
&+%$"82/18/$,423/$$N$$O:J$P%QR&$$$
to pursue these important goals. Please send your comments and ideas, on this journal
,-49>HG$#S$&TT%)'%QR&$$
U9:1/M$$P+P'R+Q'T%TQ$$N$$V>JM$$P+P'R+Q'T+()$$
and on the future of the Bolch Judicial Institute, to judicature@law.duke.edu or to me
directly at levi@law.duke.edu.
$

29&%B#@96*K4#E(&9=*(*&9$
29&%B%#47@9&%*7(&9=*(*&9! David F. Levi
K"9=*+9&%B#@96* James B. Duke and Benjamin N. Duke Dean, Duke Law School
Director, Bolch Judicial Institute
JUDICATURE VOL. 102 NO. 1

089532!9:!;6904 ì The rule of law is the foundation for the stability of society, human rights, a grow≠
>30!1375E29C65 ing economy and fl ourishing culture and artistic life. An independent judiciary
!"#$%&':%8%5,-'!"#./.0*'E.6,2./,&'9*32.#0 and a societyís belief in the fairness of its justice system are critical to preserving
and protecting the rule of law.î !!"!#$%&!'(&#)!*%+
13728!34!089532"
"7276!7F=F!/02297/ Welcome to the spring edition of Judicature. This edition includes an announcement
P0$.6,20,%'!"#$%&'CD:D'E.6,2./,'13"2,&'' of a very significant gift to benefit Duke’s judicial studies programs and Judicature: a $10
E.6,2./,'3+'1355%/,./",
million gift from Duke alumnus Carl Bolch Jr. and his wife, Susan Bass Bolch, to establish
87B98!:<4402 the Bolch Judicial Institute at Duke Law School. The institute will focus on the important
1-.%+'!"#$%&'CD:D'E.6,2./,'13"2,&'E.6,2./,'3+'C,0-
and unique mission of promoting the rule of law and the value of a fair and independent
/0/102"!34!560!13728 judiciary in the U.S. and around the world. The Bolch Judicial Institute also will support
the Master of Judicial Studies Program, which will graduate its third class this May —
89:76!72;67/107<=5
!"#$%&'()%*+,-'!"#./.0*'1.2/".,'13"2,&'4**.53.6
myself included. On behalf of the judges in the master’s program, I offer a special thank
you to the Bolches for this extraordinary gift. We have
>0::9402!179=0?
!"#$%&'7*%8%5,-'!"#./.0*'1.2/".,'13"2,&'9*32.#0
benefited greatly from our experience at Duke, and it
is wonderful to know that many more judges, in the
;6029!107"=0? United States and abroad, will now have the opportu-
!"6,./%&':";2%<%'13"2,'3+'=32,-'1023*.50
nity to participate in Duke’s programs.
4208029;!1=3;@A This edition of Judicature also features three articles
!"#$%&'13<<%2./0*'13"2,&'>%*$."<
that analyze the validity of forensic methods used in
231025!12<59:0= the court system. With data from recent reports by the
!"6,./%&'?2.@350':";2%<%'13"2,
National Research Council, the President’s Council of
!87B98!;3==9:" Advisors on Science and Technology, and the American
!"6,./%&'A.$-'13"2,'3+'=%)'B%0*05#
Association for the Advancement of Science, these arti-
/72@!87B9" cles note that many widely used forensic disciplines
!"#$%&'=32,-'1023*.50'13"2,'3+'?;;%0*6
do not meet standards of scientific validity applied in
59/356?!80C9<"59
!"#$%&'CD:D'E.6,2./,'13"2,&''
F%6,%25'E.6,2./,'3+'GH*0-3<0 !"#$%&'(%% scientific research and explore the challenge for courts
and lawyers in managing forensic testimony in light of
;629"!89==3:
!"#$%&'=32,-'1023*.50'13"2,'3+'?;;%0*6
()*&#"%*+%,'*(! these claims of fallibility.
Other articles offer an account of how the U.S.
102:9;0!83:7=8! Court of Appeals for the Tenth Circuit is addressing the ever-important issue of judi-
!"#$%&'CD:D'13"2,'3+'?;;%0*6'+32',-%':.I,-'1.2/"., cial health and a perspective on canons of construction and judicial writing from Bryan
/?23:!8<6725!99 Garner, who offers a lively response to an article published in the winter edition of
!"#$%&'J"/06'13"5,K'13"2,'3+'13<<35'L*%06&'G-.3 Judicature by Joseph Kimble. In keeping with the tradition of Judicature, this edition
>7/0"!C2944956 includes another installment of the Storied Third Branch, “Icon of the Bench and
!"#$%&'G5%.#0'90<.*K'13"5,K'13"2,'M'N3<%&'=%)'O32H Gridiron,” honoring the life of Florida Seventh Judicial Circuit Judge Kim Hammond
87B98!>3:0" and written by Judge Hammond’s good friend and chief judge of the Seventh Judicial
1-.%+'!"#$%&'CD:D'>05H2";,/K'13"2,&'' Circuit, Raul Zambrano. Our Point-Counterpoint for this edition highlights Masterpiece
:3",-%25'E.6,2./,'3+'(%I06
Cakeshop Ltd. v. Colorado Civil Rights Commission, a case pending before the U.S.
"D0:;02!=0B9:0
!"#$%&'93"2,-'E.6,2./,'13"2,'3+'?;;%0*&'9*32.#0
Supreme Court; two religious liberty scholars, professors Frank Ravitch and Brett Scharffs,
provide differing perspectives on the case’s implications. Finally, one of Florida’s finest
0//7:<0=!231025"
!"6,./%&':";2%<%'13"2,'3+':.%220'J%35%
appellate court judges (and my colleague in the LLM program), Spencer Levine of the
Florida Fourth District Court of Appeal, provides a book review of Lead Yourself First,
>0::9402!56<2"53:
P0$.6,20,%'!"#$%&'CD:D'E.6,2./,'13"2,&''
Inspiring Leadership Through Solitude, by Judge Raymond Kethledge of the U.S. Court of
706,%25'E.6,2./,'3+'10*.+325.0 Appeals for the Sixth Circuit and co-author Michael Erwin.
7::!59//02 It has been my pleasure to serve as the editor in chief of this edition of Judicature. Once
!"6,./%&'?2.@350':";2%<%'13"2, again, on behalf of the May 2018 graduating class of the Judicial Studies Program, special
527;90!5388 thanks to Mr. and Mrs. Bolch for their wonderful gift to support judicial studies at Duke
!"#$%&'1.2/".,'13"2,&'?*0Q0<0 and to continue to give judges the incredible opportunity that I and my fellow members of
the Class of 2018 have enjoyed.
!
"#$%&'($)!*+,(+)!-.!!
Joe Boatwright, Judge, Putnam County, Seventh Judicial Circuit, Florida
!"#$%$&'()"#$*(+#",*+*#"-!"#$%&)".*

Вам также может понравиться