Академический Документы
Профессиональный Документы
Культура Документы
November 2013
Bailey Farms, Ossining, NY
Table of Contents
Rationality Checklist.............................................................................................................................3
Annotated Schedule...............................................................................................................................9
What is Applied Rationality?..............................................................................................................13
Getting the Most out of the Workshop................................................................................................1
!rediction Markets..............................................................................................................................19
"pening Session # $urther Resources.................................................................................................%%
$riday # &o' to (se )our *rain..............................................................................................................%
*uilding *ayesian &a+its....................................................................................................................%
)our ,nner Si-ulator............................................................................................................................%
/-otional Re0Association...................................................................................................................1
Goal $actoring.....................................................................................................................................2
Attention..............................................................................................................................................31
Saturday # 4ry 4hings..............................................................................................................................3%
A5ersion $actoring and Cali+ration.....................................................................................................3%
Againstness..........................................................................................................................................93
,-ple-entation ,ntentions...................................................................................................................92
Curating )our /-otional 6i+rary......................................................................................................111
Co-fort 7one /8pansion 9Co7/:.....................................................................................................11;
Sunday # Co-pound Returns.................................................................................................................113
<elegating to )ourself.......................................................................................................................113
!ropagating (rges.............................................................................................................................113
"ffline &a+it 4raining.......................................................................................................................13.
4ur+ocharging 4raining.....................................................................................................................1;3
=alue of ,nfor-ation.........................................................................................................................1.%
>a-es and $aces? Staff.....................................................................................................................11
>a-es and $aces? =olunteers............................................................................................................1.
>a-es and $aces? !articipants..........................................................................................................13
Contact ,nfo.......................................................................................................................................12
%
Rationality Checklist
4his checklist is -eant for your personal use so you can ha5e a 'ish0list of rationality ha+its@ and so
that you can see if youAre acBuiring good ha+its o5er the ne8t yearC'eAre not using it to decide ho'
rational you are at the start of the progra-.
1. Reacting to evidence / surprises / arguments you haven't heard before; flagging beliefs for
examination.
a) When , see so-ething odd 0 so-ething that doesnAt fit 'ith 'hat ,Ad ordinarily
e8pect@ gi5en -y other +eliefs 0 , successfully notice@ pro-ote it to conscious
attention and think D, notice that , a- confusedD or so-e eBui5alent thereof.
9Example: You think that your flight is scheduled to depart on Thursday. On
Tuesday, you get an email from Travelocity advising you to prepare for your
flight tomorrow, which seems wrong. !o you successfully raise this
anomaly to the level of conscious attention" 9#ased on the experience of an
actual $%er who failed to notice confusion at this point and missed their plane
flight.::
<ate of last e8a-ple?
>e5er
4odayEyesterday
6ast 'eek
6ast -onth
6ast year
*efore the last year
b) When so-e+ody says so-ething that isnAt Buite clear enough for -e to
5isualiFe@ , notice this and ask for e8a-ples. 9&ecent example from Elie'er: (
mathematics student said they were studying )stacks). * asked for an example
of a stack. They said that the integers could form a stack. * asked for an
example of something that was not a stack.: 9&ecent example from (nna: +at
said that her ,oyfriend was very competitive. * asked her for an example of
)very competitive.) -he said that when he.s driving and the person next to him
revs their engine, he must ,e the one to leave the intersection first/and when
he.s the passenger he gets mad at the driver when they don.t react similarly.:
<ate of last e8a-ple?
>e5er
4odayEyesterday
6ast 'eek
6ast -onth
6ast year
*efore the last year
c) , notice 'hen -y -ind is arguing for a side 9instead of e5aluating 'hich side to
choose:@ and flag this as an error -ode. 9&ecent example from (nna: 0oticed
myself explaining to myself why outsourcing my clothes shopping does make
sense, rather than evaluating whether to do it.:
<ate of last e8a-ple?
>e5er
4odayEyesterday
6ast 'eek
6ast -onth
6ast year
*efore the last year
d) , notice -y -ind flinching a'ay fro- a thoughtG and 'hen , notice@ , flag that
area as reBuiring -ore deli+erate e8ploration. 9&ecent example from (nna: *
have a failure mode where, when * feel socially uncomforta,le, * try to make
others feel mistaken so that * will feel less vulnera,le. 1utting this thought
into words re2uired repeated conscious effort, as my mind kept wanting to 3ust
drop the su,3ect.:
<ate of last e8a-ple?
>e5er
4odayEyesterday
6ast 'eek
6ast -onth
6ast year
*efore the last year
3
e) , consciously atte-pt to 'elco-e +ad ne's@ or at least not push it a'ay.
9&ecent example from Elie'er: (t a ,rainstorming session for future
-ingularity -ummits, one issue raised was that we hadn4t really ,een asking
for money at previous ones. 5y ,rain was offering resistance, so * applied the
),ad news is good news) pattern to rephrase this as, )This point doesn4t
change the fixed amount of money we raised in past years, so it is good news
,ecause it implies that we can fix the strategy and do ,etter next year.):
<ate of last e8a-ple?
>e5er
4odayEyesterday
6ast 'eek
6ast -onth
6ast year
*efore the last year
. !uestioning and analy"ing beliefs #after they come to your attention$.
a) , notice 'hen ,A- not +eing curious. 9&ecent example from (nna: %henever
someone critici'es me, * usually find myself thinking defensively at first, and
have to visuali'e the world in which the criticism is true, and the world in
which it4s false, to convince myself that * actually want to know. 6or example,
someone critici'ed us for providing inade2uate prior info on what statistics
we4d gather for the &ationality 5inicamp7 and * had to visuali'e the
conse2uences of 8explaining to myself, internally, why * couldn.t have done
any ,etter given everything else * had to do9, vs. the possi,le conse2uences of
8visuali'ing how it might4ve ,een done ,etter, so as to update my action:
patterns for next time9, to snap my ,rain out of defensive:mode and into
should:we:do:that:differently mode.:
<ate of last e8a-ple?
>e5er
4odayEyesterday
6ast 'eek
6ast -onth
6ast year
*efore the last year
b) , look for the actual@ historical causes of -y +eliefs@ e-otions@ and ha+itsG and
'hen doing so@ , can suppress -y -indAs search for Hustifications@ or set aside
Hustifications that 'erenAt the actual@ historical causes of -y thoughts. 9&ecent
example from (nna: %hen it turned out that we couldn4t rent the 5inicamp
location * thought * was going to get, * found lots and lots of reasons to ,lame
the person who was supposed to get it7 ,ut reali'ed that most of my emotion
came from the fear of ,eing ,lamed myself for a cost overrun.:
<ate of last e8a-ple?
>e5er
4odayEyesterday
6ast 'eek
6ast -onth
6ast year
*efore the last year
c) , try to think of a concrete e8a-ple that , can use to follo' a+stract argu-ents
or proof steps. 9+lassic example: &ichard 6eynman ,eing distur,ed that
#ra'ilian physics students didn4t know that a )material with an index) meant a
material such as water. *f someone talks a,out a proof over all integers, do
you try it with the num,er ;<" *f your thoughts are circling around your
roommate ,eing messy, do you try checking your reasoning against the
specifics of a particular occasion when they were messy":
<ate of last e8a-ple?
>e5er
4odayEyesterday
6ast 'eek
6ast -onth
6ast year
*efore the last year
;
d) When ,A- trying to distinguish +et'een t'o 9or -ore: hypotheses using a piece
of e5idence@ , 5isualiFe the 'orld 'here hypothesis I1 holds@ and try to
consider the prior pro+a+ility ,Ad ha5e assigned to the e5idence in that 'orld@
then 5isualiFe the 'orld 'here hypothesis I% holdsG and see if the e5idence
see-s -ore likely or -ore specifically predicted in one 'orld than the other
9=istorical example: !uring the (manda >nox murder case, after many hours
of police interrogation, (manda >nox turned some cartwheels in her cell. The
prosecutor argued that she was cele,rating the murder. %ould you, confronted
with this argument, try to come up with a way to make the same evidence fit
her innocence" Or would you first try visuali'ing an innocent detainee, then a
guilty detainee, to ask with what fre2uency you think such people turn
cartwheels during detention, to see if the likelihoods were skewed in one
direction or the other":
<ate of last e8a-ple?
>e5er
4odayEyesterday
6ast 'eek
6ast -onth
6ast year
*efore the last year
e) , try to consciously assess prior pro+a+ilities and co-pare the- to the apparent
strength of e5idence. 9&ecent example from Elie'er: ?sed it in a conversation
a,out apparent evidence for parapsychology, saying that for this * wanted p @
A.AAA;, like they use in physics, rather than p @ A.AB, ,efore * started paying
attention at all.:
<ate of last e8a-ple?
>e5er
4odayEyesterday
6ast 'eek
6ast -onth
6ast year
*efore the last year
f) When , encounter e5idence thatAs insufficient to -ake -e Dchange -y -indD
9su+stantially change +eliefsEpolicies:@ +ut is still -ore likely to occur in 'orld
J than 'orld )@ , try to update -y pro+a+ilities at least a little. 9&ecent
example from (nna: &eali'ed * should somewhat update my ,eliefs a,out
,eing a good driver after someone else knocked off my side mirror, even
though it was legally and pro,a,ly actually their fault/even so, the accident
is still more likely to occur in worlds where my ,ad:driver parameter is
higher.:
<ate of last e8a-ple?
>e5er
4odayEyesterday
6ast 'eek
6ast -onth
6ast year
*efore the last year
%. &andling inner conflicts; 'hen different parts of you are pulling in different directions( you 'ant
different things that seem incompatible; responses to stress.
a) , notice 'hen , and -y +rain see- to +elie5e different things 9a +elief05s0
anticipation di5ergence:@ and 'hen this happens , pause and ask 'hich of us is
right. 9&ecent example from (nna: Cumping off the -tratosphere =otel in $as
Degas in a wire:guided fall. * knew it was safe ,ased on EA,AAA data points of
people doing it without significant in3ury, ,ut to persuade my ,rain * had to
visuali'e F times the population of my college 3umping off and surviving. (lso,
my ,rain sometimes seems much more pessimistic, especially a,out social
things, than * am, and is almost always wrong.:
<ate of last e8a-ple?
>e5er
4odayEyesterday
6ast 'eek
6ast -onth
6ast year
*efore the last year
.
b) When facing a difficult decision@ , try to refra-e it in a 'ay that 'ill reduce@ or
at least s'itch around@ the +iases that -ight +e influencing it. 9&ecent example
from (nna4s ,rother: Trying to decide whether to move to -ilicon Dalley and
look for a higher:paying programming 3o,, he tried a reframe to avoid the
status 2uo ,ias: *f he was living in -ilicon Dalley already, would he accept a
G<A> pay cut to move to -anta #ar,ara with his college friends" 9(nswer:
0o.::
<ate of last e8a-ple?
>e5er
4odayEyesterday
6ast 'eek
6ast -onth
6ast year
*efore the last year
c) When facing a difficult decision@ , check 'hich considerations are
conseBuentialist 0 'hich considerations are actually a+out future conseBuences.
9&ecent example from Elie'er: * ,ought a G;EAA mattress in my 2uest for
sleep, over the *nternet, and hence much cheaper than the mattress * tried in
the store, ,ut non:returna,le. %hen the new mattress didn4t seem to work too
well once * actually tried sleeping nights on it, this was making me reluctant to
spend even more money trying another mattress. * reminded myself that the
G;EAA was a sunk cost rather than a future conse2uence, and didn4t change the
importance and scope of future ,etter sleep at stake 9occurring once per day
and a large effect si'e each day:.
<ate of last e8a-ple?
>e5er
4odayEyesterday
6ast 'eek
6ast -onth
6ast year
*efore the last year
). *hat you do 'hen you find your thoughts( or an argument( going in circles or not getting any'here.
a) , try to find a concrete prediction that the different +eliefs@ or different people@
definitely disagree a+out@ Hust to -ake sure the disagree-ent is realEe-pirical.
9&ecent example from 5ichael -mith: -omeone was worried that rationality
training might ,e )fake), and * asked if they could think of a particular
prediction they4d make a,out the results of running the rationality units, that
was different from mine, given that it was )fake).:
<ate of last e8a-ple?
>e5er
4odayEyesterday
6ast 'eek
6ast -onth
6ast year
*efore the last year
b) , try to co-e up 'ith an e8peri-ental test@ 'hose possi+le results 'ould either
satisfy -e 9if itAs an internal argu-ent: or that -y friends can agree on 9if itAs a
group discussion:. 9This is how we settled the running argument over what to
call the +enter for (pplied &ationality/Culia went out and tested alternate
names on around ;FA people.:
<ate of last e8a-ple?
>e5er
4odayEyesterday
6ast 'eek
6ast -onth
6ast year
*efore the last year
c) ,f , find -y thoughts circling around a particular 'ord@ , try to ta+oo the 'ord@
i.e.@ think 'ithout using that 'ord or any of its synony-s or eBui5alent
concepts. 9/.g. 'ondering 'hether youAre Ds-art enoughD@ 'hether your
partner is DinconsiderateD@ or if youAre Dtrying to do the right thingD.: 9&ecent
example from (nna: (dvised someone to stop spending so much time
wondering if they or other people were 3ustified7 was told that they were trying
to do the right thing7 and asked them to ta,oo the word 4trying4 and talk a,out
how their thought:patterns were actually ,ehaving.:
<ate of last e8a-ple?
>e5er
4odayEyesterday
6ast 'eek
6ast -onth
6ast year
*efore the last year
+. ,oticing and flagging behaviors #habits( strategies$ for revie' and revision.
a) , consciously think a+out infor-ation05alue 'hen deciding 'hether to try
so-ething ne'@ or in5estigate so-ething that ,A- dou+tful a+out. 9&ecent
example from Elie'er: Ordering a GFA exercise ,all to see if sitting on it would
improve my alertness andHor ,ack muscle strain.I J0on:recent example from
Elie'er: (fter several months of procrastination, and due to (nna nagging me
a,out the value of information, finally trying out what happens when * write
with a paired partner7 and finding that my writing productivity went up ,y a
factor of four, literally, measured in words per day.:
<ate of last e8a-ple?
>e5er
4odayEyesterday
6ast 'eek
6ast -onth
6ast year
*efore the last year
b) , Buantify conseBuencesCho' often@ ho' long@ ho' intense. 9&ecent example
from (nna: %hen we had Culia take on the task of figuring out the +enter4s
name, * worried that a certain person would ,e offended ,y not ,eing in
control of the loop, and had to consciously evaluate how impro,a,le this was,
how little he4d pro,a,ly ,e offended, and how short the offense would pro,a,ly
last, to get my ,rain to stop worrying.: 91lus K real cases we4ve o,served in
the last year: -omeone switching careers is afraid of what a parent will think,
and has to consciously evaluate how much emotional pain the parent will
experience, for how long ,efore they acclimate, to reali'e that this shouldn4t ,e
a dominant consideration.:
<ate of last e8a-ple?
>e5er
4odayEyesterday
6ast 'eek
6ast -onth
6ast year
*efore the last year
-. Revising strategies( forming ne' habits( implementing ne' behavior patterns
a) , notice 'hen so-ething is negati5ely reinforcing a +eha5ior , 'ant to repeat.
9&ecent example from (nna: * noticed that every time * hit 4-end4 on an email,
* was visuali'ing all the ways the recipient might respond poorly or something
else might go wrong, negatively reinforcing the ,ehavior of sending emails.
*4ve JaI stopped doing that J,I installed a ha,it of smiling each time * hit 4-end4
9which provides my ,rain a 3olt of positive reinforcement:. This has resulted
in strongly reduced procrastination a,out emails.:
<ate of last e8a-ple?
>e5er
4odayEyesterday
6ast 'eek
6ast -onth
6ast year
*efore the last year
b) , talk to -y friends or deli+erately use other social co--it-ent -echanis-s
on -yself. 9&ecent example from (nna: ?sing grapefruit 3uice to keep up
,rain glucose, * had some 3uice left over when work was done. * looked at
5ichael -mith and 3okingly said, )#ut if * don4t drink this now, it will have
,een wastedL) to prevent the sunk cost fallacy.: 9Example from Elie'er: %hen
* was having trou,le getting to sleep, * JaI talked to (nna a,out the dum,
reasoning my ,rain was using for staying up later, and J,I set up a system with
$uke where * put a M in my daily work log every night * showered ,y my target
time for getting to sleep on schedule, and a / every time * didn4t.:
<ate of last e8a-ple?
>e5er
4odayEyesterday
6ast 'eek
6ast -onth
6ast year
*efore the last year
2
c) 4o esta+lish a ne' ha+it@ , re'ard -y inner pigeon for e8ecuting the ha+it.
9Example from Elie'er: 5ultiple o,servers reported a long:term increase in
my warmth H niceness several months after... K repeats of E:hour writing
sessions during which, in passing, * was rewarded with an 5N5 Jand smilesI
each time * complimented someone, i.e., remem,ered to say out loud a nice
thing * thought.: 9&ecent example from (nna: Yesterday * rewarded myself
using a smile and happy gesture for noticing that * was doing a string of low:
priority tasks without doing the metacognition for putting the top priorities on
top. 0oticing a mistake is a good ha,it, which *.ve ,een training myself to
reward, instead of 3ust feeling ,ad.:
<ate of last e8a-ple?
>e5er
4odayEyesterday
6ast 'eek
6ast -onth
6ast year
*efore the last year
d) , try not to treat -yself as if , ha5e -agic free 'illG , try to set up influences
9ha+its@ situations@ etc.: on the 'ay , +eha5e@ not Hust rely on -y 'ill to -ake
it so. 9Example from (licorn: * avoid learning politicians. positions on gun
control, ,ecause * have strong emotional reactions to the su,3ect which * don.t
endorse.: 9&ecent example from (nna: * ,ri,ed +arl to get me to write in my
3ournal every night.:
<ate of last e8a-ple?
>e5er
4odayEyesterday
6ast 'eek
6ast -onth
6ast year
*efore the last year
e) , use the outside 5ie' on -yself. 9&ecent example from (nna: * like to call
my parents once per week, ,ut hadn4t done it in a couple of weeks. 5y ,rain
said, )* shouldn4t call now ,ecause *4m ,usy today.) 5y other ,rain replied,
)Outside view, is this really an unusually ,usy day and will we actually ,e less
,usy tomorrow"):
<ate of last e8a-ple?
>e5er
4odayEyesterday
6ast 'eek
6ast -onth
6ast year
*efore the last year
3
.nnotated /chedule
0riday 1 &o' to 2se 3our 4rain
On the first day of the workshop, you.ll learn a,out the ,asic ,uilding ,locks of human reasoning Jand
some of the ,iases that turn up when they.re misappliedI. You.ll learn how to draw on your ,est ha,its
and heuristics more often, and start adding to your arsenal of cognitive tools.
5pening /ession
What does it -ean to +e rational? !opular culture sho's us a Spock0like figure # a narro' po'erhouse@
una+le to deal 'ith nuance or e-otion. At C$AR@ 'e train thinkers 'ho 'ork 'ell across -any
do-ains@ as ready to use Buick and dirty heuristics as careful@ deli+erate reasoning.
WeKll also co5er the logistics for the 'eekend? introducing the instructors@ ho' to get the -ost out of
classes and con5ersations@ and the +etting ga-e that runs during the 'orkshop.
4uilding 4ayesian &abits
!ro+a+ility theory sho's us ho' to +est update our picture of e5eryday reality in response to e5idence.
So ho' can you re-e-+er ho' to do that in e5eryday life? 6earn the ha+its and heuristics to apply
*ayesian reasoning to e5erything fro- Bualitati5e data 9L, had a good feeling a+out that inter5ie'M: to
infor-ation that see-s too s-all0scale for statistics 9LMy friend liked this +ook@ should , read it?M:.
3our 6nner /imulator
)ou can trust your refle8es to dodge a thro'n +all@ +ut 'hen else is your intuition likely to +e relia+le?
&o' can you fra-e pro+le-s in the language and i-ages you +rain is -ost prepared to parse? )ou
-ight use Lpre0hindsightM as you i-agine a -essage fro- the future saying a proHect has failed@ and
'atching as your +rain instincti5ely fills in L,t didnKt 'ork +ecauseNM
7motional Re1.ssociation
"ur e-otions distill data Buickly@ po'erfully@ unrelia+ly@ and often in strange 'ays. WeKll teach you
ho' you can use our understanding of neuroscience to learn fro- your instincti5e@ e-otional reactions
and ho' to change e-otional gears 9e.g. if youKre in a situation 'here it 'ould +e -ore useful to +e
curious than angry:.
8oal 0actoring
<o you e5er find yourself saying@ L(nfortunately@ , ha5e toN J?M Goal factoring teaches you to
syste-atically +reak do'n e5erything o+5ious and non0o+5ious youKre acco-plishing@ and ask a+out
'ays you could achie5e those factors separately and -ore effecti5ely # a ne' perspecti5e on
e5erything fro- reading ha+its to e-ail etiBuette to outings 'ith friends.
.ttention
What pulls your concentration a'ay fro- 'ork youAd like to do@ or e8periences youAd like to enHoy?
&o' can you -aintain your focus and e5en e8pand the a-ount of attention you can place on your
e8perience 'hen youAre at your +est.
9
/aturday 1 Try Things9
On day one, we taught you a,out how you think and reason, and gave some tips on exploiting this
knowledge to achieve your goals. On day two, we shift into exploration mode so you can start
expanding your a,ility to act, imagine, and create. Overcome aversions, try out a new internal story,
and find valua,le opportunities to step outside your comfort 'one.
.version 0actoring and Calibration
We daily shy a'ay fro- risks and opportunities that arenKt really har-ful. What are so-e possi+ly0
5alua+le things youK5e Lne5er gotten aroundM to trying? Would it really +e that painful to try the-?
"rder ne' foods@ +reak your co--ute routine@ speak to an inti-idating co'orker@ and learn not to take
One5erK for an ans'er.
.gainstness
4ensing up can 'in a physical fight@ +ut it 'onKt 'in a de+ate or -ake a good life decision. 6earn to
notice and control your +odyKs instincti5e fight0or0flight responseG in stressful situations@ re-ain cal-
and open to ne' infor-ation. (se your understanding of your +ody to +e a+le to redirect an unhelpful
kneeHerk reaction.
6mplementation 6ntentions
,f you could -ake only one change to your planning ha+its@ 'hat 'ould you e8pect 'ould ha5e the
largest effect? Gi5e yourself the chance to follo' through on plans -ore successfully and increase
your sense of ha5ing opportunities to seiFe as you go through your day.
Curating 3our 7motional :ibrary
A piece of art@ 'hether high+ro' or lo'@ can transfi8 us. 6earn to -ake deli+erate use of i-ages@
audio@ places@ and people that ha5e a strong e-otional effect on you@ so you can change your
disposition or Hust e8perience life -ore richly.
Comfort ;one 7xpansion #Co;7$
,tKs te-pting to stick to the ha+its you trust. And itKs hard to esti-ate the cost of the opportunities you
-iss. ,n this class@ figure out ho' to e8peri-ent socially and see 'here your fear is li-iting your fun.
4his class is follo'ed +y a real life practicu- in a pu+lic shopping -all@ 'here you can practice 'ith
real@ li5e people. (se i-pro5 e8ercises to get so-e practice thinking on your feet and e8peri-enting
'ith ne' ideas under pressure.
11
/unday 1 Compound Returns
=ow will you make use of your new skills and ha,its" On the final day of classes, learn how to make a
new ,ehavior routine, stick to plans, a2uire skills efficiently and other tools for helping you get the
most out of what you know faster.
<elegating to 3ourself
&o' can you -ake plans 9fro- the e5eryday to the a-+itious: that you can trust yourself to carry out?
6o'er your strain +y thinking socially 'hen you plan@ so you keep yourself accounta+le in the future
'ithout +eco-ing a hectoring task-aster.
WeKll also teach you a 'ay to +atch process the 'ay you learn fro- e8perience@ so you can recursi5ely
i-pro5e your strategy for planning or anything else you 'ant to adHust.
=ropagating 2rges
(se so-e of the +est0tested principles in e8peri-ental psychology to connect the inter-ediate steps
to'ard your goal to your natural enthusias- for the result. ,nstead of acti5ely reinforcing the +eha5iors
you 'ant to 'ant@ learn ho' to run that reinforce-ent on autopilot@ using your +rainKs natural facility
for shaping +eha5iors.
5ffline &abit Training
<o you 'ant to re-e-+er to plug in your cellphone each ti-e you get ho-e for 'ork@ or stop yourself
fro- interrupting others? 6earn ho' to use 5isualiFation@ associations@ and practice to +reak destructi5e
ha+its and create +eneficial ones. Pick the ha+it of checking e-ail in +ed +y setting aside fi5e -inutes
to practice your ideal -orning routine.
Turbocharging Training
)ouKre pro+a+ly 'ondering ho' to +udget ti-e to practice and internaliFe all these 'onderful ne'
techniBues. Gain ne' skills -uch faster +y understanding ho' you learn and find the -ost effecti5e
'ays of e8panding your co-petencies.
>alue of 6nformation
Quantify the e8pected 5alue of ne' infor-ation and re5a-p your guesses a+out the relati5e i-portance
of e5idence you can gather and predictions you can test. 6earn to try the easy and afforda+le
e8peri-ents that Opro+a+ly 'onKt 'orkK and search for R%1 e8penditures that might return R%@111 of
5alue. $inding a 'ay to sa5e 11 -inutes on one leg of your co--ute +uys you fi5e e8tra days per year@
and thatKs 'orth a -inute to consider carefully or half an hour to test.
Closing
Attendees and instructors gather to share their reflections on ho' it all fits together and 'hat they plan
to do 'hen they get ho-e to start -aking use of these tools.
=arty
!lay rationality ga-es@ 'rite satiric songs@ or Hust hang out 'ith your fello' attendees as you un'ind.
Attendees of past 'orkshops 'ill stop +y to 'elco-e you to the C$AR alu-ni net'ork of people@
+usinesses and ideas.
11
?onday @ =ractice/Troubleshooting
"n Monday@ youKll start rotating through discussion groups to identify and e8tend the underlying and
unifying the-es of the classes. After the recap@ you can -eet 'ith instructors one on one or in s-all
groups to practice the techniBues youK5e +een learning andEor to get ad5ice on ho' to use these ne'
tools for a specific pro+le- or proHect in your life.
1%
*hat is .pplied RationalityA
#=art 6$
4he sphex is a s-all digger 'asp that see-s to e8hi+it co-plicated@ deli+erate +eha5ior. When it
catches a cricket@ it drags the +ody +ack to the entrance of its +urro'@ lea5es the cricket outside@ goes
into the +urro' to -akes sure there are no lurking ene-ies@ and then drags the cricket inside and lays
eggs.
*ut@ it turns out thereKs a funny 'ay to interfere 'ith the sphe8Ks routine. While the sphe8 is inspecting
the +urro'@ if you pull the cricket an inch or t'o to the left@ then@ 'hen the sphe8 co-es out@ it pulls the
cricket +ack to the entrance@ and then goes in and inspects the +urro' all o5er again. And if you -o5e
the cricket again@ the sphe8 'ill tug it +ack into position and then go inspect the +urro' a third ti-e.
/ssentially@ you can keep running a sphe8 through its loop indefinitely@ 'ithout it e5er noticing that it
should +reak the pattern. 4hat inspired <ouglas &ofstadter to coin the 'ord sphexish.
Sphexish Jad3I O following patterns ,y rote, even when maladapted to the situation at hand.
Although the 'ord is inspired +y a 'asp@ its applications are unfortunately +road. When hu-ans stay
stuck in a loop@ 'eKre +eha5ing like the sphe8. &ere are so-e loops that so-e of us get stuck in?
1. Read so-ething 'rong on the internet S 'rite reply
%. !arent +rings up touchy su+Hect S gi5e the sa-e cached response as in the last fight
3. Sit do'n at co-puter S open face+ook
4he opposite of +eing sphexish is +eing agenty. An agent is an ideal at the other end of the spectru-?
so-eone 'ho could analyFe +eliefs@ ha+its@ and repeated +eha5iors and choose 'hich ones to reinforce
and 'hich ones to drop.
,n order to -ake those choices@ 'eKre going to gi5e you a +etter 5ie' of your inner 'orkings. )ouKll
get a clearer sense of ho' your -ind 'orks and 'hat heuristics it uses. 4hat 'ay you can notice 'hat
your ha+its are@ re5ise the-@ or add ne' ones.
*eco-ing -ore agenty doesnKt happen all at once. Making a s-all a-ount of progress can -ake it
easier to keep going and i-pro5ing. )ou can +ootstrap larger changes fro- s-all ones.
4he -ore you practice applied rationality@ the -ore like an agent you can +e # using auto-atic and
analytic processes deli+erately@ and +eing a+le to course0correct 'hen an old strategy no longer 'orks.
13
*hat is .pplied RationalityA
#=art 66$
When 'e -ake analyFe infor-ation or -ake decisions@ 'e tend to talk in ter-s of t'o -odes of
thought. ,n his +ook Thinking 6ast and -low@ >o+el !riFe 'inner <aniel Pahne-an descri+ed the- as
/ystem 1 and /ystem .
/ystem 1 /ystem
Co-es first in e5olutionary history <e5eloped later@ -ore uniBue to hu-ans
!rocesses infor-ation Buickly !rocesses infor-ation slo'ly
So-eti-es called OintuitionK So-eti-es called Oanalytic thinkingK
!rocess of thinking is not transparent "ften a 5er+al -ode of thinking
<oesnKt use up 'orking -e-ory 6i-ited +y a5aila+le 'orking -e-ory
>either syste- is perfect. Syste- 1 can fail +y -aking the 'rong connections # if a ne' acBuaintance
rese-+les an old ene-y@ you -ay find yourself feeling an8ious 'ithout kno'ing 'hy. Syste- % can
fail +y li-iting the infor-ation you tag as rele5ant # if you canKt put a feeling of unease into 'ords@
you -ay +e te-pted to lea5e it out of your calculations.
So-eti-es@ people think applied rationality is the process of -uting Syste- 1 and Hust relying on
Syste- %. After all@ the Syste- % parts are the +its that are -ost uniBue to hu-ansG 'ouldnKt it +e great
to do our +est thinking all the ti-e?
Applied rationality is a+out using the +est tools at hand to achie5e your goals@ and turning off the +ulk
of your +rain is seldo- helpful. ,n the classes at this 'orkshop@ 'eKll talk a+out ho' to +etter
understand Syste- 1 and Syste- %@ so you can play to their strengths and +e -ore efficient. 4he ai- is
to -ake deli+erate@ thoughtful use of all the skills you ha5e@ not to only use the skill of thinking slo'ly
and deli+erately.
1;
*hat is .pplied RationalityA
#=art 666$
)ou can i-agine all possi+le actions you could take +eing laid out according to 98@y@F: coordinates@
-apped out according to three di-ensions?
&o' -uch you enHoy the action
&o' 'ell the action ser5es your goals
&o' often you take the action
So you -ight find ,reathing at so-ething like 9not 5ery -uch fun@ enor-ously necessary@ constantly
doing:@ +ecause you donAt particularly enHoy +reathing@ +ut must do it to achie5e any other goal@ and are
al'ays doing it.
*ro'sing through your RSS reader -ight +e a +it -ore like 9-oderately fun@ relati5ely unneeded@
freBuently doing: if you like checking your reader@ +ut donAt feel 5ery strongly@ tend not to -ake -uch
use of 'hat youAre reading@ +ut keep finding yourself hitting refresh.
)ou can i-agine all of your possi+le actions +eing graphed 'ithin so-e kind of agency cu+e@ that
represented graphically all the 'ays youAre currently choosing to spend your ti-e.
)ou can think of this cu+e as ha5ing t'o 5ery 5alua+le regions. $irst@ thereAs the corner 9on top in the
i-age a+o5e: 'here you are doing useful@ pleasura+le things freBuently. And then thereAs the
dia-etrically opposed corner 'here you don4t do things that you hate and that frustrate your goals.
!art of applied rationality is trying to concentrate your possi+le actions as densely as possi+le in these
to corners@ so youAre doing the -ost of 'hatAs +est for you@ and the least of 'hatAs har-ful.
1.
8etting the ?ost out of the *orkshop
<igestion
As a child@ you -ight ha5e thought that 'hen you ate food@ it Hust +eca-e part of you 'ithout
alteration. /at a hotdog@ and there 'ould +e little tiny pieces of hot dog studded throughout your +ody.
/5entually@ 'e learned that food isnKt Hust incorporated into us@ itKs digested. We +reak it do'n into
so-ething 'e can use@ that -ay look 5ery different than 'hat 'e originally ingested@ e5en if it has the
sa-e nutrients.
,n a si-ilar 'ay@ 'hen 'e learn@ 'e donKt Hust take up the instructorKs opinions and -aterial 'holesale.
We adapt it and process it and try to e8tract 'hat 'e need -ost. So it doesnKt help too -uch to Hust
-e-oriFe 'hat you hear in class. 4he goal is to internaliFe it and -ake it your o'n.
When you digest food@ you use sto-ach enFy-es to +reak it do'n into +uilding +locks that you can use
to +eco-e stronger. When you digest content and ideas@ you ha5e a nu-+er of tools to +reak do'n
'hat youKre hearing?
!araphrase the instructor@ -ake sure you can put the idea in your o'n 'ords
4ry teaching the -aterial to a friend
6ook for ne' applications for the -aterial 9especially in your o'n life:
6ook for predictions@ if this theory is true@ 'hat 'ould you o+ser5e
Ask Buestions
4alk a+out the content 'ith others
...and -any -ore
"5er the course of the 'orkshop@ look for opportunities to digest the -aterial in the classes@ so it
+eco-es a part of you@ not Hust so-ething you can descri+e ha5ing happened to you. <eli+erately
digesting content helps you get the -ost useful@ personal -aterial out of a lesson@ and the infor-ation
'ill +e a lot easier to retain.
1
8etting the ?ost out of the *orkshop
Try Things9
When youKre e8ploring ne' ideas and ha+its@ trying the- out is a great 'ay to gather data. ,t can +e
faster and si-pler to Hust try out a ne' practice and see 'hether it 'orks for you than to spend a lot of
ti-e trying to anticipate 'hether or not youKll find it useful.
When you try so-ething out@ and it 'orks@ you get to keep doing it@ 'hich can +e really 5alua+le o5er
the long run. $or e8a-ple@ if friends kept in5iting you to ok0to0-ediocre0sounding leisure acti5ities@
you -ight keep declining their offers. *ut 'hat if you agreed to try the- out? May+e your list of
atte-pts 'ould look so-ething like this?
Acti5ity 41 4% 43 4; 4. 4 42 43 49
)oga J
(lti-ate
$ris+ee
J
Meditation
Classes
T T T T T T T T T
Salsa J
4he failed trials 9represented +y J: are -ore than counter+alanced +y the sustained run of a no'
successful ha+it 9sho'n 'ith T:. So it can +e 'orth your ti-e to try out a nu-+er of lo'er pro+a+ility
trials@ as long as a couple pay off as long0ter- ha+its.
So 'hen you listen and participate in class@ look for 'ays to turn lessons into actions that you can try
out and test dri5e. 4he act of turning class content into practical acti5ities is a great 'ay to digest
-aterial 9youKre paraphrasing theory into practice: and helps you decide 'hich -aterial you 'ant to
prioritiFe 'hen you return fro- the 'orkshop.
12
8etting the ?ost out of the *orkshop
Capture
At the end of the 'orkshop@ 'hat 'ill you re-e-+er? What 'ill you need to +e a+le to take action?
&o' do you -ake sure you retain the lessons that are the -ost 5alua+le to you?
4here are t'o co--on failure -odes 'hen taking notes or trying to retain infor-ation?
3ou might trust your brain too much. *ecause so-ething feels i-portant in the -o-ent@ you
figure youKll retain it. &as this strategy 'orked in the past? &o' -any i-portant0feeling
things can you +e e8posed to +efore your 'orking -e-ory is strained?
3ou might Bust try transcription. ,nstead of e8periencing and digesting the class@ you -ight
put -ost of your -ental energy into Hust capturing everything. 4his -eans youKll still ha5e to
filter the useful infor-ation later@ and you 'onKt ha5e access to the instructor or the other
participants 'hile you do it.
We try to preser5e the +asic -aterial of each class in the 'ork+ook@ so you donKt ha5e to 'orry a+out
transcription. ,nstead@ try capturing the actions and insights that pertain to you@ that arenKt already in
the 'ork+ook.
When it co-es to these ideas@ err on the side of inclusion. 4his are the content you 'onKt +e a+le to
find any'here else@ +ecause youKre the one 'ho created it.
WeK5e included a capture strip at the +otto- of each page in the 'ork+ook@ so itKs easy to retrie5e 'hat
you captured. ,f you already ha5e a 'orking capture syste- for idea@ plans@ and actions@ you -ay 'ant
to use it instead.
<onKt forget@ you 'onKt only think of interesting things in classU &a5e a plan to capture i-portant
actions and insights in con5ersation or during digestion of -aterial. Why not 'rite that plan do'n in
the OActionK section at the +otto- of this page? Make the co--it-ent effect 'ork for youU
*ut donKt let capture dri5e you craFy. )ouKre storing up notes for you 'hole post0'orkshop life 00 donKt
panic a+out trying to put e5erything into practice the 'eek or the -onth after you get ho-e. ,f you Hust
-ake one s-all change 9using po-odoros@ doing a fe' =", calculations@ etc: youKre -aking it easier
to +ootstrap to other changes in the future.
13
=rediction ?arkets
5vervie'
Scattered throughout the ca-p on 5arious 'alls@ youKll see large sticky sheets 'ith predictions@
pro+a+ilities@ and ti-es on the-. 4hese are prediction markets@ and they offer a playful 'ay to help
refine your predicati5e accuracy. 4o play in a -arket@ Hust pick up a pen@ 'rite a pro+a+ility +elo' the
last one already 'ritten@ and 'rite your na-e and the ti-e ne8t to your pro+a+ility.
When the prediction is settled@ you 'ill recei5e a 9possi+ly negati5e: nu-+er of points 0 called
centi,its@ or hundredths of a +it 0 according to one of t'o rules. $or the sake of descri+ing the rules@
letKs say your +et is JV and the one +efore yours is )V. ,f the clai- turns out to +e true@ then the
nu-+er of centi+its you recei5e 'ill +e?
,f the clai- turns out to +e false@ ho'e5er@ the nu-+er of centi+its you recei5e 'ill +e?
4he &ouse 9i.e.@ an assigned staff -e-+er: 'ill keep track of ho' -any points you ha5e. At the end of
the ca-p@ there 'ill +e a lottery for priFes and your chance of 'inning 'ill +e proportional to the
nu-+er of points youA5e 'on in the +etting -arketsU 9*ut the real point of this is to engage in the
practice of putting your degree of confidence on the ta+le. 4he point is the process@ not the productU:
7xample
Suppose thereKs a -arket 'ith the clai-@ C6t 'ill be raining on ?onday at noon.D At noon on
Monday the -arket is auto-atically closed@ at 'hich point the follo'ing +ets ha5e +een -ade?
!9true: !9false:
Sun 1%p- .1V .1V &ouse
Sun 9p- ;1V 1V Alice
Mon 11a- 91V 11V *o+
Mon 11a- ..V ;.V Alice
19
At noon on Monday@ letKs suppose that it is in fact raining. 4hat -eans 'e use the first colu-n to
calculate the payoffs? those 'ere the pro+a+ilities the players 'ere assigning to the true state of the
'orld. Alice 'ould lose so-e centi+its for causing the -arket to update in the 'rong direction on t'o
occasions. Specifically@ she 'ould LgainM 03% centi+its for her first +et?
and LgainM 021 centi+its for her second +et?
*o+@ on the other hand@ 'ould gain 112 centi+its@ reflecting that he caused the -arket to update
strongly in the correct direction?
$or contrast@ letKs pretend that it turns out that itKs not raining on Monday at noon. 4hat -eans 'e use
the second colu-n of nu-+ers to calculate the payoffs? those 'ere the pro+a+ilities the players 'ere
assigning to the true state of the 'orld. &ere@ Alice 'ould +e re'arded %W%12 centi+its for causing
the -arket to update in the correct direction on t'o occasions?
*o+ 'ould lose %.9 centi+its for his significant o5erconfidence in causing the -arket to update in the
'rong direction?
6n /um
4he follo'ing theore- su--ariFes ga-e play?
When you +et@ your score is the a-ount of infor-ation@ in hundredths of a +it@ that your
pro+a+ilities ha5e pro5ided as an update to the pre5ious pro+a+ility.
3our best strategy is to honestly report your credence at any ti-e. 4hat is@ at any -o-ent@ if
your credence is not exactly the same as the last credence 'ritten on the +oard@ then you e8pect
to win centi,its +y 'riting up your o'n.
"5er ti-e@ +eing +etter cali+rated 9+eing right JV of the ti-e that youAre JV sure: 'ill -ake
you +etter at the ga-e.
9$or an e8planation of 'hy 'e use this scoring rule@ look up /lieFer )udko'skyKs online essay LA
4echnical /8planation of 4echnical /8planation.M:
=roposing betting markets
Anyone can propose a +etting -arket. &o'e5er@ the &ouse -ay choose to ignore any gi5en -arket that
they did not put up the-sel5es. 9WeKll a5oid ignoring -arkets this 'ay as -uch as possi+le. 4his is in
%1
place pri-arily to a5oid +reaking the syste- 'ith o5erly cle5er -arkets.: Also@ the &ouse has to kno'
a+out a -arket for it to count.
/5ery proposed -arket should ha5e?
a state-ent 'hose truth or falsity can +e and 'ill +e deter-ined to e5eryoneKs satisfaction
during the ca-p@
a condition for closing 9ideally one that happens auto-atically:@ and
an initial +et assigned to the creator of the -arket.
*ell1formed bets
4he &ouse 'ill ignore any +et of 111V or 1V 'hen calculating points@ treating such lines as though
they 'ere ne5er 'ritten. 94his is to pre5ent you fro- losing infinitely -any points@ or fro- allo'ing
the person follo'ing your +et to potentially gain infinitely -any points.:
)ou need to specify a percentage that the &ouseKs co-puter can score. =aria+le notation like L
M 'ill cause the line in Buestion to +e co-pletely ignored 'hen calculating points. ,f you
'ant to specify a 5ery large or 5ery s-all pro+a+ility@ use so-ething fairly standard like scientific
notation. Cle5er uses of unusual notation like tetration 9e.g.@ 1E93XXX3:: -ight force the &ouse to ignore
your +et@ unless you care to e8plain ho' to enter your +et into the co-puter 9and offer to 'rite the
progra- if entering the score reBuires progra--ingU:.
*ear in -ind that you donKt gain all that -uch +y +eing e8tre-ely confident and correct@ +ut you can
lose an ar+itrary nu-+er of centi+its for +eing o5erconfident and wrong. ,f you offer a se5erely
o5erconfident +et and lose huge nu-+ers of centi+its@ you are in effect paying those centi+its to
'ho-e5er follo's your +et 'ith anything -ore reasona+le. 9*ut if you actually@ honestly ha5e a
gargantuan a-ount of confidence@ your e8pected score is still -a8i-iFed +y correctly stating your
confidenceU:
%1
5pening /ession @ 0urther Resources
/phexishness and .gency
,n a 193% -cientific (merican article 9later reprinted in his +ook 5etamagical ThemasI@ <ouglas
&ofstadter coined the ter- Lsphe8ishM to refer to repetiti5e@ pre0progra--ed +eha5ioral patterns@ and
identified the a+ility to reflect on oneKs o'n patterns as essential to +reaking out of these loops.
&ofstadter@ <. R. 9193.:. L"n the see-ing parado8 of -echaniFing creati5ity.M ,n 5etamagical
Themas, .%.0.;.
http?EEa-Fn.co-E1;.1;.9
,n his +ook The &o,ot.s &e,ellion@ cogniti5e scientist Peith Stano5ich 9%11;: connects the issue of
sphe8ishness to recent psychology research on hu-an Hudg-ent and decision -aking.
Stano5ich@ Peith. 9%11;:. The &o,ot4s &e,ellion: 6inding 5eaning in the (ge of !arwin.
http?EEa-Fn.co-E119.3;11;2
/ystem 1 and /ystem
!sychologists distinguish +et'een LSyste- 1M cogniti5e processes 9'hich are fast@ intuiti5e@
associati5e@ and parallel: and LSyste- %M cogniti5e processes 9'hich are slo'@ reflecti5e@ deli+erate@
and serial:. <aniel Pahne-anKs 9%111: +ook@ Thinking, 6ast and -low@ ela+orates on this distinction
9and the field of Hudg-ent and decision -aking research 'hich he co0founded: in depthG Pahne-anKs
9%113: re5ie' article pro5ides a +riefer su--ary.
Pahne-an@ <. 9%111:. Thinking, 6ast and -low.
http?EEgoo.glE.Y1FH
Pahne-an@ <. 9%113:. A perspecti5e on Hudg-ent and choice? Mapping +ounded rationality.
(merican 1sychologist@ BP@ 9202%1.
http?EEtinyurl.co-Ekahne-an%113
Syste- 1 processes share -any si-ilarities to the hu-an perceptual syste-. When they are
functioning 'ell@ they can dra' on a large +ody of lo'0le5el data to identify patterns@ 'hich co-e to
-ind readily 'ithout any e8planation attached. &o'e5er@ there is a risk that the 5aria+le 'hich Syste-
1 reports 'ill +e su+tly different fro- the one 'hich you are atte-pting to assess. 4his type of error
9called Lattri+ute su+stitutionM: is analogous to a 5isual illusion 'here you atte-pt to assess the t'o0
di-ensional siFe of a dra'ing on paper@ +ut your perceptual syste- reports the three0di-ensional siFe
%%
that the depicted o+Hect 'ould ha5e 9Pahne-an@ %113G %111:.
8etting the most out of the 'orkshop
/ducation research e-phasiFes that students learn -ore 'hen they engage 'ith the -aterial in a 'ay
that goes +eyond si-ply listening to the 'ords in a lecture or reading the 'ords in a +ook. Acti5e
learning focuses on getting students in5ol5ed in acti5ities 'hich lead the- to think through and -ake
use of the -aterial that they are learning a+out.
http?EEen.'ikipedia.orgE'ikiEActi5eZlearning
A re5ie' article of research on the +enefits of acti5e learning?
!rince@ M. 9%11;:. <oes acti5e learning 'ork? A re5ie' of the research. Cournal of Engineering
Education@ QK@ %%30%31.
http?EEgoo.glEo-&uY
Cogniti5e scientist Roger Schank 9199.: argues that people ha5e a set of learned LscriptsM for ho' to
interact 'ith the 'orld@ such as a script for ho' to order food at a restaurant. <oing ne' things allo's
a person to learn ne' scripts 9or 5ariations on the scripts that they already kno':@ 'hich increases the
opportunities a5aila+le to the- and reduces their sphe8ishness.
Schank@ R. C. 9199.:. What 'e learn 'hen 'e learn +y doing. 94echnical Report >o. 1:.
>orth'estern (ni5ersity@ ,nstitute for 6earning Sciences.
http?EEcogprints.orgE32E1E6earn+y<oingZSchank.ht-l
Capture is the first step of <a5id AllenKs LGetting 4hings <oneM organiFation syste-. Capture in5ol5es
'riting things do'n 9in particular@ things that you 'ant to do: and putting the- into your syste-.
&a5ing a functioning capture syste- ensures that this infor-ation 'ill co-e +ack to your attention
later on 'hen you ha5e ti-e to process it and act on it@ and frees your attention in the -o-ent to do
so-ething other than -e-oriFing things0to0do.
Allen@ <a5id 9%111:. Retting Things !one: The (rt of -tress:6ree 1roductivity.
http?EEen.'ikipedia.orgE'ikiEGettingZ4hingsZ<one
Pno'ledge tends to decay o5er ti-e@ as people gradually forget infor-ation that they ha5e learned.
Regularly accessing kno'ledge helps a person retain it. $or a gi5en a-ount of studying@ a person is
-ore likely to retain long0ter- -e-ories of the -aterial if the studying is spread out o5er ti-e rather
than condensed into a single session of Lcra--ingM@ a pheno-enon kno'n as the spacing effect
9although cra--ing is effecti5e at for-ing short0ter- -e-ories:. 4hese disco5eries a+out -e-ory
date +ack to research +y &er-ann /++inghaus in the 19th century@ and ha5e +een repeatedly replicated
%3
+y -ore recent studies 9e.g.@ Cepeda et al.@ %11:.
http?EEen.'ikipedia.orgE'ikiESpacingZeffect
Spaced repetition soft'are is designed to help people retain long0ter- -e-ories +y pro5iding re5ie's
that are ti-ed efficiently +ased on the hu-an forgetting cur5e. !rogra-s such as Anki and Super-e-o
use a flashcard0+ased -odel that repeats a gi5en flashcard less and less often o5er ti-e as long as you
re-e-+er it@ so that you are re-inded of the infor-ation +efore you forget it +ut do not spend -uch
ti-e re5ie'ing infor-ation that you already kno' 'ell.
An in0depth re5ie' of research on spaced repetition@ including su--aries of pu+lished research as 'ell
as ad5ice on ho' to use spaced repetition soft'are?
G'ern. LSpaced repetition.M
http?EE'''.g'ern.netESpacedV%1repetition
An online article 'ith tips on ho' to design spaced0repetition cards effecti5ely?
WoFniak@ !iotr. L4he %1 rules of for-ulating kno'ledge in learning.M
http?EE'''.super-e-o.co-EarticlesE%1rules.ht-
A -eta0analysis@ pro5iding a Buantitati5e re5ie' of research on the spacing effect 9also kno'n as
Ldistri+uted practiceM:?
Cepeda@ >. Y.@ !ashler@ &.@ =ul@ /.@ Wi8ted@ Y. 4.@ [ Rohrer@ <. 9%11:. <istri+uted practice in
5er+al recall tasks? A re5ie' and Buantitati5e synthesis. 1sychological #ulletin@ ;KF@ 3.;0331.
http?EEgoo.glEPg!1n
%;
=redictions
!eopleKs intuiti5e sense of pro+a+ility tends not to +e properly cali+ratedG a-ong e5ents that so-eone
thinks are 31V sure to happen@ typically only 1V actually take place 9Russo [ Schoe-aker@ 199%:.
http?EEen.'ikipedia.orgE'ikiE"5erconfidenceZeffect
Repeated rounds of prediction and feed+ack allo' a person to cali+rate their e8pectations to reality.
Sufficient training and e8perience in a do-ain 'ith clear feed+ack 9like 'eather forecasting: can lead
to -ore accurate@ un+iased esti-ates in that do-ain 9Pahne-an [ Plein@ %119:. Cali+ration practice
can also lead to less +iased esti-ates across -any do-ains 9Russo [ Schoe-aker@ 199%:.
A re5ie' article of research on e8pertise@ 'ith an e-phasis on 'hich areas of su+Hect -atter allo'
people to de5elop e8pertise and 'hich do not?
Pahne-an@ <.@ [ Plein@ G. 9%119:. Conditions for intuiti5e e8pertise. (merican 1sychologist@
SE@ .1.0.%.
http?EEgoo.glElG,!7
A re5ie' article of research on cali+ration and cali+ration training?
Russo@ Y. /.@ [ Schoe-aker@ !. Y. &. 9199%:. Managing o5erconfidence. -loan 5anagement
&eview@ KK@ 2012.
http?EEgoo.glEC93as
A 'e+site 'here you can -ake@ share@ and track pro+a+ilistic predictions a+out any e5ent?
http?EEprediction+ook.co-E
4he Credence Ga-e@ de5eloped +y C$AR@ pro5ides cali+ration training +y gi5ing you i--ediate
feed+ack on pro+a+ilistic Hudg-ents.
http?EE'''.acritch.co-Ecredence0ga-eE
%.
$riday # &o' to (se )our *rain
4uilding 4ayesian &abits
4uilding 4ayesian &abits 1 5vervie'
(sing *ayesA 4heore- to update your +eliefs in5ol5es four steps?
1. <eter-ine the hypothesis +eing considered and 'hat the alternati5e hypothesis is
%. <eter-ine your prior
3. <eter-ine the strength of the e5idence youKre considering
;. Co-+ine the prior and the strength of e5idence to produce a conclusion 9LposteriorM:
/ach of these steps has a -athe-atical for-alis-. $or instance@ the strength of e5idence is technically
defined to +e a ratio of t'o conditional pro+a+ilities that are related in a particular 'ay. &o'e5er@ 'e
'ill also practice so-e DBuick0and0dirtyD heuristics to engage parts of your intuition 9like your Dinner
si-ulatorD: that donAt really operate in ter-s of nu-+ers.
<epending on ho' i-portant a decision is@ there are 5arying a-ounts of ti-e you can spend using
*ayes Rule in 5arious 'ays to update your +eliefs?
1E1minute 4ayes 000 <oing careful research into priors and strength of e5idence@ spanning
-inutes to hours. (seful for?
&igh1stakes decisions 000 ,n situations 'here itAs 'orth taking so-e ti-e to think and
in5estigate@ *ayes Rule can help you e5aluate conflicting sources of e5idence@ and identify
useful Buestions to ask ne8t.
/ettling disagreements 000 *ayes can help you na5igate a disagree-ent 'ith so-eone@ +y
isolating 'hether you ha5e different +ackground kno'ledge or ha5e differing i-pressions
of 'hat e5idence -eans.
1E1second 4ayes 000 A Buick0and0dirty -athe-atical esti-ate@ taking around .0%1 seconds.
(seful for?
7motional situations 111 Sanity0checking your Hudg-ents 'hen you feel tired@ stressed out@
or other'ise e-otionally co-pro-ised.
Confusing situations 000 'hen you notice your pre5ious e8perience is at odds 'ith
so-ething youAre seeing or that so-eone is saying.
11second 4ayes 000 4hinking in ter-s of cali+rated intuitions instead of nu-+ers@ 'hich takes
around 103 seconds.
0ollo'ing arguments 000 <eciding fro- -o-ent to -o-ent 'hether an argu-ent or
reasoning process -akes sense@ as it is +eing presented.
4his last 10second 5ersion reBuires ha5ing D*ayesian ha+itsD installed as auto-atic -ental refle8es@
taking al-ost no conscious reflection ti-e at all. 4his -eans training your DSyste- 1D as Pahne-an or
Stano5ich 'ould say. 4he types of e8ercises 'e 'ill focus on are designed to help you hone and
accelerate those refle8es.
. note on engaging in exercisesF
%
Many e8ercises 'ill in5ol5e reading a clai- 9e.g. L4his restaurant canKt +e good@ or it 'ould +e -ore
cro'dedM: and then reasoning a+out it. Rather than reasoning 5er+ally a+out the clai-@ please -ake up
and imagine Ji.e. mental simulateI a specific scenario fitting the description@ and ans'er the clai-
a+out the scenario you -ade up. 94his 'ill causes our ans'ers to +e different@ +ut ensures you are
practicing so-ething closer to a real0life decision.:
%2
4uilding 4ayesian &abits @ <rill GE
.ccessing .nticipations
)ou ha5e an inner si-ulator that lets you check ho' surprising so-ething 'ould feel if it happened.
,tKs a 'ay to Buery your Syste- "ne -ind 'ith a specific useful Buestion 'ritten up +y Syste- 4'o.
$or e8a-ple@ i-agine a friend of -ine had RS=!Kd LyesM to a party +ut didnKt sho' up. ,f , i-agine
ho' , 'ould feel if this happened@ , 'ould +e@ at least@ a +it surprised # itKs not 'hat , anticipated
happening that night. *ut -y surprise falls along a spectru- # , -ight +e a good deal more surprised if
she sho'ed up on ti-e +ut had sha5ed off her hair.
And , can categoriFe those e8periences as Bualitati5ely different +efore either happens. , can use -y
surprise as a crude -easure of ho' likely , e8pect so-ething to occur@ and get a clearer intuiti5e
ans'er than if , i--ediately try to ascri+e a nu-erical pro+a+ility to it.
*hen to use .ccessing .nticipationsF
A Buestion or decision is high stakes.
)ou ha5e a lot of e-otional +ias clouding your response.
)ouKre in a disagree-ent.
&o' to use .ccessing .nticipationsF
,-agine the situation as 5i5idly as possi+le.
*e specific@ donKt Hust i-agine a 5ague friend@ think of a particular one.
4hink a+out 'here your surprise falls on a spectru-.
<onKt argue 'ith your Syste- 1 until you ackno'ledge its ans'er.
4hen feel free to pro+e at any disco-fort or confusion a+out ho' surprised you 'ere and decide
'hich part you 'ant to adHust.
>otice if Syste- 1 'as responding to data you hadnKt consciously factored in.
)ou can try to translate +ack and forth fro- intuitions to pro+a+ilities to tune cali+ration. Are
your surprise reactions synched up to ho' unlikely so-ething actually is? Can you use so-e
kno'n e5ents as -arkers on your surprise ther-o-eter?
%3
=racticing .ccessing .nticipationsF
Try to imagine each of these experiences vividly7 notice how surprising it seems. Then, you can try and
place it along a spectrum of experiences. You can use the letters for each example to la,el the
spectrum, with more surpising Jless likelyI things near the ,ottom.
A. )our friend doesnKt turn up for a party sEhe RS=!Kd for.
*. )ou do +adly on an e8a- that you felt good a+out 'hile taking.
C. 4he cashier greets you +y na-e at the grocery store.
<. )ou recei5e a parking ticket in the -ail.
/. )our parent dyes herEhis hair purple.
$. )ou find a +ear cu+ in your li5ing roo-.
G. )ou 'ake up naked in the 'oods.
&. A sunny day turns to rain.
,. )ou recei5e a su--ons for Hury duty.
Y. )our na-e is -isspelled on your reissued dri5erKs license.
P. )our +ookcase is -issing@ +ut all the +ooks are neatly piled on the floor.
6. )our +ookcase and +ooks are +oth -issing.
M. )ou turn a corner 'ith a friend in a city and -eet a tiger.
>. )ou canKt find your car keys in the usual spot.
". ,t sno's on Christ-as <ay@ 'here you li5e.
!. So-eone you -eet at a party has the sa-e +irthday as you.
%9
( thought experiment:
*magine, while walking across a large pu,lic university.s campus, you meet a guy named Tom who
seems very reserved and introverted. %ould you guess that Tom is a ,usiness ma3or or a math ma3or"
31
4uilding 4ayesian &abits @ <rill GE
=arsing hypotheses and evidence
,t takes effort and practice to change casual speech into 'ord pro+le-s. ,n a con5ersation 9or an
argu-ent:@ your interlocutor -ay not clearly identify 'hat e5idence sheKs considering and 'hat
hypothesis she intendeds it to support.
4he Buickest 'ay to ensure 'e -ean the sa-e thing +y DhypothesesD and De5idenceD 'ill +e to 'ork
through so-e e8a-ples +elo'.
7videnceF 4his is 'hat you o,serve to +e true.
&ypothesisF )our guess a+out 'hat is true@ often +ased on so-e e5idence. ,t -ay +e a prediction@
or a speculation for 'hat could ha5e caused or explained the e5idence you sa'.
2seful times to parse colloHuial language into hypotheses and evidenceF
When you hear any of these phrases 9or si-ilar ones: co-e out of your -outh or so-eone elseKs?
\ LJ happened +ecause of ).M
\ L, +elie5e J +ecause ) happened.M
\ LWell@ , kno' )@ +ecause JUM
\ L) is another reason to +elie5e J.M
\ LJ canKt +e true +ecause of )UM
7xercises / examples of parsing casual language into hypotheses and evidenceF
1ut a circle around the evidence Jo,servationI the speaker is presenting and a ,ox around the
hypothesis Jprediction or speculationI she4s using it to support. Then, as a precursor to using #ayes
later, give a short name or )handle) for the hypothesis, an alternative hypothesis, and the evidence.
0ote: There may ,e extraneous data andHor ,ackground information.
1. 4his restaurant canKt +e good@ or it 'ould +e -ore cro'ded.
&ypothesis? D+adD Alternate hypothesis? DgoodD
/5idence? Dnot cro'dedD
%. A 5olunteer fro- the ca-paign 5isited -eG so theyAre pro+a+ly 'ell organiFed.
&ypothesis? Alternate hypothesis?
/5idence?
31
3. ,K- 5ery good at this su+Hect@ so -y lo' test score -ust -ean there 'as a Scantron error.
&ypothesis? Alternate hypothesis?
/5idence?
;. My car keys are -issing@ +ecause -y kids hid the-.
&ypothesis? Alternate hypothesis?
/5idence?
.. , +elie5e sheKs telling the truth@ +ecause she didnKt look a'ay 'hen she told -e.
&ypothesis? Alternate hypothesis?
/5idence?
. My friend hasnKt -entioned the fight again@ so heKs not angry.
&ypothesis? Alternate hypothesis?
/5idence?
2. 4his candidate graduated fro- an ,5y 6eague schoolG sheKs pro+a+ly Bualified for the Ho+.
&ypothesis? Alternate hypothesis?
/5idence?
3. 4his candidate stu-+led o5er a Buestion in the inter5ie'G sheKs pro+a+ly not Bualified.
&ypothesis? Alternate hypothesis?
/5idence?
9. 4his candidate has pre5iously 'orked in this fieldG sheKs pro+a+ly Bualified for the Ho+.
&ypothesis? Alternate hypothesis?
/5idence?
3%
4uilding 4ayesian &abits @ <rill G1
.nchoring off the =rior
Many studies ha5e sho'n that people tend to syste-atically neglect their o'n +ackground infor-ation
'hen presented 'ith e5idence@ especially if the +ackground infor-ation is less salient in their intuition
or DSyste- 1D. So@ +efore you start to -ake sense of a ne' piece of e5idence@ itKs i-portant to check
your +aseline assu-ptions a+out the possi+le e8planations? that is@ 'hat you 'ould ha5e e8pected
+efore seeing the e5idence. 4his is called your prior.
Our ,rains do not do this automatically. 4his pheno-enon is called *ase Rate >eglect@ or !rior
,nsensiti5ity. When your prior is lopsided in fa5or of a particular hypothesis@ it needs to +e
intentionally 'eighed in against ne' e5idence@ other'ise your +rain is lia+le to ignore it. 4o do this@
you can anchor on your prior@ and use e5idence to ad3ust a'ay fro- it. When your prior doesnAt fa5or
any hypothesis in particular@ this step is less i-portant@ as the ne' e5idence alone is enough to
deter-ine your ne' +elief.
*hen to .nchor on your the =riorF
0ot that oftenL "nly if thereKs a +ig disparity +et'een the t'o options.
When you see strong e5idence fa5oring a theory and 'ant to check if you should shift your
+elief sharply.
>ote? )ou donKt al'ays ha5e to co-e up 'ith a plausi+le prior yourself@ if Googling is faster.
&o' to use your /urprisometer to check 'hether a prior is lopsidedF
\ ,-agine sa-pling fro- a +ag of outco-es 000 'hat do you e8pect to pull out?
\ &o' -any people do you think youKd need to sur5ey to find fi5e people in 'hate5er category
youKre talking a+out?
\ ,n a +ig city 9say@ >)C # 3 -illion people:@ ho' -any people do you e8pect to fall into this
category?
Calibrating your sense of confidence
http?EEacritch.co-EcredenceE 000 4his is a si-ple ga-e to gi5e you practice assigning pro+a+ilities to
your guesses and getting feed+ack a+out your actual success rate. After playing for a 'hile@ you can
de5elop the property that 'hen you say you are 21V sure@ you are actually correct 21V of the ti-e...
for -ost people@ this is not true +y defaultU
33
=racticing using your /urprisometer to construct a prior odds ratioF
,n each of these e8a-ples@ 'rite do'n a short na-e for the hypothesis +eing considered and an
alternati5e@ as in <rill I1. )our prior is 'hat you 'ould ha5e e8pected +efore seeing the e5idence@ and
'hat odds youAd gi5e to that e8pectation. )ou -ay use the techniBues listed a+o5e to help you decide
your prior.
1. Example: 4he restaurant canKt +e good@ or it 'ould +e -ore cro'ded.
# good F not good $
=rior odds I #% F 1$
9This means you think that good restaurants are a,out K times more common than ,ad ones.:
%. ]A specific friend^ enHoyed this +ook@ therefore , 'ill@ too.
!rior odds _
3. A 5olunteer fro- the ca-paign 5isited -eG thatKs e5idence that theyKre 'ell0organiFed.
!rior odds _
;. ,K- 5ery good at this su+Hect@ so -y lo' test score -ust -ean there 'as a Scantron error.
!rior odds _
.. My car keys are -issing@ +ecause -y kids hid the-.
!rior odds _
. , +elie5e sheKs telling the truth@ +ecause she didnKt look a'ay 'hen she told -e.
!rior odds _
2. My friend hasnKt -entioned the fight again@ so heKs not angry.
!rior odds _
3. 4his candidate graduated fro- an ,5y 6eague schoolG sheKs pro+a+ly Bualified for the Ho+.
!rior odds _
3;
4uilding 4ayesian &abits @ <rill G
/trength of 7vidence
)ou can use your Surpriso-eter to help check 'hether e5idence actually supports a gi5en hypothesis@
and to gauge ho' strongly it supports that theory.
/5idence supporting a gi5en e8planation J -eans that itKs -ore likely to occur in a 'orld 'here J is
true than 'here J is false. ,t doesnKt -ean that J is necessarily the most plausi+le cause of 'hate5er
youK5e o+ser5ed.
TechniHues for using your /urprisometer to Budge /trength of 7vidence as a likelihood ratioF
,-agine the sa-e situation repeats a nu-+er of ti-es 9e.g. you go on %1 Ho+ inter5ie's@ 11 of 'hich
youKre a good -atch for and 11 of 'hich are a reach:. ,n ho' -any of the inter5ie's for 'hich youKre
'ell Bualified do you e8pect to stu-+le o5er at least one Buestion? &o' -any of the 11 for 'hich
youKre a little less Bualified?
)our internal si-ulator should flag so-e results as -ore surprising than others. So you can ho-e in on
a fuFFy esti-ate of an odds ratio 9e.g. ];0.^ ? ]02^:@ 'hich can gi5e you a sense of ho' strongly the
e5idence 9flu++ed a Buestion: supports a gi5en hypothesis 9can do this Ho+ capa+ly:
5ther tipsF
)ouKre trying to trigger a strong intuiti5e@ Syste- "ne reaction@ so re-e-+er to +e vivid and specific.
/sti-ates can +e helpful@ e5en if theyKre fuFFy. )ou can use ranges here@ Hust as you used orders of
-agnitude 'hen esti-ating priors.
,f thereKs a large disparity +et'een your tallies in the t'o cases@ the e5idence is strongG if theyKre close
to e5en@ the e5idence is 'eak 9B.5. the section on *ayes 'ithout nu-+ers:.
3.
=racticing using your /urprisometer to Budge /trength of 7vidence as a likelihood ratioF
Ro ,ack over the list of propositions, and try to estimate an odds ratio ,y checking how often you
expect to see this piece of evidence appear when the hypothesis is true and when it.s false. (fter you
finish the list, compare to the previous page to see if the magnitude of your ratings varied, depending
what method you used.
1. Example: 4he restaurant canKt +e good@ or it 'ould +e -ore cro'ded.
/5idence? Lnot cro'dedM
Qualitati5e strength
of e5idence? 'eak@ for Lnot goodM "R
9 good ? not good:
6ikelihood ratio _ 91V ? 31V:
_ 93 ? ;:
2. ]A specific friend^ enHoyed this +ook@ therefore , 'ill@ too.
3. A 5olunteer fro- the ca-paign 5isited -eG thatKs e5idence that theyKre 'ell0organiFed.
;. ,K- 5ery good at this su+Hect@ so -y lo' test score -ust -ean there 'as a Scantron error.
.. My car keys are -issing@ +ecause -y kids hid the-.
. , +elie5e sheKs telling the truth@ +ecause she didnKt look a'ay 'hen she told -e.
2. My friend hasnKt -entioned the fight again@ so heKs not angry.
3
3. 4his candidate graduated fro- an ,5y 6eague schoolG sheKs pro+a+ly Bualified for the Ho+.
9. 4his candidate stu-+led o5er a Buestion in the inter5ie'G sheKs pro+a+ly not Bualified.
11. 4his candidate has pre5iously 'orked in this fieldG sheKs pro+a+ly Bualified for the Ho+.
32
4uilding 4ayesian &abits @ <rill G%
4ayes( altogether
6inally, we put the first two steps of #ayes together ::: the prior and the likelihood ratio ::: for form
our new ,elief, called the posterior.
1. Example: 4he restaurant canKt +e good@ or it 'ould +e -ore cro'ded.
9 good ? not good:
!rior odds? _ 93 ? 1:
/5idence? Dnot cro'dedD
6ikelihood ratio _ 91V ? 31V:
_ 93 ? ;:
!osterior? _ 93`3 ? 1`;:
_ 99 ? ;:
a 9% ? 1:
2. ]A specific friend^ enHoyed this +ook@ therefore , 'ill@ too.
3. A 5olunteer fro- the ca-paign 5isited -eG thatKs e5idence that theyKre 'ell0organiFed.
;. ,K- 5ery good at this su+Hect@ so -y lo' test score -ust -ean there 'as a Scantron error.
.. My car keys are -issing@ +ecause -y kids hid the-.
. , +elie5e sheKs telling the truth@ +ecause she didnKt look a'ay 'hen she told -e.
33
2. My friend hasnKt -entioned the fight again@ so heKs not angry.
3. 4his candidate graduated fro- an ,5y 6eague schoolG sheKs pro+a+ly Bualified for the Ho+.
9. 4his candidate stu-+led o5er a Buestion in the inter5ie'G sheKs pro+a+ly not Bualified.
10. 4his candidate has pre5iously 'orked in this fieldG sheKs pro+a+ly Bualified for the Ho+.
39
5ptionalF 2sing your /urprisometer for 4ayes 'ithout numbers
Surprise +eha5es a lot like the logarith- of pro+a+ility. 4he ad5antage of thinking entirely in ter-s of
surprise affects is that this process can +eco-e 5ery instincti5e and take on the order of a second or so.
4his is the kind of 11second 4ayes discussed in the outline. &ereAs 'hat the steps look like 'hen
co-+ined@ for the restaurant e8a-ple a+o5e?
;1
Without the instructions 'ritten in@ the thought process looks a +it si-pler?
;1
=racticing using your /urprisometer to construct a prior as a surprisal differenceF
,n each of the follo'ing e8a-ples@ 'rite do'n a short na-e for the hypothesis +eing considered and an
alternati5e@ as in <rill I1. )our prior is that you 'ould ha5e e8pected +efore seeing the e5idence@ and
'hat odds youAd gi5e to that e8pectation )ou -ay use the techniBues listed a+o5e to help you decide
your prior.
1. Example: 4he restaurant canKt +e good@ or it 'ould +e -ore cro'ded.
9This means your -urprisometer thinks good restaurants are more
common than ,ad ones.:
%. A 5olunteer fro- the ca-paign 5isited -eG thatKs e5idence that theyKre 'ell0organiFed.
3. ,K- 5ery good at this su+Hect@ so -y lo' test score -ust -ean there 'as a Scantron error.
;. My car keys are -issing@ +ecause -y kids hid the-.
;%
.. , +elie5e sheKs telling the truth@ +ecause she didnKt look a'ay 'hen she told -e.
. My friend hasnKt -entioned the fight again@ so heKs not angry.
2. 4his candidate graduated fro- an ,5y 6eague schoolG sheKs pro+a+ly Bualified for the Ho+.
;3
&o' to use your /urprisometer to Budge /trength of 7vidence as a surprisal difference
1 ,-agine you knew that your hypothesis 'as true 9you like the +ook:. Would it +e surprising to find out
that you sa' the e5idence that you o+ser5ed 9that your friend liked it@ too:?
2 ,-agine you knew that your hypothesis 'as false 9you donKt like the +ook:. Would it +e surprising to
find out that you sa' the e5idence that you o+ser5ed 9that your friend liked it@ too:?
3 Co-pare ho' far out on your surprise0o0-eter each of these hypotheticals fall.
a ,f thereKs a large disparity@ the e5idence is stronger.
b ,f the gap is s-all@ the e5idence is weaker.
4 ,t could +e that youKd +e very surprised to see this e5idence in either case. Whether or not intelligent
aliens e8ist@ youKd +e surprised to +e personally contacted. *ut the gap is large@ e5en though +oth
scenarios are une8pected.
;;
=ractice using your /urprisometer to Budge /trength of 7vidence as a surprisal difference:
*magine you knew the hypothesis was true. O =ow surprising would it ,e to have o,served this
evidence" =ow surprised would you ,e to see it if the hypothesis were definitely false" +ompare your
surprise gap to 3udge whether this evidence is strong, moderate, or weak. %hen you.ve rated them all,
check if propositions in the same category feel similar, or if you want to su,divide your ratings.
1. 4he restaurant canKt +e good@ or it 'ould +e -ore cro'ded.
9This means you are more surprised
when a good restaurant turns our to
,e not crowded than when a ,ad
restaurant turns out to ,e more
crowded.:
2. ]A specific friend^ enHoyed this +ook@ therefore , 'ill@ too.
3. A 5olunteer fro- the ca-paign 5isited -e? thatKs e5idence that theyKre 'ell0organiFed.
;. ,K- 5ery good at this su+Hect@ so -y lo' test score -ust -ean there 'as a Scantron error.
;.
.. My car keys are -issing@ +ecause -y kids hid the-.
. , +elie5e sheKs telling the truth@ +ecause she didnKt look a'ay 'hen she told -e.
2. My friend hasnKt -entioned the fight again@ so heKs not angry.
3. 4his candidate graduated fro- an ,5y 6eague schoolG sheKs pro+a+ly Bualified for the Ho+.
9. 4his candidate stu-+led o5er a Buestion in the inter5ie'G sheKs pro+a+ly not Bualified.
;
=ractice using your /urprisometer to form a =osterior as a surprisal difference
*magine you knew the hypothesis was true. O =ow surprising would it ,e to have o,served this
evidence" =ow surprised would you ,e to see it if the hypothesis were definitely false" +ompare your
surprise gap to 3udge whether this evidence is strong, moderate, or weak. %hen you.ve rated them all,
check if propositions in the same category feel similar, or if you want to su,divide your ratings.
1. Example: 4his restaurant canKt +e good@ or it 'ould +e -ore cro'ded.
2. ]A specific friend^ enHoyed this +ook@ therefore , 'ill@ too.
3. A 5olunteer fro- the ca-paign 5isited -e? thatKs e5idence that theyKre 'ell0organiFed.
;. ,K- 5ery good at this su+Hect@ so -y lo' test score -ust -ean there 'as a Scantron error.
;2
.. My car keys are -issing@ +ecause -y kids hid the-.
. , +elie5e sheKs telling the truth@ +ecause she didnKt look a'ay 'hen she told -e.
2. My friend hasnKt -entioned the fight again@ so heKs not angry.
3. 4his candidate graduated fro- an ,5y 6eague schoolG sheKs pro+a+ly Bualified for the Ho+.
;3
=ractice choosing 'hat evidence to seek
1ick K of the examples from the previous list. Try to come up with a different piece of evidence that
would ,e stronger evidence for the given hypothesis. ?se either likelihood ratios or surprisal
differences to compare your assessments of strength of evidence.
1ick K of the examples from the previous list. Try to come up with a different piece of evidence that
would ,e 'eaker evidence for the given hypothesis. ?se either the 2ualitative or 2uantitative exercises
to compare your assessments of strength of evidence.
;9
4uilding 4ayes &abits @ 0urther
Resources
"nce a person has a theory in -ind that e8plains 'hy so-ething happened@ they tend to gi5e too -uch
'eight to that theory and not pay enough attention to alternati5e hypotheses. Research on the
Lunpacking effectM@ for e8a-ple@ has found that people tend to o5eresti-ate the likelihood of possi+le
e8planations that they ha5e e8plicitly considered@ and underesti-ate the likelihood that so-e other
unstated e8planation is correct 945ersky [ Poehler@ 199;:.
45ersky@ A.@ [ Poehler@ <.Y. 9199;:. Support theory? A none8tensional representation of
su+Hecti5e pro+a+ility. 1sychological &eview@ 111@ .;2#.2.
http?EEgoo.glEoJ>F>
4he first e8planation that a person considers can ha5e a disproportionate effect on the conclusions that
they reach@ +ecause oneKs attention and reasoning are often guided +y the +est0a5aila+le0theory 'hich is
at hand. 4his leads to se5eral related +iases in ho' people interpret infor-ation and test their
hypotheses@ 'hich are for-s of confir-ation +ias.
http?EEen.'ikipedia.orgE'ikiEConfir-ationZ+ias
,ntentionally considering alternati5e e8planations and i-agining 'hat you 'ould see if they 'ere true
is an instance of the strategy called Lconsider the oppositeM@ 'hich is one of the de+iasing techniBues
'ith the strongest e-pirical support for countering confir-ation +ias and other cogniti5e +iases
96arrick@ %11;:.
6arrick@ R. !. 9%11;:. <e+iasing. ,n <. Y. Poehler [ >. &ar5ey 9/ds.:@ #lackwell =and,ook of
Cudgment and !ecision 5aking 9pp. 310332:. "8ford? (P.
http?EEgoo.glEner*h
/5aluating the strength of the e5idence is one co-ponent of *ayesK theore-@ 'hich is the -athe-atical
rule for ho' to reason under uncertainty. An online e8planation of *ayesK theore-@ including a gradual
introduction to the -ath in5ol5ed?
/lieFer )udko'sky@ LAn ,ntuiti5e /8planation of *ayesA 4heore-M
http?EEyudko'sky.netErationalE+ayes
*ase rate neglect 9the under'eighting of prior pro+a+ilities@ such as the fact that there are -ore
+usiness -aHors than -ath -aHors: is a co--on error of pro+a+ilistic reasoning@ as people tend to pay
too -uch attention to the salient piece of e5idence and neglect their +ackground kno'ledge. A re5ie'
article on heuristics and +iases research@ including +ase rate neglect?
Pahne-an@ <. 9%113:. A perspecti5e on Hudg-ent and choice? Mapping +ounded rationality.
A-erican !sychologist@ .3@ 9202%1.
.1
http?EEtinyurl.co-Ekahne-an%113
Concretely i-agining a scenario as if it is near0at0hand can allo' people to -ake use of infor-ation in
their -inds 'hich they do not access 'hen thinking -ore a+stractly a+out the e5ent. Research on
Construal 6e5el 4heory has docu-ented ho' peopleKs thoughts a+out an e5ent 5ary 'ith psychological
distance?
4rope@ ).@ [ 6i+er-an@ >. 9%111:. Construal le5el theory of psychological distance.
1sychological &eview@ 112@ ;;10;3.
http?EEpsych.nyu.eduEtropeE4ropeZ6i+er-anZ%111.pdf
"ne line of research sho'ing the +enefits of thinking a+out an e5ent as if it is near0at0hand has 5aried
'hether the e5ent actually is near0at0hand. (nrealistic opti-is- a+out oneKs perfor-ance is co--on
for e5ents that are hypothetical or far in the future@ +ut people +eco-e -ore realistic a+out tasks that
they are a+out to perfor-. 9Ar-or [ Sackett@ %11:.
Ar-or@ <. A.@ [ Sackett@ A. M. 9%11:. Accuracy@ error@ and +ias in predictions for real 5ersus
hypothetical e5ents. Yournal of !ersonality and Social !sychology@ 91@ .33#11.
http:HHgoo.glHDos%F
.1
3our 6nner /imulator
When you -o5e to catch a falling pen +efore you co-pute the para+ola itKs tracing out or 'hen you
notice a friend is upset Hust +y the 'ay they enter the roo- 9e5en if you couldnKt e8plain how you
noticed:@ youKre using your ,nner Si-ulator.
4his unit 'ill help you learn?
When to trust this kind of intuition@ and
&o' you can harness it to sol5e the pro+le-s itKs +est suited for.
So@ 'hat is your ,nner Si-ulator and 'hat does it do?
6nner /imulator 7xplicit/>erbal ?odels
!art of Pahne-anKs Syste- 1 !art of Pahne-anKs Syste- %
Called OanticipationsK on 6ess Wrong
9pro-pts fear 'hen dog enters the roo-:
Called OprofessionsK on 6ess Wrong
9e.g. L, +elie5e the dog is safeM:
6earns 'ell +y 'atching@ storing up e8a-plesG
-ust +e sho'n ho'@ not told ho'
6earns 'ell fro- te8t+ooks@ statistics@ Wikipedia
Good at social Hudg-ent and other situations
'here you ha5e a lot of e8perience
Good at noticing eBui5alences and refra-es
9e.g. R1 E day and R3. E year are eBui5alent:
=ulnera+le to gi5ing different ans'ers
depending on ho' Buery is fra-ed
=ulnera+le to distortion +y 'ishful thinking@
ideology
-o, make sure you.re accessing your *nner -imulator using the kinds of prompts that it.s good at
answeringL You can imagine your -imulator as a piece of hardware that has a couple ,uilt in functions
you can pass information. =ere are three useful functions:
.%
Start-a-movie: What happens next?
*nput: =isualiFe the +eginning of a scenario@ 5i5idly
Output: What does your si-ulator see happening ne8t?
/8a-ples?
Input: A laptop placed 1V of the 'ay off the ta+le.
Output?
Input: ,-agine lifting a piece of 'ater-elon to your -outh and taking a +ite.
Output?
Input: !icture sneaking up on a friend at their desk. )ou take ai- 'ith your 'ater gun and pull
the trigger.
Output?
Surprise-o-meter: How surprised do I feel?
*nput: =isualiFe a scenario fro- start to finish
Output: &o' surprised do you feel? &o' -uch dis+elief are you suspending?
/8a-ples?
Input: )ouKre trying to figure out ho' -uch food to +uy for a party to 'hich %. people
RS=!Kd. =isualiFe %1 people sho'ing up.
Output?
Input: =isualiFe 21 people sho'ing up to the party in the pre5ious e8a-ple.
Output?
Input: ,-agine you finished a specific current proHect in less than half the ti-e youK5e allotted
for yourself.
Output?
Input: ,-agine you find out that in three -onths you ha5enKt -ade any deli+erate use of your
,nner Si-ulator.
Output?
Your surprise:o:meter is discussed more in the #ayes unit.
.3
re-hindsight: What went right!wrong?
*nput: ,-agine finding out 9in a -essage fro- the future: 'hether a proHect succeeded or not
Output: What e8planation leaps to -ind a+out 'hy this happened?
/8a-ples?
Input: 4hink of a specific e-ail you plan to send in the ne8t fe' days. ,-agine you find out
tomorrow that the e-ail youKre a+out to send ticked off the recipient.
Output?
Input: ,-agine you get a 5isit fro- you0fro-0the0future 'ho tells you to -ake sure you stay at
your current Ho+ for the ne8t year@ thanks you 'ar-ly@ and then 5anishes.
Output?
Input: ,-agine you find out that in three -onths you ha5enKt -ade any deli+erate use of your
,nner Si-ulator.
Output?
.;
"eing Specific: #a$ing the "est %se of &our Inner Simulator
4hese are three 'ays you can -ake function calls on your ,nner Si-ulator@ +ut ho' can you -ake sure
youKre passing it the +est inputs? )our ,nner Si-ulator is especially good at +eing a check on 'ishful
thinking or 'hat you feel like you ought to +elie5e@ +ut you need to -ake sure your e8plicitE5er+al
-odels arenKt rigging the ga-e +y phrasing Buestions the 'rong 'ay.
*y +eing specific@ concrete@ and 5i5id@ you can -ostly a5oid getting stuck in Gar+age ,n@ Gar+age "ut.
4he (sk for ExamplesL and 0ext (ctions skills 'ill help.
.sk for 7xamples9
$or a concrete e8a-ple of using e8a-ples@ try this story fro- -urely You.re Coking, 5r. 6eynmanL
, had a sche-e@ 'hich , still use today 'hen so-e+ody is e8plaining so-ething that ,A- trying to
understand? , keep -aking up e8a-ples. $or instance@ the -athe-aticians 'ould co-e in 'ith a
terrific theore-@ and theyAre all e8cited. As theyAre telling -e the conditions of the theore-@ ,
construct so-ething 'hich fits all the conditions. )ou kno'@ you ha5e a set 9one +all: 0 disHoint
9t'o +alls:. 4hen the +alls turn colors@ gro' hairs@ or 'hate5er@ in -y head as they put -ore
conditions on. $inally they state the theore-@ 'hich is so-e du-+ thing a+out the +all 'hich isnAt
true for -y hairy green +all thing@ so , say@ D$alseUD
,f itAs true@ they get all e8cited@ and , let the- go on for a 'hile. 4hen , point out -y
countere8a-ple.
D"h. We forgot to tell you that itAs Class % &ausdorff ho-o-orphic.D
)our inner si-ulator needs so-ething to 5isualiFe. Yust saying so-ething as 'ords isnKt enough. )ou
'ant so-ething specific that your i-agination can interact 'ith. )ou can ask yourself for e8a-ples@
tooU
Asking for e8a-ples is a really handy thing to do in con5ersation. When you keep your ,nner
Si-ulator engaged during a con5ersation@ and keep feeding it data@ you -ight notice that itKs easier to?
1. 0otice if your friend.s claim is false # Yust like $eyn-an@ you -ay +e a+le to notice where the
error is@ instead of Hust ha5ing a 5ague sense of so-ething not adding up if youKre concrete.
%. 0otice if you.re misunderstanding your friend # When 'e listen to so-eone else@ 'e try to
appro8i-ate and anticipate 'hat theyKre e8plaining. ,f you ask for e8a-ples fro- your friend@
you can see if youK5e +een accidentally adding or lea5ing out e8traneous features on yours.
3. 0otice if youKre the one who.s wrong # ,tKs easy to a5oid noticing if youK5e -ade a -istakeG itKs
painfulU 4he -ore concrete your disagree-ent is@ the easier it is to notice if thereKs a fla' in
your o'n argu-ent and to o'n up to it.
..
,ext .ctions
A goal isnKt the sa-e thing as a plan. , -ight ha5e the goal of e8ercising -ore@ +ut to ha5e a plan ,
need to think a+out 'hen ,Kll go to the gy-@ 'hat ,Kll do@ and ho' ,Kll re-e-+er in the -o-ent.
*ut +efore , get up to any of those parts of the plan@ ,Kll need to take -y next action, 'hich -ight +e
printing out -y gy- coupon or setting a re-inder in -y calendar or choosing a ti-e to go +uy 'orkout
clothes. A next action is the step that sets your plan in -otion. ,tKs the first thing youKd ha5e to do to
keep the plan going@ 'hich is often as pedestrian as putting so-ething on your calendar or placing a
li+rary hold or asking so-eone to ha5e coffee to talk o5er the plan. "ften@ 'hen youKre deciding on a
ne8t action@ itKs helpful to think a+out a trigger # so-e specific e5ent or ti-e that re-inds you to do
your ne8t action 9such as .p- 4uesday@ or 'hen -y +oss returns -y e-ail@ or 'hen , 'ake up
to-orro' -orning :
%rite down one goal you have Ja larger scale thing you want to accomplishI:
Take a few minutes to think a,out your plan to make this goal happen. %hat.s the next action you need
to take to get the plan moving"
%hat specific trigger will let you know when it.s time to complete this next action"
0ow practice going through this process a few more times:
Roal:
0ext action:
Trigger:
Roal:
0ext action:
Trigger:
.
Inner Simulator ractice: #urph'(itsu)
MurphyKs 6a' says that anything that can go 'rong 'ill go 'rong@ +ut you can use so-e of the skills
and safeguards youK5e learned for your ,nner Si-ulator to anticipate and e5ade these haFards.
-tep ;: 1ick a planHpro3ectHgoal
-tep F: 5ake it specific enough to visuali'e.
WhatKs the ne8t action you 'ould need to take to keep this proHectEplan -o5ing for'ard? ,t should +e
concrete enough that you can picture yourself doing it@ not so-ething 5ague like L'ork out -ore.M
-tep K: +heck your surprise:o:meter
=isualiFe putting this plan in -otion@ then ask@ ho' surprised 'ould , +e if this plan failed? ,f youKd +e
shocked@ then youKre doneU "ther'ise@ continue to step ;.
-tep E: ?se 1re:=indsight
)our plan didnKt 'orkU And it failed at the stage of the ne8t action you 'rote in Step %U What
happened?
-tep B: ?se $ooking 6orward
What action 'ould you ha5e had to take to pre5ent this particular failure -ode? =isualiFe taking this
pree-pti5e action and then ask LWhat co-es ne8t?M &a5e you successfully defused the danger? <id
you create a ne' 'eak point to patch?
-tep S: *terateL
Repeat Steps 30. se5eral ti-es 9so-eti-es this techniBue is called LSi-ulate 12 ti-es@ act onceM:.
What else -ight ha5e gone 'rong? What could ha5e pre5ented it? )ouKre +attle0hardening your plan
against happenstance and poor ha+its. Re-e-+er that this should +e 5ery Buick # all L12M iterations
should take -ay+e a fe' -inutes total.
.2
3our 6nner /imulator @ 0urther
Resources
Pahne-an and 45ersky 9193%: proposed that people often use a si-ulation heuristic to -ake
Hudg-ents. Mental si-ulation of a scenario is used to -ake predictions +y i-agining a situation and
then running the si-ulation to see 'hat happens ne8t@ and it is also to gi5e e8planations for e5ents +y
-entally changing prior e5ents and seeing if the outco-es changes.
Pahne-an@ <. [ 45ersky@ A. 9193%:. 4he si-ulation heuristic. ,n <. Pahne-an@ !. Slo5ic@ [ A.
45ersky 9eds.: Cudgment under uncertainty: =euristics and ,iases 9pp. %110%13:.
Research on -ental si-ulation has found that i-agining future or hypothetical e5ents dra's on -uch
of the sa-e neural circuitry that is used in -e-ory. 4he ease 'ith 'hich a si-ulated scenario is
generated often see-s to +e used as a cue to the likelihood of that scenario. $or a re5ie'@ see?
SFpunar@ P.P. 9%111:. /pisodic future thought? An e-erging concept. 1erspectives on
1sychological -cience@ B@ 1;%01%.
http?EEgoo.glEg1>>,
L$ocusingM is a practice of introspection syste-atiFed +y psychotherapist /ugene Gendlin 'hich seeks
to +uild a path'ay of co--unication and feed+ack +et'een a personKs Lfelt senseM of 'hat is going on
9an internal a'areness 'hich is often difficult to articulate: and their 5er+al e8planations. ,t can +e
understood as a -ethod of Buerying oneKs inner si-ulator 9and related parts of Syste- 1:. GendlinKs
9193%: +ook 6ocusing pro5ides a guide to this techniBue@ 'hich can +e used either indi5idually or 'ith
others 9in therapy or other de+ugging con5ersations:.
Gendlin@ /ugene 9193%:. 6ocusing. Second edition@ *anta- *ooks.
http?EEen.'ikipedia.orgE'ikiE$ocusing
4he idea of identifying the concrete Lne8t actionM for any plan 'as de5eloped +y <a5id Allen in his
+ook Retting Things !one.
Allen@ <a5id 9%111:. Retting Things !one: The (rt of -tress:6ree 1roductivity.
http?EEen.'ikipedia.orgE'ikiEGettingZ4hingsZ<one
Mitchell@ Russo@ and !ennington 91939: de5eloped the techniBue 'hich they called Lprospecti5e
hindsight.M 4hey found that people 'ho i-agined the-sel5es in a future 'orld 'here an outco-e had
already occurred 'ere a+le to think of -ore plausi+le paths +y 'hich it could occur@ co-pared 'ith
people 'ho -erely considered the outco-e as so-ething that -ight occur. <ecision -aking
researcher Gary Plein has used this techniBue 'hen consulting 'ith organiFations to run Lpre-orte-sM
on proHects under consideration? assu-e that the proHect has already happened and failedG 'hy did it
fail? PleinKs 9%112: t'o0page article pro5ides a useful su--ary of this techniBue.
Mitchell@ <.@ Russo@ Y.@ [ !ennington@ >. 91939:. *ack to the future? 4e-poral perspecti5e in
.3
the e8planation of e5ents. Cournal of #ehavioral !ecision 5aking@ F@ %.#33.
http?EEgoo.glEG)Whg
Plein@ G. 9%112:. !erfor-ing a proHect pre-orte-. =arvard #usiness &eview@ PB@ 13019.
http?EEh+r.orgE%112E19Eperfor-ing0a0proHect0pre-orte-EarE1
.9
7motional Re1.ssociation
4rainstorming a 'ish list of emotions
$or each ro' in the ta+le +elo'@ think of?
1. A target situation 'here you -ight like to change ho' you feel 9+onus points if itAs a recurring
situation:.
Example: (lice forgets to send me some documents * asked her for.
%. 4he e-otion or e-otions J youAd typically feel in that situation.
Example: *ndignation... it feels like something is unfair...
3. A possi+le ne' e-otion ) youAd like to feel instead.
Example: (mused... some people find (lice funny... could * ,e amused ,y the situation
instead"
&int? it -ight help to think of so-eone else 'ho reacts differently than you. &o' -ight
they feel differently fro- you?
;. A situation that inspiresEcauses you to feel the ne' e-otion ).
Example: %hen my friend #o, forgets things, * find it funny and forgive him.
9lea5e the L!ri-ary affectsM section +lank unless 'eA5e discussed the- first.:
1. 4arget situation %. 4ypical e-otion 9J: 3. >e' e-otion 9): ;. Situation inspiring )
Example: (lice doesn4t
send me those
documents.
*ndignation... feels like
something is unfair...
!ri-ary affects?
&(RE
(musement"
!ri-ary affects?
1$(Y
%hen my little cousin
drops his toys.
!ri-ary affects? !ri-ary affects?
!ri-ary affects? !ri-ary affects?
9lea5e the L!ri-ary affectsM section +lank unless 'eA5e discussed the- first:
1
1. 4arget situation %. 4ypical e-otion 9J: 3. >e' e-otion 9): ;. Situation inspiring )
!ri-ary affects?
&(RE
!ri-ary affects?
1$(Y
!ri-ary affects? !ri-ary affects?
!ri-ary affects? !ri-ary affects?
Tips if you get stuckF
4ry +ro'sing this list of e-otions taken fro- Wikipedia?
Anger
Annoyance
,rritation
$rustration
Conte-pt
<isgust
$ear
<ou+tful
Worried
An8ious
&elplessness
!o'erlessness
Sadness
<isappoint-ent
/-+arrass-ent
Sha-e
Guilt
/n5y
Arousal
Cra5ing
Curiosity
,nterest
Surprise
6ust
Caring
6o5e
Affection
$riendliness
Courage
&ope
Cal-
Content-ent
Rela8ation
Relief
Serenity
4rust
&appiness
A-use-ent
/8cite-ent
<elight
!ride
Yoy
,f 'eA5e already discussed Lpri-ary e-otional affectsM@ try focussing on those?
RAG/ S//P,>G <isgust?
$/AR CAR,>G Surprise?
6"SS 6(S4
!6A)
1
Cultivating a ne' emotion
/tep 1F =ick an emotion to cultivate
,dentify a ne' e-otion that could help you in so-e 'ay. ,t could +e one you chose in your 'ish list@ or
so-ething different.
Tips if you get stuckF
Consider the +asic e-otions discussed +y !anksepp and others?
RAG/ S//P,>G <isgust?
$/AR CAR,>G Surprise?
6"SS 6(S4
!6A)
4ry to temporarily suspend appraisal@ i.e. try not to assign Hudg-ent or appro5al to yourself@
your e-otions@ your situation@ or other people. 4hink of things as they are@ in ter-s of cause
and effect@ rather than in ter-s of DshouldD or DoughtD.
/tep F :ook for an inspiration
Examples ,elow are for 1$(Y:
1. What are so-e specific situations that cause or inspire you to feel )?
Example: %hen my nephew takes something from me and * chase after him, * feel playful.
%. Are there any songs( books( movies( or historical events that -ake you feel )?
Example: %hen * feel really wrapped up in some deep philosophical 2uestion, remem,ering the
movie * =eart =ucka,ees makes me feel more playful a,out it.
%
/tep %F Cognition/emotion associations
4hink of the ne' e-otion ) that you 'ant to culti5ate@ and +uild your a'areness of 'hat -ental
associations you ha5e 'ith it.
9$or no'@ donAt think a+out 'here you 'ant to culti5ate itG instead Hust focus on the e-otion itself.:
1. What does feeling ) already help you do?
Example: * find it easier to ,rainstorm new ideas and try new things when * feel playful.
%. When you feel )@ 'hat are so-e things you -ight think?
Example: Tee hee, this is awesome.
3. What -ight you say?
Example: Oh man, what if we...
;. &o' can you tell 'hen other people -ight +e feeling )? <oes that gi5e you -ore ideas for the
Buestions a+o5e?
Example: They smile more, and may,e they seem a little ,ouncy"
3
/tep %F 4ody/emotion associations
Peep thinking a+out the e-otion ) that you 'ant to culti5ate@ and no' +uild your a'areness of
physical associations 'ith it.
Examples ,elow are for the -EE>*0R affect:.
1. What physical environments or situations increase your likelihood of feeling )?
Example: when *4m outdoors and exploring places, * feel -EE>*0R, like * know there4s something
interesting to ,e found.
%. Where in your body do you feel )@ and ho'?
Example: in my forehead and eye,rows, and may,e my hands.
3. What physical movements are you inclined to -ake 'hen you feel )?
Example: forward movements like reaching, learning, and walking, peering, tilting my head...
;. What happens to your voice 'hen you feel )?
Example: * think * speak faster, with more staccato, and end with more upward inflexions.
.. <oes ) re-ind you of a te8ture? 4e-perature? Color? Anything else?
Example: 5y environment feels crisp and open, like stars at night7 f* also feel like *4m ,eing pulled,
directed, and am reminded of the colors ,lue and orange.
;
/tep )F :ook for lo'1hanging fruit
What are so-e situations in your life 'here you donAt feel )@ +ut 'here it -ight +e helpful and not too
difficult?
Example: * could feel more -EE>*0RHcuriosity when *4m talking to others a,out their work.
>o' choose a target situation 'here you feel minimal resistance to feeling ). 4o get started@ 'e 'ant
to ai- for easy e-otional shifts@ not difficult ones. May+e one of the target situations fro- your 'ish
list see-s like lo' hanging fruit@ +ut if it doesnAt@ try to think of an easier application to 'ork on first.
/tep +F Re1associate
4hink +ack to the situations that naturally inspire ) for you. >o' ask yourself?
%hat can * do to approach my target situation more like my inspiring situation"
1. Change the situationA
Example: * could listen to some music that would make me feel silly and less irrita,le. (nd * can
avoid talking to #o, right ,efore dinner, when * tend to ,e cranky.
%. Reframe your thoughtsA
Example: 5ay,e if * think of #o, a little more as not knowing any ,etter, * might find his 2uirks
funny and endearing instead of annoying, sort of the way * tend to see my little ,rother.
3. ?ove your body differentlyA
Example: * tend to cross my arms when *4m feeling 3udgmental... if * can uncross my arms as a
reminder, * might feel a little ,it like *4m ,reaking my pattern of 3udgment towards #o,.
Circle your fa5orite ideas a+o5e so you can co-e +ack to the- later and try the- outU
.
2nit ,otesF 7motional Re1.ssociation
,A5e +egun to think of each of -y units as organiFed around a method 000 a useful -ental procedure or
-o5e-ent 000 along 'ith so-e tools that can +e used as part of the -ethod.
4he method of this unit 'ill +e designing and implementing changes in how our emotions work@ 'hich
, like to call D/-otional Re0associationD. ,tAs like refra-ing@ +ut in5ol5es +odily associations as 'ell.
,n +road +rush0strokes@ the -ethod is this?
7motional Re1.ssociationF The ?ethod
1. Choose a recurring situation or thought J a+out 'hich you -ight 'ant
to try t'eaking your e-otions.
%. Choose a ne' emotion you could try feeling instead.
3. Think of other situations 'here you already feel that ne' e-otion.
;. Reflect on ho' you think/feel/speak/act/etc. in the those other situations@
5s in the recurring situation fro- step 1.
.. 2se 11) as inspiration for ne' 'ays to
change your situation@
refra-e your thoughts@ and
-o5e your +ody
in 'ays that -ight culti5ate the desired e-otion.
A nu-+er of concepts and techniBues 'ill +e presented as tools for doing this@ 'hich can +e generally
useful on their o'n?
7motional Re1.ssociationF The Tools
A +asic understanding of ho' e-otions physically 'ork in the +rain and
the +ody
A list of se5en pri-ary e-otional affects
Questions for pro+ing your e-otional associations
Situational changes
Mental refra-es
!hysical -o5e-ents